Test Report: Docker_Linux_crio_arm64 19696

                    
                      60137f5eb61dd17472aeb1c9d9b63bd7ae7f04e6:2024-09-24:36347
                    
                

Test fail (3/327)

Order failed test Duration
33 TestAddons/parallel/Registry 74.24
34 TestAddons/parallel/Ingress 153.51
36 TestAddons/parallel/MetricsServer 332.84
x
+
TestAddons/parallel/Registry (74.24s)

                                                
                                                
=== RUN   TestAddons/parallel/Registry
=== PAUSE TestAddons/parallel/Registry

                                                
                                                

                                                
                                                
=== CONT  TestAddons/parallel/Registry
addons_test.go:328: registry stabilized in 10.589425ms
addons_test.go:330: (dbg) TestAddons/parallel/Registry: waiting 6m0s for pods matching "actual-registry=true" in namespace "kube-system" ...
helpers_test.go:344: "registry-66c9cd494c-vx6hr" [2d03a897-de38-4010-b9d3-7e455400c58d] Running
addons_test.go:330: (dbg) TestAddons/parallel/Registry: actual-registry=true healthy within 5.003611448s
addons_test.go:333: (dbg) TestAddons/parallel/Registry: waiting 10m0s for pods matching "registry-proxy=true" in namespace "kube-system" ...
helpers_test.go:344: "registry-proxy-9jrvf" [1cea29a0-a418-43ce-8a72-6439715dfdb4] Running
addons_test.go:333: (dbg) TestAddons/parallel/Registry: registry-proxy=true healthy within 5.004011877s
addons_test.go:338: (dbg) Run:  kubectl --context addons-371349 delete po -l run=registry-test --now
addons_test.go:343: (dbg) Run:  kubectl --context addons-371349 run --rm registry-test --restart=Never --image=gcr.io/k8s-minikube/busybox -it -- sh -c "wget --spider -S http://registry.kube-system.svc.cluster.local"
addons_test.go:343: (dbg) Non-zero exit: kubectl --context addons-371349 run --rm registry-test --restart=Never --image=gcr.io/k8s-minikube/busybox -it -- sh -c "wget --spider -S http://registry.kube-system.svc.cluster.local": exit status 1 (1m0.146157362s)

                                                
                                                
-- stdout --
	pod "registry-test" deleted

                                                
                                                
-- /stdout --
** stderr ** 
	error: timed out waiting for the condition

                                                
                                                
** /stderr **
addons_test.go:345: failed to hit registry.kube-system.svc.cluster.local. args "kubectl --context addons-371349 run --rm registry-test --restart=Never --image=gcr.io/k8s-minikube/busybox -it -- sh -c \"wget --spider -S http://registry.kube-system.svc.cluster.local\"" failed: exit status 1
addons_test.go:349: expected curl response be "HTTP/1.1 200", but got *pod "registry-test" deleted
*
addons_test.go:357: (dbg) Run:  out/minikube-linux-arm64 -p addons-371349 ip
2024/09/24 00:48:33 [DEBUG] GET http://192.168.49.2:5000
addons_test.go:386: (dbg) Run:  out/minikube-linux-arm64 -p addons-371349 addons disable registry --alsologtostderr -v=1
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:230: ======>  post-mortem[TestAddons/parallel/Registry]: docker inspect <======
helpers_test.go:231: (dbg) Run:  docker inspect addons-371349
helpers_test.go:235: (dbg) docker inspect addons-371349:

                                                
                                                
-- stdout --
	[
	    {
	        "Id": "57a8c5c845384bb63a10462f6fa297c2fd54585c86fa3de67a14d6644e9f0dd2",
	        "Created": "2024-09-24T00:35:55.003933514Z",
	        "Path": "/usr/local/bin/entrypoint",
	        "Args": [
	            "/sbin/init"
	        ],
	        "State": {
	            "Status": "running",
	            "Running": true,
	            "Paused": false,
	            "Restarting": false,
	            "OOMKilled": false,
	            "Dead": false,
	            "Pid": 1874844,
	            "ExitCode": 0,
	            "Error": "",
	            "StartedAt": "2024-09-24T00:35:55.139494316Z",
	            "FinishedAt": "0001-01-01T00:00:00Z"
	        },
	        "Image": "sha256:62002f6a97ad1f6cd4117c29b1c488a6bf3b6255c8231f0d600b1bc7ba1bcfd6",
	        "ResolvConfPath": "/var/lib/docker/containers/57a8c5c845384bb63a10462f6fa297c2fd54585c86fa3de67a14d6644e9f0dd2/resolv.conf",
	        "HostnamePath": "/var/lib/docker/containers/57a8c5c845384bb63a10462f6fa297c2fd54585c86fa3de67a14d6644e9f0dd2/hostname",
	        "HostsPath": "/var/lib/docker/containers/57a8c5c845384bb63a10462f6fa297c2fd54585c86fa3de67a14d6644e9f0dd2/hosts",
	        "LogPath": "/var/lib/docker/containers/57a8c5c845384bb63a10462f6fa297c2fd54585c86fa3de67a14d6644e9f0dd2/57a8c5c845384bb63a10462f6fa297c2fd54585c86fa3de67a14d6644e9f0dd2-json.log",
	        "Name": "/addons-371349",
	        "RestartCount": 0,
	        "Driver": "overlay2",
	        "Platform": "linux",
	        "MountLabel": "",
	        "ProcessLabel": "",
	        "AppArmorProfile": "unconfined",
	        "ExecIDs": null,
	        "HostConfig": {
	            "Binds": [
	                "/lib/modules:/lib/modules:ro",
	                "addons-371349:/var"
	            ],
	            "ContainerIDFile": "",
	            "LogConfig": {
	                "Type": "json-file",
	                "Config": {}
	            },
	            "NetworkMode": "addons-371349",
	            "PortBindings": {
	                "22/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": ""
	                    }
	                ],
	                "2376/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": ""
	                    }
	                ],
	                "32443/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": ""
	                    }
	                ],
	                "5000/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": ""
	                    }
	                ],
	                "8443/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": ""
	                    }
	                ]
	            },
	            "RestartPolicy": {
	                "Name": "no",
	                "MaximumRetryCount": 0
	            },
	            "AutoRemove": false,
	            "VolumeDriver": "",
	            "VolumesFrom": null,
	            "ConsoleSize": [
	                0,
	                0
	            ],
	            "CapAdd": null,
	            "CapDrop": null,
	            "CgroupnsMode": "host",
	            "Dns": [],
	            "DnsOptions": [],
	            "DnsSearch": [],
	            "ExtraHosts": null,
	            "GroupAdd": null,
	            "IpcMode": "private",
	            "Cgroup": "",
	            "Links": null,
	            "OomScoreAdj": 0,
	            "PidMode": "",
	            "Privileged": true,
	            "PublishAllPorts": false,
	            "ReadonlyRootfs": false,
	            "SecurityOpt": [
	                "seccomp=unconfined",
	                "apparmor=unconfined",
	                "label=disable"
	            ],
	            "Tmpfs": {
	                "/run": "",
	                "/tmp": ""
	            },
	            "UTSMode": "",
	            "UsernsMode": "",
	            "ShmSize": 67108864,
	            "Runtime": "runc",
	            "Isolation": "",
	            "CpuShares": 0,
	            "Memory": 4194304000,
	            "NanoCpus": 2000000000,
	            "CgroupParent": "",
	            "BlkioWeight": 0,
	            "BlkioWeightDevice": [],
	            "BlkioDeviceReadBps": [],
	            "BlkioDeviceWriteBps": [],
	            "BlkioDeviceReadIOps": [],
	            "BlkioDeviceWriteIOps": [],
	            "CpuPeriod": 0,
	            "CpuQuota": 0,
	            "CpuRealtimePeriod": 0,
	            "CpuRealtimeRuntime": 0,
	            "CpusetCpus": "",
	            "CpusetMems": "",
	            "Devices": [],
	            "DeviceCgroupRules": null,
	            "DeviceRequests": null,
	            "MemoryReservation": 0,
	            "MemorySwap": 8388608000,
	            "MemorySwappiness": null,
	            "OomKillDisable": false,
	            "PidsLimit": null,
	            "Ulimits": [],
	            "CpuCount": 0,
	            "CpuPercent": 0,
	            "IOMaximumIOps": 0,
	            "IOMaximumBandwidth": 0,
	            "MaskedPaths": null,
	            "ReadonlyPaths": null
	        },
	        "GraphDriver": {
	            "Data": {
	                "LowerDir": "/var/lib/docker/overlay2/e91acff4005fb62afe258fb62f9898571cc37123138239a601e3a881cbdd1e1b-init/diff:/var/lib/docker/overlay2/735dddc10109a4692c38c0935991764a2c26d0fe2b728ea40f67d848f08ebe53/diff",
	                "MergedDir": "/var/lib/docker/overlay2/e91acff4005fb62afe258fb62f9898571cc37123138239a601e3a881cbdd1e1b/merged",
	                "UpperDir": "/var/lib/docker/overlay2/e91acff4005fb62afe258fb62f9898571cc37123138239a601e3a881cbdd1e1b/diff",
	                "WorkDir": "/var/lib/docker/overlay2/e91acff4005fb62afe258fb62f9898571cc37123138239a601e3a881cbdd1e1b/work"
	            },
	            "Name": "overlay2"
	        },
	        "Mounts": [
	            {
	                "Type": "bind",
	                "Source": "/lib/modules",
	                "Destination": "/lib/modules",
	                "Mode": "ro",
	                "RW": false,
	                "Propagation": "rprivate"
	            },
	            {
	                "Type": "volume",
	                "Name": "addons-371349",
	                "Source": "/var/lib/docker/volumes/addons-371349/_data",
	                "Destination": "/var",
	                "Driver": "local",
	                "Mode": "z",
	                "RW": true,
	                "Propagation": ""
	            }
	        ],
	        "Config": {
	            "Hostname": "addons-371349",
	            "Domainname": "",
	            "User": "",
	            "AttachStdin": false,
	            "AttachStdout": false,
	            "AttachStderr": false,
	            "ExposedPorts": {
	                "22/tcp": {},
	                "2376/tcp": {},
	                "32443/tcp": {},
	                "5000/tcp": {},
	                "8443/tcp": {}
	            },
	            "Tty": true,
	            "OpenStdin": false,
	            "StdinOnce": false,
	            "Env": [
	                "container=docker",
	                "PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin"
	            ],
	            "Cmd": null,
	            "Image": "gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1727108449-19696@sha256:c662152d8855bc4c62a3b5786a68adf99e04794e7f8f374a3859703004ef1d21",
	            "Volumes": null,
	            "WorkingDir": "/",
	            "Entrypoint": [
	                "/usr/local/bin/entrypoint",
	                "/sbin/init"
	            ],
	            "OnBuild": null,
	            "Labels": {
	                "created_by.minikube.sigs.k8s.io": "true",
	                "mode.minikube.sigs.k8s.io": "addons-371349",
	                "name.minikube.sigs.k8s.io": "addons-371349",
	                "role.minikube.sigs.k8s.io": ""
	            },
	            "StopSignal": "SIGRTMIN+3"
	        },
	        "NetworkSettings": {
	            "Bridge": "",
	            "SandboxID": "6123761140dfb026c95c608d0564f7e7218831275b56b2c427350d3e2135d530",
	            "SandboxKey": "/var/run/docker/netns/6123761140df",
	            "Ports": {
	                "22/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": "34691"
	                    }
	                ],
	                "2376/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": "34692"
	                    }
	                ],
	                "32443/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": "34695"
	                    }
	                ],
	                "5000/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": "34693"
	                    }
	                ],
	                "8443/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": "34694"
	                    }
	                ]
	            },
	            "HairpinMode": false,
	            "LinkLocalIPv6Address": "",
	            "LinkLocalIPv6PrefixLen": 0,
	            "SecondaryIPAddresses": null,
	            "SecondaryIPv6Addresses": null,
	            "EndpointID": "",
	            "Gateway": "",
	            "GlobalIPv6Address": "",
	            "GlobalIPv6PrefixLen": 0,
	            "IPAddress": "",
	            "IPPrefixLen": 0,
	            "IPv6Gateway": "",
	            "MacAddress": "",
	            "Networks": {
	                "addons-371349": {
	                    "IPAMConfig": {
	                        "IPv4Address": "192.168.49.2"
	                    },
	                    "Links": null,
	                    "Aliases": null,
	                    "MacAddress": "02:42:c0:a8:31:02",
	                    "DriverOpts": null,
	                    "NetworkID": "be9e2c6d19f89ddf9ec936595a5357e0be10be979e62c375249fb6ea67bee4cf",
	                    "EndpointID": "e0512c175a378c9907b238498536bb0bcd513ef87034a8ccde9159fad0a75e37",
	                    "Gateway": "192.168.49.1",
	                    "IPAddress": "192.168.49.2",
	                    "IPPrefixLen": 24,
	                    "IPv6Gateway": "",
	                    "GlobalIPv6Address": "",
	                    "GlobalIPv6PrefixLen": 0,
	                    "DNSNames": [
	                        "addons-371349",
	                        "57a8c5c84538"
	                    ]
	                }
	            }
	        }
	    }
	]

                                                
                                                
-- /stdout --
helpers_test.go:239: (dbg) Run:  out/minikube-linux-arm64 status --format={{.Host}} -p addons-371349 -n addons-371349
helpers_test.go:244: <<< TestAddons/parallel/Registry FAILED: start of post-mortem logs <<<
helpers_test.go:245: ======>  post-mortem[TestAddons/parallel/Registry]: minikube logs <======
helpers_test.go:247: (dbg) Run:  out/minikube-linux-arm64 -p addons-371349 logs -n 25
helpers_test.go:247: (dbg) Done: out/minikube-linux-arm64 -p addons-371349 logs -n 25: (1.682869481s)
helpers_test.go:252: TestAddons/parallel/Registry logs: 
-- stdout --
	
	==> Audit <==
	|---------|--------------------------------------|------------------------|---------|---------|---------------------|---------------------|
	| Command |                 Args                 |        Profile         |  User   | Version |     Start Time      |      End Time       |
	|---------|--------------------------------------|------------------------|---------|---------|---------------------|---------------------|
	| start   | -o=json --download-only              | download-only-927064   | jenkins | v1.34.0 | 24 Sep 24 00:35 UTC |                     |
	|         | -p download-only-927064              |                        |         |         |                     |                     |
	|         | --force --alsologtostderr            |                        |         |         |                     |                     |
	|         | --kubernetes-version=v1.20.0         |                        |         |         |                     |                     |
	|         | --container-runtime=crio             |                        |         |         |                     |                     |
	|         | --driver=docker                      |                        |         |         |                     |                     |
	|         | --container-runtime=crio             |                        |         |         |                     |                     |
	| delete  | --all                                | minikube               | jenkins | v1.34.0 | 24 Sep 24 00:35 UTC | 24 Sep 24 00:35 UTC |
	| delete  | -p download-only-927064              | download-only-927064   | jenkins | v1.34.0 | 24 Sep 24 00:35 UTC | 24 Sep 24 00:35 UTC |
	| start   | -o=json --download-only              | download-only-684560   | jenkins | v1.34.0 | 24 Sep 24 00:35 UTC |                     |
	|         | -p download-only-684560              |                        |         |         |                     |                     |
	|         | --force --alsologtostderr            |                        |         |         |                     |                     |
	|         | --kubernetes-version=v1.31.1         |                        |         |         |                     |                     |
	|         | --container-runtime=crio             |                        |         |         |                     |                     |
	|         | --driver=docker                      |                        |         |         |                     |                     |
	|         | --container-runtime=crio             |                        |         |         |                     |                     |
	| delete  | --all                                | minikube               | jenkins | v1.34.0 | 24 Sep 24 00:35 UTC | 24 Sep 24 00:35 UTC |
	| delete  | -p download-only-684560              | download-only-684560   | jenkins | v1.34.0 | 24 Sep 24 00:35 UTC | 24 Sep 24 00:35 UTC |
	| delete  | -p download-only-927064              | download-only-927064   | jenkins | v1.34.0 | 24 Sep 24 00:35 UTC | 24 Sep 24 00:35 UTC |
	| delete  | -p download-only-684560              | download-only-684560   | jenkins | v1.34.0 | 24 Sep 24 00:35 UTC | 24 Sep 24 00:35 UTC |
	| start   | --download-only -p                   | download-docker-626931 | jenkins | v1.34.0 | 24 Sep 24 00:35 UTC |                     |
	|         | download-docker-626931               |                        |         |         |                     |                     |
	|         | --alsologtostderr                    |                        |         |         |                     |                     |
	|         | --driver=docker                      |                        |         |         |                     |                     |
	|         | --container-runtime=crio             |                        |         |         |                     |                     |
	| delete  | -p download-docker-626931            | download-docker-626931 | jenkins | v1.34.0 | 24 Sep 24 00:35 UTC | 24 Sep 24 00:35 UTC |
	| start   | --download-only -p                   | binary-mirror-425965   | jenkins | v1.34.0 | 24 Sep 24 00:35 UTC |                     |
	|         | binary-mirror-425965                 |                        |         |         |                     |                     |
	|         | --alsologtostderr                    |                        |         |         |                     |                     |
	|         | --binary-mirror                      |                        |         |         |                     |                     |
	|         | http://127.0.0.1:41845               |                        |         |         |                     |                     |
	|         | --driver=docker                      |                        |         |         |                     |                     |
	|         | --container-runtime=crio             |                        |         |         |                     |                     |
	| delete  | -p binary-mirror-425965              | binary-mirror-425965   | jenkins | v1.34.0 | 24 Sep 24 00:35 UTC | 24 Sep 24 00:35 UTC |
	| addons  | enable dashboard -p                  | addons-371349          | jenkins | v1.34.0 | 24 Sep 24 00:35 UTC |                     |
	|         | addons-371349                        |                        |         |         |                     |                     |
	| addons  | disable dashboard -p                 | addons-371349          | jenkins | v1.34.0 | 24 Sep 24 00:35 UTC |                     |
	|         | addons-371349                        |                        |         |         |                     |                     |
	| start   | -p addons-371349 --wait=true         | addons-371349          | jenkins | v1.34.0 | 24 Sep 24 00:35 UTC | 24 Sep 24 00:39 UTC |
	|         | --memory=4000 --alsologtostderr      |                        |         |         |                     |                     |
	|         | --addons=registry                    |                        |         |         |                     |                     |
	|         | --addons=metrics-server              |                        |         |         |                     |                     |
	|         | --addons=volumesnapshots             |                        |         |         |                     |                     |
	|         | --addons=csi-hostpath-driver         |                        |         |         |                     |                     |
	|         | --addons=gcp-auth                    |                        |         |         |                     |                     |
	|         | --addons=cloud-spanner               |                        |         |         |                     |                     |
	|         | --addons=inspektor-gadget            |                        |         |         |                     |                     |
	|         | --addons=storage-provisioner-rancher |                        |         |         |                     |                     |
	|         | --addons=nvidia-device-plugin        |                        |         |         |                     |                     |
	|         | --addons=yakd --addons=volcano       |                        |         |         |                     |                     |
	|         | --driver=docker                      |                        |         |         |                     |                     |
	|         | --container-runtime=crio             |                        |         |         |                     |                     |
	|         | --addons=ingress                     |                        |         |         |                     |                     |
	|         | --addons=ingress-dns                 |                        |         |         |                     |                     |
	| addons  | enable headlamp                      | addons-371349          | jenkins | v1.34.0 | 24 Sep 24 00:47 UTC | 24 Sep 24 00:47 UTC |
	|         | -p addons-371349                     |                        |         |         |                     |                     |
	|         | --alsologtostderr -v=1               |                        |         |         |                     |                     |
	| addons  | addons-371349 addons disable         | addons-371349          | jenkins | v1.34.0 | 24 Sep 24 00:47 UTC | 24 Sep 24 00:47 UTC |
	|         | headlamp --alsologtostderr           |                        |         |         |                     |                     |
	|         | -v=1                                 |                        |         |         |                     |                     |
	| addons  | addons-371349 addons                 | addons-371349          | jenkins | v1.34.0 | 24 Sep 24 00:48 UTC |                     |
	|         | disable csi-hostpath-driver          |                        |         |         |                     |                     |
	|         | --alsologtostderr -v=1               |                        |         |         |                     |                     |
	| ip      | addons-371349 ip                     | addons-371349          | jenkins | v1.34.0 | 24 Sep 24 00:48 UTC | 24 Sep 24 00:48 UTC |
	| addons  | addons-371349 addons disable         | addons-371349          | jenkins | v1.34.0 | 24 Sep 24 00:48 UTC | 24 Sep 24 00:48 UTC |
	|         | registry --alsologtostderr           |                        |         |         |                     |                     |
	|         | -v=1                                 |                        |         |         |                     |                     |
	|---------|--------------------------------------|------------------------|---------|---------|---------------------|---------------------|
	
	
	==> Last Start <==
	Log file created at: 2024/09/24 00:35:31
	Running on machine: ip-172-31-21-244
	Binary: Built with gc go1.23.0 for linux/arm64
	Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg
	I0924 00:35:31.109111 1874359 out.go:345] Setting OutFile to fd 1 ...
	I0924 00:35:31.109491 1874359 out.go:392] TERM=,COLORTERM=, which probably does not support color
	I0924 00:35:31.109508 1874359 out.go:358] Setting ErrFile to fd 2...
	I0924 00:35:31.109515 1874359 out.go:392] TERM=,COLORTERM=, which probably does not support color
	I0924 00:35:31.109789 1874359 root.go:338] Updating PATH: /home/jenkins/minikube-integration/19696-1868219/.minikube/bin
	I0924 00:35:31.110290 1874359 out.go:352] Setting JSON to false
	I0924 00:35:31.111147 1874359 start.go:129] hostinfo: {"hostname":"ip-172-31-21-244","uptime":29881,"bootTime":1727108250,"procs":155,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1070-aws","kernelArch":"aarch64","virtualizationSystem":"","virtualizationRole":"","hostId":"da8ac1fd-6236-412a-a346-95873c98230d"}
	I0924 00:35:31.111237 1874359 start.go:139] virtualization:  
	I0924 00:35:31.114409 1874359 out.go:177] * [addons-371349] minikube v1.34.0 on Ubuntu 20.04 (arm64)
	I0924 00:35:31.117918 1874359 out.go:177]   - MINIKUBE_LOCATION=19696
	I0924 00:35:31.118029 1874359 notify.go:220] Checking for updates...
	I0924 00:35:31.123440 1874359 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I0924 00:35:31.126227 1874359 out.go:177]   - KUBECONFIG=/home/jenkins/minikube-integration/19696-1868219/kubeconfig
	I0924 00:35:31.128996 1874359 out.go:177]   - MINIKUBE_HOME=/home/jenkins/minikube-integration/19696-1868219/.minikube
	I0924 00:35:31.131696 1874359 out.go:177]   - MINIKUBE_BIN=out/minikube-linux-arm64
	I0924 00:35:31.134392 1874359 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=
	I0924 00:35:31.137411 1874359 driver.go:394] Setting default libvirt URI to qemu:///system
	I0924 00:35:31.166048 1874359 docker.go:123] docker version: linux-27.3.1:Docker Engine - Community
	I0924 00:35:31.166177 1874359 cli_runner.go:164] Run: docker system info --format "{{json .}}"
	I0924 00:35:31.216117 1874359 info.go:266] docker info: {ID:5FDH:SA5P:5GCT:NLAS:B73P:SGDQ:PBG5:UBVH:UZY3:RXGO:CI7S:WAIH Containers:0 ContainersRunning:0 ContainersPaused:0 ContainersStopped:0 Images:1 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:false BridgeNfIP6Tables:false Debug:false NFd:29 OomKillDisable:true NGoroutines:44 SystemTime:2024-09-24 00:35:31.206607126 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1070-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Architecture:a
arch64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8214831104 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-21-244 Labels:[] ExperimentalBuild:false ServerVersion:27.3.1 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:7f7fdf5fed64eb6a7caf99b3e12efcf9d60e311c Expected:7f7fdf5fed64eb6a7caf99b3e12efcf9d60e311c} RuncCommit:{ID:v1.1.14-0-g2c9f560 Expected:v1.1.14-0-g2c9f560} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:[WARNING: brid
ge-nf-call-iptables is disabled WARNING: bridge-nf-call-ip6tables is disabled] ServerErrors:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.17.1] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.29.7]] Warnings:<nil>}}
	I0924 00:35:31.216230 1874359 docker.go:318] overlay module found
	I0924 00:35:31.220866 1874359 out.go:177] * Using the docker driver based on user configuration
	I0924 00:35:31.223404 1874359 start.go:297] selected driver: docker
	I0924 00:35:31.223428 1874359 start.go:901] validating driver "docker" against <nil>
	I0924 00:35:31.223442 1874359 start.go:912] status for docker: {Installed:true Healthy:true Running:false NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I0924 00:35:31.224063 1874359 cli_runner.go:164] Run: docker system info --format "{{json .}}"
	I0924 00:35:31.276460 1874359 info.go:266] docker info: {ID:5FDH:SA5P:5GCT:NLAS:B73P:SGDQ:PBG5:UBVH:UZY3:RXGO:CI7S:WAIH Containers:0 ContainersRunning:0 ContainersPaused:0 ContainersStopped:0 Images:1 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:false BridgeNfIP6Tables:false Debug:false NFd:29 OomKillDisable:true NGoroutines:44 SystemTime:2024-09-24 00:35:31.267813232 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1070-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Architecture:a
arch64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8214831104 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-21-244 Labels:[] ExperimentalBuild:false ServerVersion:27.3.1 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:7f7fdf5fed64eb6a7caf99b3e12efcf9d60e311c Expected:7f7fdf5fed64eb6a7caf99b3e12efcf9d60e311c} RuncCommit:{ID:v1.1.14-0-g2c9f560 Expected:v1.1.14-0-g2c9f560} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:[WARNING: brid
ge-nf-call-iptables is disabled WARNING: bridge-nf-call-ip6tables is disabled] ServerErrors:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.17.1] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.29.7]] Warnings:<nil>}}
	I0924 00:35:31.276667 1874359 start_flags.go:310] no existing cluster config was found, will generate one from the flags 
	I0924 00:35:31.276886 1874359 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
	I0924 00:35:31.279511 1874359 out.go:177] * Using Docker driver with root privileges
	I0924 00:35:31.281994 1874359 cni.go:84] Creating CNI manager for ""
	I0924 00:35:31.282050 1874359 cni.go:143] "docker" driver + "crio" runtime found, recommending kindnet
	I0924 00:35:31.282068 1874359 start_flags.go:319] Found "CNI" CNI - setting NetworkPlugin=cni
	I0924 00:35:31.282150 1874359 start.go:340] cluster config:
	{Name:addons-371349 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1727108449-19696@sha256:c662152d8855bc4c62a3b5786a68adf99e04794e7f8f374a3859703004ef1d21 Memory:4000 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.31.1 ClusterName:addons-371349 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime
:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.31.1 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSH
AgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I0924 00:35:31.284989 1874359 out.go:177] * Starting "addons-371349" primary control-plane node in "addons-371349" cluster
	I0924 00:35:31.287549 1874359 cache.go:121] Beginning downloading kic base image for docker with crio
	I0924 00:35:31.290177 1874359 out.go:177] * Pulling base image v0.0.45-1727108449-19696 ...
	I0924 00:35:31.292696 1874359 preload.go:131] Checking if preload exists for k8s version v1.31.1 and runtime crio
	I0924 00:35:31.292745 1874359 preload.go:146] Found local preload: /home/jenkins/minikube-integration/19696-1868219/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.1-cri-o-overlay-arm64.tar.lz4
	I0924 00:35:31.292758 1874359 cache.go:56] Caching tarball of preloaded images
	I0924 00:35:31.292786 1874359 image.go:79] Checking for gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1727108449-19696@sha256:c662152d8855bc4c62a3b5786a68adf99e04794e7f8f374a3859703004ef1d21 in local docker daemon
	I0924 00:35:31.292840 1874359 preload.go:172] Found /home/jenkins/minikube-integration/19696-1868219/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.1-cri-o-overlay-arm64.tar.lz4 in cache, skipping download
	I0924 00:35:31.292867 1874359 cache.go:59] Finished verifying existence of preloaded tar for v1.31.1 on crio
	I0924 00:35:31.293251 1874359 profile.go:143] Saving config to /home/jenkins/minikube-integration/19696-1868219/.minikube/profiles/addons-371349/config.json ...
	I0924 00:35:31.293286 1874359 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19696-1868219/.minikube/profiles/addons-371349/config.json: {Name:mk25e4dccbe4a04f50b9042bd55717678de78632 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0924 00:35:31.307591 1874359 cache.go:149] Downloading gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1727108449-19696@sha256:c662152d8855bc4c62a3b5786a68adf99e04794e7f8f374a3859703004ef1d21 to local cache
	I0924 00:35:31.307736 1874359 image.go:63] Checking for gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1727108449-19696@sha256:c662152d8855bc4c62a3b5786a68adf99e04794e7f8f374a3859703004ef1d21 in local cache directory
	I0924 00:35:31.307757 1874359 image.go:66] Found gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1727108449-19696@sha256:c662152d8855bc4c62a3b5786a68adf99e04794e7f8f374a3859703004ef1d21 in local cache directory, skipping pull
	I0924 00:35:31.307762 1874359 image.go:135] gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1727108449-19696@sha256:c662152d8855bc4c62a3b5786a68adf99e04794e7f8f374a3859703004ef1d21 exists in cache, skipping pull
	I0924 00:35:31.307770 1874359 cache.go:152] successfully saved gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1727108449-19696@sha256:c662152d8855bc4c62a3b5786a68adf99e04794e7f8f374a3859703004ef1d21 as a tarball
	I0924 00:35:31.307777 1874359 cache.go:162] Loading gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1727108449-19696@sha256:c662152d8855bc4c62a3b5786a68adf99e04794e7f8f374a3859703004ef1d21 from local cache
	I0924 00:35:47.930605 1874359 cache.go:164] successfully loaded and using gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1727108449-19696@sha256:c662152d8855bc4c62a3b5786a68adf99e04794e7f8f374a3859703004ef1d21 from cached tarball
	I0924 00:35:47.930645 1874359 cache.go:194] Successfully downloaded all kic artifacts
	I0924 00:35:47.930688 1874359 start.go:360] acquireMachinesLock for addons-371349: {Name:mkeb51f9a926e24ae39fcb6cc62e0aeb3a530af2 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0924 00:35:47.930830 1874359 start.go:364] duration metric: took 117.765µs to acquireMachinesLock for "addons-371349"
	I0924 00:35:47.930862 1874359 start.go:93] Provisioning new machine with config: &{Name:addons-371349 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1727108449-19696@sha256:c662152d8855bc4c62a3b5786a68adf99e04794e7f8f374a3859703004ef1d21 Memory:4000 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.31.1 ClusterName:addons-371349 Namespace:default APIServerHAVIP: APIServerName:min
ikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.31.1 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQe
muFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.31.1 ContainerRuntime:crio ControlPlane:true Worker:true}
	I0924 00:35:47.930941 1874359 start.go:125] createHost starting for "" (driver="docker")
	I0924 00:35:47.933040 1874359 out.go:235] * Creating docker container (CPUs=2, Memory=4000MB) ...
	I0924 00:35:47.933312 1874359 start.go:159] libmachine.API.Create for "addons-371349" (driver="docker")
	I0924 00:35:47.933350 1874359 client.go:168] LocalClient.Create starting
	I0924 00:35:47.933471 1874359 main.go:141] libmachine: Creating CA: /home/jenkins/minikube-integration/19696-1868219/.minikube/certs/ca.pem
	I0924 00:35:48.485151 1874359 main.go:141] libmachine: Creating client certificate: /home/jenkins/minikube-integration/19696-1868219/.minikube/certs/cert.pem
	I0924 00:35:48.899244 1874359 cli_runner.go:164] Run: docker network inspect addons-371349 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
	W0924 00:35:48.913303 1874359 cli_runner.go:211] docker network inspect addons-371349 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}" returned with exit code 1
	I0924 00:35:48.913397 1874359 network_create.go:284] running [docker network inspect addons-371349] to gather additional debugging logs...
	I0924 00:35:48.913419 1874359 cli_runner.go:164] Run: docker network inspect addons-371349
	W0924 00:35:48.929353 1874359 cli_runner.go:211] docker network inspect addons-371349 returned with exit code 1
	I0924 00:35:48.929392 1874359 network_create.go:287] error running [docker network inspect addons-371349]: docker network inspect addons-371349: exit status 1
	stdout:
	[]
	
	stderr:
	Error response from daemon: network addons-371349 not found
	I0924 00:35:48.929405 1874359 network_create.go:289] output of [docker network inspect addons-371349]: -- stdout --
	[]
	
	-- /stdout --
	** stderr ** 
	Error response from daemon: network addons-371349 not found
	
	** /stderr **
	I0924 00:35:48.929518 1874359 cli_runner.go:164] Run: docker network inspect bridge --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
	I0924 00:35:48.943684 1874359 network.go:206] using free private subnet 192.168.49.0/24: &{IP:192.168.49.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.49.0/24 Gateway:192.168.49.1 ClientMin:192.168.49.2 ClientMax:192.168.49.254 Broadcast:192.168.49.255 IsPrivate:true Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:} reservation:0x4001802f60}
	I0924 00:35:48.943730 1874359 network_create.go:124] attempt to create docker network addons-371349 192.168.49.0/24 with gateway 192.168.49.1 and MTU of 1500 ...
	I0924 00:35:48.943786 1874359 cli_runner.go:164] Run: docker network create --driver=bridge --subnet=192.168.49.0/24 --gateway=192.168.49.1 -o --ip-masq -o --icc -o com.docker.network.driver.mtu=1500 --label=created_by.minikube.sigs.k8s.io=true --label=name.minikube.sigs.k8s.io=addons-371349 addons-371349
	I0924 00:35:49.025468 1874359 network_create.go:108] docker network addons-371349 192.168.49.0/24 created
	I0924 00:35:49.025507 1874359 kic.go:121] calculated static IP "192.168.49.2" for the "addons-371349" container
	I0924 00:35:49.025584 1874359 cli_runner.go:164] Run: docker ps -a --format {{.Names}}
	I0924 00:35:49.040911 1874359 cli_runner.go:164] Run: docker volume create addons-371349 --label name.minikube.sigs.k8s.io=addons-371349 --label created_by.minikube.sigs.k8s.io=true
	I0924 00:35:49.057606 1874359 oci.go:103] Successfully created a docker volume addons-371349
	I0924 00:35:49.057704 1874359 cli_runner.go:164] Run: docker run --rm --name addons-371349-preload-sidecar --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=addons-371349 --entrypoint /usr/bin/test -v addons-371349:/var gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1727108449-19696@sha256:c662152d8855bc4c62a3b5786a68adf99e04794e7f8f374a3859703004ef1d21 -d /var/lib
	I0924 00:35:50.959914 1874359 cli_runner.go:217] Completed: docker run --rm --name addons-371349-preload-sidecar --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=addons-371349 --entrypoint /usr/bin/test -v addons-371349:/var gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1727108449-19696@sha256:c662152d8855bc4c62a3b5786a68adf99e04794e7f8f374a3859703004ef1d21 -d /var/lib: (1.902161651s)
	I0924 00:35:50.959945 1874359 oci.go:107] Successfully prepared a docker volume addons-371349
	I0924 00:35:50.959970 1874359 preload.go:131] Checking if preload exists for k8s version v1.31.1 and runtime crio
	I0924 00:35:50.959994 1874359 kic.go:194] Starting extracting preloaded images to volume ...
	I0924 00:35:50.960061 1874359 cli_runner.go:164] Run: docker run --rm --entrypoint /usr/bin/tar -v /home/jenkins/minikube-integration/19696-1868219/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.1-cri-o-overlay-arm64.tar.lz4:/preloaded.tar:ro -v addons-371349:/extractDir gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1727108449-19696@sha256:c662152d8855bc4c62a3b5786a68adf99e04794e7f8f374a3859703004ef1d21 -I lz4 -xf /preloaded.tar -C /extractDir
	I0924 00:35:54.945988 1874359 cli_runner.go:217] Completed: docker run --rm --entrypoint /usr/bin/tar -v /home/jenkins/minikube-integration/19696-1868219/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.1-cri-o-overlay-arm64.tar.lz4:/preloaded.tar:ro -v addons-371349:/extractDir gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1727108449-19696@sha256:c662152d8855bc4c62a3b5786a68adf99e04794e7f8f374a3859703004ef1d21 -I lz4 -xf /preloaded.tar -C /extractDir: (3.985880116s)
	I0924 00:35:54.946022 1874359 kic.go:203] duration metric: took 3.986025819s to extract preloaded images to volume ...
	W0924 00:35:54.946152 1874359 cgroups_linux.go:77] Your kernel does not support swap limit capabilities or the cgroup is not mounted.
	I0924 00:35:54.946256 1874359 cli_runner.go:164] Run: docker info --format "'{{json .SecurityOptions}}'"
	I0924 00:35:54.988942 1874359 cli_runner.go:164] Run: docker run -d -t --privileged --security-opt seccomp=unconfined --tmpfs /tmp --tmpfs /run -v /lib/modules:/lib/modules:ro --hostname addons-371349 --name addons-371349 --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=addons-371349 --label role.minikube.sigs.k8s.io= --label mode.minikube.sigs.k8s.io=addons-371349 --network addons-371349 --ip 192.168.49.2 --volume addons-371349:/var --security-opt apparmor=unconfined --memory=4000mb --cpus=2 -e container=docker --expose 8443 --publish=127.0.0.1::8443 --publish=127.0.0.1::22 --publish=127.0.0.1::2376 --publish=127.0.0.1::5000 --publish=127.0.0.1::32443 gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1727108449-19696@sha256:c662152d8855bc4c62a3b5786a68adf99e04794e7f8f374a3859703004ef1d21
	I0924 00:35:55.293958 1874359 cli_runner.go:164] Run: docker container inspect addons-371349 --format={{.State.Running}}
	I0924 00:35:55.320780 1874359 cli_runner.go:164] Run: docker container inspect addons-371349 --format={{.State.Status}}
	I0924 00:35:55.340642 1874359 cli_runner.go:164] Run: docker exec addons-371349 stat /var/lib/dpkg/alternatives/iptables
	I0924 00:35:55.397834 1874359 oci.go:144] the created container "addons-371349" has a running status.
	I0924 00:35:55.397864 1874359 kic.go:225] Creating ssh key for kic: /home/jenkins/minikube-integration/19696-1868219/.minikube/machines/addons-371349/id_rsa...
	I0924 00:35:55.675510 1874359 kic_runner.go:191] docker (temp): /home/jenkins/minikube-integration/19696-1868219/.minikube/machines/addons-371349/id_rsa.pub --> /home/docker/.ssh/authorized_keys (381 bytes)
	I0924 00:35:55.699212 1874359 cli_runner.go:164] Run: docker container inspect addons-371349 --format={{.State.Status}}
	I0924 00:35:55.726400 1874359 kic_runner.go:93] Run: chown docker:docker /home/docker/.ssh/authorized_keys
	I0924 00:35:55.726420 1874359 kic_runner.go:114] Args: [docker exec --privileged addons-371349 chown docker:docker /home/docker/.ssh/authorized_keys]
	I0924 00:35:55.806108 1874359 cli_runner.go:164] Run: docker container inspect addons-371349 --format={{.State.Status}}
	I0924 00:35:55.829052 1874359 machine.go:93] provisionDockerMachine start ...
	I0924 00:35:55.829141 1874359 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-371349
	I0924 00:35:55.851370 1874359 main.go:141] libmachine: Using SSH client type: native
	I0924 00:35:55.851622 1874359 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x413650] 0x415e90 <nil>  [] 0s} 127.0.0.1 34691 <nil> <nil>}
	I0924 00:35:55.851638 1874359 main.go:141] libmachine: About to run SSH command:
	hostname
	I0924 00:35:56.037194 1874359 main.go:141] libmachine: SSH cmd err, output: <nil>: addons-371349
	
	I0924 00:35:56.037220 1874359 ubuntu.go:169] provisioning hostname "addons-371349"
	I0924 00:35:56.037293 1874359 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-371349
	I0924 00:35:56.078692 1874359 main.go:141] libmachine: Using SSH client type: native
	I0924 00:35:56.079000 1874359 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x413650] 0x415e90 <nil>  [] 0s} 127.0.0.1 34691 <nil> <nil>}
	I0924 00:35:56.079012 1874359 main.go:141] libmachine: About to run SSH command:
	sudo hostname addons-371349 && echo "addons-371349" | sudo tee /etc/hostname
	I0924 00:35:56.226092 1874359 main.go:141] libmachine: SSH cmd err, output: <nil>: addons-371349
	
	I0924 00:35:56.226258 1874359 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-371349
	I0924 00:35:56.244833 1874359 main.go:141] libmachine: Using SSH client type: native
	I0924 00:35:56.245089 1874359 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x413650] 0x415e90 <nil>  [] 0s} 127.0.0.1 34691 <nil> <nil>}
	I0924 00:35:56.245106 1874359 main.go:141] libmachine: About to run SSH command:
	
			if ! grep -xq '.*\saddons-371349' /etc/hosts; then
				if grep -xq '127.0.1.1\s.*' /etc/hosts; then
					sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 addons-371349/g' /etc/hosts;
				else 
					echo '127.0.1.1 addons-371349' | sudo tee -a /etc/hosts; 
				fi
			fi
	I0924 00:35:56.381804 1874359 main.go:141] libmachine: SSH cmd err, output: <nil>: 
	I0924 00:35:56.381859 1874359 ubuntu.go:175] set auth options {CertDir:/home/jenkins/minikube-integration/19696-1868219/.minikube CaCertPath:/home/jenkins/minikube-integration/19696-1868219/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/19696-1868219/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/19696-1868219/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/19696-1868219/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/19696-1868219/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/19696-1868219/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/19696-1868219/.minikube}
	I0924 00:35:56.381886 1874359 ubuntu.go:177] setting up certificates
	I0924 00:35:56.381895 1874359 provision.go:84] configureAuth start
	I0924 00:35:56.381956 1874359 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" addons-371349
	I0924 00:35:56.400509 1874359 provision.go:143] copyHostCerts
	I0924 00:35:56.400599 1874359 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19696-1868219/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/19696-1868219/.minikube/ca.pem (1078 bytes)
	I0924 00:35:56.400716 1874359 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19696-1868219/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/19696-1868219/.minikube/cert.pem (1123 bytes)
	I0924 00:35:56.400778 1874359 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19696-1868219/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/19696-1868219/.minikube/key.pem (1675 bytes)
	I0924 00:35:56.400827 1874359 provision.go:117] generating server cert: /home/jenkins/minikube-integration/19696-1868219/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/19696-1868219/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/19696-1868219/.minikube/certs/ca-key.pem org=jenkins.addons-371349 san=[127.0.0.1 192.168.49.2 addons-371349 localhost minikube]
	I0924 00:35:56.572353 1874359 provision.go:177] copyRemoteCerts
	I0924 00:35:56.572422 1874359 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
	I0924 00:35:56.572464 1874359 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-371349
	I0924 00:35:56.588536 1874359 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:34691 SSHKeyPath:/home/jenkins/minikube-integration/19696-1868219/.minikube/machines/addons-371349/id_rsa Username:docker}
	I0924 00:35:56.682342 1874359 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19696-1868219/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1675 bytes)
	I0924 00:35:56.706256 1874359 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19696-1868219/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1078 bytes)
	I0924 00:35:56.729190 1874359 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19696-1868219/.minikube/machines/server.pem --> /etc/docker/server.pem (1208 bytes)
	I0924 00:35:56.752321 1874359 provision.go:87] duration metric: took 370.409574ms to configureAuth
	I0924 00:35:56.752398 1874359 ubuntu.go:193] setting minikube options for container-runtime
	I0924 00:35:56.752599 1874359 config.go:182] Loaded profile config "addons-371349": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.31.1
	I0924 00:35:56.752715 1874359 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-371349
	I0924 00:35:56.768527 1874359 main.go:141] libmachine: Using SSH client type: native
	I0924 00:35:56.768768 1874359 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x413650] 0x415e90 <nil>  [] 0s} 127.0.0.1 34691 <nil> <nil>}
	I0924 00:35:56.768789 1874359 main.go:141] libmachine: About to run SSH command:
	sudo mkdir -p /etc/sysconfig && printf %s "
	CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
	" | sudo tee /etc/sysconfig/crio.minikube && sudo systemctl restart crio
	I0924 00:35:56.992663 1874359 main.go:141] libmachine: SSH cmd err, output: <nil>: 
	CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
	
	I0924 00:35:56.992688 1874359 machine.go:96] duration metric: took 1.163615539s to provisionDockerMachine
	I0924 00:35:56.992698 1874359 client.go:171] duration metric: took 9.059339192s to LocalClient.Create
	I0924 00:35:56.992714 1874359 start.go:167] duration metric: took 9.059403863s to libmachine.API.Create "addons-371349"
	I0924 00:35:56.992724 1874359 start.go:293] postStartSetup for "addons-371349" (driver="docker")
	I0924 00:35:56.992735 1874359 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
	I0924 00:35:56.992800 1874359 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
	I0924 00:35:56.992842 1874359 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-371349
	I0924 00:35:57.012622 1874359 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:34691 SSHKeyPath:/home/jenkins/minikube-integration/19696-1868219/.minikube/machines/addons-371349/id_rsa Username:docker}
	I0924 00:35:57.106644 1874359 ssh_runner.go:195] Run: cat /etc/os-release
	I0924 00:35:57.109707 1874359 main.go:141] libmachine: Couldn't set key VERSION_CODENAME, no corresponding struct field found
	I0924 00:35:57.109744 1874359 main.go:141] libmachine: Couldn't set key PRIVACY_POLICY_URL, no corresponding struct field found
	I0924 00:35:57.109756 1874359 main.go:141] libmachine: Couldn't set key UBUNTU_CODENAME, no corresponding struct field found
	I0924 00:35:57.109764 1874359 info.go:137] Remote host: Ubuntu 22.04.5 LTS
	I0924 00:35:57.109794 1874359 filesync.go:126] Scanning /home/jenkins/minikube-integration/19696-1868219/.minikube/addons for local assets ...
	I0924 00:35:57.109888 1874359 filesync.go:126] Scanning /home/jenkins/minikube-integration/19696-1868219/.minikube/files for local assets ...
	I0924 00:35:57.109917 1874359 start.go:296] duration metric: took 117.186271ms for postStartSetup
	I0924 00:35:57.110231 1874359 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" addons-371349
	I0924 00:35:57.125870 1874359 profile.go:143] Saving config to /home/jenkins/minikube-integration/19696-1868219/.minikube/profiles/addons-371349/config.json ...
	I0924 00:35:57.126157 1874359 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
	I0924 00:35:57.126210 1874359 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-371349
	I0924 00:35:57.141418 1874359 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:34691 SSHKeyPath:/home/jenkins/minikube-integration/19696-1868219/.minikube/machines/addons-371349/id_rsa Username:docker}
	I0924 00:35:57.230247 1874359 ssh_runner.go:195] Run: sh -c "df -BG /var | awk 'NR==2{print $4}'"
	I0924 00:35:57.234447 1874359 start.go:128] duration metric: took 9.303490385s to createHost
	I0924 00:35:57.234475 1874359 start.go:83] releasing machines lock for "addons-371349", held for 9.3036279s
	I0924 00:35:57.234544 1874359 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" addons-371349
	I0924 00:35:57.250134 1874359 ssh_runner.go:195] Run: cat /version.json
	I0924 00:35:57.250192 1874359 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-371349
	I0924 00:35:57.250265 1874359 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/
	I0924 00:35:57.250350 1874359 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-371349
	I0924 00:35:57.266578 1874359 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:34691 SSHKeyPath:/home/jenkins/minikube-integration/19696-1868219/.minikube/machines/addons-371349/id_rsa Username:docker}
	I0924 00:35:57.276682 1874359 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:34691 SSHKeyPath:/home/jenkins/minikube-integration/19696-1868219/.minikube/machines/addons-371349/id_rsa Username:docker}
	I0924 00:35:57.481806 1874359 ssh_runner.go:195] Run: systemctl --version
	I0924 00:35:57.486022 1874359 ssh_runner.go:195] Run: sudo sh -c "podman version >/dev/null"
	I0924 00:35:57.624524 1874359 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"
	I0924 00:35:57.628624 1874359 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f -name *loopback.conf* -not -name *.mk_disabled -exec sh -c "sudo mv {} {}.mk_disabled" ;
	I0924 00:35:57.650226 1874359 cni.go:221] loopback cni configuration disabled: "/etc/cni/net.d/*loopback.conf*" found
	I0924 00:35:57.650317 1874359 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%p, " -exec sh -c "sudo mv {} {}.mk_disabled" ;
	I0924 00:35:57.681941 1874359 cni.go:262] disabled [/etc/cni/net.d/87-podman-bridge.conflist, /etc/cni/net.d/100-crio-bridge.conf] bridge cni config(s)
	I0924 00:35:57.681970 1874359 start.go:495] detecting cgroup driver to use...
	I0924 00:35:57.682003 1874359 detect.go:187] detected "cgroupfs" cgroup driver on host os
	I0924 00:35:57.682055 1874359 ssh_runner.go:195] Run: sudo systemctl stop -f containerd
	I0924 00:35:57.698588 1874359 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd
	I0924 00:35:57.710409 1874359 docker.go:217] disabling cri-docker service (if available) ...
	I0924 00:35:57.710476 1874359 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.socket
	I0924 00:35:57.723312 1874359 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.service
	I0924 00:35:57.738063 1874359 ssh_runner.go:195] Run: sudo systemctl disable cri-docker.socket
	I0924 00:35:57.828486 1874359 ssh_runner.go:195] Run: sudo systemctl mask cri-docker.service
	I0924 00:35:57.919854 1874359 docker.go:233] disabling docker service ...
	I0924 00:35:57.919944 1874359 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket
	I0924 00:35:57.939471 1874359 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service
	I0924 00:35:57.951096 1874359 ssh_runner.go:195] Run: sudo systemctl disable docker.socket
	I0924 00:35:58.033450 1874359 ssh_runner.go:195] Run: sudo systemctl mask docker.service
	I0924 00:35:58.144265 1874359 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker
	I0924 00:35:58.155196 1874359 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///var/run/crio/crio.sock
	" | sudo tee /etc/crictl.yaml"
	I0924 00:35:58.171647 1874359 crio.go:59] configure cri-o to use "registry.k8s.io/pause:3.10" pause image...
	I0924 00:35:58.171732 1874359 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*pause_image = .*$|pause_image = "registry.k8s.io/pause:3.10"|' /etc/crio/crio.conf.d/02-crio.conf"
	I0924 00:35:58.181170 1874359 crio.go:70] configuring cri-o to use "cgroupfs" as cgroup driver...
	I0924 00:35:58.181252 1874359 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*cgroup_manager = .*$|cgroup_manager = "cgroupfs"|' /etc/crio/crio.conf.d/02-crio.conf"
	I0924 00:35:58.191464 1874359 ssh_runner.go:195] Run: sh -c "sudo sed -i '/conmon_cgroup = .*/d' /etc/crio/crio.conf.d/02-crio.conf"
	I0924 00:35:58.202150 1874359 ssh_runner.go:195] Run: sh -c "sudo sed -i '/cgroup_manager = .*/a conmon_cgroup = "pod"' /etc/crio/crio.conf.d/02-crio.conf"
	I0924 00:35:58.211736 1874359 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"
	I0924 00:35:58.220977 1874359 ssh_runner.go:195] Run: sh -c "sudo sed -i '/^ *"net.ipv4.ip_unprivileged_port_start=.*"/d' /etc/crio/crio.conf.d/02-crio.conf"
	I0924 00:35:58.230251 1874359 ssh_runner.go:195] Run: sh -c "sudo grep -q "^ *default_sysctls" /etc/crio/crio.conf.d/02-crio.conf || sudo sed -i '/conmon_cgroup = .*/a default_sysctls = \[\n\]' /etc/crio/crio.conf.d/02-crio.conf"
	I0924 00:35:58.245370 1874359 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^default_sysctls *= *\[|&\n  "net.ipv4.ip_unprivileged_port_start=0",|' /etc/crio/crio.conf.d/02-crio.conf"
	I0924 00:35:58.254984 1874359 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
	I0924 00:35:58.263171 1874359 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
	I0924 00:35:58.271453 1874359 ssh_runner.go:195] Run: sudo systemctl daemon-reload
	I0924 00:35:58.353665 1874359 ssh_runner.go:195] Run: sudo systemctl restart crio
	I0924 00:35:58.467533 1874359 start.go:542] Will wait 60s for socket path /var/run/crio/crio.sock
	I0924 00:35:58.467654 1874359 ssh_runner.go:195] Run: stat /var/run/crio/crio.sock
	I0924 00:35:58.470878 1874359 start.go:563] Will wait 60s for crictl version
	I0924 00:35:58.470953 1874359 ssh_runner.go:195] Run: which crictl
	I0924 00:35:58.474104 1874359 ssh_runner.go:195] Run: sudo /usr/bin/crictl version
	I0924 00:35:58.514452 1874359 start.go:579] Version:  0.1.0
	RuntimeName:  cri-o
	RuntimeVersion:  1.24.6
	RuntimeApiVersion:  v1
	I0924 00:35:58.514567 1874359 ssh_runner.go:195] Run: crio --version
	I0924 00:35:58.551717 1874359 ssh_runner.go:195] Run: crio --version
	I0924 00:35:58.593634 1874359 out.go:177] * Preparing Kubernetes v1.31.1 on CRI-O 1.24.6 ...
	I0924 00:35:58.595974 1874359 cli_runner.go:164] Run: docker network inspect addons-371349 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
	I0924 00:35:58.610785 1874359 ssh_runner.go:195] Run: grep 192.168.49.1	host.minikube.internal$ /etc/hosts
	I0924 00:35:58.614009 1874359 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.49.1	host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
	I0924 00:35:58.624240 1874359 kubeadm.go:883] updating cluster {Name:addons-371349 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1727108449-19696@sha256:c662152d8855bc4c62a3b5786a68adf99e04794e7f8f374a3859703004ef1d21 Memory:4000 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.31.1 ClusterName:addons-371349 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNa
mes:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.49.2 Port:8443 KubernetesVersion:v1.31.1 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmw
arePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} ...
	I0924 00:35:58.624364 1874359 preload.go:131] Checking if preload exists for k8s version v1.31.1 and runtime crio
	I0924 00:35:58.624421 1874359 ssh_runner.go:195] Run: sudo crictl images --output json
	I0924 00:35:58.695904 1874359 crio.go:514] all images are preloaded for cri-o runtime.
	I0924 00:35:58.695928 1874359 crio.go:433] Images already preloaded, skipping extraction
	I0924 00:35:58.695988 1874359 ssh_runner.go:195] Run: sudo crictl images --output json
	I0924 00:35:58.733649 1874359 crio.go:514] all images are preloaded for cri-o runtime.
	I0924 00:35:58.733672 1874359 cache_images.go:84] Images are preloaded, skipping loading
	I0924 00:35:58.733681 1874359 kubeadm.go:934] updating node { 192.168.49.2 8443 v1.31.1 crio true true} ...
	I0924 00:35:58.733785 1874359 kubeadm.go:946] kubelet [Unit]
	Wants=crio.service
	
	[Service]
	ExecStart=
	ExecStart=/var/lib/minikube/binaries/v1.31.1/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --cgroups-per-qos=false --config=/var/lib/kubelet/config.yaml --enforce-node-allocatable= --hostname-override=addons-371349 --kubeconfig=/etc/kubernetes/kubelet.conf --node-ip=192.168.49.2
	
	[Install]
	 config:
	{KubernetesVersion:v1.31.1 ClusterName:addons-371349 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:}
	I0924 00:35:58.733894 1874359 ssh_runner.go:195] Run: crio config
	I0924 00:35:58.802054 1874359 cni.go:84] Creating CNI manager for ""
	I0924 00:35:58.802077 1874359 cni.go:143] "docker" driver + "crio" runtime found, recommending kindnet
	I0924 00:35:58.802089 1874359 kubeadm.go:84] Using pod CIDR: 10.244.0.0/16
	I0924 00:35:58.802112 1874359 kubeadm.go:181] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.49.2 APIServerPort:8443 KubernetesVersion:v1.31.1 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:addons-371349 NodeName:addons-371349 DNSDomain:cluster.local CRISocket:/var/run/crio/crio.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.49.2"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.49.2 CgroupDriver:cgroupfs ClientCAFile:/var/lib/minikube/certs/ca.crt StaticPodPath:/etc/kuberne
tes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[containerRuntimeEndpoint:unix:///var/run/crio/crio.sock hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:true}
	I0924 00:35:58.802254 1874359 kubeadm.go:187] kubeadm config:
	apiVersion: kubeadm.k8s.io/v1beta3
	kind: InitConfiguration
	localAPIEndpoint:
	  advertiseAddress: 192.168.49.2
	  bindPort: 8443
	bootstrapTokens:
	  - groups:
	      - system:bootstrappers:kubeadm:default-node-token
	    ttl: 24h0m0s
	    usages:
	      - signing
	      - authentication
	nodeRegistration:
	  criSocket: unix:///var/run/crio/crio.sock
	  name: "addons-371349"
	  kubeletExtraArgs:
	    node-ip: 192.168.49.2
	  taints: []
	---
	apiVersion: kubeadm.k8s.io/v1beta3
	kind: ClusterConfiguration
	apiServer:
	  certSANs: ["127.0.0.1", "localhost", "192.168.49.2"]
	  extraArgs:
	    enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"
	controllerManager:
	  extraArgs:
	    allocate-node-cidrs: "true"
	    leader-elect: "false"
	scheduler:
	  extraArgs:
	    leader-elect: "false"
	certificatesDir: /var/lib/minikube/certs
	clusterName: mk
	controlPlaneEndpoint: control-plane.minikube.internal:8443
	etcd:
	  local:
	    dataDir: /var/lib/minikube/etcd
	    extraArgs:
	      proxy-refresh-interval: "70000"
	kubernetesVersion: v1.31.1
	networking:
	  dnsDomain: cluster.local
	  podSubnet: "10.244.0.0/16"
	  serviceSubnet: 10.96.0.0/12
	---
	apiVersion: kubelet.config.k8s.io/v1beta1
	kind: KubeletConfiguration
	authentication:
	  x509:
	    clientCAFile: /var/lib/minikube/certs/ca.crt
	cgroupDriver: cgroupfs
	containerRuntimeEndpoint: unix:///var/run/crio/crio.sock
	hairpinMode: hairpin-veth
	runtimeRequestTimeout: 15m
	clusterDomain: "cluster.local"
	# disable disk resource management by default
	imageGCHighThresholdPercent: 100
	evictionHard:
	  nodefs.available: "0%"
	  nodefs.inodesFree: "0%"
	  imagefs.available: "0%"
	failSwapOn: false
	staticPodPath: /etc/kubernetes/manifests
	---
	apiVersion: kubeproxy.config.k8s.io/v1alpha1
	kind: KubeProxyConfiguration
	clusterCIDR: "10.244.0.0/16"
	metricsBindAddress: 0.0.0.0:10249
	conntrack:
	  maxPerCore: 0
	# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"
	  tcpEstablishedTimeout: 0s
	# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"
	  tcpCloseWaitTimeout: 0s
	
	I0924 00:35:58.802327 1874359 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.31.1
	I0924 00:35:58.810920 1874359 binaries.go:44] Found k8s binaries, skipping transfer
	I0924 00:35:58.811007 1874359 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube
	I0924 00:35:58.819212 1874359 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (363 bytes)
	I0924 00:35:58.837724 1874359 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)
	I0924 00:35:58.856038 1874359 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2151 bytes)
	I0924 00:35:58.873780 1874359 ssh_runner.go:195] Run: grep 192.168.49.2	control-plane.minikube.internal$ /etc/hosts
	I0924 00:35:58.877149 1874359 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.49.2	control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
	I0924 00:35:58.887775 1874359 ssh_runner.go:195] Run: sudo systemctl daemon-reload
	I0924 00:35:58.974780 1874359 ssh_runner.go:195] Run: sudo systemctl start kubelet
	I0924 00:35:58.988169 1874359 certs.go:68] Setting up /home/jenkins/minikube-integration/19696-1868219/.minikube/profiles/addons-371349 for IP: 192.168.49.2
	I0924 00:35:58.988244 1874359 certs.go:194] generating shared ca certs ...
	I0924 00:35:58.988287 1874359 certs.go:226] acquiring lock for ca certs: {Name:mk818e75f019a868ef3b3a376623c8523880c0ff Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0924 00:35:58.988471 1874359 certs.go:240] generating "minikubeCA" ca cert: /home/jenkins/minikube-integration/19696-1868219/.minikube/ca.key
	I0924 00:35:59.587260 1874359 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19696-1868219/.minikube/ca.crt ...
	I0924 00:35:59.587293 1874359 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19696-1868219/.minikube/ca.crt: {Name:mke81ea5621d8e9399e452bcb5d27949aa3a3e3f Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0924 00:35:59.588029 1874359 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19696-1868219/.minikube/ca.key ...
	I0924 00:35:59.588046 1874359 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19696-1868219/.minikube/ca.key: {Name:mke396d44ce3103d725d30848cab5b8e6daaf342 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0924 00:35:59.588626 1874359 certs.go:240] generating "proxyClientCA" ca cert: /home/jenkins/minikube-integration/19696-1868219/.minikube/proxy-client-ca.key
	I0924 00:35:59.801877 1874359 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19696-1868219/.minikube/proxy-client-ca.crt ...
	I0924 00:35:59.801907 1874359 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19696-1868219/.minikube/proxy-client-ca.crt: {Name:mka8d81d58c2fe8e182a341cf45abd586bdd7c80 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0924 00:35:59.802595 1874359 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19696-1868219/.minikube/proxy-client-ca.key ...
	I0924 00:35:59.802622 1874359 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19696-1868219/.minikube/proxy-client-ca.key: {Name:mkb2d5aac983abcd6198ab2e82a3a31af20c1be0 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0924 00:35:59.802732 1874359 certs.go:256] generating profile certs ...
	I0924 00:35:59.802795 1874359 certs.go:363] generating signed profile cert for "minikube-user": /home/jenkins/minikube-integration/19696-1868219/.minikube/profiles/addons-371349/client.key
	I0924 00:35:59.802812 1874359 crypto.go:68] Generating cert /home/jenkins/minikube-integration/19696-1868219/.minikube/profiles/addons-371349/client.crt with IP's: []
	I0924 00:36:00.032900 1874359 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19696-1868219/.minikube/profiles/addons-371349/client.crt ...
	I0924 00:36:00.032941 1874359 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19696-1868219/.minikube/profiles/addons-371349/client.crt: {Name:mk0c65c4919d6dbeb99ceefeedc5bb455538bb52 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0924 00:36:00.033160 1874359 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19696-1868219/.minikube/profiles/addons-371349/client.key ...
	I0924 00:36:00.033170 1874359 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19696-1868219/.minikube/profiles/addons-371349/client.key: {Name:mk8703043f4377c7a2b7dcc6d398d1c35642fcec Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0924 00:36:00.033246 1874359 certs.go:363] generating signed profile cert for "minikube": /home/jenkins/minikube-integration/19696-1868219/.minikube/profiles/addons-371349/apiserver.key.2f5d7484
	I0924 00:36:00.033264 1874359 crypto.go:68] Generating cert /home/jenkins/minikube-integration/19696-1868219/.minikube/profiles/addons-371349/apiserver.crt.2f5d7484 with IP's: [10.96.0.1 127.0.0.1 10.0.0.1 192.168.49.2]
	I0924 00:36:00.289276 1874359 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19696-1868219/.minikube/profiles/addons-371349/apiserver.crt.2f5d7484 ...
	I0924 00:36:00.289317 1874359 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19696-1868219/.minikube/profiles/addons-371349/apiserver.crt.2f5d7484: {Name:mk1949bfae5f28a507cc523025a347e01f859e96 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0924 00:36:00.289525 1874359 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19696-1868219/.minikube/profiles/addons-371349/apiserver.key.2f5d7484 ...
	I0924 00:36:00.289542 1874359 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19696-1868219/.minikube/profiles/addons-371349/apiserver.key.2f5d7484: {Name:mk1e2fd43443814467d34e4ff1350d3d0c2858ba Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0924 00:36:00.289633 1874359 certs.go:381] copying /home/jenkins/minikube-integration/19696-1868219/.minikube/profiles/addons-371349/apiserver.crt.2f5d7484 -> /home/jenkins/minikube-integration/19696-1868219/.minikube/profiles/addons-371349/apiserver.crt
	I0924 00:36:00.289714 1874359 certs.go:385] copying /home/jenkins/minikube-integration/19696-1868219/.minikube/profiles/addons-371349/apiserver.key.2f5d7484 -> /home/jenkins/minikube-integration/19696-1868219/.minikube/profiles/addons-371349/apiserver.key
	I0924 00:36:00.289774 1874359 certs.go:363] generating signed profile cert for "aggregator": /home/jenkins/minikube-integration/19696-1868219/.minikube/profiles/addons-371349/proxy-client.key
	I0924 00:36:00.289797 1874359 crypto.go:68] Generating cert /home/jenkins/minikube-integration/19696-1868219/.minikube/profiles/addons-371349/proxy-client.crt with IP's: []
	I0924 00:36:01.184870 1874359 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19696-1868219/.minikube/profiles/addons-371349/proxy-client.crt ...
	I0924 00:36:01.184904 1874359 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19696-1868219/.minikube/profiles/addons-371349/proxy-client.crt: {Name:mk96ef231439e929316cf55529c83e8632d14bf2 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0924 00:36:01.185111 1874359 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19696-1868219/.minikube/profiles/addons-371349/proxy-client.key ...
	I0924 00:36:01.185126 1874359 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19696-1868219/.minikube/profiles/addons-371349/proxy-client.key: {Name:mk30736069b99211f16b83e0f6cbcb537a5e08b3 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0924 00:36:01.186062 1874359 certs.go:484] found cert: /home/jenkins/minikube-integration/19696-1868219/.minikube/certs/ca-key.pem (1675 bytes)
	I0924 00:36:01.186110 1874359 certs.go:484] found cert: /home/jenkins/minikube-integration/19696-1868219/.minikube/certs/ca.pem (1078 bytes)
	I0924 00:36:01.186133 1874359 certs.go:484] found cert: /home/jenkins/minikube-integration/19696-1868219/.minikube/certs/cert.pem (1123 bytes)
	I0924 00:36:01.186163 1874359 certs.go:484] found cert: /home/jenkins/minikube-integration/19696-1868219/.minikube/certs/key.pem (1675 bytes)
	I0924 00:36:01.186798 1874359 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19696-1868219/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
	I0924 00:36:01.211166 1874359 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19696-1868219/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1679 bytes)
	I0924 00:36:01.235382 1874359 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19696-1868219/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
	I0924 00:36:01.262901 1874359 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19696-1868219/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1679 bytes)
	I0924 00:36:01.287047 1874359 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19696-1868219/.minikube/profiles/addons-371349/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1419 bytes)
	I0924 00:36:01.312081 1874359 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19696-1868219/.minikube/profiles/addons-371349/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1675 bytes)
	I0924 00:36:01.335367 1874359 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19696-1868219/.minikube/profiles/addons-371349/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
	I0924 00:36:01.359222 1874359 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19696-1868219/.minikube/profiles/addons-371349/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1679 bytes)
	I0924 00:36:01.382733 1874359 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19696-1868219/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
	I0924 00:36:01.406976 1874359 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)
	I0924 00:36:01.424742 1874359 ssh_runner.go:195] Run: openssl version
	I0924 00:36:01.430037 1874359 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
	I0924 00:36:01.439176 1874359 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
	I0924 00:36:01.442603 1874359 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 Sep 24 00:35 /usr/share/ca-certificates/minikubeCA.pem
	I0924 00:36:01.442708 1874359 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
	I0924 00:36:01.449379 1874359 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
	I0924 00:36:01.459010 1874359 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt
	I0924 00:36:01.462508 1874359 certs.go:399] 'apiserver-kubelet-client' cert doesn't exist, likely first start: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt: Process exited with status 1
	stdout:
	
	stderr:
	stat: cannot statx '/var/lib/minikube/certs/apiserver-kubelet-client.crt': No such file or directory
	I0924 00:36:01.462552 1874359 kubeadm.go:392] StartCluster: {Name:addons-371349 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1727108449-19696@sha256:c662152d8855bc4c62a3b5786a68adf99e04794e7f8f374a3859703004ef1d21 Memory:4000 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.31.1 ClusterName:addons-371349 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames
:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.49.2 Port:8443 KubernetesVersion:v1.31.1 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmware
Path: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I0924 00:36:01.462632 1874359 cri.go:54] listing CRI containers in root : {State:paused Name: Namespaces:[kube-system]}
	I0924 00:36:01.462690 1874359 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"
	I0924 00:36:01.499005 1874359 cri.go:89] found id: ""
	I0924 00:36:01.499117 1874359 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd
	I0924 00:36:01.507984 1874359 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml
	I0924 00:36:01.517128 1874359 kubeadm.go:214] ignoring SystemVerification for kubeadm because of docker driver
	I0924 00:36:01.517195 1874359 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
	I0924 00:36:01.526007 1874359 kubeadm.go:155] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
	stdout:
	
	stderr:
	ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
	ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
	ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
	ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
	I0924 00:36:01.526027 1874359 kubeadm.go:157] found existing configuration files:
	
	I0924 00:36:01.526106 1874359 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf
	I0924 00:36:01.534919 1874359 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/admin.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf: Process exited with status 2
	stdout:
	
	stderr:
	grep: /etc/kubernetes/admin.conf: No such file or directory
	I0924 00:36:01.535008 1874359 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/admin.conf
	I0924 00:36:01.543320 1874359 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf
	I0924 00:36:01.552608 1874359 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/kubelet.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf: Process exited with status 2
	stdout:
	
	stderr:
	grep: /etc/kubernetes/kubelet.conf: No such file or directory
	I0924 00:36:01.552698 1874359 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/kubelet.conf
	I0924 00:36:01.560982 1874359 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf
	I0924 00:36:01.569305 1874359 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/controller-manager.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf: Process exited with status 2
	stdout:
	
	stderr:
	grep: /etc/kubernetes/controller-manager.conf: No such file or directory
	I0924 00:36:01.569372 1874359 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/controller-manager.conf
	I0924 00:36:01.577681 1874359 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf
	I0924 00:36:01.586185 1874359 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/scheduler.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf: Process exited with status 2
	stdout:
	
	stderr:
	grep: /etc/kubernetes/scheduler.conf: No such file or directory
	I0924 00:36:01.586249 1874359 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/scheduler.conf
	I0924 00:36:01.594692 1874359 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.31.1:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml  --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem,SystemVerification,FileContent--proc-sys-net-bridge-bridge-nf-call-iptables"
	I0924 00:36:01.637749 1874359 kubeadm.go:310] [init] Using Kubernetes version: v1.31.1
	I0924 00:36:01.637865 1874359 kubeadm.go:310] [preflight] Running pre-flight checks
	I0924 00:36:01.655764 1874359 kubeadm.go:310] [preflight] The system verification failed. Printing the output from the verification:
	I0924 00:36:01.655856 1874359 kubeadm.go:310] KERNEL_VERSION: 5.15.0-1070-aws
	I0924 00:36:01.655907 1874359 kubeadm.go:310] OS: Linux
	I0924 00:36:01.655967 1874359 kubeadm.go:310] CGROUPS_CPU: enabled
	I0924 00:36:01.656027 1874359 kubeadm.go:310] CGROUPS_CPUACCT: enabled
	I0924 00:36:01.656089 1874359 kubeadm.go:310] CGROUPS_CPUSET: enabled
	I0924 00:36:01.656141 1874359 kubeadm.go:310] CGROUPS_DEVICES: enabled
	I0924 00:36:01.656201 1874359 kubeadm.go:310] CGROUPS_FREEZER: enabled
	I0924 00:36:01.656264 1874359 kubeadm.go:310] CGROUPS_MEMORY: enabled
	I0924 00:36:01.656324 1874359 kubeadm.go:310] CGROUPS_PIDS: enabled
	I0924 00:36:01.656385 1874359 kubeadm.go:310] CGROUPS_HUGETLB: enabled
	I0924 00:36:01.656445 1874359 kubeadm.go:310] CGROUPS_BLKIO: enabled
	I0924 00:36:01.719525 1874359 kubeadm.go:310] [preflight] Pulling images required for setting up a Kubernetes cluster
	I0924 00:36:01.719648 1874359 kubeadm.go:310] [preflight] This might take a minute or two, depending on the speed of your internet connection
	I0924 00:36:01.719758 1874359 kubeadm.go:310] [preflight] You can also perform this action beforehand using 'kubeadm config images pull'
	I0924 00:36:01.728062 1874359 kubeadm.go:310] [certs] Using certificateDir folder "/var/lib/minikube/certs"
	I0924 00:36:01.731719 1874359 out.go:235]   - Generating certificates and keys ...
	I0924 00:36:01.731836 1874359 kubeadm.go:310] [certs] Using existing ca certificate authority
	I0924 00:36:01.731917 1874359 kubeadm.go:310] [certs] Using existing apiserver certificate and key on disk
	I0924 00:36:01.906779 1874359 kubeadm.go:310] [certs] Generating "apiserver-kubelet-client" certificate and key
	I0924 00:36:02.049111 1874359 kubeadm.go:310] [certs] Generating "front-proxy-ca" certificate and key
	I0924 00:36:02.315960 1874359 kubeadm.go:310] [certs] Generating "front-proxy-client" certificate and key
	I0924 00:36:03.509370 1874359 kubeadm.go:310] [certs] Generating "etcd/ca" certificate and key
	I0924 00:36:03.646997 1874359 kubeadm.go:310] [certs] Generating "etcd/server" certificate and key
	I0924 00:36:03.647141 1874359 kubeadm.go:310] [certs] etcd/server serving cert is signed for DNS names [addons-371349 localhost] and IPs [192.168.49.2 127.0.0.1 ::1]
	I0924 00:36:04.006991 1874359 kubeadm.go:310] [certs] Generating "etcd/peer" certificate and key
	I0924 00:36:04.007349 1874359 kubeadm.go:310] [certs] etcd/peer serving cert is signed for DNS names [addons-371349 localhost] and IPs [192.168.49.2 127.0.0.1 ::1]
	I0924 00:36:04.300686 1874359 kubeadm.go:310] [certs] Generating "etcd/healthcheck-client" certificate and key
	I0924 00:36:05.100917 1874359 kubeadm.go:310] [certs] Generating "apiserver-etcd-client" certificate and key
	I0924 00:36:05.382780 1874359 kubeadm.go:310] [certs] Generating "sa" key and public key
	I0924 00:36:05.383050 1874359 kubeadm.go:310] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"
	I0924 00:36:05.872836 1874359 kubeadm.go:310] [kubeconfig] Writing "admin.conf" kubeconfig file
	I0924 00:36:06.283339 1874359 kubeadm.go:310] [kubeconfig] Writing "super-admin.conf" kubeconfig file
	I0924 00:36:06.905365 1874359 kubeadm.go:310] [kubeconfig] Writing "kubelet.conf" kubeconfig file
	I0924 00:36:07.389536 1874359 kubeadm.go:310] [kubeconfig] Writing "controller-manager.conf" kubeconfig file
	I0924 00:36:07.777598 1874359 kubeadm.go:310] [kubeconfig] Writing "scheduler.conf" kubeconfig file
	I0924 00:36:07.778300 1874359 kubeadm.go:310] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
	I0924 00:36:07.781412 1874359 kubeadm.go:310] [control-plane] Using manifest folder "/etc/kubernetes/manifests"
	I0924 00:36:07.784656 1874359 out.go:235]   - Booting up control plane ...
	I0924 00:36:07.784765 1874359 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-apiserver"
	I0924 00:36:07.784847 1874359 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-controller-manager"
	I0924 00:36:07.784939 1874359 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-scheduler"
	I0924 00:36:07.795428 1874359 kubeadm.go:310] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
	I0924 00:36:07.804702 1874359 kubeadm.go:310] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
	I0924 00:36:07.804863 1874359 kubeadm.go:310] [kubelet-start] Starting the kubelet
	I0924 00:36:07.897266 1874359 kubeadm.go:310] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests"
	I0924 00:36:07.897385 1874359 kubeadm.go:310] [kubelet-check] Waiting for a healthy kubelet at http://127.0.0.1:10248/healthz. This can take up to 4m0s
	I0924 00:36:08.898859 1874359 kubeadm.go:310] [kubelet-check] The kubelet is healthy after 1.001644076s
	I0924 00:36:08.898952 1874359 kubeadm.go:310] [api-check] Waiting for a healthy API server. This can take up to 4m0s
	I0924 00:36:14.400419 1874359 kubeadm.go:310] [api-check] The API server is healthy after 5.501595805s
	I0924 00:36:14.420462 1874359 kubeadm.go:310] [upload-config] Storing the configuration used in ConfigMap "kubeadm-config" in the "kube-system" Namespace
	I0924 00:36:14.434273 1874359 kubeadm.go:310] [kubelet] Creating a ConfigMap "kubelet-config" in namespace kube-system with the configuration for the kubelets in the cluster
	I0924 00:36:14.457766 1874359 kubeadm.go:310] [upload-certs] Skipping phase. Please see --upload-certs
	I0924 00:36:14.458007 1874359 kubeadm.go:310] [mark-control-plane] Marking the node addons-371349 as control-plane by adding the labels: [node-role.kubernetes.io/control-plane node.kubernetes.io/exclude-from-external-load-balancers]
	I0924 00:36:14.468841 1874359 kubeadm.go:310] [bootstrap-token] Using token: fyb3ns.xyo1unypmhns8drs
	I0924 00:36:14.471738 1874359 out.go:235]   - Configuring RBAC rules ...
	I0924 00:36:14.471858 1874359 kubeadm.go:310] [bootstrap-token] Configuring bootstrap tokens, cluster-info ConfigMap, RBAC Roles
	I0924 00:36:14.475171 1874359 kubeadm.go:310] [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to get nodes
	I0924 00:36:14.482586 1874359 kubeadm.go:310] [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to post CSRs in order for nodes to get long term certificate credentials
	I0924 00:36:14.486317 1874359 kubeadm.go:310] [bootstrap-token] Configured RBAC rules to allow the csrapprover controller automatically approve CSRs from a Node Bootstrap Token
	I0924 00:36:14.492041 1874359 kubeadm.go:310] [bootstrap-token] Configured RBAC rules to allow certificate rotation for all node client certificates in the cluster
	I0924 00:36:14.495775 1874359 kubeadm.go:310] [bootstrap-token] Creating the "cluster-info" ConfigMap in the "kube-public" namespace
	I0924 00:36:14.807767 1874359 kubeadm.go:310] [kubelet-finalize] Updating "/etc/kubernetes/kubelet.conf" to point to a rotatable kubelet client certificate and key
	I0924 00:36:15.233069 1874359 kubeadm.go:310] [addons] Applied essential addon: CoreDNS
	I0924 00:36:15.807451 1874359 kubeadm.go:310] [addons] Applied essential addon: kube-proxy
	I0924 00:36:15.808519 1874359 kubeadm.go:310] 
	I0924 00:36:15.808597 1874359 kubeadm.go:310] Your Kubernetes control-plane has initialized successfully!
	I0924 00:36:15.808611 1874359 kubeadm.go:310] 
	I0924 00:36:15.808688 1874359 kubeadm.go:310] To start using your cluster, you need to run the following as a regular user:
	I0924 00:36:15.808698 1874359 kubeadm.go:310] 
	I0924 00:36:15.808723 1874359 kubeadm.go:310]   mkdir -p $HOME/.kube
	I0924 00:36:15.808787 1874359 kubeadm.go:310]   sudo cp -i /etc/kubernetes/admin.conf $HOME/.kube/config
	I0924 00:36:15.808841 1874359 kubeadm.go:310]   sudo chown $(id -u):$(id -g) $HOME/.kube/config
	I0924 00:36:15.808850 1874359 kubeadm.go:310] 
	I0924 00:36:15.808903 1874359 kubeadm.go:310] Alternatively, if you are the root user, you can run:
	I0924 00:36:15.808911 1874359 kubeadm.go:310] 
	I0924 00:36:15.808966 1874359 kubeadm.go:310]   export KUBECONFIG=/etc/kubernetes/admin.conf
	I0924 00:36:15.808982 1874359 kubeadm.go:310] 
	I0924 00:36:15.809034 1874359 kubeadm.go:310] You should now deploy a pod network to the cluster.
	I0924 00:36:15.809111 1874359 kubeadm.go:310] Run "kubectl apply -f [podnetwork].yaml" with one of the options listed at:
	I0924 00:36:15.809191 1874359 kubeadm.go:310]   https://kubernetes.io/docs/concepts/cluster-administration/addons/
	I0924 00:36:15.809201 1874359 kubeadm.go:310] 
	I0924 00:36:15.809290 1874359 kubeadm.go:310] You can now join any number of control-plane nodes by copying certificate authorities
	I0924 00:36:15.809372 1874359 kubeadm.go:310] and service account keys on each node and then running the following as root:
	I0924 00:36:15.809381 1874359 kubeadm.go:310] 
	I0924 00:36:15.809464 1874359 kubeadm.go:310]   kubeadm join control-plane.minikube.internal:8443 --token fyb3ns.xyo1unypmhns8drs \
	I0924 00:36:15.809568 1874359 kubeadm.go:310] 	--discovery-token-ca-cert-hash sha256:92ab852119932e380fabb88b90131863744668403f48ee05cfbc8ebb0fb002df \
	I0924 00:36:15.809591 1874359 kubeadm.go:310] 	--control-plane 
	I0924 00:36:15.809601 1874359 kubeadm.go:310] 
	I0924 00:36:15.809688 1874359 kubeadm.go:310] Then you can join any number of worker nodes by running the following on each as root:
	I0924 00:36:15.809697 1874359 kubeadm.go:310] 
	I0924 00:36:15.809781 1874359 kubeadm.go:310] kubeadm join control-plane.minikube.internal:8443 --token fyb3ns.xyo1unypmhns8drs \
	I0924 00:36:15.809910 1874359 kubeadm.go:310] 	--discovery-token-ca-cert-hash sha256:92ab852119932e380fabb88b90131863744668403f48ee05cfbc8ebb0fb002df 
	I0924 00:36:15.814096 1874359 kubeadm.go:310] W0924 00:36:01.634539    1182 common.go:101] your configuration file uses a deprecated API spec: "kubeadm.k8s.io/v1beta3" (kind: "ClusterConfiguration"). Please use 'kubeadm config migrate --old-config old.yaml --new-config new.yaml', which will write the new, similar spec using a newer API version.
	I0924 00:36:15.814397 1874359 kubeadm.go:310] W0924 00:36:01.635367    1182 common.go:101] your configuration file uses a deprecated API spec: "kubeadm.k8s.io/v1beta3" (kind: "InitConfiguration"). Please use 'kubeadm config migrate --old-config old.yaml --new-config new.yaml', which will write the new, similar spec using a newer API version.
	I0924 00:36:15.814637 1874359 kubeadm.go:310] 	[WARNING SystemVerification]: failed to parse kernel config: unable to load kernel module: "configs", output: "modprobe: FATAL: Module configs not found in directory /lib/modules/5.15.0-1070-aws\n", err: exit status 1
	I0924 00:36:15.814759 1874359 kubeadm.go:310] 	[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
	I0924 00:36:15.814783 1874359 cni.go:84] Creating CNI manager for ""
	I0924 00:36:15.814791 1874359 cni.go:143] "docker" driver + "crio" runtime found, recommending kindnet
	I0924 00:36:15.816668 1874359 out.go:177] * Configuring CNI (Container Networking Interface) ...
	I0924 00:36:15.818482 1874359 ssh_runner.go:195] Run: stat /opt/cni/bin/portmap
	I0924 00:36:15.822601 1874359 cni.go:182] applying CNI manifest using /var/lib/minikube/binaries/v1.31.1/kubectl ...
	I0924 00:36:15.822619 1874359 ssh_runner.go:362] scp memory --> /var/tmp/minikube/cni.yaml (2601 bytes)
	I0924 00:36:15.843203 1874359 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.1/kubectl apply --kubeconfig=/var/lib/minikube/kubeconfig -f /var/tmp/minikube/cni.yaml
	I0924 00:36:16.155987 1874359 ssh_runner.go:195] Run: /bin/bash -c "cat /proc/$(pgrep kube-apiserver)/oom_adj"
	I0924 00:36:16.156142 1874359 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.1/kubectl create clusterrolebinding minikube-rbac --clusterrole=cluster-admin --serviceaccount=kube-system:default --kubeconfig=/var/lib/minikube/kubeconfig
	I0924 00:36:16.156262 1874359 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.1/kubectl --kubeconfig=/var/lib/minikube/kubeconfig label --overwrite nodes addons-371349 minikube.k8s.io/updated_at=2024_09_24T00_36_16_0700 minikube.k8s.io/version=v1.34.0 minikube.k8s.io/commit=41795ff643dcbe39cdf81f27d064464d20ae8e7c minikube.k8s.io/name=addons-371349 minikube.k8s.io/primary=true
	I0924 00:36:16.320925 1874359 ops.go:34] apiserver oom_adj: -16
	I0924 00:36:16.321114 1874359 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0924 00:36:16.821252 1874359 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0924 00:36:17.321244 1874359 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0924 00:36:17.821552 1874359 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0924 00:36:18.322035 1874359 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0924 00:36:18.821736 1874359 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0924 00:36:19.321684 1874359 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0924 00:36:19.821789 1874359 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0924 00:36:19.912113 1874359 kubeadm.go:1113] duration metric: took 3.756037913s to wait for elevateKubeSystemPrivileges
	I0924 00:36:19.912142 1874359 kubeadm.go:394] duration metric: took 18.449591997s to StartCluster
	I0924 00:36:19.912159 1874359 settings.go:142] acquiring lock: {Name:mk1f9eaf6a4c831f2bd4174d069aecdee825d054 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0924 00:36:19.912272 1874359 settings.go:150] Updating kubeconfig:  /home/jenkins/minikube-integration/19696-1868219/kubeconfig
	I0924 00:36:19.912639 1874359 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19696-1868219/kubeconfig: {Name:mk4b43b4b2f636bf366ceefc82df157a927b449f Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0924 00:36:19.912824 1874359 start.go:235] Will wait 6m0s for node &{Name: IP:192.168.49.2 Port:8443 KubernetesVersion:v1.31.1 ContainerRuntime:crio ControlPlane:true Worker:true}
	I0924 00:36:19.912967 1874359 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.31.1/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml"
	I0924 00:36:19.913219 1874359 config.go:182] Loaded profile config "addons-371349": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.31.1
	I0924 00:36:19.913255 1874359 addons.go:507] enable addons start: toEnable=map[ambassador:false auto-pause:false cloud-spanner:true csi-hostpath-driver:true dashboard:false default-storageclass:true efk:false freshpod:false gcp-auth:true gvisor:false headlamp:false inaccel:false ingress:true ingress-dns:true inspektor-gadget:true istio:false istio-provisioner:false kong:false kubeflow:false kubevirt:false logviewer:false metallb:false metrics-server:true nvidia-device-plugin:true nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:true registry-aliases:false registry-creds:false storage-provisioner:true storage-provisioner-gluster:false storage-provisioner-rancher:true volcano:true volumesnapshots:true yakd:true]
	I0924 00:36:19.913337 1874359 addons.go:69] Setting yakd=true in profile "addons-371349"
	I0924 00:36:19.913354 1874359 addons.go:234] Setting addon yakd=true in "addons-371349"
	I0924 00:36:19.913380 1874359 host.go:66] Checking if "addons-371349" exists ...
	I0924 00:36:19.913893 1874359 cli_runner.go:164] Run: docker container inspect addons-371349 --format={{.State.Status}}
	I0924 00:36:19.914281 1874359 addons.go:69] Setting metrics-server=true in profile "addons-371349"
	I0924 00:36:19.914303 1874359 addons.go:234] Setting addon metrics-server=true in "addons-371349"
	I0924 00:36:19.914332 1874359 host.go:66] Checking if "addons-371349" exists ...
	I0924 00:36:19.914762 1874359 cli_runner.go:164] Run: docker container inspect addons-371349 --format={{.State.Status}}
	I0924 00:36:19.914903 1874359 addons.go:69] Setting nvidia-device-plugin=true in profile "addons-371349"
	I0924 00:36:19.914922 1874359 addons.go:234] Setting addon nvidia-device-plugin=true in "addons-371349"
	I0924 00:36:19.914942 1874359 host.go:66] Checking if "addons-371349" exists ...
	I0924 00:36:19.915339 1874359 cli_runner.go:164] Run: docker container inspect addons-371349 --format={{.State.Status}}
	I0924 00:36:19.917403 1874359 addons.go:69] Setting registry=true in profile "addons-371349"
	I0924 00:36:19.917433 1874359 addons.go:234] Setting addon registry=true in "addons-371349"
	I0924 00:36:19.917459 1874359 host.go:66] Checking if "addons-371349" exists ...
	I0924 00:36:19.917922 1874359 cli_runner.go:164] Run: docker container inspect addons-371349 --format={{.State.Status}}
	I0924 00:36:19.919606 1874359 out.go:177] * Verifying Kubernetes components...
	I0924 00:36:19.919769 1874359 addons.go:69] Setting storage-provisioner=true in profile "addons-371349"
	I0924 00:36:19.919795 1874359 addons.go:234] Setting addon storage-provisioner=true in "addons-371349"
	I0924 00:36:19.919823 1874359 host.go:66] Checking if "addons-371349" exists ...
	I0924 00:36:19.920250 1874359 cli_runner.go:164] Run: docker container inspect addons-371349 --format={{.State.Status}}
	I0924 00:36:19.923735 1874359 addons.go:69] Setting storage-provisioner-rancher=true in profile "addons-371349"
	I0924 00:36:19.923769 1874359 addons_storage_classes.go:33] enableOrDisableStorageClasses storage-provisioner-rancher=true on "addons-371349"
	I0924 00:36:19.924079 1874359 cli_runner.go:164] Run: docker container inspect addons-371349 --format={{.State.Status}}
	I0924 00:36:19.926136 1874359 addons.go:69] Setting cloud-spanner=true in profile "addons-371349"
	I0924 00:36:19.926194 1874359 addons.go:234] Setting addon cloud-spanner=true in "addons-371349"
	I0924 00:36:19.926253 1874359 host.go:66] Checking if "addons-371349" exists ...
	I0924 00:36:19.926788 1874359 cli_runner.go:164] Run: docker container inspect addons-371349 --format={{.State.Status}}
	I0924 00:36:19.935402 1874359 addons.go:69] Setting volcano=true in profile "addons-371349"
	I0924 00:36:19.935434 1874359 addons.go:234] Setting addon volcano=true in "addons-371349"
	I0924 00:36:19.935472 1874359 host.go:66] Checking if "addons-371349" exists ...
	I0924 00:36:19.935980 1874359 cli_runner.go:164] Run: docker container inspect addons-371349 --format={{.State.Status}}
	I0924 00:36:19.944614 1874359 addons.go:69] Setting csi-hostpath-driver=true in profile "addons-371349"
	I0924 00:36:19.944766 1874359 addons.go:234] Setting addon csi-hostpath-driver=true in "addons-371349"
	I0924 00:36:19.944836 1874359 host.go:66] Checking if "addons-371349" exists ...
	I0924 00:36:19.945418 1874359 cli_runner.go:164] Run: docker container inspect addons-371349 --format={{.State.Status}}
	I0924 00:36:19.966987 1874359 addons.go:69] Setting volumesnapshots=true in profile "addons-371349"
	I0924 00:36:19.967067 1874359 addons.go:234] Setting addon volumesnapshots=true in "addons-371349"
	I0924 00:36:19.967119 1874359 host.go:66] Checking if "addons-371349" exists ...
	I0924 00:36:19.967689 1874359 cli_runner.go:164] Run: docker container inspect addons-371349 --format={{.State.Status}}
	I0924 00:36:19.973077 1874359 addons.go:69] Setting default-storageclass=true in profile "addons-371349"
	I0924 00:36:19.973160 1874359 addons_storage_classes.go:33] enableOrDisableStorageClasses default-storageclass=true on "addons-371349"
	I0924 00:36:19.982732 1874359 cli_runner.go:164] Run: docker container inspect addons-371349 --format={{.State.Status}}
	I0924 00:36:20.001158 1874359 ssh_runner.go:195] Run: sudo systemctl daemon-reload
	I0924 00:36:20.005134 1874359 addons.go:69] Setting gcp-auth=true in profile "addons-371349"
	I0924 00:36:20.005242 1874359 mustload.go:65] Loading cluster: addons-371349
	I0924 00:36:20.005495 1874359 config.go:182] Loaded profile config "addons-371349": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.31.1
	I0924 00:36:20.006158 1874359 cli_runner.go:164] Run: docker container inspect addons-371349 --format={{.State.Status}}
	I0924 00:36:20.027761 1874359 addons.go:69] Setting ingress=true in profile "addons-371349"
	I0924 00:36:20.027838 1874359 addons.go:234] Setting addon ingress=true in "addons-371349"
	I0924 00:36:20.027915 1874359 host.go:66] Checking if "addons-371349" exists ...
	I0924 00:36:20.028423 1874359 cli_runner.go:164] Run: docker container inspect addons-371349 --format={{.State.Status}}
	I0924 00:36:20.040640 1874359 addons.go:69] Setting ingress-dns=true in profile "addons-371349"
	I0924 00:36:20.040746 1874359 addons.go:234] Setting addon ingress-dns=true in "addons-371349"
	I0924 00:36:20.040826 1874359 host.go:66] Checking if "addons-371349" exists ...
	I0924 00:36:20.047419 1874359 cli_runner.go:164] Run: docker container inspect addons-371349 --format={{.State.Status}}
	I0924 00:36:20.062936 1874359 addons.go:69] Setting inspektor-gadget=true in profile "addons-371349"
	I0924 00:36:20.063020 1874359 addons.go:234] Setting addon inspektor-gadget=true in "addons-371349"
	I0924 00:36:20.063086 1874359 host.go:66] Checking if "addons-371349" exists ...
	I0924 00:36:20.063605 1874359 cli_runner.go:164] Run: docker container inspect addons-371349 --format={{.State.Status}}
	I0924 00:36:20.073337 1874359 out.go:177]   - Using image gcr.io/cloud-spanner-emulator/emulator:1.5.24
	I0924 00:36:20.079819 1874359 addons.go:431] installing /etc/kubernetes/addons/deployment.yaml
	I0924 00:36:20.079847 1874359 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/deployment.yaml (1004 bytes)
	I0924 00:36:20.079924 1874359 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-371349
	I0924 00:36:20.083611 1874359 addons.go:234] Setting addon storage-provisioner-rancher=true in "addons-371349"
	I0924 00:36:20.083656 1874359 host.go:66] Checking if "addons-371349" exists ...
	I0924 00:36:20.085706 1874359 cli_runner.go:164] Run: docker container inspect addons-371349 --format={{.State.Status}}
	I0924 00:36:20.097199 1874359 out.go:177]   - Using image registry.k8s.io/sig-storage/csi-resizer:v1.6.0
	I0924 00:36:20.097447 1874359 out.go:177]   - Using image nvcr.io/nvidia/k8s-device-plugin:v0.16.2
	I0924 00:36:20.097629 1874359 out.go:177]   - Using image gcr.io/k8s-minikube/storage-provisioner:v5
	I0924 00:36:20.134921 1874359 out.go:177]   - Using image docker.io/marcnuri/yakd:0.0.5
	W0924 00:36:20.112693 1874359 out.go:270] ! Enabling 'volcano' returned an error: running callbacks: [volcano addon does not support crio]
	I0924 00:36:20.143522 1874359 addons.go:431] installing /etc/kubernetes/addons/nvidia-device-plugin.yaml
	I0924 00:36:20.143539 1874359 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/nvidia-device-plugin.yaml (1966 bytes)
	I0924 00:36:20.143610 1874359 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-371349
	I0924 00:36:20.144160 1874359 out.go:177]   - Using image docker.io/registry:2.8.3
	I0924 00:36:20.144325 1874359 out.go:177]   - Using image registry.k8s.io/metrics-server/metrics-server:v0.7.2
	I0924 00:36:20.144440 1874359 addons.go:431] installing /etc/kubernetes/addons/storage-provisioner.yaml
	I0924 00:36:20.145869 1874359 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storage-provisioner.yaml (2676 bytes)
	I0924 00:36:20.145935 1874359 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-371349
	I0924 00:36:20.162770 1874359 addons.go:431] installing /etc/kubernetes/addons/yakd-ns.yaml
	I0924 00:36:20.162797 1874359 ssh_runner.go:362] scp yakd/yakd-ns.yaml --> /etc/kubernetes/addons/yakd-ns.yaml (171 bytes)
	I0924 00:36:20.162863 1874359 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-371349
	I0924 00:36:20.145538 1874359 addons.go:234] Setting addon default-storageclass=true in "addons-371349"
	I0924 00:36:20.170888 1874359 host.go:66] Checking if "addons-371349" exists ...
	I0924 00:36:20.171353 1874359 cli_runner.go:164] Run: docker container inspect addons-371349 --format={{.State.Status}}
	I0924 00:36:20.189421 1874359 out.go:177]   - Using image registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0
	I0924 00:36:20.191234 1874359 addons.go:431] installing /etc/kubernetes/addons/metrics-apiservice.yaml
	I0924 00:36:20.191255 1874359 ssh_runner.go:362] scp metrics-server/metrics-apiservice.yaml --> /etc/kubernetes/addons/metrics-apiservice.yaml (424 bytes)
	I0924 00:36:20.191322 1874359 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-371349
	I0924 00:36:20.195761 1874359 out.go:177]   - Using image registry.k8s.io/sig-storage/csi-provisioner:v3.3.0
	I0924 00:36:20.202904 1874359 host.go:66] Checking if "addons-371349" exists ...
	I0924 00:36:20.206400 1874359 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:34691 SSHKeyPath:/home/jenkins/minikube-integration/19696-1868219/.minikube/machines/addons-371349/id_rsa Username:docker}
	I0924 00:36:20.207744 1874359 out.go:177]   - Using image registry.k8s.io/sig-storage/csi-attacher:v4.0.0
	I0924 00:36:20.214882 1874359 out.go:177]   - Using image gcr.io/k8s-minikube/kube-registry-proxy:0.0.6
	I0924 00:36:20.220705 1874359 addons.go:431] installing /etc/kubernetes/addons/registry-rc.yaml
	I0924 00:36:20.220780 1874359 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/registry-rc.yaml (860 bytes)
	I0924 00:36:20.220878 1874359 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-371349
	I0924 00:36:20.221763 1874359 out.go:177]   - Using image registry.k8s.io/sig-storage/csi-external-health-monitor-controller:v0.7.0
	I0924 00:36:20.232800 1874359 out.go:177]   - Using image registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.6.0
	I0924 00:36:20.242508 1874359 out.go:177]   - Using image registry.k8s.io/sig-storage/hostpathplugin:v1.9.0
	I0924 00:36:20.252224 1874359 out.go:177]   - Using image gcr.io/k8s-minikube/minikube-ingress-dns:0.0.3
	I0924 00:36:20.255629 1874359 out.go:177]   - Using image registry.k8s.io/sig-storage/snapshot-controller:v6.1.0
	I0924 00:36:20.255709 1874359 out.go:177]   - Using image docker.io/rancher/local-path-provisioner:v0.0.22
	I0924 00:36:20.255913 1874359 addons.go:431] installing /etc/kubernetes/addons/ingress-dns-pod.yaml
	I0924 00:36:20.255926 1874359 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/ingress-dns-pod.yaml (2442 bytes)
	I0924 00:36:20.256002 1874359 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-371349
	I0924 00:36:20.259897 1874359 out.go:177]   - Using image registry.k8s.io/sig-storage/livenessprobe:v2.8.0
	I0924 00:36:20.260072 1874359 addons.go:431] installing /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml
	I0924 00:36:20.260833 1874359 ssh_runner.go:362] scp volumesnapshots/csi-hostpath-snapshotclass.yaml --> /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml (934 bytes)
	I0924 00:36:20.260903 1874359 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-371349
	I0924 00:36:20.261717 1874359 out.go:177]   - Using image docker.io/busybox:stable
	I0924 00:36:20.264539 1874359 addons.go:431] installing /etc/kubernetes/addons/storage-provisioner-rancher.yaml
	I0924 00:36:20.264561 1874359 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storage-provisioner-rancher.yaml (3113 bytes)
	I0924 00:36:20.264629 1874359 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-371349
	I0924 00:36:20.280599 1874359 addons.go:431] installing /etc/kubernetes/addons/rbac-external-attacher.yaml
	I0924 00:36:20.280625 1874359 ssh_runner.go:362] scp csi-hostpath-driver/rbac/rbac-external-attacher.yaml --> /etc/kubernetes/addons/rbac-external-attacher.yaml (3073 bytes)
	I0924 00:36:20.280702 1874359 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-371349
	I0924 00:36:20.297489 1874359 out.go:177]   - Using image registry.k8s.io/ingress-nginx/kube-webhook-certgen:v1.4.3
	I0924 00:36:20.302057 1874359 out.go:177]   - Using image ghcr.io/inspektor-gadget/inspektor-gadget:v0.32.0
	I0924 00:36:20.305758 1874359 out.go:177]   - Using image registry.k8s.io/ingress-nginx/kube-webhook-certgen:v1.4.3
	I0924 00:36:20.305913 1874359 addons.go:431] installing /etc/kubernetes/addons/ig-namespace.yaml
	I0924 00:36:20.305937 1874359 ssh_runner.go:362] scp inspektor-gadget/ig-namespace.yaml --> /etc/kubernetes/addons/ig-namespace.yaml (55 bytes)
	I0924 00:36:20.306040 1874359 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-371349
	I0924 00:36:20.310783 1874359 out.go:177]   - Using image registry.k8s.io/ingress-nginx/controller:v1.11.2
	I0924 00:36:20.320860 1874359 addons.go:431] installing /etc/kubernetes/addons/ingress-deploy.yaml
	I0924 00:36:20.320935 1874359 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/ingress-deploy.yaml (16078 bytes)
	I0924 00:36:20.321039 1874359 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-371349
	I0924 00:36:20.382635 1874359 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:34691 SSHKeyPath:/home/jenkins/minikube-integration/19696-1868219/.minikube/machines/addons-371349/id_rsa Username:docker}
	I0924 00:36:20.383295 1874359 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:34691 SSHKeyPath:/home/jenkins/minikube-integration/19696-1868219/.minikube/machines/addons-371349/id_rsa Username:docker}
	I0924 00:36:20.395401 1874359 addons.go:431] installing /etc/kubernetes/addons/storageclass.yaml
	I0924 00:36:20.395421 1874359 ssh_runner.go:362] scp storageclass/storageclass.yaml --> /etc/kubernetes/addons/storageclass.yaml (271 bytes)
	I0924 00:36:20.395476 1874359 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-371349
	I0924 00:36:20.402650 1874359 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:34691 SSHKeyPath:/home/jenkins/minikube-integration/19696-1868219/.minikube/machines/addons-371349/id_rsa Username:docker}
	I0924 00:36:20.411638 1874359 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:34691 SSHKeyPath:/home/jenkins/minikube-integration/19696-1868219/.minikube/machines/addons-371349/id_rsa Username:docker}
	I0924 00:36:20.412343 1874359 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:34691 SSHKeyPath:/home/jenkins/minikube-integration/19696-1868219/.minikube/machines/addons-371349/id_rsa Username:docker}
	I0924 00:36:20.434229 1874359 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:34691 SSHKeyPath:/home/jenkins/minikube-integration/19696-1868219/.minikube/machines/addons-371349/id_rsa Username:docker}
	I0924 00:36:20.441444 1874359 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:34691 SSHKeyPath:/home/jenkins/minikube-integration/19696-1868219/.minikube/machines/addons-371349/id_rsa Username:docker}
	I0924 00:36:20.450129 1874359 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:34691 SSHKeyPath:/home/jenkins/minikube-integration/19696-1868219/.minikube/machines/addons-371349/id_rsa Username:docker}
	I0924 00:36:20.465770 1874359 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:34691 SSHKeyPath:/home/jenkins/minikube-integration/19696-1868219/.minikube/machines/addons-371349/id_rsa Username:docker}
	I0924 00:36:20.473465 1874359 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/deployment.yaml
	I0924 00:36:20.484112 1874359 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:34691 SSHKeyPath:/home/jenkins/minikube-integration/19696-1868219/.minikube/machines/addons-371349/id_rsa Username:docker}
	I0924 00:36:20.486490 1874359 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:34691 SSHKeyPath:/home/jenkins/minikube-integration/19696-1868219/.minikube/machines/addons-371349/id_rsa Username:docker}
	I0924 00:36:20.488626 1874359 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:34691 SSHKeyPath:/home/jenkins/minikube-integration/19696-1868219/.minikube/machines/addons-371349/id_rsa Username:docker}
	I0924 00:36:20.637569 1874359 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.31.1/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml | sed -e '/^        forward . \/etc\/resolv.conf.*/i \        hosts {\n           192.168.49.1 host.minikube.internal\n           fallthrough\n        }' -e '/^        errors *$/i \        log' | sudo /var/lib/minikube/binaries/v1.31.1/kubectl --kubeconfig=/var/lib/minikube/kubeconfig replace -f -"
	I0924 00:36:20.637723 1874359 ssh_runner.go:195] Run: sudo systemctl start kubelet
	I0924 00:36:20.756622 1874359 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml
	I0924 00:36:20.767901 1874359 addons.go:431] installing /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml
	I0924 00:36:20.767928 1874359 ssh_runner.go:362] scp volumesnapshots/snapshot.storage.k8s.io_volumesnapshotclasses.yaml --> /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml (6471 bytes)
	I0924 00:36:20.793684 1874359 addons.go:431] installing /etc/kubernetes/addons/yakd-sa.yaml
	I0924 00:36:20.793756 1874359 ssh_runner.go:362] scp yakd/yakd-sa.yaml --> /etc/kubernetes/addons/yakd-sa.yaml (247 bytes)
	I0924 00:36:20.820103 1874359 addons.go:431] installing /etc/kubernetes/addons/registry-svc.yaml
	I0924 00:36:20.820174 1874359 ssh_runner.go:362] scp registry/registry-svc.yaml --> /etc/kubernetes/addons/registry-svc.yaml (398 bytes)
	I0924 00:36:20.839949 1874359 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/nvidia-device-plugin.yaml
	I0924 00:36:20.843294 1874359 addons.go:431] installing /etc/kubernetes/addons/ig-serviceaccount.yaml
	I0924 00:36:20.843373 1874359 ssh_runner.go:362] scp inspektor-gadget/ig-serviceaccount.yaml --> /etc/kubernetes/addons/ig-serviceaccount.yaml (80 bytes)
	I0924 00:36:20.862306 1874359 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/ingress-dns-pod.yaml
	I0924 00:36:20.871400 1874359 addons.go:431] installing /etc/kubernetes/addons/metrics-server-deployment.yaml
	I0924 00:36:20.871469 1874359 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-server-deployment.yaml (1907 bytes)
	I0924 00:36:20.879318 1874359 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/ingress-deploy.yaml
	I0924 00:36:20.901110 1874359 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/storage-provisioner-rancher.yaml
	I0924 00:36:20.928473 1874359 addons.go:431] installing /etc/kubernetes/addons/rbac-hostpath.yaml
	I0924 00:36:20.928553 1874359 ssh_runner.go:362] scp csi-hostpath-driver/rbac/rbac-hostpath.yaml --> /etc/kubernetes/addons/rbac-hostpath.yaml (4266 bytes)
	I0924 00:36:20.931932 1874359 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml
	I0924 00:36:20.935841 1874359 addons.go:431] installing /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml
	I0924 00:36:20.935903 1874359 ssh_runner.go:362] scp volumesnapshots/snapshot.storage.k8s.io_volumesnapshotcontents.yaml --> /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml (23126 bytes)
	I0924 00:36:20.981190 1874359 addons.go:431] installing /etc/kubernetes/addons/ig-role.yaml
	I0924 00:36:20.981266 1874359 ssh_runner.go:362] scp inspektor-gadget/ig-role.yaml --> /etc/kubernetes/addons/ig-role.yaml (210 bytes)
	I0924 00:36:21.013456 1874359 addons.go:431] installing /etc/kubernetes/addons/registry-proxy.yaml
	I0924 00:36:21.013528 1874359 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/registry-proxy.yaml (947 bytes)
	I0924 00:36:21.018372 1874359 addons.go:431] installing /etc/kubernetes/addons/yakd-crb.yaml
	I0924 00:36:21.018444 1874359 ssh_runner.go:362] scp yakd/yakd-crb.yaml --> /etc/kubernetes/addons/yakd-crb.yaml (422 bytes)
	I0924 00:36:21.084717 1874359 addons.go:431] installing /etc/kubernetes/addons/rbac-external-health-monitor-controller.yaml
	I0924 00:36:21.084779 1874359 ssh_runner.go:362] scp csi-hostpath-driver/rbac/rbac-external-health-monitor-controller.yaml --> /etc/kubernetes/addons/rbac-external-health-monitor-controller.yaml (3038 bytes)
	I0924 00:36:21.092294 1874359 addons.go:431] installing /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml
	I0924 00:36:21.092373 1874359 ssh_runner.go:362] scp volumesnapshots/snapshot.storage.k8s.io_volumesnapshots.yaml --> /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml (19582 bytes)
	I0924 00:36:21.100194 1874359 addons.go:431] installing /etc/kubernetes/addons/metrics-server-rbac.yaml
	I0924 00:36:21.100257 1874359 ssh_runner.go:362] scp metrics-server/metrics-server-rbac.yaml --> /etc/kubernetes/addons/metrics-server-rbac.yaml (2175 bytes)
	I0924 00:36:21.171337 1874359 addons.go:431] installing /etc/kubernetes/addons/ig-rolebinding.yaml
	I0924 00:36:21.171414 1874359 ssh_runner.go:362] scp inspektor-gadget/ig-rolebinding.yaml --> /etc/kubernetes/addons/ig-rolebinding.yaml (244 bytes)
	I0924 00:36:21.207779 1874359 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/registry-rc.yaml -f /etc/kubernetes/addons/registry-svc.yaml -f /etc/kubernetes/addons/registry-proxy.yaml
	I0924 00:36:21.212774 1874359 addons.go:431] installing /etc/kubernetes/addons/yakd-svc.yaml
	I0924 00:36:21.212798 1874359 ssh_runner.go:362] scp yakd/yakd-svc.yaml --> /etc/kubernetes/addons/yakd-svc.yaml (412 bytes)
	I0924 00:36:21.265598 1874359 addons.go:431] installing /etc/kubernetes/addons/metrics-server-service.yaml
	I0924 00:36:21.265669 1874359 ssh_runner.go:362] scp metrics-server/metrics-server-service.yaml --> /etc/kubernetes/addons/metrics-server-service.yaml (446 bytes)
	I0924 00:36:21.268714 1874359 addons.go:431] installing /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml
	I0924 00:36:21.268774 1874359 ssh_runner.go:362] scp volumesnapshots/rbac-volume-snapshot-controller.yaml --> /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml (3545 bytes)
	I0924 00:36:21.283692 1874359 addons.go:431] installing /etc/kubernetes/addons/rbac-external-provisioner.yaml
	I0924 00:36:21.283765 1874359 ssh_runner.go:362] scp csi-hostpath-driver/rbac/rbac-external-provisioner.yaml --> /etc/kubernetes/addons/rbac-external-provisioner.yaml (4442 bytes)
	I0924 00:36:21.339390 1874359 addons.go:431] installing /etc/kubernetes/addons/ig-clusterrole.yaml
	I0924 00:36:21.339461 1874359 ssh_runner.go:362] scp inspektor-gadget/ig-clusterrole.yaml --> /etc/kubernetes/addons/ig-clusterrole.yaml (1485 bytes)
	I0924 00:36:21.409963 1874359 addons.go:431] installing /etc/kubernetes/addons/yakd-dp.yaml
	I0924 00:36:21.410032 1874359 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/yakd-dp.yaml (2017 bytes)
	I0924 00:36:21.422530 1874359 addons.go:431] installing /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml
	I0924 00:36:21.422600 1874359 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml (1475 bytes)
	I0924 00:36:21.432482 1874359 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
	I0924 00:36:21.435211 1874359 addons.go:431] installing /etc/kubernetes/addons/rbac-external-resizer.yaml
	I0924 00:36:21.435281 1874359 ssh_runner.go:362] scp csi-hostpath-driver/rbac/rbac-external-resizer.yaml --> /etc/kubernetes/addons/rbac-external-resizer.yaml (2943 bytes)
	I0924 00:36:21.490265 1874359 addons.go:431] installing /etc/kubernetes/addons/ig-clusterrolebinding.yaml
	I0924 00:36:21.490340 1874359 ssh_runner.go:362] scp inspektor-gadget/ig-clusterrolebinding.yaml --> /etc/kubernetes/addons/ig-clusterrolebinding.yaml (274 bytes)
	I0924 00:36:21.554034 1874359 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/yakd-ns.yaml -f /etc/kubernetes/addons/yakd-sa.yaml -f /etc/kubernetes/addons/yakd-crb.yaml -f /etc/kubernetes/addons/yakd-svc.yaml -f /etc/kubernetes/addons/yakd-dp.yaml
	I0924 00:36:21.593261 1874359 addons.go:431] installing /etc/kubernetes/addons/ig-crd.yaml
	I0924 00:36:21.593333 1874359 ssh_runner.go:362] scp inspektor-gadget/ig-crd.yaml --> /etc/kubernetes/addons/ig-crd.yaml (5216 bytes)
	I0924 00:36:21.597542 1874359 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml
	I0924 00:36:21.603447 1874359 addons.go:431] installing /etc/kubernetes/addons/rbac-external-snapshotter.yaml
	I0924 00:36:21.603528 1874359 ssh_runner.go:362] scp csi-hostpath-driver/rbac/rbac-external-snapshotter.yaml --> /etc/kubernetes/addons/rbac-external-snapshotter.yaml (3149 bytes)
	I0924 00:36:21.678474 1874359 addons.go:431] installing /etc/kubernetes/addons/csi-hostpath-attacher.yaml
	I0924 00:36:21.678551 1874359 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/csi-hostpath-attacher.yaml (2143 bytes)
	I0924 00:36:21.696404 1874359 addons.go:431] installing /etc/kubernetes/addons/ig-daemonset.yaml
	I0924 00:36:21.696473 1874359 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/ig-daemonset.yaml (7735 bytes)
	I0924 00:36:21.758367 1874359 addons.go:431] installing /etc/kubernetes/addons/csi-hostpath-driverinfo.yaml
	I0924 00:36:21.758441 1874359 ssh_runner.go:362] scp csi-hostpath-driver/deploy/csi-hostpath-driverinfo.yaml --> /etc/kubernetes/addons/csi-hostpath-driverinfo.yaml (1274 bytes)
	I0924 00:36:21.788195 1874359 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/ig-namespace.yaml -f /etc/kubernetes/addons/ig-serviceaccount.yaml -f /etc/kubernetes/addons/ig-role.yaml -f /etc/kubernetes/addons/ig-rolebinding.yaml -f /etc/kubernetes/addons/ig-clusterrole.yaml -f /etc/kubernetes/addons/ig-clusterrolebinding.yaml -f /etc/kubernetes/addons/ig-crd.yaml -f /etc/kubernetes/addons/ig-daemonset.yaml
	I0924 00:36:21.873070 1874359 addons.go:431] installing /etc/kubernetes/addons/csi-hostpath-plugin.yaml
	I0924 00:36:21.873146 1874359 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/csi-hostpath-plugin.yaml (8201 bytes)
	I0924 00:36:21.996889 1874359 addons.go:431] installing /etc/kubernetes/addons/csi-hostpath-resizer.yaml
	I0924 00:36:21.996961 1874359 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/csi-hostpath-resizer.yaml (2191 bytes)
	I0924 00:36:22.083443 1874359 addons.go:431] installing /etc/kubernetes/addons/csi-hostpath-storageclass.yaml
	I0924 00:36:22.083524 1874359 ssh_runner.go:362] scp csi-hostpath-driver/deploy/csi-hostpath-storageclass.yaml --> /etc/kubernetes/addons/csi-hostpath-storageclass.yaml (846 bytes)
	I0924 00:36:22.163316 1874359 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/rbac-external-attacher.yaml -f /etc/kubernetes/addons/rbac-hostpath.yaml -f /etc/kubernetes/addons/rbac-external-health-monitor-controller.yaml -f /etc/kubernetes/addons/rbac-external-provisioner.yaml -f /etc/kubernetes/addons/rbac-external-resizer.yaml -f /etc/kubernetes/addons/rbac-external-snapshotter.yaml -f /etc/kubernetes/addons/csi-hostpath-attacher.yaml -f /etc/kubernetes/addons/csi-hostpath-driverinfo.yaml -f /etc/kubernetes/addons/csi-hostpath-plugin.yaml -f /etc/kubernetes/addons/csi-hostpath-resizer.yaml -f /etc/kubernetes/addons/csi-hostpath-storageclass.yaml
	I0924 00:36:24.144328 1874359 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/deployment.yaml: (3.670827968s)
	I0924 00:36:24.144432 1874359 ssh_runner.go:235] Completed: sudo systemctl start kubelet: (3.506674064s)
	I0924 00:36:24.145321 1874359 node_ready.go:35] waiting up to 6m0s for node "addons-371349" to be "Ready" ...
	I0924 00:36:24.145408 1874359 ssh_runner.go:235] Completed: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.31.1/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml | sed -e '/^        forward . \/etc\/resolv.conf.*/i \        hosts {\n           192.168.49.1 host.minikube.internal\n           fallthrough\n        }' -e '/^        errors *$/i \        log' | sudo /var/lib/minikube/binaries/v1.31.1/kubectl --kubeconfig=/var/lib/minikube/kubeconfig replace -f -": (3.50777396s)
	I0924 00:36:24.145532 1874359 start.go:971] {"host.minikube.internal": 192.168.49.1} host record injected into CoreDNS's ConfigMap
	I0924 00:36:24.715492 1874359 kapi.go:214] "coredns" deployment in "kube-system" namespace and "addons-371349" context rescaled to 1 replicas
	I0924 00:36:25.040041 1874359 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/nvidia-device-plugin.yaml: (4.199991565s)
	I0924 00:36:25.040144 1874359 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/ingress-dns-pod.yaml: (4.177769917s)
	I0924 00:36:25.040203 1874359 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml: (4.283555204s)
	I0924 00:36:26.068634 1874359 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/storage-provisioner-rancher.yaml: (5.167443532s)
	I0924 00:36:26.068893 1874359 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml: (5.136900017s)
	I0924 00:36:26.069063 1874359 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/registry-rc.yaml -f /etc/kubernetes/addons/registry-svc.yaml -f /etc/kubernetes/addons/registry-proxy.yaml: (4.861212104s)
	I0924 00:36:26.069102 1874359 addons.go:475] Verifying addon registry=true in "addons-371349"
	I0924 00:36:26.069312 1874359 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/ingress-deploy.yaml: (5.189916004s)
	I0924 00:36:26.069352 1874359 addons.go:475] Verifying addon ingress=true in "addons-371349"
	I0924 00:36:26.069638 1874359 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: (4.637069932s)
	I0924 00:36:26.069683 1874359 addons.go:475] Verifying addon metrics-server=true in "addons-371349"
	I0924 00:36:26.069746 1874359 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/yakd-ns.yaml -f /etc/kubernetes/addons/yakd-sa.yaml -f /etc/kubernetes/addons/yakd-crb.yaml -f /etc/kubernetes/addons/yakd-svc.yaml -f /etc/kubernetes/addons/yakd-dp.yaml: (4.515634182s)
	I0924 00:36:26.072113 1874359 out.go:177] * Verifying registry addon...
	I0924 00:36:26.072118 1874359 out.go:177] * To access YAKD - Kubernetes Dashboard, wait for Pod to be ready and run the following command:
	
		minikube -p addons-371349 service yakd-dashboard -n yakd-dashboard
	
	I0924 00:36:26.072265 1874359 out.go:177] * Verifying ingress addon...
	I0924 00:36:26.076283 1874359 kapi.go:75] Waiting for pod with label "kubernetes.io/minikube-addons=registry" in ns "kube-system" ...
	I0924 00:36:26.076406 1874359 kapi.go:75] Waiting for pod with label "app.kubernetes.io/name=ingress-nginx" in ns "ingress-nginx" ...
	I0924 00:36:26.107605 1874359 kapi.go:86] Found 1 Pods for label selector kubernetes.io/minikube-addons=registry
	I0924 00:36:26.107672 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:36:26.108621 1874359 kapi.go:86] Found 3 Pods for label selector app.kubernetes.io/name=ingress-nginx
	I0924 00:36:26.108644 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	W0924 00:36:26.113511 1874359 out.go:270] ! Enabling 'default-storageclass' returned an error: running callbacks: [Error making standard the default storage class: Error while marking storage class local-path as non-default: Operation cannot be fulfilled on storageclasses.storage.k8s.io "local-path": the object has been modified; please apply your changes to the latest version and try again]
	I0924 00:36:26.127645 1874359 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml: (4.530014705s)
	W0924 00:36:26.127709 1874359 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml: Process exited with status 1
	stdout:
	customresourcedefinition.apiextensions.k8s.io/volumesnapshotclasses.snapshot.storage.k8s.io created
	customresourcedefinition.apiextensions.k8s.io/volumesnapshotcontents.snapshot.storage.k8s.io created
	customresourcedefinition.apiextensions.k8s.io/volumesnapshots.snapshot.storage.k8s.io created
	serviceaccount/snapshot-controller created
	clusterrole.rbac.authorization.k8s.io/snapshot-controller-runner created
	clusterrolebinding.rbac.authorization.k8s.io/snapshot-controller-role created
	role.rbac.authorization.k8s.io/snapshot-controller-leaderelection created
	rolebinding.rbac.authorization.k8s.io/snapshot-controller-leaderelection created
	deployment.apps/snapshot-controller created
	
	stderr:
	error: resource mapping not found for name: "csi-hostpath-snapclass" namespace: "" from "/etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml": no matches for kind "VolumeSnapshotClass" in version "snapshot.storage.k8s.io/v1"
	ensure CRDs are installed first
	I0924 00:36:26.127734 1874359 retry.go:31] will retry after 162.565614ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml: Process exited with status 1
	stdout:
	customresourcedefinition.apiextensions.k8s.io/volumesnapshotclasses.snapshot.storage.k8s.io created
	customresourcedefinition.apiextensions.k8s.io/volumesnapshotcontents.snapshot.storage.k8s.io created
	customresourcedefinition.apiextensions.k8s.io/volumesnapshots.snapshot.storage.k8s.io created
	serviceaccount/snapshot-controller created
	clusterrole.rbac.authorization.k8s.io/snapshot-controller-runner created
	clusterrolebinding.rbac.authorization.k8s.io/snapshot-controller-role created
	role.rbac.authorization.k8s.io/snapshot-controller-leaderelection created
	rolebinding.rbac.authorization.k8s.io/snapshot-controller-leaderelection created
	deployment.apps/snapshot-controller created
	
	stderr:
	error: resource mapping not found for name: "csi-hostpath-snapclass" namespace: "" from "/etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml": no matches for kind "VolumeSnapshotClass" in version "snapshot.storage.k8s.io/v1"
	ensure CRDs are installed first
	I0924 00:36:26.127833 1874359 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/ig-namespace.yaml -f /etc/kubernetes/addons/ig-serviceaccount.yaml -f /etc/kubernetes/addons/ig-role.yaml -f /etc/kubernetes/addons/ig-rolebinding.yaml -f /etc/kubernetes/addons/ig-clusterrole.yaml -f /etc/kubernetes/addons/ig-clusterrolebinding.yaml -f /etc/kubernetes/addons/ig-crd.yaml -f /etc/kubernetes/addons/ig-daemonset.yaml: (4.339544749s)
	I0924 00:36:26.158098 1874359 node_ready.go:53] node "addons-371349" has status "Ready":"False"
	I0924 00:36:26.290971 1874359 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply --force -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml
	I0924 00:36:26.520771 1874359 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/rbac-external-attacher.yaml -f /etc/kubernetes/addons/rbac-hostpath.yaml -f /etc/kubernetes/addons/rbac-external-health-monitor-controller.yaml -f /etc/kubernetes/addons/rbac-external-provisioner.yaml -f /etc/kubernetes/addons/rbac-external-resizer.yaml -f /etc/kubernetes/addons/rbac-external-snapshotter.yaml -f /etc/kubernetes/addons/csi-hostpath-attacher.yaml -f /etc/kubernetes/addons/csi-hostpath-driverinfo.yaml -f /etc/kubernetes/addons/csi-hostpath-plugin.yaml -f /etc/kubernetes/addons/csi-hostpath-resizer.yaml -f /etc/kubernetes/addons/csi-hostpath-storageclass.yaml: (4.357357384s)
	I0924 00:36:26.520866 1874359 addons.go:475] Verifying addon csi-hostpath-driver=true in "addons-371349"
	I0924 00:36:26.528436 1874359 out.go:177] * Verifying csi-hostpath-driver addon...
	I0924 00:36:26.531914 1874359 kapi.go:75] Waiting for pod with label "kubernetes.io/minikube-addons=csi-hostpath-driver" in ns "kube-system" ...
	I0924 00:36:26.583310 1874359 kapi.go:86] Found 2 Pods for label selector kubernetes.io/minikube-addons=csi-hostpath-driver
	I0924 00:36:26.583384 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:36:26.615522 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:36:26.616914 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:36:27.036117 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:36:27.083005 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:36:27.087587 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:36:27.537002 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:36:27.581061 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:36:27.581936 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:36:28.040270 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:36:28.103999 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:36:28.106903 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:36:28.535961 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:36:28.583290 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:36:28.584302 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:36:28.649628 1874359 node_ready.go:53] node "addons-371349" has status "Ready":"False"
	I0924 00:36:29.129807 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:36:29.142056 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:36:29.142873 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:36:29.421608 1874359 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply --force -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml: (3.130525161s)
	I0924 00:36:29.536654 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:36:29.581589 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:36:29.582881 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:36:30.036664 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:36:30.081849 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:36:30.082302 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:36:30.112100 1874359 ssh_runner.go:362] scp memory --> /var/lib/minikube/google_application_credentials.json (162 bytes)
	I0924 00:36:30.112214 1874359 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-371349
	I0924 00:36:30.142251 1874359 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:34691 SSHKeyPath:/home/jenkins/minikube-integration/19696-1868219/.minikube/machines/addons-371349/id_rsa Username:docker}
	I0924 00:36:30.260045 1874359 ssh_runner.go:362] scp memory --> /var/lib/minikube/google_cloud_project (12 bytes)
	I0924 00:36:30.277969 1874359 addons.go:234] Setting addon gcp-auth=true in "addons-371349"
	I0924 00:36:30.278019 1874359 host.go:66] Checking if "addons-371349" exists ...
	I0924 00:36:30.278556 1874359 cli_runner.go:164] Run: docker container inspect addons-371349 --format={{.State.Status}}
	I0924 00:36:30.315639 1874359 ssh_runner.go:195] Run: cat /var/lib/minikube/google_application_credentials.json
	I0924 00:36:30.315718 1874359 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-371349
	I0924 00:36:30.339988 1874359 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:34691 SSHKeyPath:/home/jenkins/minikube-integration/19696-1868219/.minikube/machines/addons-371349/id_rsa Username:docker}
	I0924 00:36:30.440287 1874359 out.go:177]   - Using image registry.k8s.io/ingress-nginx/kube-webhook-certgen:v1.4.3
	I0924 00:36:30.443290 1874359 out.go:177]   - Using image gcr.io/k8s-minikube/gcp-auth-webhook:v0.1.2
	I0924 00:36:30.446069 1874359 addons.go:431] installing /etc/kubernetes/addons/gcp-auth-ns.yaml
	I0924 00:36:30.446097 1874359 ssh_runner.go:362] scp gcp-auth/gcp-auth-ns.yaml --> /etc/kubernetes/addons/gcp-auth-ns.yaml (700 bytes)
	I0924 00:36:30.465311 1874359 addons.go:431] installing /etc/kubernetes/addons/gcp-auth-service.yaml
	I0924 00:36:30.465336 1874359 ssh_runner.go:362] scp gcp-auth/gcp-auth-service.yaml --> /etc/kubernetes/addons/gcp-auth-service.yaml (788 bytes)
	I0924 00:36:30.486054 1874359 addons.go:431] installing /etc/kubernetes/addons/gcp-auth-webhook.yaml
	I0924 00:36:30.486127 1874359 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/gcp-auth-webhook.yaml (5421 bytes)
	I0924 00:36:30.505251 1874359 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/gcp-auth-ns.yaml -f /etc/kubernetes/addons/gcp-auth-service.yaml -f /etc/kubernetes/addons/gcp-auth-webhook.yaml
	I0924 00:36:30.536649 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:36:30.585185 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:36:30.586030 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:36:31.014868 1874359 addons.go:475] Verifying addon gcp-auth=true in "addons-371349"
	I0924 00:36:31.017554 1874359 out.go:177] * Verifying gcp-auth addon...
	I0924 00:36:31.021050 1874359 kapi.go:75] Waiting for pod with label "kubernetes.io/minikube-addons=gcp-auth" in ns "gcp-auth" ...
	I0924 00:36:31.034140 1874359 kapi.go:86] Found 1 Pods for label selector kubernetes.io/minikube-addons=gcp-auth
	I0924 00:36:31.034176 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:36:31.038331 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:36:31.134014 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:36:31.134925 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:36:31.148888 1874359 node_ready.go:53] node "addons-371349" has status "Ready":"False"
	I0924 00:36:31.524715 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:36:31.537587 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:36:31.583545 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:36:31.584292 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:36:32.029580 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:36:32.036463 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:36:32.079906 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:36:32.080747 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:36:32.525406 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:36:32.536047 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:36:32.581774 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:36:32.585020 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:36:33.025869 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:36:33.039581 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:36:33.080579 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:36:33.081397 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:36:33.149384 1874359 node_ready.go:53] node "addons-371349" has status "Ready":"False"
	I0924 00:36:33.524756 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:36:33.535925 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:36:33.580451 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:36:33.581698 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:36:34.024326 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:36:34.036000 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:36:34.080936 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:36:34.081359 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:36:34.524182 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:36:34.535599 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:36:34.579779 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:36:34.580333 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:36:35.024337 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:36:35.036647 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:36:35.080199 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:36:35.081117 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:36:35.524658 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:36:35.535725 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:36:35.580566 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:36:35.581224 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:36:35.648813 1874359 node_ready.go:53] node "addons-371349" has status "Ready":"False"
	I0924 00:36:36.025916 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:36:36.035978 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:36:36.080821 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:36:36.081603 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:36:36.524896 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:36:36.535453 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:36:36.580252 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:36:36.581485 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:36:37.025338 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:36:37.035963 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:36:37.080424 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:36:37.081442 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:36:37.524490 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:36:37.535728 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:36:37.579810 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:36:37.581450 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:36:38.024561 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:36:38.035487 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:36:38.080210 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:36:38.082742 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:36:38.148994 1874359 node_ready.go:53] node "addons-371349" has status "Ready":"False"
	I0924 00:36:38.525127 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:36:38.535345 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:36:38.580908 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:36:38.581362 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:36:39.024793 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:36:39.036425 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:36:39.080915 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:36:39.081967 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:36:39.525001 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:36:39.535354 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:36:39.580559 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:36:39.581513 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:36:40.024267 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:36:40.035238 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:36:40.080207 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:36:40.080204 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:36:40.149660 1874359 node_ready.go:53] node "addons-371349" has status "Ready":"False"
	I0924 00:36:40.524758 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:36:40.535590 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:36:40.581048 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:36:40.581408 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:36:41.024637 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:36:41.035772 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:36:41.080701 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:36:41.081021 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:36:41.524234 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:36:41.535462 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:36:41.580520 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:36:41.580776 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:36:42.024539 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:36:42.035544 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:36:42.081006 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:36:42.081307 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:36:42.524245 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:36:42.536155 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:36:42.580946 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:36:42.581039 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:36:42.648989 1874359 node_ready.go:53] node "addons-371349" has status "Ready":"False"
	I0924 00:36:43.025024 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:36:43.035416 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:36:43.079956 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:36:43.080806 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:36:43.524635 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:36:43.535313 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:36:43.579628 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:36:43.580591 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:36:44.024154 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:36:44.035337 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:36:44.080930 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:36:44.081486 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:36:44.525015 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:36:44.535108 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:36:44.580734 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:36:44.581548 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:36:45.025561 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:36:45.036042 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:36:45.082616 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:36:45.083677 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:36:45.149247 1874359 node_ready.go:53] node "addons-371349" has status "Ready":"False"
	I0924 00:36:45.525119 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:36:45.535570 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:36:45.581478 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:36:45.581723 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:36:46.024775 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:36:46.035430 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:36:46.080597 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:36:46.081121 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:36:46.524273 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:36:46.535421 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:36:46.580411 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:36:46.581494 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:36:47.024132 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:36:47.035958 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:36:47.079502 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:36:47.080659 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:36:47.524705 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:36:47.535463 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:36:47.579773 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:36:47.580840 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:36:47.648951 1874359 node_ready.go:53] node "addons-371349" has status "Ready":"False"
	I0924 00:36:48.024023 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:36:48.035180 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:36:48.080902 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:36:48.081690 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:36:48.525022 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:36:48.536041 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:36:48.580288 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:36:48.581384 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:36:49.024579 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:36:49.035983 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:36:49.080718 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:36:49.080794 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:36:49.524098 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:36:49.535304 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:36:49.580015 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:36:49.580711 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:36:49.651222 1874359 node_ready.go:53] node "addons-371349" has status "Ready":"False"
	I0924 00:36:50.024822 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:36:50.035661 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:36:50.081077 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:36:50.082067 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:36:50.523919 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:36:50.535086 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:36:50.579884 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:36:50.580617 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:36:51.024943 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:36:51.035906 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:36:51.080734 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:36:51.081047 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:36:51.525622 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:36:51.536144 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:36:51.582237 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:36:51.583744 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:36:52.024267 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:36:52.036157 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:36:52.080111 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:36:52.081119 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:36:52.149795 1874359 node_ready.go:53] node "addons-371349" has status "Ready":"False"
	I0924 00:36:52.524484 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:36:52.535733 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:36:52.580708 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:36:52.581326 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:36:53.024426 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:36:53.035238 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:36:53.081149 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:36:53.081259 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:36:53.523963 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:36:53.535867 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:36:53.580059 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:36:53.581802 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:36:54.024133 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:36:54.035572 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:36:54.081089 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:36:54.081851 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:36:54.524697 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:36:54.535922 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:36:54.580674 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:36:54.582700 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:36:54.648817 1874359 node_ready.go:53] node "addons-371349" has status "Ready":"False"
	I0924 00:36:55.024396 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:36:55.035661 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:36:55.080437 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:36:55.081018 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:36:55.525458 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:36:55.535674 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:36:55.580138 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:36:55.580887 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:36:56.024509 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:36:56.035901 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:36:56.079969 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:36:56.080725 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:36:56.524906 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:36:56.535679 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:36:56.580177 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:36:56.581395 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:36:57.024701 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:36:57.035901 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:36:57.080025 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:36:57.086044 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:36:57.148897 1874359 node_ready.go:53] node "addons-371349" has status "Ready":"False"
	I0924 00:36:57.524749 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:36:57.535483 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:36:57.580740 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:36:57.581056 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:36:58.024670 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:36:58.035904 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:36:58.080311 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:36:58.081007 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:36:58.524825 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:36:58.536045 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:36:58.579614 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:36:58.580465 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:36:59.024996 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:36:59.035397 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:36:59.080751 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:36:59.081451 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:36:59.524791 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:36:59.535925 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:36:59.580042 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:36:59.580800 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:36:59.649115 1874359 node_ready.go:53] node "addons-371349" has status "Ready":"False"
	I0924 00:37:00.042032 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:37:00.047337 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:37:00.083641 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:37:00.088909 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:37:00.524811 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:37:00.535611 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:37:00.581337 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:37:00.581599 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:37:01.024579 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:37:01.035532 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:37:01.080587 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:37:01.080960 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:37:01.524641 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:37:01.535695 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:37:01.580144 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:37:01.581256 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:37:01.649384 1874359 node_ready.go:53] node "addons-371349" has status "Ready":"False"
	I0924 00:37:02.025866 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:37:02.034934 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:37:02.081837 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:37:02.083560 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:37:02.524543 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:37:02.536023 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:37:02.580909 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:37:02.581242 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:37:03.024869 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:37:03.035126 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:37:03.080270 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:37:03.081025 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:37:03.524304 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:37:03.534941 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:37:03.579827 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:37:03.580519 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:37:04.024963 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:37:04.035474 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:37:04.080069 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:37:04.080924 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:37:04.148842 1874359 node_ready.go:53] node "addons-371349" has status "Ready":"False"
	I0924 00:37:04.524509 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:37:04.535251 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:37:04.580524 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:37:04.580751 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:37:05.089907 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:37:05.146256 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:37:05.148938 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:37:05.150236 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:37:05.179538 1874359 node_ready.go:49] node "addons-371349" has status "Ready":"True"
	I0924 00:37:05.179566 1874359 node_ready.go:38] duration metric: took 41.034106017s for node "addons-371349" to be "Ready" ...
	I0924 00:37:05.179588 1874359 pod_ready.go:36] extra waiting up to 6m0s for all system-critical pods including labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
	I0924 00:37:05.207895 1874359 pod_ready.go:79] waiting up to 6m0s for pod "coredns-7c65d6cfc9-bsbwf" in "kube-system" namespace to be "Ready" ...
	I0924 00:37:05.558862 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:37:05.602208 1874359 kapi.go:86] Found 3 Pods for label selector kubernetes.io/minikube-addons=csi-hostpath-driver
	I0924 00:37:05.602281 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:37:05.642597 1874359 kapi.go:86] Found 2 Pods for label selector kubernetes.io/minikube-addons=registry
	I0924 00:37:05.642664 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:37:05.644171 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:37:06.027664 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:37:06.127307 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:37:06.128297 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:37:06.129576 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:37:06.525542 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:37:06.537888 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:37:06.580363 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:37:06.581449 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:37:06.714501 1874359 pod_ready.go:93] pod "coredns-7c65d6cfc9-bsbwf" in "kube-system" namespace has status "Ready":"True"
	I0924 00:37:06.714528 1874359 pod_ready.go:82] duration metric: took 1.506549159s for pod "coredns-7c65d6cfc9-bsbwf" in "kube-system" namespace to be "Ready" ...
	I0924 00:37:06.714551 1874359 pod_ready.go:79] waiting up to 6m0s for pod "etcd-addons-371349" in "kube-system" namespace to be "Ready" ...
	I0924 00:37:06.719528 1874359 pod_ready.go:93] pod "etcd-addons-371349" in "kube-system" namespace has status "Ready":"True"
	I0924 00:37:06.719552 1874359 pod_ready.go:82] duration metric: took 4.992556ms for pod "etcd-addons-371349" in "kube-system" namespace to be "Ready" ...
	I0924 00:37:06.719568 1874359 pod_ready.go:79] waiting up to 6m0s for pod "kube-apiserver-addons-371349" in "kube-system" namespace to be "Ready" ...
	I0924 00:37:06.724493 1874359 pod_ready.go:93] pod "kube-apiserver-addons-371349" in "kube-system" namespace has status "Ready":"True"
	I0924 00:37:06.724526 1874359 pod_ready.go:82] duration metric: took 4.941719ms for pod "kube-apiserver-addons-371349" in "kube-system" namespace to be "Ready" ...
	I0924 00:37:06.724537 1874359 pod_ready.go:79] waiting up to 6m0s for pod "kube-controller-manager-addons-371349" in "kube-system" namespace to be "Ready" ...
	I0924 00:37:06.729495 1874359 pod_ready.go:93] pod "kube-controller-manager-addons-371349" in "kube-system" namespace has status "Ready":"True"
	I0924 00:37:06.729522 1874359 pod_ready.go:82] duration metric: took 4.976417ms for pod "kube-controller-manager-addons-371349" in "kube-system" namespace to be "Ready" ...
	I0924 00:37:06.729536 1874359 pod_ready.go:79] waiting up to 6m0s for pod "kube-proxy-qcb9f" in "kube-system" namespace to be "Ready" ...
	I0924 00:37:06.749711 1874359 pod_ready.go:93] pod "kube-proxy-qcb9f" in "kube-system" namespace has status "Ready":"True"
	I0924 00:37:06.749739 1874359 pod_ready.go:82] duration metric: took 20.168473ms for pod "kube-proxy-qcb9f" in "kube-system" namespace to be "Ready" ...
	I0924 00:37:06.749753 1874359 pod_ready.go:79] waiting up to 6m0s for pod "kube-scheduler-addons-371349" in "kube-system" namespace to be "Ready" ...
	I0924 00:37:07.025711 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:37:07.038223 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:37:07.081942 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:37:07.087767 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:37:07.149444 1874359 pod_ready.go:93] pod "kube-scheduler-addons-371349" in "kube-system" namespace has status "Ready":"True"
	I0924 00:37:07.149478 1874359 pod_ready.go:82] duration metric: took 399.67927ms for pod "kube-scheduler-addons-371349" in "kube-system" namespace to be "Ready" ...
	I0924 00:37:07.149493 1874359 pod_ready.go:79] waiting up to 6m0s for pod "metrics-server-84c5f94fbc-wxd2s" in "kube-system" namespace to be "Ready" ...
	I0924 00:37:07.527967 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:37:07.537140 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:37:07.581804 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:37:07.589930 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:37:08.024515 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:37:08.037935 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:37:08.080943 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:37:08.082144 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:37:08.526095 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:37:08.627092 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:37:08.628004 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:37:08.629352 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:37:09.025639 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:37:09.037030 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:37:09.080958 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:37:09.082245 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:37:09.156164 1874359 pod_ready.go:103] pod "metrics-server-84c5f94fbc-wxd2s" in "kube-system" namespace has status "Ready":"False"
	I0924 00:37:09.525206 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:37:09.536652 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:37:09.580423 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:37:09.581569 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:37:10.024542 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:37:10.036488 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:37:10.083141 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:37:10.083751 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:37:10.525674 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:37:10.539556 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:37:10.581513 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:37:10.582166 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:37:11.025092 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:37:11.037039 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:37:11.080754 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:37:11.082596 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:37:11.529972 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:37:11.542182 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:37:11.627456 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:37:11.628865 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:37:11.659076 1874359 pod_ready.go:103] pod "metrics-server-84c5f94fbc-wxd2s" in "kube-system" namespace has status "Ready":"False"
	I0924 00:37:12.024999 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:37:12.036841 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:37:12.083120 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:37:12.087612 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:37:12.524562 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:37:12.537338 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:37:12.580705 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:37:12.584105 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:37:13.025189 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:37:13.037496 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:37:13.087190 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:37:13.089015 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:37:13.525150 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:37:13.538733 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:37:13.584085 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:37:13.585380 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:37:14.027157 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:37:14.037065 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:37:14.084801 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:37:14.085746 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:37:14.157004 1874359 pod_ready.go:103] pod "metrics-server-84c5f94fbc-wxd2s" in "kube-system" namespace has status "Ready":"False"
	I0924 00:37:14.525171 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:37:14.536194 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:37:14.626376 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:37:14.627039 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:37:15.024978 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:37:15.037209 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:37:15.090958 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:37:15.091024 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:37:15.525306 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:37:15.538434 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:37:15.585043 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:37:15.587617 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:37:16.025459 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:37:16.037260 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:37:16.126894 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:37:16.130568 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:37:16.158943 1874359 pod_ready.go:103] pod "metrics-server-84c5f94fbc-wxd2s" in "kube-system" namespace has status "Ready":"False"
	I0924 00:37:16.525066 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:37:16.536819 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:37:16.582319 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:37:16.584728 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:37:17.024258 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:37:17.036828 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:37:17.080446 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:37:17.080931 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:37:17.525099 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:37:17.536245 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:37:17.580612 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:37:17.581968 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:37:18.025910 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:37:18.038077 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:37:18.080436 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:37:18.083296 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:37:18.527808 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:37:18.537402 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:37:18.630293 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:37:18.631606 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:37:18.659678 1874359 pod_ready.go:103] pod "metrics-server-84c5f94fbc-wxd2s" in "kube-system" namespace has status "Ready":"False"
	I0924 00:37:19.024917 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:37:19.037952 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:37:19.080673 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:37:19.082011 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:37:19.526385 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:37:19.537535 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:37:19.582985 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:37:19.583884 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:37:20.025520 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:37:20.037056 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:37:20.082107 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:37:20.083379 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:37:20.533110 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:37:20.536253 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:37:20.580380 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:37:20.581682 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:37:21.025861 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:37:21.036666 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:37:21.081257 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:37:21.082276 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:37:21.155291 1874359 pod_ready.go:103] pod "metrics-server-84c5f94fbc-wxd2s" in "kube-system" namespace has status "Ready":"False"
	I0924 00:37:21.525011 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:37:21.536910 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:37:21.580560 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:37:21.581558 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:37:22.024754 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:37:22.045868 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:37:22.081285 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:37:22.092291 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:37:22.524880 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:37:22.536206 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:37:22.582528 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:37:22.583540 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:37:23.024908 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:37:23.038687 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:37:23.083594 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:37:23.087148 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:37:23.166572 1874359 pod_ready.go:103] pod "metrics-server-84c5f94fbc-wxd2s" in "kube-system" namespace has status "Ready":"False"
	I0924 00:37:23.525800 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:37:23.538193 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:37:23.583530 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:37:23.585180 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:37:24.025641 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:37:24.037958 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:37:24.086952 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:37:24.091709 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:37:24.529436 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:37:24.539653 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:37:24.582335 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:37:24.583840 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:37:25.025439 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:37:25.038394 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:37:25.081750 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:37:25.092141 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:37:25.526868 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:37:25.538477 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:37:25.588303 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:37:25.589649 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:37:25.658759 1874359 pod_ready.go:103] pod "metrics-server-84c5f94fbc-wxd2s" in "kube-system" namespace has status "Ready":"False"
	I0924 00:37:26.028966 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:37:26.039906 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:37:26.085009 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:37:26.086281 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:37:26.525400 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:37:26.537986 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:37:26.582372 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:37:26.583325 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:37:27.024598 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:37:27.036494 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:37:27.082090 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:37:27.083243 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:37:27.526087 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:37:27.536693 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:37:27.585781 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:37:27.587193 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:37:28.024899 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:37:28.037156 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:37:28.084220 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:37:28.086472 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:37:28.155018 1874359 pod_ready.go:103] pod "metrics-server-84c5f94fbc-wxd2s" in "kube-system" namespace has status "Ready":"False"
	I0924 00:37:28.525481 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:37:28.537283 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:37:28.581429 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:37:28.582651 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:37:29.028915 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:37:29.041859 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:37:29.083052 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:37:29.084536 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:37:29.524326 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:37:29.538851 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:37:29.580454 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:37:29.581371 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:37:30.025742 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:37:30.040126 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:37:30.088822 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:37:30.089975 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:37:30.169449 1874359 pod_ready.go:103] pod "metrics-server-84c5f94fbc-wxd2s" in "kube-system" namespace has status "Ready":"False"
	I0924 00:37:30.525768 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:37:30.542144 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:37:30.582292 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:37:30.583557 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:37:31.025479 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:37:31.037617 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:37:31.086866 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:37:31.088089 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:37:31.524826 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:37:31.536697 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:37:31.581167 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:37:31.582168 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:37:32.024816 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:37:32.037176 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:37:32.082087 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:37:32.082530 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:37:32.525146 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:37:32.536628 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:37:32.582408 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:37:32.584925 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:37:32.655890 1874359 pod_ready.go:103] pod "metrics-server-84c5f94fbc-wxd2s" in "kube-system" namespace has status "Ready":"False"
	I0924 00:37:33.024977 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:37:33.044508 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:37:33.082373 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:37:33.088346 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:37:33.526214 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:37:33.540746 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:37:33.583760 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:37:33.585189 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:37:34.025056 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:37:34.037589 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:37:34.082589 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:37:34.086961 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:37:34.525641 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:37:34.537798 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:37:34.584630 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:37:34.586996 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:37:34.659691 1874359 pod_ready.go:103] pod "metrics-server-84c5f94fbc-wxd2s" in "kube-system" namespace has status "Ready":"False"
	I0924 00:37:35.025955 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:37:35.037530 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:37:35.085784 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:37:35.088173 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:37:35.526354 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:37:35.538479 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:37:35.591723 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:37:35.592824 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:37:36.025497 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:37:36.037602 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:37:36.083224 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:37:36.087183 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:37:36.529702 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:37:36.538066 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:37:36.581116 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:37:36.582309 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:37:37.025278 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:37:37.037273 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:37:37.081162 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:37:37.082133 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:37:37.155957 1874359 pod_ready.go:103] pod "metrics-server-84c5f94fbc-wxd2s" in "kube-system" namespace has status "Ready":"False"
	I0924 00:37:37.524751 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:37:37.537323 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:37:37.581677 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:37:37.582621 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:37:38.024821 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:37:38.037096 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:37:38.081199 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:37:38.082023 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:37:38.524480 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:37:38.536790 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:37:38.581212 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:37:38.581536 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:37:39.045544 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:37:39.059204 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:37:39.082025 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:37:39.085281 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:37:39.157501 1874359 pod_ready.go:103] pod "metrics-server-84c5f94fbc-wxd2s" in "kube-system" namespace has status "Ready":"False"
	I0924 00:37:39.525548 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:37:39.537916 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:37:39.581805 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:37:39.583375 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:37:40.026572 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:37:40.040843 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:37:40.082291 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:37:40.083067 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:37:40.524989 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:37:40.537105 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:37:40.585930 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:37:40.587514 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:37:41.029782 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:37:41.037748 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:37:41.090908 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:37:41.099541 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:37:41.525223 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:37:41.537455 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:37:41.597760 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:37:41.598335 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:37:41.656910 1874359 pod_ready.go:103] pod "metrics-server-84c5f94fbc-wxd2s" in "kube-system" namespace has status "Ready":"False"
	I0924 00:37:42.024504 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:37:42.037336 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:37:42.081180 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:37:42.082250 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:37:42.525242 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:37:42.537114 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:37:42.581394 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:37:42.582401 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:37:43.025428 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:37:43.036674 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:37:43.080101 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:37:43.081322 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:37:43.524449 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:37:43.536809 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:37:43.580565 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:37:43.581555 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:37:43.657385 1874359 pod_ready.go:103] pod "metrics-server-84c5f94fbc-wxd2s" in "kube-system" namespace has status "Ready":"False"
	I0924 00:37:44.025083 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:37:44.036712 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:37:44.081458 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:37:44.082346 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:37:44.525241 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:37:44.537777 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:37:44.583018 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:37:44.583564 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:37:45.026665 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:37:45.039492 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:37:45.084260 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:37:45.089405 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:37:45.525091 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:37:45.537406 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:37:45.580479 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:37:45.581943 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:37:46.025973 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:37:46.036622 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:37:46.081671 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:37:46.082347 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:37:46.156709 1874359 pod_ready.go:103] pod "metrics-server-84c5f94fbc-wxd2s" in "kube-system" namespace has status "Ready":"False"
	I0924 00:37:46.525927 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:37:46.537762 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:37:46.582385 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:37:46.585178 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:37:47.024474 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:37:47.036329 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:37:47.127012 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:37:47.127911 1874359 kapi.go:107] duration metric: took 1m21.05162918s to wait for kubernetes.io/minikube-addons=registry ...
	I0924 00:37:47.525100 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:37:47.536497 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:37:47.581247 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:37:48.026371 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:37:48.038903 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:37:48.081959 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:37:48.163263 1874359 pod_ready.go:103] pod "metrics-server-84c5f94fbc-wxd2s" in "kube-system" namespace has status "Ready":"False"
	I0924 00:37:48.525594 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:37:48.537361 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:37:48.580855 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:37:49.026110 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:37:49.036648 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:37:49.083100 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:37:49.526547 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:37:49.537074 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:37:49.581783 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:37:50.025551 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:37:50.037461 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:37:50.091209 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:37:50.526125 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:37:50.538037 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:37:50.581389 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:37:50.656358 1874359 pod_ready.go:103] pod "metrics-server-84c5f94fbc-wxd2s" in "kube-system" namespace has status "Ready":"False"
	I0924 00:37:51.024559 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:37:51.036562 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:37:51.126796 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:37:51.525215 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:37:51.539279 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:37:51.580966 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:37:52.024488 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:37:52.036345 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:37:52.081028 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:37:52.525396 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:37:52.536020 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:37:52.582181 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:37:53.024883 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:37:53.037277 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:37:53.081315 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:37:53.157617 1874359 pod_ready.go:103] pod "metrics-server-84c5f94fbc-wxd2s" in "kube-system" namespace has status "Ready":"False"
	I0924 00:37:53.531462 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:37:53.551300 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:37:53.581174 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:37:54.035236 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:37:54.038756 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:37:54.081353 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:37:54.525628 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:37:54.537870 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:37:54.582071 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:37:55.024989 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:37:55.037361 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:37:55.082676 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:37:55.159960 1874359 pod_ready.go:103] pod "metrics-server-84c5f94fbc-wxd2s" in "kube-system" namespace has status "Ready":"False"
	I0924 00:37:55.524909 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:37:55.536796 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:37:55.588343 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:37:56.024551 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:37:56.036790 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:37:56.082494 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:37:56.524588 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:37:56.537087 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:37:56.580954 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:37:57.024654 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:37:57.038690 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:37:57.126095 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:37:57.524362 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:37:57.537019 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:37:57.580612 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:37:57.655571 1874359 pod_ready.go:103] pod "metrics-server-84c5f94fbc-wxd2s" in "kube-system" namespace has status "Ready":"False"
	I0924 00:37:58.024601 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:37:58.037441 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:37:58.081534 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:37:58.526040 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:37:58.538585 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:37:58.581369 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:37:59.025374 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:37:59.038033 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:37:59.081690 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:37:59.525152 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:37:59.536805 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:37:59.581719 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:38:00.037589 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:38:00.053908 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:38:00.099069 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:38:00.161051 1874359 pod_ready.go:103] pod "metrics-server-84c5f94fbc-wxd2s" in "kube-system" namespace has status "Ready":"False"
	I0924 00:38:00.525439 1874359 kapi.go:107] duration metric: took 1m29.504386686s to wait for kubernetes.io/minikube-addons=gcp-auth ...
	I0924 00:38:00.527071 1874359 out.go:177] * Your GCP credentials will now be mounted into every pod created in the addons-371349 cluster.
	I0924 00:38:00.528190 1874359 out.go:177] * If you don't want your credentials mounted into a specific pod, add a label with the `gcp-auth-skip-secret` key to your pod configuration.
	I0924 00:38:00.529186 1874359 out.go:177] * If you want existing pods to be mounted with credentials, either recreate them or rerun addons enable with --refresh.
	I0924 00:38:00.536173 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:38:00.582001 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:38:01.037731 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:38:01.081278 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:38:01.540282 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:38:01.581606 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:38:02.038254 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:38:02.086067 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:38:02.537116 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:38:02.580626 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:38:02.655706 1874359 pod_ready.go:103] pod "metrics-server-84c5f94fbc-wxd2s" in "kube-system" namespace has status "Ready":"False"
	I0924 00:38:03.038020 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:38:03.094972 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:38:03.541262 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:38:03.581455 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:38:04.038649 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:38:04.092757 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:38:04.537238 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:38:04.581087 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:38:04.655863 1874359 pod_ready.go:103] pod "metrics-server-84c5f94fbc-wxd2s" in "kube-system" namespace has status "Ready":"False"
	I0924 00:38:05.036406 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:38:05.081030 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:38:05.537884 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:38:05.639562 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:38:06.037479 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:38:06.081362 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:38:06.537654 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:38:06.598408 1874359 kapi.go:107] duration metric: took 1m40.522007667s to wait for app.kubernetes.io/name=ingress-nginx ...
	I0924 00:38:07.036544 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:38:07.157639 1874359 pod_ready.go:103] pod "metrics-server-84c5f94fbc-wxd2s" in "kube-system" namespace has status "Ready":"False"
	I0924 00:38:07.537205 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:38:08.037211 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:38:08.537454 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:38:09.036723 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:38:09.536459 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:38:09.660906 1874359 pod_ready.go:103] pod "metrics-server-84c5f94fbc-wxd2s" in "kube-system" namespace has status "Ready":"False"
	I0924 00:38:10.036444 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:38:10.540294 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:38:11.037220 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:38:11.536773 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:38:12.041688 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:38:12.155984 1874359 pod_ready.go:103] pod "metrics-server-84c5f94fbc-wxd2s" in "kube-system" namespace has status "Ready":"False"
	I0924 00:38:12.537422 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:38:13.036723 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:38:13.537634 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:38:14.037440 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:38:14.156344 1874359 pod_ready.go:103] pod "metrics-server-84c5f94fbc-wxd2s" in "kube-system" namespace has status "Ready":"False"
	I0924 00:38:14.537047 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:38:15.038133 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:38:15.536566 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:38:16.037248 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:38:16.156676 1874359 pod_ready.go:103] pod "metrics-server-84c5f94fbc-wxd2s" in "kube-system" namespace has status "Ready":"False"
	I0924 00:38:16.543569 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:38:17.037895 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:38:17.537063 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:38:18.038305 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:38:18.157313 1874359 pod_ready.go:103] pod "metrics-server-84c5f94fbc-wxd2s" in "kube-system" namespace has status "Ready":"False"
	I0924 00:38:18.537792 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:38:19.036928 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:38:19.537390 1874359 kapi.go:107] duration metric: took 1m53.005474628s to wait for kubernetes.io/minikube-addons=csi-hostpath-driver ...
	I0924 00:38:19.539097 1874359 out.go:177] * Enabled addons: cloud-spanner, nvidia-device-plugin, ingress-dns, storage-provisioner, metrics-server, yakd, storage-provisioner-rancher, inspektor-gadget, volumesnapshots, registry, gcp-auth, ingress, csi-hostpath-driver
	I0924 00:38:19.540466 1874359 addons.go:510] duration metric: took 1m59.627204899s for enable addons: enabled=[cloud-spanner nvidia-device-plugin ingress-dns storage-provisioner metrics-server yakd storage-provisioner-rancher inspektor-gadget volumesnapshots registry gcp-auth ingress csi-hostpath-driver]
	I0924 00:38:20.656506 1874359 pod_ready.go:103] pod "metrics-server-84c5f94fbc-wxd2s" in "kube-system" namespace has status "Ready":"False"
	I0924 00:38:23.155679 1874359 pod_ready.go:103] pod "metrics-server-84c5f94fbc-wxd2s" in "kube-system" namespace has status "Ready":"False"
	I0924 00:38:25.156435 1874359 pod_ready.go:103] pod "metrics-server-84c5f94fbc-wxd2s" in "kube-system" namespace has status "Ready":"False"
	I0924 00:38:27.656305 1874359 pod_ready.go:103] pod "metrics-server-84c5f94fbc-wxd2s" in "kube-system" namespace has status "Ready":"False"
	I0924 00:38:30.155444 1874359 pod_ready.go:103] pod "metrics-server-84c5f94fbc-wxd2s" in "kube-system" namespace has status "Ready":"False"
	I0924 00:38:32.155689 1874359 pod_ready.go:103] pod "metrics-server-84c5f94fbc-wxd2s" in "kube-system" namespace has status "Ready":"False"
	I0924 00:38:34.655805 1874359 pod_ready.go:103] pod "metrics-server-84c5f94fbc-wxd2s" in "kube-system" namespace has status "Ready":"False"
	I0924 00:38:37.156103 1874359 pod_ready.go:103] pod "metrics-server-84c5f94fbc-wxd2s" in "kube-system" namespace has status "Ready":"False"
	I0924 00:38:39.655725 1874359 pod_ready.go:103] pod "metrics-server-84c5f94fbc-wxd2s" in "kube-system" namespace has status "Ready":"False"
	I0924 00:38:42.156282 1874359 pod_ready.go:103] pod "metrics-server-84c5f94fbc-wxd2s" in "kube-system" namespace has status "Ready":"False"
	I0924 00:38:44.655229 1874359 pod_ready.go:103] pod "metrics-server-84c5f94fbc-wxd2s" in "kube-system" namespace has status "Ready":"False"
	I0924 00:38:45.655782 1874359 pod_ready.go:93] pod "metrics-server-84c5f94fbc-wxd2s" in "kube-system" namespace has status "Ready":"True"
	I0924 00:38:45.655810 1874359 pod_ready.go:82] duration metric: took 1m38.506308998s for pod "metrics-server-84c5f94fbc-wxd2s" in "kube-system" namespace to be "Ready" ...
	I0924 00:38:45.655822 1874359 pod_ready.go:79] waiting up to 6m0s for pod "nvidia-device-plugin-daemonset-t52r5" in "kube-system" namespace to be "Ready" ...
	I0924 00:38:45.661703 1874359 pod_ready.go:93] pod "nvidia-device-plugin-daemonset-t52r5" in "kube-system" namespace has status "Ready":"True"
	I0924 00:38:45.661731 1874359 pod_ready.go:82] duration metric: took 5.900916ms for pod "nvidia-device-plugin-daemonset-t52r5" in "kube-system" namespace to be "Ready" ...
	I0924 00:38:45.661752 1874359 pod_ready.go:39] duration metric: took 1m40.482149573s for extra waiting for all system-critical and pods with labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
	I0924 00:38:45.661768 1874359 api_server.go:52] waiting for apiserver process to appear ...
	I0924 00:38:45.661798 1874359 cri.go:54] listing CRI containers in root : {State:all Name:kube-apiserver Namespaces:[]}
	I0924 00:38:45.661888 1874359 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
	I0924 00:38:45.708292 1874359 cri.go:89] found id: "749045c42da2d61080a3969428ab514fa4047e831ebb9439b8511e518e9b1c04"
	I0924 00:38:45.708314 1874359 cri.go:89] found id: ""
	I0924 00:38:45.708322 1874359 logs.go:276] 1 containers: [749045c42da2d61080a3969428ab514fa4047e831ebb9439b8511e518e9b1c04]
	I0924 00:38:45.708376 1874359 ssh_runner.go:195] Run: which crictl
	I0924 00:38:45.711784 1874359 cri.go:54] listing CRI containers in root : {State:all Name:etcd Namespaces:[]}
	I0924 00:38:45.711857 1874359 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
	I0924 00:38:45.750924 1874359 cri.go:89] found id: "40d8a21a9712f40f598893c1aba5670ff43d964a7b5d9463400bf4a64836edb2"
	I0924 00:38:45.750947 1874359 cri.go:89] found id: ""
	I0924 00:38:45.750955 1874359 logs.go:276] 1 containers: [40d8a21a9712f40f598893c1aba5670ff43d964a7b5d9463400bf4a64836edb2]
	I0924 00:38:45.751013 1874359 ssh_runner.go:195] Run: which crictl
	I0924 00:38:45.754635 1874359 cri.go:54] listing CRI containers in root : {State:all Name:coredns Namespaces:[]}
	I0924 00:38:45.754709 1874359 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
	I0924 00:38:45.793731 1874359 cri.go:89] found id: "07152f00c7b5566d20be0e478631432f898e24fefada16283e2ca7028b046c61"
	I0924 00:38:45.793754 1874359 cri.go:89] found id: ""
	I0924 00:38:45.793763 1874359 logs.go:276] 1 containers: [07152f00c7b5566d20be0e478631432f898e24fefada16283e2ca7028b046c61]
	I0924 00:38:45.793857 1874359 ssh_runner.go:195] Run: which crictl
	I0924 00:38:45.797215 1874359 cri.go:54] listing CRI containers in root : {State:all Name:kube-scheduler Namespaces:[]}
	I0924 00:38:45.797286 1874359 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
	I0924 00:38:45.835387 1874359 cri.go:89] found id: "278db6b1284e1f1d66e55b827b5a4b51ea66ac4b399cfb13b724520fb0071730"
	I0924 00:38:45.835411 1874359 cri.go:89] found id: ""
	I0924 00:38:45.835420 1874359 logs.go:276] 1 containers: [278db6b1284e1f1d66e55b827b5a4b51ea66ac4b399cfb13b724520fb0071730]
	I0924 00:38:45.835481 1874359 ssh_runner.go:195] Run: which crictl
	I0924 00:38:45.838906 1874359 cri.go:54] listing CRI containers in root : {State:all Name:kube-proxy Namespaces:[]}
	I0924 00:38:45.838976 1874359 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
	I0924 00:38:45.877355 1874359 cri.go:89] found id: "8f2c47f2d8dc25f068087f5d0e702e1768f8714f22c484f1ebe13e92be684997"
	I0924 00:38:45.877377 1874359 cri.go:89] found id: ""
	I0924 00:38:45.877385 1874359 logs.go:276] 1 containers: [8f2c47f2d8dc25f068087f5d0e702e1768f8714f22c484f1ebe13e92be684997]
	I0924 00:38:45.877441 1874359 ssh_runner.go:195] Run: which crictl
	I0924 00:38:45.880750 1874359 cri.go:54] listing CRI containers in root : {State:all Name:kube-controller-manager Namespaces:[]}
	I0924 00:38:45.880823 1874359 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
	I0924 00:38:45.917541 1874359 cri.go:89] found id: "340d83c4a515af013d7e2f2cb8dd72a56a11c8be46e63481fd282573f250be80"
	I0924 00:38:45.917564 1874359 cri.go:89] found id: ""
	I0924 00:38:45.917572 1874359 logs.go:276] 1 containers: [340d83c4a515af013d7e2f2cb8dd72a56a11c8be46e63481fd282573f250be80]
	I0924 00:38:45.917629 1874359 ssh_runner.go:195] Run: which crictl
	I0924 00:38:45.921074 1874359 cri.go:54] listing CRI containers in root : {State:all Name:kindnet Namespaces:[]}
	I0924 00:38:45.921143 1874359 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet
	I0924 00:38:45.958520 1874359 cri.go:89] found id: "7adace27f5bf6fd0d07f44c3b2d9c4b94d8130080a2626aadc5ab73681d376ef"
	I0924 00:38:45.958543 1874359 cri.go:89] found id: ""
	I0924 00:38:45.958551 1874359 logs.go:276] 1 containers: [7adace27f5bf6fd0d07f44c3b2d9c4b94d8130080a2626aadc5ab73681d376ef]
	I0924 00:38:45.958605 1874359 ssh_runner.go:195] Run: which crictl
	I0924 00:38:45.962293 1874359 logs.go:123] Gathering logs for etcd [40d8a21a9712f40f598893c1aba5670ff43d964a7b5d9463400bf4a64836edb2] ...
	I0924 00:38:45.962324 1874359 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 40d8a21a9712f40f598893c1aba5670ff43d964a7b5d9463400bf4a64836edb2"
	I0924 00:38:46.013293 1874359 logs.go:123] Gathering logs for coredns [07152f00c7b5566d20be0e478631432f898e24fefada16283e2ca7028b046c61] ...
	I0924 00:38:46.013323 1874359 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 07152f00c7b5566d20be0e478631432f898e24fefada16283e2ca7028b046c61"
	I0924 00:38:46.057115 1874359 logs.go:123] Gathering logs for kube-controller-manager [340d83c4a515af013d7e2f2cb8dd72a56a11c8be46e63481fd282573f250be80] ...
	I0924 00:38:46.057145 1874359 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 340d83c4a515af013d7e2f2cb8dd72a56a11c8be46e63481fd282573f250be80"
	I0924 00:38:46.144145 1874359 logs.go:123] Gathering logs for container status ...
	I0924 00:38:46.144184 1874359 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
	I0924 00:38:46.191233 1874359 logs.go:123] Gathering logs for kubelet ...
	I0924 00:38:46.191266 1874359 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
	W0924 00:38:46.229555 1874359 logs.go:138] Found kubelet problem: Sep 24 00:37:05 addons-371349 kubelet[1485]: W0924 00:37:05.058504    1485 reflector.go:561] object-"yakd-dashboard"/"kube-root-ca.crt": failed to list *v1.ConfigMap: configmaps "kube-root-ca.crt" is forbidden: User "system:node:addons-371349" cannot list resource "configmaps" in API group "" in the namespace "yakd-dashboard": no relationship found between node 'addons-371349' and this object
	W0924 00:38:46.229828 1874359 logs.go:138] Found kubelet problem: Sep 24 00:37:05 addons-371349 kubelet[1485]: E0924 00:37:05.058554    1485 reflector.go:158] "Unhandled Error" err="object-\"yakd-dashboard\"/\"kube-root-ca.crt\": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps \"kube-root-ca.crt\" is forbidden: User \"system:node:addons-371349\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"yakd-dashboard\": no relationship found between node 'addons-371349' and this object" logger="UnhandledError"
	W0924 00:38:46.230013 1874359 logs.go:138] Found kubelet problem: Sep 24 00:37:05 addons-371349 kubelet[1485]: W0924 00:37:05.100500    1485 reflector.go:561] object-"default"/"kube-root-ca.crt": failed to list *v1.ConfigMap: configmaps "kube-root-ca.crt" is forbidden: User "system:node:addons-371349" cannot list resource "configmaps" in API group "" in the namespace "default": no relationship found between node 'addons-371349' and this object
	W0924 00:38:46.230237 1874359 logs.go:138] Found kubelet problem: Sep 24 00:37:05 addons-371349 kubelet[1485]: E0924 00:37:05.100553    1485 reflector.go:158] "Unhandled Error" err="object-\"default\"/\"kube-root-ca.crt\": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps \"kube-root-ca.crt\" is forbidden: User \"system:node:addons-371349\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"default\": no relationship found between node 'addons-371349' and this object" logger="UnhandledError"
	W0924 00:38:46.230404 1874359 logs.go:138] Found kubelet problem: Sep 24 00:37:05 addons-371349 kubelet[1485]: W0924 00:37:05.100721    1485 reflector.go:561] object-"default"/"gcp-auth": failed to list *v1.Secret: secrets "gcp-auth" is forbidden: User "system:node:addons-371349" cannot list resource "secrets" in API group "" in the namespace "default": no relationship found between node 'addons-371349' and this object
	W0924 00:38:46.230609 1874359 logs.go:138] Found kubelet problem: Sep 24 00:37:05 addons-371349 kubelet[1485]: E0924 00:37:05.100750    1485 reflector.go:158] "Unhandled Error" err="object-\"default\"/\"gcp-auth\": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets \"gcp-auth\" is forbidden: User \"system:node:addons-371349\" cannot list resource \"secrets\" in API group \"\" in the namespace \"default\": no relationship found between node 'addons-371349' and this object" logger="UnhandledError"
	I0924 00:38:46.279179 1874359 logs.go:123] Gathering logs for describe nodes ...
	I0924 00:38:46.279214 1874359 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.31.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
	I0924 00:38:46.468252 1874359 logs.go:123] Gathering logs for kube-scheduler [278db6b1284e1f1d66e55b827b5a4b51ea66ac4b399cfb13b724520fb0071730] ...
	I0924 00:38:46.468289 1874359 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 278db6b1284e1f1d66e55b827b5a4b51ea66ac4b399cfb13b724520fb0071730"
	I0924 00:38:46.523886 1874359 logs.go:123] Gathering logs for kube-proxy [8f2c47f2d8dc25f068087f5d0e702e1768f8714f22c484f1ebe13e92be684997] ...
	I0924 00:38:46.523926 1874359 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 8f2c47f2d8dc25f068087f5d0e702e1768f8714f22c484f1ebe13e92be684997"
	I0924 00:38:46.569726 1874359 logs.go:123] Gathering logs for kindnet [7adace27f5bf6fd0d07f44c3b2d9c4b94d8130080a2626aadc5ab73681d376ef] ...
	I0924 00:38:46.569753 1874359 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 7adace27f5bf6fd0d07f44c3b2d9c4b94d8130080a2626aadc5ab73681d376ef"
	I0924 00:38:46.611343 1874359 logs.go:123] Gathering logs for CRI-O ...
	I0924 00:38:46.611376 1874359 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u crio -n 400"
	I0924 00:38:46.706100 1874359 logs.go:123] Gathering logs for dmesg ...
	I0924 00:38:46.706137 1874359 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
	I0924 00:38:46.722442 1874359 logs.go:123] Gathering logs for kube-apiserver [749045c42da2d61080a3969428ab514fa4047e831ebb9439b8511e518e9b1c04] ...
	I0924 00:38:46.722467 1874359 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 749045c42da2d61080a3969428ab514fa4047e831ebb9439b8511e518e9b1c04"
	I0924 00:38:46.793783 1874359 out.go:358] Setting ErrFile to fd 2...
	I0924 00:38:46.793901 1874359 out.go:392] TERM=,COLORTERM=, which probably does not support color
	W0924 00:38:46.793963 1874359 out.go:270] X Problems detected in kubelet:
	W0924 00:38:46.793979 1874359 out.go:270]   Sep 24 00:37:05 addons-371349 kubelet[1485]: E0924 00:37:05.058554    1485 reflector.go:158] "Unhandled Error" err="object-\"yakd-dashboard\"/\"kube-root-ca.crt\": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps \"kube-root-ca.crt\" is forbidden: User \"system:node:addons-371349\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"yakd-dashboard\": no relationship found between node 'addons-371349' and this object" logger="UnhandledError"
	W0924 00:38:46.793987 1874359 out.go:270]   Sep 24 00:37:05 addons-371349 kubelet[1485]: W0924 00:37:05.100500    1485 reflector.go:561] object-"default"/"kube-root-ca.crt": failed to list *v1.ConfigMap: configmaps "kube-root-ca.crt" is forbidden: User "system:node:addons-371349" cannot list resource "configmaps" in API group "" in the namespace "default": no relationship found between node 'addons-371349' and this object
	W0924 00:38:46.793999 1874359 out.go:270]   Sep 24 00:37:05 addons-371349 kubelet[1485]: E0924 00:37:05.100553    1485 reflector.go:158] "Unhandled Error" err="object-\"default\"/\"kube-root-ca.crt\": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps \"kube-root-ca.crt\" is forbidden: User \"system:node:addons-371349\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"default\": no relationship found between node 'addons-371349' and this object" logger="UnhandledError"
	W0924 00:38:46.794010 1874359 out.go:270]   Sep 24 00:37:05 addons-371349 kubelet[1485]: W0924 00:37:05.100721    1485 reflector.go:561] object-"default"/"gcp-auth": failed to list *v1.Secret: secrets "gcp-auth" is forbidden: User "system:node:addons-371349" cannot list resource "secrets" in API group "" in the namespace "default": no relationship found between node 'addons-371349' and this object
	W0924 00:38:46.794017 1874359 out.go:270]   Sep 24 00:37:05 addons-371349 kubelet[1485]: E0924 00:37:05.100750    1485 reflector.go:158] "Unhandled Error" err="object-\"default\"/\"gcp-auth\": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets \"gcp-auth\" is forbidden: User \"system:node:addons-371349\" cannot list resource \"secrets\" in API group \"\" in the namespace \"default\": no relationship found between node 'addons-371349' and this object" logger="UnhandledError"
	I0924 00:38:46.794029 1874359 out.go:358] Setting ErrFile to fd 2...
	I0924 00:38:46.794035 1874359 out.go:392] TERM=,COLORTERM=, which probably does not support color
	I0924 00:38:56.795250 1874359 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0924 00:38:56.809250 1874359 api_server.go:72] duration metric: took 2m36.8963927s to wait for apiserver process to appear ...
	I0924 00:38:56.809275 1874359 api_server.go:88] waiting for apiserver healthz status ...
	I0924 00:38:56.809311 1874359 cri.go:54] listing CRI containers in root : {State:all Name:kube-apiserver Namespaces:[]}
	I0924 00:38:56.809373 1874359 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
	I0924 00:38:56.849168 1874359 cri.go:89] found id: "749045c42da2d61080a3969428ab514fa4047e831ebb9439b8511e518e9b1c04"
	I0924 00:38:56.849197 1874359 cri.go:89] found id: ""
	I0924 00:38:56.849206 1874359 logs.go:276] 1 containers: [749045c42da2d61080a3969428ab514fa4047e831ebb9439b8511e518e9b1c04]
	I0924 00:38:56.849261 1874359 ssh_runner.go:195] Run: which crictl
	I0924 00:38:56.852661 1874359 cri.go:54] listing CRI containers in root : {State:all Name:etcd Namespaces:[]}
	I0924 00:38:56.852739 1874359 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
	I0924 00:38:56.895086 1874359 cri.go:89] found id: "40d8a21a9712f40f598893c1aba5670ff43d964a7b5d9463400bf4a64836edb2"
	I0924 00:38:56.895108 1874359 cri.go:89] found id: ""
	I0924 00:38:56.895115 1874359 logs.go:276] 1 containers: [40d8a21a9712f40f598893c1aba5670ff43d964a7b5d9463400bf4a64836edb2]
	I0924 00:38:56.895169 1874359 ssh_runner.go:195] Run: which crictl
	I0924 00:38:56.898822 1874359 cri.go:54] listing CRI containers in root : {State:all Name:coredns Namespaces:[]}
	I0924 00:38:56.898895 1874359 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
	I0924 00:38:56.940638 1874359 cri.go:89] found id: "07152f00c7b5566d20be0e478631432f898e24fefada16283e2ca7028b046c61"
	I0924 00:38:56.940659 1874359 cri.go:89] found id: ""
	I0924 00:38:56.940667 1874359 logs.go:276] 1 containers: [07152f00c7b5566d20be0e478631432f898e24fefada16283e2ca7028b046c61]
	I0924 00:38:56.940720 1874359 ssh_runner.go:195] Run: which crictl
	I0924 00:38:56.944215 1874359 cri.go:54] listing CRI containers in root : {State:all Name:kube-scheduler Namespaces:[]}
	I0924 00:38:56.944370 1874359 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
	I0924 00:38:56.988209 1874359 cri.go:89] found id: "278db6b1284e1f1d66e55b827b5a4b51ea66ac4b399cfb13b724520fb0071730"
	I0924 00:38:56.988232 1874359 cri.go:89] found id: ""
	I0924 00:38:56.988241 1874359 logs.go:276] 1 containers: [278db6b1284e1f1d66e55b827b5a4b51ea66ac4b399cfb13b724520fb0071730]
	I0924 00:38:56.988295 1874359 ssh_runner.go:195] Run: which crictl
	I0924 00:38:56.991784 1874359 cri.go:54] listing CRI containers in root : {State:all Name:kube-proxy Namespaces:[]}
	I0924 00:38:56.991861 1874359 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
	I0924 00:38:57.039062 1874359 cri.go:89] found id: "8f2c47f2d8dc25f068087f5d0e702e1768f8714f22c484f1ebe13e92be684997"
	I0924 00:38:57.039087 1874359 cri.go:89] found id: ""
	I0924 00:38:57.039095 1874359 logs.go:276] 1 containers: [8f2c47f2d8dc25f068087f5d0e702e1768f8714f22c484f1ebe13e92be684997]
	I0924 00:38:57.039153 1874359 ssh_runner.go:195] Run: which crictl
	I0924 00:38:57.042617 1874359 cri.go:54] listing CRI containers in root : {State:all Name:kube-controller-manager Namespaces:[]}
	I0924 00:38:57.042691 1874359 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
	I0924 00:38:57.086283 1874359 cri.go:89] found id: "340d83c4a515af013d7e2f2cb8dd72a56a11c8be46e63481fd282573f250be80"
	I0924 00:38:57.086310 1874359 cri.go:89] found id: ""
	I0924 00:38:57.086319 1874359 logs.go:276] 1 containers: [340d83c4a515af013d7e2f2cb8dd72a56a11c8be46e63481fd282573f250be80]
	I0924 00:38:57.086375 1874359 ssh_runner.go:195] Run: which crictl
	I0924 00:38:57.091139 1874359 cri.go:54] listing CRI containers in root : {State:all Name:kindnet Namespaces:[]}
	I0924 00:38:57.091208 1874359 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet
	I0924 00:38:57.133231 1874359 cri.go:89] found id: "7adace27f5bf6fd0d07f44c3b2d9c4b94d8130080a2626aadc5ab73681d376ef"
	I0924 00:38:57.133301 1874359 cri.go:89] found id: ""
	I0924 00:38:57.133324 1874359 logs.go:276] 1 containers: [7adace27f5bf6fd0d07f44c3b2d9c4b94d8130080a2626aadc5ab73681d376ef]
	I0924 00:38:57.133409 1874359 ssh_runner.go:195] Run: which crictl
	I0924 00:38:57.137358 1874359 logs.go:123] Gathering logs for coredns [07152f00c7b5566d20be0e478631432f898e24fefada16283e2ca7028b046c61] ...
	I0924 00:38:57.137387 1874359 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 07152f00c7b5566d20be0e478631432f898e24fefada16283e2ca7028b046c61"
	I0924 00:38:57.187200 1874359 logs.go:123] Gathering logs for kube-controller-manager [340d83c4a515af013d7e2f2cb8dd72a56a11c8be46e63481fd282573f250be80] ...
	I0924 00:38:57.187234 1874359 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 340d83c4a515af013d7e2f2cb8dd72a56a11c8be46e63481fd282573f250be80"
	I0924 00:38:57.263005 1874359 logs.go:123] Gathering logs for container status ...
	I0924 00:38:57.263144 1874359 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
	I0924 00:38:57.318534 1874359 logs.go:123] Gathering logs for etcd [40d8a21a9712f40f598893c1aba5670ff43d964a7b5d9463400bf4a64836edb2] ...
	I0924 00:38:57.318564 1874359 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 40d8a21a9712f40f598893c1aba5670ff43d964a7b5d9463400bf4a64836edb2"
	I0924 00:38:57.371144 1874359 logs.go:123] Gathering logs for dmesg ...
	I0924 00:38:57.371179 1874359 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
	I0924 00:38:57.388648 1874359 logs.go:123] Gathering logs for describe nodes ...
	I0924 00:38:57.388675 1874359 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.31.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
	I0924 00:38:57.530037 1874359 logs.go:123] Gathering logs for kube-apiserver [749045c42da2d61080a3969428ab514fa4047e831ebb9439b8511e518e9b1c04] ...
	I0924 00:38:57.530067 1874359 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 749045c42da2d61080a3969428ab514fa4047e831ebb9439b8511e518e9b1c04"
	I0924 00:38:57.604473 1874359 logs.go:123] Gathering logs for kube-scheduler [278db6b1284e1f1d66e55b827b5a4b51ea66ac4b399cfb13b724520fb0071730] ...
	I0924 00:38:57.604506 1874359 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 278db6b1284e1f1d66e55b827b5a4b51ea66ac4b399cfb13b724520fb0071730"
	I0924 00:38:57.657911 1874359 logs.go:123] Gathering logs for kube-proxy [8f2c47f2d8dc25f068087f5d0e702e1768f8714f22c484f1ebe13e92be684997] ...
	I0924 00:38:57.657944 1874359 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 8f2c47f2d8dc25f068087f5d0e702e1768f8714f22c484f1ebe13e92be684997"
	I0924 00:38:57.696154 1874359 logs.go:123] Gathering logs for kindnet [7adace27f5bf6fd0d07f44c3b2d9c4b94d8130080a2626aadc5ab73681d376ef] ...
	I0924 00:38:57.696187 1874359 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 7adace27f5bf6fd0d07f44c3b2d9c4b94d8130080a2626aadc5ab73681d376ef"
	I0924 00:38:57.740436 1874359 logs.go:123] Gathering logs for CRI-O ...
	I0924 00:38:57.740465 1874359 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u crio -n 400"
	I0924 00:38:57.839529 1874359 logs.go:123] Gathering logs for kubelet ...
	I0924 00:38:57.839566 1874359 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
	W0924 00:38:57.877455 1874359 logs.go:138] Found kubelet problem: Sep 24 00:37:05 addons-371349 kubelet[1485]: W0924 00:37:05.058504    1485 reflector.go:561] object-"yakd-dashboard"/"kube-root-ca.crt": failed to list *v1.ConfigMap: configmaps "kube-root-ca.crt" is forbidden: User "system:node:addons-371349" cannot list resource "configmaps" in API group "" in the namespace "yakd-dashboard": no relationship found between node 'addons-371349' and this object
	W0924 00:38:57.877724 1874359 logs.go:138] Found kubelet problem: Sep 24 00:37:05 addons-371349 kubelet[1485]: E0924 00:37:05.058554    1485 reflector.go:158] "Unhandled Error" err="object-\"yakd-dashboard\"/\"kube-root-ca.crt\": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps \"kube-root-ca.crt\" is forbidden: User \"system:node:addons-371349\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"yakd-dashboard\": no relationship found between node 'addons-371349' and this object" logger="UnhandledError"
	W0924 00:38:57.877937 1874359 logs.go:138] Found kubelet problem: Sep 24 00:37:05 addons-371349 kubelet[1485]: W0924 00:37:05.100500    1485 reflector.go:561] object-"default"/"kube-root-ca.crt": failed to list *v1.ConfigMap: configmaps "kube-root-ca.crt" is forbidden: User "system:node:addons-371349" cannot list resource "configmaps" in API group "" in the namespace "default": no relationship found between node 'addons-371349' and this object
	W0924 00:38:57.878161 1874359 logs.go:138] Found kubelet problem: Sep 24 00:37:05 addons-371349 kubelet[1485]: E0924 00:37:05.100553    1485 reflector.go:158] "Unhandled Error" err="object-\"default\"/\"kube-root-ca.crt\": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps \"kube-root-ca.crt\" is forbidden: User \"system:node:addons-371349\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"default\": no relationship found between node 'addons-371349' and this object" logger="UnhandledError"
	W0924 00:38:57.878327 1874359 logs.go:138] Found kubelet problem: Sep 24 00:37:05 addons-371349 kubelet[1485]: W0924 00:37:05.100721    1485 reflector.go:561] object-"default"/"gcp-auth": failed to list *v1.Secret: secrets "gcp-auth" is forbidden: User "system:node:addons-371349" cannot list resource "secrets" in API group "" in the namespace "default": no relationship found between node 'addons-371349' and this object
	W0924 00:38:57.878533 1874359 logs.go:138] Found kubelet problem: Sep 24 00:37:05 addons-371349 kubelet[1485]: E0924 00:37:05.100750    1485 reflector.go:158] "Unhandled Error" err="object-\"default\"/\"gcp-auth\": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets \"gcp-auth\" is forbidden: User \"system:node:addons-371349\" cannot list resource \"secrets\" in API group \"\" in the namespace \"default\": no relationship found between node 'addons-371349' and this object" logger="UnhandledError"
	I0924 00:38:57.928653 1874359 out.go:358] Setting ErrFile to fd 2...
	I0924 00:38:57.928681 1874359 out.go:392] TERM=,COLORTERM=, which probably does not support color
	W0924 00:38:57.928737 1874359 out.go:270] X Problems detected in kubelet:
	W0924 00:38:57.928749 1874359 out.go:270]   Sep 24 00:37:05 addons-371349 kubelet[1485]: E0924 00:37:05.058554    1485 reflector.go:158] "Unhandled Error" err="object-\"yakd-dashboard\"/\"kube-root-ca.crt\": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps \"kube-root-ca.crt\" is forbidden: User \"system:node:addons-371349\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"yakd-dashboard\": no relationship found between node 'addons-371349' and this object" logger="UnhandledError"
	W0924 00:38:57.928756 1874359 out.go:270]   Sep 24 00:37:05 addons-371349 kubelet[1485]: W0924 00:37:05.100500    1485 reflector.go:561] object-"default"/"kube-root-ca.crt": failed to list *v1.ConfigMap: configmaps "kube-root-ca.crt" is forbidden: User "system:node:addons-371349" cannot list resource "configmaps" in API group "" in the namespace "default": no relationship found between node 'addons-371349' and this object
	W0924 00:38:57.928771 1874359 out.go:270]   Sep 24 00:37:05 addons-371349 kubelet[1485]: E0924 00:37:05.100553    1485 reflector.go:158] "Unhandled Error" err="object-\"default\"/\"kube-root-ca.crt\": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps \"kube-root-ca.crt\" is forbidden: User \"system:node:addons-371349\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"default\": no relationship found between node 'addons-371349' and this object" logger="UnhandledError"
	W0924 00:38:57.928781 1874359 out.go:270]   Sep 24 00:37:05 addons-371349 kubelet[1485]: W0924 00:37:05.100721    1485 reflector.go:561] object-"default"/"gcp-auth": failed to list *v1.Secret: secrets "gcp-auth" is forbidden: User "system:node:addons-371349" cannot list resource "secrets" in API group "" in the namespace "default": no relationship found between node 'addons-371349' and this object
	W0924 00:38:57.928786 1874359 out.go:270]   Sep 24 00:37:05 addons-371349 kubelet[1485]: E0924 00:37:05.100750    1485 reflector.go:158] "Unhandled Error" err="object-\"default\"/\"gcp-auth\": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets \"gcp-auth\" is forbidden: User \"system:node:addons-371349\" cannot list resource \"secrets\" in API group \"\" in the namespace \"default\": no relationship found between node 'addons-371349' and this object" logger="UnhandledError"
	I0924 00:38:57.928792 1874359 out.go:358] Setting ErrFile to fd 2...
	I0924 00:38:57.928797 1874359 out.go:392] TERM=,COLORTERM=, which probably does not support color
	I0924 00:39:07.930415 1874359 api_server.go:253] Checking apiserver healthz at https://192.168.49.2:8443/healthz ...
	I0924 00:39:07.937955 1874359 api_server.go:279] https://192.168.49.2:8443/healthz returned 200:
	ok
	I0924 00:39:07.938936 1874359 api_server.go:141] control plane version: v1.31.1
	I0924 00:39:07.938963 1874359 api_server.go:131] duration metric: took 11.129680462s to wait for apiserver health ...
	I0924 00:39:07.939008 1874359 system_pods.go:43] waiting for kube-system pods to appear ...
	I0924 00:39:07.939036 1874359 cri.go:54] listing CRI containers in root : {State:all Name:kube-apiserver Namespaces:[]}
	I0924 00:39:07.939099 1874359 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
	I0924 00:39:07.980230 1874359 cri.go:89] found id: "749045c42da2d61080a3969428ab514fa4047e831ebb9439b8511e518e9b1c04"
	I0924 00:39:07.980253 1874359 cri.go:89] found id: ""
	I0924 00:39:07.980261 1874359 logs.go:276] 1 containers: [749045c42da2d61080a3969428ab514fa4047e831ebb9439b8511e518e9b1c04]
	I0924 00:39:07.980315 1874359 ssh_runner.go:195] Run: which crictl
	I0924 00:39:07.983665 1874359 cri.go:54] listing CRI containers in root : {State:all Name:etcd Namespaces:[]}
	I0924 00:39:07.983734 1874359 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
	I0924 00:39:08.026928 1874359 cri.go:89] found id: "40d8a21a9712f40f598893c1aba5670ff43d964a7b5d9463400bf4a64836edb2"
	I0924 00:39:08.026955 1874359 cri.go:89] found id: ""
	I0924 00:39:08.026963 1874359 logs.go:276] 1 containers: [40d8a21a9712f40f598893c1aba5670ff43d964a7b5d9463400bf4a64836edb2]
	I0924 00:39:08.027024 1874359 ssh_runner.go:195] Run: which crictl
	I0924 00:39:08.030930 1874359 cri.go:54] listing CRI containers in root : {State:all Name:coredns Namespaces:[]}
	I0924 00:39:08.031008 1874359 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
	I0924 00:39:08.080344 1874359 cri.go:89] found id: "07152f00c7b5566d20be0e478631432f898e24fefada16283e2ca7028b046c61"
	I0924 00:39:08.080368 1874359 cri.go:89] found id: ""
	I0924 00:39:08.080377 1874359 logs.go:276] 1 containers: [07152f00c7b5566d20be0e478631432f898e24fefada16283e2ca7028b046c61]
	I0924 00:39:08.080439 1874359 ssh_runner.go:195] Run: which crictl
	I0924 00:39:08.087899 1874359 cri.go:54] listing CRI containers in root : {State:all Name:kube-scheduler Namespaces:[]}
	I0924 00:39:08.087974 1874359 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
	I0924 00:39:08.129013 1874359 cri.go:89] found id: "278db6b1284e1f1d66e55b827b5a4b51ea66ac4b399cfb13b724520fb0071730"
	I0924 00:39:08.129035 1874359 cri.go:89] found id: ""
	I0924 00:39:08.129042 1874359 logs.go:276] 1 containers: [278db6b1284e1f1d66e55b827b5a4b51ea66ac4b399cfb13b724520fb0071730]
	I0924 00:39:08.129098 1874359 ssh_runner.go:195] Run: which crictl
	I0924 00:39:08.133170 1874359 cri.go:54] listing CRI containers in root : {State:all Name:kube-proxy Namespaces:[]}
	I0924 00:39:08.133245 1874359 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
	I0924 00:39:08.170625 1874359 cri.go:89] found id: "8f2c47f2d8dc25f068087f5d0e702e1768f8714f22c484f1ebe13e92be684997"
	I0924 00:39:08.170647 1874359 cri.go:89] found id: ""
	I0924 00:39:08.170655 1874359 logs.go:276] 1 containers: [8f2c47f2d8dc25f068087f5d0e702e1768f8714f22c484f1ebe13e92be684997]
	I0924 00:39:08.170709 1874359 ssh_runner.go:195] Run: which crictl
	I0924 00:39:08.174051 1874359 cri.go:54] listing CRI containers in root : {State:all Name:kube-controller-manager Namespaces:[]}
	I0924 00:39:08.174119 1874359 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
	I0924 00:39:08.211609 1874359 cri.go:89] found id: "340d83c4a515af013d7e2f2cb8dd72a56a11c8be46e63481fd282573f250be80"
	I0924 00:39:08.211634 1874359 cri.go:89] found id: ""
	I0924 00:39:08.211642 1874359 logs.go:276] 1 containers: [340d83c4a515af013d7e2f2cb8dd72a56a11c8be46e63481fd282573f250be80]
	I0924 00:39:08.211717 1874359 ssh_runner.go:195] Run: which crictl
	I0924 00:39:08.215082 1874359 cri.go:54] listing CRI containers in root : {State:all Name:kindnet Namespaces:[]}
	I0924 00:39:08.215154 1874359 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet
	I0924 00:39:08.254829 1874359 cri.go:89] found id: "7adace27f5bf6fd0d07f44c3b2d9c4b94d8130080a2626aadc5ab73681d376ef"
	I0924 00:39:08.254856 1874359 cri.go:89] found id: ""
	I0924 00:39:08.254865 1874359 logs.go:276] 1 containers: [7adace27f5bf6fd0d07f44c3b2d9c4b94d8130080a2626aadc5ab73681d376ef]
	I0924 00:39:08.254943 1874359 ssh_runner.go:195] Run: which crictl
	I0924 00:39:08.258637 1874359 logs.go:123] Gathering logs for dmesg ...
	I0924 00:39:08.258663 1874359 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
	I0924 00:39:08.275195 1874359 logs.go:123] Gathering logs for describe nodes ...
	I0924 00:39:08.275221 1874359 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.31.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
	I0924 00:39:08.415558 1874359 logs.go:123] Gathering logs for kube-apiserver [749045c42da2d61080a3969428ab514fa4047e831ebb9439b8511e518e9b1c04] ...
	I0924 00:39:08.415587 1874359 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 749045c42da2d61080a3969428ab514fa4047e831ebb9439b8511e518e9b1c04"
	I0924 00:39:08.489572 1874359 logs.go:123] Gathering logs for kube-controller-manager [340d83c4a515af013d7e2f2cb8dd72a56a11c8be46e63481fd282573f250be80] ...
	I0924 00:39:08.489606 1874359 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 340d83c4a515af013d7e2f2cb8dd72a56a11c8be46e63481fd282573f250be80"
	I0924 00:39:08.578827 1874359 logs.go:123] Gathering logs for kindnet [7adace27f5bf6fd0d07f44c3b2d9c4b94d8130080a2626aadc5ab73681d376ef] ...
	I0924 00:39:08.578861 1874359 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 7adace27f5bf6fd0d07f44c3b2d9c4b94d8130080a2626aadc5ab73681d376ef"
	I0924 00:39:08.617163 1874359 logs.go:123] Gathering logs for CRI-O ...
	I0924 00:39:08.617194 1874359 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u crio -n 400"
	I0924 00:39:08.713202 1874359 logs.go:123] Gathering logs for kubelet ...
	I0924 00:39:08.713240 1874359 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
	W0924 00:39:08.755826 1874359 logs.go:138] Found kubelet problem: Sep 24 00:37:05 addons-371349 kubelet[1485]: W0924 00:37:05.058504    1485 reflector.go:561] object-"yakd-dashboard"/"kube-root-ca.crt": failed to list *v1.ConfigMap: configmaps "kube-root-ca.crt" is forbidden: User "system:node:addons-371349" cannot list resource "configmaps" in API group "" in the namespace "yakd-dashboard": no relationship found between node 'addons-371349' and this object
	W0924 00:39:08.756100 1874359 logs.go:138] Found kubelet problem: Sep 24 00:37:05 addons-371349 kubelet[1485]: E0924 00:37:05.058554    1485 reflector.go:158] "Unhandled Error" err="object-\"yakd-dashboard\"/\"kube-root-ca.crt\": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps \"kube-root-ca.crt\" is forbidden: User \"system:node:addons-371349\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"yakd-dashboard\": no relationship found between node 'addons-371349' and this object" logger="UnhandledError"
	W0924 00:39:08.756284 1874359 logs.go:138] Found kubelet problem: Sep 24 00:37:05 addons-371349 kubelet[1485]: W0924 00:37:05.100500    1485 reflector.go:561] object-"default"/"kube-root-ca.crt": failed to list *v1.ConfigMap: configmaps "kube-root-ca.crt" is forbidden: User "system:node:addons-371349" cannot list resource "configmaps" in API group "" in the namespace "default": no relationship found between node 'addons-371349' and this object
	W0924 00:39:08.756508 1874359 logs.go:138] Found kubelet problem: Sep 24 00:37:05 addons-371349 kubelet[1485]: E0924 00:37:05.100553    1485 reflector.go:158] "Unhandled Error" err="object-\"default\"/\"kube-root-ca.crt\": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps \"kube-root-ca.crt\" is forbidden: User \"system:node:addons-371349\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"default\": no relationship found between node 'addons-371349' and this object" logger="UnhandledError"
	W0924 00:39:08.756709 1874359 logs.go:138] Found kubelet problem: Sep 24 00:37:05 addons-371349 kubelet[1485]: W0924 00:37:05.100721    1485 reflector.go:561] object-"default"/"gcp-auth": failed to list *v1.Secret: secrets "gcp-auth" is forbidden: User "system:node:addons-371349" cannot list resource "secrets" in API group "" in the namespace "default": no relationship found between node 'addons-371349' and this object
	W0924 00:39:08.756918 1874359 logs.go:138] Found kubelet problem: Sep 24 00:37:05 addons-371349 kubelet[1485]: E0924 00:37:05.100750    1485 reflector.go:158] "Unhandled Error" err="object-\"default\"/\"gcp-auth\": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets \"gcp-auth\" is forbidden: User \"system:node:addons-371349\" cannot list resource \"secrets\" in API group \"\" in the namespace \"default\": no relationship found between node 'addons-371349' and this object" logger="UnhandledError"
	I0924 00:39:08.808148 1874359 logs.go:123] Gathering logs for etcd [40d8a21a9712f40f598893c1aba5670ff43d964a7b5d9463400bf4a64836edb2] ...
	I0924 00:39:08.808187 1874359 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 40d8a21a9712f40f598893c1aba5670ff43d964a7b5d9463400bf4a64836edb2"
	I0924 00:39:08.862714 1874359 logs.go:123] Gathering logs for coredns [07152f00c7b5566d20be0e478631432f898e24fefada16283e2ca7028b046c61] ...
	I0924 00:39:08.862758 1874359 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 07152f00c7b5566d20be0e478631432f898e24fefada16283e2ca7028b046c61"
	I0924 00:39:08.909116 1874359 logs.go:123] Gathering logs for kube-scheduler [278db6b1284e1f1d66e55b827b5a4b51ea66ac4b399cfb13b724520fb0071730] ...
	I0924 00:39:08.909154 1874359 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 278db6b1284e1f1d66e55b827b5a4b51ea66ac4b399cfb13b724520fb0071730"
	I0924 00:39:08.956136 1874359 logs.go:123] Gathering logs for kube-proxy [8f2c47f2d8dc25f068087f5d0e702e1768f8714f22c484f1ebe13e92be684997] ...
	I0924 00:39:08.956168 1874359 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 8f2c47f2d8dc25f068087f5d0e702e1768f8714f22c484f1ebe13e92be684997"
	I0924 00:39:08.992426 1874359 logs.go:123] Gathering logs for container status ...
	I0924 00:39:08.992455 1874359 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
	I0924 00:39:09.049468 1874359 out.go:358] Setting ErrFile to fd 2...
	I0924 00:39:09.049502 1874359 out.go:392] TERM=,COLORTERM=, which probably does not support color
	W0924 00:39:09.049568 1874359 out.go:270] X Problems detected in kubelet:
	W0924 00:39:09.049591 1874359 out.go:270]   Sep 24 00:37:05 addons-371349 kubelet[1485]: E0924 00:37:05.058554    1485 reflector.go:158] "Unhandled Error" err="object-\"yakd-dashboard\"/\"kube-root-ca.crt\": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps \"kube-root-ca.crt\" is forbidden: User \"system:node:addons-371349\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"yakd-dashboard\": no relationship found between node 'addons-371349' and this object" logger="UnhandledError"
	W0924 00:39:09.049606 1874359 out.go:270]   Sep 24 00:37:05 addons-371349 kubelet[1485]: W0924 00:37:05.100500    1485 reflector.go:561] object-"default"/"kube-root-ca.crt": failed to list *v1.ConfigMap: configmaps "kube-root-ca.crt" is forbidden: User "system:node:addons-371349" cannot list resource "configmaps" in API group "" in the namespace "default": no relationship found between node 'addons-371349' and this object
	W0924 00:39:09.049625 1874359 out.go:270]   Sep 24 00:37:05 addons-371349 kubelet[1485]: E0924 00:37:05.100553    1485 reflector.go:158] "Unhandled Error" err="object-\"default\"/\"kube-root-ca.crt\": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps \"kube-root-ca.crt\" is forbidden: User \"system:node:addons-371349\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"default\": no relationship found between node 'addons-371349' and this object" logger="UnhandledError"
	W0924 00:39:09.049633 1874359 out.go:270]   Sep 24 00:37:05 addons-371349 kubelet[1485]: W0924 00:37:05.100721    1485 reflector.go:561] object-"default"/"gcp-auth": failed to list *v1.Secret: secrets "gcp-auth" is forbidden: User "system:node:addons-371349" cannot list resource "secrets" in API group "" in the namespace "default": no relationship found between node 'addons-371349' and this object
	W0924 00:39:09.049643 1874359 out.go:270]   Sep 24 00:37:05 addons-371349 kubelet[1485]: E0924 00:37:05.100750    1485 reflector.go:158] "Unhandled Error" err="object-\"default\"/\"gcp-auth\": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets \"gcp-auth\" is forbidden: User \"system:node:addons-371349\" cannot list resource \"secrets\" in API group \"\" in the namespace \"default\": no relationship found between node 'addons-371349' and this object" logger="UnhandledError"
	I0924 00:39:09.049650 1874359 out.go:358] Setting ErrFile to fd 2...
	I0924 00:39:09.049661 1874359 out.go:392] TERM=,COLORTERM=, which probably does not support color
	I0924 00:39:19.063102 1874359 system_pods.go:59] 18 kube-system pods found
	I0924 00:39:19.063145 1874359 system_pods.go:61] "coredns-7c65d6cfc9-bsbwf" [a2c84f3b-bbc2-4ab5-85a2-5ff72508507b] Running
	I0924 00:39:19.063153 1874359 system_pods.go:61] "csi-hostpath-attacher-0" [c760f7fc-01e4-476e-8f71-c2907c20ea88] Running
	I0924 00:39:19.063157 1874359 system_pods.go:61] "csi-hostpath-resizer-0" [b318fac7-c7d5-418f-9f16-8e4991ea9f29] Running
	I0924 00:39:19.063163 1874359 system_pods.go:61] "csi-hostpathplugin-rg84v" [99420363-d35f-4aef-8752-cd70a8687aca] Running
	I0924 00:39:19.063168 1874359 system_pods.go:61] "etcd-addons-371349" [0db6f1c9-6b22-4e0f-bd38-64d6f64a5f2b] Running
	I0924 00:39:19.063173 1874359 system_pods.go:61] "kindnet-c2v8q" [d7d499b8-6318-4999-8666-172b227c9eb9] Running
	I0924 00:39:19.063178 1874359 system_pods.go:61] "kube-apiserver-addons-371349" [57643502-89d7-4cb0-9a99-b11046416306] Running
	I0924 00:39:19.063183 1874359 system_pods.go:61] "kube-controller-manager-addons-371349" [a223fefc-7277-4cb1-8373-e7751bc87f10] Running
	I0924 00:39:19.063195 1874359 system_pods.go:61] "kube-ingress-dns-minikube" [4c89d0f9-906f-451c-807f-4b809f2d3f54] Running
	I0924 00:39:19.063199 1874359 system_pods.go:61] "kube-proxy-qcb9f" [69abd079-88b6-4b9f-831c-e871d95d4464] Running
	I0924 00:39:19.063204 1874359 system_pods.go:61] "kube-scheduler-addons-371349" [ae310285-de23-4f27-8f12-35713956d260] Running
	I0924 00:39:19.063212 1874359 system_pods.go:61] "metrics-server-84c5f94fbc-wxd2s" [7c5e5bee-e3dc-43a0-a7b2-e1afa3197ce6] Running
	I0924 00:39:19.063216 1874359 system_pods.go:61] "nvidia-device-plugin-daemonset-t52r5" [6ee689eb-216e-49b6-b98b-04c4a8a2a717] Running
	I0924 00:39:19.063223 1874359 system_pods.go:61] "registry-66c9cd494c-vx6hr" [2d03a897-de38-4010-b9d3-7e455400c58d] Running
	I0924 00:39:19.063227 1874359 system_pods.go:61] "registry-proxy-9jrvf" [1cea29a0-a418-43ce-8a72-6439715dfdb4] Running
	I0924 00:39:19.063231 1874359 system_pods.go:61] "snapshot-controller-56fcc65765-trtb4" [71554140-ea26-4c02-8605-9e5a7a72c935] Running
	I0924 00:39:19.063236 1874359 system_pods.go:61] "snapshot-controller-56fcc65765-vprd4" [9bf3685a-c093-4efd-9385-9e2cd6ab2d77] Running
	I0924 00:39:19.063245 1874359 system_pods.go:61] "storage-provisioner" [3f9e83c7-275e-48af-b839-10cd00b637ad] Running
	I0924 00:39:19.063251 1874359 system_pods.go:74] duration metric: took 11.124230598s to wait for pod list to return data ...
	I0924 00:39:19.063263 1874359 default_sa.go:34] waiting for default service account to be created ...
	I0924 00:39:19.066150 1874359 default_sa.go:45] found service account: "default"
	I0924 00:39:19.066183 1874359 default_sa.go:55] duration metric: took 2.913765ms for default service account to be created ...
	I0924 00:39:19.066194 1874359 system_pods.go:116] waiting for k8s-apps to be running ...
	I0924 00:39:19.076136 1874359 system_pods.go:86] 18 kube-system pods found
	I0924 00:39:19.076174 1874359 system_pods.go:89] "coredns-7c65d6cfc9-bsbwf" [a2c84f3b-bbc2-4ab5-85a2-5ff72508507b] Running
	I0924 00:39:19.076182 1874359 system_pods.go:89] "csi-hostpath-attacher-0" [c760f7fc-01e4-476e-8f71-c2907c20ea88] Running
	I0924 00:39:19.076187 1874359 system_pods.go:89] "csi-hostpath-resizer-0" [b318fac7-c7d5-418f-9f16-8e4991ea9f29] Running
	I0924 00:39:19.076191 1874359 system_pods.go:89] "csi-hostpathplugin-rg84v" [99420363-d35f-4aef-8752-cd70a8687aca] Running
	I0924 00:39:19.076196 1874359 system_pods.go:89] "etcd-addons-371349" [0db6f1c9-6b22-4e0f-bd38-64d6f64a5f2b] Running
	I0924 00:39:19.076201 1874359 system_pods.go:89] "kindnet-c2v8q" [d7d499b8-6318-4999-8666-172b227c9eb9] Running
	I0924 00:39:19.076206 1874359 system_pods.go:89] "kube-apiserver-addons-371349" [57643502-89d7-4cb0-9a99-b11046416306] Running
	I0924 00:39:19.076211 1874359 system_pods.go:89] "kube-controller-manager-addons-371349" [a223fefc-7277-4cb1-8373-e7751bc87f10] Running
	I0924 00:39:19.076223 1874359 system_pods.go:89] "kube-ingress-dns-minikube" [4c89d0f9-906f-451c-807f-4b809f2d3f54] Running
	I0924 00:39:19.076227 1874359 system_pods.go:89] "kube-proxy-qcb9f" [69abd079-88b6-4b9f-831c-e871d95d4464] Running
	I0924 00:39:19.076232 1874359 system_pods.go:89] "kube-scheduler-addons-371349" [ae310285-de23-4f27-8f12-35713956d260] Running
	I0924 00:39:19.076241 1874359 system_pods.go:89] "metrics-server-84c5f94fbc-wxd2s" [7c5e5bee-e3dc-43a0-a7b2-e1afa3197ce6] Running
	I0924 00:39:19.076246 1874359 system_pods.go:89] "nvidia-device-plugin-daemonset-t52r5" [6ee689eb-216e-49b6-b98b-04c4a8a2a717] Running
	I0924 00:39:19.076250 1874359 system_pods.go:89] "registry-66c9cd494c-vx6hr" [2d03a897-de38-4010-b9d3-7e455400c58d] Running
	I0924 00:39:19.076254 1874359 system_pods.go:89] "registry-proxy-9jrvf" [1cea29a0-a418-43ce-8a72-6439715dfdb4] Running
	I0924 00:39:19.076259 1874359 system_pods.go:89] "snapshot-controller-56fcc65765-trtb4" [71554140-ea26-4c02-8605-9e5a7a72c935] Running
	I0924 00:39:19.076266 1874359 system_pods.go:89] "snapshot-controller-56fcc65765-vprd4" [9bf3685a-c093-4efd-9385-9e2cd6ab2d77] Running
	I0924 00:39:19.076271 1874359 system_pods.go:89] "storage-provisioner" [3f9e83c7-275e-48af-b839-10cd00b637ad] Running
	I0924 00:39:19.076278 1874359 system_pods.go:126] duration metric: took 10.078477ms to wait for k8s-apps to be running ...
	I0924 00:39:19.076291 1874359 system_svc.go:44] waiting for kubelet service to be running ....
	I0924 00:39:19.076352 1874359 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
	I0924 00:39:19.090090 1874359 system_svc.go:56] duration metric: took 13.789983ms WaitForService to wait for kubelet
	I0924 00:39:19.090120 1874359 kubeadm.go:582] duration metric: took 2m59.177267701s to wait for: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
	I0924 00:39:19.090142 1874359 node_conditions.go:102] verifying NodePressure condition ...
	I0924 00:39:19.093950 1874359 node_conditions.go:122] node storage ephemeral capacity is 203034800Ki
	I0924 00:39:19.093985 1874359 node_conditions.go:123] node cpu capacity is 2
	I0924 00:39:19.093996 1874359 node_conditions.go:105] duration metric: took 3.848216ms to run NodePressure ...
	I0924 00:39:19.094009 1874359 start.go:241] waiting for startup goroutines ...
	I0924 00:39:19.094016 1874359 start.go:246] waiting for cluster config update ...
	I0924 00:39:19.094032 1874359 start.go:255] writing updated cluster config ...
	I0924 00:39:19.094333 1874359 ssh_runner.go:195] Run: rm -f paused
	I0924 00:39:19.431140 1874359 start.go:600] kubectl: 1.31.1, cluster: 1.31.1 (minor skew: 0)
	I0924 00:39:19.432602 1874359 out.go:177] * Done! kubectl is now configured to use "addons-371349" cluster and "default" namespace by default
	
	
	==> CRI-O <==
	Sep 24 00:48:31 addons-371349 crio[964]: time="2024-09-24 00:48:31.113155254Z" level=info msg="Removed container 8454902f839db2952dfc61a1eba652c5888feb432fbcfc6f1537b871151cc26c: kube-system/csi-hostpath-resizer-0/csi-resizer" id=b4febe6f-e7c4-444a-9c7e-ce5d86b0dc58 name=/runtime.v1.RuntimeService/RemoveContainer
	Sep 24 00:48:33 addons-371349 crio[964]: time="2024-09-24 00:48:33.319972839Z" level=info msg="Stopping pod sandbox: 3da937eb6911feed845ca87e3772d02baf0ad833ff4363375eb781898c4f0853" id=2d6c076a-1e73-4f56-8b14-ca0c21a93905 name=/runtime.v1.RuntimeService/StopPodSandbox
	Sep 24 00:48:33 addons-371349 crio[964]: time="2024-09-24 00:48:33.320252028Z" level=info msg="Got pod network &{Name:registry-test Namespace:default ID:3da937eb6911feed845ca87e3772d02baf0ad833ff4363375eb781898c4f0853 UID:60a48f94-fcbc-4a96-a19f-a5b6706ae30d NetNS:/var/run/netns/875beff2-cc26-413a-ab7a-22af0fea2156 Networks:[{Name:kindnet Ifname:eth0}] RuntimeConfig:map[kindnet:{IP: MAC: PortMappings:[] Bandwidth:<nil> IpRanges:[]}] Aliases:map[]}"
	Sep 24 00:48:33 addons-371349 crio[964]: time="2024-09-24 00:48:33.320386088Z" level=info msg="Deleting pod default_registry-test from CNI network \"kindnet\" (type=ptp)"
	Sep 24 00:48:33 addons-371349 crio[964]: time="2024-09-24 00:48:33.360405899Z" level=info msg="Stopped pod sandbox: 3da937eb6911feed845ca87e3772d02baf0ad833ff4363375eb781898c4f0853" id=2d6c076a-1e73-4f56-8b14-ca0c21a93905 name=/runtime.v1.RuntimeService/StopPodSandbox
	Sep 24 00:48:34 addons-371349 crio[964]: time="2024-09-24 00:48:34.050083096Z" level=info msg="Stopping container: b1d94036fa8f52368acb324313569906b686c572f1584e5caf68613cd2901235 (timeout: 30s)" id=3d47089a-ee6d-4578-9470-97885f9be8e1 name=/runtime.v1.RuntimeService/StopContainer
	Sep 24 00:48:34 addons-371349 conmon[4086]: conmon b1d94036fa8f52368acb <ninfo>: container 4097 exited with status 2
	Sep 24 00:48:34 addons-371349 crio[964]: time="2024-09-24 00:48:34.069288382Z" level=info msg="Stopping container: 0ab6867ac383a5d431961e4b1b6336b2fe21624ebc042a8f764c75fa131352cb (timeout: 30s)" id=fcc99dc9-182a-4801-a28c-07f119ac87db name=/runtime.v1.RuntimeService/StopContainer
	Sep 24 00:48:34 addons-371349 crio[964]: time="2024-09-24 00:48:34.190428864Z" level=info msg="Stopped container b1d94036fa8f52368acb324313569906b686c572f1584e5caf68613cd2901235: kube-system/registry-66c9cd494c-vx6hr/registry" id=3d47089a-ee6d-4578-9470-97885f9be8e1 name=/runtime.v1.RuntimeService/StopContainer
	Sep 24 00:48:34 addons-371349 crio[964]: time="2024-09-24 00:48:34.191151053Z" level=info msg="Stopping pod sandbox: 9c29e5319148d6b45ed65f895e5ea56464ccde21bfe926f51a55ede44bf79ad7" id=2239a4b1-21e4-409a-bc55-c519760eb06c name=/runtime.v1.RuntimeService/StopPodSandbox
	Sep 24 00:48:34 addons-371349 crio[964]: time="2024-09-24 00:48:34.191386379Z" level=info msg="Got pod network &{Name:registry-66c9cd494c-vx6hr Namespace:kube-system ID:9c29e5319148d6b45ed65f895e5ea56464ccde21bfe926f51a55ede44bf79ad7 UID:2d03a897-de38-4010-b9d3-7e455400c58d NetNS:/var/run/netns/5e7d5ab7-501a-48a6-96f8-e4b007fb4e61 Networks:[{Name:kindnet Ifname:eth0}] RuntimeConfig:map[kindnet:{IP: MAC: PortMappings:[] Bandwidth:<nil> IpRanges:[]}] Aliases:map[]}"
	Sep 24 00:48:34 addons-371349 crio[964]: time="2024-09-24 00:48:34.191518380Z" level=info msg="Deleting pod kube-system_registry-66c9cd494c-vx6hr from CNI network \"kindnet\" (type=ptp)"
	Sep 24 00:48:34 addons-371349 crio[964]: time="2024-09-24 00:48:34.248102639Z" level=info msg="Stopped pod sandbox: 9c29e5319148d6b45ed65f895e5ea56464ccde21bfe926f51a55ede44bf79ad7" id=2239a4b1-21e4-409a-bc55-c519760eb06c name=/runtime.v1.RuntimeService/StopPodSandbox
	Sep 24 00:48:34 addons-371349 crio[964]: time="2024-09-24 00:48:34.248587837Z" level=info msg="Stopped container 0ab6867ac383a5d431961e4b1b6336b2fe21624ebc042a8f764c75fa131352cb: kube-system/registry-proxy-9jrvf/registry-proxy" id=fcc99dc9-182a-4801-a28c-07f119ac87db name=/runtime.v1.RuntimeService/StopContainer
	Sep 24 00:48:34 addons-371349 crio[964]: time="2024-09-24 00:48:34.249043547Z" level=info msg="Stopping pod sandbox: 285e59e9e9ae0925ddcaa7694472b2b88e5db8fec63112b14fde0d0a897ecd69" id=f646604c-9a86-40d4-9371-9416a346f050 name=/runtime.v1.RuntimeService/StopPodSandbox
	Sep 24 00:48:34 addons-371349 crio[964]: time="2024-09-24 00:48:34.270088016Z" level=info msg="Restoring iptables rules: *nat\n:KUBE-HP-7SVZFXYR6SI3RE67 - [0:0]\n:KUBE-HOSTPORTS - [0:0]\n:KUBE-HP-26PF22LUWHJ43N5X - [0:0]\n:KUBE-HP-3KCYL77QTKVU2ZNB - [0:0]\n-A KUBE-HOSTPORTS -p tcp -m comment --comment \"k8s_ingress-nginx-controller-bc57996ff-n2nsv_ingress-nginx_8ad70d54-e7ea-4840-8ce6-dabb26a9abc3_0_ hostport 443\" -m tcp --dport 443 -j KUBE-HP-3KCYL77QTKVU2ZNB\n-A KUBE-HOSTPORTS -p tcp -m comment --comment \"k8s_ingress-nginx-controller-bc57996ff-n2nsv_ingress-nginx_8ad70d54-e7ea-4840-8ce6-dabb26a9abc3_0_ hostport 80\" -m tcp --dport 80 -j KUBE-HP-26PF22LUWHJ43N5X\n-A KUBE-HP-26PF22LUWHJ43N5X -s 10.244.0.19/32 -m comment --comment \"k8s_ingress-nginx-controller-bc57996ff-n2nsv_ingress-nginx_8ad70d54-e7ea-4840-8ce6-dabb26a9abc3_0_ hostport 80\" -j KUBE-MARK-MASQ\n-A KUBE-HP-26PF22LUWHJ43N5X -p tcp -m comment --comment \"k8s_ingress-nginx-controller-bc57996ff-n2nsv_ingress-nginx_8ad70d54-e7ea-4840-8ce
6-dabb26a9abc3_0_ hostport 80\" -m tcp -j DNAT --to-destination 10.244.0.19:80\n-A KUBE-HP-3KCYL77QTKVU2ZNB -s 10.244.0.19/32 -m comment --comment \"k8s_ingress-nginx-controller-bc57996ff-n2nsv_ingress-nginx_8ad70d54-e7ea-4840-8ce6-dabb26a9abc3_0_ hostport 443\" -j KUBE-MARK-MASQ\n-A KUBE-HP-3KCYL77QTKVU2ZNB -p tcp -m comment --comment \"k8s_ingress-nginx-controller-bc57996ff-n2nsv_ingress-nginx_8ad70d54-e7ea-4840-8ce6-dabb26a9abc3_0_ hostport 443\" -m tcp -j DNAT --to-destination 10.244.0.19:443\n-X KUBE-HP-7SVZFXYR6SI3RE67\nCOMMIT\n"
	Sep 24 00:48:34 addons-371349 crio[964]: time="2024-09-24 00:48:34.277415047Z" level=info msg="Closing host port tcp:5000"
	Sep 24 00:48:34 addons-371349 crio[964]: time="2024-09-24 00:48:34.281732577Z" level=info msg="Host port tcp:5000 does not have an open socket"
	Sep 24 00:48:34 addons-371349 crio[964]: time="2024-09-24 00:48:34.281997022Z" level=info msg="Got pod network &{Name:registry-proxy-9jrvf Namespace:kube-system ID:285e59e9e9ae0925ddcaa7694472b2b88e5db8fec63112b14fde0d0a897ecd69 UID:1cea29a0-a418-43ce-8a72-6439715dfdb4 NetNS:/var/run/netns/4309c079-358c-4419-8dde-605934a2fa75 Networks:[{Name:kindnet Ifname:eth0}] RuntimeConfig:map[kindnet:{IP: MAC: PortMappings:[] Bandwidth:<nil> IpRanges:[]}] Aliases:map[]}"
	Sep 24 00:48:34 addons-371349 crio[964]: time="2024-09-24 00:48:34.282137983Z" level=info msg="Deleting pod kube-system_registry-proxy-9jrvf from CNI network \"kindnet\" (type=ptp)"
	Sep 24 00:48:34 addons-371349 crio[964]: time="2024-09-24 00:48:34.327998626Z" level=info msg="Stopped pod sandbox: 285e59e9e9ae0925ddcaa7694472b2b88e5db8fec63112b14fde0d0a897ecd69" id=f646604c-9a86-40d4-9371-9416a346f050 name=/runtime.v1.RuntimeService/StopPodSandbox
	Sep 24 00:48:34 addons-371349 crio[964]: time="2024-09-24 00:48:34.937167740Z" level=info msg="Removing container: b1d94036fa8f52368acb324313569906b686c572f1584e5caf68613cd2901235" id=dba95a22-161f-486b-a0af-d974314e4672 name=/runtime.v1.RuntimeService/RemoveContainer
	Sep 24 00:48:34 addons-371349 crio[964]: time="2024-09-24 00:48:34.966607998Z" level=info msg="Removed container b1d94036fa8f52368acb324313569906b686c572f1584e5caf68613cd2901235: kube-system/registry-66c9cd494c-vx6hr/registry" id=dba95a22-161f-486b-a0af-d974314e4672 name=/runtime.v1.RuntimeService/RemoveContainer
	Sep 24 00:48:34 addons-371349 crio[964]: time="2024-09-24 00:48:34.968920835Z" level=info msg="Removing container: 0ab6867ac383a5d431961e4b1b6336b2fe21624ebc042a8f764c75fa131352cb" id=a74f2226-f1fd-46be-b1ac-278a55a67a35 name=/runtime.v1.RuntimeService/RemoveContainer
	Sep 24 00:48:35 addons-371349 crio[964]: time="2024-09-24 00:48:35.000320617Z" level=info msg="Removed container 0ab6867ac383a5d431961e4b1b6336b2fe21624ebc042a8f764c75fa131352cb: kube-system/registry-proxy-9jrvf/registry-proxy" id=a74f2226-f1fd-46be-b1ac-278a55a67a35 name=/runtime.v1.RuntimeService/RemoveContainer
	
	
	==> container status <==
	CONTAINER           IMAGE                                                                                                                        CREATED             STATE               NAME                         ATTEMPT             POD ID              POD
	7f26839062247       ghcr.io/inspektor-gadget/inspektor-gadget@sha256:03e677e1cf9d2c9bea454e3dbcbcef20b3022e987534a2874eb1abc5bc3e73ec            21 seconds ago      Exited              gadget                       7                   03f0019b2bcac       gadget-fs9jc
	4463520cffdc1       registry.k8s.io/ingress-nginx/controller@sha256:22f9d129ae8c89a2cabbd13af3c1668944f3dd68fec186199b7024a0a2fc75b3             10 minutes ago      Running             controller                   0                   ae52844225819       ingress-nginx-controller-bc57996ff-n2nsv
	e149e451e3126       gcr.io/k8s-minikube/gcp-auth-webhook@sha256:a40e1a121ee367d1712ac3a54ec9c38c405a65dde923c98e5fa6368fa82c4b69                 10 minutes ago      Running             gcp-auth                     0                   c4f48f413c25f       gcp-auth-89d5ffd79-d948l
	85e06e0090091       gcr.io/cloud-spanner-emulator/emulator@sha256:6ce1265c73355797b34d2531c7146eed3996346f860517e35d1434182eb5f01d               10 minutes ago      Running             cloud-spanner-emulator       0                   3e49192aad656       cloud-spanner-emulator-5b584cc74-hfmlx
	6aa09a7ac6da5       docker.io/marcnuri/yakd@sha256:1c961556224d57fc747de0b1874524208e5fb4f8386f23e9c1c4c18e97109f17                              10 minutes ago      Running             yakd                         0                   c67945ae57513       yakd-dashboard-67d98fc6b-2rl8g
	37202d0c24a10       registry.k8s.io/sig-storage/snapshot-controller@sha256:5d668e35c15df6e87e2530da25d557f543182cedbdb39d421b87076463ee9857      10 minutes ago      Running             volume-snapshot-controller   0                   0af8abb4d1f48       snapshot-controller-56fcc65765-trtb4
	cf9ce75275386       registry.k8s.io/ingress-nginx/kube-webhook-certgen@sha256:7c4c1a6ca8855c524a64983eaf590e126a669ae12df83ad65de281c9beee13d3   11 minutes ago      Exited              patch                        0                   ada159dcac269       ingress-nginx-admission-patch-9xrbk
	818b4f0b37443       registry.k8s.io/metrics-server/metrics-server@sha256:048bcf48fc2cce517a61777e22bac782ba59ea5e9b9a54bcb42dbee99566a91f        11 minutes ago      Running             metrics-server               0                   d88787db1414c       metrics-server-84c5f94fbc-wxd2s
	d8a79b23cd874       nvcr.io/nvidia/k8s-device-plugin@sha256:cdd05f9d89f0552478d46474005e86b98795ad364664f644225b99d94978e680                     11 minutes ago      Running             nvidia-device-plugin-ctr     0                   d1fbb4249f7de       nvidia-device-plugin-daemonset-t52r5
	4f11a1288c9bb       docker.io/rancher/local-path-provisioner@sha256:689a2489a24e74426e4a4666e611c988202c5fa995908b0c60133aca3eb87d98             11 minutes ago      Running             local-path-provisioner       0                   4c000f65cf36b       local-path-provisioner-86d989889c-tshng
	f1661a0e1f8b0       registry.k8s.io/sig-storage/snapshot-controller@sha256:5d668e35c15df6e87e2530da25d557f543182cedbdb39d421b87076463ee9857      11 minutes ago      Running             volume-snapshot-controller   0                   d1b72df5353ea       snapshot-controller-56fcc65765-vprd4
	b8338b5a326d7       gcr.io/k8s-minikube/minikube-ingress-dns@sha256:4211a1de532376c881851542238121b26792225faa36a7b02dccad88fd05797c             11 minutes ago      Running             minikube-ingress-dns         0                   ebc02a7e6f6d7       kube-ingress-dns-minikube
	9ff09a8761eed       registry.k8s.io/ingress-nginx/kube-webhook-certgen@sha256:7c4c1a6ca8855c524a64983eaf590e126a669ae12df83ad65de281c9beee13d3   11 minutes ago      Exited              create                       0                   abefc786cbf2a       ingress-nginx-admission-create-bjd4p
	07152f00c7b55       2f6c962e7b8311337352d9fdea917da2184d9919f4da7695bc2a6517cf392fe4                                                             11 minutes ago      Running             coredns                      0                   3ba7cebb00be1       coredns-7c65d6cfc9-bsbwf
	f1f18e06d2168       ba04bb24b95753201135cbc420b233c1b0b9fa2e1fd21d28319c348c33fbcde6                                                             11 minutes ago      Running             storage-provisioner          0                   c3ea98ab822e0       storage-provisioner
	8f2c47f2d8dc2       24a140c548c075e487e45d0ee73b1aa89f8bfb40c08a57e05975559728822b1d                                                             12 minutes ago      Running             kube-proxy                   0                   2489a6eed4e31       kube-proxy-qcb9f
	7adace27f5bf6       6a23fa8fd2b78ab58e42ba273808edc936a9c53d8ac4a919f6337be094843a51                                                             12 minutes ago      Running             kindnet-cni                  0                   2495b8a3a9496       kindnet-c2v8q
	749045c42da2d       d3f53a98c0a9d9163c4848bcf34b2d2f5e1e3691b79f3d1dd6d0206809e02853                                                             12 minutes ago      Running             kube-apiserver               0                   6cdf84a4b6fee       kube-apiserver-addons-371349
	278db6b1284e1       7f8aa378bb47dffcf430f3a601abe39137e88aee0238e23ed8530fdd18dab82d                                                             12 minutes ago      Running             kube-scheduler               0                   b82c8f825daff       kube-scheduler-addons-371349
	40d8a21a9712f       27e3830e1402783674d8b594038967deea9d51f0d91b34c93c8f39d2f68af7da                                                             12 minutes ago      Running             etcd                         0                   d6149f16a9e9c       etcd-addons-371349
	340d83c4a515a       279f381cb37365bbbcd133c9531fba9c2beb0f38dbbe6ddfcd0b1b1643d3450e                                                             12 minutes ago      Running             kube-controller-manager      0                   aad17fb9b4c3f       kube-controller-manager-addons-371349
	
	
	==> coredns [07152f00c7b5566d20be0e478631432f898e24fefada16283e2ca7028b046c61] <==
	[INFO] 10.244.0.11:48609 - 27216 "A IN registry.kube-system.svc.cluster.local.cluster.local. udp 70 false 512" NXDOMAIN qr,aa,rd 163 0.000038178s
	[INFO] 10.244.0.11:38318 - 42285 "AAAA IN registry.kube-system.svc.cluster.local.us-east-2.compute.internal. udp 83 false 512" NXDOMAIN qr,rd,ra 83 0.00156723s
	[INFO] 10.244.0.11:38318 - 14127 "A IN registry.kube-system.svc.cluster.local.us-east-2.compute.internal. udp 83 false 512" NXDOMAIN qr,rd,ra 83 0.001620136s
	[INFO] 10.244.0.11:44250 - 19435 "AAAA IN registry.kube-system.svc.cluster.local. udp 56 false 512" NOERROR qr,aa,rd 149 0.000072589s
	[INFO] 10.244.0.11:44250 - 37865 "A IN registry.kube-system.svc.cluster.local. udp 56 false 512" NOERROR qr,aa,rd 110 0.000080277s
	[INFO] 10.244.0.11:44447 - 10882 "AAAA IN registry.kube-system.svc.cluster.local.kube-system.svc.cluster.local. udp 86 false 512" NXDOMAIN qr,aa,rd 179 0.000091764s
	[INFO] 10.244.0.11:44447 - 64414 "A IN registry.kube-system.svc.cluster.local.kube-system.svc.cluster.local. udp 86 false 512" NXDOMAIN qr,aa,rd 179 0.0000421s
	[INFO] 10.244.0.11:56763 - 16602 "A IN registry.kube-system.svc.cluster.local.svc.cluster.local. udp 74 false 512" NXDOMAIN qr,aa,rd 167 0.000073598s
	[INFO] 10.244.0.11:56763 - 7384 "AAAA IN registry.kube-system.svc.cluster.local.svc.cluster.local. udp 74 false 512" NXDOMAIN qr,aa,rd 167 0.00005828s
	[INFO] 10.244.0.11:57197 - 45264 "A IN registry.kube-system.svc.cluster.local.cluster.local. udp 70 false 512" NXDOMAIN qr,aa,rd 163 0.000080121s
	[INFO] 10.244.0.11:57197 - 13267 "AAAA IN registry.kube-system.svc.cluster.local.cluster.local. udp 70 false 512" NXDOMAIN qr,aa,rd 163 0.000119915s
	[INFO] 10.244.0.11:39794 - 42327 "A IN registry.kube-system.svc.cluster.local.us-east-2.compute.internal. udp 83 false 512" NXDOMAIN qr,rd,ra 83 0.001858752s
	[INFO] 10.244.0.11:39794 - 29017 "AAAA IN registry.kube-system.svc.cluster.local.us-east-2.compute.internal. udp 83 false 512" NXDOMAIN qr,rd,ra 83 0.002064112s
	[INFO] 10.244.0.11:34677 - 56184 "AAAA IN registry.kube-system.svc.cluster.local. udp 56 false 512" NOERROR qr,aa,rd 149 0.000062341s
	[INFO] 10.244.0.11:34677 - 8827 "A IN registry.kube-system.svc.cluster.local. udp 56 false 512" NOERROR qr,aa,rd 110 0.000037554s
	[INFO] 10.244.0.20:56840 - 63749 "A IN storage.googleapis.com.gcp-auth.svc.cluster.local. udp 78 false 1232" NXDOMAIN qr,aa,rd 160 0.004884802s
	[INFO] 10.244.0.20:49691 - 10017 "AAAA IN storage.googleapis.com.gcp-auth.svc.cluster.local. udp 78 false 1232" NXDOMAIN qr,aa,rd 160 0.004779089s
	[INFO] 10.244.0.20:34378 - 59763 "AAAA IN storage.googleapis.com.svc.cluster.local. udp 69 false 1232" NXDOMAIN qr,aa,rd 151 0.000111111s
	[INFO] 10.244.0.20:35355 - 24664 "A IN storage.googleapis.com.svc.cluster.local. udp 69 false 1232" NXDOMAIN qr,aa,rd 151 0.0001304s
	[INFO] 10.244.0.20:49361 - 45456 "A IN storage.googleapis.com.cluster.local. udp 65 false 1232" NXDOMAIN qr,aa,rd 147 0.000152095s
	[INFO] 10.244.0.20:51037 - 55739 "AAAA IN storage.googleapis.com.cluster.local. udp 65 false 1232" NXDOMAIN qr,aa,rd 147 0.000066607s
	[INFO] 10.244.0.20:48455 - 44296 "A IN storage.googleapis.com.us-east-2.compute.internal. udp 78 false 1232" NXDOMAIN qr,rd,ra 67 0.007091482s
	[INFO] 10.244.0.20:53491 - 40826 "AAAA IN storage.googleapis.com.us-east-2.compute.internal. udp 78 false 1232" NXDOMAIN qr,rd,ra 67 0.006788458s
	[INFO] 10.244.0.20:49373 - 48596 "AAAA IN storage.googleapis.com. udp 51 false 1232" NOERROR qr,rd,ra 240 0.001932063s
	[INFO] 10.244.0.20:49671 - 38666 "A IN storage.googleapis.com. udp 51 false 1232" NOERROR qr,rd,ra 648 0.00145365s
	
	
	==> describe nodes <==
	Name:               addons-371349
	Roles:              control-plane
	Labels:             beta.kubernetes.io/arch=arm64
	                    beta.kubernetes.io/os=linux
	                    kubernetes.io/arch=arm64
	                    kubernetes.io/hostname=addons-371349
	                    kubernetes.io/os=linux
	                    minikube.k8s.io/commit=41795ff643dcbe39cdf81f27d064464d20ae8e7c
	                    minikube.k8s.io/name=addons-371349
	                    minikube.k8s.io/primary=true
	                    minikube.k8s.io/updated_at=2024_09_24T00_36_16_0700
	                    minikube.k8s.io/version=v1.34.0
	                    node-role.kubernetes.io/control-plane=
	                    node.kubernetes.io/exclude-from-external-load-balancers=
	                    topology.hostpath.csi/node=addons-371349
	Annotations:        kubeadm.alpha.kubernetes.io/cri-socket: unix:///var/run/crio/crio.sock
	                    node.alpha.kubernetes.io/ttl: 0
	                    volumes.kubernetes.io/controller-managed-attach-detach: true
	CreationTimestamp:  Tue, 24 Sep 2024 00:36:12 +0000
	Taints:             <none>
	Unschedulable:      false
	Lease:
	  HolderIdentity:  addons-371349
	  AcquireTime:     <unset>
	  RenewTime:       Tue, 24 Sep 2024 00:48:29 +0000
	Conditions:
	  Type             Status  LastHeartbeatTime                 LastTransitionTime                Reason                       Message
	  ----             ------  -----------------                 ------------------                ------                       -------
	  MemoryPressure   False   Tue, 24 Sep 2024 00:48:19 +0000   Tue, 24 Sep 2024 00:36:10 +0000   KubeletHasSufficientMemory   kubelet has sufficient memory available
	  DiskPressure     False   Tue, 24 Sep 2024 00:48:19 +0000   Tue, 24 Sep 2024 00:36:10 +0000   KubeletHasNoDiskPressure     kubelet has no disk pressure
	  PIDPressure      False   Tue, 24 Sep 2024 00:48:19 +0000   Tue, 24 Sep 2024 00:36:10 +0000   KubeletHasSufficientPID      kubelet has sufficient PID available
	  Ready            True    Tue, 24 Sep 2024 00:48:19 +0000   Tue, 24 Sep 2024 00:37:04 +0000   KubeletReady                 kubelet is posting ready status
	Addresses:
	  InternalIP:  192.168.49.2
	  Hostname:    addons-371349
	Capacity:
	  cpu:                2
	  ephemeral-storage:  203034800Ki
	  hugepages-1Gi:      0
	  hugepages-2Mi:      0
	  hugepages-32Mi:     0
	  hugepages-64Ki:     0
	  memory:             8022296Ki
	  pods:               110
	Allocatable:
	  cpu:                2
	  ephemeral-storage:  203034800Ki
	  hugepages-1Gi:      0
	  hugepages-2Mi:      0
	  hugepages-32Mi:     0
	  hugepages-64Ki:     0
	  memory:             8022296Ki
	  pods:               110
	System Info:
	  Machine ID:                 7aa8545f283e470b93293e30cac1a65d
	  System UUID:                c56a6457-0c21-4897-8a88-d64df490f5dc
	  Boot ID:                    2adb9b4a-25b4-46c0-b3e7-a2955d81a12f
	  Kernel Version:             5.15.0-1070-aws
	  OS Image:                   Ubuntu 22.04.5 LTS
	  Operating System:           linux
	  Architecture:               arm64
	  Container Runtime Version:  cri-o://1.24.6
	  Kubelet Version:            v1.31.1
	  Kube-Proxy Version:         v1.31.1
	PodCIDR:                      10.244.0.0/24
	PodCIDRs:                     10.244.0.0/24
	Non-terminated Pods:          (20 in total)
	  Namespace                   Name                                        CPU Requests  CPU Limits  Memory Requests  Memory Limits  Age
	  ---------                   ----                                        ------------  ----------  ---------------  -------------  ---
	  default                     busybox                                     0 (0%)        0 (0%)      0 (0%)           0 (0%)         9m16s
	  default                     cloud-spanner-emulator-5b584cc74-hfmlx      0 (0%)        0 (0%)      0 (0%)           0 (0%)         12m
	  gadget                      gadget-fs9jc                                0 (0%)        0 (0%)      0 (0%)           0 (0%)         12m
	  gcp-auth                    gcp-auth-89d5ffd79-d948l                    0 (0%)        0 (0%)      0 (0%)           0 (0%)         12m
	  ingress-nginx               ingress-nginx-controller-bc57996ff-n2nsv    100m (5%)     0 (0%)      90Mi (1%)        0 (0%)         12m
	  kube-system                 coredns-7c65d6cfc9-bsbwf                    100m (5%)     0 (0%)      70Mi (0%)        170Mi (2%)     12m
	  kube-system                 etcd-addons-371349                          100m (5%)     0 (0%)      100Mi (1%)       0 (0%)         12m
	  kube-system                 kindnet-c2v8q                               100m (5%)     100m (5%)   50Mi (0%)        50Mi (0%)      12m
	  kube-system                 kube-apiserver-addons-371349                250m (12%)    0 (0%)      0 (0%)           0 (0%)         12m
	  kube-system                 kube-controller-manager-addons-371349       200m (10%)    0 (0%)      0 (0%)           0 (0%)         12m
	  kube-system                 kube-ingress-dns-minikube                   0 (0%)        0 (0%)      0 (0%)           0 (0%)         12m
	  kube-system                 kube-proxy-qcb9f                            0 (0%)        0 (0%)      0 (0%)           0 (0%)         12m
	  kube-system                 kube-scheduler-addons-371349                100m (5%)     0 (0%)      0 (0%)           0 (0%)         12m
	  kube-system                 metrics-server-84c5f94fbc-wxd2s             100m (5%)     0 (0%)      200Mi (2%)       0 (0%)         12m
	  kube-system                 nvidia-device-plugin-daemonset-t52r5        0 (0%)        0 (0%)      0 (0%)           0 (0%)         11m
	  kube-system                 snapshot-controller-56fcc65765-trtb4        0 (0%)        0 (0%)      0 (0%)           0 (0%)         12m
	  kube-system                 snapshot-controller-56fcc65765-vprd4        0 (0%)        0 (0%)      0 (0%)           0 (0%)         12m
	  kube-system                 storage-provisioner                         0 (0%)        0 (0%)      0 (0%)           0 (0%)         12m
	  local-path-storage          local-path-provisioner-86d989889c-tshng     0 (0%)        0 (0%)      0 (0%)           0 (0%)         12m
	  yakd-dashboard              yakd-dashboard-67d98fc6b-2rl8g              0 (0%)        0 (0%)      128Mi (1%)       256Mi (3%)     12m
	Allocated resources:
	  (Total limits may be over 100 percent, i.e., overcommitted.)
	  Resource           Requests     Limits
	  --------           --------     ------
	  cpu                1050m (52%)  100m (5%)
	  memory             638Mi (8%)   476Mi (6%)
	  ephemeral-storage  0 (0%)       0 (0%)
	  hugepages-1Gi      0 (0%)       0 (0%)
	  hugepages-2Mi      0 (0%)       0 (0%)
	  hugepages-32Mi     0 (0%)       0 (0%)
	  hugepages-64Ki     0 (0%)       0 (0%)
	Events:
	  Type     Reason                   Age                From             Message
	  ----     ------                   ----               ----             -------
	  Normal   Starting                 12m                kube-proxy       
	  Normal   NodeHasSufficientMemory  12m (x8 over 12m)  kubelet          Node addons-371349 status is now: NodeHasSufficientMemory
	  Normal   NodeHasNoDiskPressure    12m (x8 over 12m)  kubelet          Node addons-371349 status is now: NodeHasNoDiskPressure
	  Normal   NodeHasSufficientPID     12m (x7 over 12m)  kubelet          Node addons-371349 status is now: NodeHasSufficientPID
	  Normal   Starting                 12m                kubelet          Starting kubelet.
	  Warning  CgroupV1                 12m                kubelet          Cgroup v1 support is in maintenance mode, please migrate to Cgroup v2.
	  Normal   NodeHasSufficientMemory  12m                kubelet          Node addons-371349 status is now: NodeHasSufficientMemory
	  Normal   NodeHasNoDiskPressure    12m                kubelet          Node addons-371349 status is now: NodeHasNoDiskPressure
	  Normal   NodeHasSufficientPID     12m                kubelet          Node addons-371349 status is now: NodeHasSufficientPID
	  Normal   RegisteredNode           12m                node-controller  Node addons-371349 event: Registered Node addons-371349 in Controller
	  Normal   NodeReady                11m                kubelet          Node addons-371349 status is now: NodeReady
	
	
	==> dmesg <==
	[Sep23 22:30] hrtimer: interrupt took 9485972 ns
	[Sep24 00:08] overlayfs: '/var/lib/containers/storage/overlay/l/7FOWQIVXOWACA56BLQVF4JJOLY' not a directory
	[  +0.687175] overlayfs: '/var/lib/containers/storage/overlay/l/ZLTOCNGE2IGM6DT7VP2QP7OV3M' not a directory
	
	
	==> etcd [40d8a21a9712f40f598893c1aba5670ff43d964a7b5d9463400bf4a64836edb2] <==
	{"level":"info","ts":"2024-09-24T00:36:09.763365Z","caller":"membership/cluster.go:584","msg":"set initial cluster version","cluster-id":"fa54960ea34d58be","local-member-id":"aec36adc501070cc","cluster-version":"3.5"}
	{"level":"info","ts":"2024-09-24T00:36:09.763451Z","caller":"api/capability.go:75","msg":"enabled capabilities for version","cluster-version":"3.5"}
	{"level":"info","ts":"2024-09-24T00:36:09.763501Z","caller":"etcdserver/server.go:2653","msg":"cluster version is updated","cluster-version":"3.5"}
	{"level":"info","ts":"2024-09-24T00:36:09.764104Z","caller":"v3rpc/health.go:61","msg":"grpc service status changed","service":"","status":"SERVING"}
	{"level":"info","ts":"2024-09-24T00:36:09.765015Z","caller":"embed/serve.go:250","msg":"serving client traffic securely","traffic":"grpc+http","address":"192.168.49.2:2379"}
	{"level":"info","ts":"2024-09-24T00:36:09.769951Z","caller":"v3rpc/health.go:61","msg":"grpc service status changed","service":"","status":"SERVING"}
	{"level":"info","ts":"2024-09-24T00:36:09.771591Z","caller":"embed/serve.go:250","msg":"serving client traffic securely","traffic":"grpc+http","address":"127.0.0.1:2379"}
	{"level":"info","ts":"2024-09-24T00:36:20.632723Z","caller":"traceutil/trace.go:171","msg":"trace[773032134] transaction","detail":"{read_only:false; response_revision:337; number_of_response:1; }","duration":"103.686352ms","start":"2024-09-24T00:36:20.529020Z","end":"2024-09-24T00:36:20.632707Z","steps":["trace[773032134] 'process raft request'  (duration: 103.584422ms)"],"step_count":1}
	{"level":"info","ts":"2024-09-24T00:36:20.688729Z","caller":"traceutil/trace.go:171","msg":"trace[1378336386] transaction","detail":"{read_only:false; response_revision:338; number_of_response:1; }","duration":"159.451203ms","start":"2024-09-24T00:36:20.529260Z","end":"2024-09-24T00:36:20.688711Z","steps":["trace[1378336386] 'process raft request'  (duration: 156.488906ms)"],"step_count":1}
	{"level":"info","ts":"2024-09-24T00:36:20.708331Z","caller":"traceutil/trace.go:171","msg":"trace[1784308832] transaction","detail":"{read_only:false; response_revision:339; number_of_response:1; }","duration":"178.882143ms","start":"2024-09-24T00:36:20.529425Z","end":"2024-09-24T00:36:20.708307Z","steps":["trace[1784308832] 'process raft request'  (duration: 159.09506ms)"],"step_count":1}
	{"level":"info","ts":"2024-09-24T00:36:20.708902Z","caller":"traceutil/trace.go:171","msg":"trace[1518002914] linearizableReadLoop","detail":"{readStateIndex:348; appliedIndex:347; }","duration":"179.503099ms","start":"2024-09-24T00:36:20.529388Z","end":"2024-09-24T00:36:20.708891Z","steps":["trace[1518002914] 'read index received'  (duration: 103.522869ms)","trace[1518002914] 'applied index is now lower than readState.Index'  (duration: 75.979664ms)"],"step_count":2}
	{"level":"warn","ts":"2024-09-24T00:36:20.709094Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"179.677462ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/serviceaccounts/kube-system/ttl-controller\" ","response":"range_response_count:1 size:193"}
	{"level":"info","ts":"2024-09-24T00:36:20.709133Z","caller":"traceutil/trace.go:171","msg":"trace[1395871771] range","detail":"{range_begin:/registry/serviceaccounts/kube-system/ttl-controller; range_end:; response_count:1; response_revision:341; }","duration":"179.738343ms","start":"2024-09-24T00:36:20.529384Z","end":"2024-09-24T00:36:20.709122Z","steps":["trace[1395871771] 'agreement among raft nodes before linearized reading'  (duration: 179.649443ms)"],"step_count":1}
	{"level":"info","ts":"2024-09-24T00:36:21.611273Z","caller":"traceutil/trace.go:171","msg":"trace[662860870] transaction","detail":"{read_only:false; response_revision:345; number_of_response:1; }","duration":"106.953913ms","start":"2024-09-24T00:36:21.504299Z","end":"2024-09-24T00:36:21.611253Z","steps":["trace[662860870] 'process raft request'  (duration: 101.338407ms)"],"step_count":1}
	{"level":"info","ts":"2024-09-24T00:36:23.201763Z","caller":"traceutil/trace.go:171","msg":"trace[1579303640] transaction","detail":"{read_only:false; response_revision:363; number_of_response:1; }","duration":"247.066318ms","start":"2024-09-24T00:36:22.954673Z","end":"2024-09-24T00:36:23.201740Z","steps":["trace[1579303640] 'process raft request'  (duration: 246.933841ms)"],"step_count":1}
	{"level":"info","ts":"2024-09-24T00:36:23.205834Z","caller":"traceutil/trace.go:171","msg":"trace[578334532] transaction","detail":"{read_only:false; response_revision:364; number_of_response:1; }","duration":"101.109154ms","start":"2024-09-24T00:36:23.104699Z","end":"2024-09-24T00:36:23.205808Z","steps":["trace[578334532] 'process raft request'  (duration: 101.019022ms)"],"step_count":1}
	{"level":"info","ts":"2024-09-24T00:36:23.209377Z","caller":"traceutil/trace.go:171","msg":"trace[634610568] linearizableReadLoop","detail":"{readStateIndex:374; appliedIndex:374; }","duration":"104.566675ms","start":"2024-09-24T00:36:23.104792Z","end":"2024-09-24T00:36:23.209359Z","steps":["trace[634610568] 'read index received'  (duration: 104.557379ms)","trace[634610568] 'applied index is now lower than readState.Index'  (duration: 7.926µs)"],"step_count":2}
	{"level":"warn","ts":"2024-09-24T00:36:23.209761Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"104.957533ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/deployments/kube-system/registry\" ","response":"range_response_count:0 size:5"}
	{"level":"info","ts":"2024-09-24T00:36:23.209860Z","caller":"traceutil/trace.go:171","msg":"trace[589915269] range","detail":"{range_begin:/registry/deployments/kube-system/registry; range_end:; response_count:0; response_revision:364; }","duration":"105.061851ms","start":"2024-09-24T00:36:23.104788Z","end":"2024-09-24T00:36:23.209850Z","steps":["trace[589915269] 'agreement among raft nodes before linearized reading'  (duration: 104.923737ms)"],"step_count":1}
	{"level":"warn","ts":"2024-09-24T00:36:23.217249Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"109.080301ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/serviceaccounts/kube-system/kindnet\" ","response":"range_response_count:1 size:520"}
	{"level":"info","ts":"2024-09-24T00:36:23.217391Z","caller":"traceutil/trace.go:171","msg":"trace[1037015755] range","detail":"{range_begin:/registry/serviceaccounts/kube-system/kindnet; range_end:; response_count:1; response_revision:365; }","duration":"109.229213ms","start":"2024-09-24T00:36:23.108151Z","end":"2024-09-24T00:36:23.217380Z","steps":["trace[1037015755] 'agreement among raft nodes before linearized reading'  (duration: 109.058739ms)"],"step_count":1}
	{"level":"info","ts":"2024-09-24T00:36:23.826883Z","caller":"traceutil/trace.go:171","msg":"trace[275907741] transaction","detail":"{read_only:false; response_revision:394; number_of_response:1; }","duration":"111.28535ms","start":"2024-09-24T00:36:23.715585Z","end":"2024-09-24T00:36:23.826870Z","steps":["trace[275907741] 'process raft request'  (duration: 111.027855ms)"],"step_count":1}
	{"level":"info","ts":"2024-09-24T00:46:10.181655Z","caller":"mvcc/index.go:214","msg":"compact tree index","revision":1545}
	{"level":"info","ts":"2024-09-24T00:46:10.223346Z","caller":"mvcc/kvstore_compaction.go:69","msg":"finished scheduled compaction","compact-revision":1545,"took":"41.164636ms","hash":4261425463,"current-db-size-bytes":6520832,"current-db-size":"6.5 MB","current-db-size-in-use-bytes":3383296,"current-db-size-in-use":"3.4 MB"}
	{"level":"info","ts":"2024-09-24T00:46:10.223469Z","caller":"mvcc/hash.go:137","msg":"storing new hash","hash":4261425463,"revision":1545,"compact-revision":-1}
	
	
	==> gcp-auth [e149e451e3126d1f31e6122bc09312613e217e7626fd798777f48f923270c222] <==
	2024/09/24 00:37:59 GCP Auth Webhook started!
	2024/09/24 00:39:19 Ready to marshal response ...
	2024/09/24 00:39:19 Ready to write response ...
	2024/09/24 00:39:19 Ready to marshal response ...
	2024/09/24 00:39:19 Ready to write response ...
	2024/09/24 00:39:19 Ready to marshal response ...
	2024/09/24 00:39:19 Ready to write response ...
	2024/09/24 00:47:23 Ready to marshal response ...
	2024/09/24 00:47:23 Ready to write response ...
	2024/09/24 00:47:23 Ready to marshal response ...
	2024/09/24 00:47:23 Ready to write response ...
	2024/09/24 00:47:23 Ready to marshal response ...
	2024/09/24 00:47:23 Ready to write response ...
	2024/09/24 00:47:33 Ready to marshal response ...
	2024/09/24 00:47:33 Ready to write response ...
	2024/09/24 00:47:49 Ready to marshal response ...
	2024/09/24 00:47:49 Ready to write response ...
	2024/09/24 00:48:19 Ready to marshal response ...
	2024/09/24 00:48:19 Ready to write response ...
	
	
	==> kernel <==
	 00:48:35 up  8:31,  0 users,  load average: 1.73, 0.85, 1.31
	Linux addons-371349 5.15.0-1070-aws #76~20.04.1-Ubuntu SMP Mon Sep 2 12:20:48 UTC 2024 aarch64 aarch64 aarch64 GNU/Linux
	PRETTY_NAME="Ubuntu 22.04.5 LTS"
	
	
	==> kindnet [7adace27f5bf6fd0d07f44c3b2d9c4b94d8130080a2626aadc5ab73681d376ef] <==
	I0924 00:46:34.872158       1 main.go:299] handling current node
	I0924 00:46:44.876182       1 main.go:295] Handling node with IPs: map[192.168.49.2:{}]
	I0924 00:46:44.876218       1 main.go:299] handling current node
	I0924 00:46:54.871423       1 main.go:295] Handling node with IPs: map[192.168.49.2:{}]
	I0924 00:46:54.871537       1 main.go:299] handling current node
	I0924 00:47:04.866582       1 main.go:295] Handling node with IPs: map[192.168.49.2:{}]
	I0924 00:47:04.866619       1 main.go:299] handling current node
	I0924 00:47:14.871961       1 main.go:295] Handling node with IPs: map[192.168.49.2:{}]
	I0924 00:47:14.871996       1 main.go:299] handling current node
	I0924 00:47:24.867170       1 main.go:295] Handling node with IPs: map[192.168.49.2:{}]
	I0924 00:47:24.867203       1 main.go:299] handling current node
	I0924 00:47:34.867226       1 main.go:295] Handling node with IPs: map[192.168.49.2:{}]
	I0924 00:47:34.867338       1 main.go:299] handling current node
	I0924 00:47:44.869939       1 main.go:295] Handling node with IPs: map[192.168.49.2:{}]
	I0924 00:47:44.870052       1 main.go:299] handling current node
	I0924 00:47:54.866784       1 main.go:295] Handling node with IPs: map[192.168.49.2:{}]
	I0924 00:47:54.866917       1 main.go:299] handling current node
	I0924 00:48:04.868932       1 main.go:295] Handling node with IPs: map[192.168.49.2:{}]
	I0924 00:48:04.869016       1 main.go:299] handling current node
	I0924 00:48:14.867419       1 main.go:295] Handling node with IPs: map[192.168.49.2:{}]
	I0924 00:48:14.867458       1 main.go:299] handling current node
	I0924 00:48:24.866571       1 main.go:295] Handling node with IPs: map[192.168.49.2:{}]
	I0924 00:48:24.866606       1 main.go:299] handling current node
	I0924 00:48:34.866986       1 main.go:295] Handling node with IPs: map[192.168.49.2:{}]
	I0924 00:48:34.867016       1 main.go:299] handling current node
	
	
	==> kube-apiserver [749045c42da2d61080a3969428ab514fa4047e831ebb9439b8511e518e9b1c04] <==
	E0924 00:38:45.433793       1 remote_available_controller.go:448] "Unhandled Error" err="v1beta1.metrics.k8s.io failed with: failing or missing response from https://10.103.153.130:443/apis/metrics.k8s.io/v1beta1: Get \"https://10.103.153.130:443/apis/metrics.k8s.io/v1beta1\": dial tcp 10.103.153.130:443: connect: connection refused" logger="UnhandledError"
	W0924 00:38:45.434205       1 handler_proxy.go:99] no RequestInfo found in the context
	E0924 00:38:45.434269       1 controller.go:146] "Unhandled Error" err=<
		Error updating APIService "v1beta1.metrics.k8s.io" with err: failed to download v1beta1.metrics.k8s.io: failed to retrieve openAPI spec, http error: ResponseCode: 503, Body: service unavailable
		, Header: map[Content-Type:[text/plain; charset=utf-8] X-Content-Type-Options:[nosniff]]
	 > logger="UnhandledError"
	W0924 00:38:46.435500       1 handler_proxy.go:99] no RequestInfo found in the context
	E0924 00:38:46.435559       1 controller.go:113] "Unhandled Error" err="loading OpenAPI spec for \"v1beta1.metrics.k8s.io\" failed with: Error, could not get list of group versions for APIService" logger="UnhandledError"
	W0924 00:38:46.435611       1 handler_proxy.go:99] no RequestInfo found in the context
	E0924 00:38:46.435690       1 controller.go:102] "Unhandled Error" err=<
		loading OpenAPI spec for "v1beta1.metrics.k8s.io" failed with: failed to download v1beta1.metrics.k8s.io: failed to retrieve openAPI spec, http error: ResponseCode: 503, Body: service unavailable
		, Header: map[Content-Type:[text/plain; charset=utf-8] X-Content-Type-Options:[nosniff]]
	 > logger="UnhandledError"
	I0924 00:38:46.436649       1 controller.go:126] OpenAPI AggregationController: action for item v1beta1.metrics.k8s.io: Rate Limited Requeue.
	I0924 00:38:46.437745       1 controller.go:109] OpenAPI AggregationController: action for item v1beta1.metrics.k8s.io: Rate Limited Requeue.
	E0924 00:38:50.441106       1 remote_available_controller.go:448] "Unhandled Error" err="v1beta1.metrics.k8s.io failed with: failing or missing response from https://10.103.153.130:443/apis/metrics.k8s.io/v1beta1: Get \"https://10.103.153.130:443/apis/metrics.k8s.io/v1beta1\": context deadline exceeded" logger="UnhandledError"
	W0924 00:38:50.441314       1 handler_proxy.go:99] no RequestInfo found in the context
	E0924 00:38:50.441371       1 controller.go:146] "Unhandled Error" err=<
		Error updating APIService "v1beta1.metrics.k8s.io" with err: failed to download v1beta1.metrics.k8s.io: failed to retrieve openAPI spec, http error: ResponseCode: 503, Body: service unavailable
		, Header: map[Content-Type:[text/plain; charset=utf-8] X-Content-Type-Options:[nosniff]]
	 > logger="UnhandledError"
	I0924 00:38:50.494463       1 handler.go:286] Adding GroupVersion metrics.k8s.io v1beta1 to ResourceManager
	E0924 00:38:50.513681       1 remote_available_controller.go:448] "Unhandled Error" err="v1beta1.metrics.k8s.io failed with: Operation cannot be fulfilled on apiservices.apiregistration.k8s.io \"v1beta1.metrics.k8s.io\": the object has been modified; please apply your changes to the latest version and try again" logger="UnhandledError"
	I0924 00:47:23.907476       1 alloc.go:330] "allocated clusterIPs" service="headlamp/headlamp" clusterIPs={"IPv4":"10.111.108.144"}
	I0924 00:48:00.394720       1 controller.go:615] quota admission added evaluator for: volumesnapshots.snapshot.storage.k8s.io
	
	
	==> kube-controller-manager [340d83c4a515af013d7e2f2cb8dd72a56a11c8be46e63481fd282573f250be80] <==
	E0924 00:38:19.744419       1 resource_quota_controller.go:446] "Unhandled Error" err="unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: stale GroupVersion discovery: metrics.k8s.io/v1beta1" logger="UnhandledError"
	I0924 00:38:20.299194       1 garbagecollector.go:826] "failed to discover some groups" logger="garbage-collector-controller" groups="<internal error: json: unsupported type: map[schema.GroupVersion]error>"
	I0924 00:38:22.852858       1 replica_set.go:679] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="ingress-nginx/ingress-nginx-controller-bc57996ff" duration="10.606054ms"
	I0924 00:38:22.853562       1 replica_set.go:679] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="ingress-nginx/ingress-nginx-controller-bc57996ff" duration="46.415µs"
	I0924 00:38:45.426184       1 replica_set.go:679] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="kube-system/metrics-server-84c5f94fbc" duration="13.209025ms"
	I0924 00:38:45.426644       1 replica_set.go:679] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="kube-system/metrics-server-84c5f94fbc" duration="70.849µs"
	I0924 00:38:48.227710       1 range_allocator.go:241] "Successfully synced" logger="node-ipam-controller" key="addons-371349"
	E0924 00:38:49.749531       1 resource_quota_controller.go:446] "Unhandled Error" err="unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: stale GroupVersion discovery: metrics.k8s.io/v1beta1" logger="UnhandledError"
	I0924 00:38:50.306915       1 garbagecollector.go:826] "failed to discover some groups" logger="garbage-collector-controller" groups="<internal error: json: unsupported type: map[schema.GroupVersion]error>"
	I0924 00:43:55.182684       1 range_allocator.go:241] "Successfully synced" logger="node-ipam-controller" key="addons-371349"
	I0924 00:47:23.992327       1 replica_set.go:679] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="headlamp/headlamp-7b5c95b59d" duration="62.125988ms"
	I0924 00:47:24.006158       1 replica_set.go:679] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="headlamp/headlamp-7b5c95b59d" duration="13.555694ms"
	I0924 00:47:24.006692       1 replica_set.go:679] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="headlamp/headlamp-7b5c95b59d" duration="97.967µs"
	I0924 00:47:24.007440       1 replica_set.go:679] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="headlamp/headlamp-7b5c95b59d" duration="48.779µs"
	I0924 00:47:27.624482       1 replica_set.go:679] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="headlamp/headlamp-7b5c95b59d" duration="176.873µs"
	I0924 00:47:27.657666       1 replica_set.go:679] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="headlamp/headlamp-7b5c95b59d" duration="11.734652ms"
	I0924 00:47:27.657853       1 replica_set.go:679] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="headlamp/headlamp-7b5c95b59d" duration="77.544µs"
	I0924 00:47:33.557520       1 replica_set.go:679] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="headlamp/headlamp-7b5c95b59d" duration="12.849µs"
	I0924 00:47:43.775488       1 namespace_controller.go:187] "Namespace has been deleted" logger="namespace-controller" namespace="headlamp"
	I0924 00:47:49.550443       1 range_allocator.go:241] "Successfully synced" logger="node-ipam-controller" key="addons-371349"
	I0924 00:48:20.014374       1 range_allocator.go:241] "Successfully synced" logger="node-ipam-controller" key="addons-371349"
	I0924 00:48:29.976087       1 stateful_set.go:466] "StatefulSet has been deleted" logger="statefulset-controller" key="kube-system/csi-hostpath-attacher"
	I0924 00:48:30.085241       1 stateful_set.go:466] "StatefulSet has been deleted" logger="statefulset-controller" key="kube-system/csi-hostpath-resizer"
	I0924 00:48:30.651607       1 range_allocator.go:241] "Successfully synced" logger="node-ipam-controller" key="addons-371349"
	I0924 00:48:34.027924       1 replica_set.go:679] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="kube-system/registry-66c9cd494c" duration="5.932µs"
	
	
	==> kube-proxy [8f2c47f2d8dc25f068087f5d0e702e1768f8714f22c484f1ebe13e92be684997] <==
	I0924 00:36:25.074970       1 server_linux.go:66] "Using iptables proxy"
	I0924 00:36:25.515603       1 server.go:677] "Successfully retrieved node IP(s)" IPs=["192.168.49.2"]
	E0924 00:36:25.515901       1 server.go:234] "Kube-proxy configuration may be incomplete or incorrect" err="nodePortAddresses is unset; NodePort connections will be accepted on all local IPs. Consider using `--nodeport-addresses primary`"
	I0924 00:36:25.628068       1 server.go:243] "kube-proxy running in dual-stack mode" primary ipFamily="IPv4"
	I0924 00:36:25.628119       1 server_linux.go:169] "Using iptables Proxier"
	I0924 00:36:25.648842       1 proxier.go:255] "Setting route_localnet=1 to allow node-ports on localhost; to change this either disable iptables.localhostNodePorts (--iptables-localhost-nodeports) or set nodePortAddresses (--nodeport-addresses) to filter loopback addresses" ipFamily="IPv4"
	I0924 00:36:25.653049       1 server.go:483] "Version info" version="v1.31.1"
	I0924 00:36:25.653080       1 server.go:485] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
	I0924 00:36:25.700056       1 config.go:199] "Starting service config controller"
	I0924 00:36:25.700112       1 shared_informer.go:313] Waiting for caches to sync for service config
	I0924 00:36:25.700145       1 config.go:105] "Starting endpoint slice config controller"
	I0924 00:36:25.700151       1 shared_informer.go:313] Waiting for caches to sync for endpoint slice config
	I0924 00:36:25.700699       1 config.go:328] "Starting node config controller"
	I0924 00:36:25.700719       1 shared_informer.go:313] Waiting for caches to sync for node config
	I0924 00:36:26.004104       1 shared_informer.go:320] Caches are synced for node config
	I0924 00:36:26.004226       1 shared_informer.go:320] Caches are synced for service config
	I0924 00:36:26.004259       1 shared_informer.go:320] Caches are synced for endpoint slice config
	
	
	==> kube-scheduler [278db6b1284e1f1d66e55b827b5a4b51ea66ac4b399cfb13b724520fb0071730] <==
	W0924 00:36:12.854573       1 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.Service: services is forbidden: User "system:kube-scheduler" cannot list resource "services" in API group "" at the cluster scope
	E0924 00:36:12.858043       1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.Service: failed to list *v1.Service: services is forbidden: User \"system:kube-scheduler\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError"
	W0924 00:36:13.660480       1 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.PersistentVolume: persistentvolumes is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumes" in API group "" at the cluster scope
	E0924 00:36:13.660619       1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.PersistentVolume: failed to list *v1.PersistentVolume: persistentvolumes is forbidden: User \"system:kube-scheduler\" cannot list resource \"persistentvolumes\" in API group \"\" at the cluster scope" logger="UnhandledError"
	W0924 00:36:13.671582       1 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.ReplicationController: replicationcontrollers is forbidden: User "system:kube-scheduler" cannot list resource "replicationcontrollers" in API group "" at the cluster scope
	E0924 00:36:13.671700       1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.ReplicationController: failed to list *v1.ReplicationController: replicationcontrollers is forbidden: User \"system:kube-scheduler\" cannot list resource \"replicationcontrollers\" in API group \"\" at the cluster scope" logger="UnhandledError"
	W0924 00:36:13.680036       1 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.ReplicaSet: replicasets.apps is forbidden: User "system:kube-scheduler" cannot list resource "replicasets" in API group "apps" at the cluster scope
	E0924 00:36:13.680155       1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.ReplicaSet: failed to list *v1.ReplicaSet: replicasets.apps is forbidden: User \"system:kube-scheduler\" cannot list resource \"replicasets\" in API group \"apps\" at the cluster scope" logger="UnhandledError"
	W0924 00:36:13.738765       1 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.CSIStorageCapacity: csistoragecapacities.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csistoragecapacities" in API group "storage.k8s.io" at the cluster scope
	E0924 00:36:13.738807       1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.CSIStorageCapacity: failed to list *v1.CSIStorageCapacity: csistoragecapacities.storage.k8s.io is forbidden: User \"system:kube-scheduler\" cannot list resource \"csistoragecapacities\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError"
	W0924 00:36:13.767667       1 reflector.go:561] runtime/asm_arm64.s:1222: failed to list *v1.ConfigMap: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot list resource "configmaps" in API group "" in the namespace "kube-system"
	E0924 00:36:13.767800       1 reflector.go:158] "Unhandled Error" err="runtime/asm_arm64.s:1222: Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps \"extension-apiserver-authentication\" is forbidden: User \"system:kube-scheduler\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"kube-system\"" logger="UnhandledError"
	W0924 00:36:13.793760       1 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csidrivers" in API group "storage.k8s.io" at the cluster scope
	E0924 00:36:13.793802       1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.CSIDriver: failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:kube-scheduler\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError"
	W0924 00:36:13.833453       1 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.CSINode: csinodes.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csinodes" in API group "storage.k8s.io" at the cluster scope
	E0924 00:36:13.833510       1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.CSINode: failed to list *v1.CSINode: csinodes.storage.k8s.io is forbidden: User \"system:kube-scheduler\" cannot list resource \"csinodes\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError"
	W0924 00:36:13.843267       1 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.PersistentVolumeClaim: persistentvolumeclaims is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumeclaims" in API group "" at the cluster scope
	E0924 00:36:13.843320       1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.PersistentVolumeClaim: failed to list *v1.PersistentVolumeClaim: persistentvolumeclaims is forbidden: User \"system:kube-scheduler\" cannot list resource \"persistentvolumeclaims\" in API group \"\" at the cluster scope" logger="UnhandledError"
	W0924 00:36:13.901524       1 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.Pod: pods is forbidden: User "system:kube-scheduler" cannot list resource "pods" in API group "" at the cluster scope
	E0924 00:36:13.901892       1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.Pod: failed to list *v1.Pod: pods is forbidden: User \"system:kube-scheduler\" cannot list resource \"pods\" in API group \"\" at the cluster scope" logger="UnhandledError"
	W0924 00:36:13.930111       1 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.PodDisruptionBudget: poddisruptionbudgets.policy is forbidden: User "system:kube-scheduler" cannot list resource "poddisruptionbudgets" in API group "policy" at the cluster scope
	E0924 00:36:13.930255       1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.PodDisruptionBudget: failed to list *v1.PodDisruptionBudget: poddisruptionbudgets.policy is forbidden: User \"system:kube-scheduler\" cannot list resource \"poddisruptionbudgets\" in API group \"policy\" at the cluster scope" logger="UnhandledError"
	W0924 00:36:13.937226       1 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.Namespace: namespaces is forbidden: User "system:kube-scheduler" cannot list resource "namespaces" in API group "" at the cluster scope
	E0924 00:36:13.937281       1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.Namespace: failed to list *v1.Namespace: namespaces is forbidden: User \"system:kube-scheduler\" cannot list resource \"namespaces\" in API group \"\" at the cluster scope" logger="UnhandledError"
	I0924 00:36:15.547144       1 shared_informer.go:320] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file
	
	
	==> kubelet <==
	Sep 24 00:48:33 addons-371349 kubelet[1485]: I0924 00:48:33.481035    1485 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"gcp-creds\" (UniqueName: \"kubernetes.io/host-path/60a48f94-fcbc-4a96-a19f-a5b6706ae30d-gcp-creds\") pod \"60a48f94-fcbc-4a96-a19f-a5b6706ae30d\" (UID: \"60a48f94-fcbc-4a96-a19f-a5b6706ae30d\") "
	Sep 24 00:48:33 addons-371349 kubelet[1485]: I0924 00:48:33.481101    1485 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qzh6m\" (UniqueName: \"kubernetes.io/projected/60a48f94-fcbc-4a96-a19f-a5b6706ae30d-kube-api-access-qzh6m\") pod \"60a48f94-fcbc-4a96-a19f-a5b6706ae30d\" (UID: \"60a48f94-fcbc-4a96-a19f-a5b6706ae30d\") "
	Sep 24 00:48:33 addons-371349 kubelet[1485]: I0924 00:48:33.481533    1485 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/60a48f94-fcbc-4a96-a19f-a5b6706ae30d-gcp-creds" (OuterVolumeSpecName: "gcp-creds") pod "60a48f94-fcbc-4a96-a19f-a5b6706ae30d" (UID: "60a48f94-fcbc-4a96-a19f-a5b6706ae30d"). InnerVolumeSpecName "gcp-creds". PluginName "kubernetes.io/host-path", VolumeGidValue ""
	Sep 24 00:48:33 addons-371349 kubelet[1485]: I0924 00:48:33.486352    1485 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/60a48f94-fcbc-4a96-a19f-a5b6706ae30d-kube-api-access-qzh6m" (OuterVolumeSpecName: "kube-api-access-qzh6m") pod "60a48f94-fcbc-4a96-a19f-a5b6706ae30d" (UID: "60a48f94-fcbc-4a96-a19f-a5b6706ae30d"). InnerVolumeSpecName "kube-api-access-qzh6m". PluginName "kubernetes.io/projected", VolumeGidValue ""
	Sep 24 00:48:33 addons-371349 kubelet[1485]: I0924 00:48:33.582037    1485 reconciler_common.go:288] "Volume detached for volume \"kube-api-access-qzh6m\" (UniqueName: \"kubernetes.io/projected/60a48f94-fcbc-4a96-a19f-a5b6706ae30d-kube-api-access-qzh6m\") on node \"addons-371349\" DevicePath \"\""
	Sep 24 00:48:33 addons-371349 kubelet[1485]: I0924 00:48:33.582083    1485 reconciler_common.go:288] "Volume detached for volume \"gcp-creds\" (UniqueName: \"kubernetes.io/host-path/60a48f94-fcbc-4a96-a19f-a5b6706ae30d-gcp-creds\") on node \"addons-371349\" DevicePath \"\""
	Sep 24 00:48:34 addons-371349 kubelet[1485]: I0924 00:48:34.387950    1485 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lcx5q\" (UniqueName: \"kubernetes.io/projected/2d03a897-de38-4010-b9d3-7e455400c58d-kube-api-access-lcx5q\") pod \"2d03a897-de38-4010-b9d3-7e455400c58d\" (UID: \"2d03a897-de38-4010-b9d3-7e455400c58d\") "
	Sep 24 00:48:34 addons-371349 kubelet[1485]: I0924 00:48:34.388018    1485 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tfcp7\" (UniqueName: \"kubernetes.io/projected/1cea29a0-a418-43ce-8a72-6439715dfdb4-kube-api-access-tfcp7\") pod \"1cea29a0-a418-43ce-8a72-6439715dfdb4\" (UID: \"1cea29a0-a418-43ce-8a72-6439715dfdb4\") "
	Sep 24 00:48:34 addons-371349 kubelet[1485]: I0924 00:48:34.395518    1485 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1cea29a0-a418-43ce-8a72-6439715dfdb4-kube-api-access-tfcp7" (OuterVolumeSpecName: "kube-api-access-tfcp7") pod "1cea29a0-a418-43ce-8a72-6439715dfdb4" (UID: "1cea29a0-a418-43ce-8a72-6439715dfdb4"). InnerVolumeSpecName "kube-api-access-tfcp7". PluginName "kubernetes.io/projected", VolumeGidValue ""
	Sep 24 00:48:34 addons-371349 kubelet[1485]: I0924 00:48:34.396086    1485 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2d03a897-de38-4010-b9d3-7e455400c58d-kube-api-access-lcx5q" (OuterVolumeSpecName: "kube-api-access-lcx5q") pod "2d03a897-de38-4010-b9d3-7e455400c58d" (UID: "2d03a897-de38-4010-b9d3-7e455400c58d"). InnerVolumeSpecName "kube-api-access-lcx5q". PluginName "kubernetes.io/projected", VolumeGidValue ""
	Sep 24 00:48:34 addons-371349 kubelet[1485]: I0924 00:48:34.488742    1485 reconciler_common.go:288] "Volume detached for volume \"kube-api-access-tfcp7\" (UniqueName: \"kubernetes.io/projected/1cea29a0-a418-43ce-8a72-6439715dfdb4-kube-api-access-tfcp7\") on node \"addons-371349\" DevicePath \"\""
	Sep 24 00:48:34 addons-371349 kubelet[1485]: I0924 00:48:34.488776    1485 reconciler_common.go:288] "Volume detached for volume \"kube-api-access-lcx5q\" (UniqueName: \"kubernetes.io/projected/2d03a897-de38-4010-b9d3-7e455400c58d-kube-api-access-lcx5q\") on node \"addons-371349\" DevicePath \"\""
	Sep 24 00:48:34 addons-371349 kubelet[1485]: I0924 00:48:34.935211    1485 scope.go:117] "RemoveContainer" containerID="b1d94036fa8f52368acb324313569906b686c572f1584e5caf68613cd2901235"
	Sep 24 00:48:34 addons-371349 kubelet[1485]: I0924 00:48:34.967030    1485 scope.go:117] "RemoveContainer" containerID="b1d94036fa8f52368acb324313569906b686c572f1584e5caf68613cd2901235"
	Sep 24 00:48:34 addons-371349 kubelet[1485]: E0924 00:48:34.967394    1485 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b1d94036fa8f52368acb324313569906b686c572f1584e5caf68613cd2901235\": container with ID starting with b1d94036fa8f52368acb324313569906b686c572f1584e5caf68613cd2901235 not found: ID does not exist" containerID="b1d94036fa8f52368acb324313569906b686c572f1584e5caf68613cd2901235"
	Sep 24 00:48:34 addons-371349 kubelet[1485]: I0924 00:48:34.967429    1485 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b1d94036fa8f52368acb324313569906b686c572f1584e5caf68613cd2901235"} err="failed to get container status \"b1d94036fa8f52368acb324313569906b686c572f1584e5caf68613cd2901235\": rpc error: code = NotFound desc = could not find container \"b1d94036fa8f52368acb324313569906b686c572f1584e5caf68613cd2901235\": container with ID starting with b1d94036fa8f52368acb324313569906b686c572f1584e5caf68613cd2901235 not found: ID does not exist"
	Sep 24 00:48:34 addons-371349 kubelet[1485]: I0924 00:48:34.967455    1485 scope.go:117] "RemoveContainer" containerID="0ab6867ac383a5d431961e4b1b6336b2fe21624ebc042a8f764c75fa131352cb"
	Sep 24 00:48:35 addons-371349 kubelet[1485]: I0924 00:48:35.000761    1485 scope.go:117] "RemoveContainer" containerID="0ab6867ac383a5d431961e4b1b6336b2fe21624ebc042a8f764c75fa131352cb"
	Sep 24 00:48:35 addons-371349 kubelet[1485]: E0924 00:48:35.001151    1485 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0ab6867ac383a5d431961e4b1b6336b2fe21624ebc042a8f764c75fa131352cb\": container with ID starting with 0ab6867ac383a5d431961e4b1b6336b2fe21624ebc042a8f764c75fa131352cb not found: ID does not exist" containerID="0ab6867ac383a5d431961e4b1b6336b2fe21624ebc042a8f764c75fa131352cb"
	Sep 24 00:48:35 addons-371349 kubelet[1485]: I0924 00:48:35.001187    1485 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0ab6867ac383a5d431961e4b1b6336b2fe21624ebc042a8f764c75fa131352cb"} err="failed to get container status \"0ab6867ac383a5d431961e4b1b6336b2fe21624ebc042a8f764c75fa131352cb\": rpc error: code = NotFound desc = could not find container \"0ab6867ac383a5d431961e4b1b6336b2fe21624ebc042a8f764c75fa131352cb\": container with ID starting with 0ab6867ac383a5d431961e4b1b6336b2fe21624ebc042a8f764c75fa131352cb not found: ID does not exist"
	Sep 24 00:48:35 addons-371349 kubelet[1485]: I0924 00:48:35.142532    1485 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1cea29a0-a418-43ce-8a72-6439715dfdb4" path="/var/lib/kubelet/pods/1cea29a0-a418-43ce-8a72-6439715dfdb4/volumes"
	Sep 24 00:48:35 addons-371349 kubelet[1485]: I0924 00:48:35.142947    1485 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2d03a897-de38-4010-b9d3-7e455400c58d" path="/var/lib/kubelet/pods/2d03a897-de38-4010-b9d3-7e455400c58d/volumes"
	Sep 24 00:48:35 addons-371349 kubelet[1485]: I0924 00:48:35.143325    1485 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="60a48f94-fcbc-4a96-a19f-a5b6706ae30d" path="/var/lib/kubelet/pods/60a48f94-fcbc-4a96-a19f-a5b6706ae30d/volumes"
	Sep 24 00:48:35 addons-371349 kubelet[1485]: E0924 00:48:35.423981    1485 eviction_manager.go:257] "Eviction manager: failed to get HasDedicatedImageFs" err="missing image stats: &ImageFsInfoResponse{ImageFilesystems:[]*FilesystemUsage{&FilesystemUsage{Timestamp:1727138915423722661,FsId:&FilesystemIdentifier{Mountpoint:/var/lib/containers/storage/overlay-images,},UsedBytes:&UInt64Value{Value:503200,},InodesUsed:&UInt64Value{Value:195,},},},ContainerFilesystems:[]*FilesystemUsage{},}"
	Sep 24 00:48:35 addons-371349 kubelet[1485]: E0924 00:48:35.424019    1485 eviction_manager.go:212] "Eviction manager: failed to synchronize" err="eviction manager: failed to get HasDedicatedImageFs: missing image stats: &ImageFsInfoResponse{ImageFilesystems:[]*FilesystemUsage{&FilesystemUsage{Timestamp:1727138915423722661,FsId:&FilesystemIdentifier{Mountpoint:/var/lib/containers/storage/overlay-images,},UsedBytes:&UInt64Value{Value:503200,},InodesUsed:&UInt64Value{Value:195,},},},ContainerFilesystems:[]*FilesystemUsage{},}"
	
	
	==> storage-provisioner [f1f18e06d2168b28d189eb5c666ad7d131f5f957d56fade8478d775c15870ec6] <==
	I0924 00:37:05.969239       1 storage_provisioner.go:116] Initializing the minikube storage provisioner...
	I0924 00:37:05.993268       1 storage_provisioner.go:141] Storage provisioner initialized, now starting service!
	I0924 00:37:05.993402       1 leaderelection.go:243] attempting to acquire leader lease kube-system/k8s.io-minikube-hostpath...
	I0924 00:37:06.013890       1 leaderelection.go:253] successfully acquired lease kube-system/k8s.io-minikube-hostpath
	I0924 00:37:06.014216       1 controller.go:835] Starting provisioner controller k8s.io/minikube-hostpath_addons-371349_c1c71ef6-3afa-4b5e-932a-ce8168f67da3!
	I0924 00:37:06.015491       1 event.go:282] Event(v1.ObjectReference{Kind:"Endpoints", Namespace:"kube-system", Name:"k8s.io-minikube-hostpath", UID:"f1de51ca-2882-4f64-af09-93e4790263f0", APIVersion:"v1", ResourceVersion:"937", FieldPath:""}): type: 'Normal' reason: 'LeaderElection' addons-371349_c1c71ef6-3afa-4b5e-932a-ce8168f67da3 became leader
	I0924 00:37:06.115267       1 controller.go:884] Started provisioner controller k8s.io/minikube-hostpath_addons-371349_c1c71ef6-3afa-4b5e-932a-ce8168f67da3!
	

                                                
                                                
-- /stdout --
helpers_test.go:254: (dbg) Run:  out/minikube-linux-arm64 status --format={{.APIServer}} -p addons-371349 -n addons-371349
helpers_test.go:261: (dbg) Run:  kubectl --context addons-371349 get po -o=jsonpath={.items[*].metadata.name} -A --field-selector=status.phase!=Running
helpers_test.go:272: non-running pods: busybox ingress-nginx-admission-create-bjd4p ingress-nginx-admission-patch-9xrbk
helpers_test.go:274: ======> post-mortem[TestAddons/parallel/Registry]: describe non-running pods <======
helpers_test.go:277: (dbg) Run:  kubectl --context addons-371349 describe pod busybox ingress-nginx-admission-create-bjd4p ingress-nginx-admission-patch-9xrbk
helpers_test.go:277: (dbg) Non-zero exit: kubectl --context addons-371349 describe pod busybox ingress-nginx-admission-create-bjd4p ingress-nginx-admission-patch-9xrbk: exit status 1 (153.394291ms)

                                                
                                                
-- stdout --
	Name:             busybox
	Namespace:        default
	Priority:         0
	Service Account:  default
	Node:             addons-371349/192.168.49.2
	Start Time:       Tue, 24 Sep 2024 00:39:19 +0000
	Labels:           integration-test=busybox
	Annotations:      <none>
	Status:           Pending
	IP:               10.244.0.21
	IPs:
	  IP:  10.244.0.21
	Containers:
	  busybox:
	    Container ID:  
	    Image:         gcr.io/k8s-minikube/busybox:1.28.4-glibc
	    Image ID:      
	    Port:          <none>
	    Host Port:     <none>
	    Command:
	      sleep
	      3600
	    State:          Waiting
	      Reason:       ImagePullBackOff
	    Ready:          False
	    Restart Count:  0
	    Environment:
	      GOOGLE_APPLICATION_CREDENTIALS:  /google-app-creds.json
	      PROJECT_ID:                      this_is_fake
	      GCP_PROJECT:                     this_is_fake
	      GCLOUD_PROJECT:                  this_is_fake
	      GOOGLE_CLOUD_PROJECT:            this_is_fake
	      CLOUDSDK_CORE_PROJECT:           this_is_fake
	    Mounts:
	      /google-app-creds.json from gcp-creds (ro)
	      /var/run/secrets/kubernetes.io/serviceaccount from kube-api-access-fffwl (ro)
	Conditions:
	  Type                        Status
	  PodReadyToStartContainers   True 
	  Initialized                 True 
	  Ready                       False 
	  ContainersReady             False 
	  PodScheduled                True 
	Volumes:
	  kube-api-access-fffwl:
	    Type:                    Projected (a volume that contains injected data from multiple sources)
	    TokenExpirationSeconds:  3607
	    ConfigMapName:           kube-root-ca.crt
	    ConfigMapOptional:       <nil>
	    DownwardAPI:             true
	  gcp-creds:
	    Type:          HostPath (bare host directory volume)
	    Path:          /var/lib/minikube/google_application_credentials.json
	    HostPathType:  File
	QoS Class:         BestEffort
	Node-Selectors:    <none>
	Tolerations:       node.kubernetes.io/not-ready:NoExecute op=Exists for 300s
	                   node.kubernetes.io/unreachable:NoExecute op=Exists for 300s
	Events:
	  Type     Reason     Age                     From               Message
	  ----     ------     ----                    ----               -------
	  Normal   Scheduled  9m18s                   default-scheduler  Successfully assigned default/busybox to addons-371349
	  Normal   Pulling    7m50s (x4 over 9m17s)   kubelet            Pulling image "gcr.io/k8s-minikube/busybox:1.28.4-glibc"
	  Warning  Failed     7m50s (x4 over 9m17s)   kubelet            Failed to pull image "gcr.io/k8s-minikube/busybox:1.28.4-glibc": unable to retrieve auth token: invalid username/password: unauthorized: authentication failed
	  Warning  Failed     7m50s (x4 over 9m17s)   kubelet            Error: ErrImagePull
	  Warning  Failed     7m38s (x6 over 9m17s)   kubelet            Error: ImagePullBackOff
	  Normal   BackOff    4m15s (x21 over 9m17s)  kubelet            Back-off pulling image "gcr.io/k8s-minikube/busybox:1.28.4-glibc"

                                                
                                                
-- /stdout --
** stderr ** 
	Error from server (NotFound): pods "ingress-nginx-admission-create-bjd4p" not found
	Error from server (NotFound): pods "ingress-nginx-admission-patch-9xrbk" not found

                                                
                                                
** /stderr **
helpers_test.go:279: kubectl --context addons-371349 describe pod busybox ingress-nginx-admission-create-bjd4p ingress-nginx-admission-patch-9xrbk: exit status 1
--- FAIL: TestAddons/parallel/Registry (74.24s)

                                                
                                    
x
+
TestAddons/parallel/Ingress (153.51s)

                                                
                                                
=== RUN   TestAddons/parallel/Ingress
=== PAUSE TestAddons/parallel/Ingress

                                                
                                                

                                                
                                                
=== CONT  TestAddons/parallel/Ingress
addons_test.go:205: (dbg) Run:  kubectl --context addons-371349 wait --for=condition=ready --namespace=ingress-nginx pod --selector=app.kubernetes.io/component=controller --timeout=90s
addons_test.go:230: (dbg) Run:  kubectl --context addons-371349 replace --force -f testdata/nginx-ingress-v1.yaml
addons_test.go:243: (dbg) Run:  kubectl --context addons-371349 replace --force -f testdata/nginx-pod-svc.yaml
addons_test.go:248: (dbg) TestAddons/parallel/Ingress: waiting 8m0s for pods matching "run=nginx" in namespace "default" ...
helpers_test.go:344: "nginx" [3fd6b5d6-62fa-4679-b54e-1f35ff9dd937] Pending / Ready:ContainersNotReady (containers with unready status: [nginx]) / ContainersReady:ContainersNotReady (containers with unready status: [nginx])
helpers_test.go:344: "nginx" [3fd6b5d6-62fa-4679-b54e-1f35ff9dd937] Running
addons_test.go:248: (dbg) TestAddons/parallel/Ingress: run=nginx healthy within 9.003518902s
I0924 00:48:58.794855 1873600 kapi.go:150] Service nginx in namespace default found.
addons_test.go:260: (dbg) Run:  out/minikube-linux-arm64 -p addons-371349 ssh "curl -s http://127.0.0.1/ -H 'Host: nginx.example.com'"
addons_test.go:260: (dbg) Non-zero exit: out/minikube-linux-arm64 -p addons-371349 ssh "curl -s http://127.0.0.1/ -H 'Host: nginx.example.com'": exit status 1 (2m11.144206874s)

                                                
                                                
** stderr ** 
	ssh: Process exited with status 28

                                                
                                                
** /stderr **
addons_test.go:276: failed to get expected response from http://127.0.0.1/ within minikube: exit status 1
addons_test.go:284: (dbg) Run:  kubectl --context addons-371349 replace --force -f testdata/ingress-dns-example-v1.yaml
addons_test.go:289: (dbg) Run:  out/minikube-linux-arm64 -p addons-371349 ip
addons_test.go:295: (dbg) Run:  nslookup hello-john.test 192.168.49.2
addons_test.go:304: (dbg) Run:  out/minikube-linux-arm64 -p addons-371349 addons disable ingress-dns --alsologtostderr -v=1
addons_test.go:304: (dbg) Done: out/minikube-linux-arm64 -p addons-371349 addons disable ingress-dns --alsologtostderr -v=1: (1.648235399s)
addons_test.go:309: (dbg) Run:  out/minikube-linux-arm64 -p addons-371349 addons disable ingress --alsologtostderr -v=1
addons_test.go:309: (dbg) Done: out/minikube-linux-arm64 -p addons-371349 addons disable ingress --alsologtostderr -v=1: (7.762633897s)
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:230: ======>  post-mortem[TestAddons/parallel/Ingress]: docker inspect <======
helpers_test.go:231: (dbg) Run:  docker inspect addons-371349
helpers_test.go:235: (dbg) docker inspect addons-371349:

                                                
                                                
-- stdout --
	[
	    {
	        "Id": "57a8c5c845384bb63a10462f6fa297c2fd54585c86fa3de67a14d6644e9f0dd2",
	        "Created": "2024-09-24T00:35:55.003933514Z",
	        "Path": "/usr/local/bin/entrypoint",
	        "Args": [
	            "/sbin/init"
	        ],
	        "State": {
	            "Status": "running",
	            "Running": true,
	            "Paused": false,
	            "Restarting": false,
	            "OOMKilled": false,
	            "Dead": false,
	            "Pid": 1874844,
	            "ExitCode": 0,
	            "Error": "",
	            "StartedAt": "2024-09-24T00:35:55.139494316Z",
	            "FinishedAt": "0001-01-01T00:00:00Z"
	        },
	        "Image": "sha256:62002f6a97ad1f6cd4117c29b1c488a6bf3b6255c8231f0d600b1bc7ba1bcfd6",
	        "ResolvConfPath": "/var/lib/docker/containers/57a8c5c845384bb63a10462f6fa297c2fd54585c86fa3de67a14d6644e9f0dd2/resolv.conf",
	        "HostnamePath": "/var/lib/docker/containers/57a8c5c845384bb63a10462f6fa297c2fd54585c86fa3de67a14d6644e9f0dd2/hostname",
	        "HostsPath": "/var/lib/docker/containers/57a8c5c845384bb63a10462f6fa297c2fd54585c86fa3de67a14d6644e9f0dd2/hosts",
	        "LogPath": "/var/lib/docker/containers/57a8c5c845384bb63a10462f6fa297c2fd54585c86fa3de67a14d6644e9f0dd2/57a8c5c845384bb63a10462f6fa297c2fd54585c86fa3de67a14d6644e9f0dd2-json.log",
	        "Name": "/addons-371349",
	        "RestartCount": 0,
	        "Driver": "overlay2",
	        "Platform": "linux",
	        "MountLabel": "",
	        "ProcessLabel": "",
	        "AppArmorProfile": "unconfined",
	        "ExecIDs": null,
	        "HostConfig": {
	            "Binds": [
	                "/lib/modules:/lib/modules:ro",
	                "addons-371349:/var"
	            ],
	            "ContainerIDFile": "",
	            "LogConfig": {
	                "Type": "json-file",
	                "Config": {}
	            },
	            "NetworkMode": "addons-371349",
	            "PortBindings": {
	                "22/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": ""
	                    }
	                ],
	                "2376/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": ""
	                    }
	                ],
	                "32443/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": ""
	                    }
	                ],
	                "5000/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": ""
	                    }
	                ],
	                "8443/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": ""
	                    }
	                ]
	            },
	            "RestartPolicy": {
	                "Name": "no",
	                "MaximumRetryCount": 0
	            },
	            "AutoRemove": false,
	            "VolumeDriver": "",
	            "VolumesFrom": null,
	            "ConsoleSize": [
	                0,
	                0
	            ],
	            "CapAdd": null,
	            "CapDrop": null,
	            "CgroupnsMode": "host",
	            "Dns": [],
	            "DnsOptions": [],
	            "DnsSearch": [],
	            "ExtraHosts": null,
	            "GroupAdd": null,
	            "IpcMode": "private",
	            "Cgroup": "",
	            "Links": null,
	            "OomScoreAdj": 0,
	            "PidMode": "",
	            "Privileged": true,
	            "PublishAllPorts": false,
	            "ReadonlyRootfs": false,
	            "SecurityOpt": [
	                "seccomp=unconfined",
	                "apparmor=unconfined",
	                "label=disable"
	            ],
	            "Tmpfs": {
	                "/run": "",
	                "/tmp": ""
	            },
	            "UTSMode": "",
	            "UsernsMode": "",
	            "ShmSize": 67108864,
	            "Runtime": "runc",
	            "Isolation": "",
	            "CpuShares": 0,
	            "Memory": 4194304000,
	            "NanoCpus": 2000000000,
	            "CgroupParent": "",
	            "BlkioWeight": 0,
	            "BlkioWeightDevice": [],
	            "BlkioDeviceReadBps": [],
	            "BlkioDeviceWriteBps": [],
	            "BlkioDeviceReadIOps": [],
	            "BlkioDeviceWriteIOps": [],
	            "CpuPeriod": 0,
	            "CpuQuota": 0,
	            "CpuRealtimePeriod": 0,
	            "CpuRealtimeRuntime": 0,
	            "CpusetCpus": "",
	            "CpusetMems": "",
	            "Devices": [],
	            "DeviceCgroupRules": null,
	            "DeviceRequests": null,
	            "MemoryReservation": 0,
	            "MemorySwap": 8388608000,
	            "MemorySwappiness": null,
	            "OomKillDisable": false,
	            "PidsLimit": null,
	            "Ulimits": [],
	            "CpuCount": 0,
	            "CpuPercent": 0,
	            "IOMaximumIOps": 0,
	            "IOMaximumBandwidth": 0,
	            "MaskedPaths": null,
	            "ReadonlyPaths": null
	        },
	        "GraphDriver": {
	            "Data": {
	                "LowerDir": "/var/lib/docker/overlay2/e91acff4005fb62afe258fb62f9898571cc37123138239a601e3a881cbdd1e1b-init/diff:/var/lib/docker/overlay2/735dddc10109a4692c38c0935991764a2c26d0fe2b728ea40f67d848f08ebe53/diff",
	                "MergedDir": "/var/lib/docker/overlay2/e91acff4005fb62afe258fb62f9898571cc37123138239a601e3a881cbdd1e1b/merged",
	                "UpperDir": "/var/lib/docker/overlay2/e91acff4005fb62afe258fb62f9898571cc37123138239a601e3a881cbdd1e1b/diff",
	                "WorkDir": "/var/lib/docker/overlay2/e91acff4005fb62afe258fb62f9898571cc37123138239a601e3a881cbdd1e1b/work"
	            },
	            "Name": "overlay2"
	        },
	        "Mounts": [
	            {
	                "Type": "bind",
	                "Source": "/lib/modules",
	                "Destination": "/lib/modules",
	                "Mode": "ro",
	                "RW": false,
	                "Propagation": "rprivate"
	            },
	            {
	                "Type": "volume",
	                "Name": "addons-371349",
	                "Source": "/var/lib/docker/volumes/addons-371349/_data",
	                "Destination": "/var",
	                "Driver": "local",
	                "Mode": "z",
	                "RW": true,
	                "Propagation": ""
	            }
	        ],
	        "Config": {
	            "Hostname": "addons-371349",
	            "Domainname": "",
	            "User": "",
	            "AttachStdin": false,
	            "AttachStdout": false,
	            "AttachStderr": false,
	            "ExposedPorts": {
	                "22/tcp": {},
	                "2376/tcp": {},
	                "32443/tcp": {},
	                "5000/tcp": {},
	                "8443/tcp": {}
	            },
	            "Tty": true,
	            "OpenStdin": false,
	            "StdinOnce": false,
	            "Env": [
	                "container=docker",
	                "PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin"
	            ],
	            "Cmd": null,
	            "Image": "gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1727108449-19696@sha256:c662152d8855bc4c62a3b5786a68adf99e04794e7f8f374a3859703004ef1d21",
	            "Volumes": null,
	            "WorkingDir": "/",
	            "Entrypoint": [
	                "/usr/local/bin/entrypoint",
	                "/sbin/init"
	            ],
	            "OnBuild": null,
	            "Labels": {
	                "created_by.minikube.sigs.k8s.io": "true",
	                "mode.minikube.sigs.k8s.io": "addons-371349",
	                "name.minikube.sigs.k8s.io": "addons-371349",
	                "role.minikube.sigs.k8s.io": ""
	            },
	            "StopSignal": "SIGRTMIN+3"
	        },
	        "NetworkSettings": {
	            "Bridge": "",
	            "SandboxID": "6123761140dfb026c95c608d0564f7e7218831275b56b2c427350d3e2135d530",
	            "SandboxKey": "/var/run/docker/netns/6123761140df",
	            "Ports": {
	                "22/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": "34691"
	                    }
	                ],
	                "2376/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": "34692"
	                    }
	                ],
	                "32443/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": "34695"
	                    }
	                ],
	                "5000/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": "34693"
	                    }
	                ],
	                "8443/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": "34694"
	                    }
	                ]
	            },
	            "HairpinMode": false,
	            "LinkLocalIPv6Address": "",
	            "LinkLocalIPv6PrefixLen": 0,
	            "SecondaryIPAddresses": null,
	            "SecondaryIPv6Addresses": null,
	            "EndpointID": "",
	            "Gateway": "",
	            "GlobalIPv6Address": "",
	            "GlobalIPv6PrefixLen": 0,
	            "IPAddress": "",
	            "IPPrefixLen": 0,
	            "IPv6Gateway": "",
	            "MacAddress": "",
	            "Networks": {
	                "addons-371349": {
	                    "IPAMConfig": {
	                        "IPv4Address": "192.168.49.2"
	                    },
	                    "Links": null,
	                    "Aliases": null,
	                    "MacAddress": "02:42:c0:a8:31:02",
	                    "DriverOpts": null,
	                    "NetworkID": "be9e2c6d19f89ddf9ec936595a5357e0be10be979e62c375249fb6ea67bee4cf",
	                    "EndpointID": "e0512c175a378c9907b238498536bb0bcd513ef87034a8ccde9159fad0a75e37",
	                    "Gateway": "192.168.49.1",
	                    "IPAddress": "192.168.49.2",
	                    "IPPrefixLen": 24,
	                    "IPv6Gateway": "",
	                    "GlobalIPv6Address": "",
	                    "GlobalIPv6PrefixLen": 0,
	                    "DNSNames": [
	                        "addons-371349",
	                        "57a8c5c84538"
	                    ]
	                }
	            }
	        }
	    }
	]

                                                
                                                
-- /stdout --
helpers_test.go:239: (dbg) Run:  out/minikube-linux-arm64 status --format={{.Host}} -p addons-371349 -n addons-371349
helpers_test.go:244: <<< TestAddons/parallel/Ingress FAILED: start of post-mortem logs <<<
helpers_test.go:245: ======>  post-mortem[TestAddons/parallel/Ingress]: minikube logs <======
helpers_test.go:247: (dbg) Run:  out/minikube-linux-arm64 -p addons-371349 logs -n 25
helpers_test.go:247: (dbg) Done: out/minikube-linux-arm64 -p addons-371349 logs -n 25: (1.48961329s)
helpers_test.go:252: TestAddons/parallel/Ingress logs: 
-- stdout --
	
	==> Audit <==
	|---------|--------------------------------------|------------------------|---------|---------|---------------------|---------------------|
	| Command |                 Args                 |        Profile         |  User   | Version |     Start Time      |      End Time       |
	|---------|--------------------------------------|------------------------|---------|---------|---------------------|---------------------|
	| delete  | --all                                | minikube               | jenkins | v1.34.0 | 24 Sep 24 00:35 UTC | 24 Sep 24 00:35 UTC |
	| delete  | -p download-only-927064              | download-only-927064   | jenkins | v1.34.0 | 24 Sep 24 00:35 UTC | 24 Sep 24 00:35 UTC |
	| start   | -o=json --download-only              | download-only-684560   | jenkins | v1.34.0 | 24 Sep 24 00:35 UTC |                     |
	|         | -p download-only-684560              |                        |         |         |                     |                     |
	|         | --force --alsologtostderr            |                        |         |         |                     |                     |
	|         | --kubernetes-version=v1.31.1         |                        |         |         |                     |                     |
	|         | --container-runtime=crio             |                        |         |         |                     |                     |
	|         | --driver=docker                      |                        |         |         |                     |                     |
	|         | --container-runtime=crio             |                        |         |         |                     |                     |
	| delete  | --all                                | minikube               | jenkins | v1.34.0 | 24 Sep 24 00:35 UTC | 24 Sep 24 00:35 UTC |
	| delete  | -p download-only-684560              | download-only-684560   | jenkins | v1.34.0 | 24 Sep 24 00:35 UTC | 24 Sep 24 00:35 UTC |
	| delete  | -p download-only-927064              | download-only-927064   | jenkins | v1.34.0 | 24 Sep 24 00:35 UTC | 24 Sep 24 00:35 UTC |
	| delete  | -p download-only-684560              | download-only-684560   | jenkins | v1.34.0 | 24 Sep 24 00:35 UTC | 24 Sep 24 00:35 UTC |
	| start   | --download-only -p                   | download-docker-626931 | jenkins | v1.34.0 | 24 Sep 24 00:35 UTC |                     |
	|         | download-docker-626931               |                        |         |         |                     |                     |
	|         | --alsologtostderr                    |                        |         |         |                     |                     |
	|         | --driver=docker                      |                        |         |         |                     |                     |
	|         | --container-runtime=crio             |                        |         |         |                     |                     |
	| delete  | -p download-docker-626931            | download-docker-626931 | jenkins | v1.34.0 | 24 Sep 24 00:35 UTC | 24 Sep 24 00:35 UTC |
	| start   | --download-only -p                   | binary-mirror-425965   | jenkins | v1.34.0 | 24 Sep 24 00:35 UTC |                     |
	|         | binary-mirror-425965                 |                        |         |         |                     |                     |
	|         | --alsologtostderr                    |                        |         |         |                     |                     |
	|         | --binary-mirror                      |                        |         |         |                     |                     |
	|         | http://127.0.0.1:41845               |                        |         |         |                     |                     |
	|         | --driver=docker                      |                        |         |         |                     |                     |
	|         | --container-runtime=crio             |                        |         |         |                     |                     |
	| delete  | -p binary-mirror-425965              | binary-mirror-425965   | jenkins | v1.34.0 | 24 Sep 24 00:35 UTC | 24 Sep 24 00:35 UTC |
	| addons  | enable dashboard -p                  | addons-371349          | jenkins | v1.34.0 | 24 Sep 24 00:35 UTC |                     |
	|         | addons-371349                        |                        |         |         |                     |                     |
	| addons  | disable dashboard -p                 | addons-371349          | jenkins | v1.34.0 | 24 Sep 24 00:35 UTC |                     |
	|         | addons-371349                        |                        |         |         |                     |                     |
	| start   | -p addons-371349 --wait=true         | addons-371349          | jenkins | v1.34.0 | 24 Sep 24 00:35 UTC | 24 Sep 24 00:39 UTC |
	|         | --memory=4000 --alsologtostderr      |                        |         |         |                     |                     |
	|         | --addons=registry                    |                        |         |         |                     |                     |
	|         | --addons=metrics-server              |                        |         |         |                     |                     |
	|         | --addons=volumesnapshots             |                        |         |         |                     |                     |
	|         | --addons=csi-hostpath-driver         |                        |         |         |                     |                     |
	|         | --addons=gcp-auth                    |                        |         |         |                     |                     |
	|         | --addons=cloud-spanner               |                        |         |         |                     |                     |
	|         | --addons=inspektor-gadget            |                        |         |         |                     |                     |
	|         | --addons=storage-provisioner-rancher |                        |         |         |                     |                     |
	|         | --addons=nvidia-device-plugin        |                        |         |         |                     |                     |
	|         | --addons=yakd --addons=volcano       |                        |         |         |                     |                     |
	|         | --driver=docker                      |                        |         |         |                     |                     |
	|         | --container-runtime=crio             |                        |         |         |                     |                     |
	|         | --addons=ingress                     |                        |         |         |                     |                     |
	|         | --addons=ingress-dns                 |                        |         |         |                     |                     |
	| addons  | enable headlamp                      | addons-371349          | jenkins | v1.34.0 | 24 Sep 24 00:47 UTC | 24 Sep 24 00:47 UTC |
	|         | -p addons-371349                     |                        |         |         |                     |                     |
	|         | --alsologtostderr -v=1               |                        |         |         |                     |                     |
	| addons  | addons-371349 addons disable         | addons-371349          | jenkins | v1.34.0 | 24 Sep 24 00:47 UTC | 24 Sep 24 00:47 UTC |
	|         | headlamp --alsologtostderr           |                        |         |         |                     |                     |
	|         | -v=1                                 |                        |         |         |                     |                     |
	| addons  | addons-371349 addons                 | addons-371349          | jenkins | v1.34.0 | 24 Sep 24 00:48 UTC | 24 Sep 24 00:48 UTC |
	|         | disable csi-hostpath-driver          |                        |         |         |                     |                     |
	|         | --alsologtostderr -v=1               |                        |         |         |                     |                     |
	| ip      | addons-371349 ip                     | addons-371349          | jenkins | v1.34.0 | 24 Sep 24 00:48 UTC | 24 Sep 24 00:48 UTC |
	| addons  | addons-371349 addons disable         | addons-371349          | jenkins | v1.34.0 | 24 Sep 24 00:48 UTC | 24 Sep 24 00:48 UTC |
	|         | registry --alsologtostderr           |                        |         |         |                     |                     |
	|         | -v=1                                 |                        |         |         |                     |                     |
	| addons  | addons-371349 addons                 | addons-371349          | jenkins | v1.34.0 | 24 Sep 24 00:48 UTC | 24 Sep 24 00:48 UTC |
	|         | disable volumesnapshots              |                        |         |         |                     |                     |
	|         | --alsologtostderr -v=1               |                        |         |         |                     |                     |
	| addons  | disable inspektor-gadget -p          | addons-371349          | jenkins | v1.34.0 | 24 Sep 24 00:48 UTC | 24 Sep 24 00:48 UTC |
	|         | addons-371349                        |                        |         |         |                     |                     |
	| ssh     | addons-371349 ssh curl -s            | addons-371349          | jenkins | v1.34.0 | 24 Sep 24 00:48 UTC |                     |
	|         | http://127.0.0.1/ -H 'Host:          |                        |         |         |                     |                     |
	|         | nginx.example.com'                   |                        |         |         |                     |                     |
	| ip      | addons-371349 ip                     | addons-371349          | jenkins | v1.34.0 | 24 Sep 24 00:51 UTC | 24 Sep 24 00:51 UTC |
	| addons  | addons-371349 addons disable         | addons-371349          | jenkins | v1.34.0 | 24 Sep 24 00:51 UTC | 24 Sep 24 00:51 UTC |
	|         | ingress-dns --alsologtostderr        |                        |         |         |                     |                     |
	|         | -v=1                                 |                        |         |         |                     |                     |
	| addons  | addons-371349 addons disable         | addons-371349          | jenkins | v1.34.0 | 24 Sep 24 00:51 UTC | 24 Sep 24 00:51 UTC |
	|         | ingress --alsologtostderr -v=1       |                        |         |         |                     |                     |
	|---------|--------------------------------------|------------------------|---------|---------|---------------------|---------------------|
	
	
	==> Last Start <==
	Log file created at: 2024/09/24 00:35:31
	Running on machine: ip-172-31-21-244
	Binary: Built with gc go1.23.0 for linux/arm64
	Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg
	I0924 00:35:31.109111 1874359 out.go:345] Setting OutFile to fd 1 ...
	I0924 00:35:31.109491 1874359 out.go:392] TERM=,COLORTERM=, which probably does not support color
	I0924 00:35:31.109508 1874359 out.go:358] Setting ErrFile to fd 2...
	I0924 00:35:31.109515 1874359 out.go:392] TERM=,COLORTERM=, which probably does not support color
	I0924 00:35:31.109789 1874359 root.go:338] Updating PATH: /home/jenkins/minikube-integration/19696-1868219/.minikube/bin
	I0924 00:35:31.110290 1874359 out.go:352] Setting JSON to false
	I0924 00:35:31.111147 1874359 start.go:129] hostinfo: {"hostname":"ip-172-31-21-244","uptime":29881,"bootTime":1727108250,"procs":155,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1070-aws","kernelArch":"aarch64","virtualizationSystem":"","virtualizationRole":"","hostId":"da8ac1fd-6236-412a-a346-95873c98230d"}
	I0924 00:35:31.111237 1874359 start.go:139] virtualization:  
	I0924 00:35:31.114409 1874359 out.go:177] * [addons-371349] minikube v1.34.0 on Ubuntu 20.04 (arm64)
	I0924 00:35:31.117918 1874359 out.go:177]   - MINIKUBE_LOCATION=19696
	I0924 00:35:31.118029 1874359 notify.go:220] Checking for updates...
	I0924 00:35:31.123440 1874359 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I0924 00:35:31.126227 1874359 out.go:177]   - KUBECONFIG=/home/jenkins/minikube-integration/19696-1868219/kubeconfig
	I0924 00:35:31.128996 1874359 out.go:177]   - MINIKUBE_HOME=/home/jenkins/minikube-integration/19696-1868219/.minikube
	I0924 00:35:31.131696 1874359 out.go:177]   - MINIKUBE_BIN=out/minikube-linux-arm64
	I0924 00:35:31.134392 1874359 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=
	I0924 00:35:31.137411 1874359 driver.go:394] Setting default libvirt URI to qemu:///system
	I0924 00:35:31.166048 1874359 docker.go:123] docker version: linux-27.3.1:Docker Engine - Community
	I0924 00:35:31.166177 1874359 cli_runner.go:164] Run: docker system info --format "{{json .}}"
	I0924 00:35:31.216117 1874359 info.go:266] docker info: {ID:5FDH:SA5P:5GCT:NLAS:B73P:SGDQ:PBG5:UBVH:UZY3:RXGO:CI7S:WAIH Containers:0 ContainersRunning:0 ContainersPaused:0 ContainersStopped:0 Images:1 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:false BridgeNfIP6Tables:false Debug:false NFd:29 OomKillDisable:true NGoroutines:44 SystemTime:2024-09-24 00:35:31.206607126 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1070-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Architecture:a
arch64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8214831104 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-21-244 Labels:[] ExperimentalBuild:false ServerVersion:27.3.1 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:7f7fdf5fed64eb6a7caf99b3e12efcf9d60e311c Expected:7f7fdf5fed64eb6a7caf99b3e12efcf9d60e311c} RuncCommit:{ID:v1.1.14-0-g2c9f560 Expected:v1.1.14-0-g2c9f560} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:[WARNING: brid
ge-nf-call-iptables is disabled WARNING: bridge-nf-call-ip6tables is disabled] ServerErrors:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.17.1] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.29.7]] Warnings:<nil>}}
	I0924 00:35:31.216230 1874359 docker.go:318] overlay module found
	I0924 00:35:31.220866 1874359 out.go:177] * Using the docker driver based on user configuration
	I0924 00:35:31.223404 1874359 start.go:297] selected driver: docker
	I0924 00:35:31.223428 1874359 start.go:901] validating driver "docker" against <nil>
	I0924 00:35:31.223442 1874359 start.go:912] status for docker: {Installed:true Healthy:true Running:false NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I0924 00:35:31.224063 1874359 cli_runner.go:164] Run: docker system info --format "{{json .}}"
	I0924 00:35:31.276460 1874359 info.go:266] docker info: {ID:5FDH:SA5P:5GCT:NLAS:B73P:SGDQ:PBG5:UBVH:UZY3:RXGO:CI7S:WAIH Containers:0 ContainersRunning:0 ContainersPaused:0 ContainersStopped:0 Images:1 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:false BridgeNfIP6Tables:false Debug:false NFd:29 OomKillDisable:true NGoroutines:44 SystemTime:2024-09-24 00:35:31.267813232 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1070-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Architecture:a
arch64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8214831104 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-21-244 Labels:[] ExperimentalBuild:false ServerVersion:27.3.1 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:7f7fdf5fed64eb6a7caf99b3e12efcf9d60e311c Expected:7f7fdf5fed64eb6a7caf99b3e12efcf9d60e311c} RuncCommit:{ID:v1.1.14-0-g2c9f560 Expected:v1.1.14-0-g2c9f560} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:[WARNING: brid
ge-nf-call-iptables is disabled WARNING: bridge-nf-call-ip6tables is disabled] ServerErrors:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.17.1] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.29.7]] Warnings:<nil>}}
	I0924 00:35:31.276667 1874359 start_flags.go:310] no existing cluster config was found, will generate one from the flags 
	I0924 00:35:31.276886 1874359 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
	I0924 00:35:31.279511 1874359 out.go:177] * Using Docker driver with root privileges
	I0924 00:35:31.281994 1874359 cni.go:84] Creating CNI manager for ""
	I0924 00:35:31.282050 1874359 cni.go:143] "docker" driver + "crio" runtime found, recommending kindnet
	I0924 00:35:31.282068 1874359 start_flags.go:319] Found "CNI" CNI - setting NetworkPlugin=cni
	I0924 00:35:31.282150 1874359 start.go:340] cluster config:
	{Name:addons-371349 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1727108449-19696@sha256:c662152d8855bc4c62a3b5786a68adf99e04794e7f8f374a3859703004ef1d21 Memory:4000 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.31.1 ClusterName:addons-371349 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime
:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.31.1 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSH
AgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I0924 00:35:31.284989 1874359 out.go:177] * Starting "addons-371349" primary control-plane node in "addons-371349" cluster
	I0924 00:35:31.287549 1874359 cache.go:121] Beginning downloading kic base image for docker with crio
	I0924 00:35:31.290177 1874359 out.go:177] * Pulling base image v0.0.45-1727108449-19696 ...
	I0924 00:35:31.292696 1874359 preload.go:131] Checking if preload exists for k8s version v1.31.1 and runtime crio
	I0924 00:35:31.292745 1874359 preload.go:146] Found local preload: /home/jenkins/minikube-integration/19696-1868219/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.1-cri-o-overlay-arm64.tar.lz4
	I0924 00:35:31.292758 1874359 cache.go:56] Caching tarball of preloaded images
	I0924 00:35:31.292786 1874359 image.go:79] Checking for gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1727108449-19696@sha256:c662152d8855bc4c62a3b5786a68adf99e04794e7f8f374a3859703004ef1d21 in local docker daemon
	I0924 00:35:31.292840 1874359 preload.go:172] Found /home/jenkins/minikube-integration/19696-1868219/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.1-cri-o-overlay-arm64.tar.lz4 in cache, skipping download
	I0924 00:35:31.292867 1874359 cache.go:59] Finished verifying existence of preloaded tar for v1.31.1 on crio
	I0924 00:35:31.293251 1874359 profile.go:143] Saving config to /home/jenkins/minikube-integration/19696-1868219/.minikube/profiles/addons-371349/config.json ...
	I0924 00:35:31.293286 1874359 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19696-1868219/.minikube/profiles/addons-371349/config.json: {Name:mk25e4dccbe4a04f50b9042bd55717678de78632 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0924 00:35:31.307591 1874359 cache.go:149] Downloading gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1727108449-19696@sha256:c662152d8855bc4c62a3b5786a68adf99e04794e7f8f374a3859703004ef1d21 to local cache
	I0924 00:35:31.307736 1874359 image.go:63] Checking for gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1727108449-19696@sha256:c662152d8855bc4c62a3b5786a68adf99e04794e7f8f374a3859703004ef1d21 in local cache directory
	I0924 00:35:31.307757 1874359 image.go:66] Found gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1727108449-19696@sha256:c662152d8855bc4c62a3b5786a68adf99e04794e7f8f374a3859703004ef1d21 in local cache directory, skipping pull
	I0924 00:35:31.307762 1874359 image.go:135] gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1727108449-19696@sha256:c662152d8855bc4c62a3b5786a68adf99e04794e7f8f374a3859703004ef1d21 exists in cache, skipping pull
	I0924 00:35:31.307770 1874359 cache.go:152] successfully saved gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1727108449-19696@sha256:c662152d8855bc4c62a3b5786a68adf99e04794e7f8f374a3859703004ef1d21 as a tarball
	I0924 00:35:31.307777 1874359 cache.go:162] Loading gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1727108449-19696@sha256:c662152d8855bc4c62a3b5786a68adf99e04794e7f8f374a3859703004ef1d21 from local cache
	I0924 00:35:47.930605 1874359 cache.go:164] successfully loaded and using gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1727108449-19696@sha256:c662152d8855bc4c62a3b5786a68adf99e04794e7f8f374a3859703004ef1d21 from cached tarball
	I0924 00:35:47.930645 1874359 cache.go:194] Successfully downloaded all kic artifacts
	I0924 00:35:47.930688 1874359 start.go:360] acquireMachinesLock for addons-371349: {Name:mkeb51f9a926e24ae39fcb6cc62e0aeb3a530af2 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0924 00:35:47.930830 1874359 start.go:364] duration metric: took 117.765µs to acquireMachinesLock for "addons-371349"
	I0924 00:35:47.930862 1874359 start.go:93] Provisioning new machine with config: &{Name:addons-371349 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1727108449-19696@sha256:c662152d8855bc4c62a3b5786a68adf99e04794e7f8f374a3859703004ef1d21 Memory:4000 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.31.1 ClusterName:addons-371349 Namespace:default APIServerHAVIP: APIServerName:min
ikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.31.1 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQe
muFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.31.1 ContainerRuntime:crio ControlPlane:true Worker:true}
	I0924 00:35:47.930941 1874359 start.go:125] createHost starting for "" (driver="docker")
	I0924 00:35:47.933040 1874359 out.go:235] * Creating docker container (CPUs=2, Memory=4000MB) ...
	I0924 00:35:47.933312 1874359 start.go:159] libmachine.API.Create for "addons-371349" (driver="docker")
	I0924 00:35:47.933350 1874359 client.go:168] LocalClient.Create starting
	I0924 00:35:47.933471 1874359 main.go:141] libmachine: Creating CA: /home/jenkins/minikube-integration/19696-1868219/.minikube/certs/ca.pem
	I0924 00:35:48.485151 1874359 main.go:141] libmachine: Creating client certificate: /home/jenkins/minikube-integration/19696-1868219/.minikube/certs/cert.pem
	I0924 00:35:48.899244 1874359 cli_runner.go:164] Run: docker network inspect addons-371349 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
	W0924 00:35:48.913303 1874359 cli_runner.go:211] docker network inspect addons-371349 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}" returned with exit code 1
	I0924 00:35:48.913397 1874359 network_create.go:284] running [docker network inspect addons-371349] to gather additional debugging logs...
	I0924 00:35:48.913419 1874359 cli_runner.go:164] Run: docker network inspect addons-371349
	W0924 00:35:48.929353 1874359 cli_runner.go:211] docker network inspect addons-371349 returned with exit code 1
	I0924 00:35:48.929392 1874359 network_create.go:287] error running [docker network inspect addons-371349]: docker network inspect addons-371349: exit status 1
	stdout:
	[]
	
	stderr:
	Error response from daemon: network addons-371349 not found
	I0924 00:35:48.929405 1874359 network_create.go:289] output of [docker network inspect addons-371349]: -- stdout --
	[]
	
	-- /stdout --
	** stderr ** 
	Error response from daemon: network addons-371349 not found
	
	** /stderr **
	I0924 00:35:48.929518 1874359 cli_runner.go:164] Run: docker network inspect bridge --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
	I0924 00:35:48.943684 1874359 network.go:206] using free private subnet 192.168.49.0/24: &{IP:192.168.49.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.49.0/24 Gateway:192.168.49.1 ClientMin:192.168.49.2 ClientMax:192.168.49.254 Broadcast:192.168.49.255 IsPrivate:true Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:} reservation:0x4001802f60}
	I0924 00:35:48.943730 1874359 network_create.go:124] attempt to create docker network addons-371349 192.168.49.0/24 with gateway 192.168.49.1 and MTU of 1500 ...
	I0924 00:35:48.943786 1874359 cli_runner.go:164] Run: docker network create --driver=bridge --subnet=192.168.49.0/24 --gateway=192.168.49.1 -o --ip-masq -o --icc -o com.docker.network.driver.mtu=1500 --label=created_by.minikube.sigs.k8s.io=true --label=name.minikube.sigs.k8s.io=addons-371349 addons-371349
	I0924 00:35:49.025468 1874359 network_create.go:108] docker network addons-371349 192.168.49.0/24 created
	I0924 00:35:49.025507 1874359 kic.go:121] calculated static IP "192.168.49.2" for the "addons-371349" container
	I0924 00:35:49.025584 1874359 cli_runner.go:164] Run: docker ps -a --format {{.Names}}
	I0924 00:35:49.040911 1874359 cli_runner.go:164] Run: docker volume create addons-371349 --label name.minikube.sigs.k8s.io=addons-371349 --label created_by.minikube.sigs.k8s.io=true
	I0924 00:35:49.057606 1874359 oci.go:103] Successfully created a docker volume addons-371349
	I0924 00:35:49.057704 1874359 cli_runner.go:164] Run: docker run --rm --name addons-371349-preload-sidecar --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=addons-371349 --entrypoint /usr/bin/test -v addons-371349:/var gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1727108449-19696@sha256:c662152d8855bc4c62a3b5786a68adf99e04794e7f8f374a3859703004ef1d21 -d /var/lib
	I0924 00:35:50.959914 1874359 cli_runner.go:217] Completed: docker run --rm --name addons-371349-preload-sidecar --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=addons-371349 --entrypoint /usr/bin/test -v addons-371349:/var gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1727108449-19696@sha256:c662152d8855bc4c62a3b5786a68adf99e04794e7f8f374a3859703004ef1d21 -d /var/lib: (1.902161651s)
	I0924 00:35:50.959945 1874359 oci.go:107] Successfully prepared a docker volume addons-371349
	I0924 00:35:50.959970 1874359 preload.go:131] Checking if preload exists for k8s version v1.31.1 and runtime crio
	I0924 00:35:50.959994 1874359 kic.go:194] Starting extracting preloaded images to volume ...
	I0924 00:35:50.960061 1874359 cli_runner.go:164] Run: docker run --rm --entrypoint /usr/bin/tar -v /home/jenkins/minikube-integration/19696-1868219/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.1-cri-o-overlay-arm64.tar.lz4:/preloaded.tar:ro -v addons-371349:/extractDir gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1727108449-19696@sha256:c662152d8855bc4c62a3b5786a68adf99e04794e7f8f374a3859703004ef1d21 -I lz4 -xf /preloaded.tar -C /extractDir
	I0924 00:35:54.945988 1874359 cli_runner.go:217] Completed: docker run --rm --entrypoint /usr/bin/tar -v /home/jenkins/minikube-integration/19696-1868219/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.1-cri-o-overlay-arm64.tar.lz4:/preloaded.tar:ro -v addons-371349:/extractDir gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1727108449-19696@sha256:c662152d8855bc4c62a3b5786a68adf99e04794e7f8f374a3859703004ef1d21 -I lz4 -xf /preloaded.tar -C /extractDir: (3.985880116s)
	I0924 00:35:54.946022 1874359 kic.go:203] duration metric: took 3.986025819s to extract preloaded images to volume ...
	W0924 00:35:54.946152 1874359 cgroups_linux.go:77] Your kernel does not support swap limit capabilities or the cgroup is not mounted.
	I0924 00:35:54.946256 1874359 cli_runner.go:164] Run: docker info --format "'{{json .SecurityOptions}}'"
	I0924 00:35:54.988942 1874359 cli_runner.go:164] Run: docker run -d -t --privileged --security-opt seccomp=unconfined --tmpfs /tmp --tmpfs /run -v /lib/modules:/lib/modules:ro --hostname addons-371349 --name addons-371349 --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=addons-371349 --label role.minikube.sigs.k8s.io= --label mode.minikube.sigs.k8s.io=addons-371349 --network addons-371349 --ip 192.168.49.2 --volume addons-371349:/var --security-opt apparmor=unconfined --memory=4000mb --cpus=2 -e container=docker --expose 8443 --publish=127.0.0.1::8443 --publish=127.0.0.1::22 --publish=127.0.0.1::2376 --publish=127.0.0.1::5000 --publish=127.0.0.1::32443 gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1727108449-19696@sha256:c662152d8855bc4c62a3b5786a68adf99e04794e7f8f374a3859703004ef1d21
	I0924 00:35:55.293958 1874359 cli_runner.go:164] Run: docker container inspect addons-371349 --format={{.State.Running}}
	I0924 00:35:55.320780 1874359 cli_runner.go:164] Run: docker container inspect addons-371349 --format={{.State.Status}}
	I0924 00:35:55.340642 1874359 cli_runner.go:164] Run: docker exec addons-371349 stat /var/lib/dpkg/alternatives/iptables
	I0924 00:35:55.397834 1874359 oci.go:144] the created container "addons-371349" has a running status.
	I0924 00:35:55.397864 1874359 kic.go:225] Creating ssh key for kic: /home/jenkins/minikube-integration/19696-1868219/.minikube/machines/addons-371349/id_rsa...
	I0924 00:35:55.675510 1874359 kic_runner.go:191] docker (temp): /home/jenkins/minikube-integration/19696-1868219/.minikube/machines/addons-371349/id_rsa.pub --> /home/docker/.ssh/authorized_keys (381 bytes)
	I0924 00:35:55.699212 1874359 cli_runner.go:164] Run: docker container inspect addons-371349 --format={{.State.Status}}
	I0924 00:35:55.726400 1874359 kic_runner.go:93] Run: chown docker:docker /home/docker/.ssh/authorized_keys
	I0924 00:35:55.726420 1874359 kic_runner.go:114] Args: [docker exec --privileged addons-371349 chown docker:docker /home/docker/.ssh/authorized_keys]
	I0924 00:35:55.806108 1874359 cli_runner.go:164] Run: docker container inspect addons-371349 --format={{.State.Status}}
	I0924 00:35:55.829052 1874359 machine.go:93] provisionDockerMachine start ...
	I0924 00:35:55.829141 1874359 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-371349
	I0924 00:35:55.851370 1874359 main.go:141] libmachine: Using SSH client type: native
	I0924 00:35:55.851622 1874359 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x413650] 0x415e90 <nil>  [] 0s} 127.0.0.1 34691 <nil> <nil>}
	I0924 00:35:55.851638 1874359 main.go:141] libmachine: About to run SSH command:
	hostname
	I0924 00:35:56.037194 1874359 main.go:141] libmachine: SSH cmd err, output: <nil>: addons-371349
	
	I0924 00:35:56.037220 1874359 ubuntu.go:169] provisioning hostname "addons-371349"
	I0924 00:35:56.037293 1874359 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-371349
	I0924 00:35:56.078692 1874359 main.go:141] libmachine: Using SSH client type: native
	I0924 00:35:56.079000 1874359 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x413650] 0x415e90 <nil>  [] 0s} 127.0.0.1 34691 <nil> <nil>}
	I0924 00:35:56.079012 1874359 main.go:141] libmachine: About to run SSH command:
	sudo hostname addons-371349 && echo "addons-371349" | sudo tee /etc/hostname
	I0924 00:35:56.226092 1874359 main.go:141] libmachine: SSH cmd err, output: <nil>: addons-371349
	
	I0924 00:35:56.226258 1874359 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-371349
	I0924 00:35:56.244833 1874359 main.go:141] libmachine: Using SSH client type: native
	I0924 00:35:56.245089 1874359 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x413650] 0x415e90 <nil>  [] 0s} 127.0.0.1 34691 <nil> <nil>}
	I0924 00:35:56.245106 1874359 main.go:141] libmachine: About to run SSH command:
	
			if ! grep -xq '.*\saddons-371349' /etc/hosts; then
				if grep -xq '127.0.1.1\s.*' /etc/hosts; then
					sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 addons-371349/g' /etc/hosts;
				else 
					echo '127.0.1.1 addons-371349' | sudo tee -a /etc/hosts; 
				fi
			fi
	I0924 00:35:56.381804 1874359 main.go:141] libmachine: SSH cmd err, output: <nil>: 
	I0924 00:35:56.381859 1874359 ubuntu.go:175] set auth options {CertDir:/home/jenkins/minikube-integration/19696-1868219/.minikube CaCertPath:/home/jenkins/minikube-integration/19696-1868219/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/19696-1868219/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/19696-1868219/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/19696-1868219/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/19696-1868219/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/19696-1868219/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/19696-1868219/.minikube}
	I0924 00:35:56.381886 1874359 ubuntu.go:177] setting up certificates
	I0924 00:35:56.381895 1874359 provision.go:84] configureAuth start
	I0924 00:35:56.381956 1874359 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" addons-371349
	I0924 00:35:56.400509 1874359 provision.go:143] copyHostCerts
	I0924 00:35:56.400599 1874359 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19696-1868219/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/19696-1868219/.minikube/ca.pem (1078 bytes)
	I0924 00:35:56.400716 1874359 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19696-1868219/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/19696-1868219/.minikube/cert.pem (1123 bytes)
	I0924 00:35:56.400778 1874359 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19696-1868219/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/19696-1868219/.minikube/key.pem (1675 bytes)
	I0924 00:35:56.400827 1874359 provision.go:117] generating server cert: /home/jenkins/minikube-integration/19696-1868219/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/19696-1868219/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/19696-1868219/.minikube/certs/ca-key.pem org=jenkins.addons-371349 san=[127.0.0.1 192.168.49.2 addons-371349 localhost minikube]
	I0924 00:35:56.572353 1874359 provision.go:177] copyRemoteCerts
	I0924 00:35:56.572422 1874359 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
	I0924 00:35:56.572464 1874359 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-371349
	I0924 00:35:56.588536 1874359 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:34691 SSHKeyPath:/home/jenkins/minikube-integration/19696-1868219/.minikube/machines/addons-371349/id_rsa Username:docker}
	I0924 00:35:56.682342 1874359 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19696-1868219/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1675 bytes)
	I0924 00:35:56.706256 1874359 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19696-1868219/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1078 bytes)
	I0924 00:35:56.729190 1874359 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19696-1868219/.minikube/machines/server.pem --> /etc/docker/server.pem (1208 bytes)
	I0924 00:35:56.752321 1874359 provision.go:87] duration metric: took 370.409574ms to configureAuth
	I0924 00:35:56.752398 1874359 ubuntu.go:193] setting minikube options for container-runtime
	I0924 00:35:56.752599 1874359 config.go:182] Loaded profile config "addons-371349": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.31.1
	I0924 00:35:56.752715 1874359 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-371349
	I0924 00:35:56.768527 1874359 main.go:141] libmachine: Using SSH client type: native
	I0924 00:35:56.768768 1874359 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x413650] 0x415e90 <nil>  [] 0s} 127.0.0.1 34691 <nil> <nil>}
	I0924 00:35:56.768789 1874359 main.go:141] libmachine: About to run SSH command:
	sudo mkdir -p /etc/sysconfig && printf %s "
	CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
	" | sudo tee /etc/sysconfig/crio.minikube && sudo systemctl restart crio
	I0924 00:35:56.992663 1874359 main.go:141] libmachine: SSH cmd err, output: <nil>: 
	CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
	
	I0924 00:35:56.992688 1874359 machine.go:96] duration metric: took 1.163615539s to provisionDockerMachine
	I0924 00:35:56.992698 1874359 client.go:171] duration metric: took 9.059339192s to LocalClient.Create
	I0924 00:35:56.992714 1874359 start.go:167] duration metric: took 9.059403863s to libmachine.API.Create "addons-371349"
	I0924 00:35:56.992724 1874359 start.go:293] postStartSetup for "addons-371349" (driver="docker")
	I0924 00:35:56.992735 1874359 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
	I0924 00:35:56.992800 1874359 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
	I0924 00:35:56.992842 1874359 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-371349
	I0924 00:35:57.012622 1874359 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:34691 SSHKeyPath:/home/jenkins/minikube-integration/19696-1868219/.minikube/machines/addons-371349/id_rsa Username:docker}
	I0924 00:35:57.106644 1874359 ssh_runner.go:195] Run: cat /etc/os-release
	I0924 00:35:57.109707 1874359 main.go:141] libmachine: Couldn't set key VERSION_CODENAME, no corresponding struct field found
	I0924 00:35:57.109744 1874359 main.go:141] libmachine: Couldn't set key PRIVACY_POLICY_URL, no corresponding struct field found
	I0924 00:35:57.109756 1874359 main.go:141] libmachine: Couldn't set key UBUNTU_CODENAME, no corresponding struct field found
	I0924 00:35:57.109764 1874359 info.go:137] Remote host: Ubuntu 22.04.5 LTS
	I0924 00:35:57.109794 1874359 filesync.go:126] Scanning /home/jenkins/minikube-integration/19696-1868219/.minikube/addons for local assets ...
	I0924 00:35:57.109888 1874359 filesync.go:126] Scanning /home/jenkins/minikube-integration/19696-1868219/.minikube/files for local assets ...
	I0924 00:35:57.109917 1874359 start.go:296] duration metric: took 117.186271ms for postStartSetup
	I0924 00:35:57.110231 1874359 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" addons-371349
	I0924 00:35:57.125870 1874359 profile.go:143] Saving config to /home/jenkins/minikube-integration/19696-1868219/.minikube/profiles/addons-371349/config.json ...
	I0924 00:35:57.126157 1874359 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
	I0924 00:35:57.126210 1874359 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-371349
	I0924 00:35:57.141418 1874359 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:34691 SSHKeyPath:/home/jenkins/minikube-integration/19696-1868219/.minikube/machines/addons-371349/id_rsa Username:docker}
	I0924 00:35:57.230247 1874359 ssh_runner.go:195] Run: sh -c "df -BG /var | awk 'NR==2{print $4}'"
	I0924 00:35:57.234447 1874359 start.go:128] duration metric: took 9.303490385s to createHost
	I0924 00:35:57.234475 1874359 start.go:83] releasing machines lock for "addons-371349", held for 9.3036279s
	I0924 00:35:57.234544 1874359 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" addons-371349
	I0924 00:35:57.250134 1874359 ssh_runner.go:195] Run: cat /version.json
	I0924 00:35:57.250192 1874359 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-371349
	I0924 00:35:57.250265 1874359 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/
	I0924 00:35:57.250350 1874359 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-371349
	I0924 00:35:57.266578 1874359 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:34691 SSHKeyPath:/home/jenkins/minikube-integration/19696-1868219/.minikube/machines/addons-371349/id_rsa Username:docker}
	I0924 00:35:57.276682 1874359 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:34691 SSHKeyPath:/home/jenkins/minikube-integration/19696-1868219/.minikube/machines/addons-371349/id_rsa Username:docker}
	I0924 00:35:57.481806 1874359 ssh_runner.go:195] Run: systemctl --version
	I0924 00:35:57.486022 1874359 ssh_runner.go:195] Run: sudo sh -c "podman version >/dev/null"
	I0924 00:35:57.624524 1874359 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"
	I0924 00:35:57.628624 1874359 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f -name *loopback.conf* -not -name *.mk_disabled -exec sh -c "sudo mv {} {}.mk_disabled" ;
	I0924 00:35:57.650226 1874359 cni.go:221] loopback cni configuration disabled: "/etc/cni/net.d/*loopback.conf*" found
	I0924 00:35:57.650317 1874359 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%p, " -exec sh -c "sudo mv {} {}.mk_disabled" ;
	I0924 00:35:57.681941 1874359 cni.go:262] disabled [/etc/cni/net.d/87-podman-bridge.conflist, /etc/cni/net.d/100-crio-bridge.conf] bridge cni config(s)
	I0924 00:35:57.681970 1874359 start.go:495] detecting cgroup driver to use...
	I0924 00:35:57.682003 1874359 detect.go:187] detected "cgroupfs" cgroup driver on host os
	I0924 00:35:57.682055 1874359 ssh_runner.go:195] Run: sudo systemctl stop -f containerd
	I0924 00:35:57.698588 1874359 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd
	I0924 00:35:57.710409 1874359 docker.go:217] disabling cri-docker service (if available) ...
	I0924 00:35:57.710476 1874359 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.socket
	I0924 00:35:57.723312 1874359 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.service
	I0924 00:35:57.738063 1874359 ssh_runner.go:195] Run: sudo systemctl disable cri-docker.socket
	I0924 00:35:57.828486 1874359 ssh_runner.go:195] Run: sudo systemctl mask cri-docker.service
	I0924 00:35:57.919854 1874359 docker.go:233] disabling docker service ...
	I0924 00:35:57.919944 1874359 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket
	I0924 00:35:57.939471 1874359 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service
	I0924 00:35:57.951096 1874359 ssh_runner.go:195] Run: sudo systemctl disable docker.socket
	I0924 00:35:58.033450 1874359 ssh_runner.go:195] Run: sudo systemctl mask docker.service
	I0924 00:35:58.144265 1874359 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker
	I0924 00:35:58.155196 1874359 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///var/run/crio/crio.sock
	" | sudo tee /etc/crictl.yaml"
	I0924 00:35:58.171647 1874359 crio.go:59] configure cri-o to use "registry.k8s.io/pause:3.10" pause image...
	I0924 00:35:58.171732 1874359 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*pause_image = .*$|pause_image = "registry.k8s.io/pause:3.10"|' /etc/crio/crio.conf.d/02-crio.conf"
	I0924 00:35:58.181170 1874359 crio.go:70] configuring cri-o to use "cgroupfs" as cgroup driver...
	I0924 00:35:58.181252 1874359 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*cgroup_manager = .*$|cgroup_manager = "cgroupfs"|' /etc/crio/crio.conf.d/02-crio.conf"
	I0924 00:35:58.191464 1874359 ssh_runner.go:195] Run: sh -c "sudo sed -i '/conmon_cgroup = .*/d' /etc/crio/crio.conf.d/02-crio.conf"
	I0924 00:35:58.202150 1874359 ssh_runner.go:195] Run: sh -c "sudo sed -i '/cgroup_manager = .*/a conmon_cgroup = "pod"' /etc/crio/crio.conf.d/02-crio.conf"
	I0924 00:35:58.211736 1874359 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"
	I0924 00:35:58.220977 1874359 ssh_runner.go:195] Run: sh -c "sudo sed -i '/^ *"net.ipv4.ip_unprivileged_port_start=.*"/d' /etc/crio/crio.conf.d/02-crio.conf"
	I0924 00:35:58.230251 1874359 ssh_runner.go:195] Run: sh -c "sudo grep -q "^ *default_sysctls" /etc/crio/crio.conf.d/02-crio.conf || sudo sed -i '/conmon_cgroup = .*/a default_sysctls = \[\n\]' /etc/crio/crio.conf.d/02-crio.conf"
	I0924 00:35:58.245370 1874359 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^default_sysctls *= *\[|&\n  "net.ipv4.ip_unprivileged_port_start=0",|' /etc/crio/crio.conf.d/02-crio.conf"
	I0924 00:35:58.254984 1874359 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
	I0924 00:35:58.263171 1874359 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
	I0924 00:35:58.271453 1874359 ssh_runner.go:195] Run: sudo systemctl daemon-reload
	I0924 00:35:58.353665 1874359 ssh_runner.go:195] Run: sudo systemctl restart crio
	I0924 00:35:58.467533 1874359 start.go:542] Will wait 60s for socket path /var/run/crio/crio.sock
	I0924 00:35:58.467654 1874359 ssh_runner.go:195] Run: stat /var/run/crio/crio.sock
	I0924 00:35:58.470878 1874359 start.go:563] Will wait 60s for crictl version
	I0924 00:35:58.470953 1874359 ssh_runner.go:195] Run: which crictl
	I0924 00:35:58.474104 1874359 ssh_runner.go:195] Run: sudo /usr/bin/crictl version
	I0924 00:35:58.514452 1874359 start.go:579] Version:  0.1.0
	RuntimeName:  cri-o
	RuntimeVersion:  1.24.6
	RuntimeApiVersion:  v1
	I0924 00:35:58.514567 1874359 ssh_runner.go:195] Run: crio --version
	I0924 00:35:58.551717 1874359 ssh_runner.go:195] Run: crio --version
	I0924 00:35:58.593634 1874359 out.go:177] * Preparing Kubernetes v1.31.1 on CRI-O 1.24.6 ...
	I0924 00:35:58.595974 1874359 cli_runner.go:164] Run: docker network inspect addons-371349 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
	I0924 00:35:58.610785 1874359 ssh_runner.go:195] Run: grep 192.168.49.1	host.minikube.internal$ /etc/hosts
	I0924 00:35:58.614009 1874359 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.49.1	host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
	I0924 00:35:58.624240 1874359 kubeadm.go:883] updating cluster {Name:addons-371349 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1727108449-19696@sha256:c662152d8855bc4c62a3b5786a68adf99e04794e7f8f374a3859703004ef1d21 Memory:4000 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.31.1 ClusterName:addons-371349 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNa
mes:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.49.2 Port:8443 KubernetesVersion:v1.31.1 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmw
arePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} ...
	I0924 00:35:58.624364 1874359 preload.go:131] Checking if preload exists for k8s version v1.31.1 and runtime crio
	I0924 00:35:58.624421 1874359 ssh_runner.go:195] Run: sudo crictl images --output json
	I0924 00:35:58.695904 1874359 crio.go:514] all images are preloaded for cri-o runtime.
	I0924 00:35:58.695928 1874359 crio.go:433] Images already preloaded, skipping extraction
	I0924 00:35:58.695988 1874359 ssh_runner.go:195] Run: sudo crictl images --output json
	I0924 00:35:58.733649 1874359 crio.go:514] all images are preloaded for cri-o runtime.
	I0924 00:35:58.733672 1874359 cache_images.go:84] Images are preloaded, skipping loading
	I0924 00:35:58.733681 1874359 kubeadm.go:934] updating node { 192.168.49.2 8443 v1.31.1 crio true true} ...
	I0924 00:35:58.733785 1874359 kubeadm.go:946] kubelet [Unit]
	Wants=crio.service
	
	[Service]
	ExecStart=
	ExecStart=/var/lib/minikube/binaries/v1.31.1/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --cgroups-per-qos=false --config=/var/lib/kubelet/config.yaml --enforce-node-allocatable= --hostname-override=addons-371349 --kubeconfig=/etc/kubernetes/kubelet.conf --node-ip=192.168.49.2
	
	[Install]
	 config:
	{KubernetesVersion:v1.31.1 ClusterName:addons-371349 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:}
	I0924 00:35:58.733894 1874359 ssh_runner.go:195] Run: crio config
	I0924 00:35:58.802054 1874359 cni.go:84] Creating CNI manager for ""
	I0924 00:35:58.802077 1874359 cni.go:143] "docker" driver + "crio" runtime found, recommending kindnet
	I0924 00:35:58.802089 1874359 kubeadm.go:84] Using pod CIDR: 10.244.0.0/16
	I0924 00:35:58.802112 1874359 kubeadm.go:181] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.49.2 APIServerPort:8443 KubernetesVersion:v1.31.1 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:addons-371349 NodeName:addons-371349 DNSDomain:cluster.local CRISocket:/var/run/crio/crio.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.49.2"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.49.2 CgroupDriver:cgroupfs ClientCAFile:/var/lib/minikube/certs/ca.crt StaticPodPath:/etc/kuberne
tes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[containerRuntimeEndpoint:unix:///var/run/crio/crio.sock hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:true}
	I0924 00:35:58.802254 1874359 kubeadm.go:187] kubeadm config:
	apiVersion: kubeadm.k8s.io/v1beta3
	kind: InitConfiguration
	localAPIEndpoint:
	  advertiseAddress: 192.168.49.2
	  bindPort: 8443
	bootstrapTokens:
	  - groups:
	      - system:bootstrappers:kubeadm:default-node-token
	    ttl: 24h0m0s
	    usages:
	      - signing
	      - authentication
	nodeRegistration:
	  criSocket: unix:///var/run/crio/crio.sock
	  name: "addons-371349"
	  kubeletExtraArgs:
	    node-ip: 192.168.49.2
	  taints: []
	---
	apiVersion: kubeadm.k8s.io/v1beta3
	kind: ClusterConfiguration
	apiServer:
	  certSANs: ["127.0.0.1", "localhost", "192.168.49.2"]
	  extraArgs:
	    enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"
	controllerManager:
	  extraArgs:
	    allocate-node-cidrs: "true"
	    leader-elect: "false"
	scheduler:
	  extraArgs:
	    leader-elect: "false"
	certificatesDir: /var/lib/minikube/certs
	clusterName: mk
	controlPlaneEndpoint: control-plane.minikube.internal:8443
	etcd:
	  local:
	    dataDir: /var/lib/minikube/etcd
	    extraArgs:
	      proxy-refresh-interval: "70000"
	kubernetesVersion: v1.31.1
	networking:
	  dnsDomain: cluster.local
	  podSubnet: "10.244.0.0/16"
	  serviceSubnet: 10.96.0.0/12
	---
	apiVersion: kubelet.config.k8s.io/v1beta1
	kind: KubeletConfiguration
	authentication:
	  x509:
	    clientCAFile: /var/lib/minikube/certs/ca.crt
	cgroupDriver: cgroupfs
	containerRuntimeEndpoint: unix:///var/run/crio/crio.sock
	hairpinMode: hairpin-veth
	runtimeRequestTimeout: 15m
	clusterDomain: "cluster.local"
	# disable disk resource management by default
	imageGCHighThresholdPercent: 100
	evictionHard:
	  nodefs.available: "0%"
	  nodefs.inodesFree: "0%"
	  imagefs.available: "0%"
	failSwapOn: false
	staticPodPath: /etc/kubernetes/manifests
	---
	apiVersion: kubeproxy.config.k8s.io/v1alpha1
	kind: KubeProxyConfiguration
	clusterCIDR: "10.244.0.0/16"
	metricsBindAddress: 0.0.0.0:10249
	conntrack:
	  maxPerCore: 0
	# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"
	  tcpEstablishedTimeout: 0s
	# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"
	  tcpCloseWaitTimeout: 0s
	
	I0924 00:35:58.802327 1874359 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.31.1
	I0924 00:35:58.810920 1874359 binaries.go:44] Found k8s binaries, skipping transfer
	I0924 00:35:58.811007 1874359 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube
	I0924 00:35:58.819212 1874359 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (363 bytes)
	I0924 00:35:58.837724 1874359 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)
	I0924 00:35:58.856038 1874359 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2151 bytes)
	I0924 00:35:58.873780 1874359 ssh_runner.go:195] Run: grep 192.168.49.2	control-plane.minikube.internal$ /etc/hosts
	I0924 00:35:58.877149 1874359 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.49.2	control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
	I0924 00:35:58.887775 1874359 ssh_runner.go:195] Run: sudo systemctl daemon-reload
	I0924 00:35:58.974780 1874359 ssh_runner.go:195] Run: sudo systemctl start kubelet
	I0924 00:35:58.988169 1874359 certs.go:68] Setting up /home/jenkins/minikube-integration/19696-1868219/.minikube/profiles/addons-371349 for IP: 192.168.49.2
	I0924 00:35:58.988244 1874359 certs.go:194] generating shared ca certs ...
	I0924 00:35:58.988287 1874359 certs.go:226] acquiring lock for ca certs: {Name:mk818e75f019a868ef3b3a376623c8523880c0ff Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0924 00:35:58.988471 1874359 certs.go:240] generating "minikubeCA" ca cert: /home/jenkins/minikube-integration/19696-1868219/.minikube/ca.key
	I0924 00:35:59.587260 1874359 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19696-1868219/.minikube/ca.crt ...
	I0924 00:35:59.587293 1874359 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19696-1868219/.minikube/ca.crt: {Name:mke81ea5621d8e9399e452bcb5d27949aa3a3e3f Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0924 00:35:59.588029 1874359 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19696-1868219/.minikube/ca.key ...
	I0924 00:35:59.588046 1874359 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19696-1868219/.minikube/ca.key: {Name:mke396d44ce3103d725d30848cab5b8e6daaf342 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0924 00:35:59.588626 1874359 certs.go:240] generating "proxyClientCA" ca cert: /home/jenkins/minikube-integration/19696-1868219/.minikube/proxy-client-ca.key
	I0924 00:35:59.801877 1874359 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19696-1868219/.minikube/proxy-client-ca.crt ...
	I0924 00:35:59.801907 1874359 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19696-1868219/.minikube/proxy-client-ca.crt: {Name:mka8d81d58c2fe8e182a341cf45abd586bdd7c80 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0924 00:35:59.802595 1874359 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19696-1868219/.minikube/proxy-client-ca.key ...
	I0924 00:35:59.802622 1874359 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19696-1868219/.minikube/proxy-client-ca.key: {Name:mkb2d5aac983abcd6198ab2e82a3a31af20c1be0 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0924 00:35:59.802732 1874359 certs.go:256] generating profile certs ...
	I0924 00:35:59.802795 1874359 certs.go:363] generating signed profile cert for "minikube-user": /home/jenkins/minikube-integration/19696-1868219/.minikube/profiles/addons-371349/client.key
	I0924 00:35:59.802812 1874359 crypto.go:68] Generating cert /home/jenkins/minikube-integration/19696-1868219/.minikube/profiles/addons-371349/client.crt with IP's: []
	I0924 00:36:00.032900 1874359 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19696-1868219/.minikube/profiles/addons-371349/client.crt ...
	I0924 00:36:00.032941 1874359 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19696-1868219/.minikube/profiles/addons-371349/client.crt: {Name:mk0c65c4919d6dbeb99ceefeedc5bb455538bb52 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0924 00:36:00.033160 1874359 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19696-1868219/.minikube/profiles/addons-371349/client.key ...
	I0924 00:36:00.033170 1874359 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19696-1868219/.minikube/profiles/addons-371349/client.key: {Name:mk8703043f4377c7a2b7dcc6d398d1c35642fcec Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0924 00:36:00.033246 1874359 certs.go:363] generating signed profile cert for "minikube": /home/jenkins/minikube-integration/19696-1868219/.minikube/profiles/addons-371349/apiserver.key.2f5d7484
	I0924 00:36:00.033264 1874359 crypto.go:68] Generating cert /home/jenkins/minikube-integration/19696-1868219/.minikube/profiles/addons-371349/apiserver.crt.2f5d7484 with IP's: [10.96.0.1 127.0.0.1 10.0.0.1 192.168.49.2]
	I0924 00:36:00.289276 1874359 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19696-1868219/.minikube/profiles/addons-371349/apiserver.crt.2f5d7484 ...
	I0924 00:36:00.289317 1874359 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19696-1868219/.minikube/profiles/addons-371349/apiserver.crt.2f5d7484: {Name:mk1949bfae5f28a507cc523025a347e01f859e96 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0924 00:36:00.289525 1874359 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19696-1868219/.minikube/profiles/addons-371349/apiserver.key.2f5d7484 ...
	I0924 00:36:00.289542 1874359 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19696-1868219/.minikube/profiles/addons-371349/apiserver.key.2f5d7484: {Name:mk1e2fd43443814467d34e4ff1350d3d0c2858ba Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0924 00:36:00.289633 1874359 certs.go:381] copying /home/jenkins/minikube-integration/19696-1868219/.minikube/profiles/addons-371349/apiserver.crt.2f5d7484 -> /home/jenkins/minikube-integration/19696-1868219/.minikube/profiles/addons-371349/apiserver.crt
	I0924 00:36:00.289714 1874359 certs.go:385] copying /home/jenkins/minikube-integration/19696-1868219/.minikube/profiles/addons-371349/apiserver.key.2f5d7484 -> /home/jenkins/minikube-integration/19696-1868219/.minikube/profiles/addons-371349/apiserver.key
	I0924 00:36:00.289774 1874359 certs.go:363] generating signed profile cert for "aggregator": /home/jenkins/minikube-integration/19696-1868219/.minikube/profiles/addons-371349/proxy-client.key
	I0924 00:36:00.289797 1874359 crypto.go:68] Generating cert /home/jenkins/minikube-integration/19696-1868219/.minikube/profiles/addons-371349/proxy-client.crt with IP's: []
	I0924 00:36:01.184870 1874359 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19696-1868219/.minikube/profiles/addons-371349/proxy-client.crt ...
	I0924 00:36:01.184904 1874359 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19696-1868219/.minikube/profiles/addons-371349/proxy-client.crt: {Name:mk96ef231439e929316cf55529c83e8632d14bf2 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0924 00:36:01.185111 1874359 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19696-1868219/.minikube/profiles/addons-371349/proxy-client.key ...
	I0924 00:36:01.185126 1874359 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19696-1868219/.minikube/profiles/addons-371349/proxy-client.key: {Name:mk30736069b99211f16b83e0f6cbcb537a5e08b3 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0924 00:36:01.186062 1874359 certs.go:484] found cert: /home/jenkins/minikube-integration/19696-1868219/.minikube/certs/ca-key.pem (1675 bytes)
	I0924 00:36:01.186110 1874359 certs.go:484] found cert: /home/jenkins/minikube-integration/19696-1868219/.minikube/certs/ca.pem (1078 bytes)
	I0924 00:36:01.186133 1874359 certs.go:484] found cert: /home/jenkins/minikube-integration/19696-1868219/.minikube/certs/cert.pem (1123 bytes)
	I0924 00:36:01.186163 1874359 certs.go:484] found cert: /home/jenkins/minikube-integration/19696-1868219/.minikube/certs/key.pem (1675 bytes)
	I0924 00:36:01.186798 1874359 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19696-1868219/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
	I0924 00:36:01.211166 1874359 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19696-1868219/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1679 bytes)
	I0924 00:36:01.235382 1874359 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19696-1868219/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
	I0924 00:36:01.262901 1874359 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19696-1868219/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1679 bytes)
	I0924 00:36:01.287047 1874359 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19696-1868219/.minikube/profiles/addons-371349/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1419 bytes)
	I0924 00:36:01.312081 1874359 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19696-1868219/.minikube/profiles/addons-371349/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1675 bytes)
	I0924 00:36:01.335367 1874359 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19696-1868219/.minikube/profiles/addons-371349/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
	I0924 00:36:01.359222 1874359 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19696-1868219/.minikube/profiles/addons-371349/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1679 bytes)
	I0924 00:36:01.382733 1874359 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19696-1868219/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
	I0924 00:36:01.406976 1874359 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)
	I0924 00:36:01.424742 1874359 ssh_runner.go:195] Run: openssl version
	I0924 00:36:01.430037 1874359 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
	I0924 00:36:01.439176 1874359 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
	I0924 00:36:01.442603 1874359 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 Sep 24 00:35 /usr/share/ca-certificates/minikubeCA.pem
	I0924 00:36:01.442708 1874359 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
	I0924 00:36:01.449379 1874359 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
	I0924 00:36:01.459010 1874359 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt
	I0924 00:36:01.462508 1874359 certs.go:399] 'apiserver-kubelet-client' cert doesn't exist, likely first start: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt: Process exited with status 1
	stdout:
	
	stderr:
	stat: cannot statx '/var/lib/minikube/certs/apiserver-kubelet-client.crt': No such file or directory
	I0924 00:36:01.462552 1874359 kubeadm.go:392] StartCluster: {Name:addons-371349 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1727108449-19696@sha256:c662152d8855bc4c62a3b5786a68adf99e04794e7f8f374a3859703004ef1d21 Memory:4000 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.31.1 ClusterName:addons-371349 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames
:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.49.2 Port:8443 KubernetesVersion:v1.31.1 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmware
Path: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I0924 00:36:01.462632 1874359 cri.go:54] listing CRI containers in root : {State:paused Name: Namespaces:[kube-system]}
	I0924 00:36:01.462690 1874359 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"
	I0924 00:36:01.499005 1874359 cri.go:89] found id: ""
	I0924 00:36:01.499117 1874359 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd
	I0924 00:36:01.507984 1874359 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml
	I0924 00:36:01.517128 1874359 kubeadm.go:214] ignoring SystemVerification for kubeadm because of docker driver
	I0924 00:36:01.517195 1874359 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
	I0924 00:36:01.526007 1874359 kubeadm.go:155] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
	stdout:
	
	stderr:
	ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
	ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
	ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
	ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
	I0924 00:36:01.526027 1874359 kubeadm.go:157] found existing configuration files:
	
	I0924 00:36:01.526106 1874359 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf
	I0924 00:36:01.534919 1874359 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/admin.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf: Process exited with status 2
	stdout:
	
	stderr:
	grep: /etc/kubernetes/admin.conf: No such file or directory
	I0924 00:36:01.535008 1874359 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/admin.conf
	I0924 00:36:01.543320 1874359 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf
	I0924 00:36:01.552608 1874359 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/kubelet.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf: Process exited with status 2
	stdout:
	
	stderr:
	grep: /etc/kubernetes/kubelet.conf: No such file or directory
	I0924 00:36:01.552698 1874359 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/kubelet.conf
	I0924 00:36:01.560982 1874359 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf
	I0924 00:36:01.569305 1874359 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/controller-manager.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf: Process exited with status 2
	stdout:
	
	stderr:
	grep: /etc/kubernetes/controller-manager.conf: No such file or directory
	I0924 00:36:01.569372 1874359 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/controller-manager.conf
	I0924 00:36:01.577681 1874359 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf
	I0924 00:36:01.586185 1874359 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/scheduler.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf: Process exited with status 2
	stdout:
	
	stderr:
	grep: /etc/kubernetes/scheduler.conf: No such file or directory
	I0924 00:36:01.586249 1874359 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/scheduler.conf
	I0924 00:36:01.594692 1874359 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.31.1:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml  --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem,SystemVerification,FileContent--proc-sys-net-bridge-bridge-nf-call-iptables"
	I0924 00:36:01.637749 1874359 kubeadm.go:310] [init] Using Kubernetes version: v1.31.1
	I0924 00:36:01.637865 1874359 kubeadm.go:310] [preflight] Running pre-flight checks
	I0924 00:36:01.655764 1874359 kubeadm.go:310] [preflight] The system verification failed. Printing the output from the verification:
	I0924 00:36:01.655856 1874359 kubeadm.go:310] KERNEL_VERSION: 5.15.0-1070-aws
	I0924 00:36:01.655907 1874359 kubeadm.go:310] OS: Linux
	I0924 00:36:01.655967 1874359 kubeadm.go:310] CGROUPS_CPU: enabled
	I0924 00:36:01.656027 1874359 kubeadm.go:310] CGROUPS_CPUACCT: enabled
	I0924 00:36:01.656089 1874359 kubeadm.go:310] CGROUPS_CPUSET: enabled
	I0924 00:36:01.656141 1874359 kubeadm.go:310] CGROUPS_DEVICES: enabled
	I0924 00:36:01.656201 1874359 kubeadm.go:310] CGROUPS_FREEZER: enabled
	I0924 00:36:01.656264 1874359 kubeadm.go:310] CGROUPS_MEMORY: enabled
	I0924 00:36:01.656324 1874359 kubeadm.go:310] CGROUPS_PIDS: enabled
	I0924 00:36:01.656385 1874359 kubeadm.go:310] CGROUPS_HUGETLB: enabled
	I0924 00:36:01.656445 1874359 kubeadm.go:310] CGROUPS_BLKIO: enabled
	I0924 00:36:01.719525 1874359 kubeadm.go:310] [preflight] Pulling images required for setting up a Kubernetes cluster
	I0924 00:36:01.719648 1874359 kubeadm.go:310] [preflight] This might take a minute or two, depending on the speed of your internet connection
	I0924 00:36:01.719758 1874359 kubeadm.go:310] [preflight] You can also perform this action beforehand using 'kubeadm config images pull'
	I0924 00:36:01.728062 1874359 kubeadm.go:310] [certs] Using certificateDir folder "/var/lib/minikube/certs"
	I0924 00:36:01.731719 1874359 out.go:235]   - Generating certificates and keys ...
	I0924 00:36:01.731836 1874359 kubeadm.go:310] [certs] Using existing ca certificate authority
	I0924 00:36:01.731917 1874359 kubeadm.go:310] [certs] Using existing apiserver certificate and key on disk
	I0924 00:36:01.906779 1874359 kubeadm.go:310] [certs] Generating "apiserver-kubelet-client" certificate and key
	I0924 00:36:02.049111 1874359 kubeadm.go:310] [certs] Generating "front-proxy-ca" certificate and key
	I0924 00:36:02.315960 1874359 kubeadm.go:310] [certs] Generating "front-proxy-client" certificate and key
	I0924 00:36:03.509370 1874359 kubeadm.go:310] [certs] Generating "etcd/ca" certificate and key
	I0924 00:36:03.646997 1874359 kubeadm.go:310] [certs] Generating "etcd/server" certificate and key
	I0924 00:36:03.647141 1874359 kubeadm.go:310] [certs] etcd/server serving cert is signed for DNS names [addons-371349 localhost] and IPs [192.168.49.2 127.0.0.1 ::1]
	I0924 00:36:04.006991 1874359 kubeadm.go:310] [certs] Generating "etcd/peer" certificate and key
	I0924 00:36:04.007349 1874359 kubeadm.go:310] [certs] etcd/peer serving cert is signed for DNS names [addons-371349 localhost] and IPs [192.168.49.2 127.0.0.1 ::1]
	I0924 00:36:04.300686 1874359 kubeadm.go:310] [certs] Generating "etcd/healthcheck-client" certificate and key
	I0924 00:36:05.100917 1874359 kubeadm.go:310] [certs] Generating "apiserver-etcd-client" certificate and key
	I0924 00:36:05.382780 1874359 kubeadm.go:310] [certs] Generating "sa" key and public key
	I0924 00:36:05.383050 1874359 kubeadm.go:310] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"
	I0924 00:36:05.872836 1874359 kubeadm.go:310] [kubeconfig] Writing "admin.conf" kubeconfig file
	I0924 00:36:06.283339 1874359 kubeadm.go:310] [kubeconfig] Writing "super-admin.conf" kubeconfig file
	I0924 00:36:06.905365 1874359 kubeadm.go:310] [kubeconfig] Writing "kubelet.conf" kubeconfig file
	I0924 00:36:07.389536 1874359 kubeadm.go:310] [kubeconfig] Writing "controller-manager.conf" kubeconfig file
	I0924 00:36:07.777598 1874359 kubeadm.go:310] [kubeconfig] Writing "scheduler.conf" kubeconfig file
	I0924 00:36:07.778300 1874359 kubeadm.go:310] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
	I0924 00:36:07.781412 1874359 kubeadm.go:310] [control-plane] Using manifest folder "/etc/kubernetes/manifests"
	I0924 00:36:07.784656 1874359 out.go:235]   - Booting up control plane ...
	I0924 00:36:07.784765 1874359 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-apiserver"
	I0924 00:36:07.784847 1874359 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-controller-manager"
	I0924 00:36:07.784939 1874359 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-scheduler"
	I0924 00:36:07.795428 1874359 kubeadm.go:310] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
	I0924 00:36:07.804702 1874359 kubeadm.go:310] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
	I0924 00:36:07.804863 1874359 kubeadm.go:310] [kubelet-start] Starting the kubelet
	I0924 00:36:07.897266 1874359 kubeadm.go:310] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests"
	I0924 00:36:07.897385 1874359 kubeadm.go:310] [kubelet-check] Waiting for a healthy kubelet at http://127.0.0.1:10248/healthz. This can take up to 4m0s
	I0924 00:36:08.898859 1874359 kubeadm.go:310] [kubelet-check] The kubelet is healthy after 1.001644076s
	I0924 00:36:08.898952 1874359 kubeadm.go:310] [api-check] Waiting for a healthy API server. This can take up to 4m0s
	I0924 00:36:14.400419 1874359 kubeadm.go:310] [api-check] The API server is healthy after 5.501595805s
	I0924 00:36:14.420462 1874359 kubeadm.go:310] [upload-config] Storing the configuration used in ConfigMap "kubeadm-config" in the "kube-system" Namespace
	I0924 00:36:14.434273 1874359 kubeadm.go:310] [kubelet] Creating a ConfigMap "kubelet-config" in namespace kube-system with the configuration for the kubelets in the cluster
	I0924 00:36:14.457766 1874359 kubeadm.go:310] [upload-certs] Skipping phase. Please see --upload-certs
	I0924 00:36:14.458007 1874359 kubeadm.go:310] [mark-control-plane] Marking the node addons-371349 as control-plane by adding the labels: [node-role.kubernetes.io/control-plane node.kubernetes.io/exclude-from-external-load-balancers]
	I0924 00:36:14.468841 1874359 kubeadm.go:310] [bootstrap-token] Using token: fyb3ns.xyo1unypmhns8drs
	I0924 00:36:14.471738 1874359 out.go:235]   - Configuring RBAC rules ...
	I0924 00:36:14.471858 1874359 kubeadm.go:310] [bootstrap-token] Configuring bootstrap tokens, cluster-info ConfigMap, RBAC Roles
	I0924 00:36:14.475171 1874359 kubeadm.go:310] [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to get nodes
	I0924 00:36:14.482586 1874359 kubeadm.go:310] [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to post CSRs in order for nodes to get long term certificate credentials
	I0924 00:36:14.486317 1874359 kubeadm.go:310] [bootstrap-token] Configured RBAC rules to allow the csrapprover controller automatically approve CSRs from a Node Bootstrap Token
	I0924 00:36:14.492041 1874359 kubeadm.go:310] [bootstrap-token] Configured RBAC rules to allow certificate rotation for all node client certificates in the cluster
	I0924 00:36:14.495775 1874359 kubeadm.go:310] [bootstrap-token] Creating the "cluster-info" ConfigMap in the "kube-public" namespace
	I0924 00:36:14.807767 1874359 kubeadm.go:310] [kubelet-finalize] Updating "/etc/kubernetes/kubelet.conf" to point to a rotatable kubelet client certificate and key
	I0924 00:36:15.233069 1874359 kubeadm.go:310] [addons] Applied essential addon: CoreDNS
	I0924 00:36:15.807451 1874359 kubeadm.go:310] [addons] Applied essential addon: kube-proxy
	I0924 00:36:15.808519 1874359 kubeadm.go:310] 
	I0924 00:36:15.808597 1874359 kubeadm.go:310] Your Kubernetes control-plane has initialized successfully!
	I0924 00:36:15.808611 1874359 kubeadm.go:310] 
	I0924 00:36:15.808688 1874359 kubeadm.go:310] To start using your cluster, you need to run the following as a regular user:
	I0924 00:36:15.808698 1874359 kubeadm.go:310] 
	I0924 00:36:15.808723 1874359 kubeadm.go:310]   mkdir -p $HOME/.kube
	I0924 00:36:15.808787 1874359 kubeadm.go:310]   sudo cp -i /etc/kubernetes/admin.conf $HOME/.kube/config
	I0924 00:36:15.808841 1874359 kubeadm.go:310]   sudo chown $(id -u):$(id -g) $HOME/.kube/config
	I0924 00:36:15.808850 1874359 kubeadm.go:310] 
	I0924 00:36:15.808903 1874359 kubeadm.go:310] Alternatively, if you are the root user, you can run:
	I0924 00:36:15.808911 1874359 kubeadm.go:310] 
	I0924 00:36:15.808966 1874359 kubeadm.go:310]   export KUBECONFIG=/etc/kubernetes/admin.conf
	I0924 00:36:15.808982 1874359 kubeadm.go:310] 
	I0924 00:36:15.809034 1874359 kubeadm.go:310] You should now deploy a pod network to the cluster.
	I0924 00:36:15.809111 1874359 kubeadm.go:310] Run "kubectl apply -f [podnetwork].yaml" with one of the options listed at:
	I0924 00:36:15.809191 1874359 kubeadm.go:310]   https://kubernetes.io/docs/concepts/cluster-administration/addons/
	I0924 00:36:15.809201 1874359 kubeadm.go:310] 
	I0924 00:36:15.809290 1874359 kubeadm.go:310] You can now join any number of control-plane nodes by copying certificate authorities
	I0924 00:36:15.809372 1874359 kubeadm.go:310] and service account keys on each node and then running the following as root:
	I0924 00:36:15.809381 1874359 kubeadm.go:310] 
	I0924 00:36:15.809464 1874359 kubeadm.go:310]   kubeadm join control-plane.minikube.internal:8443 --token fyb3ns.xyo1unypmhns8drs \
	I0924 00:36:15.809568 1874359 kubeadm.go:310] 	--discovery-token-ca-cert-hash sha256:92ab852119932e380fabb88b90131863744668403f48ee05cfbc8ebb0fb002df \
	I0924 00:36:15.809591 1874359 kubeadm.go:310] 	--control-plane 
	I0924 00:36:15.809601 1874359 kubeadm.go:310] 
	I0924 00:36:15.809688 1874359 kubeadm.go:310] Then you can join any number of worker nodes by running the following on each as root:
	I0924 00:36:15.809697 1874359 kubeadm.go:310] 
	I0924 00:36:15.809781 1874359 kubeadm.go:310] kubeadm join control-plane.minikube.internal:8443 --token fyb3ns.xyo1unypmhns8drs \
	I0924 00:36:15.809910 1874359 kubeadm.go:310] 	--discovery-token-ca-cert-hash sha256:92ab852119932e380fabb88b90131863744668403f48ee05cfbc8ebb0fb002df 
	I0924 00:36:15.814096 1874359 kubeadm.go:310] W0924 00:36:01.634539    1182 common.go:101] your configuration file uses a deprecated API spec: "kubeadm.k8s.io/v1beta3" (kind: "ClusterConfiguration"). Please use 'kubeadm config migrate --old-config old.yaml --new-config new.yaml', which will write the new, similar spec using a newer API version.
	I0924 00:36:15.814397 1874359 kubeadm.go:310] W0924 00:36:01.635367    1182 common.go:101] your configuration file uses a deprecated API spec: "kubeadm.k8s.io/v1beta3" (kind: "InitConfiguration"). Please use 'kubeadm config migrate --old-config old.yaml --new-config new.yaml', which will write the new, similar spec using a newer API version.
	I0924 00:36:15.814637 1874359 kubeadm.go:310] 	[WARNING SystemVerification]: failed to parse kernel config: unable to load kernel module: "configs", output: "modprobe: FATAL: Module configs not found in directory /lib/modules/5.15.0-1070-aws\n", err: exit status 1
	I0924 00:36:15.814759 1874359 kubeadm.go:310] 	[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
	I0924 00:36:15.814783 1874359 cni.go:84] Creating CNI manager for ""
	I0924 00:36:15.814791 1874359 cni.go:143] "docker" driver + "crio" runtime found, recommending kindnet
	I0924 00:36:15.816668 1874359 out.go:177] * Configuring CNI (Container Networking Interface) ...
	I0924 00:36:15.818482 1874359 ssh_runner.go:195] Run: stat /opt/cni/bin/portmap
	I0924 00:36:15.822601 1874359 cni.go:182] applying CNI manifest using /var/lib/minikube/binaries/v1.31.1/kubectl ...
	I0924 00:36:15.822619 1874359 ssh_runner.go:362] scp memory --> /var/tmp/minikube/cni.yaml (2601 bytes)
	I0924 00:36:15.843203 1874359 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.1/kubectl apply --kubeconfig=/var/lib/minikube/kubeconfig -f /var/tmp/minikube/cni.yaml
	I0924 00:36:16.155987 1874359 ssh_runner.go:195] Run: /bin/bash -c "cat /proc/$(pgrep kube-apiserver)/oom_adj"
	I0924 00:36:16.156142 1874359 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.1/kubectl create clusterrolebinding minikube-rbac --clusterrole=cluster-admin --serviceaccount=kube-system:default --kubeconfig=/var/lib/minikube/kubeconfig
	I0924 00:36:16.156262 1874359 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.1/kubectl --kubeconfig=/var/lib/minikube/kubeconfig label --overwrite nodes addons-371349 minikube.k8s.io/updated_at=2024_09_24T00_36_16_0700 minikube.k8s.io/version=v1.34.0 minikube.k8s.io/commit=41795ff643dcbe39cdf81f27d064464d20ae8e7c minikube.k8s.io/name=addons-371349 minikube.k8s.io/primary=true
	I0924 00:36:16.320925 1874359 ops.go:34] apiserver oom_adj: -16
	I0924 00:36:16.321114 1874359 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0924 00:36:16.821252 1874359 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0924 00:36:17.321244 1874359 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0924 00:36:17.821552 1874359 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0924 00:36:18.322035 1874359 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0924 00:36:18.821736 1874359 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0924 00:36:19.321684 1874359 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0924 00:36:19.821789 1874359 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0924 00:36:19.912113 1874359 kubeadm.go:1113] duration metric: took 3.756037913s to wait for elevateKubeSystemPrivileges
	I0924 00:36:19.912142 1874359 kubeadm.go:394] duration metric: took 18.449591997s to StartCluster
	I0924 00:36:19.912159 1874359 settings.go:142] acquiring lock: {Name:mk1f9eaf6a4c831f2bd4174d069aecdee825d054 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0924 00:36:19.912272 1874359 settings.go:150] Updating kubeconfig:  /home/jenkins/minikube-integration/19696-1868219/kubeconfig
	I0924 00:36:19.912639 1874359 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19696-1868219/kubeconfig: {Name:mk4b43b4b2f636bf366ceefc82df157a927b449f Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0924 00:36:19.912824 1874359 start.go:235] Will wait 6m0s for node &{Name: IP:192.168.49.2 Port:8443 KubernetesVersion:v1.31.1 ContainerRuntime:crio ControlPlane:true Worker:true}
	I0924 00:36:19.912967 1874359 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.31.1/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml"
	I0924 00:36:19.913219 1874359 config.go:182] Loaded profile config "addons-371349": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.31.1
	I0924 00:36:19.913255 1874359 addons.go:507] enable addons start: toEnable=map[ambassador:false auto-pause:false cloud-spanner:true csi-hostpath-driver:true dashboard:false default-storageclass:true efk:false freshpod:false gcp-auth:true gvisor:false headlamp:false inaccel:false ingress:true ingress-dns:true inspektor-gadget:true istio:false istio-provisioner:false kong:false kubeflow:false kubevirt:false logviewer:false metallb:false metrics-server:true nvidia-device-plugin:true nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:true registry-aliases:false registry-creds:false storage-provisioner:true storage-provisioner-gluster:false storage-provisioner-rancher:true volcano:true volumesnapshots:true yakd:true]
	I0924 00:36:19.913337 1874359 addons.go:69] Setting yakd=true in profile "addons-371349"
	I0924 00:36:19.913354 1874359 addons.go:234] Setting addon yakd=true in "addons-371349"
	I0924 00:36:19.913380 1874359 host.go:66] Checking if "addons-371349" exists ...
	I0924 00:36:19.913893 1874359 cli_runner.go:164] Run: docker container inspect addons-371349 --format={{.State.Status}}
	I0924 00:36:19.914281 1874359 addons.go:69] Setting metrics-server=true in profile "addons-371349"
	I0924 00:36:19.914303 1874359 addons.go:234] Setting addon metrics-server=true in "addons-371349"
	I0924 00:36:19.914332 1874359 host.go:66] Checking if "addons-371349" exists ...
	I0924 00:36:19.914762 1874359 cli_runner.go:164] Run: docker container inspect addons-371349 --format={{.State.Status}}
	I0924 00:36:19.914903 1874359 addons.go:69] Setting nvidia-device-plugin=true in profile "addons-371349"
	I0924 00:36:19.914922 1874359 addons.go:234] Setting addon nvidia-device-plugin=true in "addons-371349"
	I0924 00:36:19.914942 1874359 host.go:66] Checking if "addons-371349" exists ...
	I0924 00:36:19.915339 1874359 cli_runner.go:164] Run: docker container inspect addons-371349 --format={{.State.Status}}
	I0924 00:36:19.917403 1874359 addons.go:69] Setting registry=true in profile "addons-371349"
	I0924 00:36:19.917433 1874359 addons.go:234] Setting addon registry=true in "addons-371349"
	I0924 00:36:19.917459 1874359 host.go:66] Checking if "addons-371349" exists ...
	I0924 00:36:19.917922 1874359 cli_runner.go:164] Run: docker container inspect addons-371349 --format={{.State.Status}}
	I0924 00:36:19.919606 1874359 out.go:177] * Verifying Kubernetes components...
	I0924 00:36:19.919769 1874359 addons.go:69] Setting storage-provisioner=true in profile "addons-371349"
	I0924 00:36:19.919795 1874359 addons.go:234] Setting addon storage-provisioner=true in "addons-371349"
	I0924 00:36:19.919823 1874359 host.go:66] Checking if "addons-371349" exists ...
	I0924 00:36:19.920250 1874359 cli_runner.go:164] Run: docker container inspect addons-371349 --format={{.State.Status}}
	I0924 00:36:19.923735 1874359 addons.go:69] Setting storage-provisioner-rancher=true in profile "addons-371349"
	I0924 00:36:19.923769 1874359 addons_storage_classes.go:33] enableOrDisableStorageClasses storage-provisioner-rancher=true on "addons-371349"
	I0924 00:36:19.924079 1874359 cli_runner.go:164] Run: docker container inspect addons-371349 --format={{.State.Status}}
	I0924 00:36:19.926136 1874359 addons.go:69] Setting cloud-spanner=true in profile "addons-371349"
	I0924 00:36:19.926194 1874359 addons.go:234] Setting addon cloud-spanner=true in "addons-371349"
	I0924 00:36:19.926253 1874359 host.go:66] Checking if "addons-371349" exists ...
	I0924 00:36:19.926788 1874359 cli_runner.go:164] Run: docker container inspect addons-371349 --format={{.State.Status}}
	I0924 00:36:19.935402 1874359 addons.go:69] Setting volcano=true in profile "addons-371349"
	I0924 00:36:19.935434 1874359 addons.go:234] Setting addon volcano=true in "addons-371349"
	I0924 00:36:19.935472 1874359 host.go:66] Checking if "addons-371349" exists ...
	I0924 00:36:19.935980 1874359 cli_runner.go:164] Run: docker container inspect addons-371349 --format={{.State.Status}}
	I0924 00:36:19.944614 1874359 addons.go:69] Setting csi-hostpath-driver=true in profile "addons-371349"
	I0924 00:36:19.944766 1874359 addons.go:234] Setting addon csi-hostpath-driver=true in "addons-371349"
	I0924 00:36:19.944836 1874359 host.go:66] Checking if "addons-371349" exists ...
	I0924 00:36:19.945418 1874359 cli_runner.go:164] Run: docker container inspect addons-371349 --format={{.State.Status}}
	I0924 00:36:19.966987 1874359 addons.go:69] Setting volumesnapshots=true in profile "addons-371349"
	I0924 00:36:19.967067 1874359 addons.go:234] Setting addon volumesnapshots=true in "addons-371349"
	I0924 00:36:19.967119 1874359 host.go:66] Checking if "addons-371349" exists ...
	I0924 00:36:19.967689 1874359 cli_runner.go:164] Run: docker container inspect addons-371349 --format={{.State.Status}}
	I0924 00:36:19.973077 1874359 addons.go:69] Setting default-storageclass=true in profile "addons-371349"
	I0924 00:36:19.973160 1874359 addons_storage_classes.go:33] enableOrDisableStorageClasses default-storageclass=true on "addons-371349"
	I0924 00:36:19.982732 1874359 cli_runner.go:164] Run: docker container inspect addons-371349 --format={{.State.Status}}
	I0924 00:36:20.001158 1874359 ssh_runner.go:195] Run: sudo systemctl daemon-reload
	I0924 00:36:20.005134 1874359 addons.go:69] Setting gcp-auth=true in profile "addons-371349"
	I0924 00:36:20.005242 1874359 mustload.go:65] Loading cluster: addons-371349
	I0924 00:36:20.005495 1874359 config.go:182] Loaded profile config "addons-371349": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.31.1
	I0924 00:36:20.006158 1874359 cli_runner.go:164] Run: docker container inspect addons-371349 --format={{.State.Status}}
	I0924 00:36:20.027761 1874359 addons.go:69] Setting ingress=true in profile "addons-371349"
	I0924 00:36:20.027838 1874359 addons.go:234] Setting addon ingress=true in "addons-371349"
	I0924 00:36:20.027915 1874359 host.go:66] Checking if "addons-371349" exists ...
	I0924 00:36:20.028423 1874359 cli_runner.go:164] Run: docker container inspect addons-371349 --format={{.State.Status}}
	I0924 00:36:20.040640 1874359 addons.go:69] Setting ingress-dns=true in profile "addons-371349"
	I0924 00:36:20.040746 1874359 addons.go:234] Setting addon ingress-dns=true in "addons-371349"
	I0924 00:36:20.040826 1874359 host.go:66] Checking if "addons-371349" exists ...
	I0924 00:36:20.047419 1874359 cli_runner.go:164] Run: docker container inspect addons-371349 --format={{.State.Status}}
	I0924 00:36:20.062936 1874359 addons.go:69] Setting inspektor-gadget=true in profile "addons-371349"
	I0924 00:36:20.063020 1874359 addons.go:234] Setting addon inspektor-gadget=true in "addons-371349"
	I0924 00:36:20.063086 1874359 host.go:66] Checking if "addons-371349" exists ...
	I0924 00:36:20.063605 1874359 cli_runner.go:164] Run: docker container inspect addons-371349 --format={{.State.Status}}
	I0924 00:36:20.073337 1874359 out.go:177]   - Using image gcr.io/cloud-spanner-emulator/emulator:1.5.24
	I0924 00:36:20.079819 1874359 addons.go:431] installing /etc/kubernetes/addons/deployment.yaml
	I0924 00:36:20.079847 1874359 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/deployment.yaml (1004 bytes)
	I0924 00:36:20.079924 1874359 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-371349
	I0924 00:36:20.083611 1874359 addons.go:234] Setting addon storage-provisioner-rancher=true in "addons-371349"
	I0924 00:36:20.083656 1874359 host.go:66] Checking if "addons-371349" exists ...
	I0924 00:36:20.085706 1874359 cli_runner.go:164] Run: docker container inspect addons-371349 --format={{.State.Status}}
	I0924 00:36:20.097199 1874359 out.go:177]   - Using image registry.k8s.io/sig-storage/csi-resizer:v1.6.0
	I0924 00:36:20.097447 1874359 out.go:177]   - Using image nvcr.io/nvidia/k8s-device-plugin:v0.16.2
	I0924 00:36:20.097629 1874359 out.go:177]   - Using image gcr.io/k8s-minikube/storage-provisioner:v5
	I0924 00:36:20.134921 1874359 out.go:177]   - Using image docker.io/marcnuri/yakd:0.0.5
	W0924 00:36:20.112693 1874359 out.go:270] ! Enabling 'volcano' returned an error: running callbacks: [volcano addon does not support crio]
	I0924 00:36:20.143522 1874359 addons.go:431] installing /etc/kubernetes/addons/nvidia-device-plugin.yaml
	I0924 00:36:20.143539 1874359 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/nvidia-device-plugin.yaml (1966 bytes)
	I0924 00:36:20.143610 1874359 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-371349
	I0924 00:36:20.144160 1874359 out.go:177]   - Using image docker.io/registry:2.8.3
	I0924 00:36:20.144325 1874359 out.go:177]   - Using image registry.k8s.io/metrics-server/metrics-server:v0.7.2
	I0924 00:36:20.144440 1874359 addons.go:431] installing /etc/kubernetes/addons/storage-provisioner.yaml
	I0924 00:36:20.145869 1874359 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storage-provisioner.yaml (2676 bytes)
	I0924 00:36:20.145935 1874359 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-371349
	I0924 00:36:20.162770 1874359 addons.go:431] installing /etc/kubernetes/addons/yakd-ns.yaml
	I0924 00:36:20.162797 1874359 ssh_runner.go:362] scp yakd/yakd-ns.yaml --> /etc/kubernetes/addons/yakd-ns.yaml (171 bytes)
	I0924 00:36:20.162863 1874359 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-371349
	I0924 00:36:20.145538 1874359 addons.go:234] Setting addon default-storageclass=true in "addons-371349"
	I0924 00:36:20.170888 1874359 host.go:66] Checking if "addons-371349" exists ...
	I0924 00:36:20.171353 1874359 cli_runner.go:164] Run: docker container inspect addons-371349 --format={{.State.Status}}
	I0924 00:36:20.189421 1874359 out.go:177]   - Using image registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0
	I0924 00:36:20.191234 1874359 addons.go:431] installing /etc/kubernetes/addons/metrics-apiservice.yaml
	I0924 00:36:20.191255 1874359 ssh_runner.go:362] scp metrics-server/metrics-apiservice.yaml --> /etc/kubernetes/addons/metrics-apiservice.yaml (424 bytes)
	I0924 00:36:20.191322 1874359 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-371349
	I0924 00:36:20.195761 1874359 out.go:177]   - Using image registry.k8s.io/sig-storage/csi-provisioner:v3.3.0
	I0924 00:36:20.202904 1874359 host.go:66] Checking if "addons-371349" exists ...
	I0924 00:36:20.206400 1874359 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:34691 SSHKeyPath:/home/jenkins/minikube-integration/19696-1868219/.minikube/machines/addons-371349/id_rsa Username:docker}
	I0924 00:36:20.207744 1874359 out.go:177]   - Using image registry.k8s.io/sig-storage/csi-attacher:v4.0.0
	I0924 00:36:20.214882 1874359 out.go:177]   - Using image gcr.io/k8s-minikube/kube-registry-proxy:0.0.6
	I0924 00:36:20.220705 1874359 addons.go:431] installing /etc/kubernetes/addons/registry-rc.yaml
	I0924 00:36:20.220780 1874359 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/registry-rc.yaml (860 bytes)
	I0924 00:36:20.220878 1874359 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-371349
	I0924 00:36:20.221763 1874359 out.go:177]   - Using image registry.k8s.io/sig-storage/csi-external-health-monitor-controller:v0.7.0
	I0924 00:36:20.232800 1874359 out.go:177]   - Using image registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.6.0
	I0924 00:36:20.242508 1874359 out.go:177]   - Using image registry.k8s.io/sig-storage/hostpathplugin:v1.9.0
	I0924 00:36:20.252224 1874359 out.go:177]   - Using image gcr.io/k8s-minikube/minikube-ingress-dns:0.0.3
	I0924 00:36:20.255629 1874359 out.go:177]   - Using image registry.k8s.io/sig-storage/snapshot-controller:v6.1.0
	I0924 00:36:20.255709 1874359 out.go:177]   - Using image docker.io/rancher/local-path-provisioner:v0.0.22
	I0924 00:36:20.255913 1874359 addons.go:431] installing /etc/kubernetes/addons/ingress-dns-pod.yaml
	I0924 00:36:20.255926 1874359 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/ingress-dns-pod.yaml (2442 bytes)
	I0924 00:36:20.256002 1874359 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-371349
	I0924 00:36:20.259897 1874359 out.go:177]   - Using image registry.k8s.io/sig-storage/livenessprobe:v2.8.0
	I0924 00:36:20.260072 1874359 addons.go:431] installing /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml
	I0924 00:36:20.260833 1874359 ssh_runner.go:362] scp volumesnapshots/csi-hostpath-snapshotclass.yaml --> /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml (934 bytes)
	I0924 00:36:20.260903 1874359 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-371349
	I0924 00:36:20.261717 1874359 out.go:177]   - Using image docker.io/busybox:stable
	I0924 00:36:20.264539 1874359 addons.go:431] installing /etc/kubernetes/addons/storage-provisioner-rancher.yaml
	I0924 00:36:20.264561 1874359 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storage-provisioner-rancher.yaml (3113 bytes)
	I0924 00:36:20.264629 1874359 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-371349
	I0924 00:36:20.280599 1874359 addons.go:431] installing /etc/kubernetes/addons/rbac-external-attacher.yaml
	I0924 00:36:20.280625 1874359 ssh_runner.go:362] scp csi-hostpath-driver/rbac/rbac-external-attacher.yaml --> /etc/kubernetes/addons/rbac-external-attacher.yaml (3073 bytes)
	I0924 00:36:20.280702 1874359 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-371349
	I0924 00:36:20.297489 1874359 out.go:177]   - Using image registry.k8s.io/ingress-nginx/kube-webhook-certgen:v1.4.3
	I0924 00:36:20.302057 1874359 out.go:177]   - Using image ghcr.io/inspektor-gadget/inspektor-gadget:v0.32.0
	I0924 00:36:20.305758 1874359 out.go:177]   - Using image registry.k8s.io/ingress-nginx/kube-webhook-certgen:v1.4.3
	I0924 00:36:20.305913 1874359 addons.go:431] installing /etc/kubernetes/addons/ig-namespace.yaml
	I0924 00:36:20.305937 1874359 ssh_runner.go:362] scp inspektor-gadget/ig-namespace.yaml --> /etc/kubernetes/addons/ig-namespace.yaml (55 bytes)
	I0924 00:36:20.306040 1874359 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-371349
	I0924 00:36:20.310783 1874359 out.go:177]   - Using image registry.k8s.io/ingress-nginx/controller:v1.11.2
	I0924 00:36:20.320860 1874359 addons.go:431] installing /etc/kubernetes/addons/ingress-deploy.yaml
	I0924 00:36:20.320935 1874359 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/ingress-deploy.yaml (16078 bytes)
	I0924 00:36:20.321039 1874359 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-371349
	I0924 00:36:20.382635 1874359 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:34691 SSHKeyPath:/home/jenkins/minikube-integration/19696-1868219/.minikube/machines/addons-371349/id_rsa Username:docker}
	I0924 00:36:20.383295 1874359 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:34691 SSHKeyPath:/home/jenkins/minikube-integration/19696-1868219/.minikube/machines/addons-371349/id_rsa Username:docker}
	I0924 00:36:20.395401 1874359 addons.go:431] installing /etc/kubernetes/addons/storageclass.yaml
	I0924 00:36:20.395421 1874359 ssh_runner.go:362] scp storageclass/storageclass.yaml --> /etc/kubernetes/addons/storageclass.yaml (271 bytes)
	I0924 00:36:20.395476 1874359 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-371349
	I0924 00:36:20.402650 1874359 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:34691 SSHKeyPath:/home/jenkins/minikube-integration/19696-1868219/.minikube/machines/addons-371349/id_rsa Username:docker}
	I0924 00:36:20.411638 1874359 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:34691 SSHKeyPath:/home/jenkins/minikube-integration/19696-1868219/.minikube/machines/addons-371349/id_rsa Username:docker}
	I0924 00:36:20.412343 1874359 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:34691 SSHKeyPath:/home/jenkins/minikube-integration/19696-1868219/.minikube/machines/addons-371349/id_rsa Username:docker}
	I0924 00:36:20.434229 1874359 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:34691 SSHKeyPath:/home/jenkins/minikube-integration/19696-1868219/.minikube/machines/addons-371349/id_rsa Username:docker}
	I0924 00:36:20.441444 1874359 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:34691 SSHKeyPath:/home/jenkins/minikube-integration/19696-1868219/.minikube/machines/addons-371349/id_rsa Username:docker}
	I0924 00:36:20.450129 1874359 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:34691 SSHKeyPath:/home/jenkins/minikube-integration/19696-1868219/.minikube/machines/addons-371349/id_rsa Username:docker}
	I0924 00:36:20.465770 1874359 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:34691 SSHKeyPath:/home/jenkins/minikube-integration/19696-1868219/.minikube/machines/addons-371349/id_rsa Username:docker}
	I0924 00:36:20.473465 1874359 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/deployment.yaml
	I0924 00:36:20.484112 1874359 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:34691 SSHKeyPath:/home/jenkins/minikube-integration/19696-1868219/.minikube/machines/addons-371349/id_rsa Username:docker}
	I0924 00:36:20.486490 1874359 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:34691 SSHKeyPath:/home/jenkins/minikube-integration/19696-1868219/.minikube/machines/addons-371349/id_rsa Username:docker}
	I0924 00:36:20.488626 1874359 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:34691 SSHKeyPath:/home/jenkins/minikube-integration/19696-1868219/.minikube/machines/addons-371349/id_rsa Username:docker}
	I0924 00:36:20.637569 1874359 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.31.1/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml | sed -e '/^        forward . \/etc\/resolv.conf.*/i \        hosts {\n           192.168.49.1 host.minikube.internal\n           fallthrough\n        }' -e '/^        errors *$/i \        log' | sudo /var/lib/minikube/binaries/v1.31.1/kubectl --kubeconfig=/var/lib/minikube/kubeconfig replace -f -"
	I0924 00:36:20.637723 1874359 ssh_runner.go:195] Run: sudo systemctl start kubelet
	I0924 00:36:20.756622 1874359 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml
	I0924 00:36:20.767901 1874359 addons.go:431] installing /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml
	I0924 00:36:20.767928 1874359 ssh_runner.go:362] scp volumesnapshots/snapshot.storage.k8s.io_volumesnapshotclasses.yaml --> /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml (6471 bytes)
	I0924 00:36:20.793684 1874359 addons.go:431] installing /etc/kubernetes/addons/yakd-sa.yaml
	I0924 00:36:20.793756 1874359 ssh_runner.go:362] scp yakd/yakd-sa.yaml --> /etc/kubernetes/addons/yakd-sa.yaml (247 bytes)
	I0924 00:36:20.820103 1874359 addons.go:431] installing /etc/kubernetes/addons/registry-svc.yaml
	I0924 00:36:20.820174 1874359 ssh_runner.go:362] scp registry/registry-svc.yaml --> /etc/kubernetes/addons/registry-svc.yaml (398 bytes)
	I0924 00:36:20.839949 1874359 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/nvidia-device-plugin.yaml
	I0924 00:36:20.843294 1874359 addons.go:431] installing /etc/kubernetes/addons/ig-serviceaccount.yaml
	I0924 00:36:20.843373 1874359 ssh_runner.go:362] scp inspektor-gadget/ig-serviceaccount.yaml --> /etc/kubernetes/addons/ig-serviceaccount.yaml (80 bytes)
	I0924 00:36:20.862306 1874359 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/ingress-dns-pod.yaml
	I0924 00:36:20.871400 1874359 addons.go:431] installing /etc/kubernetes/addons/metrics-server-deployment.yaml
	I0924 00:36:20.871469 1874359 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-server-deployment.yaml (1907 bytes)
	I0924 00:36:20.879318 1874359 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/ingress-deploy.yaml
	I0924 00:36:20.901110 1874359 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/storage-provisioner-rancher.yaml
	I0924 00:36:20.928473 1874359 addons.go:431] installing /etc/kubernetes/addons/rbac-hostpath.yaml
	I0924 00:36:20.928553 1874359 ssh_runner.go:362] scp csi-hostpath-driver/rbac/rbac-hostpath.yaml --> /etc/kubernetes/addons/rbac-hostpath.yaml (4266 bytes)
	I0924 00:36:20.931932 1874359 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml
	I0924 00:36:20.935841 1874359 addons.go:431] installing /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml
	I0924 00:36:20.935903 1874359 ssh_runner.go:362] scp volumesnapshots/snapshot.storage.k8s.io_volumesnapshotcontents.yaml --> /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml (23126 bytes)
	I0924 00:36:20.981190 1874359 addons.go:431] installing /etc/kubernetes/addons/ig-role.yaml
	I0924 00:36:20.981266 1874359 ssh_runner.go:362] scp inspektor-gadget/ig-role.yaml --> /etc/kubernetes/addons/ig-role.yaml (210 bytes)
	I0924 00:36:21.013456 1874359 addons.go:431] installing /etc/kubernetes/addons/registry-proxy.yaml
	I0924 00:36:21.013528 1874359 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/registry-proxy.yaml (947 bytes)
	I0924 00:36:21.018372 1874359 addons.go:431] installing /etc/kubernetes/addons/yakd-crb.yaml
	I0924 00:36:21.018444 1874359 ssh_runner.go:362] scp yakd/yakd-crb.yaml --> /etc/kubernetes/addons/yakd-crb.yaml (422 bytes)
	I0924 00:36:21.084717 1874359 addons.go:431] installing /etc/kubernetes/addons/rbac-external-health-monitor-controller.yaml
	I0924 00:36:21.084779 1874359 ssh_runner.go:362] scp csi-hostpath-driver/rbac/rbac-external-health-monitor-controller.yaml --> /etc/kubernetes/addons/rbac-external-health-monitor-controller.yaml (3038 bytes)
	I0924 00:36:21.092294 1874359 addons.go:431] installing /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml
	I0924 00:36:21.092373 1874359 ssh_runner.go:362] scp volumesnapshots/snapshot.storage.k8s.io_volumesnapshots.yaml --> /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml (19582 bytes)
	I0924 00:36:21.100194 1874359 addons.go:431] installing /etc/kubernetes/addons/metrics-server-rbac.yaml
	I0924 00:36:21.100257 1874359 ssh_runner.go:362] scp metrics-server/metrics-server-rbac.yaml --> /etc/kubernetes/addons/metrics-server-rbac.yaml (2175 bytes)
	I0924 00:36:21.171337 1874359 addons.go:431] installing /etc/kubernetes/addons/ig-rolebinding.yaml
	I0924 00:36:21.171414 1874359 ssh_runner.go:362] scp inspektor-gadget/ig-rolebinding.yaml --> /etc/kubernetes/addons/ig-rolebinding.yaml (244 bytes)
	I0924 00:36:21.207779 1874359 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/registry-rc.yaml -f /etc/kubernetes/addons/registry-svc.yaml -f /etc/kubernetes/addons/registry-proxy.yaml
	I0924 00:36:21.212774 1874359 addons.go:431] installing /etc/kubernetes/addons/yakd-svc.yaml
	I0924 00:36:21.212798 1874359 ssh_runner.go:362] scp yakd/yakd-svc.yaml --> /etc/kubernetes/addons/yakd-svc.yaml (412 bytes)
	I0924 00:36:21.265598 1874359 addons.go:431] installing /etc/kubernetes/addons/metrics-server-service.yaml
	I0924 00:36:21.265669 1874359 ssh_runner.go:362] scp metrics-server/metrics-server-service.yaml --> /etc/kubernetes/addons/metrics-server-service.yaml (446 bytes)
	I0924 00:36:21.268714 1874359 addons.go:431] installing /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml
	I0924 00:36:21.268774 1874359 ssh_runner.go:362] scp volumesnapshots/rbac-volume-snapshot-controller.yaml --> /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml (3545 bytes)
	I0924 00:36:21.283692 1874359 addons.go:431] installing /etc/kubernetes/addons/rbac-external-provisioner.yaml
	I0924 00:36:21.283765 1874359 ssh_runner.go:362] scp csi-hostpath-driver/rbac/rbac-external-provisioner.yaml --> /etc/kubernetes/addons/rbac-external-provisioner.yaml (4442 bytes)
	I0924 00:36:21.339390 1874359 addons.go:431] installing /etc/kubernetes/addons/ig-clusterrole.yaml
	I0924 00:36:21.339461 1874359 ssh_runner.go:362] scp inspektor-gadget/ig-clusterrole.yaml --> /etc/kubernetes/addons/ig-clusterrole.yaml (1485 bytes)
	I0924 00:36:21.409963 1874359 addons.go:431] installing /etc/kubernetes/addons/yakd-dp.yaml
	I0924 00:36:21.410032 1874359 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/yakd-dp.yaml (2017 bytes)
	I0924 00:36:21.422530 1874359 addons.go:431] installing /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml
	I0924 00:36:21.422600 1874359 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml (1475 bytes)
	I0924 00:36:21.432482 1874359 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
	I0924 00:36:21.435211 1874359 addons.go:431] installing /etc/kubernetes/addons/rbac-external-resizer.yaml
	I0924 00:36:21.435281 1874359 ssh_runner.go:362] scp csi-hostpath-driver/rbac/rbac-external-resizer.yaml --> /etc/kubernetes/addons/rbac-external-resizer.yaml (2943 bytes)
	I0924 00:36:21.490265 1874359 addons.go:431] installing /etc/kubernetes/addons/ig-clusterrolebinding.yaml
	I0924 00:36:21.490340 1874359 ssh_runner.go:362] scp inspektor-gadget/ig-clusterrolebinding.yaml --> /etc/kubernetes/addons/ig-clusterrolebinding.yaml (274 bytes)
	I0924 00:36:21.554034 1874359 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/yakd-ns.yaml -f /etc/kubernetes/addons/yakd-sa.yaml -f /etc/kubernetes/addons/yakd-crb.yaml -f /etc/kubernetes/addons/yakd-svc.yaml -f /etc/kubernetes/addons/yakd-dp.yaml
	I0924 00:36:21.593261 1874359 addons.go:431] installing /etc/kubernetes/addons/ig-crd.yaml
	I0924 00:36:21.593333 1874359 ssh_runner.go:362] scp inspektor-gadget/ig-crd.yaml --> /etc/kubernetes/addons/ig-crd.yaml (5216 bytes)
	I0924 00:36:21.597542 1874359 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml
	I0924 00:36:21.603447 1874359 addons.go:431] installing /etc/kubernetes/addons/rbac-external-snapshotter.yaml
	I0924 00:36:21.603528 1874359 ssh_runner.go:362] scp csi-hostpath-driver/rbac/rbac-external-snapshotter.yaml --> /etc/kubernetes/addons/rbac-external-snapshotter.yaml (3149 bytes)
	I0924 00:36:21.678474 1874359 addons.go:431] installing /etc/kubernetes/addons/csi-hostpath-attacher.yaml
	I0924 00:36:21.678551 1874359 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/csi-hostpath-attacher.yaml (2143 bytes)
	I0924 00:36:21.696404 1874359 addons.go:431] installing /etc/kubernetes/addons/ig-daemonset.yaml
	I0924 00:36:21.696473 1874359 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/ig-daemonset.yaml (7735 bytes)
	I0924 00:36:21.758367 1874359 addons.go:431] installing /etc/kubernetes/addons/csi-hostpath-driverinfo.yaml
	I0924 00:36:21.758441 1874359 ssh_runner.go:362] scp csi-hostpath-driver/deploy/csi-hostpath-driverinfo.yaml --> /etc/kubernetes/addons/csi-hostpath-driverinfo.yaml (1274 bytes)
	I0924 00:36:21.788195 1874359 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/ig-namespace.yaml -f /etc/kubernetes/addons/ig-serviceaccount.yaml -f /etc/kubernetes/addons/ig-role.yaml -f /etc/kubernetes/addons/ig-rolebinding.yaml -f /etc/kubernetes/addons/ig-clusterrole.yaml -f /etc/kubernetes/addons/ig-clusterrolebinding.yaml -f /etc/kubernetes/addons/ig-crd.yaml -f /etc/kubernetes/addons/ig-daemonset.yaml
	I0924 00:36:21.873070 1874359 addons.go:431] installing /etc/kubernetes/addons/csi-hostpath-plugin.yaml
	I0924 00:36:21.873146 1874359 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/csi-hostpath-plugin.yaml (8201 bytes)
	I0924 00:36:21.996889 1874359 addons.go:431] installing /etc/kubernetes/addons/csi-hostpath-resizer.yaml
	I0924 00:36:21.996961 1874359 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/csi-hostpath-resizer.yaml (2191 bytes)
	I0924 00:36:22.083443 1874359 addons.go:431] installing /etc/kubernetes/addons/csi-hostpath-storageclass.yaml
	I0924 00:36:22.083524 1874359 ssh_runner.go:362] scp csi-hostpath-driver/deploy/csi-hostpath-storageclass.yaml --> /etc/kubernetes/addons/csi-hostpath-storageclass.yaml (846 bytes)
	I0924 00:36:22.163316 1874359 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/rbac-external-attacher.yaml -f /etc/kubernetes/addons/rbac-hostpath.yaml -f /etc/kubernetes/addons/rbac-external-health-monitor-controller.yaml -f /etc/kubernetes/addons/rbac-external-provisioner.yaml -f /etc/kubernetes/addons/rbac-external-resizer.yaml -f /etc/kubernetes/addons/rbac-external-snapshotter.yaml -f /etc/kubernetes/addons/csi-hostpath-attacher.yaml -f /etc/kubernetes/addons/csi-hostpath-driverinfo.yaml -f /etc/kubernetes/addons/csi-hostpath-plugin.yaml -f /etc/kubernetes/addons/csi-hostpath-resizer.yaml -f /etc/kubernetes/addons/csi-hostpath-storageclass.yaml
	I0924 00:36:24.144328 1874359 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/deployment.yaml: (3.670827968s)
	I0924 00:36:24.144432 1874359 ssh_runner.go:235] Completed: sudo systemctl start kubelet: (3.506674064s)
	I0924 00:36:24.145321 1874359 node_ready.go:35] waiting up to 6m0s for node "addons-371349" to be "Ready" ...
	I0924 00:36:24.145408 1874359 ssh_runner.go:235] Completed: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.31.1/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml | sed -e '/^        forward . \/etc\/resolv.conf.*/i \        hosts {\n           192.168.49.1 host.minikube.internal\n           fallthrough\n        }' -e '/^        errors *$/i \        log' | sudo /var/lib/minikube/binaries/v1.31.1/kubectl --kubeconfig=/var/lib/minikube/kubeconfig replace -f -": (3.50777396s)
	I0924 00:36:24.145532 1874359 start.go:971] {"host.minikube.internal": 192.168.49.1} host record injected into CoreDNS's ConfigMap
	I0924 00:36:24.715492 1874359 kapi.go:214] "coredns" deployment in "kube-system" namespace and "addons-371349" context rescaled to 1 replicas
	I0924 00:36:25.040041 1874359 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/nvidia-device-plugin.yaml: (4.199991565s)
	I0924 00:36:25.040144 1874359 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/ingress-dns-pod.yaml: (4.177769917s)
	I0924 00:36:25.040203 1874359 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml: (4.283555204s)
	I0924 00:36:26.068634 1874359 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/storage-provisioner-rancher.yaml: (5.167443532s)
	I0924 00:36:26.068893 1874359 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml: (5.136900017s)
	I0924 00:36:26.069063 1874359 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/registry-rc.yaml -f /etc/kubernetes/addons/registry-svc.yaml -f /etc/kubernetes/addons/registry-proxy.yaml: (4.861212104s)
	I0924 00:36:26.069102 1874359 addons.go:475] Verifying addon registry=true in "addons-371349"
	I0924 00:36:26.069312 1874359 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/ingress-deploy.yaml: (5.189916004s)
	I0924 00:36:26.069352 1874359 addons.go:475] Verifying addon ingress=true in "addons-371349"
	I0924 00:36:26.069638 1874359 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: (4.637069932s)
	I0924 00:36:26.069683 1874359 addons.go:475] Verifying addon metrics-server=true in "addons-371349"
	I0924 00:36:26.069746 1874359 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/yakd-ns.yaml -f /etc/kubernetes/addons/yakd-sa.yaml -f /etc/kubernetes/addons/yakd-crb.yaml -f /etc/kubernetes/addons/yakd-svc.yaml -f /etc/kubernetes/addons/yakd-dp.yaml: (4.515634182s)
	I0924 00:36:26.072113 1874359 out.go:177] * Verifying registry addon...
	I0924 00:36:26.072118 1874359 out.go:177] * To access YAKD - Kubernetes Dashboard, wait for Pod to be ready and run the following command:
	
		minikube -p addons-371349 service yakd-dashboard -n yakd-dashboard
	
	I0924 00:36:26.072265 1874359 out.go:177] * Verifying ingress addon...
	I0924 00:36:26.076283 1874359 kapi.go:75] Waiting for pod with label "kubernetes.io/minikube-addons=registry" in ns "kube-system" ...
	I0924 00:36:26.076406 1874359 kapi.go:75] Waiting for pod with label "app.kubernetes.io/name=ingress-nginx" in ns "ingress-nginx" ...
	I0924 00:36:26.107605 1874359 kapi.go:86] Found 1 Pods for label selector kubernetes.io/minikube-addons=registry
	I0924 00:36:26.107672 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:36:26.108621 1874359 kapi.go:86] Found 3 Pods for label selector app.kubernetes.io/name=ingress-nginx
	I0924 00:36:26.108644 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	W0924 00:36:26.113511 1874359 out.go:270] ! Enabling 'default-storageclass' returned an error: running callbacks: [Error making standard the default storage class: Error while marking storage class local-path as non-default: Operation cannot be fulfilled on storageclasses.storage.k8s.io "local-path": the object has been modified; please apply your changes to the latest version and try again]
	I0924 00:36:26.127645 1874359 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml: (4.530014705s)
	W0924 00:36:26.127709 1874359 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml: Process exited with status 1
	stdout:
	customresourcedefinition.apiextensions.k8s.io/volumesnapshotclasses.snapshot.storage.k8s.io created
	customresourcedefinition.apiextensions.k8s.io/volumesnapshotcontents.snapshot.storage.k8s.io created
	customresourcedefinition.apiextensions.k8s.io/volumesnapshots.snapshot.storage.k8s.io created
	serviceaccount/snapshot-controller created
	clusterrole.rbac.authorization.k8s.io/snapshot-controller-runner created
	clusterrolebinding.rbac.authorization.k8s.io/snapshot-controller-role created
	role.rbac.authorization.k8s.io/snapshot-controller-leaderelection created
	rolebinding.rbac.authorization.k8s.io/snapshot-controller-leaderelection created
	deployment.apps/snapshot-controller created
	
	stderr:
	error: resource mapping not found for name: "csi-hostpath-snapclass" namespace: "" from "/etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml": no matches for kind "VolumeSnapshotClass" in version "snapshot.storage.k8s.io/v1"
	ensure CRDs are installed first
	I0924 00:36:26.127734 1874359 retry.go:31] will retry after 162.565614ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml: Process exited with status 1
	stdout:
	customresourcedefinition.apiextensions.k8s.io/volumesnapshotclasses.snapshot.storage.k8s.io created
	customresourcedefinition.apiextensions.k8s.io/volumesnapshotcontents.snapshot.storage.k8s.io created
	customresourcedefinition.apiextensions.k8s.io/volumesnapshots.snapshot.storage.k8s.io created
	serviceaccount/snapshot-controller created
	clusterrole.rbac.authorization.k8s.io/snapshot-controller-runner created
	clusterrolebinding.rbac.authorization.k8s.io/snapshot-controller-role created
	role.rbac.authorization.k8s.io/snapshot-controller-leaderelection created
	rolebinding.rbac.authorization.k8s.io/snapshot-controller-leaderelection created
	deployment.apps/snapshot-controller created
	
	stderr:
	error: resource mapping not found for name: "csi-hostpath-snapclass" namespace: "" from "/etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml": no matches for kind "VolumeSnapshotClass" in version "snapshot.storage.k8s.io/v1"
	ensure CRDs are installed first
	I0924 00:36:26.127833 1874359 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/ig-namespace.yaml -f /etc/kubernetes/addons/ig-serviceaccount.yaml -f /etc/kubernetes/addons/ig-role.yaml -f /etc/kubernetes/addons/ig-rolebinding.yaml -f /etc/kubernetes/addons/ig-clusterrole.yaml -f /etc/kubernetes/addons/ig-clusterrolebinding.yaml -f /etc/kubernetes/addons/ig-crd.yaml -f /etc/kubernetes/addons/ig-daemonset.yaml: (4.339544749s)
	I0924 00:36:26.158098 1874359 node_ready.go:53] node "addons-371349" has status "Ready":"False"
	I0924 00:36:26.290971 1874359 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply --force -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml
	I0924 00:36:26.520771 1874359 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/rbac-external-attacher.yaml -f /etc/kubernetes/addons/rbac-hostpath.yaml -f /etc/kubernetes/addons/rbac-external-health-monitor-controller.yaml -f /etc/kubernetes/addons/rbac-external-provisioner.yaml -f /etc/kubernetes/addons/rbac-external-resizer.yaml -f /etc/kubernetes/addons/rbac-external-snapshotter.yaml -f /etc/kubernetes/addons/csi-hostpath-attacher.yaml -f /etc/kubernetes/addons/csi-hostpath-driverinfo.yaml -f /etc/kubernetes/addons/csi-hostpath-plugin.yaml -f /etc/kubernetes/addons/csi-hostpath-resizer.yaml -f /etc/kubernetes/addons/csi-hostpath-storageclass.yaml: (4.357357384s)
	I0924 00:36:26.520866 1874359 addons.go:475] Verifying addon csi-hostpath-driver=true in "addons-371349"
	I0924 00:36:26.528436 1874359 out.go:177] * Verifying csi-hostpath-driver addon...
	I0924 00:36:26.531914 1874359 kapi.go:75] Waiting for pod with label "kubernetes.io/minikube-addons=csi-hostpath-driver" in ns "kube-system" ...
	I0924 00:36:26.583310 1874359 kapi.go:86] Found 2 Pods for label selector kubernetes.io/minikube-addons=csi-hostpath-driver
	I0924 00:36:26.583384 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:36:26.615522 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:36:26.616914 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:36:27.036117 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:36:27.083005 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:36:27.087587 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:36:27.537002 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:36:27.581061 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:36:27.581936 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:36:28.040270 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:36:28.103999 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:36:28.106903 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:36:28.535961 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:36:28.583290 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:36:28.584302 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:36:28.649628 1874359 node_ready.go:53] node "addons-371349" has status "Ready":"False"
	I0924 00:36:29.129807 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:36:29.142056 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:36:29.142873 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:36:29.421608 1874359 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply --force -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml: (3.130525161s)
	I0924 00:36:29.536654 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:36:29.581589 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:36:29.582881 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:36:30.036664 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:36:30.081849 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:36:30.082302 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:36:30.112100 1874359 ssh_runner.go:362] scp memory --> /var/lib/minikube/google_application_credentials.json (162 bytes)
	I0924 00:36:30.112214 1874359 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-371349
	I0924 00:36:30.142251 1874359 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:34691 SSHKeyPath:/home/jenkins/minikube-integration/19696-1868219/.minikube/machines/addons-371349/id_rsa Username:docker}
	I0924 00:36:30.260045 1874359 ssh_runner.go:362] scp memory --> /var/lib/minikube/google_cloud_project (12 bytes)
	I0924 00:36:30.277969 1874359 addons.go:234] Setting addon gcp-auth=true in "addons-371349"
	I0924 00:36:30.278019 1874359 host.go:66] Checking if "addons-371349" exists ...
	I0924 00:36:30.278556 1874359 cli_runner.go:164] Run: docker container inspect addons-371349 --format={{.State.Status}}
	I0924 00:36:30.315639 1874359 ssh_runner.go:195] Run: cat /var/lib/minikube/google_application_credentials.json
	I0924 00:36:30.315718 1874359 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-371349
	I0924 00:36:30.339988 1874359 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:34691 SSHKeyPath:/home/jenkins/minikube-integration/19696-1868219/.minikube/machines/addons-371349/id_rsa Username:docker}
	I0924 00:36:30.440287 1874359 out.go:177]   - Using image registry.k8s.io/ingress-nginx/kube-webhook-certgen:v1.4.3
	I0924 00:36:30.443290 1874359 out.go:177]   - Using image gcr.io/k8s-minikube/gcp-auth-webhook:v0.1.2
	I0924 00:36:30.446069 1874359 addons.go:431] installing /etc/kubernetes/addons/gcp-auth-ns.yaml
	I0924 00:36:30.446097 1874359 ssh_runner.go:362] scp gcp-auth/gcp-auth-ns.yaml --> /etc/kubernetes/addons/gcp-auth-ns.yaml (700 bytes)
	I0924 00:36:30.465311 1874359 addons.go:431] installing /etc/kubernetes/addons/gcp-auth-service.yaml
	I0924 00:36:30.465336 1874359 ssh_runner.go:362] scp gcp-auth/gcp-auth-service.yaml --> /etc/kubernetes/addons/gcp-auth-service.yaml (788 bytes)
	I0924 00:36:30.486054 1874359 addons.go:431] installing /etc/kubernetes/addons/gcp-auth-webhook.yaml
	I0924 00:36:30.486127 1874359 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/gcp-auth-webhook.yaml (5421 bytes)
	I0924 00:36:30.505251 1874359 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/gcp-auth-ns.yaml -f /etc/kubernetes/addons/gcp-auth-service.yaml -f /etc/kubernetes/addons/gcp-auth-webhook.yaml
	I0924 00:36:30.536649 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:36:30.585185 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:36:30.586030 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:36:31.014868 1874359 addons.go:475] Verifying addon gcp-auth=true in "addons-371349"
	I0924 00:36:31.017554 1874359 out.go:177] * Verifying gcp-auth addon...
	I0924 00:36:31.021050 1874359 kapi.go:75] Waiting for pod with label "kubernetes.io/minikube-addons=gcp-auth" in ns "gcp-auth" ...
	I0924 00:36:31.034140 1874359 kapi.go:86] Found 1 Pods for label selector kubernetes.io/minikube-addons=gcp-auth
	I0924 00:36:31.034176 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:36:31.038331 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:36:31.134014 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:36:31.134925 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:36:31.148888 1874359 node_ready.go:53] node "addons-371349" has status "Ready":"False"
	I0924 00:36:31.524715 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:36:31.537587 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:36:31.583545 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:36:31.584292 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:36:32.029580 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:36:32.036463 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:36:32.079906 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:36:32.080747 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:36:32.525406 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:36:32.536047 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:36:32.581774 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:36:32.585020 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:36:33.025869 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:36:33.039581 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:36:33.080579 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:36:33.081397 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:36:33.149384 1874359 node_ready.go:53] node "addons-371349" has status "Ready":"False"
	I0924 00:36:33.524756 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:36:33.535925 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:36:33.580451 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:36:33.581698 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:36:34.024326 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:36:34.036000 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:36:34.080936 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:36:34.081359 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:36:34.524182 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:36:34.535599 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:36:34.579779 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:36:34.580333 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:36:35.024337 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:36:35.036647 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:36:35.080199 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:36:35.081117 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:36:35.524658 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:36:35.535725 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:36:35.580566 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:36:35.581224 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:36:35.648813 1874359 node_ready.go:53] node "addons-371349" has status "Ready":"False"
	I0924 00:36:36.025916 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:36:36.035978 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:36:36.080821 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:36:36.081603 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:36:36.524896 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:36:36.535453 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:36:36.580252 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:36:36.581485 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:36:37.025338 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:36:37.035963 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:36:37.080424 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:36:37.081442 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:36:37.524490 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:36:37.535728 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:36:37.579810 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:36:37.581450 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:36:38.024561 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:36:38.035487 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:36:38.080210 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:36:38.082742 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:36:38.148994 1874359 node_ready.go:53] node "addons-371349" has status "Ready":"False"
	I0924 00:36:38.525127 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:36:38.535345 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:36:38.580908 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:36:38.581362 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:36:39.024793 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:36:39.036425 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:36:39.080915 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:36:39.081967 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:36:39.525001 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:36:39.535354 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:36:39.580559 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:36:39.581513 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:36:40.024267 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:36:40.035238 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:36:40.080207 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:36:40.080204 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:36:40.149660 1874359 node_ready.go:53] node "addons-371349" has status "Ready":"False"
	I0924 00:36:40.524758 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:36:40.535590 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:36:40.581048 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:36:40.581408 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:36:41.024637 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:36:41.035772 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:36:41.080701 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:36:41.081021 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:36:41.524234 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:36:41.535462 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:36:41.580520 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:36:41.580776 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:36:42.024539 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:36:42.035544 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:36:42.081006 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:36:42.081307 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:36:42.524245 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:36:42.536155 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:36:42.580946 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:36:42.581039 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:36:42.648989 1874359 node_ready.go:53] node "addons-371349" has status "Ready":"False"
	I0924 00:36:43.025024 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:36:43.035416 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:36:43.079956 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:36:43.080806 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:36:43.524635 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:36:43.535313 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:36:43.579628 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:36:43.580591 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:36:44.024154 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:36:44.035337 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:36:44.080930 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:36:44.081486 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:36:44.525015 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:36:44.535108 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:36:44.580734 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:36:44.581548 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:36:45.025561 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:36:45.036042 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:36:45.082616 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:36:45.083677 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:36:45.149247 1874359 node_ready.go:53] node "addons-371349" has status "Ready":"False"
	I0924 00:36:45.525119 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:36:45.535570 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:36:45.581478 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:36:45.581723 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:36:46.024775 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:36:46.035430 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:36:46.080597 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:36:46.081121 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:36:46.524273 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:36:46.535421 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:36:46.580411 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:36:46.581494 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:36:47.024132 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:36:47.035958 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:36:47.079502 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:36:47.080659 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:36:47.524705 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:36:47.535463 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:36:47.579773 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:36:47.580840 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:36:47.648951 1874359 node_ready.go:53] node "addons-371349" has status "Ready":"False"
	I0924 00:36:48.024023 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:36:48.035180 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:36:48.080902 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:36:48.081690 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:36:48.525022 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:36:48.536041 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:36:48.580288 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:36:48.581384 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:36:49.024579 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:36:49.035983 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:36:49.080718 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:36:49.080794 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:36:49.524098 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:36:49.535304 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:36:49.580015 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:36:49.580711 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:36:49.651222 1874359 node_ready.go:53] node "addons-371349" has status "Ready":"False"
	I0924 00:36:50.024822 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:36:50.035661 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:36:50.081077 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:36:50.082067 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:36:50.523919 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:36:50.535086 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:36:50.579884 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:36:50.580617 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:36:51.024943 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:36:51.035906 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:36:51.080734 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:36:51.081047 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:36:51.525622 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:36:51.536144 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:36:51.582237 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:36:51.583744 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:36:52.024267 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:36:52.036157 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:36:52.080111 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:36:52.081119 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:36:52.149795 1874359 node_ready.go:53] node "addons-371349" has status "Ready":"False"
	I0924 00:36:52.524484 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:36:52.535733 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:36:52.580708 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:36:52.581326 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:36:53.024426 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:36:53.035238 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:36:53.081149 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:36:53.081259 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:36:53.523963 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:36:53.535867 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:36:53.580059 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:36:53.581802 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:36:54.024133 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:36:54.035572 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:36:54.081089 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:36:54.081851 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:36:54.524697 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:36:54.535922 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:36:54.580674 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:36:54.582700 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:36:54.648817 1874359 node_ready.go:53] node "addons-371349" has status "Ready":"False"
	I0924 00:36:55.024396 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:36:55.035661 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:36:55.080437 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:36:55.081018 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:36:55.525458 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:36:55.535674 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:36:55.580138 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:36:55.580887 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:36:56.024509 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:36:56.035901 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:36:56.079969 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:36:56.080725 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:36:56.524906 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:36:56.535679 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:36:56.580177 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:36:56.581395 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:36:57.024701 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:36:57.035901 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:36:57.080025 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:36:57.086044 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:36:57.148897 1874359 node_ready.go:53] node "addons-371349" has status "Ready":"False"
	I0924 00:36:57.524749 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:36:57.535483 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:36:57.580740 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:36:57.581056 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:36:58.024670 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:36:58.035904 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:36:58.080311 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:36:58.081007 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:36:58.524825 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:36:58.536045 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:36:58.579614 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:36:58.580465 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:36:59.024996 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:36:59.035397 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:36:59.080751 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:36:59.081451 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:36:59.524791 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:36:59.535925 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:36:59.580042 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:36:59.580800 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:36:59.649115 1874359 node_ready.go:53] node "addons-371349" has status "Ready":"False"
	I0924 00:37:00.042032 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:37:00.047337 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:37:00.083641 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:37:00.088909 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:37:00.524811 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:37:00.535611 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:37:00.581337 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:37:00.581599 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:37:01.024579 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:37:01.035532 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:37:01.080587 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:37:01.080960 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:37:01.524641 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:37:01.535695 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:37:01.580144 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:37:01.581256 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:37:01.649384 1874359 node_ready.go:53] node "addons-371349" has status "Ready":"False"
	I0924 00:37:02.025866 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:37:02.034934 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:37:02.081837 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:37:02.083560 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:37:02.524543 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:37:02.536023 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:37:02.580909 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:37:02.581242 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:37:03.024869 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:37:03.035126 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:37:03.080270 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:37:03.081025 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:37:03.524304 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:37:03.534941 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:37:03.579827 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:37:03.580519 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:37:04.024963 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:37:04.035474 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:37:04.080069 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:37:04.080924 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:37:04.148842 1874359 node_ready.go:53] node "addons-371349" has status "Ready":"False"
	I0924 00:37:04.524509 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:37:04.535251 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:37:04.580524 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:37:04.580751 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:37:05.089907 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:37:05.146256 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:37:05.148938 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:37:05.150236 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:37:05.179538 1874359 node_ready.go:49] node "addons-371349" has status "Ready":"True"
	I0924 00:37:05.179566 1874359 node_ready.go:38] duration metric: took 41.034106017s for node "addons-371349" to be "Ready" ...
	I0924 00:37:05.179588 1874359 pod_ready.go:36] extra waiting up to 6m0s for all system-critical pods including labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
	I0924 00:37:05.207895 1874359 pod_ready.go:79] waiting up to 6m0s for pod "coredns-7c65d6cfc9-bsbwf" in "kube-system" namespace to be "Ready" ...
	I0924 00:37:05.558862 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:37:05.602208 1874359 kapi.go:86] Found 3 Pods for label selector kubernetes.io/minikube-addons=csi-hostpath-driver
	I0924 00:37:05.602281 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:37:05.642597 1874359 kapi.go:86] Found 2 Pods for label selector kubernetes.io/minikube-addons=registry
	I0924 00:37:05.642664 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:37:05.644171 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:37:06.027664 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:37:06.127307 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:37:06.128297 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:37:06.129576 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:37:06.525542 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:37:06.537888 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:37:06.580363 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:37:06.581449 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:37:06.714501 1874359 pod_ready.go:93] pod "coredns-7c65d6cfc9-bsbwf" in "kube-system" namespace has status "Ready":"True"
	I0924 00:37:06.714528 1874359 pod_ready.go:82] duration metric: took 1.506549159s for pod "coredns-7c65d6cfc9-bsbwf" in "kube-system" namespace to be "Ready" ...
	I0924 00:37:06.714551 1874359 pod_ready.go:79] waiting up to 6m0s for pod "etcd-addons-371349" in "kube-system" namespace to be "Ready" ...
	I0924 00:37:06.719528 1874359 pod_ready.go:93] pod "etcd-addons-371349" in "kube-system" namespace has status "Ready":"True"
	I0924 00:37:06.719552 1874359 pod_ready.go:82] duration metric: took 4.992556ms for pod "etcd-addons-371349" in "kube-system" namespace to be "Ready" ...
	I0924 00:37:06.719568 1874359 pod_ready.go:79] waiting up to 6m0s for pod "kube-apiserver-addons-371349" in "kube-system" namespace to be "Ready" ...
	I0924 00:37:06.724493 1874359 pod_ready.go:93] pod "kube-apiserver-addons-371349" in "kube-system" namespace has status "Ready":"True"
	I0924 00:37:06.724526 1874359 pod_ready.go:82] duration metric: took 4.941719ms for pod "kube-apiserver-addons-371349" in "kube-system" namespace to be "Ready" ...
	I0924 00:37:06.724537 1874359 pod_ready.go:79] waiting up to 6m0s for pod "kube-controller-manager-addons-371349" in "kube-system" namespace to be "Ready" ...
	I0924 00:37:06.729495 1874359 pod_ready.go:93] pod "kube-controller-manager-addons-371349" in "kube-system" namespace has status "Ready":"True"
	I0924 00:37:06.729522 1874359 pod_ready.go:82] duration metric: took 4.976417ms for pod "kube-controller-manager-addons-371349" in "kube-system" namespace to be "Ready" ...
	I0924 00:37:06.729536 1874359 pod_ready.go:79] waiting up to 6m0s for pod "kube-proxy-qcb9f" in "kube-system" namespace to be "Ready" ...
	I0924 00:37:06.749711 1874359 pod_ready.go:93] pod "kube-proxy-qcb9f" in "kube-system" namespace has status "Ready":"True"
	I0924 00:37:06.749739 1874359 pod_ready.go:82] duration metric: took 20.168473ms for pod "kube-proxy-qcb9f" in "kube-system" namespace to be "Ready" ...
	I0924 00:37:06.749753 1874359 pod_ready.go:79] waiting up to 6m0s for pod "kube-scheduler-addons-371349" in "kube-system" namespace to be "Ready" ...
	I0924 00:37:07.025711 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:37:07.038223 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:37:07.081942 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:37:07.087767 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:37:07.149444 1874359 pod_ready.go:93] pod "kube-scheduler-addons-371349" in "kube-system" namespace has status "Ready":"True"
	I0924 00:37:07.149478 1874359 pod_ready.go:82] duration metric: took 399.67927ms for pod "kube-scheduler-addons-371349" in "kube-system" namespace to be "Ready" ...
	I0924 00:37:07.149493 1874359 pod_ready.go:79] waiting up to 6m0s for pod "metrics-server-84c5f94fbc-wxd2s" in "kube-system" namespace to be "Ready" ...
	I0924 00:37:07.527967 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:37:07.537140 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:37:07.581804 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:37:07.589930 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:37:08.024515 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:37:08.037935 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:37:08.080943 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:37:08.082144 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:37:08.526095 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:37:08.627092 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:37:08.628004 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:37:08.629352 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:37:09.025639 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:37:09.037030 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:37:09.080958 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:37:09.082245 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:37:09.156164 1874359 pod_ready.go:103] pod "metrics-server-84c5f94fbc-wxd2s" in "kube-system" namespace has status "Ready":"False"
	I0924 00:37:09.525206 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:37:09.536652 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:37:09.580423 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:37:09.581569 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:37:10.024542 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:37:10.036488 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:37:10.083141 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:37:10.083751 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:37:10.525674 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:37:10.539556 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:37:10.581513 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:37:10.582166 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:37:11.025092 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:37:11.037039 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:37:11.080754 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:37:11.082596 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:37:11.529972 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:37:11.542182 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:37:11.627456 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:37:11.628865 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:37:11.659076 1874359 pod_ready.go:103] pod "metrics-server-84c5f94fbc-wxd2s" in "kube-system" namespace has status "Ready":"False"
	I0924 00:37:12.024999 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:37:12.036841 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:37:12.083120 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:37:12.087612 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:37:12.524562 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:37:12.537338 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:37:12.580705 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:37:12.584105 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:37:13.025189 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:37:13.037496 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:37:13.087190 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:37:13.089015 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:37:13.525150 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:37:13.538733 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:37:13.584085 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:37:13.585380 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:37:14.027157 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:37:14.037065 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:37:14.084801 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:37:14.085746 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:37:14.157004 1874359 pod_ready.go:103] pod "metrics-server-84c5f94fbc-wxd2s" in "kube-system" namespace has status "Ready":"False"
	I0924 00:37:14.525171 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:37:14.536194 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:37:14.626376 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:37:14.627039 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:37:15.024978 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:37:15.037209 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:37:15.090958 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:37:15.091024 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:37:15.525306 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:37:15.538434 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:37:15.585043 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:37:15.587617 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:37:16.025459 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:37:16.037260 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:37:16.126894 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:37:16.130568 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:37:16.158943 1874359 pod_ready.go:103] pod "metrics-server-84c5f94fbc-wxd2s" in "kube-system" namespace has status "Ready":"False"
	I0924 00:37:16.525066 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:37:16.536819 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:37:16.582319 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:37:16.584728 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:37:17.024258 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:37:17.036828 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:37:17.080446 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:37:17.080931 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:37:17.525099 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:37:17.536245 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:37:17.580612 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:37:17.581968 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:37:18.025910 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:37:18.038077 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:37:18.080436 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:37:18.083296 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:37:18.527808 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:37:18.537402 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:37:18.630293 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:37:18.631606 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:37:18.659678 1874359 pod_ready.go:103] pod "metrics-server-84c5f94fbc-wxd2s" in "kube-system" namespace has status "Ready":"False"
	I0924 00:37:19.024917 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:37:19.037952 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:37:19.080673 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:37:19.082011 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:37:19.526385 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:37:19.537535 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:37:19.582985 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:37:19.583884 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:37:20.025520 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:37:20.037056 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:37:20.082107 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:37:20.083379 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:37:20.533110 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:37:20.536253 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:37:20.580380 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:37:20.581682 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:37:21.025861 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:37:21.036666 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:37:21.081257 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:37:21.082276 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:37:21.155291 1874359 pod_ready.go:103] pod "metrics-server-84c5f94fbc-wxd2s" in "kube-system" namespace has status "Ready":"False"
	I0924 00:37:21.525011 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:37:21.536910 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:37:21.580560 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:37:21.581558 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:37:22.024754 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:37:22.045868 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:37:22.081285 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:37:22.092291 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:37:22.524880 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:37:22.536206 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:37:22.582528 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:37:22.583540 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:37:23.024908 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:37:23.038687 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:37:23.083594 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:37:23.087148 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:37:23.166572 1874359 pod_ready.go:103] pod "metrics-server-84c5f94fbc-wxd2s" in "kube-system" namespace has status "Ready":"False"
	I0924 00:37:23.525800 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:37:23.538193 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:37:23.583530 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:37:23.585180 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:37:24.025641 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:37:24.037958 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:37:24.086952 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:37:24.091709 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:37:24.529436 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:37:24.539653 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:37:24.582335 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:37:24.583840 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:37:25.025439 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:37:25.038394 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:37:25.081750 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:37:25.092141 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:37:25.526868 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:37:25.538477 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:37:25.588303 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:37:25.589649 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:37:25.658759 1874359 pod_ready.go:103] pod "metrics-server-84c5f94fbc-wxd2s" in "kube-system" namespace has status "Ready":"False"
	I0924 00:37:26.028966 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:37:26.039906 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:37:26.085009 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:37:26.086281 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:37:26.525400 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:37:26.537986 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:37:26.582372 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:37:26.583325 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:37:27.024598 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:37:27.036494 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:37:27.082090 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:37:27.083243 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:37:27.526087 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:37:27.536693 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:37:27.585781 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:37:27.587193 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:37:28.024899 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:37:28.037156 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:37:28.084220 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:37:28.086472 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:37:28.155018 1874359 pod_ready.go:103] pod "metrics-server-84c5f94fbc-wxd2s" in "kube-system" namespace has status "Ready":"False"
	I0924 00:37:28.525481 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:37:28.537283 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:37:28.581429 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:37:28.582651 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:37:29.028915 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:37:29.041859 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:37:29.083052 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:37:29.084536 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:37:29.524326 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:37:29.538851 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:37:29.580454 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:37:29.581371 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:37:30.025742 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:37:30.040126 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:37:30.088822 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:37:30.089975 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:37:30.169449 1874359 pod_ready.go:103] pod "metrics-server-84c5f94fbc-wxd2s" in "kube-system" namespace has status "Ready":"False"
	I0924 00:37:30.525768 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:37:30.542144 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:37:30.582292 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:37:30.583557 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:37:31.025479 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:37:31.037617 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:37:31.086866 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:37:31.088089 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:37:31.524826 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:37:31.536697 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:37:31.581167 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:37:31.582168 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:37:32.024816 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:37:32.037176 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:37:32.082087 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:37:32.082530 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:37:32.525146 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:37:32.536628 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:37:32.582408 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:37:32.584925 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:37:32.655890 1874359 pod_ready.go:103] pod "metrics-server-84c5f94fbc-wxd2s" in "kube-system" namespace has status "Ready":"False"
	I0924 00:37:33.024977 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:37:33.044508 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:37:33.082373 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:37:33.088346 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:37:33.526214 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:37:33.540746 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:37:33.583760 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:37:33.585189 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:37:34.025056 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:37:34.037589 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:37:34.082589 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:37:34.086961 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:37:34.525641 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:37:34.537798 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:37:34.584630 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:37:34.586996 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:37:34.659691 1874359 pod_ready.go:103] pod "metrics-server-84c5f94fbc-wxd2s" in "kube-system" namespace has status "Ready":"False"
	I0924 00:37:35.025955 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:37:35.037530 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:37:35.085784 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:37:35.088173 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:37:35.526354 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:37:35.538479 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:37:35.591723 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:37:35.592824 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:37:36.025497 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:37:36.037602 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:37:36.083224 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:37:36.087183 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:37:36.529702 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:37:36.538066 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:37:36.581116 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:37:36.582309 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:37:37.025278 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:37:37.037273 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:37:37.081162 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:37:37.082133 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:37:37.155957 1874359 pod_ready.go:103] pod "metrics-server-84c5f94fbc-wxd2s" in "kube-system" namespace has status "Ready":"False"
	I0924 00:37:37.524751 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:37:37.537323 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:37:37.581677 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:37:37.582621 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:37:38.024821 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:37:38.037096 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:37:38.081199 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:37:38.082023 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:37:38.524480 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:37:38.536790 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:37:38.581212 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:37:38.581536 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:37:39.045544 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:37:39.059204 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:37:39.082025 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:37:39.085281 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:37:39.157501 1874359 pod_ready.go:103] pod "metrics-server-84c5f94fbc-wxd2s" in "kube-system" namespace has status "Ready":"False"
	I0924 00:37:39.525548 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:37:39.537916 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:37:39.581805 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:37:39.583375 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:37:40.026572 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:37:40.040843 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:37:40.082291 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:37:40.083067 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:37:40.524989 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:37:40.537105 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:37:40.585930 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:37:40.587514 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:37:41.029782 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:37:41.037748 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:37:41.090908 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:37:41.099541 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:37:41.525223 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:37:41.537455 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:37:41.597760 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:37:41.598335 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:37:41.656910 1874359 pod_ready.go:103] pod "metrics-server-84c5f94fbc-wxd2s" in "kube-system" namespace has status "Ready":"False"
	I0924 00:37:42.024504 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:37:42.037336 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:37:42.081180 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:37:42.082250 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:37:42.525242 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:37:42.537114 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:37:42.581394 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:37:42.582401 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:37:43.025428 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:37:43.036674 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:37:43.080101 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:37:43.081322 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:37:43.524449 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:37:43.536809 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:37:43.580565 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:37:43.581555 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:37:43.657385 1874359 pod_ready.go:103] pod "metrics-server-84c5f94fbc-wxd2s" in "kube-system" namespace has status "Ready":"False"
	I0924 00:37:44.025083 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:37:44.036712 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:37:44.081458 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:37:44.082346 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:37:44.525241 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:37:44.537777 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:37:44.583018 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:37:44.583564 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:37:45.026665 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:37:45.039492 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:37:45.084260 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:37:45.089405 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:37:45.525091 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:37:45.537406 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:37:45.580479 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:37:45.581943 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:37:46.025973 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:37:46.036622 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:37:46.081671 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:37:46.082347 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:37:46.156709 1874359 pod_ready.go:103] pod "metrics-server-84c5f94fbc-wxd2s" in "kube-system" namespace has status "Ready":"False"
	I0924 00:37:46.525927 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:37:46.537762 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:37:46.582385 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:37:46.585178 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:37:47.024474 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:37:47.036329 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:37:47.127012 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:37:47.127911 1874359 kapi.go:107] duration metric: took 1m21.05162918s to wait for kubernetes.io/minikube-addons=registry ...
	I0924 00:37:47.525100 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:37:47.536497 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:37:47.581247 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:37:48.026371 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:37:48.038903 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:37:48.081959 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:37:48.163263 1874359 pod_ready.go:103] pod "metrics-server-84c5f94fbc-wxd2s" in "kube-system" namespace has status "Ready":"False"
	I0924 00:37:48.525594 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:37:48.537361 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:37:48.580855 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:37:49.026110 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:37:49.036648 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:37:49.083100 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:37:49.526547 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:37:49.537074 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:37:49.581783 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:37:50.025551 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:37:50.037461 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:37:50.091209 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:37:50.526125 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:37:50.538037 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:37:50.581389 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:37:50.656358 1874359 pod_ready.go:103] pod "metrics-server-84c5f94fbc-wxd2s" in "kube-system" namespace has status "Ready":"False"
	I0924 00:37:51.024559 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:37:51.036562 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:37:51.126796 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:37:51.525215 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:37:51.539279 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:37:51.580966 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:37:52.024488 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:37:52.036345 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:37:52.081028 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:37:52.525396 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:37:52.536020 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:37:52.582181 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:37:53.024883 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:37:53.037277 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:37:53.081315 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:37:53.157617 1874359 pod_ready.go:103] pod "metrics-server-84c5f94fbc-wxd2s" in "kube-system" namespace has status "Ready":"False"
	I0924 00:37:53.531462 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:37:53.551300 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:37:53.581174 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:37:54.035236 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:37:54.038756 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:37:54.081353 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:37:54.525628 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:37:54.537870 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:37:54.582071 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:37:55.024989 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:37:55.037361 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:37:55.082676 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:37:55.159960 1874359 pod_ready.go:103] pod "metrics-server-84c5f94fbc-wxd2s" in "kube-system" namespace has status "Ready":"False"
	I0924 00:37:55.524909 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:37:55.536796 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:37:55.588343 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:37:56.024551 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:37:56.036790 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:37:56.082494 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:37:56.524588 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:37:56.537087 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:37:56.580954 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:37:57.024654 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:37:57.038690 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:37:57.126095 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:37:57.524362 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:37:57.537019 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:37:57.580612 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:37:57.655571 1874359 pod_ready.go:103] pod "metrics-server-84c5f94fbc-wxd2s" in "kube-system" namespace has status "Ready":"False"
	I0924 00:37:58.024601 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:37:58.037441 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:37:58.081534 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:37:58.526040 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:37:58.538585 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:37:58.581369 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:37:59.025374 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:37:59.038033 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:37:59.081690 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:37:59.525152 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:37:59.536805 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:37:59.581719 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:38:00.037589 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:38:00.053908 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:38:00.099069 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:38:00.161051 1874359 pod_ready.go:103] pod "metrics-server-84c5f94fbc-wxd2s" in "kube-system" namespace has status "Ready":"False"
	I0924 00:38:00.525439 1874359 kapi.go:107] duration metric: took 1m29.504386686s to wait for kubernetes.io/minikube-addons=gcp-auth ...
	I0924 00:38:00.527071 1874359 out.go:177] * Your GCP credentials will now be mounted into every pod created in the addons-371349 cluster.
	I0924 00:38:00.528190 1874359 out.go:177] * If you don't want your credentials mounted into a specific pod, add a label with the `gcp-auth-skip-secret` key to your pod configuration.
	I0924 00:38:00.529186 1874359 out.go:177] * If you want existing pods to be mounted with credentials, either recreate them or rerun addons enable with --refresh.
	I0924 00:38:00.536173 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:38:00.582001 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:38:01.037731 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:38:01.081278 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:38:01.540282 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:38:01.581606 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:38:02.038254 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:38:02.086067 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:38:02.537116 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:38:02.580626 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:38:02.655706 1874359 pod_ready.go:103] pod "metrics-server-84c5f94fbc-wxd2s" in "kube-system" namespace has status "Ready":"False"
	I0924 00:38:03.038020 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:38:03.094972 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:38:03.541262 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:38:03.581455 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:38:04.038649 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:38:04.092757 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:38:04.537238 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:38:04.581087 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:38:04.655863 1874359 pod_ready.go:103] pod "metrics-server-84c5f94fbc-wxd2s" in "kube-system" namespace has status "Ready":"False"
	I0924 00:38:05.036406 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:38:05.081030 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:38:05.537884 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:38:05.639562 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:38:06.037479 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:38:06.081362 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:38:06.537654 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:38:06.598408 1874359 kapi.go:107] duration metric: took 1m40.522007667s to wait for app.kubernetes.io/name=ingress-nginx ...
	I0924 00:38:07.036544 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:38:07.157639 1874359 pod_ready.go:103] pod "metrics-server-84c5f94fbc-wxd2s" in "kube-system" namespace has status "Ready":"False"
	I0924 00:38:07.537205 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:38:08.037211 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:38:08.537454 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:38:09.036723 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:38:09.536459 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:38:09.660906 1874359 pod_ready.go:103] pod "metrics-server-84c5f94fbc-wxd2s" in "kube-system" namespace has status "Ready":"False"
	I0924 00:38:10.036444 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:38:10.540294 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:38:11.037220 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:38:11.536773 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:38:12.041688 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:38:12.155984 1874359 pod_ready.go:103] pod "metrics-server-84c5f94fbc-wxd2s" in "kube-system" namespace has status "Ready":"False"
	I0924 00:38:12.537422 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:38:13.036723 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:38:13.537634 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:38:14.037440 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:38:14.156344 1874359 pod_ready.go:103] pod "metrics-server-84c5f94fbc-wxd2s" in "kube-system" namespace has status "Ready":"False"
	I0924 00:38:14.537047 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:38:15.038133 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:38:15.536566 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:38:16.037248 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:38:16.156676 1874359 pod_ready.go:103] pod "metrics-server-84c5f94fbc-wxd2s" in "kube-system" namespace has status "Ready":"False"
	I0924 00:38:16.543569 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:38:17.037895 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:38:17.537063 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:38:18.038305 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:38:18.157313 1874359 pod_ready.go:103] pod "metrics-server-84c5f94fbc-wxd2s" in "kube-system" namespace has status "Ready":"False"
	I0924 00:38:18.537792 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:38:19.036928 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:38:19.537390 1874359 kapi.go:107] duration metric: took 1m53.005474628s to wait for kubernetes.io/minikube-addons=csi-hostpath-driver ...
	I0924 00:38:19.539097 1874359 out.go:177] * Enabled addons: cloud-spanner, nvidia-device-plugin, ingress-dns, storage-provisioner, metrics-server, yakd, storage-provisioner-rancher, inspektor-gadget, volumesnapshots, registry, gcp-auth, ingress, csi-hostpath-driver
	I0924 00:38:19.540466 1874359 addons.go:510] duration metric: took 1m59.627204899s for enable addons: enabled=[cloud-spanner nvidia-device-plugin ingress-dns storage-provisioner metrics-server yakd storage-provisioner-rancher inspektor-gadget volumesnapshots registry gcp-auth ingress csi-hostpath-driver]
	I0924 00:38:20.656506 1874359 pod_ready.go:103] pod "metrics-server-84c5f94fbc-wxd2s" in "kube-system" namespace has status "Ready":"False"
	I0924 00:38:23.155679 1874359 pod_ready.go:103] pod "metrics-server-84c5f94fbc-wxd2s" in "kube-system" namespace has status "Ready":"False"
	I0924 00:38:25.156435 1874359 pod_ready.go:103] pod "metrics-server-84c5f94fbc-wxd2s" in "kube-system" namespace has status "Ready":"False"
	I0924 00:38:27.656305 1874359 pod_ready.go:103] pod "metrics-server-84c5f94fbc-wxd2s" in "kube-system" namespace has status "Ready":"False"
	I0924 00:38:30.155444 1874359 pod_ready.go:103] pod "metrics-server-84c5f94fbc-wxd2s" in "kube-system" namespace has status "Ready":"False"
	I0924 00:38:32.155689 1874359 pod_ready.go:103] pod "metrics-server-84c5f94fbc-wxd2s" in "kube-system" namespace has status "Ready":"False"
	I0924 00:38:34.655805 1874359 pod_ready.go:103] pod "metrics-server-84c5f94fbc-wxd2s" in "kube-system" namespace has status "Ready":"False"
	I0924 00:38:37.156103 1874359 pod_ready.go:103] pod "metrics-server-84c5f94fbc-wxd2s" in "kube-system" namespace has status "Ready":"False"
	I0924 00:38:39.655725 1874359 pod_ready.go:103] pod "metrics-server-84c5f94fbc-wxd2s" in "kube-system" namespace has status "Ready":"False"
	I0924 00:38:42.156282 1874359 pod_ready.go:103] pod "metrics-server-84c5f94fbc-wxd2s" in "kube-system" namespace has status "Ready":"False"
	I0924 00:38:44.655229 1874359 pod_ready.go:103] pod "metrics-server-84c5f94fbc-wxd2s" in "kube-system" namespace has status "Ready":"False"
	I0924 00:38:45.655782 1874359 pod_ready.go:93] pod "metrics-server-84c5f94fbc-wxd2s" in "kube-system" namespace has status "Ready":"True"
	I0924 00:38:45.655810 1874359 pod_ready.go:82] duration metric: took 1m38.506308998s for pod "metrics-server-84c5f94fbc-wxd2s" in "kube-system" namespace to be "Ready" ...
	I0924 00:38:45.655822 1874359 pod_ready.go:79] waiting up to 6m0s for pod "nvidia-device-plugin-daemonset-t52r5" in "kube-system" namespace to be "Ready" ...
	I0924 00:38:45.661703 1874359 pod_ready.go:93] pod "nvidia-device-plugin-daemonset-t52r5" in "kube-system" namespace has status "Ready":"True"
	I0924 00:38:45.661731 1874359 pod_ready.go:82] duration metric: took 5.900916ms for pod "nvidia-device-plugin-daemonset-t52r5" in "kube-system" namespace to be "Ready" ...
	I0924 00:38:45.661752 1874359 pod_ready.go:39] duration metric: took 1m40.482149573s for extra waiting for all system-critical and pods with labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
	I0924 00:38:45.661768 1874359 api_server.go:52] waiting for apiserver process to appear ...
	I0924 00:38:45.661798 1874359 cri.go:54] listing CRI containers in root : {State:all Name:kube-apiserver Namespaces:[]}
	I0924 00:38:45.661888 1874359 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
	I0924 00:38:45.708292 1874359 cri.go:89] found id: "749045c42da2d61080a3969428ab514fa4047e831ebb9439b8511e518e9b1c04"
	I0924 00:38:45.708314 1874359 cri.go:89] found id: ""
	I0924 00:38:45.708322 1874359 logs.go:276] 1 containers: [749045c42da2d61080a3969428ab514fa4047e831ebb9439b8511e518e9b1c04]
	I0924 00:38:45.708376 1874359 ssh_runner.go:195] Run: which crictl
	I0924 00:38:45.711784 1874359 cri.go:54] listing CRI containers in root : {State:all Name:etcd Namespaces:[]}
	I0924 00:38:45.711857 1874359 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
	I0924 00:38:45.750924 1874359 cri.go:89] found id: "40d8a21a9712f40f598893c1aba5670ff43d964a7b5d9463400bf4a64836edb2"
	I0924 00:38:45.750947 1874359 cri.go:89] found id: ""
	I0924 00:38:45.750955 1874359 logs.go:276] 1 containers: [40d8a21a9712f40f598893c1aba5670ff43d964a7b5d9463400bf4a64836edb2]
	I0924 00:38:45.751013 1874359 ssh_runner.go:195] Run: which crictl
	I0924 00:38:45.754635 1874359 cri.go:54] listing CRI containers in root : {State:all Name:coredns Namespaces:[]}
	I0924 00:38:45.754709 1874359 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
	I0924 00:38:45.793731 1874359 cri.go:89] found id: "07152f00c7b5566d20be0e478631432f898e24fefada16283e2ca7028b046c61"
	I0924 00:38:45.793754 1874359 cri.go:89] found id: ""
	I0924 00:38:45.793763 1874359 logs.go:276] 1 containers: [07152f00c7b5566d20be0e478631432f898e24fefada16283e2ca7028b046c61]
	I0924 00:38:45.793857 1874359 ssh_runner.go:195] Run: which crictl
	I0924 00:38:45.797215 1874359 cri.go:54] listing CRI containers in root : {State:all Name:kube-scheduler Namespaces:[]}
	I0924 00:38:45.797286 1874359 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
	I0924 00:38:45.835387 1874359 cri.go:89] found id: "278db6b1284e1f1d66e55b827b5a4b51ea66ac4b399cfb13b724520fb0071730"
	I0924 00:38:45.835411 1874359 cri.go:89] found id: ""
	I0924 00:38:45.835420 1874359 logs.go:276] 1 containers: [278db6b1284e1f1d66e55b827b5a4b51ea66ac4b399cfb13b724520fb0071730]
	I0924 00:38:45.835481 1874359 ssh_runner.go:195] Run: which crictl
	I0924 00:38:45.838906 1874359 cri.go:54] listing CRI containers in root : {State:all Name:kube-proxy Namespaces:[]}
	I0924 00:38:45.838976 1874359 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
	I0924 00:38:45.877355 1874359 cri.go:89] found id: "8f2c47f2d8dc25f068087f5d0e702e1768f8714f22c484f1ebe13e92be684997"
	I0924 00:38:45.877377 1874359 cri.go:89] found id: ""
	I0924 00:38:45.877385 1874359 logs.go:276] 1 containers: [8f2c47f2d8dc25f068087f5d0e702e1768f8714f22c484f1ebe13e92be684997]
	I0924 00:38:45.877441 1874359 ssh_runner.go:195] Run: which crictl
	I0924 00:38:45.880750 1874359 cri.go:54] listing CRI containers in root : {State:all Name:kube-controller-manager Namespaces:[]}
	I0924 00:38:45.880823 1874359 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
	I0924 00:38:45.917541 1874359 cri.go:89] found id: "340d83c4a515af013d7e2f2cb8dd72a56a11c8be46e63481fd282573f250be80"
	I0924 00:38:45.917564 1874359 cri.go:89] found id: ""
	I0924 00:38:45.917572 1874359 logs.go:276] 1 containers: [340d83c4a515af013d7e2f2cb8dd72a56a11c8be46e63481fd282573f250be80]
	I0924 00:38:45.917629 1874359 ssh_runner.go:195] Run: which crictl
	I0924 00:38:45.921074 1874359 cri.go:54] listing CRI containers in root : {State:all Name:kindnet Namespaces:[]}
	I0924 00:38:45.921143 1874359 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet
	I0924 00:38:45.958520 1874359 cri.go:89] found id: "7adace27f5bf6fd0d07f44c3b2d9c4b94d8130080a2626aadc5ab73681d376ef"
	I0924 00:38:45.958543 1874359 cri.go:89] found id: ""
	I0924 00:38:45.958551 1874359 logs.go:276] 1 containers: [7adace27f5bf6fd0d07f44c3b2d9c4b94d8130080a2626aadc5ab73681d376ef]
	I0924 00:38:45.958605 1874359 ssh_runner.go:195] Run: which crictl
	I0924 00:38:45.962293 1874359 logs.go:123] Gathering logs for etcd [40d8a21a9712f40f598893c1aba5670ff43d964a7b5d9463400bf4a64836edb2] ...
	I0924 00:38:45.962324 1874359 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 40d8a21a9712f40f598893c1aba5670ff43d964a7b5d9463400bf4a64836edb2"
	I0924 00:38:46.013293 1874359 logs.go:123] Gathering logs for coredns [07152f00c7b5566d20be0e478631432f898e24fefada16283e2ca7028b046c61] ...
	I0924 00:38:46.013323 1874359 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 07152f00c7b5566d20be0e478631432f898e24fefada16283e2ca7028b046c61"
	I0924 00:38:46.057115 1874359 logs.go:123] Gathering logs for kube-controller-manager [340d83c4a515af013d7e2f2cb8dd72a56a11c8be46e63481fd282573f250be80] ...
	I0924 00:38:46.057145 1874359 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 340d83c4a515af013d7e2f2cb8dd72a56a11c8be46e63481fd282573f250be80"
	I0924 00:38:46.144145 1874359 logs.go:123] Gathering logs for container status ...
	I0924 00:38:46.144184 1874359 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
	I0924 00:38:46.191233 1874359 logs.go:123] Gathering logs for kubelet ...
	I0924 00:38:46.191266 1874359 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
	W0924 00:38:46.229555 1874359 logs.go:138] Found kubelet problem: Sep 24 00:37:05 addons-371349 kubelet[1485]: W0924 00:37:05.058504    1485 reflector.go:561] object-"yakd-dashboard"/"kube-root-ca.crt": failed to list *v1.ConfigMap: configmaps "kube-root-ca.crt" is forbidden: User "system:node:addons-371349" cannot list resource "configmaps" in API group "" in the namespace "yakd-dashboard": no relationship found between node 'addons-371349' and this object
	W0924 00:38:46.229828 1874359 logs.go:138] Found kubelet problem: Sep 24 00:37:05 addons-371349 kubelet[1485]: E0924 00:37:05.058554    1485 reflector.go:158] "Unhandled Error" err="object-\"yakd-dashboard\"/\"kube-root-ca.crt\": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps \"kube-root-ca.crt\" is forbidden: User \"system:node:addons-371349\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"yakd-dashboard\": no relationship found between node 'addons-371349' and this object" logger="UnhandledError"
	W0924 00:38:46.230013 1874359 logs.go:138] Found kubelet problem: Sep 24 00:37:05 addons-371349 kubelet[1485]: W0924 00:37:05.100500    1485 reflector.go:561] object-"default"/"kube-root-ca.crt": failed to list *v1.ConfigMap: configmaps "kube-root-ca.crt" is forbidden: User "system:node:addons-371349" cannot list resource "configmaps" in API group "" in the namespace "default": no relationship found between node 'addons-371349' and this object
	W0924 00:38:46.230237 1874359 logs.go:138] Found kubelet problem: Sep 24 00:37:05 addons-371349 kubelet[1485]: E0924 00:37:05.100553    1485 reflector.go:158] "Unhandled Error" err="object-\"default\"/\"kube-root-ca.crt\": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps \"kube-root-ca.crt\" is forbidden: User \"system:node:addons-371349\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"default\": no relationship found between node 'addons-371349' and this object" logger="UnhandledError"
	W0924 00:38:46.230404 1874359 logs.go:138] Found kubelet problem: Sep 24 00:37:05 addons-371349 kubelet[1485]: W0924 00:37:05.100721    1485 reflector.go:561] object-"default"/"gcp-auth": failed to list *v1.Secret: secrets "gcp-auth" is forbidden: User "system:node:addons-371349" cannot list resource "secrets" in API group "" in the namespace "default": no relationship found between node 'addons-371349' and this object
	W0924 00:38:46.230609 1874359 logs.go:138] Found kubelet problem: Sep 24 00:37:05 addons-371349 kubelet[1485]: E0924 00:37:05.100750    1485 reflector.go:158] "Unhandled Error" err="object-\"default\"/\"gcp-auth\": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets \"gcp-auth\" is forbidden: User \"system:node:addons-371349\" cannot list resource \"secrets\" in API group \"\" in the namespace \"default\": no relationship found between node 'addons-371349' and this object" logger="UnhandledError"
	I0924 00:38:46.279179 1874359 logs.go:123] Gathering logs for describe nodes ...
	I0924 00:38:46.279214 1874359 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.31.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
	I0924 00:38:46.468252 1874359 logs.go:123] Gathering logs for kube-scheduler [278db6b1284e1f1d66e55b827b5a4b51ea66ac4b399cfb13b724520fb0071730] ...
	I0924 00:38:46.468289 1874359 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 278db6b1284e1f1d66e55b827b5a4b51ea66ac4b399cfb13b724520fb0071730"
	I0924 00:38:46.523886 1874359 logs.go:123] Gathering logs for kube-proxy [8f2c47f2d8dc25f068087f5d0e702e1768f8714f22c484f1ebe13e92be684997] ...
	I0924 00:38:46.523926 1874359 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 8f2c47f2d8dc25f068087f5d0e702e1768f8714f22c484f1ebe13e92be684997"
	I0924 00:38:46.569726 1874359 logs.go:123] Gathering logs for kindnet [7adace27f5bf6fd0d07f44c3b2d9c4b94d8130080a2626aadc5ab73681d376ef] ...
	I0924 00:38:46.569753 1874359 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 7adace27f5bf6fd0d07f44c3b2d9c4b94d8130080a2626aadc5ab73681d376ef"
	I0924 00:38:46.611343 1874359 logs.go:123] Gathering logs for CRI-O ...
	I0924 00:38:46.611376 1874359 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u crio -n 400"
	I0924 00:38:46.706100 1874359 logs.go:123] Gathering logs for dmesg ...
	I0924 00:38:46.706137 1874359 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
	I0924 00:38:46.722442 1874359 logs.go:123] Gathering logs for kube-apiserver [749045c42da2d61080a3969428ab514fa4047e831ebb9439b8511e518e9b1c04] ...
	I0924 00:38:46.722467 1874359 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 749045c42da2d61080a3969428ab514fa4047e831ebb9439b8511e518e9b1c04"
	I0924 00:38:46.793783 1874359 out.go:358] Setting ErrFile to fd 2...
	I0924 00:38:46.793901 1874359 out.go:392] TERM=,COLORTERM=, which probably does not support color
	W0924 00:38:46.793963 1874359 out.go:270] X Problems detected in kubelet:
	W0924 00:38:46.793979 1874359 out.go:270]   Sep 24 00:37:05 addons-371349 kubelet[1485]: E0924 00:37:05.058554    1485 reflector.go:158] "Unhandled Error" err="object-\"yakd-dashboard\"/\"kube-root-ca.crt\": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps \"kube-root-ca.crt\" is forbidden: User \"system:node:addons-371349\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"yakd-dashboard\": no relationship found between node 'addons-371349' and this object" logger="UnhandledError"
	W0924 00:38:46.793987 1874359 out.go:270]   Sep 24 00:37:05 addons-371349 kubelet[1485]: W0924 00:37:05.100500    1485 reflector.go:561] object-"default"/"kube-root-ca.crt": failed to list *v1.ConfigMap: configmaps "kube-root-ca.crt" is forbidden: User "system:node:addons-371349" cannot list resource "configmaps" in API group "" in the namespace "default": no relationship found between node 'addons-371349' and this object
	W0924 00:38:46.793999 1874359 out.go:270]   Sep 24 00:37:05 addons-371349 kubelet[1485]: E0924 00:37:05.100553    1485 reflector.go:158] "Unhandled Error" err="object-\"default\"/\"kube-root-ca.crt\": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps \"kube-root-ca.crt\" is forbidden: User \"system:node:addons-371349\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"default\": no relationship found between node 'addons-371349' and this object" logger="UnhandledError"
	W0924 00:38:46.794010 1874359 out.go:270]   Sep 24 00:37:05 addons-371349 kubelet[1485]: W0924 00:37:05.100721    1485 reflector.go:561] object-"default"/"gcp-auth": failed to list *v1.Secret: secrets "gcp-auth" is forbidden: User "system:node:addons-371349" cannot list resource "secrets" in API group "" in the namespace "default": no relationship found between node 'addons-371349' and this object
	W0924 00:38:46.794017 1874359 out.go:270]   Sep 24 00:37:05 addons-371349 kubelet[1485]: E0924 00:37:05.100750    1485 reflector.go:158] "Unhandled Error" err="object-\"default\"/\"gcp-auth\": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets \"gcp-auth\" is forbidden: User \"system:node:addons-371349\" cannot list resource \"secrets\" in API group \"\" in the namespace \"default\": no relationship found between node 'addons-371349' and this object" logger="UnhandledError"
	I0924 00:38:46.794029 1874359 out.go:358] Setting ErrFile to fd 2...
	I0924 00:38:46.794035 1874359 out.go:392] TERM=,COLORTERM=, which probably does not support color
	I0924 00:38:56.795250 1874359 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0924 00:38:56.809250 1874359 api_server.go:72] duration metric: took 2m36.8963927s to wait for apiserver process to appear ...
	I0924 00:38:56.809275 1874359 api_server.go:88] waiting for apiserver healthz status ...
	I0924 00:38:56.809311 1874359 cri.go:54] listing CRI containers in root : {State:all Name:kube-apiserver Namespaces:[]}
	I0924 00:38:56.809373 1874359 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
	I0924 00:38:56.849168 1874359 cri.go:89] found id: "749045c42da2d61080a3969428ab514fa4047e831ebb9439b8511e518e9b1c04"
	I0924 00:38:56.849197 1874359 cri.go:89] found id: ""
	I0924 00:38:56.849206 1874359 logs.go:276] 1 containers: [749045c42da2d61080a3969428ab514fa4047e831ebb9439b8511e518e9b1c04]
	I0924 00:38:56.849261 1874359 ssh_runner.go:195] Run: which crictl
	I0924 00:38:56.852661 1874359 cri.go:54] listing CRI containers in root : {State:all Name:etcd Namespaces:[]}
	I0924 00:38:56.852739 1874359 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
	I0924 00:38:56.895086 1874359 cri.go:89] found id: "40d8a21a9712f40f598893c1aba5670ff43d964a7b5d9463400bf4a64836edb2"
	I0924 00:38:56.895108 1874359 cri.go:89] found id: ""
	I0924 00:38:56.895115 1874359 logs.go:276] 1 containers: [40d8a21a9712f40f598893c1aba5670ff43d964a7b5d9463400bf4a64836edb2]
	I0924 00:38:56.895169 1874359 ssh_runner.go:195] Run: which crictl
	I0924 00:38:56.898822 1874359 cri.go:54] listing CRI containers in root : {State:all Name:coredns Namespaces:[]}
	I0924 00:38:56.898895 1874359 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
	I0924 00:38:56.940638 1874359 cri.go:89] found id: "07152f00c7b5566d20be0e478631432f898e24fefada16283e2ca7028b046c61"
	I0924 00:38:56.940659 1874359 cri.go:89] found id: ""
	I0924 00:38:56.940667 1874359 logs.go:276] 1 containers: [07152f00c7b5566d20be0e478631432f898e24fefada16283e2ca7028b046c61]
	I0924 00:38:56.940720 1874359 ssh_runner.go:195] Run: which crictl
	I0924 00:38:56.944215 1874359 cri.go:54] listing CRI containers in root : {State:all Name:kube-scheduler Namespaces:[]}
	I0924 00:38:56.944370 1874359 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
	I0924 00:38:56.988209 1874359 cri.go:89] found id: "278db6b1284e1f1d66e55b827b5a4b51ea66ac4b399cfb13b724520fb0071730"
	I0924 00:38:56.988232 1874359 cri.go:89] found id: ""
	I0924 00:38:56.988241 1874359 logs.go:276] 1 containers: [278db6b1284e1f1d66e55b827b5a4b51ea66ac4b399cfb13b724520fb0071730]
	I0924 00:38:56.988295 1874359 ssh_runner.go:195] Run: which crictl
	I0924 00:38:56.991784 1874359 cri.go:54] listing CRI containers in root : {State:all Name:kube-proxy Namespaces:[]}
	I0924 00:38:56.991861 1874359 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
	I0924 00:38:57.039062 1874359 cri.go:89] found id: "8f2c47f2d8dc25f068087f5d0e702e1768f8714f22c484f1ebe13e92be684997"
	I0924 00:38:57.039087 1874359 cri.go:89] found id: ""
	I0924 00:38:57.039095 1874359 logs.go:276] 1 containers: [8f2c47f2d8dc25f068087f5d0e702e1768f8714f22c484f1ebe13e92be684997]
	I0924 00:38:57.039153 1874359 ssh_runner.go:195] Run: which crictl
	I0924 00:38:57.042617 1874359 cri.go:54] listing CRI containers in root : {State:all Name:kube-controller-manager Namespaces:[]}
	I0924 00:38:57.042691 1874359 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
	I0924 00:38:57.086283 1874359 cri.go:89] found id: "340d83c4a515af013d7e2f2cb8dd72a56a11c8be46e63481fd282573f250be80"
	I0924 00:38:57.086310 1874359 cri.go:89] found id: ""
	I0924 00:38:57.086319 1874359 logs.go:276] 1 containers: [340d83c4a515af013d7e2f2cb8dd72a56a11c8be46e63481fd282573f250be80]
	I0924 00:38:57.086375 1874359 ssh_runner.go:195] Run: which crictl
	I0924 00:38:57.091139 1874359 cri.go:54] listing CRI containers in root : {State:all Name:kindnet Namespaces:[]}
	I0924 00:38:57.091208 1874359 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet
	I0924 00:38:57.133231 1874359 cri.go:89] found id: "7adace27f5bf6fd0d07f44c3b2d9c4b94d8130080a2626aadc5ab73681d376ef"
	I0924 00:38:57.133301 1874359 cri.go:89] found id: ""
	I0924 00:38:57.133324 1874359 logs.go:276] 1 containers: [7adace27f5bf6fd0d07f44c3b2d9c4b94d8130080a2626aadc5ab73681d376ef]
	I0924 00:38:57.133409 1874359 ssh_runner.go:195] Run: which crictl
	I0924 00:38:57.137358 1874359 logs.go:123] Gathering logs for coredns [07152f00c7b5566d20be0e478631432f898e24fefada16283e2ca7028b046c61] ...
	I0924 00:38:57.137387 1874359 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 07152f00c7b5566d20be0e478631432f898e24fefada16283e2ca7028b046c61"
	I0924 00:38:57.187200 1874359 logs.go:123] Gathering logs for kube-controller-manager [340d83c4a515af013d7e2f2cb8dd72a56a11c8be46e63481fd282573f250be80] ...
	I0924 00:38:57.187234 1874359 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 340d83c4a515af013d7e2f2cb8dd72a56a11c8be46e63481fd282573f250be80"
	I0924 00:38:57.263005 1874359 logs.go:123] Gathering logs for container status ...
	I0924 00:38:57.263144 1874359 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
	I0924 00:38:57.318534 1874359 logs.go:123] Gathering logs for etcd [40d8a21a9712f40f598893c1aba5670ff43d964a7b5d9463400bf4a64836edb2] ...
	I0924 00:38:57.318564 1874359 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 40d8a21a9712f40f598893c1aba5670ff43d964a7b5d9463400bf4a64836edb2"
	I0924 00:38:57.371144 1874359 logs.go:123] Gathering logs for dmesg ...
	I0924 00:38:57.371179 1874359 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
	I0924 00:38:57.388648 1874359 logs.go:123] Gathering logs for describe nodes ...
	I0924 00:38:57.388675 1874359 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.31.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
	I0924 00:38:57.530037 1874359 logs.go:123] Gathering logs for kube-apiserver [749045c42da2d61080a3969428ab514fa4047e831ebb9439b8511e518e9b1c04] ...
	I0924 00:38:57.530067 1874359 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 749045c42da2d61080a3969428ab514fa4047e831ebb9439b8511e518e9b1c04"
	I0924 00:38:57.604473 1874359 logs.go:123] Gathering logs for kube-scheduler [278db6b1284e1f1d66e55b827b5a4b51ea66ac4b399cfb13b724520fb0071730] ...
	I0924 00:38:57.604506 1874359 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 278db6b1284e1f1d66e55b827b5a4b51ea66ac4b399cfb13b724520fb0071730"
	I0924 00:38:57.657911 1874359 logs.go:123] Gathering logs for kube-proxy [8f2c47f2d8dc25f068087f5d0e702e1768f8714f22c484f1ebe13e92be684997] ...
	I0924 00:38:57.657944 1874359 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 8f2c47f2d8dc25f068087f5d0e702e1768f8714f22c484f1ebe13e92be684997"
	I0924 00:38:57.696154 1874359 logs.go:123] Gathering logs for kindnet [7adace27f5bf6fd0d07f44c3b2d9c4b94d8130080a2626aadc5ab73681d376ef] ...
	I0924 00:38:57.696187 1874359 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 7adace27f5bf6fd0d07f44c3b2d9c4b94d8130080a2626aadc5ab73681d376ef"
	I0924 00:38:57.740436 1874359 logs.go:123] Gathering logs for CRI-O ...
	I0924 00:38:57.740465 1874359 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u crio -n 400"
	I0924 00:38:57.839529 1874359 logs.go:123] Gathering logs for kubelet ...
	I0924 00:38:57.839566 1874359 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
	W0924 00:38:57.877455 1874359 logs.go:138] Found kubelet problem: Sep 24 00:37:05 addons-371349 kubelet[1485]: W0924 00:37:05.058504    1485 reflector.go:561] object-"yakd-dashboard"/"kube-root-ca.crt": failed to list *v1.ConfigMap: configmaps "kube-root-ca.crt" is forbidden: User "system:node:addons-371349" cannot list resource "configmaps" in API group "" in the namespace "yakd-dashboard": no relationship found between node 'addons-371349' and this object
	W0924 00:38:57.877724 1874359 logs.go:138] Found kubelet problem: Sep 24 00:37:05 addons-371349 kubelet[1485]: E0924 00:37:05.058554    1485 reflector.go:158] "Unhandled Error" err="object-\"yakd-dashboard\"/\"kube-root-ca.crt\": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps \"kube-root-ca.crt\" is forbidden: User \"system:node:addons-371349\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"yakd-dashboard\": no relationship found between node 'addons-371349' and this object" logger="UnhandledError"
	W0924 00:38:57.877937 1874359 logs.go:138] Found kubelet problem: Sep 24 00:37:05 addons-371349 kubelet[1485]: W0924 00:37:05.100500    1485 reflector.go:561] object-"default"/"kube-root-ca.crt": failed to list *v1.ConfigMap: configmaps "kube-root-ca.crt" is forbidden: User "system:node:addons-371349" cannot list resource "configmaps" in API group "" in the namespace "default": no relationship found between node 'addons-371349' and this object
	W0924 00:38:57.878161 1874359 logs.go:138] Found kubelet problem: Sep 24 00:37:05 addons-371349 kubelet[1485]: E0924 00:37:05.100553    1485 reflector.go:158] "Unhandled Error" err="object-\"default\"/\"kube-root-ca.crt\": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps \"kube-root-ca.crt\" is forbidden: User \"system:node:addons-371349\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"default\": no relationship found between node 'addons-371349' and this object" logger="UnhandledError"
	W0924 00:38:57.878327 1874359 logs.go:138] Found kubelet problem: Sep 24 00:37:05 addons-371349 kubelet[1485]: W0924 00:37:05.100721    1485 reflector.go:561] object-"default"/"gcp-auth": failed to list *v1.Secret: secrets "gcp-auth" is forbidden: User "system:node:addons-371349" cannot list resource "secrets" in API group "" in the namespace "default": no relationship found between node 'addons-371349' and this object
	W0924 00:38:57.878533 1874359 logs.go:138] Found kubelet problem: Sep 24 00:37:05 addons-371349 kubelet[1485]: E0924 00:37:05.100750    1485 reflector.go:158] "Unhandled Error" err="object-\"default\"/\"gcp-auth\": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets \"gcp-auth\" is forbidden: User \"system:node:addons-371349\" cannot list resource \"secrets\" in API group \"\" in the namespace \"default\": no relationship found between node 'addons-371349' and this object" logger="UnhandledError"
	I0924 00:38:57.928653 1874359 out.go:358] Setting ErrFile to fd 2...
	I0924 00:38:57.928681 1874359 out.go:392] TERM=,COLORTERM=, which probably does not support color
	W0924 00:38:57.928737 1874359 out.go:270] X Problems detected in kubelet:
	W0924 00:38:57.928749 1874359 out.go:270]   Sep 24 00:37:05 addons-371349 kubelet[1485]: E0924 00:37:05.058554    1485 reflector.go:158] "Unhandled Error" err="object-\"yakd-dashboard\"/\"kube-root-ca.crt\": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps \"kube-root-ca.crt\" is forbidden: User \"system:node:addons-371349\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"yakd-dashboard\": no relationship found between node 'addons-371349' and this object" logger="UnhandledError"
	W0924 00:38:57.928756 1874359 out.go:270]   Sep 24 00:37:05 addons-371349 kubelet[1485]: W0924 00:37:05.100500    1485 reflector.go:561] object-"default"/"kube-root-ca.crt": failed to list *v1.ConfigMap: configmaps "kube-root-ca.crt" is forbidden: User "system:node:addons-371349" cannot list resource "configmaps" in API group "" in the namespace "default": no relationship found between node 'addons-371349' and this object
	W0924 00:38:57.928771 1874359 out.go:270]   Sep 24 00:37:05 addons-371349 kubelet[1485]: E0924 00:37:05.100553    1485 reflector.go:158] "Unhandled Error" err="object-\"default\"/\"kube-root-ca.crt\": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps \"kube-root-ca.crt\" is forbidden: User \"system:node:addons-371349\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"default\": no relationship found between node 'addons-371349' and this object" logger="UnhandledError"
	W0924 00:38:57.928781 1874359 out.go:270]   Sep 24 00:37:05 addons-371349 kubelet[1485]: W0924 00:37:05.100721    1485 reflector.go:561] object-"default"/"gcp-auth": failed to list *v1.Secret: secrets "gcp-auth" is forbidden: User "system:node:addons-371349" cannot list resource "secrets" in API group "" in the namespace "default": no relationship found between node 'addons-371349' and this object
	W0924 00:38:57.928786 1874359 out.go:270]   Sep 24 00:37:05 addons-371349 kubelet[1485]: E0924 00:37:05.100750    1485 reflector.go:158] "Unhandled Error" err="object-\"default\"/\"gcp-auth\": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets \"gcp-auth\" is forbidden: User \"system:node:addons-371349\" cannot list resource \"secrets\" in API group \"\" in the namespace \"default\": no relationship found between node 'addons-371349' and this object" logger="UnhandledError"
	I0924 00:38:57.928792 1874359 out.go:358] Setting ErrFile to fd 2...
	I0924 00:38:57.928797 1874359 out.go:392] TERM=,COLORTERM=, which probably does not support color
	I0924 00:39:07.930415 1874359 api_server.go:253] Checking apiserver healthz at https://192.168.49.2:8443/healthz ...
	I0924 00:39:07.937955 1874359 api_server.go:279] https://192.168.49.2:8443/healthz returned 200:
	ok
	I0924 00:39:07.938936 1874359 api_server.go:141] control plane version: v1.31.1
	I0924 00:39:07.938963 1874359 api_server.go:131] duration metric: took 11.129680462s to wait for apiserver health ...
	I0924 00:39:07.939008 1874359 system_pods.go:43] waiting for kube-system pods to appear ...
	I0924 00:39:07.939036 1874359 cri.go:54] listing CRI containers in root : {State:all Name:kube-apiserver Namespaces:[]}
	I0924 00:39:07.939099 1874359 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
	I0924 00:39:07.980230 1874359 cri.go:89] found id: "749045c42da2d61080a3969428ab514fa4047e831ebb9439b8511e518e9b1c04"
	I0924 00:39:07.980253 1874359 cri.go:89] found id: ""
	I0924 00:39:07.980261 1874359 logs.go:276] 1 containers: [749045c42da2d61080a3969428ab514fa4047e831ebb9439b8511e518e9b1c04]
	I0924 00:39:07.980315 1874359 ssh_runner.go:195] Run: which crictl
	I0924 00:39:07.983665 1874359 cri.go:54] listing CRI containers in root : {State:all Name:etcd Namespaces:[]}
	I0924 00:39:07.983734 1874359 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
	I0924 00:39:08.026928 1874359 cri.go:89] found id: "40d8a21a9712f40f598893c1aba5670ff43d964a7b5d9463400bf4a64836edb2"
	I0924 00:39:08.026955 1874359 cri.go:89] found id: ""
	I0924 00:39:08.026963 1874359 logs.go:276] 1 containers: [40d8a21a9712f40f598893c1aba5670ff43d964a7b5d9463400bf4a64836edb2]
	I0924 00:39:08.027024 1874359 ssh_runner.go:195] Run: which crictl
	I0924 00:39:08.030930 1874359 cri.go:54] listing CRI containers in root : {State:all Name:coredns Namespaces:[]}
	I0924 00:39:08.031008 1874359 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
	I0924 00:39:08.080344 1874359 cri.go:89] found id: "07152f00c7b5566d20be0e478631432f898e24fefada16283e2ca7028b046c61"
	I0924 00:39:08.080368 1874359 cri.go:89] found id: ""
	I0924 00:39:08.080377 1874359 logs.go:276] 1 containers: [07152f00c7b5566d20be0e478631432f898e24fefada16283e2ca7028b046c61]
	I0924 00:39:08.080439 1874359 ssh_runner.go:195] Run: which crictl
	I0924 00:39:08.087899 1874359 cri.go:54] listing CRI containers in root : {State:all Name:kube-scheduler Namespaces:[]}
	I0924 00:39:08.087974 1874359 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
	I0924 00:39:08.129013 1874359 cri.go:89] found id: "278db6b1284e1f1d66e55b827b5a4b51ea66ac4b399cfb13b724520fb0071730"
	I0924 00:39:08.129035 1874359 cri.go:89] found id: ""
	I0924 00:39:08.129042 1874359 logs.go:276] 1 containers: [278db6b1284e1f1d66e55b827b5a4b51ea66ac4b399cfb13b724520fb0071730]
	I0924 00:39:08.129098 1874359 ssh_runner.go:195] Run: which crictl
	I0924 00:39:08.133170 1874359 cri.go:54] listing CRI containers in root : {State:all Name:kube-proxy Namespaces:[]}
	I0924 00:39:08.133245 1874359 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
	I0924 00:39:08.170625 1874359 cri.go:89] found id: "8f2c47f2d8dc25f068087f5d0e702e1768f8714f22c484f1ebe13e92be684997"
	I0924 00:39:08.170647 1874359 cri.go:89] found id: ""
	I0924 00:39:08.170655 1874359 logs.go:276] 1 containers: [8f2c47f2d8dc25f068087f5d0e702e1768f8714f22c484f1ebe13e92be684997]
	I0924 00:39:08.170709 1874359 ssh_runner.go:195] Run: which crictl
	I0924 00:39:08.174051 1874359 cri.go:54] listing CRI containers in root : {State:all Name:kube-controller-manager Namespaces:[]}
	I0924 00:39:08.174119 1874359 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
	I0924 00:39:08.211609 1874359 cri.go:89] found id: "340d83c4a515af013d7e2f2cb8dd72a56a11c8be46e63481fd282573f250be80"
	I0924 00:39:08.211634 1874359 cri.go:89] found id: ""
	I0924 00:39:08.211642 1874359 logs.go:276] 1 containers: [340d83c4a515af013d7e2f2cb8dd72a56a11c8be46e63481fd282573f250be80]
	I0924 00:39:08.211717 1874359 ssh_runner.go:195] Run: which crictl
	I0924 00:39:08.215082 1874359 cri.go:54] listing CRI containers in root : {State:all Name:kindnet Namespaces:[]}
	I0924 00:39:08.215154 1874359 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet
	I0924 00:39:08.254829 1874359 cri.go:89] found id: "7adace27f5bf6fd0d07f44c3b2d9c4b94d8130080a2626aadc5ab73681d376ef"
	I0924 00:39:08.254856 1874359 cri.go:89] found id: ""
	I0924 00:39:08.254865 1874359 logs.go:276] 1 containers: [7adace27f5bf6fd0d07f44c3b2d9c4b94d8130080a2626aadc5ab73681d376ef]
	I0924 00:39:08.254943 1874359 ssh_runner.go:195] Run: which crictl
	I0924 00:39:08.258637 1874359 logs.go:123] Gathering logs for dmesg ...
	I0924 00:39:08.258663 1874359 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
	I0924 00:39:08.275195 1874359 logs.go:123] Gathering logs for describe nodes ...
	I0924 00:39:08.275221 1874359 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.31.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
	I0924 00:39:08.415558 1874359 logs.go:123] Gathering logs for kube-apiserver [749045c42da2d61080a3969428ab514fa4047e831ebb9439b8511e518e9b1c04] ...
	I0924 00:39:08.415587 1874359 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 749045c42da2d61080a3969428ab514fa4047e831ebb9439b8511e518e9b1c04"
	I0924 00:39:08.489572 1874359 logs.go:123] Gathering logs for kube-controller-manager [340d83c4a515af013d7e2f2cb8dd72a56a11c8be46e63481fd282573f250be80] ...
	I0924 00:39:08.489606 1874359 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 340d83c4a515af013d7e2f2cb8dd72a56a11c8be46e63481fd282573f250be80"
	I0924 00:39:08.578827 1874359 logs.go:123] Gathering logs for kindnet [7adace27f5bf6fd0d07f44c3b2d9c4b94d8130080a2626aadc5ab73681d376ef] ...
	I0924 00:39:08.578861 1874359 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 7adace27f5bf6fd0d07f44c3b2d9c4b94d8130080a2626aadc5ab73681d376ef"
	I0924 00:39:08.617163 1874359 logs.go:123] Gathering logs for CRI-O ...
	I0924 00:39:08.617194 1874359 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u crio -n 400"
	I0924 00:39:08.713202 1874359 logs.go:123] Gathering logs for kubelet ...
	I0924 00:39:08.713240 1874359 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
	W0924 00:39:08.755826 1874359 logs.go:138] Found kubelet problem: Sep 24 00:37:05 addons-371349 kubelet[1485]: W0924 00:37:05.058504    1485 reflector.go:561] object-"yakd-dashboard"/"kube-root-ca.crt": failed to list *v1.ConfigMap: configmaps "kube-root-ca.crt" is forbidden: User "system:node:addons-371349" cannot list resource "configmaps" in API group "" in the namespace "yakd-dashboard": no relationship found between node 'addons-371349' and this object
	W0924 00:39:08.756100 1874359 logs.go:138] Found kubelet problem: Sep 24 00:37:05 addons-371349 kubelet[1485]: E0924 00:37:05.058554    1485 reflector.go:158] "Unhandled Error" err="object-\"yakd-dashboard\"/\"kube-root-ca.crt\": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps \"kube-root-ca.crt\" is forbidden: User \"system:node:addons-371349\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"yakd-dashboard\": no relationship found between node 'addons-371349' and this object" logger="UnhandledError"
	W0924 00:39:08.756284 1874359 logs.go:138] Found kubelet problem: Sep 24 00:37:05 addons-371349 kubelet[1485]: W0924 00:37:05.100500    1485 reflector.go:561] object-"default"/"kube-root-ca.crt": failed to list *v1.ConfigMap: configmaps "kube-root-ca.crt" is forbidden: User "system:node:addons-371349" cannot list resource "configmaps" in API group "" in the namespace "default": no relationship found between node 'addons-371349' and this object
	W0924 00:39:08.756508 1874359 logs.go:138] Found kubelet problem: Sep 24 00:37:05 addons-371349 kubelet[1485]: E0924 00:37:05.100553    1485 reflector.go:158] "Unhandled Error" err="object-\"default\"/\"kube-root-ca.crt\": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps \"kube-root-ca.crt\" is forbidden: User \"system:node:addons-371349\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"default\": no relationship found between node 'addons-371349' and this object" logger="UnhandledError"
	W0924 00:39:08.756709 1874359 logs.go:138] Found kubelet problem: Sep 24 00:37:05 addons-371349 kubelet[1485]: W0924 00:37:05.100721    1485 reflector.go:561] object-"default"/"gcp-auth": failed to list *v1.Secret: secrets "gcp-auth" is forbidden: User "system:node:addons-371349" cannot list resource "secrets" in API group "" in the namespace "default": no relationship found between node 'addons-371349' and this object
	W0924 00:39:08.756918 1874359 logs.go:138] Found kubelet problem: Sep 24 00:37:05 addons-371349 kubelet[1485]: E0924 00:37:05.100750    1485 reflector.go:158] "Unhandled Error" err="object-\"default\"/\"gcp-auth\": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets \"gcp-auth\" is forbidden: User \"system:node:addons-371349\" cannot list resource \"secrets\" in API group \"\" in the namespace \"default\": no relationship found between node 'addons-371349' and this object" logger="UnhandledError"
	I0924 00:39:08.808148 1874359 logs.go:123] Gathering logs for etcd [40d8a21a9712f40f598893c1aba5670ff43d964a7b5d9463400bf4a64836edb2] ...
	I0924 00:39:08.808187 1874359 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 40d8a21a9712f40f598893c1aba5670ff43d964a7b5d9463400bf4a64836edb2"
	I0924 00:39:08.862714 1874359 logs.go:123] Gathering logs for coredns [07152f00c7b5566d20be0e478631432f898e24fefada16283e2ca7028b046c61] ...
	I0924 00:39:08.862758 1874359 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 07152f00c7b5566d20be0e478631432f898e24fefada16283e2ca7028b046c61"
	I0924 00:39:08.909116 1874359 logs.go:123] Gathering logs for kube-scheduler [278db6b1284e1f1d66e55b827b5a4b51ea66ac4b399cfb13b724520fb0071730] ...
	I0924 00:39:08.909154 1874359 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 278db6b1284e1f1d66e55b827b5a4b51ea66ac4b399cfb13b724520fb0071730"
	I0924 00:39:08.956136 1874359 logs.go:123] Gathering logs for kube-proxy [8f2c47f2d8dc25f068087f5d0e702e1768f8714f22c484f1ebe13e92be684997] ...
	I0924 00:39:08.956168 1874359 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 8f2c47f2d8dc25f068087f5d0e702e1768f8714f22c484f1ebe13e92be684997"
	I0924 00:39:08.992426 1874359 logs.go:123] Gathering logs for container status ...
	I0924 00:39:08.992455 1874359 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
	I0924 00:39:09.049468 1874359 out.go:358] Setting ErrFile to fd 2...
	I0924 00:39:09.049502 1874359 out.go:392] TERM=,COLORTERM=, which probably does not support color
	W0924 00:39:09.049568 1874359 out.go:270] X Problems detected in kubelet:
	W0924 00:39:09.049591 1874359 out.go:270]   Sep 24 00:37:05 addons-371349 kubelet[1485]: E0924 00:37:05.058554    1485 reflector.go:158] "Unhandled Error" err="object-\"yakd-dashboard\"/\"kube-root-ca.crt\": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps \"kube-root-ca.crt\" is forbidden: User \"system:node:addons-371349\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"yakd-dashboard\": no relationship found between node 'addons-371349' and this object" logger="UnhandledError"
	W0924 00:39:09.049606 1874359 out.go:270]   Sep 24 00:37:05 addons-371349 kubelet[1485]: W0924 00:37:05.100500    1485 reflector.go:561] object-"default"/"kube-root-ca.crt": failed to list *v1.ConfigMap: configmaps "kube-root-ca.crt" is forbidden: User "system:node:addons-371349" cannot list resource "configmaps" in API group "" in the namespace "default": no relationship found between node 'addons-371349' and this object
	W0924 00:39:09.049625 1874359 out.go:270]   Sep 24 00:37:05 addons-371349 kubelet[1485]: E0924 00:37:05.100553    1485 reflector.go:158] "Unhandled Error" err="object-\"default\"/\"kube-root-ca.crt\": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps \"kube-root-ca.crt\" is forbidden: User \"system:node:addons-371349\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"default\": no relationship found between node 'addons-371349' and this object" logger="UnhandledError"
	W0924 00:39:09.049633 1874359 out.go:270]   Sep 24 00:37:05 addons-371349 kubelet[1485]: W0924 00:37:05.100721    1485 reflector.go:561] object-"default"/"gcp-auth": failed to list *v1.Secret: secrets "gcp-auth" is forbidden: User "system:node:addons-371349" cannot list resource "secrets" in API group "" in the namespace "default": no relationship found between node 'addons-371349' and this object
	W0924 00:39:09.049643 1874359 out.go:270]   Sep 24 00:37:05 addons-371349 kubelet[1485]: E0924 00:37:05.100750    1485 reflector.go:158] "Unhandled Error" err="object-\"default\"/\"gcp-auth\": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets \"gcp-auth\" is forbidden: User \"system:node:addons-371349\" cannot list resource \"secrets\" in API group \"\" in the namespace \"default\": no relationship found between node 'addons-371349' and this object" logger="UnhandledError"
	I0924 00:39:09.049650 1874359 out.go:358] Setting ErrFile to fd 2...
	I0924 00:39:09.049661 1874359 out.go:392] TERM=,COLORTERM=, which probably does not support color
	I0924 00:39:19.063102 1874359 system_pods.go:59] 18 kube-system pods found
	I0924 00:39:19.063145 1874359 system_pods.go:61] "coredns-7c65d6cfc9-bsbwf" [a2c84f3b-bbc2-4ab5-85a2-5ff72508507b] Running
	I0924 00:39:19.063153 1874359 system_pods.go:61] "csi-hostpath-attacher-0" [c760f7fc-01e4-476e-8f71-c2907c20ea88] Running
	I0924 00:39:19.063157 1874359 system_pods.go:61] "csi-hostpath-resizer-0" [b318fac7-c7d5-418f-9f16-8e4991ea9f29] Running
	I0924 00:39:19.063163 1874359 system_pods.go:61] "csi-hostpathplugin-rg84v" [99420363-d35f-4aef-8752-cd70a8687aca] Running
	I0924 00:39:19.063168 1874359 system_pods.go:61] "etcd-addons-371349" [0db6f1c9-6b22-4e0f-bd38-64d6f64a5f2b] Running
	I0924 00:39:19.063173 1874359 system_pods.go:61] "kindnet-c2v8q" [d7d499b8-6318-4999-8666-172b227c9eb9] Running
	I0924 00:39:19.063178 1874359 system_pods.go:61] "kube-apiserver-addons-371349" [57643502-89d7-4cb0-9a99-b11046416306] Running
	I0924 00:39:19.063183 1874359 system_pods.go:61] "kube-controller-manager-addons-371349" [a223fefc-7277-4cb1-8373-e7751bc87f10] Running
	I0924 00:39:19.063195 1874359 system_pods.go:61] "kube-ingress-dns-minikube" [4c89d0f9-906f-451c-807f-4b809f2d3f54] Running
	I0924 00:39:19.063199 1874359 system_pods.go:61] "kube-proxy-qcb9f" [69abd079-88b6-4b9f-831c-e871d95d4464] Running
	I0924 00:39:19.063204 1874359 system_pods.go:61] "kube-scheduler-addons-371349" [ae310285-de23-4f27-8f12-35713956d260] Running
	I0924 00:39:19.063212 1874359 system_pods.go:61] "metrics-server-84c5f94fbc-wxd2s" [7c5e5bee-e3dc-43a0-a7b2-e1afa3197ce6] Running
	I0924 00:39:19.063216 1874359 system_pods.go:61] "nvidia-device-plugin-daemonset-t52r5" [6ee689eb-216e-49b6-b98b-04c4a8a2a717] Running
	I0924 00:39:19.063223 1874359 system_pods.go:61] "registry-66c9cd494c-vx6hr" [2d03a897-de38-4010-b9d3-7e455400c58d] Running
	I0924 00:39:19.063227 1874359 system_pods.go:61] "registry-proxy-9jrvf" [1cea29a0-a418-43ce-8a72-6439715dfdb4] Running
	I0924 00:39:19.063231 1874359 system_pods.go:61] "snapshot-controller-56fcc65765-trtb4" [71554140-ea26-4c02-8605-9e5a7a72c935] Running
	I0924 00:39:19.063236 1874359 system_pods.go:61] "snapshot-controller-56fcc65765-vprd4" [9bf3685a-c093-4efd-9385-9e2cd6ab2d77] Running
	I0924 00:39:19.063245 1874359 system_pods.go:61] "storage-provisioner" [3f9e83c7-275e-48af-b839-10cd00b637ad] Running
	I0924 00:39:19.063251 1874359 system_pods.go:74] duration metric: took 11.124230598s to wait for pod list to return data ...
	I0924 00:39:19.063263 1874359 default_sa.go:34] waiting for default service account to be created ...
	I0924 00:39:19.066150 1874359 default_sa.go:45] found service account: "default"
	I0924 00:39:19.066183 1874359 default_sa.go:55] duration metric: took 2.913765ms for default service account to be created ...
	I0924 00:39:19.066194 1874359 system_pods.go:116] waiting for k8s-apps to be running ...
	I0924 00:39:19.076136 1874359 system_pods.go:86] 18 kube-system pods found
	I0924 00:39:19.076174 1874359 system_pods.go:89] "coredns-7c65d6cfc9-bsbwf" [a2c84f3b-bbc2-4ab5-85a2-5ff72508507b] Running
	I0924 00:39:19.076182 1874359 system_pods.go:89] "csi-hostpath-attacher-0" [c760f7fc-01e4-476e-8f71-c2907c20ea88] Running
	I0924 00:39:19.076187 1874359 system_pods.go:89] "csi-hostpath-resizer-0" [b318fac7-c7d5-418f-9f16-8e4991ea9f29] Running
	I0924 00:39:19.076191 1874359 system_pods.go:89] "csi-hostpathplugin-rg84v" [99420363-d35f-4aef-8752-cd70a8687aca] Running
	I0924 00:39:19.076196 1874359 system_pods.go:89] "etcd-addons-371349" [0db6f1c9-6b22-4e0f-bd38-64d6f64a5f2b] Running
	I0924 00:39:19.076201 1874359 system_pods.go:89] "kindnet-c2v8q" [d7d499b8-6318-4999-8666-172b227c9eb9] Running
	I0924 00:39:19.076206 1874359 system_pods.go:89] "kube-apiserver-addons-371349" [57643502-89d7-4cb0-9a99-b11046416306] Running
	I0924 00:39:19.076211 1874359 system_pods.go:89] "kube-controller-manager-addons-371349" [a223fefc-7277-4cb1-8373-e7751bc87f10] Running
	I0924 00:39:19.076223 1874359 system_pods.go:89] "kube-ingress-dns-minikube" [4c89d0f9-906f-451c-807f-4b809f2d3f54] Running
	I0924 00:39:19.076227 1874359 system_pods.go:89] "kube-proxy-qcb9f" [69abd079-88b6-4b9f-831c-e871d95d4464] Running
	I0924 00:39:19.076232 1874359 system_pods.go:89] "kube-scheduler-addons-371349" [ae310285-de23-4f27-8f12-35713956d260] Running
	I0924 00:39:19.076241 1874359 system_pods.go:89] "metrics-server-84c5f94fbc-wxd2s" [7c5e5bee-e3dc-43a0-a7b2-e1afa3197ce6] Running
	I0924 00:39:19.076246 1874359 system_pods.go:89] "nvidia-device-plugin-daemonset-t52r5" [6ee689eb-216e-49b6-b98b-04c4a8a2a717] Running
	I0924 00:39:19.076250 1874359 system_pods.go:89] "registry-66c9cd494c-vx6hr" [2d03a897-de38-4010-b9d3-7e455400c58d] Running
	I0924 00:39:19.076254 1874359 system_pods.go:89] "registry-proxy-9jrvf" [1cea29a0-a418-43ce-8a72-6439715dfdb4] Running
	I0924 00:39:19.076259 1874359 system_pods.go:89] "snapshot-controller-56fcc65765-trtb4" [71554140-ea26-4c02-8605-9e5a7a72c935] Running
	I0924 00:39:19.076266 1874359 system_pods.go:89] "snapshot-controller-56fcc65765-vprd4" [9bf3685a-c093-4efd-9385-9e2cd6ab2d77] Running
	I0924 00:39:19.076271 1874359 system_pods.go:89] "storage-provisioner" [3f9e83c7-275e-48af-b839-10cd00b637ad] Running
	I0924 00:39:19.076278 1874359 system_pods.go:126] duration metric: took 10.078477ms to wait for k8s-apps to be running ...
	I0924 00:39:19.076291 1874359 system_svc.go:44] waiting for kubelet service to be running ....
	I0924 00:39:19.076352 1874359 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
	I0924 00:39:19.090090 1874359 system_svc.go:56] duration metric: took 13.789983ms WaitForService to wait for kubelet
	I0924 00:39:19.090120 1874359 kubeadm.go:582] duration metric: took 2m59.177267701s to wait for: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
	I0924 00:39:19.090142 1874359 node_conditions.go:102] verifying NodePressure condition ...
	I0924 00:39:19.093950 1874359 node_conditions.go:122] node storage ephemeral capacity is 203034800Ki
	I0924 00:39:19.093985 1874359 node_conditions.go:123] node cpu capacity is 2
	I0924 00:39:19.093996 1874359 node_conditions.go:105] duration metric: took 3.848216ms to run NodePressure ...
	I0924 00:39:19.094009 1874359 start.go:241] waiting for startup goroutines ...
	I0924 00:39:19.094016 1874359 start.go:246] waiting for cluster config update ...
	I0924 00:39:19.094032 1874359 start.go:255] writing updated cluster config ...
	I0924 00:39:19.094333 1874359 ssh_runner.go:195] Run: rm -f paused
	I0924 00:39:19.431140 1874359 start.go:600] kubectl: 1.31.1, cluster: 1.31.1 (minor skew: 0)
	I0924 00:39:19.432602 1874359 out.go:177] * Done! kubectl is now configured to use "addons-371349" cluster and "default" namespace by default
	
	
	==> CRI-O <==
	Sep 24 00:51:15 addons-371349 crio[964]: time="2024-09-24 00:51:15.431063295Z" level=info msg="Stopped pod sandbox (already stopped): ebc02a7e6f6d7f7bbbf69537c9b79d2240f7ae0bc1b3e970293cf87beb78a403" id=a86985af-43e8-4b96-8508-fc04124a607b name=/runtime.v1.RuntimeService/StopPodSandbox
	Sep 24 00:51:15 addons-371349 crio[964]: time="2024-09-24 00:51:15.431457568Z" level=info msg="Removing pod sandbox: ebc02a7e6f6d7f7bbbf69537c9b79d2240f7ae0bc1b3e970293cf87beb78a403" id=af6123fc-0a85-4a8a-94f7-872933702346 name=/runtime.v1.RuntimeService/RemovePodSandbox
	Sep 24 00:51:15 addons-371349 crio[964]: time="2024-09-24 00:51:15.441504293Z" level=info msg="Removed pod sandbox: ebc02a7e6f6d7f7bbbf69537c9b79d2240f7ae0bc1b3e970293cf87beb78a403" id=af6123fc-0a85-4a8a-94f7-872933702346 name=/runtime.v1.RuntimeService/RemovePodSandbox
	Sep 24 00:51:15 addons-371349 crio[964]: time="2024-09-24 00:51:15.442141064Z" level=info msg="Stopping pod sandbox: abefc786cbf2a36b8040cfe51c92027cdfbba63c3699262985ebe698108f7112" id=65a923a2-55de-47c9-9213-b82f437fb97f name=/runtime.v1.RuntimeService/StopPodSandbox
	Sep 24 00:51:15 addons-371349 crio[964]: time="2024-09-24 00:51:15.442182499Z" level=info msg="Stopped pod sandbox (already stopped): abefc786cbf2a36b8040cfe51c92027cdfbba63c3699262985ebe698108f7112" id=65a923a2-55de-47c9-9213-b82f437fb97f name=/runtime.v1.RuntimeService/StopPodSandbox
	Sep 24 00:51:15 addons-371349 crio[964]: time="2024-09-24 00:51:15.442468622Z" level=info msg="Removing pod sandbox: abefc786cbf2a36b8040cfe51c92027cdfbba63c3699262985ebe698108f7112" id=86137a10-2be0-402d-a4c6-5e4ae812ab5e name=/runtime.v1.RuntimeService/RemovePodSandbox
	Sep 24 00:51:15 addons-371349 crio[964]: time="2024-09-24 00:51:15.452894515Z" level=info msg="Removed pod sandbox: abefc786cbf2a36b8040cfe51c92027cdfbba63c3699262985ebe698108f7112" id=86137a10-2be0-402d-a4c6-5e4ae812ab5e name=/runtime.v1.RuntimeService/RemovePodSandbox
	Sep 24 00:51:15 addons-371349 crio[964]: time="2024-09-24 00:51:15.453476066Z" level=info msg="Stopping pod sandbox: ada159dcac269ce1c2a03f6851a41cf9f328386637b85729b3af7633a1a56ac2" id=d77a3883-5b71-4986-9561-5c141869bad7 name=/runtime.v1.RuntimeService/StopPodSandbox
	Sep 24 00:51:15 addons-371349 crio[964]: time="2024-09-24 00:51:15.453600724Z" level=info msg="Stopped pod sandbox (already stopped): ada159dcac269ce1c2a03f6851a41cf9f328386637b85729b3af7633a1a56ac2" id=d77a3883-5b71-4986-9561-5c141869bad7 name=/runtime.v1.RuntimeService/StopPodSandbox
	Sep 24 00:51:15 addons-371349 crio[964]: time="2024-09-24 00:51:15.453980228Z" level=info msg="Removing pod sandbox: ada159dcac269ce1c2a03f6851a41cf9f328386637b85729b3af7633a1a56ac2" id=81dcf3ca-16d6-4b80-930a-6291fa9b8256 name=/runtime.v1.RuntimeService/RemovePodSandbox
	Sep 24 00:51:15 addons-371349 crio[964]: time="2024-09-24 00:51:15.464330882Z" level=info msg="Removed pod sandbox: ada159dcac269ce1c2a03f6851a41cf9f328386637b85729b3af7633a1a56ac2" id=81dcf3ca-16d6-4b80-930a-6291fa9b8256 name=/runtime.v1.RuntimeService/RemovePodSandbox
	Sep 24 00:51:16 addons-371349 crio[964]: time="2024-09-24 00:51:16.005433001Z" level=warning msg="Stopping container 4463520cffdc13a01590e700922ab1ff114b4107d0e62f9da0a973d2c83b620c with stop signal timed out: timeout reached after 2 seconds waiting for container process to exit" id=cf03b7af-2e42-4963-888c-5b6aa63732ac name=/runtime.v1.RuntimeService/StopContainer
	Sep 24 00:51:16 addons-371349 conmon[4635]: conmon 4463520cffdc13a01590 <ninfo>: container 4646 exited with status 137
	Sep 24 00:51:16 addons-371349 crio[964]: time="2024-09-24 00:51:16.143912154Z" level=info msg="Stopped container 4463520cffdc13a01590e700922ab1ff114b4107d0e62f9da0a973d2c83b620c: ingress-nginx/ingress-nginx-controller-bc57996ff-n2nsv/controller" id=cf03b7af-2e42-4963-888c-5b6aa63732ac name=/runtime.v1.RuntimeService/StopContainer
	Sep 24 00:51:16 addons-371349 crio[964]: time="2024-09-24 00:51:16.144441834Z" level=info msg="Stopping pod sandbox: ae5284422581913130b8c89b3900ac4e56e3b8d655aee5d0e5de29c76fa0562f" id=0e0f5ed9-8c2b-46a1-b06a-8eef7e1664a8 name=/runtime.v1.RuntimeService/StopPodSandbox
	Sep 24 00:51:16 addons-371349 crio[964]: time="2024-09-24 00:51:16.148103707Z" level=info msg="Restoring iptables rules: *nat\n:KUBE-HOSTPORTS - [0:0]\n:KUBE-HP-3KCYL77QTKVU2ZNB - [0:0]\n:KUBE-HP-26PF22LUWHJ43N5X - [0:0]\n-X KUBE-HP-26PF22LUWHJ43N5X\n-X KUBE-HP-3KCYL77QTKVU2ZNB\nCOMMIT\n"
	Sep 24 00:51:16 addons-371349 crio[964]: time="2024-09-24 00:51:16.149637812Z" level=info msg="Closing host port tcp:80"
	Sep 24 00:51:16 addons-371349 crio[964]: time="2024-09-24 00:51:16.149682480Z" level=info msg="Closing host port tcp:443"
	Sep 24 00:51:16 addons-371349 crio[964]: time="2024-09-24 00:51:16.151014465Z" level=info msg="Host port tcp:80 does not have an open socket"
	Sep 24 00:51:16 addons-371349 crio[964]: time="2024-09-24 00:51:16.151043215Z" level=info msg="Host port tcp:443 does not have an open socket"
	Sep 24 00:51:16 addons-371349 crio[964]: time="2024-09-24 00:51:16.151236064Z" level=info msg="Got pod network &{Name:ingress-nginx-controller-bc57996ff-n2nsv Namespace:ingress-nginx ID:ae5284422581913130b8c89b3900ac4e56e3b8d655aee5d0e5de29c76fa0562f UID:8ad70d54-e7ea-4840-8ce6-dabb26a9abc3 NetNS:/var/run/netns/6fed16a6-8032-4b2b-b1db-e00e286b156f Networks:[{Name:kindnet Ifname:eth0}] RuntimeConfig:map[kindnet:{IP: MAC: PortMappings:[] Bandwidth:<nil> IpRanges:[]}] Aliases:map[]}"
	Sep 24 00:51:16 addons-371349 crio[964]: time="2024-09-24 00:51:16.151379495Z" level=info msg="Deleting pod ingress-nginx_ingress-nginx-controller-bc57996ff-n2nsv from CNI network \"kindnet\" (type=ptp)"
	Sep 24 00:51:16 addons-371349 crio[964]: time="2024-09-24 00:51:16.172218161Z" level=info msg="Stopped pod sandbox: ae5284422581913130b8c89b3900ac4e56e3b8d655aee5d0e5de29c76fa0562f" id=0e0f5ed9-8c2b-46a1-b06a-8eef7e1664a8 name=/runtime.v1.RuntimeService/StopPodSandbox
	Sep 24 00:51:16 addons-371349 crio[964]: time="2024-09-24 00:51:16.302992087Z" level=info msg="Removing container: 4463520cffdc13a01590e700922ab1ff114b4107d0e62f9da0a973d2c83b620c" id=780abddd-ed57-4870-b91e-be6494c65059 name=/runtime.v1.RuntimeService/RemoveContainer
	Sep 24 00:51:16 addons-371349 crio[964]: time="2024-09-24 00:51:16.320757028Z" level=info msg="Removed container 4463520cffdc13a01590e700922ab1ff114b4107d0e62f9da0a973d2c83b620c: ingress-nginx/ingress-nginx-controller-bc57996ff-n2nsv/controller" id=780abddd-ed57-4870-b91e-be6494c65059 name=/runtime.v1.RuntimeService/RemoveContainer
	
	
	==> container status <==
	CONTAINER           IMAGE                                                                                                                   CREATED             STATE               NAME                       ATTEMPT             POD ID              POD
	e8c49b533dcd4       docker.io/kicbase/echo-server@sha256:127ac38a2bb9537b7f252addff209ea6801edcac8a92c8b1104dacd66a583ed6                   9 seconds ago       Running             hello-world-app            0                   9be0d5bc67fd5       hello-world-app-55bf9c44b4-jd6dh
	146f7add64605       docker.io/library/nginx@sha256:19db381c08a95b2040d5637a65c7a59af6c2f21444b0c8730505280a0255fb53                         2 minutes ago       Running             nginx                      0                   e66e2cb3f3976       nginx
	e149e451e3126       gcr.io/k8s-minikube/gcp-auth-webhook@sha256:a40e1a121ee367d1712ac3a54ec9c38c405a65dde923c98e5fa6368fa82c4b69            13 minutes ago      Running             gcp-auth                   0                   c4f48f413c25f       gcp-auth-89d5ffd79-d948l
	85e06e0090091       gcr.io/cloud-spanner-emulator/emulator@sha256:6ce1265c73355797b34d2531c7146eed3996346f860517e35d1434182eb5f01d          13 minutes ago      Running             cloud-spanner-emulator     0                   3e49192aad656       cloud-spanner-emulator-5b584cc74-hfmlx
	6aa09a7ac6da5       docker.io/marcnuri/yakd@sha256:1c961556224d57fc747de0b1874524208e5fb4f8386f23e9c1c4c18e97109f17                         13 minutes ago      Running             yakd                       0                   c67945ae57513       yakd-dashboard-67d98fc6b-2rl8g
	818b4f0b37443       registry.k8s.io/metrics-server/metrics-server@sha256:048bcf48fc2cce517a61777e22bac782ba59ea5e9b9a54bcb42dbee99566a91f   13 minutes ago      Running             metrics-server             0                   d88787db1414c       metrics-server-84c5f94fbc-wxd2s
	d8a79b23cd874       nvcr.io/nvidia/k8s-device-plugin@sha256:cdd05f9d89f0552478d46474005e86b98795ad364664f644225b99d94978e680                13 minutes ago      Running             nvidia-device-plugin-ctr   0                   d1fbb4249f7de       nvidia-device-plugin-daemonset-t52r5
	4f11a1288c9bb       docker.io/rancher/local-path-provisioner@sha256:689a2489a24e74426e4a4666e611c988202c5fa995908b0c60133aca3eb87d98        14 minutes ago      Running             local-path-provisioner     0                   4c000f65cf36b       local-path-provisioner-86d989889c-tshng
	07152f00c7b55       2f6c962e7b8311337352d9fdea917da2184d9919f4da7695bc2a6517cf392fe4                                                        14 minutes ago      Running             coredns                    0                   3ba7cebb00be1       coredns-7c65d6cfc9-bsbwf
	f1f18e06d2168       ba04bb24b95753201135cbc420b233c1b0b9fa2e1fd21d28319c348c33fbcde6                                                        14 minutes ago      Running             storage-provisioner        0                   c3ea98ab822e0       storage-provisioner
	8f2c47f2d8dc2       24a140c548c075e487e45d0ee73b1aa89f8bfb40c08a57e05975559728822b1d                                                        14 minutes ago      Running             kube-proxy                 0                   2489a6eed4e31       kube-proxy-qcb9f
	7adace27f5bf6       6a23fa8fd2b78ab58e42ba273808edc936a9c53d8ac4a919f6337be094843a51                                                        14 minutes ago      Running             kindnet-cni                0                   2495b8a3a9496       kindnet-c2v8q
	749045c42da2d       d3f53a98c0a9d9163c4848bcf34b2d2f5e1e3691b79f3d1dd6d0206809e02853                                                        15 minutes ago      Running             kube-apiserver             0                   6cdf84a4b6fee       kube-apiserver-addons-371349
	278db6b1284e1       7f8aa378bb47dffcf430f3a601abe39137e88aee0238e23ed8530fdd18dab82d                                                        15 minutes ago      Running             kube-scheduler             0                   b82c8f825daff       kube-scheduler-addons-371349
	40d8a21a9712f       27e3830e1402783674d8b594038967deea9d51f0d91b34c93c8f39d2f68af7da                                                        15 minutes ago      Running             etcd                       0                   d6149f16a9e9c       etcd-addons-371349
	340d83c4a515a       279f381cb37365bbbcd133c9531fba9c2beb0f38dbbe6ddfcd0b1b1643d3450e                                                        15 minutes ago      Running             kube-controller-manager    0                   aad17fb9b4c3f       kube-controller-manager-addons-371349
	
	
	==> coredns [07152f00c7b5566d20be0e478631432f898e24fefada16283e2ca7028b046c61] <==
	[INFO] 10.244.0.11:48609 - 27216 "A IN registry.kube-system.svc.cluster.local.cluster.local. udp 70 false 512" NXDOMAIN qr,aa,rd 163 0.000038178s
	[INFO] 10.244.0.11:38318 - 42285 "AAAA IN registry.kube-system.svc.cluster.local.us-east-2.compute.internal. udp 83 false 512" NXDOMAIN qr,rd,ra 83 0.00156723s
	[INFO] 10.244.0.11:38318 - 14127 "A IN registry.kube-system.svc.cluster.local.us-east-2.compute.internal. udp 83 false 512" NXDOMAIN qr,rd,ra 83 0.001620136s
	[INFO] 10.244.0.11:44250 - 19435 "AAAA IN registry.kube-system.svc.cluster.local. udp 56 false 512" NOERROR qr,aa,rd 149 0.000072589s
	[INFO] 10.244.0.11:44250 - 37865 "A IN registry.kube-system.svc.cluster.local. udp 56 false 512" NOERROR qr,aa,rd 110 0.000080277s
	[INFO] 10.244.0.11:44447 - 10882 "AAAA IN registry.kube-system.svc.cluster.local.kube-system.svc.cluster.local. udp 86 false 512" NXDOMAIN qr,aa,rd 179 0.000091764s
	[INFO] 10.244.0.11:44447 - 64414 "A IN registry.kube-system.svc.cluster.local.kube-system.svc.cluster.local. udp 86 false 512" NXDOMAIN qr,aa,rd 179 0.0000421s
	[INFO] 10.244.0.11:56763 - 16602 "A IN registry.kube-system.svc.cluster.local.svc.cluster.local. udp 74 false 512" NXDOMAIN qr,aa,rd 167 0.000073598s
	[INFO] 10.244.0.11:56763 - 7384 "AAAA IN registry.kube-system.svc.cluster.local.svc.cluster.local. udp 74 false 512" NXDOMAIN qr,aa,rd 167 0.00005828s
	[INFO] 10.244.0.11:57197 - 45264 "A IN registry.kube-system.svc.cluster.local.cluster.local. udp 70 false 512" NXDOMAIN qr,aa,rd 163 0.000080121s
	[INFO] 10.244.0.11:57197 - 13267 "AAAA IN registry.kube-system.svc.cluster.local.cluster.local. udp 70 false 512" NXDOMAIN qr,aa,rd 163 0.000119915s
	[INFO] 10.244.0.11:39794 - 42327 "A IN registry.kube-system.svc.cluster.local.us-east-2.compute.internal. udp 83 false 512" NXDOMAIN qr,rd,ra 83 0.001858752s
	[INFO] 10.244.0.11:39794 - 29017 "AAAA IN registry.kube-system.svc.cluster.local.us-east-2.compute.internal. udp 83 false 512" NXDOMAIN qr,rd,ra 83 0.002064112s
	[INFO] 10.244.0.11:34677 - 56184 "AAAA IN registry.kube-system.svc.cluster.local. udp 56 false 512" NOERROR qr,aa,rd 149 0.000062341s
	[INFO] 10.244.0.11:34677 - 8827 "A IN registry.kube-system.svc.cluster.local. udp 56 false 512" NOERROR qr,aa,rd 110 0.000037554s
	[INFO] 10.244.0.20:56840 - 63749 "A IN storage.googleapis.com.gcp-auth.svc.cluster.local. udp 78 false 1232" NXDOMAIN qr,aa,rd 160 0.004884802s
	[INFO] 10.244.0.20:49691 - 10017 "AAAA IN storage.googleapis.com.gcp-auth.svc.cluster.local. udp 78 false 1232" NXDOMAIN qr,aa,rd 160 0.004779089s
	[INFO] 10.244.0.20:34378 - 59763 "AAAA IN storage.googleapis.com.svc.cluster.local. udp 69 false 1232" NXDOMAIN qr,aa,rd 151 0.000111111s
	[INFO] 10.244.0.20:35355 - 24664 "A IN storage.googleapis.com.svc.cluster.local. udp 69 false 1232" NXDOMAIN qr,aa,rd 151 0.0001304s
	[INFO] 10.244.0.20:49361 - 45456 "A IN storage.googleapis.com.cluster.local. udp 65 false 1232" NXDOMAIN qr,aa,rd 147 0.000152095s
	[INFO] 10.244.0.20:51037 - 55739 "AAAA IN storage.googleapis.com.cluster.local. udp 65 false 1232" NXDOMAIN qr,aa,rd 147 0.000066607s
	[INFO] 10.244.0.20:48455 - 44296 "A IN storage.googleapis.com.us-east-2.compute.internal. udp 78 false 1232" NXDOMAIN qr,rd,ra 67 0.007091482s
	[INFO] 10.244.0.20:53491 - 40826 "AAAA IN storage.googleapis.com.us-east-2.compute.internal. udp 78 false 1232" NXDOMAIN qr,rd,ra 67 0.006788458s
	[INFO] 10.244.0.20:49373 - 48596 "AAAA IN storage.googleapis.com. udp 51 false 1232" NOERROR qr,rd,ra 240 0.001932063s
	[INFO] 10.244.0.20:49671 - 38666 "A IN storage.googleapis.com. udp 51 false 1232" NOERROR qr,rd,ra 648 0.00145365s
	
	
	==> describe nodes <==
	Name:               addons-371349
	Roles:              control-plane
	Labels:             beta.kubernetes.io/arch=arm64
	                    beta.kubernetes.io/os=linux
	                    kubernetes.io/arch=arm64
	                    kubernetes.io/hostname=addons-371349
	                    kubernetes.io/os=linux
	                    minikube.k8s.io/commit=41795ff643dcbe39cdf81f27d064464d20ae8e7c
	                    minikube.k8s.io/name=addons-371349
	                    minikube.k8s.io/primary=true
	                    minikube.k8s.io/updated_at=2024_09_24T00_36_16_0700
	                    minikube.k8s.io/version=v1.34.0
	                    node-role.kubernetes.io/control-plane=
	                    node.kubernetes.io/exclude-from-external-load-balancers=
	                    topology.hostpath.csi/node=addons-371349
	Annotations:        kubeadm.alpha.kubernetes.io/cri-socket: unix:///var/run/crio/crio.sock
	                    node.alpha.kubernetes.io/ttl: 0
	                    volumes.kubernetes.io/controller-managed-attach-detach: true
	CreationTimestamp:  Tue, 24 Sep 2024 00:36:12 +0000
	Taints:             <none>
	Unschedulable:      false
	Lease:
	  HolderIdentity:  addons-371349
	  AcquireTime:     <unset>
	  RenewTime:       Tue, 24 Sep 2024 00:51:11 +0000
	Conditions:
	  Type             Status  LastHeartbeatTime                 LastTransitionTime                Reason                       Message
	  ----             ------  -----------------                 ------------------                ------                       -------
	  MemoryPressure   False   Tue, 24 Sep 2024 00:49:21 +0000   Tue, 24 Sep 2024 00:36:10 +0000   KubeletHasSufficientMemory   kubelet has sufficient memory available
	  DiskPressure     False   Tue, 24 Sep 2024 00:49:21 +0000   Tue, 24 Sep 2024 00:36:10 +0000   KubeletHasNoDiskPressure     kubelet has no disk pressure
	  PIDPressure      False   Tue, 24 Sep 2024 00:49:21 +0000   Tue, 24 Sep 2024 00:36:10 +0000   KubeletHasSufficientPID      kubelet has sufficient PID available
	  Ready            True    Tue, 24 Sep 2024 00:49:21 +0000   Tue, 24 Sep 2024 00:37:04 +0000   KubeletReady                 kubelet is posting ready status
	Addresses:
	  InternalIP:  192.168.49.2
	  Hostname:    addons-371349
	Capacity:
	  cpu:                2
	  ephemeral-storage:  203034800Ki
	  hugepages-1Gi:      0
	  hugepages-2Mi:      0
	  hugepages-32Mi:     0
	  hugepages-64Ki:     0
	  memory:             8022296Ki
	  pods:               110
	Allocatable:
	  cpu:                2
	  ephemeral-storage:  203034800Ki
	  hugepages-1Gi:      0
	  hugepages-2Mi:      0
	  hugepages-32Mi:     0
	  hugepages-64Ki:     0
	  memory:             8022296Ki
	  pods:               110
	System Info:
	  Machine ID:                 7aa8545f283e470b93293e30cac1a65d
	  System UUID:                c56a6457-0c21-4897-8a88-d64df490f5dc
	  Boot ID:                    2adb9b4a-25b4-46c0-b3e7-a2955d81a12f
	  Kernel Version:             5.15.0-1070-aws
	  OS Image:                   Ubuntu 22.04.5 LTS
	  Operating System:           linux
	  Architecture:               arm64
	  Container Runtime Version:  cri-o://1.24.6
	  Kubelet Version:            v1.31.1
	  Kube-Proxy Version:         v1.31.1
	PodCIDR:                      10.244.0.0/24
	PodCIDRs:                     10.244.0.0/24
	Non-terminated Pods:          (17 in total)
	  Namespace                   Name                                       CPU Requests  CPU Limits  Memory Requests  Memory Limits  Age
	  ---------                   ----                                       ------------  ----------  ---------------  -------------  ---
	  default                     busybox                                    0 (0%)        0 (0%)      0 (0%)           0 (0%)         12m
	  default                     cloud-spanner-emulator-5b584cc74-hfmlx     0 (0%)        0 (0%)      0 (0%)           0 (0%)         14m
	  default                     hello-world-app-55bf9c44b4-jd6dh           0 (0%)        0 (0%)      0 (0%)           0 (0%)         11s
	  default                     nginx                                      0 (0%)        0 (0%)      0 (0%)           0 (0%)         2m32s
	  gcp-auth                    gcp-auth-89d5ffd79-d948l                   0 (0%)        0 (0%)      0 (0%)           0 (0%)         14m
	  kube-system                 coredns-7c65d6cfc9-bsbwf                   100m (5%)     0 (0%)      70Mi (0%)        170Mi (2%)     14m
	  kube-system                 etcd-addons-371349                         100m (5%)     0 (0%)      100Mi (1%)       0 (0%)         15m
	  kube-system                 kindnet-c2v8q                              100m (5%)     100m (5%)   50Mi (0%)        50Mi (0%)      15m
	  kube-system                 kube-apiserver-addons-371349               250m (12%)    0 (0%)      0 (0%)           0 (0%)         15m
	  kube-system                 kube-controller-manager-addons-371349      200m (10%)    0 (0%)      0 (0%)           0 (0%)         15m
	  kube-system                 kube-proxy-qcb9f                           0 (0%)        0 (0%)      0 (0%)           0 (0%)         15m
	  kube-system                 kube-scheduler-addons-371349               100m (5%)     0 (0%)      0 (0%)           0 (0%)         15m
	  kube-system                 metrics-server-84c5f94fbc-wxd2s            100m (5%)     0 (0%)      200Mi (2%)       0 (0%)         14m
	  kube-system                 nvidia-device-plugin-daemonset-t52r5       0 (0%)        0 (0%)      0 (0%)           0 (0%)         14m
	  kube-system                 storage-provisioner                        0 (0%)        0 (0%)      0 (0%)           0 (0%)         14m
	  local-path-storage          local-path-provisioner-86d989889c-tshng    0 (0%)        0 (0%)      0 (0%)           0 (0%)         14m
	  yakd-dashboard              yakd-dashboard-67d98fc6b-2rl8g             0 (0%)        0 (0%)      128Mi (1%)       256Mi (3%)     14m
	Allocated resources:
	  (Total limits may be over 100 percent, i.e., overcommitted.)
	  Resource           Requests    Limits
	  --------           --------    ------
	  cpu                950m (47%)  100m (5%)
	  memory             548Mi (6%)  476Mi (6%)
	  ephemeral-storage  0 (0%)      0 (0%)
	  hugepages-1Gi      0 (0%)      0 (0%)
	  hugepages-2Mi      0 (0%)      0 (0%)
	  hugepages-32Mi     0 (0%)      0 (0%)
	  hugepages-64Ki     0 (0%)      0 (0%)
	Events:
	  Type     Reason                   Age                From             Message
	  ----     ------                   ----               ----             -------
	  Normal   Starting                 14m                kube-proxy       
	  Normal   NodeHasSufficientMemory  15m (x8 over 15m)  kubelet          Node addons-371349 status is now: NodeHasSufficientMemory
	  Normal   NodeHasNoDiskPressure    15m (x8 over 15m)  kubelet          Node addons-371349 status is now: NodeHasNoDiskPressure
	  Normal   NodeHasSufficientPID     15m (x7 over 15m)  kubelet          Node addons-371349 status is now: NodeHasSufficientPID
	  Normal   Starting                 15m                kubelet          Starting kubelet.
	  Warning  CgroupV1                 15m                kubelet          Cgroup v1 support is in maintenance mode, please migrate to Cgroup v2.
	  Normal   NodeHasSufficientMemory  15m                kubelet          Node addons-371349 status is now: NodeHasSufficientMemory
	  Normal   NodeHasNoDiskPressure    15m                kubelet          Node addons-371349 status is now: NodeHasNoDiskPressure
	  Normal   NodeHasSufficientPID     15m                kubelet          Node addons-371349 status is now: NodeHasSufficientPID
	  Normal   RegisteredNode           15m                node-controller  Node addons-371349 event: Registered Node addons-371349 in Controller
	  Normal   NodeReady                14m                kubelet          Node addons-371349 status is now: NodeReady
	
	
	==> dmesg <==
	[Sep23 22:30] hrtimer: interrupt took 9485972 ns
	[Sep24 00:08] overlayfs: '/var/lib/containers/storage/overlay/l/7FOWQIVXOWACA56BLQVF4JJOLY' not a directory
	[  +0.687175] overlayfs: '/var/lib/containers/storage/overlay/l/ZLTOCNGE2IGM6DT7VP2QP7OV3M' not a directory
	
	
	==> etcd [40d8a21a9712f40f598893c1aba5670ff43d964a7b5d9463400bf4a64836edb2] <==
	{"level":"info","ts":"2024-09-24T00:36:09.764104Z","caller":"v3rpc/health.go:61","msg":"grpc service status changed","service":"","status":"SERVING"}
	{"level":"info","ts":"2024-09-24T00:36:09.765015Z","caller":"embed/serve.go:250","msg":"serving client traffic securely","traffic":"grpc+http","address":"192.168.49.2:2379"}
	{"level":"info","ts":"2024-09-24T00:36:09.769951Z","caller":"v3rpc/health.go:61","msg":"grpc service status changed","service":"","status":"SERVING"}
	{"level":"info","ts":"2024-09-24T00:36:09.771591Z","caller":"embed/serve.go:250","msg":"serving client traffic securely","traffic":"grpc+http","address":"127.0.0.1:2379"}
	{"level":"info","ts":"2024-09-24T00:36:20.632723Z","caller":"traceutil/trace.go:171","msg":"trace[773032134] transaction","detail":"{read_only:false; response_revision:337; number_of_response:1; }","duration":"103.686352ms","start":"2024-09-24T00:36:20.529020Z","end":"2024-09-24T00:36:20.632707Z","steps":["trace[773032134] 'process raft request'  (duration: 103.584422ms)"],"step_count":1}
	{"level":"info","ts":"2024-09-24T00:36:20.688729Z","caller":"traceutil/trace.go:171","msg":"trace[1378336386] transaction","detail":"{read_only:false; response_revision:338; number_of_response:1; }","duration":"159.451203ms","start":"2024-09-24T00:36:20.529260Z","end":"2024-09-24T00:36:20.688711Z","steps":["trace[1378336386] 'process raft request'  (duration: 156.488906ms)"],"step_count":1}
	{"level":"info","ts":"2024-09-24T00:36:20.708331Z","caller":"traceutil/trace.go:171","msg":"trace[1784308832] transaction","detail":"{read_only:false; response_revision:339; number_of_response:1; }","duration":"178.882143ms","start":"2024-09-24T00:36:20.529425Z","end":"2024-09-24T00:36:20.708307Z","steps":["trace[1784308832] 'process raft request'  (duration: 159.09506ms)"],"step_count":1}
	{"level":"info","ts":"2024-09-24T00:36:20.708902Z","caller":"traceutil/trace.go:171","msg":"trace[1518002914] linearizableReadLoop","detail":"{readStateIndex:348; appliedIndex:347; }","duration":"179.503099ms","start":"2024-09-24T00:36:20.529388Z","end":"2024-09-24T00:36:20.708891Z","steps":["trace[1518002914] 'read index received'  (duration: 103.522869ms)","trace[1518002914] 'applied index is now lower than readState.Index'  (duration: 75.979664ms)"],"step_count":2}
	{"level":"warn","ts":"2024-09-24T00:36:20.709094Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"179.677462ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/serviceaccounts/kube-system/ttl-controller\" ","response":"range_response_count:1 size:193"}
	{"level":"info","ts":"2024-09-24T00:36:20.709133Z","caller":"traceutil/trace.go:171","msg":"trace[1395871771] range","detail":"{range_begin:/registry/serviceaccounts/kube-system/ttl-controller; range_end:; response_count:1; response_revision:341; }","duration":"179.738343ms","start":"2024-09-24T00:36:20.529384Z","end":"2024-09-24T00:36:20.709122Z","steps":["trace[1395871771] 'agreement among raft nodes before linearized reading'  (duration: 179.649443ms)"],"step_count":1}
	{"level":"info","ts":"2024-09-24T00:36:21.611273Z","caller":"traceutil/trace.go:171","msg":"trace[662860870] transaction","detail":"{read_only:false; response_revision:345; number_of_response:1; }","duration":"106.953913ms","start":"2024-09-24T00:36:21.504299Z","end":"2024-09-24T00:36:21.611253Z","steps":["trace[662860870] 'process raft request'  (duration: 101.338407ms)"],"step_count":1}
	{"level":"info","ts":"2024-09-24T00:36:23.201763Z","caller":"traceutil/trace.go:171","msg":"trace[1579303640] transaction","detail":"{read_only:false; response_revision:363; number_of_response:1; }","duration":"247.066318ms","start":"2024-09-24T00:36:22.954673Z","end":"2024-09-24T00:36:23.201740Z","steps":["trace[1579303640] 'process raft request'  (duration: 246.933841ms)"],"step_count":1}
	{"level":"info","ts":"2024-09-24T00:36:23.205834Z","caller":"traceutil/trace.go:171","msg":"trace[578334532] transaction","detail":"{read_only:false; response_revision:364; number_of_response:1; }","duration":"101.109154ms","start":"2024-09-24T00:36:23.104699Z","end":"2024-09-24T00:36:23.205808Z","steps":["trace[578334532] 'process raft request'  (duration: 101.019022ms)"],"step_count":1}
	{"level":"info","ts":"2024-09-24T00:36:23.209377Z","caller":"traceutil/trace.go:171","msg":"trace[634610568] linearizableReadLoop","detail":"{readStateIndex:374; appliedIndex:374; }","duration":"104.566675ms","start":"2024-09-24T00:36:23.104792Z","end":"2024-09-24T00:36:23.209359Z","steps":["trace[634610568] 'read index received'  (duration: 104.557379ms)","trace[634610568] 'applied index is now lower than readState.Index'  (duration: 7.926µs)"],"step_count":2}
	{"level":"warn","ts":"2024-09-24T00:36:23.209761Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"104.957533ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/deployments/kube-system/registry\" ","response":"range_response_count:0 size:5"}
	{"level":"info","ts":"2024-09-24T00:36:23.209860Z","caller":"traceutil/trace.go:171","msg":"trace[589915269] range","detail":"{range_begin:/registry/deployments/kube-system/registry; range_end:; response_count:0; response_revision:364; }","duration":"105.061851ms","start":"2024-09-24T00:36:23.104788Z","end":"2024-09-24T00:36:23.209850Z","steps":["trace[589915269] 'agreement among raft nodes before linearized reading'  (duration: 104.923737ms)"],"step_count":1}
	{"level":"warn","ts":"2024-09-24T00:36:23.217249Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"109.080301ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/serviceaccounts/kube-system/kindnet\" ","response":"range_response_count:1 size:520"}
	{"level":"info","ts":"2024-09-24T00:36:23.217391Z","caller":"traceutil/trace.go:171","msg":"trace[1037015755] range","detail":"{range_begin:/registry/serviceaccounts/kube-system/kindnet; range_end:; response_count:1; response_revision:365; }","duration":"109.229213ms","start":"2024-09-24T00:36:23.108151Z","end":"2024-09-24T00:36:23.217380Z","steps":["trace[1037015755] 'agreement among raft nodes before linearized reading'  (duration: 109.058739ms)"],"step_count":1}
	{"level":"info","ts":"2024-09-24T00:36:23.826883Z","caller":"traceutil/trace.go:171","msg":"trace[275907741] transaction","detail":"{read_only:false; response_revision:394; number_of_response:1; }","duration":"111.28535ms","start":"2024-09-24T00:36:23.715585Z","end":"2024-09-24T00:36:23.826870Z","steps":["trace[275907741] 'process raft request'  (duration: 111.027855ms)"],"step_count":1}
	{"level":"info","ts":"2024-09-24T00:46:10.181655Z","caller":"mvcc/index.go:214","msg":"compact tree index","revision":1545}
	{"level":"info","ts":"2024-09-24T00:46:10.223346Z","caller":"mvcc/kvstore_compaction.go:69","msg":"finished scheduled compaction","compact-revision":1545,"took":"41.164636ms","hash":4261425463,"current-db-size-bytes":6520832,"current-db-size":"6.5 MB","current-db-size-in-use-bytes":3383296,"current-db-size-in-use":"3.4 MB"}
	{"level":"info","ts":"2024-09-24T00:46:10.223469Z","caller":"mvcc/hash.go:137","msg":"storing new hash","hash":4261425463,"revision":1545,"compact-revision":-1}
	{"level":"info","ts":"2024-09-24T00:51:10.211113Z","caller":"mvcc/index.go:214","msg":"compact tree index","revision":1964}
	{"level":"info","ts":"2024-09-24T00:51:10.238560Z","caller":"mvcc/kvstore_compaction.go:69","msg":"finished scheduled compaction","compact-revision":1964,"took":"26.87627ms","hash":2345089157,"current-db-size-bytes":6520832,"current-db-size":"6.5 MB","current-db-size-in-use-bytes":4173824,"current-db-size-in-use":"4.2 MB"}
	{"level":"info","ts":"2024-09-24T00:51:10.238693Z","caller":"mvcc/hash.go:137","msg":"storing new hash","hash":2345089157,"revision":1964,"compact-revision":1545}
	
	
	==> gcp-auth [e149e451e3126d1f31e6122bc09312613e217e7626fd798777f48f923270c222] <==
	2024/09/24 00:37:59 GCP Auth Webhook started!
	2024/09/24 00:39:19 Ready to marshal response ...
	2024/09/24 00:39:19 Ready to write response ...
	2024/09/24 00:39:19 Ready to marshal response ...
	2024/09/24 00:39:19 Ready to write response ...
	2024/09/24 00:39:19 Ready to marshal response ...
	2024/09/24 00:39:19 Ready to write response ...
	2024/09/24 00:47:23 Ready to marshal response ...
	2024/09/24 00:47:23 Ready to write response ...
	2024/09/24 00:47:23 Ready to marshal response ...
	2024/09/24 00:47:23 Ready to write response ...
	2024/09/24 00:47:23 Ready to marshal response ...
	2024/09/24 00:47:23 Ready to write response ...
	2024/09/24 00:47:33 Ready to marshal response ...
	2024/09/24 00:47:33 Ready to write response ...
	2024/09/24 00:47:49 Ready to marshal response ...
	2024/09/24 00:47:49 Ready to write response ...
	2024/09/24 00:48:19 Ready to marshal response ...
	2024/09/24 00:48:19 Ready to write response ...
	2024/09/24 00:48:49 Ready to marshal response ...
	2024/09/24 00:48:49 Ready to write response ...
	2024/09/24 00:51:10 Ready to marshal response ...
	2024/09/24 00:51:10 Ready to write response ...
	
	
	==> kernel <==
	 00:51:21 up  8:33,  0 users,  load average: 0.77, 0.66, 1.15
	Linux addons-371349 5.15.0-1070-aws #76~20.04.1-Ubuntu SMP Mon Sep 2 12:20:48 UTC 2024 aarch64 aarch64 aarch64 GNU/Linux
	PRETTY_NAME="Ubuntu 22.04.5 LTS"
	
	
	==> kindnet [7adace27f5bf6fd0d07f44c3b2d9c4b94d8130080a2626aadc5ab73681d376ef] <==
	I0924 00:49:14.875529       1 main.go:299] handling current node
	I0924 00:49:24.867287       1 main.go:295] Handling node with IPs: map[192.168.49.2:{}]
	I0924 00:49:24.867321       1 main.go:299] handling current node
	I0924 00:49:34.866792       1 main.go:295] Handling node with IPs: map[192.168.49.2:{}]
	I0924 00:49:34.866823       1 main.go:299] handling current node
	I0924 00:49:44.875795       1 main.go:295] Handling node with IPs: map[192.168.49.2:{}]
	I0924 00:49:44.875837       1 main.go:299] handling current node
	I0924 00:49:54.866566       1 main.go:295] Handling node with IPs: map[192.168.49.2:{}]
	I0924 00:49:54.866601       1 main.go:299] handling current node
	I0924 00:50:04.870235       1 main.go:295] Handling node with IPs: map[192.168.49.2:{}]
	I0924 00:50:04.870270       1 main.go:299] handling current node
	I0924 00:50:14.867087       1 main.go:295] Handling node with IPs: map[192.168.49.2:{}]
	I0924 00:50:14.867143       1 main.go:299] handling current node
	I0924 00:50:24.866833       1 main.go:295] Handling node with IPs: map[192.168.49.2:{}]
	I0924 00:50:24.866866       1 main.go:299] handling current node
	I0924 00:50:34.866578       1 main.go:295] Handling node with IPs: map[192.168.49.2:{}]
	I0924 00:50:34.866698       1 main.go:299] handling current node
	I0924 00:50:44.866816       1 main.go:295] Handling node with IPs: map[192.168.49.2:{}]
	I0924 00:50:44.866933       1 main.go:299] handling current node
	I0924 00:50:54.868099       1 main.go:295] Handling node with IPs: map[192.168.49.2:{}]
	I0924 00:50:54.868137       1 main.go:299] handling current node
	I0924 00:51:04.874145       1 main.go:295] Handling node with IPs: map[192.168.49.2:{}]
	I0924 00:51:04.874182       1 main.go:299] handling current node
	I0924 00:51:14.866585       1 main.go:295] Handling node with IPs: map[192.168.49.2:{}]
	I0924 00:51:14.866724       1 main.go:299] handling current node
	
	
	==> kube-apiserver [749045c42da2d61080a3969428ab514fa4047e831ebb9439b8511e518e9b1c04] <==
	I0924 00:38:50.494463       1 handler.go:286] Adding GroupVersion metrics.k8s.io v1beta1 to ResourceManager
	E0924 00:38:50.513681       1 remote_available_controller.go:448] "Unhandled Error" err="v1beta1.metrics.k8s.io failed with: Operation cannot be fulfilled on apiservices.apiregistration.k8s.io \"v1beta1.metrics.k8s.io\": the object has been modified; please apply your changes to the latest version and try again" logger="UnhandledError"
	I0924 00:47:23.907476       1 alloc.go:330] "allocated clusterIPs" service="headlamp/headlamp" clusterIPs={"IPv4":"10.111.108.144"}
	I0924 00:48:00.394720       1 controller.go:615] quota admission added evaluator for: volumesnapshots.snapshot.storage.k8s.io
	I0924 00:48:36.745714       1 handler.go:286] Adding GroupVersion snapshot.storage.k8s.io v1 to ResourceManager
	I0924 00:48:36.745795       1 handler.go:286] Adding GroupVersion snapshot.storage.k8s.io v1beta1 to ResourceManager
	I0924 00:48:36.783900       1 handler.go:286] Adding GroupVersion snapshot.storage.k8s.io v1 to ResourceManager
	I0924 00:48:36.784082       1 handler.go:286] Adding GroupVersion snapshot.storage.k8s.io v1beta1 to ResourceManager
	I0924 00:48:36.952645       1 handler.go:286] Adding GroupVersion snapshot.storage.k8s.io v1 to ResourceManager
	I0924 00:48:36.952811       1 handler.go:286] Adding GroupVersion snapshot.storage.k8s.io v1beta1 to ResourceManager
	I0924 00:48:36.952859       1 handler.go:286] Adding GroupVersion snapshot.storage.k8s.io v1 to ResourceManager
	I0924 00:48:37.018886       1 handler.go:286] Adding GroupVersion snapshot.storage.k8s.io v1 to ResourceManager
	I0924 00:48:37.019016       1 handler.go:286] Adding GroupVersion snapshot.storage.k8s.io v1beta1 to ResourceManager
	W0924 00:48:37.945516       1 cacher.go:171] Terminating all watchers from cacher volumesnapshotclasses.snapshot.storage.k8s.io
	W0924 00:48:38.018934       1 cacher.go:171] Terminating all watchers from cacher volumesnapshots.snapshot.storage.k8s.io
	W0924 00:48:38.045455       1 cacher.go:171] Terminating all watchers from cacher volumesnapshotcontents.snapshot.storage.k8s.io
	I0924 00:48:43.815830       1 handler.go:286] Adding GroupVersion gadget.kinvolk.io v1alpha1 to ResourceManager
	W0924 00:48:44.935663       1 cacher.go:171] Terminating all watchers from cacher traces.gadget.kinvolk.io
	I0924 00:48:49.462606       1 controller.go:615] quota admission added evaluator for: ingresses.networking.k8s.io
	I0924 00:48:49.779386       1 alloc.go:330] "allocated clusterIPs" service="default/nginx" clusterIPs={"IPv4":"10.98.176.210"}
	I0924 00:51:10.368010       1 alloc.go:330] "allocated clusterIPs" service="default/hello-world-app" clusterIPs={"IPv4":"10.100.198.90"}
	E0924 00:51:12.905099       1 repair.go:325] "Unhandled Error" err="the cluster IP 10.106.165.243 may have leaked: flagging for later clean up" logger="UnhandledError"
	E0924 00:51:13.043749       1 authentication.go:73] "Unable to authenticate the request" err="[invalid bearer token, serviceaccounts \"ingress-nginx\" not found]"
	E0924 00:51:15.783571       1 authentication.go:73] "Unable to authenticate the request" err="[invalid bearer token, serviceaccounts \"ingress-nginx\" not found]"
	E0924 00:51:15.793239       1 authentication.go:73] "Unable to authenticate the request" err="[invalid bearer token, serviceaccounts \"ingress-nginx\" not found]"
	
	
	==> kube-controller-manager [340d83c4a515af013d7e2f2cb8dd72a56a11c8be46e63481fd282573f250be80] <==
	W0924 00:49:54.806060       1 reflector.go:561] k8s.io/client-go/metadata/metadatainformer/informer.go:138: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource
	E0924 00:49:54.806202       1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/metadata/metadatainformer/informer.go:138: Failed to watch *v1.PartialObjectMetadata: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource" logger="UnhandledError"
	W0924 00:50:12.396151       1 reflector.go:561] k8s.io/client-go/metadata/metadatainformer/informer.go:138: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource
	E0924 00:50:12.396202       1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/metadata/metadatainformer/informer.go:138: Failed to watch *v1.PartialObjectMetadata: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource" logger="UnhandledError"
	W0924 00:50:29.407335       1 reflector.go:561] k8s.io/client-go/metadata/metadatainformer/informer.go:138: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource
	E0924 00:50:29.407377       1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/metadata/metadatainformer/informer.go:138: Failed to watch *v1.PartialObjectMetadata: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource" logger="UnhandledError"
	W0924 00:50:36.991146       1 reflector.go:561] k8s.io/client-go/metadata/metadatainformer/informer.go:138: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource
	E0924 00:50:36.991190       1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/metadata/metadatainformer/informer.go:138: Failed to watch *v1.PartialObjectMetadata: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource" logger="UnhandledError"
	W0924 00:50:49.179365       1 reflector.go:561] k8s.io/client-go/metadata/metadatainformer/informer.go:138: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource
	E0924 00:50:49.179406       1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/metadata/metadatainformer/informer.go:138: Failed to watch *v1.PartialObjectMetadata: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource" logger="UnhandledError"
	W0924 00:51:00.640778       1 reflector.go:561] k8s.io/client-go/metadata/metadatainformer/informer.go:138: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource
	E0924 00:51:00.640819       1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/metadata/metadatainformer/informer.go:138: Failed to watch *v1.PartialObjectMetadata: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource" logger="UnhandledError"
	W0924 00:51:07.764912       1 reflector.go:561] k8s.io/client-go/metadata/metadatainformer/informer.go:138: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource
	E0924 00:51:07.765033       1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/metadata/metadatainformer/informer.go:138: Failed to watch *v1.PartialObjectMetadata: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource" logger="UnhandledError"
	I0924 00:51:10.139337       1 replica_set.go:679] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="default/hello-world-app-55bf9c44b4" duration="44.670437ms"
	I0924 00:51:10.166458       1 replica_set.go:679] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="default/hello-world-app-55bf9c44b4" duration="27.062662ms"
	I0924 00:51:10.214927       1 replica_set.go:679] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="default/hello-world-app-55bf9c44b4" duration="48.339523ms"
	I0924 00:51:10.215113       1 replica_set.go:679] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="default/hello-world-app-55bf9c44b4" duration="72.704µs"
	I0924 00:51:12.352616       1 replica_set.go:679] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="default/hello-world-app-55bf9c44b4" duration="21.100889ms"
	I0924 00:51:12.352833       1 replica_set.go:679] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="default/hello-world-app-55bf9c44b4" duration="54.916µs"
	I0924 00:51:12.974453       1 job_controller.go:568] "enqueueing job" logger="job-controller" key="ingress-nginx/ingress-nginx-admission-create" delay="0s"
	I0924 00:51:12.978647       1 replica_set.go:679] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="ingress-nginx/ingress-nginx-controller-bc57996ff" duration="6.703µs"
	I0924 00:51:12.982414       1 job_controller.go:568] "enqueueing job" logger="job-controller" key="ingress-nginx/ingress-nginx-admission-patch" delay="0s"
	W0924 00:51:15.460098       1 reflector.go:561] k8s.io/client-go/metadata/metadatainformer/informer.go:138: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource
	E0924 00:51:15.460171       1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/metadata/metadatainformer/informer.go:138: Failed to watch *v1.PartialObjectMetadata: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource" logger="UnhandledError"
	
	
	==> kube-proxy [8f2c47f2d8dc25f068087f5d0e702e1768f8714f22c484f1ebe13e92be684997] <==
	I0924 00:36:25.074970       1 server_linux.go:66] "Using iptables proxy"
	I0924 00:36:25.515603       1 server.go:677] "Successfully retrieved node IP(s)" IPs=["192.168.49.2"]
	E0924 00:36:25.515901       1 server.go:234] "Kube-proxy configuration may be incomplete or incorrect" err="nodePortAddresses is unset; NodePort connections will be accepted on all local IPs. Consider using `--nodeport-addresses primary`"
	I0924 00:36:25.628068       1 server.go:243] "kube-proxy running in dual-stack mode" primary ipFamily="IPv4"
	I0924 00:36:25.628119       1 server_linux.go:169] "Using iptables Proxier"
	I0924 00:36:25.648842       1 proxier.go:255] "Setting route_localnet=1 to allow node-ports on localhost; to change this either disable iptables.localhostNodePorts (--iptables-localhost-nodeports) or set nodePortAddresses (--nodeport-addresses) to filter loopback addresses" ipFamily="IPv4"
	I0924 00:36:25.653049       1 server.go:483] "Version info" version="v1.31.1"
	I0924 00:36:25.653080       1 server.go:485] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
	I0924 00:36:25.700056       1 config.go:199] "Starting service config controller"
	I0924 00:36:25.700112       1 shared_informer.go:313] Waiting for caches to sync for service config
	I0924 00:36:25.700145       1 config.go:105] "Starting endpoint slice config controller"
	I0924 00:36:25.700151       1 shared_informer.go:313] Waiting for caches to sync for endpoint slice config
	I0924 00:36:25.700699       1 config.go:328] "Starting node config controller"
	I0924 00:36:25.700719       1 shared_informer.go:313] Waiting for caches to sync for node config
	I0924 00:36:26.004104       1 shared_informer.go:320] Caches are synced for node config
	I0924 00:36:26.004226       1 shared_informer.go:320] Caches are synced for service config
	I0924 00:36:26.004259       1 shared_informer.go:320] Caches are synced for endpoint slice config
	
	
	==> kube-scheduler [278db6b1284e1f1d66e55b827b5a4b51ea66ac4b399cfb13b724520fb0071730] <==
	W0924 00:36:12.854573       1 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.Service: services is forbidden: User "system:kube-scheduler" cannot list resource "services" in API group "" at the cluster scope
	E0924 00:36:12.858043       1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.Service: failed to list *v1.Service: services is forbidden: User \"system:kube-scheduler\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError"
	W0924 00:36:13.660480       1 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.PersistentVolume: persistentvolumes is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumes" in API group "" at the cluster scope
	E0924 00:36:13.660619       1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.PersistentVolume: failed to list *v1.PersistentVolume: persistentvolumes is forbidden: User \"system:kube-scheduler\" cannot list resource \"persistentvolumes\" in API group \"\" at the cluster scope" logger="UnhandledError"
	W0924 00:36:13.671582       1 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.ReplicationController: replicationcontrollers is forbidden: User "system:kube-scheduler" cannot list resource "replicationcontrollers" in API group "" at the cluster scope
	E0924 00:36:13.671700       1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.ReplicationController: failed to list *v1.ReplicationController: replicationcontrollers is forbidden: User \"system:kube-scheduler\" cannot list resource \"replicationcontrollers\" in API group \"\" at the cluster scope" logger="UnhandledError"
	W0924 00:36:13.680036       1 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.ReplicaSet: replicasets.apps is forbidden: User "system:kube-scheduler" cannot list resource "replicasets" in API group "apps" at the cluster scope
	E0924 00:36:13.680155       1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.ReplicaSet: failed to list *v1.ReplicaSet: replicasets.apps is forbidden: User \"system:kube-scheduler\" cannot list resource \"replicasets\" in API group \"apps\" at the cluster scope" logger="UnhandledError"
	W0924 00:36:13.738765       1 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.CSIStorageCapacity: csistoragecapacities.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csistoragecapacities" in API group "storage.k8s.io" at the cluster scope
	E0924 00:36:13.738807       1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.CSIStorageCapacity: failed to list *v1.CSIStorageCapacity: csistoragecapacities.storage.k8s.io is forbidden: User \"system:kube-scheduler\" cannot list resource \"csistoragecapacities\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError"
	W0924 00:36:13.767667       1 reflector.go:561] runtime/asm_arm64.s:1222: failed to list *v1.ConfigMap: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot list resource "configmaps" in API group "" in the namespace "kube-system"
	E0924 00:36:13.767800       1 reflector.go:158] "Unhandled Error" err="runtime/asm_arm64.s:1222: Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps \"extension-apiserver-authentication\" is forbidden: User \"system:kube-scheduler\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"kube-system\"" logger="UnhandledError"
	W0924 00:36:13.793760       1 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csidrivers" in API group "storage.k8s.io" at the cluster scope
	E0924 00:36:13.793802       1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.CSIDriver: failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:kube-scheduler\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError"
	W0924 00:36:13.833453       1 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.CSINode: csinodes.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csinodes" in API group "storage.k8s.io" at the cluster scope
	E0924 00:36:13.833510       1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.CSINode: failed to list *v1.CSINode: csinodes.storage.k8s.io is forbidden: User \"system:kube-scheduler\" cannot list resource \"csinodes\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError"
	W0924 00:36:13.843267       1 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.PersistentVolumeClaim: persistentvolumeclaims is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumeclaims" in API group "" at the cluster scope
	E0924 00:36:13.843320       1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.PersistentVolumeClaim: failed to list *v1.PersistentVolumeClaim: persistentvolumeclaims is forbidden: User \"system:kube-scheduler\" cannot list resource \"persistentvolumeclaims\" in API group \"\" at the cluster scope" logger="UnhandledError"
	W0924 00:36:13.901524       1 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.Pod: pods is forbidden: User "system:kube-scheduler" cannot list resource "pods" in API group "" at the cluster scope
	E0924 00:36:13.901892       1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.Pod: failed to list *v1.Pod: pods is forbidden: User \"system:kube-scheduler\" cannot list resource \"pods\" in API group \"\" at the cluster scope" logger="UnhandledError"
	W0924 00:36:13.930111       1 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.PodDisruptionBudget: poddisruptionbudgets.policy is forbidden: User "system:kube-scheduler" cannot list resource "poddisruptionbudgets" in API group "policy" at the cluster scope
	E0924 00:36:13.930255       1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.PodDisruptionBudget: failed to list *v1.PodDisruptionBudget: poddisruptionbudgets.policy is forbidden: User \"system:kube-scheduler\" cannot list resource \"poddisruptionbudgets\" in API group \"policy\" at the cluster scope" logger="UnhandledError"
	W0924 00:36:13.937226       1 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.Namespace: namespaces is forbidden: User "system:kube-scheduler" cannot list resource "namespaces" in API group "" at the cluster scope
	E0924 00:36:13.937281       1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.Namespace: failed to list *v1.Namespace: namespaces is forbidden: User \"system:kube-scheduler\" cannot list resource \"namespaces\" in API group \"\" at the cluster scope" logger="UnhandledError"
	I0924 00:36:15.547144       1 shared_informer.go:320] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file
	
	
	==> kubelet <==
	Sep 24 00:51:11 addons-371349 kubelet[1485]: I0924 00:51:11.478004    1485 reconciler_common.go:288] "Volume detached for volume \"kube-api-access-pmhzj\" (UniqueName: \"kubernetes.io/projected/4c89d0f9-906f-451c-807f-4b809f2d3f54-kube-api-access-pmhzj\") on node \"addons-371349\" DevicePath \"\""
	Sep 24 00:51:12 addons-371349 kubelet[1485]: I0924 00:51:12.288066    1485 scope.go:117] "RemoveContainer" containerID="b8338b5a326d77682eaef90d904f8d33b9a81a01fcc142bc8dc8d8c8d503188a"
	Sep 24 00:51:12 addons-371349 kubelet[1485]: I0924 00:51:12.315800    1485 scope.go:117] "RemoveContainer" containerID="b8338b5a326d77682eaef90d904f8d33b9a81a01fcc142bc8dc8d8c8d503188a"
	Sep 24 00:51:12 addons-371349 kubelet[1485]: E0924 00:51:12.316198    1485 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b8338b5a326d77682eaef90d904f8d33b9a81a01fcc142bc8dc8d8c8d503188a\": container with ID starting with b8338b5a326d77682eaef90d904f8d33b9a81a01fcc142bc8dc8d8c8d503188a not found: ID does not exist" containerID="b8338b5a326d77682eaef90d904f8d33b9a81a01fcc142bc8dc8d8c8d503188a"
	Sep 24 00:51:12 addons-371349 kubelet[1485]: I0924 00:51:12.316246    1485 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b8338b5a326d77682eaef90d904f8d33b9a81a01fcc142bc8dc8d8c8d503188a"} err="failed to get container status \"b8338b5a326d77682eaef90d904f8d33b9a81a01fcc142bc8dc8d8c8d503188a\": rpc error: code = NotFound desc = could not find container \"b8338b5a326d77682eaef90d904f8d33b9a81a01fcc142bc8dc8d8c8d503188a\": container with ID starting with b8338b5a326d77682eaef90d904f8d33b9a81a01fcc142bc8dc8d8c8d503188a not found: ID does not exist"
	Sep 24 00:51:12 addons-371349 kubelet[1485]: I0924 00:51:12.328775    1485 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="default/hello-world-app-55bf9c44b4-jd6dh" podStartSLOduration=1.24363153 podStartE2EDuration="2.328760509s" podCreationTimestamp="2024-09-24 00:51:10 +0000 UTC" firstStartedPulling="2024-09-24 00:51:10.507023242 +0000 UTC m=+895.504964628" lastFinishedPulling="2024-09-24 00:51:11.592152221 +0000 UTC m=+896.590093607" observedRunningTime="2024-09-24 00:51:12.328737437 +0000 UTC m=+897.326678839" watchObservedRunningTime="2024-09-24 00:51:12.328760509 +0000 UTC m=+897.326701895"
	Sep 24 00:51:13 addons-371349 kubelet[1485]: I0924 00:51:13.141459    1485 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4c89d0f9-906f-451c-807f-4b809f2d3f54" path="/var/lib/kubelet/pods/4c89d0f9-906f-451c-807f-4b809f2d3f54/volumes"
	Sep 24 00:51:13 addons-371349 kubelet[1485]: I0924 00:51:13.141878    1485 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4eaaa98f-a5b6-48eb-ae6e-a33058187263" path="/var/lib/kubelet/pods/4eaaa98f-a5b6-48eb-ae6e-a33058187263/volumes"
	Sep 24 00:51:13 addons-371349 kubelet[1485]: I0924 00:51:13.142215    1485 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="77d0c678-9e90-41c1-9cf0-09a80e7cb895" path="/var/lib/kubelet/pods/77d0c678-9e90-41c1-9cf0-09a80e7cb895/volumes"
	Sep 24 00:51:15 addons-371349 kubelet[1485]: E0924 00:51:15.204184    1485 container_manager_linux.go:513] "Failed to find cgroups of kubelet" err="cpu and memory cgroup hierarchy not unified.  cpu: /docker/57a8c5c845384bb63a10462f6fa297c2fd54585c86fa3de67a14d6644e9f0dd2, memory: /docker/57a8c5c845384bb63a10462f6fa297c2fd54585c86fa3de67a14d6644e9f0dd2/system.slice/kubelet.service"
	Sep 24 00:51:15 addons-371349 kubelet[1485]: I0924 00:51:15.385919    1485 scope.go:117] "RemoveContainer" containerID="cf9ce75275386ada12a4ba6b2e4fa6b705c6552498acef795016b9dbed25fb62"
	Sep 24 00:51:15 addons-371349 kubelet[1485]: I0924 00:51:15.408633    1485 scope.go:117] "RemoveContainer" containerID="9ff09a8761eedfe6473e14decccecfe66011aa8cba5ca57780da93d785f5acb2"
	Sep 24 00:51:15 addons-371349 kubelet[1485]: E0924 00:51:15.465347    1485 eviction_manager.go:257] "Eviction manager: failed to get HasDedicatedImageFs" err="missing image stats: &ImageFsInfoResponse{ImageFilesystems:[]*FilesystemUsage{&FilesystemUsage{Timestamp:1727139075464950963,FsId:&FilesystemIdentifier{Mountpoint:/var/lib/containers/storage/overlay-images,},UsedBytes:&UInt64Value{Value:543503,},InodesUsed:&UInt64Value{Value:207,},},},ContainerFilesystems:[]*FilesystemUsage{},}"
	Sep 24 00:51:15 addons-371349 kubelet[1485]: E0924 00:51:15.465379    1485 eviction_manager.go:212] "Eviction manager: failed to synchronize" err="eviction manager: failed to get HasDedicatedImageFs: missing image stats: &ImageFsInfoResponse{ImageFilesystems:[]*FilesystemUsage{&FilesystemUsage{Timestamp:1727139075464950963,FsId:&FilesystemIdentifier{Mountpoint:/var/lib/containers/storage/overlay-images,},UsedBytes:&UInt64Value{Value:543503,},InodesUsed:&UInt64Value{Value:207,},},},ContainerFilesystems:[]*FilesystemUsage{},}"
	Sep 24 00:51:16 addons-371349 kubelet[1485]: I0924 00:51:16.209623    1485 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8ad70d54-e7ea-4840-8ce6-dabb26a9abc3-webhook-cert\") pod \"8ad70d54-e7ea-4840-8ce6-dabb26a9abc3\" (UID: \"8ad70d54-e7ea-4840-8ce6-dabb26a9abc3\") "
	Sep 24 00:51:16 addons-371349 kubelet[1485]: I0924 00:51:16.209702    1485 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7m9n9\" (UniqueName: \"kubernetes.io/projected/8ad70d54-e7ea-4840-8ce6-dabb26a9abc3-kube-api-access-7m9n9\") pod \"8ad70d54-e7ea-4840-8ce6-dabb26a9abc3\" (UID: \"8ad70d54-e7ea-4840-8ce6-dabb26a9abc3\") "
	Sep 24 00:51:16 addons-371349 kubelet[1485]: I0924 00:51:16.211577    1485 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8ad70d54-e7ea-4840-8ce6-dabb26a9abc3-kube-api-access-7m9n9" (OuterVolumeSpecName: "kube-api-access-7m9n9") pod "8ad70d54-e7ea-4840-8ce6-dabb26a9abc3" (UID: "8ad70d54-e7ea-4840-8ce6-dabb26a9abc3"). InnerVolumeSpecName "kube-api-access-7m9n9". PluginName "kubernetes.io/projected", VolumeGidValue ""
	Sep 24 00:51:16 addons-371349 kubelet[1485]: I0924 00:51:16.212166    1485 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8ad70d54-e7ea-4840-8ce6-dabb26a9abc3-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "8ad70d54-e7ea-4840-8ce6-dabb26a9abc3" (UID: "8ad70d54-e7ea-4840-8ce6-dabb26a9abc3"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGidValue ""
	Sep 24 00:51:16 addons-371349 kubelet[1485]: I0924 00:51:16.301607    1485 scope.go:117] "RemoveContainer" containerID="4463520cffdc13a01590e700922ab1ff114b4107d0e62f9da0a973d2c83b620c"
	Sep 24 00:51:16 addons-371349 kubelet[1485]: I0924 00:51:16.310242    1485 reconciler_common.go:288] "Volume detached for volume \"kube-api-access-7m9n9\" (UniqueName: \"kubernetes.io/projected/8ad70d54-e7ea-4840-8ce6-dabb26a9abc3-kube-api-access-7m9n9\") on node \"addons-371349\" DevicePath \"\""
	Sep 24 00:51:16 addons-371349 kubelet[1485]: I0924 00:51:16.310282    1485 reconciler_common.go:288] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8ad70d54-e7ea-4840-8ce6-dabb26a9abc3-webhook-cert\") on node \"addons-371349\" DevicePath \"\""
	Sep 24 00:51:16 addons-371349 kubelet[1485]: I0924 00:51:16.321063    1485 scope.go:117] "RemoveContainer" containerID="4463520cffdc13a01590e700922ab1ff114b4107d0e62f9da0a973d2c83b620c"
	Sep 24 00:51:16 addons-371349 kubelet[1485]: E0924 00:51:16.321423    1485 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4463520cffdc13a01590e700922ab1ff114b4107d0e62f9da0a973d2c83b620c\": container with ID starting with 4463520cffdc13a01590e700922ab1ff114b4107d0e62f9da0a973d2c83b620c not found: ID does not exist" containerID="4463520cffdc13a01590e700922ab1ff114b4107d0e62f9da0a973d2c83b620c"
	Sep 24 00:51:16 addons-371349 kubelet[1485]: I0924 00:51:16.321461    1485 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4463520cffdc13a01590e700922ab1ff114b4107d0e62f9da0a973d2c83b620c"} err="failed to get container status \"4463520cffdc13a01590e700922ab1ff114b4107d0e62f9da0a973d2c83b620c\": rpc error: code = NotFound desc = could not find container \"4463520cffdc13a01590e700922ab1ff114b4107d0e62f9da0a973d2c83b620c\": container with ID starting with 4463520cffdc13a01590e700922ab1ff114b4107d0e62f9da0a973d2c83b620c not found: ID does not exist"
	Sep 24 00:51:17 addons-371349 kubelet[1485]: I0924 00:51:17.141259    1485 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8ad70d54-e7ea-4840-8ce6-dabb26a9abc3" path="/var/lib/kubelet/pods/8ad70d54-e7ea-4840-8ce6-dabb26a9abc3/volumes"
	
	
	==> storage-provisioner [f1f18e06d2168b28d189eb5c666ad7d131f5f957d56fade8478d775c15870ec6] <==
	I0924 00:37:05.969239       1 storage_provisioner.go:116] Initializing the minikube storage provisioner...
	I0924 00:37:05.993268       1 storage_provisioner.go:141] Storage provisioner initialized, now starting service!
	I0924 00:37:05.993402       1 leaderelection.go:243] attempting to acquire leader lease kube-system/k8s.io-minikube-hostpath...
	I0924 00:37:06.013890       1 leaderelection.go:253] successfully acquired lease kube-system/k8s.io-minikube-hostpath
	I0924 00:37:06.014216       1 controller.go:835] Starting provisioner controller k8s.io/minikube-hostpath_addons-371349_c1c71ef6-3afa-4b5e-932a-ce8168f67da3!
	I0924 00:37:06.015491       1 event.go:282] Event(v1.ObjectReference{Kind:"Endpoints", Namespace:"kube-system", Name:"k8s.io-minikube-hostpath", UID:"f1de51ca-2882-4f64-af09-93e4790263f0", APIVersion:"v1", ResourceVersion:"937", FieldPath:""}): type: 'Normal' reason: 'LeaderElection' addons-371349_c1c71ef6-3afa-4b5e-932a-ce8168f67da3 became leader
	I0924 00:37:06.115267       1 controller.go:884] Started provisioner controller k8s.io/minikube-hostpath_addons-371349_c1c71ef6-3afa-4b5e-932a-ce8168f67da3!
	

                                                
                                                
-- /stdout --
helpers_test.go:254: (dbg) Run:  out/minikube-linux-arm64 status --format={{.APIServer}} -p addons-371349 -n addons-371349
helpers_test.go:261: (dbg) Run:  kubectl --context addons-371349 get po -o=jsonpath={.items[*].metadata.name} -A --field-selector=status.phase!=Running
helpers_test.go:272: non-running pods: busybox
helpers_test.go:274: ======> post-mortem[TestAddons/parallel/Ingress]: describe non-running pods <======
helpers_test.go:277: (dbg) Run:  kubectl --context addons-371349 describe pod busybox
helpers_test.go:282: (dbg) kubectl --context addons-371349 describe pod busybox:

                                                
                                                
-- stdout --
	Name:             busybox
	Namespace:        default
	Priority:         0
	Service Account:  default
	Node:             addons-371349/192.168.49.2
	Start Time:       Tue, 24 Sep 2024 00:39:19 +0000
	Labels:           integration-test=busybox
	Annotations:      <none>
	Status:           Pending
	IP:               10.244.0.21
	IPs:
	  IP:  10.244.0.21
	Containers:
	  busybox:
	    Container ID:  
	    Image:         gcr.io/k8s-minikube/busybox:1.28.4-glibc
	    Image ID:      
	    Port:          <none>
	    Host Port:     <none>
	    Command:
	      sleep
	      3600
	    State:          Waiting
	      Reason:       ImagePullBackOff
	    Ready:          False
	    Restart Count:  0
	    Environment:
	      GOOGLE_APPLICATION_CREDENTIALS:  /google-app-creds.json
	      PROJECT_ID:                      this_is_fake
	      GCP_PROJECT:                     this_is_fake
	      GCLOUD_PROJECT:                  this_is_fake
	      GOOGLE_CLOUD_PROJECT:            this_is_fake
	      CLOUDSDK_CORE_PROJECT:           this_is_fake
	    Mounts:
	      /google-app-creds.json from gcp-creds (ro)
	      /var/run/secrets/kubernetes.io/serviceaccount from kube-api-access-fffwl (ro)
	Conditions:
	  Type                        Status
	  PodReadyToStartContainers   True 
	  Initialized                 True 
	  Ready                       False 
	  ContainersReady             False 
	  PodScheduled                True 
	Volumes:
	  kube-api-access-fffwl:
	    Type:                    Projected (a volume that contains injected data from multiple sources)
	    TokenExpirationSeconds:  3607
	    ConfigMapName:           kube-root-ca.crt
	    ConfigMapOptional:       <nil>
	    DownwardAPI:             true
	  gcp-creds:
	    Type:          HostPath (bare host directory volume)
	    Path:          /var/lib/minikube/google_application_credentials.json
	    HostPathType:  File
	QoS Class:         BestEffort
	Node-Selectors:    <none>
	Tolerations:       node.kubernetes.io/not-ready:NoExecute op=Exists for 300s
	                   node.kubernetes.io/unreachable:NoExecute op=Exists for 300s
	Events:
	  Type     Reason     Age                  From               Message
	  ----     ------     ----                 ----               -------
	  Normal   Scheduled  12m                  default-scheduler  Successfully assigned default/busybox to addons-371349
	  Normal   Pulling    10m (x4 over 12m)    kubelet            Pulling image "gcr.io/k8s-minikube/busybox:1.28.4-glibc"
	  Warning  Failed     10m (x4 over 12m)    kubelet            Failed to pull image "gcr.io/k8s-minikube/busybox:1.28.4-glibc": unable to retrieve auth token: invalid username/password: unauthorized: authentication failed
	  Warning  Failed     10m (x4 over 12m)    kubelet            Error: ErrImagePull
	  Warning  Failed     10m (x6 over 12m)    kubelet            Error: ImagePullBackOff
	  Normal   BackOff    114s (x44 over 12m)  kubelet            Back-off pulling image "gcr.io/k8s-minikube/busybox:1.28.4-glibc"

                                                
                                                
-- /stdout --
helpers_test.go:285: <<< TestAddons/parallel/Ingress FAILED: end of post-mortem logs <<<
helpers_test.go:286: ---------------------/post-mortem---------------------------------
--- FAIL: TestAddons/parallel/Ingress (153.51s)

                                                
                                    
x
+
TestAddons/parallel/MetricsServer (332.84s)

                                                
                                                
=== RUN   TestAddons/parallel/MetricsServer
=== PAUSE TestAddons/parallel/MetricsServer

                                                
                                                

                                                
                                                
=== CONT  TestAddons/parallel/MetricsServer
addons_test.go:405: metrics-server stabilized in 10.153037ms
addons_test.go:407: (dbg) TestAddons/parallel/MetricsServer: waiting 6m0s for pods matching "k8s-app=metrics-server" in namespace "kube-system" ...
helpers_test.go:344: "metrics-server-84c5f94fbc-wxd2s" [7c5e5bee-e3dc-43a0-a7b2-e1afa3197ce6] Running
addons_test.go:407: (dbg) TestAddons/parallel/MetricsServer: k8s-app=metrics-server healthy within 6.003740722s
addons_test.go:413: (dbg) Run:  kubectl --context addons-371349 top pods -n kube-system
addons_test.go:413: (dbg) Non-zero exit: kubectl --context addons-371349 top pods -n kube-system: exit status 1 (101.610897ms)

                                                
                                                
** stderr ** 
	error: Metrics not available for pod kube-system/coredns-7c65d6cfc9-bsbwf, age: 12m21.347759253s

                                                
                                                
** /stderr **
I0924 00:48:43.351179 1873600 retry.go:31] will retry after 3.590031637s: exit status 1
addons_test.go:413: (dbg) Run:  kubectl --context addons-371349 top pods -n kube-system
addons_test.go:413: (dbg) Non-zero exit: kubectl --context addons-371349 top pods -n kube-system: exit status 1 (96.081664ms)

                                                
                                                
** stderr ** 
	error: Metrics not available for pod kube-system/coredns-7c65d6cfc9-bsbwf, age: 12m25.03460643s

                                                
                                                
** /stderr **
I0924 00:48:47.037628 1873600 retry.go:31] will retry after 4.863365786s: exit status 1
addons_test.go:413: (dbg) Run:  kubectl --context addons-371349 top pods -n kube-system
addons_test.go:413: (dbg) Non-zero exit: kubectl --context addons-371349 top pods -n kube-system: exit status 1 (106.675823ms)

                                                
                                                
** stderr ** 
	error: Metrics not available for pod kube-system/coredns-7c65d6cfc9-bsbwf, age: 12m30.00556008s

                                                
                                                
** /stderr **
I0924 00:48:52.008644 1873600 retry.go:31] will retry after 8.319287599s: exit status 1
addons_test.go:413: (dbg) Run:  kubectl --context addons-371349 top pods -n kube-system
addons_test.go:413: (dbg) Non-zero exit: kubectl --context addons-371349 top pods -n kube-system: exit status 1 (85.802524ms)

                                                
                                                
** stderr ** 
	error: Metrics not available for pod kube-system/coredns-7c65d6cfc9-bsbwf, age: 12m38.411410147s

                                                
                                                
** /stderr **
I0924 00:49:00.414695 1873600 retry.go:31] will retry after 11.339997227s: exit status 1
addons_test.go:413: (dbg) Run:  kubectl --context addons-371349 top pods -n kube-system
addons_test.go:413: (dbg) Non-zero exit: kubectl --context addons-371349 top pods -n kube-system: exit status 1 (84.422669ms)

                                                
                                                
** stderr ** 
	error: Metrics not available for pod kube-system/coredns-7c65d6cfc9-bsbwf, age: 12m49.838115237s

                                                
                                                
** /stderr **
I0924 00:49:11.841043 1873600 retry.go:31] will retry after 11.506213265s: exit status 1
addons_test.go:413: (dbg) Run:  kubectl --context addons-371349 top pods -n kube-system
addons_test.go:413: (dbg) Non-zero exit: kubectl --context addons-371349 top pods -n kube-system: exit status 1 (82.971817ms)

                                                
                                                
** stderr ** 
	error: Metrics not available for pod kube-system/coredns-7c65d6cfc9-bsbwf, age: 13m1.429655949s

                                                
                                                
** /stderr **
I0924 00:49:23.433020 1873600 retry.go:31] will retry after 24.682524931s: exit status 1
addons_test.go:413: (dbg) Run:  kubectl --context addons-371349 top pods -n kube-system
addons_test.go:413: (dbg) Non-zero exit: kubectl --context addons-371349 top pods -n kube-system: exit status 1 (81.950182ms)

                                                
                                                
** stderr ** 
	error: Metrics not available for pod kube-system/coredns-7c65d6cfc9-bsbwf, age: 13m26.195219978s

                                                
                                                
** /stderr **
I0924 00:49:48.198022 1873600 retry.go:31] will retry after 26.27458316s: exit status 1
addons_test.go:413: (dbg) Run:  kubectl --context addons-371349 top pods -n kube-system
addons_test.go:413: (dbg) Non-zero exit: kubectl --context addons-371349 top pods -n kube-system: exit status 1 (91.486603ms)

                                                
                                                
** stderr ** 
	error: Metrics not available for pod kube-system/coredns-7c65d6cfc9-bsbwf, age: 13m52.564592008s

                                                
                                                
** /stderr **
I0924 00:50:14.568238 1873600 retry.go:31] will retry after 49.357660367s: exit status 1
addons_test.go:413: (dbg) Run:  kubectl --context addons-371349 top pods -n kube-system
addons_test.go:413: (dbg) Non-zero exit: kubectl --context addons-371349 top pods -n kube-system: exit status 1 (88.259851ms)

                                                
                                                
** stderr ** 
	error: Metrics not available for pod kube-system/coredns-7c65d6cfc9-bsbwf, age: 14m42.013501733s

                                                
                                                
** /stderr **
I0924 00:51:04.017326 1873600 retry.go:31] will retry after 1m0.298743117s: exit status 1
addons_test.go:413: (dbg) Run:  kubectl --context addons-371349 top pods -n kube-system
addons_test.go:413: (dbg) Non-zero exit: kubectl --context addons-371349 top pods -n kube-system: exit status 1 (98.416485ms)

                                                
                                                
** stderr ** 
	error: Metrics not available for pod kube-system/coredns-7c65d6cfc9-bsbwf, age: 15m42.413516488s

                                                
                                                
** /stderr **
I0924 00:52:04.416477 1873600 retry.go:31] will retry after 1m5.997644015s: exit status 1
addons_test.go:413: (dbg) Run:  kubectl --context addons-371349 top pods -n kube-system
addons_test.go:413: (dbg) Non-zero exit: kubectl --context addons-371349 top pods -n kube-system: exit status 1 (93.62592ms)

                                                
                                                
** stderr ** 
	error: Metrics not available for pod kube-system/coredns-7c65d6cfc9-bsbwf, age: 16m48.504897287s

                                                
                                                
** /stderr **
I0924 00:53:10.508324 1873600 retry.go:31] will retry after 56.317399201s: exit status 1
addons_test.go:413: (dbg) Run:  kubectl --context addons-371349 top pods -n kube-system
addons_test.go:413: (dbg) Non-zero exit: kubectl --context addons-371349 top pods -n kube-system: exit status 1 (80.829592ms)

                                                
                                                
** stderr ** 
	error: Metrics not available for pod kube-system/coredns-7c65d6cfc9-bsbwf, age: 17m44.903812551s

                                                
                                                
** /stderr **
addons_test.go:427: failed checking metric server: exit status 1
addons_test.go:430: (dbg) Run:  out/minikube-linux-arm64 -p addons-371349 addons disable metrics-server --alsologtostderr -v=1
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:230: ======>  post-mortem[TestAddons/parallel/MetricsServer]: docker inspect <======
helpers_test.go:231: (dbg) Run:  docker inspect addons-371349
helpers_test.go:235: (dbg) docker inspect addons-371349:

                                                
                                                
-- stdout --
	[
	    {
	        "Id": "57a8c5c845384bb63a10462f6fa297c2fd54585c86fa3de67a14d6644e9f0dd2",
	        "Created": "2024-09-24T00:35:55.003933514Z",
	        "Path": "/usr/local/bin/entrypoint",
	        "Args": [
	            "/sbin/init"
	        ],
	        "State": {
	            "Status": "running",
	            "Running": true,
	            "Paused": false,
	            "Restarting": false,
	            "OOMKilled": false,
	            "Dead": false,
	            "Pid": 1874844,
	            "ExitCode": 0,
	            "Error": "",
	            "StartedAt": "2024-09-24T00:35:55.139494316Z",
	            "FinishedAt": "0001-01-01T00:00:00Z"
	        },
	        "Image": "sha256:62002f6a97ad1f6cd4117c29b1c488a6bf3b6255c8231f0d600b1bc7ba1bcfd6",
	        "ResolvConfPath": "/var/lib/docker/containers/57a8c5c845384bb63a10462f6fa297c2fd54585c86fa3de67a14d6644e9f0dd2/resolv.conf",
	        "HostnamePath": "/var/lib/docker/containers/57a8c5c845384bb63a10462f6fa297c2fd54585c86fa3de67a14d6644e9f0dd2/hostname",
	        "HostsPath": "/var/lib/docker/containers/57a8c5c845384bb63a10462f6fa297c2fd54585c86fa3de67a14d6644e9f0dd2/hosts",
	        "LogPath": "/var/lib/docker/containers/57a8c5c845384bb63a10462f6fa297c2fd54585c86fa3de67a14d6644e9f0dd2/57a8c5c845384bb63a10462f6fa297c2fd54585c86fa3de67a14d6644e9f0dd2-json.log",
	        "Name": "/addons-371349",
	        "RestartCount": 0,
	        "Driver": "overlay2",
	        "Platform": "linux",
	        "MountLabel": "",
	        "ProcessLabel": "",
	        "AppArmorProfile": "unconfined",
	        "ExecIDs": null,
	        "HostConfig": {
	            "Binds": [
	                "/lib/modules:/lib/modules:ro",
	                "addons-371349:/var"
	            ],
	            "ContainerIDFile": "",
	            "LogConfig": {
	                "Type": "json-file",
	                "Config": {}
	            },
	            "NetworkMode": "addons-371349",
	            "PortBindings": {
	                "22/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": ""
	                    }
	                ],
	                "2376/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": ""
	                    }
	                ],
	                "32443/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": ""
	                    }
	                ],
	                "5000/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": ""
	                    }
	                ],
	                "8443/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": ""
	                    }
	                ]
	            },
	            "RestartPolicy": {
	                "Name": "no",
	                "MaximumRetryCount": 0
	            },
	            "AutoRemove": false,
	            "VolumeDriver": "",
	            "VolumesFrom": null,
	            "ConsoleSize": [
	                0,
	                0
	            ],
	            "CapAdd": null,
	            "CapDrop": null,
	            "CgroupnsMode": "host",
	            "Dns": [],
	            "DnsOptions": [],
	            "DnsSearch": [],
	            "ExtraHosts": null,
	            "GroupAdd": null,
	            "IpcMode": "private",
	            "Cgroup": "",
	            "Links": null,
	            "OomScoreAdj": 0,
	            "PidMode": "",
	            "Privileged": true,
	            "PublishAllPorts": false,
	            "ReadonlyRootfs": false,
	            "SecurityOpt": [
	                "seccomp=unconfined",
	                "apparmor=unconfined",
	                "label=disable"
	            ],
	            "Tmpfs": {
	                "/run": "",
	                "/tmp": ""
	            },
	            "UTSMode": "",
	            "UsernsMode": "",
	            "ShmSize": 67108864,
	            "Runtime": "runc",
	            "Isolation": "",
	            "CpuShares": 0,
	            "Memory": 4194304000,
	            "NanoCpus": 2000000000,
	            "CgroupParent": "",
	            "BlkioWeight": 0,
	            "BlkioWeightDevice": [],
	            "BlkioDeviceReadBps": [],
	            "BlkioDeviceWriteBps": [],
	            "BlkioDeviceReadIOps": [],
	            "BlkioDeviceWriteIOps": [],
	            "CpuPeriod": 0,
	            "CpuQuota": 0,
	            "CpuRealtimePeriod": 0,
	            "CpuRealtimeRuntime": 0,
	            "CpusetCpus": "",
	            "CpusetMems": "",
	            "Devices": [],
	            "DeviceCgroupRules": null,
	            "DeviceRequests": null,
	            "MemoryReservation": 0,
	            "MemorySwap": 8388608000,
	            "MemorySwappiness": null,
	            "OomKillDisable": false,
	            "PidsLimit": null,
	            "Ulimits": [],
	            "CpuCount": 0,
	            "CpuPercent": 0,
	            "IOMaximumIOps": 0,
	            "IOMaximumBandwidth": 0,
	            "MaskedPaths": null,
	            "ReadonlyPaths": null
	        },
	        "GraphDriver": {
	            "Data": {
	                "LowerDir": "/var/lib/docker/overlay2/e91acff4005fb62afe258fb62f9898571cc37123138239a601e3a881cbdd1e1b-init/diff:/var/lib/docker/overlay2/735dddc10109a4692c38c0935991764a2c26d0fe2b728ea40f67d848f08ebe53/diff",
	                "MergedDir": "/var/lib/docker/overlay2/e91acff4005fb62afe258fb62f9898571cc37123138239a601e3a881cbdd1e1b/merged",
	                "UpperDir": "/var/lib/docker/overlay2/e91acff4005fb62afe258fb62f9898571cc37123138239a601e3a881cbdd1e1b/diff",
	                "WorkDir": "/var/lib/docker/overlay2/e91acff4005fb62afe258fb62f9898571cc37123138239a601e3a881cbdd1e1b/work"
	            },
	            "Name": "overlay2"
	        },
	        "Mounts": [
	            {
	                "Type": "bind",
	                "Source": "/lib/modules",
	                "Destination": "/lib/modules",
	                "Mode": "ro",
	                "RW": false,
	                "Propagation": "rprivate"
	            },
	            {
	                "Type": "volume",
	                "Name": "addons-371349",
	                "Source": "/var/lib/docker/volumes/addons-371349/_data",
	                "Destination": "/var",
	                "Driver": "local",
	                "Mode": "z",
	                "RW": true,
	                "Propagation": ""
	            }
	        ],
	        "Config": {
	            "Hostname": "addons-371349",
	            "Domainname": "",
	            "User": "",
	            "AttachStdin": false,
	            "AttachStdout": false,
	            "AttachStderr": false,
	            "ExposedPorts": {
	                "22/tcp": {},
	                "2376/tcp": {},
	                "32443/tcp": {},
	                "5000/tcp": {},
	                "8443/tcp": {}
	            },
	            "Tty": true,
	            "OpenStdin": false,
	            "StdinOnce": false,
	            "Env": [
	                "container=docker",
	                "PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin"
	            ],
	            "Cmd": null,
	            "Image": "gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1727108449-19696@sha256:c662152d8855bc4c62a3b5786a68adf99e04794e7f8f374a3859703004ef1d21",
	            "Volumes": null,
	            "WorkingDir": "/",
	            "Entrypoint": [
	                "/usr/local/bin/entrypoint",
	                "/sbin/init"
	            ],
	            "OnBuild": null,
	            "Labels": {
	                "created_by.minikube.sigs.k8s.io": "true",
	                "mode.minikube.sigs.k8s.io": "addons-371349",
	                "name.minikube.sigs.k8s.io": "addons-371349",
	                "role.minikube.sigs.k8s.io": ""
	            },
	            "StopSignal": "SIGRTMIN+3"
	        },
	        "NetworkSettings": {
	            "Bridge": "",
	            "SandboxID": "6123761140dfb026c95c608d0564f7e7218831275b56b2c427350d3e2135d530",
	            "SandboxKey": "/var/run/docker/netns/6123761140df",
	            "Ports": {
	                "22/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": "34691"
	                    }
	                ],
	                "2376/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": "34692"
	                    }
	                ],
	                "32443/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": "34695"
	                    }
	                ],
	                "5000/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": "34693"
	                    }
	                ],
	                "8443/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": "34694"
	                    }
	                ]
	            },
	            "HairpinMode": false,
	            "LinkLocalIPv6Address": "",
	            "LinkLocalIPv6PrefixLen": 0,
	            "SecondaryIPAddresses": null,
	            "SecondaryIPv6Addresses": null,
	            "EndpointID": "",
	            "Gateway": "",
	            "GlobalIPv6Address": "",
	            "GlobalIPv6PrefixLen": 0,
	            "IPAddress": "",
	            "IPPrefixLen": 0,
	            "IPv6Gateway": "",
	            "MacAddress": "",
	            "Networks": {
	                "addons-371349": {
	                    "IPAMConfig": {
	                        "IPv4Address": "192.168.49.2"
	                    },
	                    "Links": null,
	                    "Aliases": null,
	                    "MacAddress": "02:42:c0:a8:31:02",
	                    "DriverOpts": null,
	                    "NetworkID": "be9e2c6d19f89ddf9ec936595a5357e0be10be979e62c375249fb6ea67bee4cf",
	                    "EndpointID": "e0512c175a378c9907b238498536bb0bcd513ef87034a8ccde9159fad0a75e37",
	                    "Gateway": "192.168.49.1",
	                    "IPAddress": "192.168.49.2",
	                    "IPPrefixLen": 24,
	                    "IPv6Gateway": "",
	                    "GlobalIPv6Address": "",
	                    "GlobalIPv6PrefixLen": 0,
	                    "DNSNames": [
	                        "addons-371349",
	                        "57a8c5c84538"
	                    ]
	                }
	            }
	        }
	    }
	]

                                                
                                                
-- /stdout --
helpers_test.go:239: (dbg) Run:  out/minikube-linux-arm64 status --format={{.Host}} -p addons-371349 -n addons-371349
helpers_test.go:244: <<< TestAddons/parallel/MetricsServer FAILED: start of post-mortem logs <<<
helpers_test.go:245: ======>  post-mortem[TestAddons/parallel/MetricsServer]: minikube logs <======
helpers_test.go:247: (dbg) Run:  out/minikube-linux-arm64 -p addons-371349 logs -n 25
helpers_test.go:247: (dbg) Done: out/minikube-linux-arm64 -p addons-371349 logs -n 25: (1.514167013s)
helpers_test.go:252: TestAddons/parallel/MetricsServer logs: 
-- stdout --
	
	==> Audit <==
	|---------|---------------------------------------------------------------------------------------------|------------------------|---------|---------|---------------------|---------------------|
	| Command |                                            Args                                             |        Profile         |  User   | Version |     Start Time      |      End Time       |
	|---------|---------------------------------------------------------------------------------------------|------------------------|---------|---------|---------------------|---------------------|
	| delete  | -p download-only-684560                                                                     | download-only-684560   | jenkins | v1.34.0 | 24 Sep 24 00:35 UTC | 24 Sep 24 00:35 UTC |
	| start   | --download-only -p                                                                          | download-docker-626931 | jenkins | v1.34.0 | 24 Sep 24 00:35 UTC |                     |
	|         | download-docker-626931                                                                      |                        |         |         |                     |                     |
	|         | --alsologtostderr                                                                           |                        |         |         |                     |                     |
	|         | --driver=docker                                                                             |                        |         |         |                     |                     |
	|         | --container-runtime=crio                                                                    |                        |         |         |                     |                     |
	| delete  | -p download-docker-626931                                                                   | download-docker-626931 | jenkins | v1.34.0 | 24 Sep 24 00:35 UTC | 24 Sep 24 00:35 UTC |
	| start   | --download-only -p                                                                          | binary-mirror-425965   | jenkins | v1.34.0 | 24 Sep 24 00:35 UTC |                     |
	|         | binary-mirror-425965                                                                        |                        |         |         |                     |                     |
	|         | --alsologtostderr                                                                           |                        |         |         |                     |                     |
	|         | --binary-mirror                                                                             |                        |         |         |                     |                     |
	|         | http://127.0.0.1:41845                                                                      |                        |         |         |                     |                     |
	|         | --driver=docker                                                                             |                        |         |         |                     |                     |
	|         | --container-runtime=crio                                                                    |                        |         |         |                     |                     |
	| delete  | -p binary-mirror-425965                                                                     | binary-mirror-425965   | jenkins | v1.34.0 | 24 Sep 24 00:35 UTC | 24 Sep 24 00:35 UTC |
	| addons  | enable dashboard -p                                                                         | addons-371349          | jenkins | v1.34.0 | 24 Sep 24 00:35 UTC |                     |
	|         | addons-371349                                                                               |                        |         |         |                     |                     |
	| addons  | disable dashboard -p                                                                        | addons-371349          | jenkins | v1.34.0 | 24 Sep 24 00:35 UTC |                     |
	|         | addons-371349                                                                               |                        |         |         |                     |                     |
	| start   | -p addons-371349 --wait=true                                                                | addons-371349          | jenkins | v1.34.0 | 24 Sep 24 00:35 UTC | 24 Sep 24 00:39 UTC |
	|         | --memory=4000 --alsologtostderr                                                             |                        |         |         |                     |                     |
	|         | --addons=registry                                                                           |                        |         |         |                     |                     |
	|         | --addons=metrics-server                                                                     |                        |         |         |                     |                     |
	|         | --addons=volumesnapshots                                                                    |                        |         |         |                     |                     |
	|         | --addons=csi-hostpath-driver                                                                |                        |         |         |                     |                     |
	|         | --addons=gcp-auth                                                                           |                        |         |         |                     |                     |
	|         | --addons=cloud-spanner                                                                      |                        |         |         |                     |                     |
	|         | --addons=inspektor-gadget                                                                   |                        |         |         |                     |                     |
	|         | --addons=storage-provisioner-rancher                                                        |                        |         |         |                     |                     |
	|         | --addons=nvidia-device-plugin                                                               |                        |         |         |                     |                     |
	|         | --addons=yakd --addons=volcano                                                              |                        |         |         |                     |                     |
	|         | --driver=docker                                                                             |                        |         |         |                     |                     |
	|         | --container-runtime=crio                                                                    |                        |         |         |                     |                     |
	|         | --addons=ingress                                                                            |                        |         |         |                     |                     |
	|         | --addons=ingress-dns                                                                        |                        |         |         |                     |                     |
	| addons  | enable headlamp                                                                             | addons-371349          | jenkins | v1.34.0 | 24 Sep 24 00:47 UTC | 24 Sep 24 00:47 UTC |
	|         | -p addons-371349                                                                            |                        |         |         |                     |                     |
	|         | --alsologtostderr -v=1                                                                      |                        |         |         |                     |                     |
	| addons  | addons-371349 addons disable                                                                | addons-371349          | jenkins | v1.34.0 | 24 Sep 24 00:47 UTC | 24 Sep 24 00:47 UTC |
	|         | headlamp --alsologtostderr                                                                  |                        |         |         |                     |                     |
	|         | -v=1                                                                                        |                        |         |         |                     |                     |
	| addons  | addons-371349 addons                                                                        | addons-371349          | jenkins | v1.34.0 | 24 Sep 24 00:48 UTC | 24 Sep 24 00:48 UTC |
	|         | disable csi-hostpath-driver                                                                 |                        |         |         |                     |                     |
	|         | --alsologtostderr -v=1                                                                      |                        |         |         |                     |                     |
	| ip      | addons-371349 ip                                                                            | addons-371349          | jenkins | v1.34.0 | 24 Sep 24 00:48 UTC | 24 Sep 24 00:48 UTC |
	| addons  | addons-371349 addons disable                                                                | addons-371349          | jenkins | v1.34.0 | 24 Sep 24 00:48 UTC | 24 Sep 24 00:48 UTC |
	|         | registry --alsologtostderr                                                                  |                        |         |         |                     |                     |
	|         | -v=1                                                                                        |                        |         |         |                     |                     |
	| addons  | addons-371349 addons                                                                        | addons-371349          | jenkins | v1.34.0 | 24 Sep 24 00:48 UTC | 24 Sep 24 00:48 UTC |
	|         | disable volumesnapshots                                                                     |                        |         |         |                     |                     |
	|         | --alsologtostderr -v=1                                                                      |                        |         |         |                     |                     |
	| addons  | disable inspektor-gadget -p                                                                 | addons-371349          | jenkins | v1.34.0 | 24 Sep 24 00:48 UTC | 24 Sep 24 00:48 UTC |
	|         | addons-371349                                                                               |                        |         |         |                     |                     |
	| ssh     | addons-371349 ssh curl -s                                                                   | addons-371349          | jenkins | v1.34.0 | 24 Sep 24 00:48 UTC |                     |
	|         | http://127.0.0.1/ -H 'Host:                                                                 |                        |         |         |                     |                     |
	|         | nginx.example.com'                                                                          |                        |         |         |                     |                     |
	| ip      | addons-371349 ip                                                                            | addons-371349          | jenkins | v1.34.0 | 24 Sep 24 00:51 UTC | 24 Sep 24 00:51 UTC |
	| addons  | addons-371349 addons disable                                                                | addons-371349          | jenkins | v1.34.0 | 24 Sep 24 00:51 UTC | 24 Sep 24 00:51 UTC |
	|         | ingress-dns --alsologtostderr                                                               |                        |         |         |                     |                     |
	|         | -v=1                                                                                        |                        |         |         |                     |                     |
	| addons  | addons-371349 addons disable                                                                | addons-371349          | jenkins | v1.34.0 | 24 Sep 24 00:51 UTC | 24 Sep 24 00:51 UTC |
	|         | ingress --alsologtostderr -v=1                                                              |                        |         |         |                     |                     |
	| addons  | addons-371349 addons disable                                                                | addons-371349          | jenkins | v1.34.0 | 24 Sep 24 00:51 UTC | 24 Sep 24 00:51 UTC |
	|         | yakd --alsologtostderr -v=1                                                                 |                        |         |         |                     |                     |
	| addons  | disable nvidia-device-plugin                                                                | addons-371349          | jenkins | v1.34.0 | 24 Sep 24 00:51 UTC | 24 Sep 24 00:51 UTC |
	|         | -p addons-371349                                                                            |                        |         |         |                     |                     |
	| ssh     | addons-371349 ssh cat                                                                       | addons-371349          | jenkins | v1.34.0 | 24 Sep 24 00:51 UTC | 24 Sep 24 00:51 UTC |
	|         | /opt/local-path-provisioner/pvc-d27a0d1d-621b-4281-ad84-3736d4ad810f_default_test-pvc/file1 |                        |         |         |                     |                     |
	| addons  | addons-371349 addons disable                                                                | addons-371349          | jenkins | v1.34.0 | 24 Sep 24 00:51 UTC | 24 Sep 24 00:52 UTC |
	|         | storage-provisioner-rancher                                                                 |                        |         |         |                     |                     |
	|         | --alsologtostderr -v=1                                                                      |                        |         |         |                     |                     |
	| addons  | disable cloud-spanner -p                                                                    | addons-371349          | jenkins | v1.34.0 | 24 Sep 24 00:52 UTC | 24 Sep 24 00:52 UTC |
	|         | addons-371349                                                                               |                        |         |         |                     |                     |
	| addons  | addons-371349 addons                                                                        | addons-371349          | jenkins | v1.34.0 | 24 Sep 24 00:54 UTC | 24 Sep 24 00:54 UTC |
	|         | disable metrics-server                                                                      |                        |         |         |                     |                     |
	|         | --alsologtostderr -v=1                                                                      |                        |         |         |                     |                     |
	|---------|---------------------------------------------------------------------------------------------|------------------------|---------|---------|---------------------|---------------------|
	
	
	==> Last Start <==
	Log file created at: 2024/09/24 00:35:31
	Running on machine: ip-172-31-21-244
	Binary: Built with gc go1.23.0 for linux/arm64
	Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg
	I0924 00:35:31.109111 1874359 out.go:345] Setting OutFile to fd 1 ...
	I0924 00:35:31.109491 1874359 out.go:392] TERM=,COLORTERM=, which probably does not support color
	I0924 00:35:31.109508 1874359 out.go:358] Setting ErrFile to fd 2...
	I0924 00:35:31.109515 1874359 out.go:392] TERM=,COLORTERM=, which probably does not support color
	I0924 00:35:31.109789 1874359 root.go:338] Updating PATH: /home/jenkins/minikube-integration/19696-1868219/.minikube/bin
	I0924 00:35:31.110290 1874359 out.go:352] Setting JSON to false
	I0924 00:35:31.111147 1874359 start.go:129] hostinfo: {"hostname":"ip-172-31-21-244","uptime":29881,"bootTime":1727108250,"procs":155,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1070-aws","kernelArch":"aarch64","virtualizationSystem":"","virtualizationRole":"","hostId":"da8ac1fd-6236-412a-a346-95873c98230d"}
	I0924 00:35:31.111237 1874359 start.go:139] virtualization:  
	I0924 00:35:31.114409 1874359 out.go:177] * [addons-371349] minikube v1.34.0 on Ubuntu 20.04 (arm64)
	I0924 00:35:31.117918 1874359 out.go:177]   - MINIKUBE_LOCATION=19696
	I0924 00:35:31.118029 1874359 notify.go:220] Checking for updates...
	I0924 00:35:31.123440 1874359 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I0924 00:35:31.126227 1874359 out.go:177]   - KUBECONFIG=/home/jenkins/minikube-integration/19696-1868219/kubeconfig
	I0924 00:35:31.128996 1874359 out.go:177]   - MINIKUBE_HOME=/home/jenkins/minikube-integration/19696-1868219/.minikube
	I0924 00:35:31.131696 1874359 out.go:177]   - MINIKUBE_BIN=out/minikube-linux-arm64
	I0924 00:35:31.134392 1874359 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=
	I0924 00:35:31.137411 1874359 driver.go:394] Setting default libvirt URI to qemu:///system
	I0924 00:35:31.166048 1874359 docker.go:123] docker version: linux-27.3.1:Docker Engine - Community
	I0924 00:35:31.166177 1874359 cli_runner.go:164] Run: docker system info --format "{{json .}}"
	I0924 00:35:31.216117 1874359 info.go:266] docker info: {ID:5FDH:SA5P:5GCT:NLAS:B73P:SGDQ:PBG5:UBVH:UZY3:RXGO:CI7S:WAIH Containers:0 ContainersRunning:0 ContainersPaused:0 ContainersStopped:0 Images:1 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:false BridgeNfIP6Tables:false Debug:false NFd:29 OomKillDisable:true NGoroutines:44 SystemTime:2024-09-24 00:35:31.206607126 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1070-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Architecture:a
arch64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8214831104 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-21-244 Labels:[] ExperimentalBuild:false ServerVersion:27.3.1 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:7f7fdf5fed64eb6a7caf99b3e12efcf9d60e311c Expected:7f7fdf5fed64eb6a7caf99b3e12efcf9d60e311c} RuncCommit:{ID:v1.1.14-0-g2c9f560 Expected:v1.1.14-0-g2c9f560} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:[WARNING: brid
ge-nf-call-iptables is disabled WARNING: bridge-nf-call-ip6tables is disabled] ServerErrors:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.17.1] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.29.7]] Warnings:<nil>}}
	I0924 00:35:31.216230 1874359 docker.go:318] overlay module found
	I0924 00:35:31.220866 1874359 out.go:177] * Using the docker driver based on user configuration
	I0924 00:35:31.223404 1874359 start.go:297] selected driver: docker
	I0924 00:35:31.223428 1874359 start.go:901] validating driver "docker" against <nil>
	I0924 00:35:31.223442 1874359 start.go:912] status for docker: {Installed:true Healthy:true Running:false NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I0924 00:35:31.224063 1874359 cli_runner.go:164] Run: docker system info --format "{{json .}}"
	I0924 00:35:31.276460 1874359 info.go:266] docker info: {ID:5FDH:SA5P:5GCT:NLAS:B73P:SGDQ:PBG5:UBVH:UZY3:RXGO:CI7S:WAIH Containers:0 ContainersRunning:0 ContainersPaused:0 ContainersStopped:0 Images:1 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:false BridgeNfIP6Tables:false Debug:false NFd:29 OomKillDisable:true NGoroutines:44 SystemTime:2024-09-24 00:35:31.267813232 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1070-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Architecture:a
arch64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8214831104 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-21-244 Labels:[] ExperimentalBuild:false ServerVersion:27.3.1 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:7f7fdf5fed64eb6a7caf99b3e12efcf9d60e311c Expected:7f7fdf5fed64eb6a7caf99b3e12efcf9d60e311c} RuncCommit:{ID:v1.1.14-0-g2c9f560 Expected:v1.1.14-0-g2c9f560} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:[WARNING: brid
ge-nf-call-iptables is disabled WARNING: bridge-nf-call-ip6tables is disabled] ServerErrors:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.17.1] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.29.7]] Warnings:<nil>}}
	I0924 00:35:31.276667 1874359 start_flags.go:310] no existing cluster config was found, will generate one from the flags 
	I0924 00:35:31.276886 1874359 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
	I0924 00:35:31.279511 1874359 out.go:177] * Using Docker driver with root privileges
	I0924 00:35:31.281994 1874359 cni.go:84] Creating CNI manager for ""
	I0924 00:35:31.282050 1874359 cni.go:143] "docker" driver + "crio" runtime found, recommending kindnet
	I0924 00:35:31.282068 1874359 start_flags.go:319] Found "CNI" CNI - setting NetworkPlugin=cni
	I0924 00:35:31.282150 1874359 start.go:340] cluster config:
	{Name:addons-371349 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1727108449-19696@sha256:c662152d8855bc4c62a3b5786a68adf99e04794e7f8f374a3859703004ef1d21 Memory:4000 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.31.1 ClusterName:addons-371349 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime
:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.31.1 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSH
AgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I0924 00:35:31.284989 1874359 out.go:177] * Starting "addons-371349" primary control-plane node in "addons-371349" cluster
	I0924 00:35:31.287549 1874359 cache.go:121] Beginning downloading kic base image for docker with crio
	I0924 00:35:31.290177 1874359 out.go:177] * Pulling base image v0.0.45-1727108449-19696 ...
	I0924 00:35:31.292696 1874359 preload.go:131] Checking if preload exists for k8s version v1.31.1 and runtime crio
	I0924 00:35:31.292745 1874359 preload.go:146] Found local preload: /home/jenkins/minikube-integration/19696-1868219/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.1-cri-o-overlay-arm64.tar.lz4
	I0924 00:35:31.292758 1874359 cache.go:56] Caching tarball of preloaded images
	I0924 00:35:31.292786 1874359 image.go:79] Checking for gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1727108449-19696@sha256:c662152d8855bc4c62a3b5786a68adf99e04794e7f8f374a3859703004ef1d21 in local docker daemon
	I0924 00:35:31.292840 1874359 preload.go:172] Found /home/jenkins/minikube-integration/19696-1868219/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.1-cri-o-overlay-arm64.tar.lz4 in cache, skipping download
	I0924 00:35:31.292867 1874359 cache.go:59] Finished verifying existence of preloaded tar for v1.31.1 on crio
	I0924 00:35:31.293251 1874359 profile.go:143] Saving config to /home/jenkins/minikube-integration/19696-1868219/.minikube/profiles/addons-371349/config.json ...
	I0924 00:35:31.293286 1874359 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19696-1868219/.minikube/profiles/addons-371349/config.json: {Name:mk25e4dccbe4a04f50b9042bd55717678de78632 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0924 00:35:31.307591 1874359 cache.go:149] Downloading gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1727108449-19696@sha256:c662152d8855bc4c62a3b5786a68adf99e04794e7f8f374a3859703004ef1d21 to local cache
	I0924 00:35:31.307736 1874359 image.go:63] Checking for gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1727108449-19696@sha256:c662152d8855bc4c62a3b5786a68adf99e04794e7f8f374a3859703004ef1d21 in local cache directory
	I0924 00:35:31.307757 1874359 image.go:66] Found gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1727108449-19696@sha256:c662152d8855bc4c62a3b5786a68adf99e04794e7f8f374a3859703004ef1d21 in local cache directory, skipping pull
	I0924 00:35:31.307762 1874359 image.go:135] gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1727108449-19696@sha256:c662152d8855bc4c62a3b5786a68adf99e04794e7f8f374a3859703004ef1d21 exists in cache, skipping pull
	I0924 00:35:31.307770 1874359 cache.go:152] successfully saved gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1727108449-19696@sha256:c662152d8855bc4c62a3b5786a68adf99e04794e7f8f374a3859703004ef1d21 as a tarball
	I0924 00:35:31.307777 1874359 cache.go:162] Loading gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1727108449-19696@sha256:c662152d8855bc4c62a3b5786a68adf99e04794e7f8f374a3859703004ef1d21 from local cache
	I0924 00:35:47.930605 1874359 cache.go:164] successfully loaded and using gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1727108449-19696@sha256:c662152d8855bc4c62a3b5786a68adf99e04794e7f8f374a3859703004ef1d21 from cached tarball
	I0924 00:35:47.930645 1874359 cache.go:194] Successfully downloaded all kic artifacts
	I0924 00:35:47.930688 1874359 start.go:360] acquireMachinesLock for addons-371349: {Name:mkeb51f9a926e24ae39fcb6cc62e0aeb3a530af2 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0924 00:35:47.930830 1874359 start.go:364] duration metric: took 117.765µs to acquireMachinesLock for "addons-371349"
	I0924 00:35:47.930862 1874359 start.go:93] Provisioning new machine with config: &{Name:addons-371349 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1727108449-19696@sha256:c662152d8855bc4c62a3b5786a68adf99e04794e7f8f374a3859703004ef1d21 Memory:4000 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.31.1 ClusterName:addons-371349 Namespace:default APIServerHAVIP: APIServerName:min
ikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.31.1 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQe
muFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.31.1 ContainerRuntime:crio ControlPlane:true Worker:true}
	I0924 00:35:47.930941 1874359 start.go:125] createHost starting for "" (driver="docker")
	I0924 00:35:47.933040 1874359 out.go:235] * Creating docker container (CPUs=2, Memory=4000MB) ...
	I0924 00:35:47.933312 1874359 start.go:159] libmachine.API.Create for "addons-371349" (driver="docker")
	I0924 00:35:47.933350 1874359 client.go:168] LocalClient.Create starting
	I0924 00:35:47.933471 1874359 main.go:141] libmachine: Creating CA: /home/jenkins/minikube-integration/19696-1868219/.minikube/certs/ca.pem
	I0924 00:35:48.485151 1874359 main.go:141] libmachine: Creating client certificate: /home/jenkins/minikube-integration/19696-1868219/.minikube/certs/cert.pem
	I0924 00:35:48.899244 1874359 cli_runner.go:164] Run: docker network inspect addons-371349 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
	W0924 00:35:48.913303 1874359 cli_runner.go:211] docker network inspect addons-371349 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}" returned with exit code 1
	I0924 00:35:48.913397 1874359 network_create.go:284] running [docker network inspect addons-371349] to gather additional debugging logs...
	I0924 00:35:48.913419 1874359 cli_runner.go:164] Run: docker network inspect addons-371349
	W0924 00:35:48.929353 1874359 cli_runner.go:211] docker network inspect addons-371349 returned with exit code 1
	I0924 00:35:48.929392 1874359 network_create.go:287] error running [docker network inspect addons-371349]: docker network inspect addons-371349: exit status 1
	stdout:
	[]
	
	stderr:
	Error response from daemon: network addons-371349 not found
	I0924 00:35:48.929405 1874359 network_create.go:289] output of [docker network inspect addons-371349]: -- stdout --
	[]
	
	-- /stdout --
	** stderr ** 
	Error response from daemon: network addons-371349 not found
	
	** /stderr **
	I0924 00:35:48.929518 1874359 cli_runner.go:164] Run: docker network inspect bridge --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
	I0924 00:35:48.943684 1874359 network.go:206] using free private subnet 192.168.49.0/24: &{IP:192.168.49.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.49.0/24 Gateway:192.168.49.1 ClientMin:192.168.49.2 ClientMax:192.168.49.254 Broadcast:192.168.49.255 IsPrivate:true Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:} reservation:0x4001802f60}
	I0924 00:35:48.943730 1874359 network_create.go:124] attempt to create docker network addons-371349 192.168.49.0/24 with gateway 192.168.49.1 and MTU of 1500 ...
	I0924 00:35:48.943786 1874359 cli_runner.go:164] Run: docker network create --driver=bridge --subnet=192.168.49.0/24 --gateway=192.168.49.1 -o --ip-masq -o --icc -o com.docker.network.driver.mtu=1500 --label=created_by.minikube.sigs.k8s.io=true --label=name.minikube.sigs.k8s.io=addons-371349 addons-371349
	I0924 00:35:49.025468 1874359 network_create.go:108] docker network addons-371349 192.168.49.0/24 created
	I0924 00:35:49.025507 1874359 kic.go:121] calculated static IP "192.168.49.2" for the "addons-371349" container
	I0924 00:35:49.025584 1874359 cli_runner.go:164] Run: docker ps -a --format {{.Names}}
	I0924 00:35:49.040911 1874359 cli_runner.go:164] Run: docker volume create addons-371349 --label name.minikube.sigs.k8s.io=addons-371349 --label created_by.minikube.sigs.k8s.io=true
	I0924 00:35:49.057606 1874359 oci.go:103] Successfully created a docker volume addons-371349
	I0924 00:35:49.057704 1874359 cli_runner.go:164] Run: docker run --rm --name addons-371349-preload-sidecar --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=addons-371349 --entrypoint /usr/bin/test -v addons-371349:/var gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1727108449-19696@sha256:c662152d8855bc4c62a3b5786a68adf99e04794e7f8f374a3859703004ef1d21 -d /var/lib
	I0924 00:35:50.959914 1874359 cli_runner.go:217] Completed: docker run --rm --name addons-371349-preload-sidecar --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=addons-371349 --entrypoint /usr/bin/test -v addons-371349:/var gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1727108449-19696@sha256:c662152d8855bc4c62a3b5786a68adf99e04794e7f8f374a3859703004ef1d21 -d /var/lib: (1.902161651s)
	I0924 00:35:50.959945 1874359 oci.go:107] Successfully prepared a docker volume addons-371349
	I0924 00:35:50.959970 1874359 preload.go:131] Checking if preload exists for k8s version v1.31.1 and runtime crio
	I0924 00:35:50.959994 1874359 kic.go:194] Starting extracting preloaded images to volume ...
	I0924 00:35:50.960061 1874359 cli_runner.go:164] Run: docker run --rm --entrypoint /usr/bin/tar -v /home/jenkins/minikube-integration/19696-1868219/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.1-cri-o-overlay-arm64.tar.lz4:/preloaded.tar:ro -v addons-371349:/extractDir gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1727108449-19696@sha256:c662152d8855bc4c62a3b5786a68adf99e04794e7f8f374a3859703004ef1d21 -I lz4 -xf /preloaded.tar -C /extractDir
	I0924 00:35:54.945988 1874359 cli_runner.go:217] Completed: docker run --rm --entrypoint /usr/bin/tar -v /home/jenkins/minikube-integration/19696-1868219/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.1-cri-o-overlay-arm64.tar.lz4:/preloaded.tar:ro -v addons-371349:/extractDir gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1727108449-19696@sha256:c662152d8855bc4c62a3b5786a68adf99e04794e7f8f374a3859703004ef1d21 -I lz4 -xf /preloaded.tar -C /extractDir: (3.985880116s)
	I0924 00:35:54.946022 1874359 kic.go:203] duration metric: took 3.986025819s to extract preloaded images to volume ...
	W0924 00:35:54.946152 1874359 cgroups_linux.go:77] Your kernel does not support swap limit capabilities or the cgroup is not mounted.
	I0924 00:35:54.946256 1874359 cli_runner.go:164] Run: docker info --format "'{{json .SecurityOptions}}'"
	I0924 00:35:54.988942 1874359 cli_runner.go:164] Run: docker run -d -t --privileged --security-opt seccomp=unconfined --tmpfs /tmp --tmpfs /run -v /lib/modules:/lib/modules:ro --hostname addons-371349 --name addons-371349 --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=addons-371349 --label role.minikube.sigs.k8s.io= --label mode.minikube.sigs.k8s.io=addons-371349 --network addons-371349 --ip 192.168.49.2 --volume addons-371349:/var --security-opt apparmor=unconfined --memory=4000mb --cpus=2 -e container=docker --expose 8443 --publish=127.0.0.1::8443 --publish=127.0.0.1::22 --publish=127.0.0.1::2376 --publish=127.0.0.1::5000 --publish=127.0.0.1::32443 gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1727108449-19696@sha256:c662152d8855bc4c62a3b5786a68adf99e04794e7f8f374a3859703004ef1d21
	I0924 00:35:55.293958 1874359 cli_runner.go:164] Run: docker container inspect addons-371349 --format={{.State.Running}}
	I0924 00:35:55.320780 1874359 cli_runner.go:164] Run: docker container inspect addons-371349 --format={{.State.Status}}
	I0924 00:35:55.340642 1874359 cli_runner.go:164] Run: docker exec addons-371349 stat /var/lib/dpkg/alternatives/iptables
	I0924 00:35:55.397834 1874359 oci.go:144] the created container "addons-371349" has a running status.
	I0924 00:35:55.397864 1874359 kic.go:225] Creating ssh key for kic: /home/jenkins/minikube-integration/19696-1868219/.minikube/machines/addons-371349/id_rsa...
	I0924 00:35:55.675510 1874359 kic_runner.go:191] docker (temp): /home/jenkins/minikube-integration/19696-1868219/.minikube/machines/addons-371349/id_rsa.pub --> /home/docker/.ssh/authorized_keys (381 bytes)
	I0924 00:35:55.699212 1874359 cli_runner.go:164] Run: docker container inspect addons-371349 --format={{.State.Status}}
	I0924 00:35:55.726400 1874359 kic_runner.go:93] Run: chown docker:docker /home/docker/.ssh/authorized_keys
	I0924 00:35:55.726420 1874359 kic_runner.go:114] Args: [docker exec --privileged addons-371349 chown docker:docker /home/docker/.ssh/authorized_keys]
	I0924 00:35:55.806108 1874359 cli_runner.go:164] Run: docker container inspect addons-371349 --format={{.State.Status}}
	I0924 00:35:55.829052 1874359 machine.go:93] provisionDockerMachine start ...
	I0924 00:35:55.829141 1874359 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-371349
	I0924 00:35:55.851370 1874359 main.go:141] libmachine: Using SSH client type: native
	I0924 00:35:55.851622 1874359 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x413650] 0x415e90 <nil>  [] 0s} 127.0.0.1 34691 <nil> <nil>}
	I0924 00:35:55.851638 1874359 main.go:141] libmachine: About to run SSH command:
	hostname
	I0924 00:35:56.037194 1874359 main.go:141] libmachine: SSH cmd err, output: <nil>: addons-371349
	
	I0924 00:35:56.037220 1874359 ubuntu.go:169] provisioning hostname "addons-371349"
	I0924 00:35:56.037293 1874359 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-371349
	I0924 00:35:56.078692 1874359 main.go:141] libmachine: Using SSH client type: native
	I0924 00:35:56.079000 1874359 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x413650] 0x415e90 <nil>  [] 0s} 127.0.0.1 34691 <nil> <nil>}
	I0924 00:35:56.079012 1874359 main.go:141] libmachine: About to run SSH command:
	sudo hostname addons-371349 && echo "addons-371349" | sudo tee /etc/hostname
	I0924 00:35:56.226092 1874359 main.go:141] libmachine: SSH cmd err, output: <nil>: addons-371349
	
	I0924 00:35:56.226258 1874359 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-371349
	I0924 00:35:56.244833 1874359 main.go:141] libmachine: Using SSH client type: native
	I0924 00:35:56.245089 1874359 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x413650] 0x415e90 <nil>  [] 0s} 127.0.0.1 34691 <nil> <nil>}
	I0924 00:35:56.245106 1874359 main.go:141] libmachine: About to run SSH command:
	
			if ! grep -xq '.*\saddons-371349' /etc/hosts; then
				if grep -xq '127.0.1.1\s.*' /etc/hosts; then
					sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 addons-371349/g' /etc/hosts;
				else 
					echo '127.0.1.1 addons-371349' | sudo tee -a /etc/hosts; 
				fi
			fi
	I0924 00:35:56.381804 1874359 main.go:141] libmachine: SSH cmd err, output: <nil>: 
	I0924 00:35:56.381859 1874359 ubuntu.go:175] set auth options {CertDir:/home/jenkins/minikube-integration/19696-1868219/.minikube CaCertPath:/home/jenkins/minikube-integration/19696-1868219/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/19696-1868219/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/19696-1868219/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/19696-1868219/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/19696-1868219/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/19696-1868219/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/19696-1868219/.minikube}
	I0924 00:35:56.381886 1874359 ubuntu.go:177] setting up certificates
	I0924 00:35:56.381895 1874359 provision.go:84] configureAuth start
	I0924 00:35:56.381956 1874359 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" addons-371349
	I0924 00:35:56.400509 1874359 provision.go:143] copyHostCerts
	I0924 00:35:56.400599 1874359 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19696-1868219/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/19696-1868219/.minikube/ca.pem (1078 bytes)
	I0924 00:35:56.400716 1874359 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19696-1868219/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/19696-1868219/.minikube/cert.pem (1123 bytes)
	I0924 00:35:56.400778 1874359 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19696-1868219/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/19696-1868219/.minikube/key.pem (1675 bytes)
	I0924 00:35:56.400827 1874359 provision.go:117] generating server cert: /home/jenkins/minikube-integration/19696-1868219/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/19696-1868219/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/19696-1868219/.minikube/certs/ca-key.pem org=jenkins.addons-371349 san=[127.0.0.1 192.168.49.2 addons-371349 localhost minikube]
	I0924 00:35:56.572353 1874359 provision.go:177] copyRemoteCerts
	I0924 00:35:56.572422 1874359 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
	I0924 00:35:56.572464 1874359 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-371349
	I0924 00:35:56.588536 1874359 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:34691 SSHKeyPath:/home/jenkins/minikube-integration/19696-1868219/.minikube/machines/addons-371349/id_rsa Username:docker}
	I0924 00:35:56.682342 1874359 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19696-1868219/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1675 bytes)
	I0924 00:35:56.706256 1874359 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19696-1868219/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1078 bytes)
	I0924 00:35:56.729190 1874359 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19696-1868219/.minikube/machines/server.pem --> /etc/docker/server.pem (1208 bytes)
	I0924 00:35:56.752321 1874359 provision.go:87] duration metric: took 370.409574ms to configureAuth
	I0924 00:35:56.752398 1874359 ubuntu.go:193] setting minikube options for container-runtime
	I0924 00:35:56.752599 1874359 config.go:182] Loaded profile config "addons-371349": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.31.1
	I0924 00:35:56.752715 1874359 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-371349
	I0924 00:35:56.768527 1874359 main.go:141] libmachine: Using SSH client type: native
	I0924 00:35:56.768768 1874359 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x413650] 0x415e90 <nil>  [] 0s} 127.0.0.1 34691 <nil> <nil>}
	I0924 00:35:56.768789 1874359 main.go:141] libmachine: About to run SSH command:
	sudo mkdir -p /etc/sysconfig && printf %s "
	CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
	" | sudo tee /etc/sysconfig/crio.minikube && sudo systemctl restart crio
	I0924 00:35:56.992663 1874359 main.go:141] libmachine: SSH cmd err, output: <nil>: 
	CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
	
	I0924 00:35:56.992688 1874359 machine.go:96] duration metric: took 1.163615539s to provisionDockerMachine
	I0924 00:35:56.992698 1874359 client.go:171] duration metric: took 9.059339192s to LocalClient.Create
	I0924 00:35:56.992714 1874359 start.go:167] duration metric: took 9.059403863s to libmachine.API.Create "addons-371349"
	I0924 00:35:56.992724 1874359 start.go:293] postStartSetup for "addons-371349" (driver="docker")
	I0924 00:35:56.992735 1874359 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
	I0924 00:35:56.992800 1874359 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
	I0924 00:35:56.992842 1874359 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-371349
	I0924 00:35:57.012622 1874359 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:34691 SSHKeyPath:/home/jenkins/minikube-integration/19696-1868219/.minikube/machines/addons-371349/id_rsa Username:docker}
	I0924 00:35:57.106644 1874359 ssh_runner.go:195] Run: cat /etc/os-release
	I0924 00:35:57.109707 1874359 main.go:141] libmachine: Couldn't set key VERSION_CODENAME, no corresponding struct field found
	I0924 00:35:57.109744 1874359 main.go:141] libmachine: Couldn't set key PRIVACY_POLICY_URL, no corresponding struct field found
	I0924 00:35:57.109756 1874359 main.go:141] libmachine: Couldn't set key UBUNTU_CODENAME, no corresponding struct field found
	I0924 00:35:57.109764 1874359 info.go:137] Remote host: Ubuntu 22.04.5 LTS
	I0924 00:35:57.109794 1874359 filesync.go:126] Scanning /home/jenkins/minikube-integration/19696-1868219/.minikube/addons for local assets ...
	I0924 00:35:57.109888 1874359 filesync.go:126] Scanning /home/jenkins/minikube-integration/19696-1868219/.minikube/files for local assets ...
	I0924 00:35:57.109917 1874359 start.go:296] duration metric: took 117.186271ms for postStartSetup
	I0924 00:35:57.110231 1874359 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" addons-371349
	I0924 00:35:57.125870 1874359 profile.go:143] Saving config to /home/jenkins/minikube-integration/19696-1868219/.minikube/profiles/addons-371349/config.json ...
	I0924 00:35:57.126157 1874359 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
	I0924 00:35:57.126210 1874359 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-371349
	I0924 00:35:57.141418 1874359 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:34691 SSHKeyPath:/home/jenkins/minikube-integration/19696-1868219/.minikube/machines/addons-371349/id_rsa Username:docker}
	I0924 00:35:57.230247 1874359 ssh_runner.go:195] Run: sh -c "df -BG /var | awk 'NR==2{print $4}'"
	I0924 00:35:57.234447 1874359 start.go:128] duration metric: took 9.303490385s to createHost
	I0924 00:35:57.234475 1874359 start.go:83] releasing machines lock for "addons-371349", held for 9.3036279s
	I0924 00:35:57.234544 1874359 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" addons-371349
	I0924 00:35:57.250134 1874359 ssh_runner.go:195] Run: cat /version.json
	I0924 00:35:57.250192 1874359 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-371349
	I0924 00:35:57.250265 1874359 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/
	I0924 00:35:57.250350 1874359 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-371349
	I0924 00:35:57.266578 1874359 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:34691 SSHKeyPath:/home/jenkins/minikube-integration/19696-1868219/.minikube/machines/addons-371349/id_rsa Username:docker}
	I0924 00:35:57.276682 1874359 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:34691 SSHKeyPath:/home/jenkins/minikube-integration/19696-1868219/.minikube/machines/addons-371349/id_rsa Username:docker}
	I0924 00:35:57.481806 1874359 ssh_runner.go:195] Run: systemctl --version
	I0924 00:35:57.486022 1874359 ssh_runner.go:195] Run: sudo sh -c "podman version >/dev/null"
	I0924 00:35:57.624524 1874359 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"
	I0924 00:35:57.628624 1874359 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f -name *loopback.conf* -not -name *.mk_disabled -exec sh -c "sudo mv {} {}.mk_disabled" ;
	I0924 00:35:57.650226 1874359 cni.go:221] loopback cni configuration disabled: "/etc/cni/net.d/*loopback.conf*" found
	I0924 00:35:57.650317 1874359 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%p, " -exec sh -c "sudo mv {} {}.mk_disabled" ;
	I0924 00:35:57.681941 1874359 cni.go:262] disabled [/etc/cni/net.d/87-podman-bridge.conflist, /etc/cni/net.d/100-crio-bridge.conf] bridge cni config(s)
	I0924 00:35:57.681970 1874359 start.go:495] detecting cgroup driver to use...
	I0924 00:35:57.682003 1874359 detect.go:187] detected "cgroupfs" cgroup driver on host os
	I0924 00:35:57.682055 1874359 ssh_runner.go:195] Run: sudo systemctl stop -f containerd
	I0924 00:35:57.698588 1874359 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd
	I0924 00:35:57.710409 1874359 docker.go:217] disabling cri-docker service (if available) ...
	I0924 00:35:57.710476 1874359 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.socket
	I0924 00:35:57.723312 1874359 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.service
	I0924 00:35:57.738063 1874359 ssh_runner.go:195] Run: sudo systemctl disable cri-docker.socket
	I0924 00:35:57.828486 1874359 ssh_runner.go:195] Run: sudo systemctl mask cri-docker.service
	I0924 00:35:57.919854 1874359 docker.go:233] disabling docker service ...
	I0924 00:35:57.919944 1874359 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket
	I0924 00:35:57.939471 1874359 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service
	I0924 00:35:57.951096 1874359 ssh_runner.go:195] Run: sudo systemctl disable docker.socket
	I0924 00:35:58.033450 1874359 ssh_runner.go:195] Run: sudo systemctl mask docker.service
	I0924 00:35:58.144265 1874359 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker
	I0924 00:35:58.155196 1874359 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///var/run/crio/crio.sock
	" | sudo tee /etc/crictl.yaml"
	I0924 00:35:58.171647 1874359 crio.go:59] configure cri-o to use "registry.k8s.io/pause:3.10" pause image...
	I0924 00:35:58.171732 1874359 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*pause_image = .*$|pause_image = "registry.k8s.io/pause:3.10"|' /etc/crio/crio.conf.d/02-crio.conf"
	I0924 00:35:58.181170 1874359 crio.go:70] configuring cri-o to use "cgroupfs" as cgroup driver...
	I0924 00:35:58.181252 1874359 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*cgroup_manager = .*$|cgroup_manager = "cgroupfs"|' /etc/crio/crio.conf.d/02-crio.conf"
	I0924 00:35:58.191464 1874359 ssh_runner.go:195] Run: sh -c "sudo sed -i '/conmon_cgroup = .*/d' /etc/crio/crio.conf.d/02-crio.conf"
	I0924 00:35:58.202150 1874359 ssh_runner.go:195] Run: sh -c "sudo sed -i '/cgroup_manager = .*/a conmon_cgroup = "pod"' /etc/crio/crio.conf.d/02-crio.conf"
	I0924 00:35:58.211736 1874359 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"
	I0924 00:35:58.220977 1874359 ssh_runner.go:195] Run: sh -c "sudo sed -i '/^ *"net.ipv4.ip_unprivileged_port_start=.*"/d' /etc/crio/crio.conf.d/02-crio.conf"
	I0924 00:35:58.230251 1874359 ssh_runner.go:195] Run: sh -c "sudo grep -q "^ *default_sysctls" /etc/crio/crio.conf.d/02-crio.conf || sudo sed -i '/conmon_cgroup = .*/a default_sysctls = \[\n\]' /etc/crio/crio.conf.d/02-crio.conf"
	I0924 00:35:58.245370 1874359 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^default_sysctls *= *\[|&\n  "net.ipv4.ip_unprivileged_port_start=0",|' /etc/crio/crio.conf.d/02-crio.conf"
	I0924 00:35:58.254984 1874359 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
	I0924 00:35:58.263171 1874359 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
	I0924 00:35:58.271453 1874359 ssh_runner.go:195] Run: sudo systemctl daemon-reload
	I0924 00:35:58.353665 1874359 ssh_runner.go:195] Run: sudo systemctl restart crio
	I0924 00:35:58.467533 1874359 start.go:542] Will wait 60s for socket path /var/run/crio/crio.sock
	I0924 00:35:58.467654 1874359 ssh_runner.go:195] Run: stat /var/run/crio/crio.sock
	I0924 00:35:58.470878 1874359 start.go:563] Will wait 60s for crictl version
	I0924 00:35:58.470953 1874359 ssh_runner.go:195] Run: which crictl
	I0924 00:35:58.474104 1874359 ssh_runner.go:195] Run: sudo /usr/bin/crictl version
	I0924 00:35:58.514452 1874359 start.go:579] Version:  0.1.0
	RuntimeName:  cri-o
	RuntimeVersion:  1.24.6
	RuntimeApiVersion:  v1
	I0924 00:35:58.514567 1874359 ssh_runner.go:195] Run: crio --version
	I0924 00:35:58.551717 1874359 ssh_runner.go:195] Run: crio --version
	I0924 00:35:58.593634 1874359 out.go:177] * Preparing Kubernetes v1.31.1 on CRI-O 1.24.6 ...
	I0924 00:35:58.595974 1874359 cli_runner.go:164] Run: docker network inspect addons-371349 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
	I0924 00:35:58.610785 1874359 ssh_runner.go:195] Run: grep 192.168.49.1	host.minikube.internal$ /etc/hosts
	I0924 00:35:58.614009 1874359 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.49.1	host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
	I0924 00:35:58.624240 1874359 kubeadm.go:883] updating cluster {Name:addons-371349 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1727108449-19696@sha256:c662152d8855bc4c62a3b5786a68adf99e04794e7f8f374a3859703004ef1d21 Memory:4000 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.31.1 ClusterName:addons-371349 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNa
mes:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.49.2 Port:8443 KubernetesVersion:v1.31.1 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmw
arePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} ...
	I0924 00:35:58.624364 1874359 preload.go:131] Checking if preload exists for k8s version v1.31.1 and runtime crio
	I0924 00:35:58.624421 1874359 ssh_runner.go:195] Run: sudo crictl images --output json
	I0924 00:35:58.695904 1874359 crio.go:514] all images are preloaded for cri-o runtime.
	I0924 00:35:58.695928 1874359 crio.go:433] Images already preloaded, skipping extraction
	I0924 00:35:58.695988 1874359 ssh_runner.go:195] Run: sudo crictl images --output json
	I0924 00:35:58.733649 1874359 crio.go:514] all images are preloaded for cri-o runtime.
	I0924 00:35:58.733672 1874359 cache_images.go:84] Images are preloaded, skipping loading
	I0924 00:35:58.733681 1874359 kubeadm.go:934] updating node { 192.168.49.2 8443 v1.31.1 crio true true} ...
	I0924 00:35:58.733785 1874359 kubeadm.go:946] kubelet [Unit]
	Wants=crio.service
	
	[Service]
	ExecStart=
	ExecStart=/var/lib/minikube/binaries/v1.31.1/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --cgroups-per-qos=false --config=/var/lib/kubelet/config.yaml --enforce-node-allocatable= --hostname-override=addons-371349 --kubeconfig=/etc/kubernetes/kubelet.conf --node-ip=192.168.49.2
	
	[Install]
	 config:
	{KubernetesVersion:v1.31.1 ClusterName:addons-371349 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:}
	I0924 00:35:58.733894 1874359 ssh_runner.go:195] Run: crio config
	I0924 00:35:58.802054 1874359 cni.go:84] Creating CNI manager for ""
	I0924 00:35:58.802077 1874359 cni.go:143] "docker" driver + "crio" runtime found, recommending kindnet
	I0924 00:35:58.802089 1874359 kubeadm.go:84] Using pod CIDR: 10.244.0.0/16
	I0924 00:35:58.802112 1874359 kubeadm.go:181] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.49.2 APIServerPort:8443 KubernetesVersion:v1.31.1 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:addons-371349 NodeName:addons-371349 DNSDomain:cluster.local CRISocket:/var/run/crio/crio.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.49.2"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.49.2 CgroupDriver:cgroupfs ClientCAFile:/var/lib/minikube/certs/ca.crt StaticPodPath:/etc/kuberne
tes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[containerRuntimeEndpoint:unix:///var/run/crio/crio.sock hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:true}
	I0924 00:35:58.802254 1874359 kubeadm.go:187] kubeadm config:
	apiVersion: kubeadm.k8s.io/v1beta3
	kind: InitConfiguration
	localAPIEndpoint:
	  advertiseAddress: 192.168.49.2
	  bindPort: 8443
	bootstrapTokens:
	  - groups:
	      - system:bootstrappers:kubeadm:default-node-token
	    ttl: 24h0m0s
	    usages:
	      - signing
	      - authentication
	nodeRegistration:
	  criSocket: unix:///var/run/crio/crio.sock
	  name: "addons-371349"
	  kubeletExtraArgs:
	    node-ip: 192.168.49.2
	  taints: []
	---
	apiVersion: kubeadm.k8s.io/v1beta3
	kind: ClusterConfiguration
	apiServer:
	  certSANs: ["127.0.0.1", "localhost", "192.168.49.2"]
	  extraArgs:
	    enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"
	controllerManager:
	  extraArgs:
	    allocate-node-cidrs: "true"
	    leader-elect: "false"
	scheduler:
	  extraArgs:
	    leader-elect: "false"
	certificatesDir: /var/lib/minikube/certs
	clusterName: mk
	controlPlaneEndpoint: control-plane.minikube.internal:8443
	etcd:
	  local:
	    dataDir: /var/lib/minikube/etcd
	    extraArgs:
	      proxy-refresh-interval: "70000"
	kubernetesVersion: v1.31.1
	networking:
	  dnsDomain: cluster.local
	  podSubnet: "10.244.0.0/16"
	  serviceSubnet: 10.96.0.0/12
	---
	apiVersion: kubelet.config.k8s.io/v1beta1
	kind: KubeletConfiguration
	authentication:
	  x509:
	    clientCAFile: /var/lib/minikube/certs/ca.crt
	cgroupDriver: cgroupfs
	containerRuntimeEndpoint: unix:///var/run/crio/crio.sock
	hairpinMode: hairpin-veth
	runtimeRequestTimeout: 15m
	clusterDomain: "cluster.local"
	# disable disk resource management by default
	imageGCHighThresholdPercent: 100
	evictionHard:
	  nodefs.available: "0%"
	  nodefs.inodesFree: "0%"
	  imagefs.available: "0%"
	failSwapOn: false
	staticPodPath: /etc/kubernetes/manifests
	---
	apiVersion: kubeproxy.config.k8s.io/v1alpha1
	kind: KubeProxyConfiguration
	clusterCIDR: "10.244.0.0/16"
	metricsBindAddress: 0.0.0.0:10249
	conntrack:
	  maxPerCore: 0
	# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"
	  tcpEstablishedTimeout: 0s
	# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"
	  tcpCloseWaitTimeout: 0s
	
	I0924 00:35:58.802327 1874359 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.31.1
	I0924 00:35:58.810920 1874359 binaries.go:44] Found k8s binaries, skipping transfer
	I0924 00:35:58.811007 1874359 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube
	I0924 00:35:58.819212 1874359 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (363 bytes)
	I0924 00:35:58.837724 1874359 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)
	I0924 00:35:58.856038 1874359 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2151 bytes)
	I0924 00:35:58.873780 1874359 ssh_runner.go:195] Run: grep 192.168.49.2	control-plane.minikube.internal$ /etc/hosts
	I0924 00:35:58.877149 1874359 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.49.2	control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
	I0924 00:35:58.887775 1874359 ssh_runner.go:195] Run: sudo systemctl daemon-reload
	I0924 00:35:58.974780 1874359 ssh_runner.go:195] Run: sudo systemctl start kubelet
	I0924 00:35:58.988169 1874359 certs.go:68] Setting up /home/jenkins/minikube-integration/19696-1868219/.minikube/profiles/addons-371349 for IP: 192.168.49.2
	I0924 00:35:58.988244 1874359 certs.go:194] generating shared ca certs ...
	I0924 00:35:58.988287 1874359 certs.go:226] acquiring lock for ca certs: {Name:mk818e75f019a868ef3b3a376623c8523880c0ff Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0924 00:35:58.988471 1874359 certs.go:240] generating "minikubeCA" ca cert: /home/jenkins/minikube-integration/19696-1868219/.minikube/ca.key
	I0924 00:35:59.587260 1874359 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19696-1868219/.minikube/ca.crt ...
	I0924 00:35:59.587293 1874359 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19696-1868219/.minikube/ca.crt: {Name:mke81ea5621d8e9399e452bcb5d27949aa3a3e3f Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0924 00:35:59.588029 1874359 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19696-1868219/.minikube/ca.key ...
	I0924 00:35:59.588046 1874359 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19696-1868219/.minikube/ca.key: {Name:mke396d44ce3103d725d30848cab5b8e6daaf342 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0924 00:35:59.588626 1874359 certs.go:240] generating "proxyClientCA" ca cert: /home/jenkins/minikube-integration/19696-1868219/.minikube/proxy-client-ca.key
	I0924 00:35:59.801877 1874359 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19696-1868219/.minikube/proxy-client-ca.crt ...
	I0924 00:35:59.801907 1874359 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19696-1868219/.minikube/proxy-client-ca.crt: {Name:mka8d81d58c2fe8e182a341cf45abd586bdd7c80 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0924 00:35:59.802595 1874359 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19696-1868219/.minikube/proxy-client-ca.key ...
	I0924 00:35:59.802622 1874359 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19696-1868219/.minikube/proxy-client-ca.key: {Name:mkb2d5aac983abcd6198ab2e82a3a31af20c1be0 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0924 00:35:59.802732 1874359 certs.go:256] generating profile certs ...
	I0924 00:35:59.802795 1874359 certs.go:363] generating signed profile cert for "minikube-user": /home/jenkins/minikube-integration/19696-1868219/.minikube/profiles/addons-371349/client.key
	I0924 00:35:59.802812 1874359 crypto.go:68] Generating cert /home/jenkins/minikube-integration/19696-1868219/.minikube/profiles/addons-371349/client.crt with IP's: []
	I0924 00:36:00.032900 1874359 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19696-1868219/.minikube/profiles/addons-371349/client.crt ...
	I0924 00:36:00.032941 1874359 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19696-1868219/.minikube/profiles/addons-371349/client.crt: {Name:mk0c65c4919d6dbeb99ceefeedc5bb455538bb52 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0924 00:36:00.033160 1874359 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19696-1868219/.minikube/profiles/addons-371349/client.key ...
	I0924 00:36:00.033170 1874359 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19696-1868219/.minikube/profiles/addons-371349/client.key: {Name:mk8703043f4377c7a2b7dcc6d398d1c35642fcec Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0924 00:36:00.033246 1874359 certs.go:363] generating signed profile cert for "minikube": /home/jenkins/minikube-integration/19696-1868219/.minikube/profiles/addons-371349/apiserver.key.2f5d7484
	I0924 00:36:00.033264 1874359 crypto.go:68] Generating cert /home/jenkins/minikube-integration/19696-1868219/.minikube/profiles/addons-371349/apiserver.crt.2f5d7484 with IP's: [10.96.0.1 127.0.0.1 10.0.0.1 192.168.49.2]
	I0924 00:36:00.289276 1874359 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19696-1868219/.minikube/profiles/addons-371349/apiserver.crt.2f5d7484 ...
	I0924 00:36:00.289317 1874359 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19696-1868219/.minikube/profiles/addons-371349/apiserver.crt.2f5d7484: {Name:mk1949bfae5f28a507cc523025a347e01f859e96 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0924 00:36:00.289525 1874359 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19696-1868219/.minikube/profiles/addons-371349/apiserver.key.2f5d7484 ...
	I0924 00:36:00.289542 1874359 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19696-1868219/.minikube/profiles/addons-371349/apiserver.key.2f5d7484: {Name:mk1e2fd43443814467d34e4ff1350d3d0c2858ba Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0924 00:36:00.289633 1874359 certs.go:381] copying /home/jenkins/minikube-integration/19696-1868219/.minikube/profiles/addons-371349/apiserver.crt.2f5d7484 -> /home/jenkins/minikube-integration/19696-1868219/.minikube/profiles/addons-371349/apiserver.crt
	I0924 00:36:00.289714 1874359 certs.go:385] copying /home/jenkins/minikube-integration/19696-1868219/.minikube/profiles/addons-371349/apiserver.key.2f5d7484 -> /home/jenkins/minikube-integration/19696-1868219/.minikube/profiles/addons-371349/apiserver.key
	I0924 00:36:00.289774 1874359 certs.go:363] generating signed profile cert for "aggregator": /home/jenkins/minikube-integration/19696-1868219/.minikube/profiles/addons-371349/proxy-client.key
	I0924 00:36:00.289797 1874359 crypto.go:68] Generating cert /home/jenkins/minikube-integration/19696-1868219/.minikube/profiles/addons-371349/proxy-client.crt with IP's: []
	I0924 00:36:01.184870 1874359 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19696-1868219/.minikube/profiles/addons-371349/proxy-client.crt ...
	I0924 00:36:01.184904 1874359 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19696-1868219/.minikube/profiles/addons-371349/proxy-client.crt: {Name:mk96ef231439e929316cf55529c83e8632d14bf2 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0924 00:36:01.185111 1874359 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19696-1868219/.minikube/profiles/addons-371349/proxy-client.key ...
	I0924 00:36:01.185126 1874359 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19696-1868219/.minikube/profiles/addons-371349/proxy-client.key: {Name:mk30736069b99211f16b83e0f6cbcb537a5e08b3 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0924 00:36:01.186062 1874359 certs.go:484] found cert: /home/jenkins/minikube-integration/19696-1868219/.minikube/certs/ca-key.pem (1675 bytes)
	I0924 00:36:01.186110 1874359 certs.go:484] found cert: /home/jenkins/minikube-integration/19696-1868219/.minikube/certs/ca.pem (1078 bytes)
	I0924 00:36:01.186133 1874359 certs.go:484] found cert: /home/jenkins/minikube-integration/19696-1868219/.minikube/certs/cert.pem (1123 bytes)
	I0924 00:36:01.186163 1874359 certs.go:484] found cert: /home/jenkins/minikube-integration/19696-1868219/.minikube/certs/key.pem (1675 bytes)
	I0924 00:36:01.186798 1874359 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19696-1868219/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
	I0924 00:36:01.211166 1874359 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19696-1868219/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1679 bytes)
	I0924 00:36:01.235382 1874359 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19696-1868219/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
	I0924 00:36:01.262901 1874359 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19696-1868219/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1679 bytes)
	I0924 00:36:01.287047 1874359 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19696-1868219/.minikube/profiles/addons-371349/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1419 bytes)
	I0924 00:36:01.312081 1874359 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19696-1868219/.minikube/profiles/addons-371349/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1675 bytes)
	I0924 00:36:01.335367 1874359 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19696-1868219/.minikube/profiles/addons-371349/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
	I0924 00:36:01.359222 1874359 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19696-1868219/.minikube/profiles/addons-371349/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1679 bytes)
	I0924 00:36:01.382733 1874359 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19696-1868219/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
	I0924 00:36:01.406976 1874359 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)
	I0924 00:36:01.424742 1874359 ssh_runner.go:195] Run: openssl version
	I0924 00:36:01.430037 1874359 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
	I0924 00:36:01.439176 1874359 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
	I0924 00:36:01.442603 1874359 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 Sep 24 00:35 /usr/share/ca-certificates/minikubeCA.pem
	I0924 00:36:01.442708 1874359 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
	I0924 00:36:01.449379 1874359 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
	I0924 00:36:01.459010 1874359 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt
	I0924 00:36:01.462508 1874359 certs.go:399] 'apiserver-kubelet-client' cert doesn't exist, likely first start: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt: Process exited with status 1
	stdout:
	
	stderr:
	stat: cannot statx '/var/lib/minikube/certs/apiserver-kubelet-client.crt': No such file or directory
	I0924 00:36:01.462552 1874359 kubeadm.go:392] StartCluster: {Name:addons-371349 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1727108449-19696@sha256:c662152d8855bc4c62a3b5786a68adf99e04794e7f8f374a3859703004ef1d21 Memory:4000 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.31.1 ClusterName:addons-371349 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames
:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.49.2 Port:8443 KubernetesVersion:v1.31.1 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmware
Path: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I0924 00:36:01.462632 1874359 cri.go:54] listing CRI containers in root : {State:paused Name: Namespaces:[kube-system]}
	I0924 00:36:01.462690 1874359 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"
	I0924 00:36:01.499005 1874359 cri.go:89] found id: ""
	I0924 00:36:01.499117 1874359 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd
	I0924 00:36:01.507984 1874359 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml
	I0924 00:36:01.517128 1874359 kubeadm.go:214] ignoring SystemVerification for kubeadm because of docker driver
	I0924 00:36:01.517195 1874359 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
	I0924 00:36:01.526007 1874359 kubeadm.go:155] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
	stdout:
	
	stderr:
	ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
	ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
	ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
	ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
	I0924 00:36:01.526027 1874359 kubeadm.go:157] found existing configuration files:
	
	I0924 00:36:01.526106 1874359 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf
	I0924 00:36:01.534919 1874359 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/admin.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf: Process exited with status 2
	stdout:
	
	stderr:
	grep: /etc/kubernetes/admin.conf: No such file or directory
	I0924 00:36:01.535008 1874359 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/admin.conf
	I0924 00:36:01.543320 1874359 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf
	I0924 00:36:01.552608 1874359 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/kubelet.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf: Process exited with status 2
	stdout:
	
	stderr:
	grep: /etc/kubernetes/kubelet.conf: No such file or directory
	I0924 00:36:01.552698 1874359 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/kubelet.conf
	I0924 00:36:01.560982 1874359 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf
	I0924 00:36:01.569305 1874359 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/controller-manager.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf: Process exited with status 2
	stdout:
	
	stderr:
	grep: /etc/kubernetes/controller-manager.conf: No such file or directory
	I0924 00:36:01.569372 1874359 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/controller-manager.conf
	I0924 00:36:01.577681 1874359 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf
	I0924 00:36:01.586185 1874359 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/scheduler.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf: Process exited with status 2
	stdout:
	
	stderr:
	grep: /etc/kubernetes/scheduler.conf: No such file or directory
	I0924 00:36:01.586249 1874359 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/scheduler.conf
	I0924 00:36:01.594692 1874359 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.31.1:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml  --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem,SystemVerification,FileContent--proc-sys-net-bridge-bridge-nf-call-iptables"
	I0924 00:36:01.637749 1874359 kubeadm.go:310] [init] Using Kubernetes version: v1.31.1
	I0924 00:36:01.637865 1874359 kubeadm.go:310] [preflight] Running pre-flight checks
	I0924 00:36:01.655764 1874359 kubeadm.go:310] [preflight] The system verification failed. Printing the output from the verification:
	I0924 00:36:01.655856 1874359 kubeadm.go:310] KERNEL_VERSION: 5.15.0-1070-aws
	I0924 00:36:01.655907 1874359 kubeadm.go:310] OS: Linux
	I0924 00:36:01.655967 1874359 kubeadm.go:310] CGROUPS_CPU: enabled
	I0924 00:36:01.656027 1874359 kubeadm.go:310] CGROUPS_CPUACCT: enabled
	I0924 00:36:01.656089 1874359 kubeadm.go:310] CGROUPS_CPUSET: enabled
	I0924 00:36:01.656141 1874359 kubeadm.go:310] CGROUPS_DEVICES: enabled
	I0924 00:36:01.656201 1874359 kubeadm.go:310] CGROUPS_FREEZER: enabled
	I0924 00:36:01.656264 1874359 kubeadm.go:310] CGROUPS_MEMORY: enabled
	I0924 00:36:01.656324 1874359 kubeadm.go:310] CGROUPS_PIDS: enabled
	I0924 00:36:01.656385 1874359 kubeadm.go:310] CGROUPS_HUGETLB: enabled
	I0924 00:36:01.656445 1874359 kubeadm.go:310] CGROUPS_BLKIO: enabled
	I0924 00:36:01.719525 1874359 kubeadm.go:310] [preflight] Pulling images required for setting up a Kubernetes cluster
	I0924 00:36:01.719648 1874359 kubeadm.go:310] [preflight] This might take a minute or two, depending on the speed of your internet connection
	I0924 00:36:01.719758 1874359 kubeadm.go:310] [preflight] You can also perform this action beforehand using 'kubeadm config images pull'
	I0924 00:36:01.728062 1874359 kubeadm.go:310] [certs] Using certificateDir folder "/var/lib/minikube/certs"
	I0924 00:36:01.731719 1874359 out.go:235]   - Generating certificates and keys ...
	I0924 00:36:01.731836 1874359 kubeadm.go:310] [certs] Using existing ca certificate authority
	I0924 00:36:01.731917 1874359 kubeadm.go:310] [certs] Using existing apiserver certificate and key on disk
	I0924 00:36:01.906779 1874359 kubeadm.go:310] [certs] Generating "apiserver-kubelet-client" certificate and key
	I0924 00:36:02.049111 1874359 kubeadm.go:310] [certs] Generating "front-proxy-ca" certificate and key
	I0924 00:36:02.315960 1874359 kubeadm.go:310] [certs] Generating "front-proxy-client" certificate and key
	I0924 00:36:03.509370 1874359 kubeadm.go:310] [certs] Generating "etcd/ca" certificate and key
	I0924 00:36:03.646997 1874359 kubeadm.go:310] [certs] Generating "etcd/server" certificate and key
	I0924 00:36:03.647141 1874359 kubeadm.go:310] [certs] etcd/server serving cert is signed for DNS names [addons-371349 localhost] and IPs [192.168.49.2 127.0.0.1 ::1]
	I0924 00:36:04.006991 1874359 kubeadm.go:310] [certs] Generating "etcd/peer" certificate and key
	I0924 00:36:04.007349 1874359 kubeadm.go:310] [certs] etcd/peer serving cert is signed for DNS names [addons-371349 localhost] and IPs [192.168.49.2 127.0.0.1 ::1]
	I0924 00:36:04.300686 1874359 kubeadm.go:310] [certs] Generating "etcd/healthcheck-client" certificate and key
	I0924 00:36:05.100917 1874359 kubeadm.go:310] [certs] Generating "apiserver-etcd-client" certificate and key
	I0924 00:36:05.382780 1874359 kubeadm.go:310] [certs] Generating "sa" key and public key
	I0924 00:36:05.383050 1874359 kubeadm.go:310] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"
	I0924 00:36:05.872836 1874359 kubeadm.go:310] [kubeconfig] Writing "admin.conf" kubeconfig file
	I0924 00:36:06.283339 1874359 kubeadm.go:310] [kubeconfig] Writing "super-admin.conf" kubeconfig file
	I0924 00:36:06.905365 1874359 kubeadm.go:310] [kubeconfig] Writing "kubelet.conf" kubeconfig file
	I0924 00:36:07.389536 1874359 kubeadm.go:310] [kubeconfig] Writing "controller-manager.conf" kubeconfig file
	I0924 00:36:07.777598 1874359 kubeadm.go:310] [kubeconfig] Writing "scheduler.conf" kubeconfig file
	I0924 00:36:07.778300 1874359 kubeadm.go:310] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
	I0924 00:36:07.781412 1874359 kubeadm.go:310] [control-plane] Using manifest folder "/etc/kubernetes/manifests"
	I0924 00:36:07.784656 1874359 out.go:235]   - Booting up control plane ...
	I0924 00:36:07.784765 1874359 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-apiserver"
	I0924 00:36:07.784847 1874359 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-controller-manager"
	I0924 00:36:07.784939 1874359 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-scheduler"
	I0924 00:36:07.795428 1874359 kubeadm.go:310] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
	I0924 00:36:07.804702 1874359 kubeadm.go:310] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
	I0924 00:36:07.804863 1874359 kubeadm.go:310] [kubelet-start] Starting the kubelet
	I0924 00:36:07.897266 1874359 kubeadm.go:310] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests"
	I0924 00:36:07.897385 1874359 kubeadm.go:310] [kubelet-check] Waiting for a healthy kubelet at http://127.0.0.1:10248/healthz. This can take up to 4m0s
	I0924 00:36:08.898859 1874359 kubeadm.go:310] [kubelet-check] The kubelet is healthy after 1.001644076s
	I0924 00:36:08.898952 1874359 kubeadm.go:310] [api-check] Waiting for a healthy API server. This can take up to 4m0s
	I0924 00:36:14.400419 1874359 kubeadm.go:310] [api-check] The API server is healthy after 5.501595805s
	I0924 00:36:14.420462 1874359 kubeadm.go:310] [upload-config] Storing the configuration used in ConfigMap "kubeadm-config" in the "kube-system" Namespace
	I0924 00:36:14.434273 1874359 kubeadm.go:310] [kubelet] Creating a ConfigMap "kubelet-config" in namespace kube-system with the configuration for the kubelets in the cluster
	I0924 00:36:14.457766 1874359 kubeadm.go:310] [upload-certs] Skipping phase. Please see --upload-certs
	I0924 00:36:14.458007 1874359 kubeadm.go:310] [mark-control-plane] Marking the node addons-371349 as control-plane by adding the labels: [node-role.kubernetes.io/control-plane node.kubernetes.io/exclude-from-external-load-balancers]
	I0924 00:36:14.468841 1874359 kubeadm.go:310] [bootstrap-token] Using token: fyb3ns.xyo1unypmhns8drs
	I0924 00:36:14.471738 1874359 out.go:235]   - Configuring RBAC rules ...
	I0924 00:36:14.471858 1874359 kubeadm.go:310] [bootstrap-token] Configuring bootstrap tokens, cluster-info ConfigMap, RBAC Roles
	I0924 00:36:14.475171 1874359 kubeadm.go:310] [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to get nodes
	I0924 00:36:14.482586 1874359 kubeadm.go:310] [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to post CSRs in order for nodes to get long term certificate credentials
	I0924 00:36:14.486317 1874359 kubeadm.go:310] [bootstrap-token] Configured RBAC rules to allow the csrapprover controller automatically approve CSRs from a Node Bootstrap Token
	I0924 00:36:14.492041 1874359 kubeadm.go:310] [bootstrap-token] Configured RBAC rules to allow certificate rotation for all node client certificates in the cluster
	I0924 00:36:14.495775 1874359 kubeadm.go:310] [bootstrap-token] Creating the "cluster-info" ConfigMap in the "kube-public" namespace
	I0924 00:36:14.807767 1874359 kubeadm.go:310] [kubelet-finalize] Updating "/etc/kubernetes/kubelet.conf" to point to a rotatable kubelet client certificate and key
	I0924 00:36:15.233069 1874359 kubeadm.go:310] [addons] Applied essential addon: CoreDNS
	I0924 00:36:15.807451 1874359 kubeadm.go:310] [addons] Applied essential addon: kube-proxy
	I0924 00:36:15.808519 1874359 kubeadm.go:310] 
	I0924 00:36:15.808597 1874359 kubeadm.go:310] Your Kubernetes control-plane has initialized successfully!
	I0924 00:36:15.808611 1874359 kubeadm.go:310] 
	I0924 00:36:15.808688 1874359 kubeadm.go:310] To start using your cluster, you need to run the following as a regular user:
	I0924 00:36:15.808698 1874359 kubeadm.go:310] 
	I0924 00:36:15.808723 1874359 kubeadm.go:310]   mkdir -p $HOME/.kube
	I0924 00:36:15.808787 1874359 kubeadm.go:310]   sudo cp -i /etc/kubernetes/admin.conf $HOME/.kube/config
	I0924 00:36:15.808841 1874359 kubeadm.go:310]   sudo chown $(id -u):$(id -g) $HOME/.kube/config
	I0924 00:36:15.808850 1874359 kubeadm.go:310] 
	I0924 00:36:15.808903 1874359 kubeadm.go:310] Alternatively, if you are the root user, you can run:
	I0924 00:36:15.808911 1874359 kubeadm.go:310] 
	I0924 00:36:15.808966 1874359 kubeadm.go:310]   export KUBECONFIG=/etc/kubernetes/admin.conf
	I0924 00:36:15.808982 1874359 kubeadm.go:310] 
	I0924 00:36:15.809034 1874359 kubeadm.go:310] You should now deploy a pod network to the cluster.
	I0924 00:36:15.809111 1874359 kubeadm.go:310] Run "kubectl apply -f [podnetwork].yaml" with one of the options listed at:
	I0924 00:36:15.809191 1874359 kubeadm.go:310]   https://kubernetes.io/docs/concepts/cluster-administration/addons/
	I0924 00:36:15.809201 1874359 kubeadm.go:310] 
	I0924 00:36:15.809290 1874359 kubeadm.go:310] You can now join any number of control-plane nodes by copying certificate authorities
	I0924 00:36:15.809372 1874359 kubeadm.go:310] and service account keys on each node and then running the following as root:
	I0924 00:36:15.809381 1874359 kubeadm.go:310] 
	I0924 00:36:15.809464 1874359 kubeadm.go:310]   kubeadm join control-plane.minikube.internal:8443 --token fyb3ns.xyo1unypmhns8drs \
	I0924 00:36:15.809568 1874359 kubeadm.go:310] 	--discovery-token-ca-cert-hash sha256:92ab852119932e380fabb88b90131863744668403f48ee05cfbc8ebb0fb002df \
	I0924 00:36:15.809591 1874359 kubeadm.go:310] 	--control-plane 
	I0924 00:36:15.809601 1874359 kubeadm.go:310] 
	I0924 00:36:15.809688 1874359 kubeadm.go:310] Then you can join any number of worker nodes by running the following on each as root:
	I0924 00:36:15.809697 1874359 kubeadm.go:310] 
	I0924 00:36:15.809781 1874359 kubeadm.go:310] kubeadm join control-plane.minikube.internal:8443 --token fyb3ns.xyo1unypmhns8drs \
	I0924 00:36:15.809910 1874359 kubeadm.go:310] 	--discovery-token-ca-cert-hash sha256:92ab852119932e380fabb88b90131863744668403f48ee05cfbc8ebb0fb002df 
	I0924 00:36:15.814096 1874359 kubeadm.go:310] W0924 00:36:01.634539    1182 common.go:101] your configuration file uses a deprecated API spec: "kubeadm.k8s.io/v1beta3" (kind: "ClusterConfiguration"). Please use 'kubeadm config migrate --old-config old.yaml --new-config new.yaml', which will write the new, similar spec using a newer API version.
	I0924 00:36:15.814397 1874359 kubeadm.go:310] W0924 00:36:01.635367    1182 common.go:101] your configuration file uses a deprecated API spec: "kubeadm.k8s.io/v1beta3" (kind: "InitConfiguration"). Please use 'kubeadm config migrate --old-config old.yaml --new-config new.yaml', which will write the new, similar spec using a newer API version.
	I0924 00:36:15.814637 1874359 kubeadm.go:310] 	[WARNING SystemVerification]: failed to parse kernel config: unable to load kernel module: "configs", output: "modprobe: FATAL: Module configs not found in directory /lib/modules/5.15.0-1070-aws\n", err: exit status 1
	I0924 00:36:15.814759 1874359 kubeadm.go:310] 	[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
	I0924 00:36:15.814783 1874359 cni.go:84] Creating CNI manager for ""
	I0924 00:36:15.814791 1874359 cni.go:143] "docker" driver + "crio" runtime found, recommending kindnet
	I0924 00:36:15.816668 1874359 out.go:177] * Configuring CNI (Container Networking Interface) ...
	I0924 00:36:15.818482 1874359 ssh_runner.go:195] Run: stat /opt/cni/bin/portmap
	I0924 00:36:15.822601 1874359 cni.go:182] applying CNI manifest using /var/lib/minikube/binaries/v1.31.1/kubectl ...
	I0924 00:36:15.822619 1874359 ssh_runner.go:362] scp memory --> /var/tmp/minikube/cni.yaml (2601 bytes)
	I0924 00:36:15.843203 1874359 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.1/kubectl apply --kubeconfig=/var/lib/minikube/kubeconfig -f /var/tmp/minikube/cni.yaml
	I0924 00:36:16.155987 1874359 ssh_runner.go:195] Run: /bin/bash -c "cat /proc/$(pgrep kube-apiserver)/oom_adj"
	I0924 00:36:16.156142 1874359 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.1/kubectl create clusterrolebinding minikube-rbac --clusterrole=cluster-admin --serviceaccount=kube-system:default --kubeconfig=/var/lib/minikube/kubeconfig
	I0924 00:36:16.156262 1874359 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.1/kubectl --kubeconfig=/var/lib/minikube/kubeconfig label --overwrite nodes addons-371349 minikube.k8s.io/updated_at=2024_09_24T00_36_16_0700 minikube.k8s.io/version=v1.34.0 minikube.k8s.io/commit=41795ff643dcbe39cdf81f27d064464d20ae8e7c minikube.k8s.io/name=addons-371349 minikube.k8s.io/primary=true
	I0924 00:36:16.320925 1874359 ops.go:34] apiserver oom_adj: -16
	I0924 00:36:16.321114 1874359 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0924 00:36:16.821252 1874359 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0924 00:36:17.321244 1874359 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0924 00:36:17.821552 1874359 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0924 00:36:18.322035 1874359 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0924 00:36:18.821736 1874359 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0924 00:36:19.321684 1874359 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0924 00:36:19.821789 1874359 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0924 00:36:19.912113 1874359 kubeadm.go:1113] duration metric: took 3.756037913s to wait for elevateKubeSystemPrivileges
	I0924 00:36:19.912142 1874359 kubeadm.go:394] duration metric: took 18.449591997s to StartCluster
	I0924 00:36:19.912159 1874359 settings.go:142] acquiring lock: {Name:mk1f9eaf6a4c831f2bd4174d069aecdee825d054 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0924 00:36:19.912272 1874359 settings.go:150] Updating kubeconfig:  /home/jenkins/minikube-integration/19696-1868219/kubeconfig
	I0924 00:36:19.912639 1874359 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19696-1868219/kubeconfig: {Name:mk4b43b4b2f636bf366ceefc82df157a927b449f Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0924 00:36:19.912824 1874359 start.go:235] Will wait 6m0s for node &{Name: IP:192.168.49.2 Port:8443 KubernetesVersion:v1.31.1 ContainerRuntime:crio ControlPlane:true Worker:true}
	I0924 00:36:19.912967 1874359 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.31.1/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml"
	I0924 00:36:19.913219 1874359 config.go:182] Loaded profile config "addons-371349": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.31.1
	I0924 00:36:19.913255 1874359 addons.go:507] enable addons start: toEnable=map[ambassador:false auto-pause:false cloud-spanner:true csi-hostpath-driver:true dashboard:false default-storageclass:true efk:false freshpod:false gcp-auth:true gvisor:false headlamp:false inaccel:false ingress:true ingress-dns:true inspektor-gadget:true istio:false istio-provisioner:false kong:false kubeflow:false kubevirt:false logviewer:false metallb:false metrics-server:true nvidia-device-plugin:true nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:true registry-aliases:false registry-creds:false storage-provisioner:true storage-provisioner-gluster:false storage-provisioner-rancher:true volcano:true volumesnapshots:true yakd:true]
	I0924 00:36:19.913337 1874359 addons.go:69] Setting yakd=true in profile "addons-371349"
	I0924 00:36:19.913354 1874359 addons.go:234] Setting addon yakd=true in "addons-371349"
	I0924 00:36:19.913380 1874359 host.go:66] Checking if "addons-371349" exists ...
	I0924 00:36:19.913893 1874359 cli_runner.go:164] Run: docker container inspect addons-371349 --format={{.State.Status}}
	I0924 00:36:19.914281 1874359 addons.go:69] Setting metrics-server=true in profile "addons-371349"
	I0924 00:36:19.914303 1874359 addons.go:234] Setting addon metrics-server=true in "addons-371349"
	I0924 00:36:19.914332 1874359 host.go:66] Checking if "addons-371349" exists ...
	I0924 00:36:19.914762 1874359 cli_runner.go:164] Run: docker container inspect addons-371349 --format={{.State.Status}}
	I0924 00:36:19.914903 1874359 addons.go:69] Setting nvidia-device-plugin=true in profile "addons-371349"
	I0924 00:36:19.914922 1874359 addons.go:234] Setting addon nvidia-device-plugin=true in "addons-371349"
	I0924 00:36:19.914942 1874359 host.go:66] Checking if "addons-371349" exists ...
	I0924 00:36:19.915339 1874359 cli_runner.go:164] Run: docker container inspect addons-371349 --format={{.State.Status}}
	I0924 00:36:19.917403 1874359 addons.go:69] Setting registry=true in profile "addons-371349"
	I0924 00:36:19.917433 1874359 addons.go:234] Setting addon registry=true in "addons-371349"
	I0924 00:36:19.917459 1874359 host.go:66] Checking if "addons-371349" exists ...
	I0924 00:36:19.917922 1874359 cli_runner.go:164] Run: docker container inspect addons-371349 --format={{.State.Status}}
	I0924 00:36:19.919606 1874359 out.go:177] * Verifying Kubernetes components...
	I0924 00:36:19.919769 1874359 addons.go:69] Setting storage-provisioner=true in profile "addons-371349"
	I0924 00:36:19.919795 1874359 addons.go:234] Setting addon storage-provisioner=true in "addons-371349"
	I0924 00:36:19.919823 1874359 host.go:66] Checking if "addons-371349" exists ...
	I0924 00:36:19.920250 1874359 cli_runner.go:164] Run: docker container inspect addons-371349 --format={{.State.Status}}
	I0924 00:36:19.923735 1874359 addons.go:69] Setting storage-provisioner-rancher=true in profile "addons-371349"
	I0924 00:36:19.923769 1874359 addons_storage_classes.go:33] enableOrDisableStorageClasses storage-provisioner-rancher=true on "addons-371349"
	I0924 00:36:19.924079 1874359 cli_runner.go:164] Run: docker container inspect addons-371349 --format={{.State.Status}}
	I0924 00:36:19.926136 1874359 addons.go:69] Setting cloud-spanner=true in profile "addons-371349"
	I0924 00:36:19.926194 1874359 addons.go:234] Setting addon cloud-spanner=true in "addons-371349"
	I0924 00:36:19.926253 1874359 host.go:66] Checking if "addons-371349" exists ...
	I0924 00:36:19.926788 1874359 cli_runner.go:164] Run: docker container inspect addons-371349 --format={{.State.Status}}
	I0924 00:36:19.935402 1874359 addons.go:69] Setting volcano=true in profile "addons-371349"
	I0924 00:36:19.935434 1874359 addons.go:234] Setting addon volcano=true in "addons-371349"
	I0924 00:36:19.935472 1874359 host.go:66] Checking if "addons-371349" exists ...
	I0924 00:36:19.935980 1874359 cli_runner.go:164] Run: docker container inspect addons-371349 --format={{.State.Status}}
	I0924 00:36:19.944614 1874359 addons.go:69] Setting csi-hostpath-driver=true in profile "addons-371349"
	I0924 00:36:19.944766 1874359 addons.go:234] Setting addon csi-hostpath-driver=true in "addons-371349"
	I0924 00:36:19.944836 1874359 host.go:66] Checking if "addons-371349" exists ...
	I0924 00:36:19.945418 1874359 cli_runner.go:164] Run: docker container inspect addons-371349 --format={{.State.Status}}
	I0924 00:36:19.966987 1874359 addons.go:69] Setting volumesnapshots=true in profile "addons-371349"
	I0924 00:36:19.967067 1874359 addons.go:234] Setting addon volumesnapshots=true in "addons-371349"
	I0924 00:36:19.967119 1874359 host.go:66] Checking if "addons-371349" exists ...
	I0924 00:36:19.967689 1874359 cli_runner.go:164] Run: docker container inspect addons-371349 --format={{.State.Status}}
	I0924 00:36:19.973077 1874359 addons.go:69] Setting default-storageclass=true in profile "addons-371349"
	I0924 00:36:19.973160 1874359 addons_storage_classes.go:33] enableOrDisableStorageClasses default-storageclass=true on "addons-371349"
	I0924 00:36:19.982732 1874359 cli_runner.go:164] Run: docker container inspect addons-371349 --format={{.State.Status}}
	I0924 00:36:20.001158 1874359 ssh_runner.go:195] Run: sudo systemctl daemon-reload
	I0924 00:36:20.005134 1874359 addons.go:69] Setting gcp-auth=true in profile "addons-371349"
	I0924 00:36:20.005242 1874359 mustload.go:65] Loading cluster: addons-371349
	I0924 00:36:20.005495 1874359 config.go:182] Loaded profile config "addons-371349": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.31.1
	I0924 00:36:20.006158 1874359 cli_runner.go:164] Run: docker container inspect addons-371349 --format={{.State.Status}}
	I0924 00:36:20.027761 1874359 addons.go:69] Setting ingress=true in profile "addons-371349"
	I0924 00:36:20.027838 1874359 addons.go:234] Setting addon ingress=true in "addons-371349"
	I0924 00:36:20.027915 1874359 host.go:66] Checking if "addons-371349" exists ...
	I0924 00:36:20.028423 1874359 cli_runner.go:164] Run: docker container inspect addons-371349 --format={{.State.Status}}
	I0924 00:36:20.040640 1874359 addons.go:69] Setting ingress-dns=true in profile "addons-371349"
	I0924 00:36:20.040746 1874359 addons.go:234] Setting addon ingress-dns=true in "addons-371349"
	I0924 00:36:20.040826 1874359 host.go:66] Checking if "addons-371349" exists ...
	I0924 00:36:20.047419 1874359 cli_runner.go:164] Run: docker container inspect addons-371349 --format={{.State.Status}}
	I0924 00:36:20.062936 1874359 addons.go:69] Setting inspektor-gadget=true in profile "addons-371349"
	I0924 00:36:20.063020 1874359 addons.go:234] Setting addon inspektor-gadget=true in "addons-371349"
	I0924 00:36:20.063086 1874359 host.go:66] Checking if "addons-371349" exists ...
	I0924 00:36:20.063605 1874359 cli_runner.go:164] Run: docker container inspect addons-371349 --format={{.State.Status}}
	I0924 00:36:20.073337 1874359 out.go:177]   - Using image gcr.io/cloud-spanner-emulator/emulator:1.5.24
	I0924 00:36:20.079819 1874359 addons.go:431] installing /etc/kubernetes/addons/deployment.yaml
	I0924 00:36:20.079847 1874359 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/deployment.yaml (1004 bytes)
	I0924 00:36:20.079924 1874359 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-371349
	I0924 00:36:20.083611 1874359 addons.go:234] Setting addon storage-provisioner-rancher=true in "addons-371349"
	I0924 00:36:20.083656 1874359 host.go:66] Checking if "addons-371349" exists ...
	I0924 00:36:20.085706 1874359 cli_runner.go:164] Run: docker container inspect addons-371349 --format={{.State.Status}}
	I0924 00:36:20.097199 1874359 out.go:177]   - Using image registry.k8s.io/sig-storage/csi-resizer:v1.6.0
	I0924 00:36:20.097447 1874359 out.go:177]   - Using image nvcr.io/nvidia/k8s-device-plugin:v0.16.2
	I0924 00:36:20.097629 1874359 out.go:177]   - Using image gcr.io/k8s-minikube/storage-provisioner:v5
	I0924 00:36:20.134921 1874359 out.go:177]   - Using image docker.io/marcnuri/yakd:0.0.5
	W0924 00:36:20.112693 1874359 out.go:270] ! Enabling 'volcano' returned an error: running callbacks: [volcano addon does not support crio]
	I0924 00:36:20.143522 1874359 addons.go:431] installing /etc/kubernetes/addons/nvidia-device-plugin.yaml
	I0924 00:36:20.143539 1874359 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/nvidia-device-plugin.yaml (1966 bytes)
	I0924 00:36:20.143610 1874359 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-371349
	I0924 00:36:20.144160 1874359 out.go:177]   - Using image docker.io/registry:2.8.3
	I0924 00:36:20.144325 1874359 out.go:177]   - Using image registry.k8s.io/metrics-server/metrics-server:v0.7.2
	I0924 00:36:20.144440 1874359 addons.go:431] installing /etc/kubernetes/addons/storage-provisioner.yaml
	I0924 00:36:20.145869 1874359 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storage-provisioner.yaml (2676 bytes)
	I0924 00:36:20.145935 1874359 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-371349
	I0924 00:36:20.162770 1874359 addons.go:431] installing /etc/kubernetes/addons/yakd-ns.yaml
	I0924 00:36:20.162797 1874359 ssh_runner.go:362] scp yakd/yakd-ns.yaml --> /etc/kubernetes/addons/yakd-ns.yaml (171 bytes)
	I0924 00:36:20.162863 1874359 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-371349
	I0924 00:36:20.145538 1874359 addons.go:234] Setting addon default-storageclass=true in "addons-371349"
	I0924 00:36:20.170888 1874359 host.go:66] Checking if "addons-371349" exists ...
	I0924 00:36:20.171353 1874359 cli_runner.go:164] Run: docker container inspect addons-371349 --format={{.State.Status}}
	I0924 00:36:20.189421 1874359 out.go:177]   - Using image registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0
	I0924 00:36:20.191234 1874359 addons.go:431] installing /etc/kubernetes/addons/metrics-apiservice.yaml
	I0924 00:36:20.191255 1874359 ssh_runner.go:362] scp metrics-server/metrics-apiservice.yaml --> /etc/kubernetes/addons/metrics-apiservice.yaml (424 bytes)
	I0924 00:36:20.191322 1874359 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-371349
	I0924 00:36:20.195761 1874359 out.go:177]   - Using image registry.k8s.io/sig-storage/csi-provisioner:v3.3.0
	I0924 00:36:20.202904 1874359 host.go:66] Checking if "addons-371349" exists ...
	I0924 00:36:20.206400 1874359 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:34691 SSHKeyPath:/home/jenkins/minikube-integration/19696-1868219/.minikube/machines/addons-371349/id_rsa Username:docker}
	I0924 00:36:20.207744 1874359 out.go:177]   - Using image registry.k8s.io/sig-storage/csi-attacher:v4.0.0
	I0924 00:36:20.214882 1874359 out.go:177]   - Using image gcr.io/k8s-minikube/kube-registry-proxy:0.0.6
	I0924 00:36:20.220705 1874359 addons.go:431] installing /etc/kubernetes/addons/registry-rc.yaml
	I0924 00:36:20.220780 1874359 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/registry-rc.yaml (860 bytes)
	I0924 00:36:20.220878 1874359 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-371349
	I0924 00:36:20.221763 1874359 out.go:177]   - Using image registry.k8s.io/sig-storage/csi-external-health-monitor-controller:v0.7.0
	I0924 00:36:20.232800 1874359 out.go:177]   - Using image registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.6.0
	I0924 00:36:20.242508 1874359 out.go:177]   - Using image registry.k8s.io/sig-storage/hostpathplugin:v1.9.0
	I0924 00:36:20.252224 1874359 out.go:177]   - Using image gcr.io/k8s-minikube/minikube-ingress-dns:0.0.3
	I0924 00:36:20.255629 1874359 out.go:177]   - Using image registry.k8s.io/sig-storage/snapshot-controller:v6.1.0
	I0924 00:36:20.255709 1874359 out.go:177]   - Using image docker.io/rancher/local-path-provisioner:v0.0.22
	I0924 00:36:20.255913 1874359 addons.go:431] installing /etc/kubernetes/addons/ingress-dns-pod.yaml
	I0924 00:36:20.255926 1874359 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/ingress-dns-pod.yaml (2442 bytes)
	I0924 00:36:20.256002 1874359 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-371349
	I0924 00:36:20.259897 1874359 out.go:177]   - Using image registry.k8s.io/sig-storage/livenessprobe:v2.8.0
	I0924 00:36:20.260072 1874359 addons.go:431] installing /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml
	I0924 00:36:20.260833 1874359 ssh_runner.go:362] scp volumesnapshots/csi-hostpath-snapshotclass.yaml --> /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml (934 bytes)
	I0924 00:36:20.260903 1874359 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-371349
	I0924 00:36:20.261717 1874359 out.go:177]   - Using image docker.io/busybox:stable
	I0924 00:36:20.264539 1874359 addons.go:431] installing /etc/kubernetes/addons/storage-provisioner-rancher.yaml
	I0924 00:36:20.264561 1874359 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storage-provisioner-rancher.yaml (3113 bytes)
	I0924 00:36:20.264629 1874359 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-371349
	I0924 00:36:20.280599 1874359 addons.go:431] installing /etc/kubernetes/addons/rbac-external-attacher.yaml
	I0924 00:36:20.280625 1874359 ssh_runner.go:362] scp csi-hostpath-driver/rbac/rbac-external-attacher.yaml --> /etc/kubernetes/addons/rbac-external-attacher.yaml (3073 bytes)
	I0924 00:36:20.280702 1874359 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-371349
	I0924 00:36:20.297489 1874359 out.go:177]   - Using image registry.k8s.io/ingress-nginx/kube-webhook-certgen:v1.4.3
	I0924 00:36:20.302057 1874359 out.go:177]   - Using image ghcr.io/inspektor-gadget/inspektor-gadget:v0.32.0
	I0924 00:36:20.305758 1874359 out.go:177]   - Using image registry.k8s.io/ingress-nginx/kube-webhook-certgen:v1.4.3
	I0924 00:36:20.305913 1874359 addons.go:431] installing /etc/kubernetes/addons/ig-namespace.yaml
	I0924 00:36:20.305937 1874359 ssh_runner.go:362] scp inspektor-gadget/ig-namespace.yaml --> /etc/kubernetes/addons/ig-namespace.yaml (55 bytes)
	I0924 00:36:20.306040 1874359 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-371349
	I0924 00:36:20.310783 1874359 out.go:177]   - Using image registry.k8s.io/ingress-nginx/controller:v1.11.2
	I0924 00:36:20.320860 1874359 addons.go:431] installing /etc/kubernetes/addons/ingress-deploy.yaml
	I0924 00:36:20.320935 1874359 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/ingress-deploy.yaml (16078 bytes)
	I0924 00:36:20.321039 1874359 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-371349
	I0924 00:36:20.382635 1874359 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:34691 SSHKeyPath:/home/jenkins/minikube-integration/19696-1868219/.minikube/machines/addons-371349/id_rsa Username:docker}
	I0924 00:36:20.383295 1874359 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:34691 SSHKeyPath:/home/jenkins/minikube-integration/19696-1868219/.minikube/machines/addons-371349/id_rsa Username:docker}
	I0924 00:36:20.395401 1874359 addons.go:431] installing /etc/kubernetes/addons/storageclass.yaml
	I0924 00:36:20.395421 1874359 ssh_runner.go:362] scp storageclass/storageclass.yaml --> /etc/kubernetes/addons/storageclass.yaml (271 bytes)
	I0924 00:36:20.395476 1874359 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-371349
	I0924 00:36:20.402650 1874359 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:34691 SSHKeyPath:/home/jenkins/minikube-integration/19696-1868219/.minikube/machines/addons-371349/id_rsa Username:docker}
	I0924 00:36:20.411638 1874359 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:34691 SSHKeyPath:/home/jenkins/minikube-integration/19696-1868219/.minikube/machines/addons-371349/id_rsa Username:docker}
	I0924 00:36:20.412343 1874359 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:34691 SSHKeyPath:/home/jenkins/minikube-integration/19696-1868219/.minikube/machines/addons-371349/id_rsa Username:docker}
	I0924 00:36:20.434229 1874359 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:34691 SSHKeyPath:/home/jenkins/minikube-integration/19696-1868219/.minikube/machines/addons-371349/id_rsa Username:docker}
	I0924 00:36:20.441444 1874359 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:34691 SSHKeyPath:/home/jenkins/minikube-integration/19696-1868219/.minikube/machines/addons-371349/id_rsa Username:docker}
	I0924 00:36:20.450129 1874359 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:34691 SSHKeyPath:/home/jenkins/minikube-integration/19696-1868219/.minikube/machines/addons-371349/id_rsa Username:docker}
	I0924 00:36:20.465770 1874359 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:34691 SSHKeyPath:/home/jenkins/minikube-integration/19696-1868219/.minikube/machines/addons-371349/id_rsa Username:docker}
	I0924 00:36:20.473465 1874359 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/deployment.yaml
	I0924 00:36:20.484112 1874359 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:34691 SSHKeyPath:/home/jenkins/minikube-integration/19696-1868219/.minikube/machines/addons-371349/id_rsa Username:docker}
	I0924 00:36:20.486490 1874359 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:34691 SSHKeyPath:/home/jenkins/minikube-integration/19696-1868219/.minikube/machines/addons-371349/id_rsa Username:docker}
	I0924 00:36:20.488626 1874359 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:34691 SSHKeyPath:/home/jenkins/minikube-integration/19696-1868219/.minikube/machines/addons-371349/id_rsa Username:docker}
	I0924 00:36:20.637569 1874359 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.31.1/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml | sed -e '/^        forward . \/etc\/resolv.conf.*/i \        hosts {\n           192.168.49.1 host.minikube.internal\n           fallthrough\n        }' -e '/^        errors *$/i \        log' | sudo /var/lib/minikube/binaries/v1.31.1/kubectl --kubeconfig=/var/lib/minikube/kubeconfig replace -f -"
	I0924 00:36:20.637723 1874359 ssh_runner.go:195] Run: sudo systemctl start kubelet
	I0924 00:36:20.756622 1874359 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml
	I0924 00:36:20.767901 1874359 addons.go:431] installing /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml
	I0924 00:36:20.767928 1874359 ssh_runner.go:362] scp volumesnapshots/snapshot.storage.k8s.io_volumesnapshotclasses.yaml --> /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml (6471 bytes)
	I0924 00:36:20.793684 1874359 addons.go:431] installing /etc/kubernetes/addons/yakd-sa.yaml
	I0924 00:36:20.793756 1874359 ssh_runner.go:362] scp yakd/yakd-sa.yaml --> /etc/kubernetes/addons/yakd-sa.yaml (247 bytes)
	I0924 00:36:20.820103 1874359 addons.go:431] installing /etc/kubernetes/addons/registry-svc.yaml
	I0924 00:36:20.820174 1874359 ssh_runner.go:362] scp registry/registry-svc.yaml --> /etc/kubernetes/addons/registry-svc.yaml (398 bytes)
	I0924 00:36:20.839949 1874359 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/nvidia-device-plugin.yaml
	I0924 00:36:20.843294 1874359 addons.go:431] installing /etc/kubernetes/addons/ig-serviceaccount.yaml
	I0924 00:36:20.843373 1874359 ssh_runner.go:362] scp inspektor-gadget/ig-serviceaccount.yaml --> /etc/kubernetes/addons/ig-serviceaccount.yaml (80 bytes)
	I0924 00:36:20.862306 1874359 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/ingress-dns-pod.yaml
	I0924 00:36:20.871400 1874359 addons.go:431] installing /etc/kubernetes/addons/metrics-server-deployment.yaml
	I0924 00:36:20.871469 1874359 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-server-deployment.yaml (1907 bytes)
	I0924 00:36:20.879318 1874359 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/ingress-deploy.yaml
	I0924 00:36:20.901110 1874359 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/storage-provisioner-rancher.yaml
	I0924 00:36:20.928473 1874359 addons.go:431] installing /etc/kubernetes/addons/rbac-hostpath.yaml
	I0924 00:36:20.928553 1874359 ssh_runner.go:362] scp csi-hostpath-driver/rbac/rbac-hostpath.yaml --> /etc/kubernetes/addons/rbac-hostpath.yaml (4266 bytes)
	I0924 00:36:20.931932 1874359 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml
	I0924 00:36:20.935841 1874359 addons.go:431] installing /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml
	I0924 00:36:20.935903 1874359 ssh_runner.go:362] scp volumesnapshots/snapshot.storage.k8s.io_volumesnapshotcontents.yaml --> /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml (23126 bytes)
	I0924 00:36:20.981190 1874359 addons.go:431] installing /etc/kubernetes/addons/ig-role.yaml
	I0924 00:36:20.981266 1874359 ssh_runner.go:362] scp inspektor-gadget/ig-role.yaml --> /etc/kubernetes/addons/ig-role.yaml (210 bytes)
	I0924 00:36:21.013456 1874359 addons.go:431] installing /etc/kubernetes/addons/registry-proxy.yaml
	I0924 00:36:21.013528 1874359 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/registry-proxy.yaml (947 bytes)
	I0924 00:36:21.018372 1874359 addons.go:431] installing /etc/kubernetes/addons/yakd-crb.yaml
	I0924 00:36:21.018444 1874359 ssh_runner.go:362] scp yakd/yakd-crb.yaml --> /etc/kubernetes/addons/yakd-crb.yaml (422 bytes)
	I0924 00:36:21.084717 1874359 addons.go:431] installing /etc/kubernetes/addons/rbac-external-health-monitor-controller.yaml
	I0924 00:36:21.084779 1874359 ssh_runner.go:362] scp csi-hostpath-driver/rbac/rbac-external-health-monitor-controller.yaml --> /etc/kubernetes/addons/rbac-external-health-monitor-controller.yaml (3038 bytes)
	I0924 00:36:21.092294 1874359 addons.go:431] installing /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml
	I0924 00:36:21.092373 1874359 ssh_runner.go:362] scp volumesnapshots/snapshot.storage.k8s.io_volumesnapshots.yaml --> /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml (19582 bytes)
	I0924 00:36:21.100194 1874359 addons.go:431] installing /etc/kubernetes/addons/metrics-server-rbac.yaml
	I0924 00:36:21.100257 1874359 ssh_runner.go:362] scp metrics-server/metrics-server-rbac.yaml --> /etc/kubernetes/addons/metrics-server-rbac.yaml (2175 bytes)
	I0924 00:36:21.171337 1874359 addons.go:431] installing /etc/kubernetes/addons/ig-rolebinding.yaml
	I0924 00:36:21.171414 1874359 ssh_runner.go:362] scp inspektor-gadget/ig-rolebinding.yaml --> /etc/kubernetes/addons/ig-rolebinding.yaml (244 bytes)
	I0924 00:36:21.207779 1874359 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/registry-rc.yaml -f /etc/kubernetes/addons/registry-svc.yaml -f /etc/kubernetes/addons/registry-proxy.yaml
	I0924 00:36:21.212774 1874359 addons.go:431] installing /etc/kubernetes/addons/yakd-svc.yaml
	I0924 00:36:21.212798 1874359 ssh_runner.go:362] scp yakd/yakd-svc.yaml --> /etc/kubernetes/addons/yakd-svc.yaml (412 bytes)
	I0924 00:36:21.265598 1874359 addons.go:431] installing /etc/kubernetes/addons/metrics-server-service.yaml
	I0924 00:36:21.265669 1874359 ssh_runner.go:362] scp metrics-server/metrics-server-service.yaml --> /etc/kubernetes/addons/metrics-server-service.yaml (446 bytes)
	I0924 00:36:21.268714 1874359 addons.go:431] installing /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml
	I0924 00:36:21.268774 1874359 ssh_runner.go:362] scp volumesnapshots/rbac-volume-snapshot-controller.yaml --> /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml (3545 bytes)
	I0924 00:36:21.283692 1874359 addons.go:431] installing /etc/kubernetes/addons/rbac-external-provisioner.yaml
	I0924 00:36:21.283765 1874359 ssh_runner.go:362] scp csi-hostpath-driver/rbac/rbac-external-provisioner.yaml --> /etc/kubernetes/addons/rbac-external-provisioner.yaml (4442 bytes)
	I0924 00:36:21.339390 1874359 addons.go:431] installing /etc/kubernetes/addons/ig-clusterrole.yaml
	I0924 00:36:21.339461 1874359 ssh_runner.go:362] scp inspektor-gadget/ig-clusterrole.yaml --> /etc/kubernetes/addons/ig-clusterrole.yaml (1485 bytes)
	I0924 00:36:21.409963 1874359 addons.go:431] installing /etc/kubernetes/addons/yakd-dp.yaml
	I0924 00:36:21.410032 1874359 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/yakd-dp.yaml (2017 bytes)
	I0924 00:36:21.422530 1874359 addons.go:431] installing /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml
	I0924 00:36:21.422600 1874359 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml (1475 bytes)
	I0924 00:36:21.432482 1874359 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
	I0924 00:36:21.435211 1874359 addons.go:431] installing /etc/kubernetes/addons/rbac-external-resizer.yaml
	I0924 00:36:21.435281 1874359 ssh_runner.go:362] scp csi-hostpath-driver/rbac/rbac-external-resizer.yaml --> /etc/kubernetes/addons/rbac-external-resizer.yaml (2943 bytes)
	I0924 00:36:21.490265 1874359 addons.go:431] installing /etc/kubernetes/addons/ig-clusterrolebinding.yaml
	I0924 00:36:21.490340 1874359 ssh_runner.go:362] scp inspektor-gadget/ig-clusterrolebinding.yaml --> /etc/kubernetes/addons/ig-clusterrolebinding.yaml (274 bytes)
	I0924 00:36:21.554034 1874359 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/yakd-ns.yaml -f /etc/kubernetes/addons/yakd-sa.yaml -f /etc/kubernetes/addons/yakd-crb.yaml -f /etc/kubernetes/addons/yakd-svc.yaml -f /etc/kubernetes/addons/yakd-dp.yaml
	I0924 00:36:21.593261 1874359 addons.go:431] installing /etc/kubernetes/addons/ig-crd.yaml
	I0924 00:36:21.593333 1874359 ssh_runner.go:362] scp inspektor-gadget/ig-crd.yaml --> /etc/kubernetes/addons/ig-crd.yaml (5216 bytes)
	I0924 00:36:21.597542 1874359 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml
	I0924 00:36:21.603447 1874359 addons.go:431] installing /etc/kubernetes/addons/rbac-external-snapshotter.yaml
	I0924 00:36:21.603528 1874359 ssh_runner.go:362] scp csi-hostpath-driver/rbac/rbac-external-snapshotter.yaml --> /etc/kubernetes/addons/rbac-external-snapshotter.yaml (3149 bytes)
	I0924 00:36:21.678474 1874359 addons.go:431] installing /etc/kubernetes/addons/csi-hostpath-attacher.yaml
	I0924 00:36:21.678551 1874359 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/csi-hostpath-attacher.yaml (2143 bytes)
	I0924 00:36:21.696404 1874359 addons.go:431] installing /etc/kubernetes/addons/ig-daemonset.yaml
	I0924 00:36:21.696473 1874359 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/ig-daemonset.yaml (7735 bytes)
	I0924 00:36:21.758367 1874359 addons.go:431] installing /etc/kubernetes/addons/csi-hostpath-driverinfo.yaml
	I0924 00:36:21.758441 1874359 ssh_runner.go:362] scp csi-hostpath-driver/deploy/csi-hostpath-driverinfo.yaml --> /etc/kubernetes/addons/csi-hostpath-driverinfo.yaml (1274 bytes)
	I0924 00:36:21.788195 1874359 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/ig-namespace.yaml -f /etc/kubernetes/addons/ig-serviceaccount.yaml -f /etc/kubernetes/addons/ig-role.yaml -f /etc/kubernetes/addons/ig-rolebinding.yaml -f /etc/kubernetes/addons/ig-clusterrole.yaml -f /etc/kubernetes/addons/ig-clusterrolebinding.yaml -f /etc/kubernetes/addons/ig-crd.yaml -f /etc/kubernetes/addons/ig-daemonset.yaml
	I0924 00:36:21.873070 1874359 addons.go:431] installing /etc/kubernetes/addons/csi-hostpath-plugin.yaml
	I0924 00:36:21.873146 1874359 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/csi-hostpath-plugin.yaml (8201 bytes)
	I0924 00:36:21.996889 1874359 addons.go:431] installing /etc/kubernetes/addons/csi-hostpath-resizer.yaml
	I0924 00:36:21.996961 1874359 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/csi-hostpath-resizer.yaml (2191 bytes)
	I0924 00:36:22.083443 1874359 addons.go:431] installing /etc/kubernetes/addons/csi-hostpath-storageclass.yaml
	I0924 00:36:22.083524 1874359 ssh_runner.go:362] scp csi-hostpath-driver/deploy/csi-hostpath-storageclass.yaml --> /etc/kubernetes/addons/csi-hostpath-storageclass.yaml (846 bytes)
	I0924 00:36:22.163316 1874359 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/rbac-external-attacher.yaml -f /etc/kubernetes/addons/rbac-hostpath.yaml -f /etc/kubernetes/addons/rbac-external-health-monitor-controller.yaml -f /etc/kubernetes/addons/rbac-external-provisioner.yaml -f /etc/kubernetes/addons/rbac-external-resizer.yaml -f /etc/kubernetes/addons/rbac-external-snapshotter.yaml -f /etc/kubernetes/addons/csi-hostpath-attacher.yaml -f /etc/kubernetes/addons/csi-hostpath-driverinfo.yaml -f /etc/kubernetes/addons/csi-hostpath-plugin.yaml -f /etc/kubernetes/addons/csi-hostpath-resizer.yaml -f /etc/kubernetes/addons/csi-hostpath-storageclass.yaml
	I0924 00:36:24.144328 1874359 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/deployment.yaml: (3.670827968s)
	I0924 00:36:24.144432 1874359 ssh_runner.go:235] Completed: sudo systemctl start kubelet: (3.506674064s)
	I0924 00:36:24.145321 1874359 node_ready.go:35] waiting up to 6m0s for node "addons-371349" to be "Ready" ...
	I0924 00:36:24.145408 1874359 ssh_runner.go:235] Completed: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.31.1/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml | sed -e '/^        forward . \/etc\/resolv.conf.*/i \        hosts {\n           192.168.49.1 host.minikube.internal\n           fallthrough\n        }' -e '/^        errors *$/i \        log' | sudo /var/lib/minikube/binaries/v1.31.1/kubectl --kubeconfig=/var/lib/minikube/kubeconfig replace -f -": (3.50777396s)
	I0924 00:36:24.145532 1874359 start.go:971] {"host.minikube.internal": 192.168.49.1} host record injected into CoreDNS's ConfigMap
	I0924 00:36:24.715492 1874359 kapi.go:214] "coredns" deployment in "kube-system" namespace and "addons-371349" context rescaled to 1 replicas
	I0924 00:36:25.040041 1874359 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/nvidia-device-plugin.yaml: (4.199991565s)
	I0924 00:36:25.040144 1874359 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/ingress-dns-pod.yaml: (4.177769917s)
	I0924 00:36:25.040203 1874359 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml: (4.283555204s)
	I0924 00:36:26.068634 1874359 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/storage-provisioner-rancher.yaml: (5.167443532s)
	I0924 00:36:26.068893 1874359 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml: (5.136900017s)
	I0924 00:36:26.069063 1874359 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/registry-rc.yaml -f /etc/kubernetes/addons/registry-svc.yaml -f /etc/kubernetes/addons/registry-proxy.yaml: (4.861212104s)
	I0924 00:36:26.069102 1874359 addons.go:475] Verifying addon registry=true in "addons-371349"
	I0924 00:36:26.069312 1874359 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/ingress-deploy.yaml: (5.189916004s)
	I0924 00:36:26.069352 1874359 addons.go:475] Verifying addon ingress=true in "addons-371349"
	I0924 00:36:26.069638 1874359 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: (4.637069932s)
	I0924 00:36:26.069683 1874359 addons.go:475] Verifying addon metrics-server=true in "addons-371349"
	I0924 00:36:26.069746 1874359 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/yakd-ns.yaml -f /etc/kubernetes/addons/yakd-sa.yaml -f /etc/kubernetes/addons/yakd-crb.yaml -f /etc/kubernetes/addons/yakd-svc.yaml -f /etc/kubernetes/addons/yakd-dp.yaml: (4.515634182s)
	I0924 00:36:26.072113 1874359 out.go:177] * Verifying registry addon...
	I0924 00:36:26.072118 1874359 out.go:177] * To access YAKD - Kubernetes Dashboard, wait for Pod to be ready and run the following command:
	
		minikube -p addons-371349 service yakd-dashboard -n yakd-dashboard
	
	I0924 00:36:26.072265 1874359 out.go:177] * Verifying ingress addon...
	I0924 00:36:26.076283 1874359 kapi.go:75] Waiting for pod with label "kubernetes.io/minikube-addons=registry" in ns "kube-system" ...
	I0924 00:36:26.076406 1874359 kapi.go:75] Waiting for pod with label "app.kubernetes.io/name=ingress-nginx" in ns "ingress-nginx" ...
	I0924 00:36:26.107605 1874359 kapi.go:86] Found 1 Pods for label selector kubernetes.io/minikube-addons=registry
	I0924 00:36:26.107672 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:36:26.108621 1874359 kapi.go:86] Found 3 Pods for label selector app.kubernetes.io/name=ingress-nginx
	I0924 00:36:26.108644 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	W0924 00:36:26.113511 1874359 out.go:270] ! Enabling 'default-storageclass' returned an error: running callbacks: [Error making standard the default storage class: Error while marking storage class local-path as non-default: Operation cannot be fulfilled on storageclasses.storage.k8s.io "local-path": the object has been modified; please apply your changes to the latest version and try again]
	I0924 00:36:26.127645 1874359 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml: (4.530014705s)
	W0924 00:36:26.127709 1874359 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml: Process exited with status 1
	stdout:
	customresourcedefinition.apiextensions.k8s.io/volumesnapshotclasses.snapshot.storage.k8s.io created
	customresourcedefinition.apiextensions.k8s.io/volumesnapshotcontents.snapshot.storage.k8s.io created
	customresourcedefinition.apiextensions.k8s.io/volumesnapshots.snapshot.storage.k8s.io created
	serviceaccount/snapshot-controller created
	clusterrole.rbac.authorization.k8s.io/snapshot-controller-runner created
	clusterrolebinding.rbac.authorization.k8s.io/snapshot-controller-role created
	role.rbac.authorization.k8s.io/snapshot-controller-leaderelection created
	rolebinding.rbac.authorization.k8s.io/snapshot-controller-leaderelection created
	deployment.apps/snapshot-controller created
	
	stderr:
	error: resource mapping not found for name: "csi-hostpath-snapclass" namespace: "" from "/etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml": no matches for kind "VolumeSnapshotClass" in version "snapshot.storage.k8s.io/v1"
	ensure CRDs are installed first
	I0924 00:36:26.127734 1874359 retry.go:31] will retry after 162.565614ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml: Process exited with status 1
	stdout:
	customresourcedefinition.apiextensions.k8s.io/volumesnapshotclasses.snapshot.storage.k8s.io created
	customresourcedefinition.apiextensions.k8s.io/volumesnapshotcontents.snapshot.storage.k8s.io created
	customresourcedefinition.apiextensions.k8s.io/volumesnapshots.snapshot.storage.k8s.io created
	serviceaccount/snapshot-controller created
	clusterrole.rbac.authorization.k8s.io/snapshot-controller-runner created
	clusterrolebinding.rbac.authorization.k8s.io/snapshot-controller-role created
	role.rbac.authorization.k8s.io/snapshot-controller-leaderelection created
	rolebinding.rbac.authorization.k8s.io/snapshot-controller-leaderelection created
	deployment.apps/snapshot-controller created
	
	stderr:
	error: resource mapping not found for name: "csi-hostpath-snapclass" namespace: "" from "/etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml": no matches for kind "VolumeSnapshotClass" in version "snapshot.storage.k8s.io/v1"
	ensure CRDs are installed first
	I0924 00:36:26.127833 1874359 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/ig-namespace.yaml -f /etc/kubernetes/addons/ig-serviceaccount.yaml -f /etc/kubernetes/addons/ig-role.yaml -f /etc/kubernetes/addons/ig-rolebinding.yaml -f /etc/kubernetes/addons/ig-clusterrole.yaml -f /etc/kubernetes/addons/ig-clusterrolebinding.yaml -f /etc/kubernetes/addons/ig-crd.yaml -f /etc/kubernetes/addons/ig-daemonset.yaml: (4.339544749s)
	I0924 00:36:26.158098 1874359 node_ready.go:53] node "addons-371349" has status "Ready":"False"
	I0924 00:36:26.290971 1874359 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply --force -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml
	I0924 00:36:26.520771 1874359 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/rbac-external-attacher.yaml -f /etc/kubernetes/addons/rbac-hostpath.yaml -f /etc/kubernetes/addons/rbac-external-health-monitor-controller.yaml -f /etc/kubernetes/addons/rbac-external-provisioner.yaml -f /etc/kubernetes/addons/rbac-external-resizer.yaml -f /etc/kubernetes/addons/rbac-external-snapshotter.yaml -f /etc/kubernetes/addons/csi-hostpath-attacher.yaml -f /etc/kubernetes/addons/csi-hostpath-driverinfo.yaml -f /etc/kubernetes/addons/csi-hostpath-plugin.yaml -f /etc/kubernetes/addons/csi-hostpath-resizer.yaml -f /etc/kubernetes/addons/csi-hostpath-storageclass.yaml: (4.357357384s)
	I0924 00:36:26.520866 1874359 addons.go:475] Verifying addon csi-hostpath-driver=true in "addons-371349"
	I0924 00:36:26.528436 1874359 out.go:177] * Verifying csi-hostpath-driver addon...
	I0924 00:36:26.531914 1874359 kapi.go:75] Waiting for pod with label "kubernetes.io/minikube-addons=csi-hostpath-driver" in ns "kube-system" ...
	I0924 00:36:26.583310 1874359 kapi.go:86] Found 2 Pods for label selector kubernetes.io/minikube-addons=csi-hostpath-driver
	I0924 00:36:26.583384 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:36:26.615522 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:36:26.616914 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:36:27.036117 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:36:27.083005 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:36:27.087587 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:36:27.537002 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:36:27.581061 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:36:27.581936 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:36:28.040270 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:36:28.103999 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:36:28.106903 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:36:28.535961 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:36:28.583290 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:36:28.584302 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:36:28.649628 1874359 node_ready.go:53] node "addons-371349" has status "Ready":"False"
	I0924 00:36:29.129807 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:36:29.142056 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:36:29.142873 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:36:29.421608 1874359 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply --force -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml: (3.130525161s)
	I0924 00:36:29.536654 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:36:29.581589 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:36:29.582881 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:36:30.036664 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:36:30.081849 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:36:30.082302 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:36:30.112100 1874359 ssh_runner.go:362] scp memory --> /var/lib/minikube/google_application_credentials.json (162 bytes)
	I0924 00:36:30.112214 1874359 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-371349
	I0924 00:36:30.142251 1874359 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:34691 SSHKeyPath:/home/jenkins/minikube-integration/19696-1868219/.minikube/machines/addons-371349/id_rsa Username:docker}
	I0924 00:36:30.260045 1874359 ssh_runner.go:362] scp memory --> /var/lib/minikube/google_cloud_project (12 bytes)
	I0924 00:36:30.277969 1874359 addons.go:234] Setting addon gcp-auth=true in "addons-371349"
	I0924 00:36:30.278019 1874359 host.go:66] Checking if "addons-371349" exists ...
	I0924 00:36:30.278556 1874359 cli_runner.go:164] Run: docker container inspect addons-371349 --format={{.State.Status}}
	I0924 00:36:30.315639 1874359 ssh_runner.go:195] Run: cat /var/lib/minikube/google_application_credentials.json
	I0924 00:36:30.315718 1874359 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-371349
	I0924 00:36:30.339988 1874359 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:34691 SSHKeyPath:/home/jenkins/minikube-integration/19696-1868219/.minikube/machines/addons-371349/id_rsa Username:docker}
	I0924 00:36:30.440287 1874359 out.go:177]   - Using image registry.k8s.io/ingress-nginx/kube-webhook-certgen:v1.4.3
	I0924 00:36:30.443290 1874359 out.go:177]   - Using image gcr.io/k8s-minikube/gcp-auth-webhook:v0.1.2
	I0924 00:36:30.446069 1874359 addons.go:431] installing /etc/kubernetes/addons/gcp-auth-ns.yaml
	I0924 00:36:30.446097 1874359 ssh_runner.go:362] scp gcp-auth/gcp-auth-ns.yaml --> /etc/kubernetes/addons/gcp-auth-ns.yaml (700 bytes)
	I0924 00:36:30.465311 1874359 addons.go:431] installing /etc/kubernetes/addons/gcp-auth-service.yaml
	I0924 00:36:30.465336 1874359 ssh_runner.go:362] scp gcp-auth/gcp-auth-service.yaml --> /etc/kubernetes/addons/gcp-auth-service.yaml (788 bytes)
	I0924 00:36:30.486054 1874359 addons.go:431] installing /etc/kubernetes/addons/gcp-auth-webhook.yaml
	I0924 00:36:30.486127 1874359 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/gcp-auth-webhook.yaml (5421 bytes)
	I0924 00:36:30.505251 1874359 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/gcp-auth-ns.yaml -f /etc/kubernetes/addons/gcp-auth-service.yaml -f /etc/kubernetes/addons/gcp-auth-webhook.yaml
	I0924 00:36:30.536649 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:36:30.585185 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:36:30.586030 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:36:31.014868 1874359 addons.go:475] Verifying addon gcp-auth=true in "addons-371349"
	I0924 00:36:31.017554 1874359 out.go:177] * Verifying gcp-auth addon...
	I0924 00:36:31.021050 1874359 kapi.go:75] Waiting for pod with label "kubernetes.io/minikube-addons=gcp-auth" in ns "gcp-auth" ...
	I0924 00:36:31.034140 1874359 kapi.go:86] Found 1 Pods for label selector kubernetes.io/minikube-addons=gcp-auth
	I0924 00:36:31.034176 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:36:31.038331 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:36:31.134014 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:36:31.134925 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:36:31.148888 1874359 node_ready.go:53] node "addons-371349" has status "Ready":"False"
	I0924 00:36:31.524715 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:36:31.537587 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:36:31.583545 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:36:31.584292 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:36:32.029580 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:36:32.036463 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:36:32.079906 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:36:32.080747 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:36:32.525406 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:36:32.536047 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:36:32.581774 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:36:32.585020 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:36:33.025869 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:36:33.039581 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:36:33.080579 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:36:33.081397 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:36:33.149384 1874359 node_ready.go:53] node "addons-371349" has status "Ready":"False"
	I0924 00:36:33.524756 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:36:33.535925 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:36:33.580451 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:36:33.581698 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:36:34.024326 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:36:34.036000 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:36:34.080936 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:36:34.081359 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:36:34.524182 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:36:34.535599 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:36:34.579779 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:36:34.580333 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:36:35.024337 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:36:35.036647 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:36:35.080199 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:36:35.081117 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:36:35.524658 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:36:35.535725 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:36:35.580566 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:36:35.581224 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:36:35.648813 1874359 node_ready.go:53] node "addons-371349" has status "Ready":"False"
	I0924 00:36:36.025916 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:36:36.035978 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:36:36.080821 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:36:36.081603 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:36:36.524896 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:36:36.535453 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:36:36.580252 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:36:36.581485 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:36:37.025338 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:36:37.035963 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:36:37.080424 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:36:37.081442 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:36:37.524490 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:36:37.535728 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:36:37.579810 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:36:37.581450 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:36:38.024561 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:36:38.035487 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:36:38.080210 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:36:38.082742 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:36:38.148994 1874359 node_ready.go:53] node "addons-371349" has status "Ready":"False"
	I0924 00:36:38.525127 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:36:38.535345 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:36:38.580908 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:36:38.581362 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:36:39.024793 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:36:39.036425 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:36:39.080915 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:36:39.081967 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:36:39.525001 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:36:39.535354 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:36:39.580559 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:36:39.581513 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:36:40.024267 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:36:40.035238 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:36:40.080207 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:36:40.080204 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:36:40.149660 1874359 node_ready.go:53] node "addons-371349" has status "Ready":"False"
	I0924 00:36:40.524758 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:36:40.535590 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:36:40.581048 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:36:40.581408 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:36:41.024637 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:36:41.035772 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:36:41.080701 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:36:41.081021 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:36:41.524234 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:36:41.535462 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:36:41.580520 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:36:41.580776 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:36:42.024539 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:36:42.035544 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:36:42.081006 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:36:42.081307 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:36:42.524245 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:36:42.536155 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:36:42.580946 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:36:42.581039 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:36:42.648989 1874359 node_ready.go:53] node "addons-371349" has status "Ready":"False"
	I0924 00:36:43.025024 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:36:43.035416 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:36:43.079956 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:36:43.080806 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:36:43.524635 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:36:43.535313 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:36:43.579628 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:36:43.580591 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:36:44.024154 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:36:44.035337 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:36:44.080930 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:36:44.081486 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:36:44.525015 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:36:44.535108 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:36:44.580734 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:36:44.581548 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:36:45.025561 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:36:45.036042 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:36:45.082616 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:36:45.083677 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:36:45.149247 1874359 node_ready.go:53] node "addons-371349" has status "Ready":"False"
	I0924 00:36:45.525119 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:36:45.535570 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:36:45.581478 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:36:45.581723 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:36:46.024775 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:36:46.035430 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:36:46.080597 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:36:46.081121 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:36:46.524273 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:36:46.535421 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:36:46.580411 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:36:46.581494 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:36:47.024132 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:36:47.035958 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:36:47.079502 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:36:47.080659 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:36:47.524705 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:36:47.535463 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:36:47.579773 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:36:47.580840 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:36:47.648951 1874359 node_ready.go:53] node "addons-371349" has status "Ready":"False"
	I0924 00:36:48.024023 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:36:48.035180 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:36:48.080902 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:36:48.081690 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:36:48.525022 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:36:48.536041 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:36:48.580288 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:36:48.581384 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:36:49.024579 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:36:49.035983 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:36:49.080718 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:36:49.080794 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:36:49.524098 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:36:49.535304 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:36:49.580015 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:36:49.580711 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:36:49.651222 1874359 node_ready.go:53] node "addons-371349" has status "Ready":"False"
	I0924 00:36:50.024822 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:36:50.035661 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:36:50.081077 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:36:50.082067 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:36:50.523919 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:36:50.535086 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:36:50.579884 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:36:50.580617 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:36:51.024943 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:36:51.035906 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:36:51.080734 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:36:51.081047 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:36:51.525622 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:36:51.536144 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:36:51.582237 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:36:51.583744 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:36:52.024267 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:36:52.036157 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:36:52.080111 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:36:52.081119 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:36:52.149795 1874359 node_ready.go:53] node "addons-371349" has status "Ready":"False"
	I0924 00:36:52.524484 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:36:52.535733 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:36:52.580708 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:36:52.581326 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:36:53.024426 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:36:53.035238 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:36:53.081149 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:36:53.081259 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:36:53.523963 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:36:53.535867 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:36:53.580059 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:36:53.581802 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:36:54.024133 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:36:54.035572 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:36:54.081089 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:36:54.081851 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:36:54.524697 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:36:54.535922 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:36:54.580674 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:36:54.582700 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:36:54.648817 1874359 node_ready.go:53] node "addons-371349" has status "Ready":"False"
	I0924 00:36:55.024396 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:36:55.035661 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:36:55.080437 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:36:55.081018 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:36:55.525458 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:36:55.535674 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:36:55.580138 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:36:55.580887 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:36:56.024509 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:36:56.035901 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:36:56.079969 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:36:56.080725 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:36:56.524906 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:36:56.535679 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:36:56.580177 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:36:56.581395 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:36:57.024701 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:36:57.035901 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:36:57.080025 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:36:57.086044 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:36:57.148897 1874359 node_ready.go:53] node "addons-371349" has status "Ready":"False"
	I0924 00:36:57.524749 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:36:57.535483 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:36:57.580740 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:36:57.581056 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:36:58.024670 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:36:58.035904 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:36:58.080311 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:36:58.081007 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:36:58.524825 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:36:58.536045 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:36:58.579614 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:36:58.580465 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:36:59.024996 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:36:59.035397 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:36:59.080751 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:36:59.081451 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:36:59.524791 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:36:59.535925 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:36:59.580042 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:36:59.580800 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:36:59.649115 1874359 node_ready.go:53] node "addons-371349" has status "Ready":"False"
	I0924 00:37:00.042032 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:37:00.047337 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:37:00.083641 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:37:00.088909 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:37:00.524811 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:37:00.535611 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:37:00.581337 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:37:00.581599 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:37:01.024579 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:37:01.035532 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:37:01.080587 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:37:01.080960 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:37:01.524641 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:37:01.535695 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:37:01.580144 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:37:01.581256 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:37:01.649384 1874359 node_ready.go:53] node "addons-371349" has status "Ready":"False"
	I0924 00:37:02.025866 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:37:02.034934 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:37:02.081837 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:37:02.083560 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:37:02.524543 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:37:02.536023 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:37:02.580909 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:37:02.581242 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:37:03.024869 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:37:03.035126 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:37:03.080270 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:37:03.081025 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:37:03.524304 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:37:03.534941 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:37:03.579827 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:37:03.580519 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:37:04.024963 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:37:04.035474 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:37:04.080069 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:37:04.080924 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:37:04.148842 1874359 node_ready.go:53] node "addons-371349" has status "Ready":"False"
	I0924 00:37:04.524509 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:37:04.535251 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:37:04.580524 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:37:04.580751 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:37:05.089907 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:37:05.146256 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:37:05.148938 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:37:05.150236 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:37:05.179538 1874359 node_ready.go:49] node "addons-371349" has status "Ready":"True"
	I0924 00:37:05.179566 1874359 node_ready.go:38] duration metric: took 41.034106017s for node "addons-371349" to be "Ready" ...
	I0924 00:37:05.179588 1874359 pod_ready.go:36] extra waiting up to 6m0s for all system-critical pods including labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
	I0924 00:37:05.207895 1874359 pod_ready.go:79] waiting up to 6m0s for pod "coredns-7c65d6cfc9-bsbwf" in "kube-system" namespace to be "Ready" ...
	I0924 00:37:05.558862 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:37:05.602208 1874359 kapi.go:86] Found 3 Pods for label selector kubernetes.io/minikube-addons=csi-hostpath-driver
	I0924 00:37:05.602281 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:37:05.642597 1874359 kapi.go:86] Found 2 Pods for label selector kubernetes.io/minikube-addons=registry
	I0924 00:37:05.642664 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:37:05.644171 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:37:06.027664 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:37:06.127307 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:37:06.128297 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:37:06.129576 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:37:06.525542 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:37:06.537888 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:37:06.580363 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:37:06.581449 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:37:06.714501 1874359 pod_ready.go:93] pod "coredns-7c65d6cfc9-bsbwf" in "kube-system" namespace has status "Ready":"True"
	I0924 00:37:06.714528 1874359 pod_ready.go:82] duration metric: took 1.506549159s for pod "coredns-7c65d6cfc9-bsbwf" in "kube-system" namespace to be "Ready" ...
	I0924 00:37:06.714551 1874359 pod_ready.go:79] waiting up to 6m0s for pod "etcd-addons-371349" in "kube-system" namespace to be "Ready" ...
	I0924 00:37:06.719528 1874359 pod_ready.go:93] pod "etcd-addons-371349" in "kube-system" namespace has status "Ready":"True"
	I0924 00:37:06.719552 1874359 pod_ready.go:82] duration metric: took 4.992556ms for pod "etcd-addons-371349" in "kube-system" namespace to be "Ready" ...
	I0924 00:37:06.719568 1874359 pod_ready.go:79] waiting up to 6m0s for pod "kube-apiserver-addons-371349" in "kube-system" namespace to be "Ready" ...
	I0924 00:37:06.724493 1874359 pod_ready.go:93] pod "kube-apiserver-addons-371349" in "kube-system" namespace has status "Ready":"True"
	I0924 00:37:06.724526 1874359 pod_ready.go:82] duration metric: took 4.941719ms for pod "kube-apiserver-addons-371349" in "kube-system" namespace to be "Ready" ...
	I0924 00:37:06.724537 1874359 pod_ready.go:79] waiting up to 6m0s for pod "kube-controller-manager-addons-371349" in "kube-system" namespace to be "Ready" ...
	I0924 00:37:06.729495 1874359 pod_ready.go:93] pod "kube-controller-manager-addons-371349" in "kube-system" namespace has status "Ready":"True"
	I0924 00:37:06.729522 1874359 pod_ready.go:82] duration metric: took 4.976417ms for pod "kube-controller-manager-addons-371349" in "kube-system" namespace to be "Ready" ...
	I0924 00:37:06.729536 1874359 pod_ready.go:79] waiting up to 6m0s for pod "kube-proxy-qcb9f" in "kube-system" namespace to be "Ready" ...
	I0924 00:37:06.749711 1874359 pod_ready.go:93] pod "kube-proxy-qcb9f" in "kube-system" namespace has status "Ready":"True"
	I0924 00:37:06.749739 1874359 pod_ready.go:82] duration metric: took 20.168473ms for pod "kube-proxy-qcb9f" in "kube-system" namespace to be "Ready" ...
	I0924 00:37:06.749753 1874359 pod_ready.go:79] waiting up to 6m0s for pod "kube-scheduler-addons-371349" in "kube-system" namespace to be "Ready" ...
	I0924 00:37:07.025711 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:37:07.038223 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:37:07.081942 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:37:07.087767 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:37:07.149444 1874359 pod_ready.go:93] pod "kube-scheduler-addons-371349" in "kube-system" namespace has status "Ready":"True"
	I0924 00:37:07.149478 1874359 pod_ready.go:82] duration metric: took 399.67927ms for pod "kube-scheduler-addons-371349" in "kube-system" namespace to be "Ready" ...
	I0924 00:37:07.149493 1874359 pod_ready.go:79] waiting up to 6m0s for pod "metrics-server-84c5f94fbc-wxd2s" in "kube-system" namespace to be "Ready" ...
	I0924 00:37:07.527967 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:37:07.537140 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:37:07.581804 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:37:07.589930 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:37:08.024515 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:37:08.037935 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:37:08.080943 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:37:08.082144 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:37:08.526095 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:37:08.627092 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:37:08.628004 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:37:08.629352 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:37:09.025639 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:37:09.037030 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:37:09.080958 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:37:09.082245 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:37:09.156164 1874359 pod_ready.go:103] pod "metrics-server-84c5f94fbc-wxd2s" in "kube-system" namespace has status "Ready":"False"
	I0924 00:37:09.525206 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:37:09.536652 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:37:09.580423 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:37:09.581569 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:37:10.024542 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:37:10.036488 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:37:10.083141 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:37:10.083751 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:37:10.525674 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:37:10.539556 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:37:10.581513 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:37:10.582166 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:37:11.025092 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:37:11.037039 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:37:11.080754 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:37:11.082596 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:37:11.529972 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:37:11.542182 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:37:11.627456 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:37:11.628865 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:37:11.659076 1874359 pod_ready.go:103] pod "metrics-server-84c5f94fbc-wxd2s" in "kube-system" namespace has status "Ready":"False"
	I0924 00:37:12.024999 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:37:12.036841 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:37:12.083120 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:37:12.087612 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:37:12.524562 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:37:12.537338 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:37:12.580705 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:37:12.584105 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:37:13.025189 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:37:13.037496 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:37:13.087190 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:37:13.089015 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:37:13.525150 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:37:13.538733 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:37:13.584085 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:37:13.585380 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:37:14.027157 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:37:14.037065 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:37:14.084801 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:37:14.085746 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:37:14.157004 1874359 pod_ready.go:103] pod "metrics-server-84c5f94fbc-wxd2s" in "kube-system" namespace has status "Ready":"False"
	I0924 00:37:14.525171 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:37:14.536194 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:37:14.626376 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:37:14.627039 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:37:15.024978 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:37:15.037209 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:37:15.090958 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:37:15.091024 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:37:15.525306 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:37:15.538434 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:37:15.585043 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:37:15.587617 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:37:16.025459 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:37:16.037260 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:37:16.126894 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:37:16.130568 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:37:16.158943 1874359 pod_ready.go:103] pod "metrics-server-84c5f94fbc-wxd2s" in "kube-system" namespace has status "Ready":"False"
	I0924 00:37:16.525066 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:37:16.536819 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:37:16.582319 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:37:16.584728 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:37:17.024258 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:37:17.036828 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:37:17.080446 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:37:17.080931 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:37:17.525099 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:37:17.536245 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:37:17.580612 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:37:17.581968 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:37:18.025910 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:37:18.038077 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:37:18.080436 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:37:18.083296 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:37:18.527808 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:37:18.537402 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:37:18.630293 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:37:18.631606 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:37:18.659678 1874359 pod_ready.go:103] pod "metrics-server-84c5f94fbc-wxd2s" in "kube-system" namespace has status "Ready":"False"
	I0924 00:37:19.024917 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:37:19.037952 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:37:19.080673 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:37:19.082011 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:37:19.526385 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:37:19.537535 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:37:19.582985 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:37:19.583884 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:37:20.025520 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:37:20.037056 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:37:20.082107 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:37:20.083379 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:37:20.533110 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:37:20.536253 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:37:20.580380 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:37:20.581682 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:37:21.025861 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:37:21.036666 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:37:21.081257 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:37:21.082276 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:37:21.155291 1874359 pod_ready.go:103] pod "metrics-server-84c5f94fbc-wxd2s" in "kube-system" namespace has status "Ready":"False"
	I0924 00:37:21.525011 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:37:21.536910 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:37:21.580560 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:37:21.581558 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:37:22.024754 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:37:22.045868 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:37:22.081285 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:37:22.092291 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:37:22.524880 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:37:22.536206 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:37:22.582528 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:37:22.583540 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:37:23.024908 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:37:23.038687 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:37:23.083594 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:37:23.087148 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:37:23.166572 1874359 pod_ready.go:103] pod "metrics-server-84c5f94fbc-wxd2s" in "kube-system" namespace has status "Ready":"False"
	I0924 00:37:23.525800 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:37:23.538193 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:37:23.583530 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:37:23.585180 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:37:24.025641 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:37:24.037958 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:37:24.086952 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:37:24.091709 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:37:24.529436 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:37:24.539653 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:37:24.582335 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:37:24.583840 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:37:25.025439 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:37:25.038394 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:37:25.081750 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:37:25.092141 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:37:25.526868 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:37:25.538477 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:37:25.588303 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:37:25.589649 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:37:25.658759 1874359 pod_ready.go:103] pod "metrics-server-84c5f94fbc-wxd2s" in "kube-system" namespace has status "Ready":"False"
	I0924 00:37:26.028966 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:37:26.039906 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:37:26.085009 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:37:26.086281 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:37:26.525400 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:37:26.537986 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:37:26.582372 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:37:26.583325 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:37:27.024598 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:37:27.036494 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:37:27.082090 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:37:27.083243 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:37:27.526087 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:37:27.536693 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:37:27.585781 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:37:27.587193 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:37:28.024899 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:37:28.037156 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:37:28.084220 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:37:28.086472 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:37:28.155018 1874359 pod_ready.go:103] pod "metrics-server-84c5f94fbc-wxd2s" in "kube-system" namespace has status "Ready":"False"
	I0924 00:37:28.525481 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:37:28.537283 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:37:28.581429 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:37:28.582651 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:37:29.028915 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:37:29.041859 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:37:29.083052 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:37:29.084536 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:37:29.524326 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:37:29.538851 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:37:29.580454 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:37:29.581371 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:37:30.025742 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:37:30.040126 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:37:30.088822 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:37:30.089975 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:37:30.169449 1874359 pod_ready.go:103] pod "metrics-server-84c5f94fbc-wxd2s" in "kube-system" namespace has status "Ready":"False"
	I0924 00:37:30.525768 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:37:30.542144 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:37:30.582292 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:37:30.583557 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:37:31.025479 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:37:31.037617 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:37:31.086866 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:37:31.088089 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:37:31.524826 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:37:31.536697 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:37:31.581167 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:37:31.582168 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:37:32.024816 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:37:32.037176 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:37:32.082087 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:37:32.082530 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:37:32.525146 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:37:32.536628 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:37:32.582408 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:37:32.584925 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:37:32.655890 1874359 pod_ready.go:103] pod "metrics-server-84c5f94fbc-wxd2s" in "kube-system" namespace has status "Ready":"False"
	I0924 00:37:33.024977 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:37:33.044508 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:37:33.082373 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:37:33.088346 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:37:33.526214 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:37:33.540746 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:37:33.583760 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:37:33.585189 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:37:34.025056 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:37:34.037589 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:37:34.082589 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:37:34.086961 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:37:34.525641 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:37:34.537798 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:37:34.584630 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:37:34.586996 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:37:34.659691 1874359 pod_ready.go:103] pod "metrics-server-84c5f94fbc-wxd2s" in "kube-system" namespace has status "Ready":"False"
	I0924 00:37:35.025955 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:37:35.037530 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:37:35.085784 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:37:35.088173 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:37:35.526354 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:37:35.538479 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:37:35.591723 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:37:35.592824 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:37:36.025497 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:37:36.037602 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:37:36.083224 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:37:36.087183 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:37:36.529702 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:37:36.538066 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:37:36.581116 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:37:36.582309 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:37:37.025278 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:37:37.037273 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:37:37.081162 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:37:37.082133 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:37:37.155957 1874359 pod_ready.go:103] pod "metrics-server-84c5f94fbc-wxd2s" in "kube-system" namespace has status "Ready":"False"
	I0924 00:37:37.524751 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:37:37.537323 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:37:37.581677 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:37:37.582621 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:37:38.024821 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:37:38.037096 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:37:38.081199 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:37:38.082023 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:37:38.524480 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:37:38.536790 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:37:38.581212 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:37:38.581536 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:37:39.045544 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:37:39.059204 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:37:39.082025 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:37:39.085281 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:37:39.157501 1874359 pod_ready.go:103] pod "metrics-server-84c5f94fbc-wxd2s" in "kube-system" namespace has status "Ready":"False"
	I0924 00:37:39.525548 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:37:39.537916 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:37:39.581805 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:37:39.583375 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:37:40.026572 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:37:40.040843 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:37:40.082291 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:37:40.083067 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:37:40.524989 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:37:40.537105 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:37:40.585930 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:37:40.587514 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:37:41.029782 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:37:41.037748 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:37:41.090908 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:37:41.099541 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:37:41.525223 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:37:41.537455 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:37:41.597760 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:37:41.598335 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:37:41.656910 1874359 pod_ready.go:103] pod "metrics-server-84c5f94fbc-wxd2s" in "kube-system" namespace has status "Ready":"False"
	I0924 00:37:42.024504 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:37:42.037336 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:37:42.081180 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:37:42.082250 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:37:42.525242 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:37:42.537114 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:37:42.581394 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:37:42.582401 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:37:43.025428 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:37:43.036674 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:37:43.080101 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:37:43.081322 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:37:43.524449 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:37:43.536809 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:37:43.580565 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:37:43.581555 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:37:43.657385 1874359 pod_ready.go:103] pod "metrics-server-84c5f94fbc-wxd2s" in "kube-system" namespace has status "Ready":"False"
	I0924 00:37:44.025083 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:37:44.036712 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:37:44.081458 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:37:44.082346 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:37:44.525241 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:37:44.537777 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:37:44.583018 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:37:44.583564 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:37:45.026665 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:37:45.039492 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:37:45.084260 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:37:45.089405 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:37:45.525091 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:37:45.537406 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:37:45.580479 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:37:45.581943 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:37:46.025973 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:37:46.036622 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:37:46.081671 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:37:46.082347 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:37:46.156709 1874359 pod_ready.go:103] pod "metrics-server-84c5f94fbc-wxd2s" in "kube-system" namespace has status "Ready":"False"
	I0924 00:37:46.525927 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:37:46.537762 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:37:46.582385 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0924 00:37:46.585178 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:37:47.024474 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:37:47.036329 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:37:47.127012 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:37:47.127911 1874359 kapi.go:107] duration metric: took 1m21.05162918s to wait for kubernetes.io/minikube-addons=registry ...
	I0924 00:37:47.525100 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:37:47.536497 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:37:47.581247 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:37:48.026371 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:37:48.038903 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:37:48.081959 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:37:48.163263 1874359 pod_ready.go:103] pod "metrics-server-84c5f94fbc-wxd2s" in "kube-system" namespace has status "Ready":"False"
	I0924 00:37:48.525594 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:37:48.537361 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:37:48.580855 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:37:49.026110 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:37:49.036648 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:37:49.083100 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:37:49.526547 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:37:49.537074 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:37:49.581783 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:37:50.025551 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:37:50.037461 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:37:50.091209 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:37:50.526125 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:37:50.538037 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:37:50.581389 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:37:50.656358 1874359 pod_ready.go:103] pod "metrics-server-84c5f94fbc-wxd2s" in "kube-system" namespace has status "Ready":"False"
	I0924 00:37:51.024559 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:37:51.036562 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:37:51.126796 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:37:51.525215 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:37:51.539279 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:37:51.580966 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:37:52.024488 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:37:52.036345 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:37:52.081028 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:37:52.525396 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:37:52.536020 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:37:52.582181 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:37:53.024883 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:37:53.037277 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:37:53.081315 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:37:53.157617 1874359 pod_ready.go:103] pod "metrics-server-84c5f94fbc-wxd2s" in "kube-system" namespace has status "Ready":"False"
	I0924 00:37:53.531462 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:37:53.551300 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:37:53.581174 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:37:54.035236 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:37:54.038756 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:37:54.081353 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:37:54.525628 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:37:54.537870 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:37:54.582071 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:37:55.024989 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:37:55.037361 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:37:55.082676 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:37:55.159960 1874359 pod_ready.go:103] pod "metrics-server-84c5f94fbc-wxd2s" in "kube-system" namespace has status "Ready":"False"
	I0924 00:37:55.524909 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:37:55.536796 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:37:55.588343 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:37:56.024551 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:37:56.036790 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:37:56.082494 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:37:56.524588 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:37:56.537087 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:37:56.580954 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:37:57.024654 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:37:57.038690 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:37:57.126095 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:37:57.524362 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:37:57.537019 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:37:57.580612 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:37:57.655571 1874359 pod_ready.go:103] pod "metrics-server-84c5f94fbc-wxd2s" in "kube-system" namespace has status "Ready":"False"
	I0924 00:37:58.024601 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:37:58.037441 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:37:58.081534 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:37:58.526040 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:37:58.538585 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:37:58.581369 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:37:59.025374 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:37:59.038033 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:37:59.081690 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:37:59.525152 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:37:59.536805 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:37:59.581719 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:38:00.037589 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0924 00:38:00.053908 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:38:00.099069 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:38:00.161051 1874359 pod_ready.go:103] pod "metrics-server-84c5f94fbc-wxd2s" in "kube-system" namespace has status "Ready":"False"
	I0924 00:38:00.525439 1874359 kapi.go:107] duration metric: took 1m29.504386686s to wait for kubernetes.io/minikube-addons=gcp-auth ...
	I0924 00:38:00.527071 1874359 out.go:177] * Your GCP credentials will now be mounted into every pod created in the addons-371349 cluster.
	I0924 00:38:00.528190 1874359 out.go:177] * If you don't want your credentials mounted into a specific pod, add a label with the `gcp-auth-skip-secret` key to your pod configuration.
	I0924 00:38:00.529186 1874359 out.go:177] * If you want existing pods to be mounted with credentials, either recreate them or rerun addons enable with --refresh.
	I0924 00:38:00.536173 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:38:00.582001 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:38:01.037731 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:38:01.081278 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:38:01.540282 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:38:01.581606 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:38:02.038254 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:38:02.086067 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:38:02.537116 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:38:02.580626 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:38:02.655706 1874359 pod_ready.go:103] pod "metrics-server-84c5f94fbc-wxd2s" in "kube-system" namespace has status "Ready":"False"
	I0924 00:38:03.038020 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:38:03.094972 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:38:03.541262 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:38:03.581455 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:38:04.038649 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:38:04.092757 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:38:04.537238 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:38:04.581087 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:38:04.655863 1874359 pod_ready.go:103] pod "metrics-server-84c5f94fbc-wxd2s" in "kube-system" namespace has status "Ready":"False"
	I0924 00:38:05.036406 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:38:05.081030 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:38:05.537884 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:38:05.639562 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:38:06.037479 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:38:06.081362 1874359 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0924 00:38:06.537654 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:38:06.598408 1874359 kapi.go:107] duration metric: took 1m40.522007667s to wait for app.kubernetes.io/name=ingress-nginx ...
	I0924 00:38:07.036544 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:38:07.157639 1874359 pod_ready.go:103] pod "metrics-server-84c5f94fbc-wxd2s" in "kube-system" namespace has status "Ready":"False"
	I0924 00:38:07.537205 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:38:08.037211 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:38:08.537454 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:38:09.036723 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:38:09.536459 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:38:09.660906 1874359 pod_ready.go:103] pod "metrics-server-84c5f94fbc-wxd2s" in "kube-system" namespace has status "Ready":"False"
	I0924 00:38:10.036444 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:38:10.540294 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:38:11.037220 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:38:11.536773 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:38:12.041688 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:38:12.155984 1874359 pod_ready.go:103] pod "metrics-server-84c5f94fbc-wxd2s" in "kube-system" namespace has status "Ready":"False"
	I0924 00:38:12.537422 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:38:13.036723 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:38:13.537634 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:38:14.037440 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:38:14.156344 1874359 pod_ready.go:103] pod "metrics-server-84c5f94fbc-wxd2s" in "kube-system" namespace has status "Ready":"False"
	I0924 00:38:14.537047 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:38:15.038133 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:38:15.536566 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:38:16.037248 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:38:16.156676 1874359 pod_ready.go:103] pod "metrics-server-84c5f94fbc-wxd2s" in "kube-system" namespace has status "Ready":"False"
	I0924 00:38:16.543569 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:38:17.037895 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:38:17.537063 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:38:18.038305 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:38:18.157313 1874359 pod_ready.go:103] pod "metrics-server-84c5f94fbc-wxd2s" in "kube-system" namespace has status "Ready":"False"
	I0924 00:38:18.537792 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:38:19.036928 1874359 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0924 00:38:19.537390 1874359 kapi.go:107] duration metric: took 1m53.005474628s to wait for kubernetes.io/minikube-addons=csi-hostpath-driver ...
	I0924 00:38:19.539097 1874359 out.go:177] * Enabled addons: cloud-spanner, nvidia-device-plugin, ingress-dns, storage-provisioner, metrics-server, yakd, storage-provisioner-rancher, inspektor-gadget, volumesnapshots, registry, gcp-auth, ingress, csi-hostpath-driver
	I0924 00:38:19.540466 1874359 addons.go:510] duration metric: took 1m59.627204899s for enable addons: enabled=[cloud-spanner nvidia-device-plugin ingress-dns storage-provisioner metrics-server yakd storage-provisioner-rancher inspektor-gadget volumesnapshots registry gcp-auth ingress csi-hostpath-driver]
	I0924 00:38:20.656506 1874359 pod_ready.go:103] pod "metrics-server-84c5f94fbc-wxd2s" in "kube-system" namespace has status "Ready":"False"
	I0924 00:38:23.155679 1874359 pod_ready.go:103] pod "metrics-server-84c5f94fbc-wxd2s" in "kube-system" namespace has status "Ready":"False"
	I0924 00:38:25.156435 1874359 pod_ready.go:103] pod "metrics-server-84c5f94fbc-wxd2s" in "kube-system" namespace has status "Ready":"False"
	I0924 00:38:27.656305 1874359 pod_ready.go:103] pod "metrics-server-84c5f94fbc-wxd2s" in "kube-system" namespace has status "Ready":"False"
	I0924 00:38:30.155444 1874359 pod_ready.go:103] pod "metrics-server-84c5f94fbc-wxd2s" in "kube-system" namespace has status "Ready":"False"
	I0924 00:38:32.155689 1874359 pod_ready.go:103] pod "metrics-server-84c5f94fbc-wxd2s" in "kube-system" namespace has status "Ready":"False"
	I0924 00:38:34.655805 1874359 pod_ready.go:103] pod "metrics-server-84c5f94fbc-wxd2s" in "kube-system" namespace has status "Ready":"False"
	I0924 00:38:37.156103 1874359 pod_ready.go:103] pod "metrics-server-84c5f94fbc-wxd2s" in "kube-system" namespace has status "Ready":"False"
	I0924 00:38:39.655725 1874359 pod_ready.go:103] pod "metrics-server-84c5f94fbc-wxd2s" in "kube-system" namespace has status "Ready":"False"
	I0924 00:38:42.156282 1874359 pod_ready.go:103] pod "metrics-server-84c5f94fbc-wxd2s" in "kube-system" namespace has status "Ready":"False"
	I0924 00:38:44.655229 1874359 pod_ready.go:103] pod "metrics-server-84c5f94fbc-wxd2s" in "kube-system" namespace has status "Ready":"False"
	I0924 00:38:45.655782 1874359 pod_ready.go:93] pod "metrics-server-84c5f94fbc-wxd2s" in "kube-system" namespace has status "Ready":"True"
	I0924 00:38:45.655810 1874359 pod_ready.go:82] duration metric: took 1m38.506308998s for pod "metrics-server-84c5f94fbc-wxd2s" in "kube-system" namespace to be "Ready" ...
	I0924 00:38:45.655822 1874359 pod_ready.go:79] waiting up to 6m0s for pod "nvidia-device-plugin-daemonset-t52r5" in "kube-system" namespace to be "Ready" ...
	I0924 00:38:45.661703 1874359 pod_ready.go:93] pod "nvidia-device-plugin-daemonset-t52r5" in "kube-system" namespace has status "Ready":"True"
	I0924 00:38:45.661731 1874359 pod_ready.go:82] duration metric: took 5.900916ms for pod "nvidia-device-plugin-daemonset-t52r5" in "kube-system" namespace to be "Ready" ...
	I0924 00:38:45.661752 1874359 pod_ready.go:39] duration metric: took 1m40.482149573s for extra waiting for all system-critical and pods with labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
	I0924 00:38:45.661768 1874359 api_server.go:52] waiting for apiserver process to appear ...
	I0924 00:38:45.661798 1874359 cri.go:54] listing CRI containers in root : {State:all Name:kube-apiserver Namespaces:[]}
	I0924 00:38:45.661888 1874359 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
	I0924 00:38:45.708292 1874359 cri.go:89] found id: "749045c42da2d61080a3969428ab514fa4047e831ebb9439b8511e518e9b1c04"
	I0924 00:38:45.708314 1874359 cri.go:89] found id: ""
	I0924 00:38:45.708322 1874359 logs.go:276] 1 containers: [749045c42da2d61080a3969428ab514fa4047e831ebb9439b8511e518e9b1c04]
	I0924 00:38:45.708376 1874359 ssh_runner.go:195] Run: which crictl
	I0924 00:38:45.711784 1874359 cri.go:54] listing CRI containers in root : {State:all Name:etcd Namespaces:[]}
	I0924 00:38:45.711857 1874359 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
	I0924 00:38:45.750924 1874359 cri.go:89] found id: "40d8a21a9712f40f598893c1aba5670ff43d964a7b5d9463400bf4a64836edb2"
	I0924 00:38:45.750947 1874359 cri.go:89] found id: ""
	I0924 00:38:45.750955 1874359 logs.go:276] 1 containers: [40d8a21a9712f40f598893c1aba5670ff43d964a7b5d9463400bf4a64836edb2]
	I0924 00:38:45.751013 1874359 ssh_runner.go:195] Run: which crictl
	I0924 00:38:45.754635 1874359 cri.go:54] listing CRI containers in root : {State:all Name:coredns Namespaces:[]}
	I0924 00:38:45.754709 1874359 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
	I0924 00:38:45.793731 1874359 cri.go:89] found id: "07152f00c7b5566d20be0e478631432f898e24fefada16283e2ca7028b046c61"
	I0924 00:38:45.793754 1874359 cri.go:89] found id: ""
	I0924 00:38:45.793763 1874359 logs.go:276] 1 containers: [07152f00c7b5566d20be0e478631432f898e24fefada16283e2ca7028b046c61]
	I0924 00:38:45.793857 1874359 ssh_runner.go:195] Run: which crictl
	I0924 00:38:45.797215 1874359 cri.go:54] listing CRI containers in root : {State:all Name:kube-scheduler Namespaces:[]}
	I0924 00:38:45.797286 1874359 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
	I0924 00:38:45.835387 1874359 cri.go:89] found id: "278db6b1284e1f1d66e55b827b5a4b51ea66ac4b399cfb13b724520fb0071730"
	I0924 00:38:45.835411 1874359 cri.go:89] found id: ""
	I0924 00:38:45.835420 1874359 logs.go:276] 1 containers: [278db6b1284e1f1d66e55b827b5a4b51ea66ac4b399cfb13b724520fb0071730]
	I0924 00:38:45.835481 1874359 ssh_runner.go:195] Run: which crictl
	I0924 00:38:45.838906 1874359 cri.go:54] listing CRI containers in root : {State:all Name:kube-proxy Namespaces:[]}
	I0924 00:38:45.838976 1874359 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
	I0924 00:38:45.877355 1874359 cri.go:89] found id: "8f2c47f2d8dc25f068087f5d0e702e1768f8714f22c484f1ebe13e92be684997"
	I0924 00:38:45.877377 1874359 cri.go:89] found id: ""
	I0924 00:38:45.877385 1874359 logs.go:276] 1 containers: [8f2c47f2d8dc25f068087f5d0e702e1768f8714f22c484f1ebe13e92be684997]
	I0924 00:38:45.877441 1874359 ssh_runner.go:195] Run: which crictl
	I0924 00:38:45.880750 1874359 cri.go:54] listing CRI containers in root : {State:all Name:kube-controller-manager Namespaces:[]}
	I0924 00:38:45.880823 1874359 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
	I0924 00:38:45.917541 1874359 cri.go:89] found id: "340d83c4a515af013d7e2f2cb8dd72a56a11c8be46e63481fd282573f250be80"
	I0924 00:38:45.917564 1874359 cri.go:89] found id: ""
	I0924 00:38:45.917572 1874359 logs.go:276] 1 containers: [340d83c4a515af013d7e2f2cb8dd72a56a11c8be46e63481fd282573f250be80]
	I0924 00:38:45.917629 1874359 ssh_runner.go:195] Run: which crictl
	I0924 00:38:45.921074 1874359 cri.go:54] listing CRI containers in root : {State:all Name:kindnet Namespaces:[]}
	I0924 00:38:45.921143 1874359 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet
	I0924 00:38:45.958520 1874359 cri.go:89] found id: "7adace27f5bf6fd0d07f44c3b2d9c4b94d8130080a2626aadc5ab73681d376ef"
	I0924 00:38:45.958543 1874359 cri.go:89] found id: ""
	I0924 00:38:45.958551 1874359 logs.go:276] 1 containers: [7adace27f5bf6fd0d07f44c3b2d9c4b94d8130080a2626aadc5ab73681d376ef]
	I0924 00:38:45.958605 1874359 ssh_runner.go:195] Run: which crictl
	I0924 00:38:45.962293 1874359 logs.go:123] Gathering logs for etcd [40d8a21a9712f40f598893c1aba5670ff43d964a7b5d9463400bf4a64836edb2] ...
	I0924 00:38:45.962324 1874359 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 40d8a21a9712f40f598893c1aba5670ff43d964a7b5d9463400bf4a64836edb2"
	I0924 00:38:46.013293 1874359 logs.go:123] Gathering logs for coredns [07152f00c7b5566d20be0e478631432f898e24fefada16283e2ca7028b046c61] ...
	I0924 00:38:46.013323 1874359 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 07152f00c7b5566d20be0e478631432f898e24fefada16283e2ca7028b046c61"
	I0924 00:38:46.057115 1874359 logs.go:123] Gathering logs for kube-controller-manager [340d83c4a515af013d7e2f2cb8dd72a56a11c8be46e63481fd282573f250be80] ...
	I0924 00:38:46.057145 1874359 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 340d83c4a515af013d7e2f2cb8dd72a56a11c8be46e63481fd282573f250be80"
	I0924 00:38:46.144145 1874359 logs.go:123] Gathering logs for container status ...
	I0924 00:38:46.144184 1874359 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
	I0924 00:38:46.191233 1874359 logs.go:123] Gathering logs for kubelet ...
	I0924 00:38:46.191266 1874359 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
	W0924 00:38:46.229555 1874359 logs.go:138] Found kubelet problem: Sep 24 00:37:05 addons-371349 kubelet[1485]: W0924 00:37:05.058504    1485 reflector.go:561] object-"yakd-dashboard"/"kube-root-ca.crt": failed to list *v1.ConfigMap: configmaps "kube-root-ca.crt" is forbidden: User "system:node:addons-371349" cannot list resource "configmaps" in API group "" in the namespace "yakd-dashboard": no relationship found between node 'addons-371349' and this object
	W0924 00:38:46.229828 1874359 logs.go:138] Found kubelet problem: Sep 24 00:37:05 addons-371349 kubelet[1485]: E0924 00:37:05.058554    1485 reflector.go:158] "Unhandled Error" err="object-\"yakd-dashboard\"/\"kube-root-ca.crt\": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps \"kube-root-ca.crt\" is forbidden: User \"system:node:addons-371349\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"yakd-dashboard\": no relationship found between node 'addons-371349' and this object" logger="UnhandledError"
	W0924 00:38:46.230013 1874359 logs.go:138] Found kubelet problem: Sep 24 00:37:05 addons-371349 kubelet[1485]: W0924 00:37:05.100500    1485 reflector.go:561] object-"default"/"kube-root-ca.crt": failed to list *v1.ConfigMap: configmaps "kube-root-ca.crt" is forbidden: User "system:node:addons-371349" cannot list resource "configmaps" in API group "" in the namespace "default": no relationship found between node 'addons-371349' and this object
	W0924 00:38:46.230237 1874359 logs.go:138] Found kubelet problem: Sep 24 00:37:05 addons-371349 kubelet[1485]: E0924 00:37:05.100553    1485 reflector.go:158] "Unhandled Error" err="object-\"default\"/\"kube-root-ca.crt\": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps \"kube-root-ca.crt\" is forbidden: User \"system:node:addons-371349\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"default\": no relationship found between node 'addons-371349' and this object" logger="UnhandledError"
	W0924 00:38:46.230404 1874359 logs.go:138] Found kubelet problem: Sep 24 00:37:05 addons-371349 kubelet[1485]: W0924 00:37:05.100721    1485 reflector.go:561] object-"default"/"gcp-auth": failed to list *v1.Secret: secrets "gcp-auth" is forbidden: User "system:node:addons-371349" cannot list resource "secrets" in API group "" in the namespace "default": no relationship found between node 'addons-371349' and this object
	W0924 00:38:46.230609 1874359 logs.go:138] Found kubelet problem: Sep 24 00:37:05 addons-371349 kubelet[1485]: E0924 00:37:05.100750    1485 reflector.go:158] "Unhandled Error" err="object-\"default\"/\"gcp-auth\": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets \"gcp-auth\" is forbidden: User \"system:node:addons-371349\" cannot list resource \"secrets\" in API group \"\" in the namespace \"default\": no relationship found between node 'addons-371349' and this object" logger="UnhandledError"
	I0924 00:38:46.279179 1874359 logs.go:123] Gathering logs for describe nodes ...
	I0924 00:38:46.279214 1874359 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.31.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
	I0924 00:38:46.468252 1874359 logs.go:123] Gathering logs for kube-scheduler [278db6b1284e1f1d66e55b827b5a4b51ea66ac4b399cfb13b724520fb0071730] ...
	I0924 00:38:46.468289 1874359 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 278db6b1284e1f1d66e55b827b5a4b51ea66ac4b399cfb13b724520fb0071730"
	I0924 00:38:46.523886 1874359 logs.go:123] Gathering logs for kube-proxy [8f2c47f2d8dc25f068087f5d0e702e1768f8714f22c484f1ebe13e92be684997] ...
	I0924 00:38:46.523926 1874359 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 8f2c47f2d8dc25f068087f5d0e702e1768f8714f22c484f1ebe13e92be684997"
	I0924 00:38:46.569726 1874359 logs.go:123] Gathering logs for kindnet [7adace27f5bf6fd0d07f44c3b2d9c4b94d8130080a2626aadc5ab73681d376ef] ...
	I0924 00:38:46.569753 1874359 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 7adace27f5bf6fd0d07f44c3b2d9c4b94d8130080a2626aadc5ab73681d376ef"
	I0924 00:38:46.611343 1874359 logs.go:123] Gathering logs for CRI-O ...
	I0924 00:38:46.611376 1874359 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u crio -n 400"
	I0924 00:38:46.706100 1874359 logs.go:123] Gathering logs for dmesg ...
	I0924 00:38:46.706137 1874359 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
	I0924 00:38:46.722442 1874359 logs.go:123] Gathering logs for kube-apiserver [749045c42da2d61080a3969428ab514fa4047e831ebb9439b8511e518e9b1c04] ...
	I0924 00:38:46.722467 1874359 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 749045c42da2d61080a3969428ab514fa4047e831ebb9439b8511e518e9b1c04"
	I0924 00:38:46.793783 1874359 out.go:358] Setting ErrFile to fd 2...
	I0924 00:38:46.793901 1874359 out.go:392] TERM=,COLORTERM=, which probably does not support color
	W0924 00:38:46.793963 1874359 out.go:270] X Problems detected in kubelet:
	W0924 00:38:46.793979 1874359 out.go:270]   Sep 24 00:37:05 addons-371349 kubelet[1485]: E0924 00:37:05.058554    1485 reflector.go:158] "Unhandled Error" err="object-\"yakd-dashboard\"/\"kube-root-ca.crt\": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps \"kube-root-ca.crt\" is forbidden: User \"system:node:addons-371349\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"yakd-dashboard\": no relationship found between node 'addons-371349' and this object" logger="UnhandledError"
	W0924 00:38:46.793987 1874359 out.go:270]   Sep 24 00:37:05 addons-371349 kubelet[1485]: W0924 00:37:05.100500    1485 reflector.go:561] object-"default"/"kube-root-ca.crt": failed to list *v1.ConfigMap: configmaps "kube-root-ca.crt" is forbidden: User "system:node:addons-371349" cannot list resource "configmaps" in API group "" in the namespace "default": no relationship found between node 'addons-371349' and this object
	W0924 00:38:46.793999 1874359 out.go:270]   Sep 24 00:37:05 addons-371349 kubelet[1485]: E0924 00:37:05.100553    1485 reflector.go:158] "Unhandled Error" err="object-\"default\"/\"kube-root-ca.crt\": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps \"kube-root-ca.crt\" is forbidden: User \"system:node:addons-371349\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"default\": no relationship found between node 'addons-371349' and this object" logger="UnhandledError"
	W0924 00:38:46.794010 1874359 out.go:270]   Sep 24 00:37:05 addons-371349 kubelet[1485]: W0924 00:37:05.100721    1485 reflector.go:561] object-"default"/"gcp-auth": failed to list *v1.Secret: secrets "gcp-auth" is forbidden: User "system:node:addons-371349" cannot list resource "secrets" in API group "" in the namespace "default": no relationship found between node 'addons-371349' and this object
	W0924 00:38:46.794017 1874359 out.go:270]   Sep 24 00:37:05 addons-371349 kubelet[1485]: E0924 00:37:05.100750    1485 reflector.go:158] "Unhandled Error" err="object-\"default\"/\"gcp-auth\": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets \"gcp-auth\" is forbidden: User \"system:node:addons-371349\" cannot list resource \"secrets\" in API group \"\" in the namespace \"default\": no relationship found between node 'addons-371349' and this object" logger="UnhandledError"
	I0924 00:38:46.794029 1874359 out.go:358] Setting ErrFile to fd 2...
	I0924 00:38:46.794035 1874359 out.go:392] TERM=,COLORTERM=, which probably does not support color
	I0924 00:38:56.795250 1874359 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0924 00:38:56.809250 1874359 api_server.go:72] duration metric: took 2m36.8963927s to wait for apiserver process to appear ...
	I0924 00:38:56.809275 1874359 api_server.go:88] waiting for apiserver healthz status ...
	I0924 00:38:56.809311 1874359 cri.go:54] listing CRI containers in root : {State:all Name:kube-apiserver Namespaces:[]}
	I0924 00:38:56.809373 1874359 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
	I0924 00:38:56.849168 1874359 cri.go:89] found id: "749045c42da2d61080a3969428ab514fa4047e831ebb9439b8511e518e9b1c04"
	I0924 00:38:56.849197 1874359 cri.go:89] found id: ""
	I0924 00:38:56.849206 1874359 logs.go:276] 1 containers: [749045c42da2d61080a3969428ab514fa4047e831ebb9439b8511e518e9b1c04]
	I0924 00:38:56.849261 1874359 ssh_runner.go:195] Run: which crictl
	I0924 00:38:56.852661 1874359 cri.go:54] listing CRI containers in root : {State:all Name:etcd Namespaces:[]}
	I0924 00:38:56.852739 1874359 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
	I0924 00:38:56.895086 1874359 cri.go:89] found id: "40d8a21a9712f40f598893c1aba5670ff43d964a7b5d9463400bf4a64836edb2"
	I0924 00:38:56.895108 1874359 cri.go:89] found id: ""
	I0924 00:38:56.895115 1874359 logs.go:276] 1 containers: [40d8a21a9712f40f598893c1aba5670ff43d964a7b5d9463400bf4a64836edb2]
	I0924 00:38:56.895169 1874359 ssh_runner.go:195] Run: which crictl
	I0924 00:38:56.898822 1874359 cri.go:54] listing CRI containers in root : {State:all Name:coredns Namespaces:[]}
	I0924 00:38:56.898895 1874359 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
	I0924 00:38:56.940638 1874359 cri.go:89] found id: "07152f00c7b5566d20be0e478631432f898e24fefada16283e2ca7028b046c61"
	I0924 00:38:56.940659 1874359 cri.go:89] found id: ""
	I0924 00:38:56.940667 1874359 logs.go:276] 1 containers: [07152f00c7b5566d20be0e478631432f898e24fefada16283e2ca7028b046c61]
	I0924 00:38:56.940720 1874359 ssh_runner.go:195] Run: which crictl
	I0924 00:38:56.944215 1874359 cri.go:54] listing CRI containers in root : {State:all Name:kube-scheduler Namespaces:[]}
	I0924 00:38:56.944370 1874359 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
	I0924 00:38:56.988209 1874359 cri.go:89] found id: "278db6b1284e1f1d66e55b827b5a4b51ea66ac4b399cfb13b724520fb0071730"
	I0924 00:38:56.988232 1874359 cri.go:89] found id: ""
	I0924 00:38:56.988241 1874359 logs.go:276] 1 containers: [278db6b1284e1f1d66e55b827b5a4b51ea66ac4b399cfb13b724520fb0071730]
	I0924 00:38:56.988295 1874359 ssh_runner.go:195] Run: which crictl
	I0924 00:38:56.991784 1874359 cri.go:54] listing CRI containers in root : {State:all Name:kube-proxy Namespaces:[]}
	I0924 00:38:56.991861 1874359 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
	I0924 00:38:57.039062 1874359 cri.go:89] found id: "8f2c47f2d8dc25f068087f5d0e702e1768f8714f22c484f1ebe13e92be684997"
	I0924 00:38:57.039087 1874359 cri.go:89] found id: ""
	I0924 00:38:57.039095 1874359 logs.go:276] 1 containers: [8f2c47f2d8dc25f068087f5d0e702e1768f8714f22c484f1ebe13e92be684997]
	I0924 00:38:57.039153 1874359 ssh_runner.go:195] Run: which crictl
	I0924 00:38:57.042617 1874359 cri.go:54] listing CRI containers in root : {State:all Name:kube-controller-manager Namespaces:[]}
	I0924 00:38:57.042691 1874359 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
	I0924 00:38:57.086283 1874359 cri.go:89] found id: "340d83c4a515af013d7e2f2cb8dd72a56a11c8be46e63481fd282573f250be80"
	I0924 00:38:57.086310 1874359 cri.go:89] found id: ""
	I0924 00:38:57.086319 1874359 logs.go:276] 1 containers: [340d83c4a515af013d7e2f2cb8dd72a56a11c8be46e63481fd282573f250be80]
	I0924 00:38:57.086375 1874359 ssh_runner.go:195] Run: which crictl
	I0924 00:38:57.091139 1874359 cri.go:54] listing CRI containers in root : {State:all Name:kindnet Namespaces:[]}
	I0924 00:38:57.091208 1874359 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet
	I0924 00:38:57.133231 1874359 cri.go:89] found id: "7adace27f5bf6fd0d07f44c3b2d9c4b94d8130080a2626aadc5ab73681d376ef"
	I0924 00:38:57.133301 1874359 cri.go:89] found id: ""
	I0924 00:38:57.133324 1874359 logs.go:276] 1 containers: [7adace27f5bf6fd0d07f44c3b2d9c4b94d8130080a2626aadc5ab73681d376ef]
	I0924 00:38:57.133409 1874359 ssh_runner.go:195] Run: which crictl
	I0924 00:38:57.137358 1874359 logs.go:123] Gathering logs for coredns [07152f00c7b5566d20be0e478631432f898e24fefada16283e2ca7028b046c61] ...
	I0924 00:38:57.137387 1874359 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 07152f00c7b5566d20be0e478631432f898e24fefada16283e2ca7028b046c61"
	I0924 00:38:57.187200 1874359 logs.go:123] Gathering logs for kube-controller-manager [340d83c4a515af013d7e2f2cb8dd72a56a11c8be46e63481fd282573f250be80] ...
	I0924 00:38:57.187234 1874359 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 340d83c4a515af013d7e2f2cb8dd72a56a11c8be46e63481fd282573f250be80"
	I0924 00:38:57.263005 1874359 logs.go:123] Gathering logs for container status ...
	I0924 00:38:57.263144 1874359 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
	I0924 00:38:57.318534 1874359 logs.go:123] Gathering logs for etcd [40d8a21a9712f40f598893c1aba5670ff43d964a7b5d9463400bf4a64836edb2] ...
	I0924 00:38:57.318564 1874359 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 40d8a21a9712f40f598893c1aba5670ff43d964a7b5d9463400bf4a64836edb2"
	I0924 00:38:57.371144 1874359 logs.go:123] Gathering logs for dmesg ...
	I0924 00:38:57.371179 1874359 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
	I0924 00:38:57.388648 1874359 logs.go:123] Gathering logs for describe nodes ...
	I0924 00:38:57.388675 1874359 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.31.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
	I0924 00:38:57.530037 1874359 logs.go:123] Gathering logs for kube-apiserver [749045c42da2d61080a3969428ab514fa4047e831ebb9439b8511e518e9b1c04] ...
	I0924 00:38:57.530067 1874359 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 749045c42da2d61080a3969428ab514fa4047e831ebb9439b8511e518e9b1c04"
	I0924 00:38:57.604473 1874359 logs.go:123] Gathering logs for kube-scheduler [278db6b1284e1f1d66e55b827b5a4b51ea66ac4b399cfb13b724520fb0071730] ...
	I0924 00:38:57.604506 1874359 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 278db6b1284e1f1d66e55b827b5a4b51ea66ac4b399cfb13b724520fb0071730"
	I0924 00:38:57.657911 1874359 logs.go:123] Gathering logs for kube-proxy [8f2c47f2d8dc25f068087f5d0e702e1768f8714f22c484f1ebe13e92be684997] ...
	I0924 00:38:57.657944 1874359 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 8f2c47f2d8dc25f068087f5d0e702e1768f8714f22c484f1ebe13e92be684997"
	I0924 00:38:57.696154 1874359 logs.go:123] Gathering logs for kindnet [7adace27f5bf6fd0d07f44c3b2d9c4b94d8130080a2626aadc5ab73681d376ef] ...
	I0924 00:38:57.696187 1874359 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 7adace27f5bf6fd0d07f44c3b2d9c4b94d8130080a2626aadc5ab73681d376ef"
	I0924 00:38:57.740436 1874359 logs.go:123] Gathering logs for CRI-O ...
	I0924 00:38:57.740465 1874359 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u crio -n 400"
	I0924 00:38:57.839529 1874359 logs.go:123] Gathering logs for kubelet ...
	I0924 00:38:57.839566 1874359 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
	W0924 00:38:57.877455 1874359 logs.go:138] Found kubelet problem: Sep 24 00:37:05 addons-371349 kubelet[1485]: W0924 00:37:05.058504    1485 reflector.go:561] object-"yakd-dashboard"/"kube-root-ca.crt": failed to list *v1.ConfigMap: configmaps "kube-root-ca.crt" is forbidden: User "system:node:addons-371349" cannot list resource "configmaps" in API group "" in the namespace "yakd-dashboard": no relationship found between node 'addons-371349' and this object
	W0924 00:38:57.877724 1874359 logs.go:138] Found kubelet problem: Sep 24 00:37:05 addons-371349 kubelet[1485]: E0924 00:37:05.058554    1485 reflector.go:158] "Unhandled Error" err="object-\"yakd-dashboard\"/\"kube-root-ca.crt\": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps \"kube-root-ca.crt\" is forbidden: User \"system:node:addons-371349\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"yakd-dashboard\": no relationship found between node 'addons-371349' and this object" logger="UnhandledError"
	W0924 00:38:57.877937 1874359 logs.go:138] Found kubelet problem: Sep 24 00:37:05 addons-371349 kubelet[1485]: W0924 00:37:05.100500    1485 reflector.go:561] object-"default"/"kube-root-ca.crt": failed to list *v1.ConfigMap: configmaps "kube-root-ca.crt" is forbidden: User "system:node:addons-371349" cannot list resource "configmaps" in API group "" in the namespace "default": no relationship found between node 'addons-371349' and this object
	W0924 00:38:57.878161 1874359 logs.go:138] Found kubelet problem: Sep 24 00:37:05 addons-371349 kubelet[1485]: E0924 00:37:05.100553    1485 reflector.go:158] "Unhandled Error" err="object-\"default\"/\"kube-root-ca.crt\": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps \"kube-root-ca.crt\" is forbidden: User \"system:node:addons-371349\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"default\": no relationship found between node 'addons-371349' and this object" logger="UnhandledError"
	W0924 00:38:57.878327 1874359 logs.go:138] Found kubelet problem: Sep 24 00:37:05 addons-371349 kubelet[1485]: W0924 00:37:05.100721    1485 reflector.go:561] object-"default"/"gcp-auth": failed to list *v1.Secret: secrets "gcp-auth" is forbidden: User "system:node:addons-371349" cannot list resource "secrets" in API group "" in the namespace "default": no relationship found between node 'addons-371349' and this object
	W0924 00:38:57.878533 1874359 logs.go:138] Found kubelet problem: Sep 24 00:37:05 addons-371349 kubelet[1485]: E0924 00:37:05.100750    1485 reflector.go:158] "Unhandled Error" err="object-\"default\"/\"gcp-auth\": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets \"gcp-auth\" is forbidden: User \"system:node:addons-371349\" cannot list resource \"secrets\" in API group \"\" in the namespace \"default\": no relationship found between node 'addons-371349' and this object" logger="UnhandledError"
	I0924 00:38:57.928653 1874359 out.go:358] Setting ErrFile to fd 2...
	I0924 00:38:57.928681 1874359 out.go:392] TERM=,COLORTERM=, which probably does not support color
	W0924 00:38:57.928737 1874359 out.go:270] X Problems detected in kubelet:
	W0924 00:38:57.928749 1874359 out.go:270]   Sep 24 00:37:05 addons-371349 kubelet[1485]: E0924 00:37:05.058554    1485 reflector.go:158] "Unhandled Error" err="object-\"yakd-dashboard\"/\"kube-root-ca.crt\": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps \"kube-root-ca.crt\" is forbidden: User \"system:node:addons-371349\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"yakd-dashboard\": no relationship found between node 'addons-371349' and this object" logger="UnhandledError"
	W0924 00:38:57.928756 1874359 out.go:270]   Sep 24 00:37:05 addons-371349 kubelet[1485]: W0924 00:37:05.100500    1485 reflector.go:561] object-"default"/"kube-root-ca.crt": failed to list *v1.ConfigMap: configmaps "kube-root-ca.crt" is forbidden: User "system:node:addons-371349" cannot list resource "configmaps" in API group "" in the namespace "default": no relationship found between node 'addons-371349' and this object
	W0924 00:38:57.928771 1874359 out.go:270]   Sep 24 00:37:05 addons-371349 kubelet[1485]: E0924 00:37:05.100553    1485 reflector.go:158] "Unhandled Error" err="object-\"default\"/\"kube-root-ca.crt\": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps \"kube-root-ca.crt\" is forbidden: User \"system:node:addons-371349\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"default\": no relationship found between node 'addons-371349' and this object" logger="UnhandledError"
	W0924 00:38:57.928781 1874359 out.go:270]   Sep 24 00:37:05 addons-371349 kubelet[1485]: W0924 00:37:05.100721    1485 reflector.go:561] object-"default"/"gcp-auth": failed to list *v1.Secret: secrets "gcp-auth" is forbidden: User "system:node:addons-371349" cannot list resource "secrets" in API group "" in the namespace "default": no relationship found between node 'addons-371349' and this object
	W0924 00:38:57.928786 1874359 out.go:270]   Sep 24 00:37:05 addons-371349 kubelet[1485]: E0924 00:37:05.100750    1485 reflector.go:158] "Unhandled Error" err="object-\"default\"/\"gcp-auth\": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets \"gcp-auth\" is forbidden: User \"system:node:addons-371349\" cannot list resource \"secrets\" in API group \"\" in the namespace \"default\": no relationship found between node 'addons-371349' and this object" logger="UnhandledError"
	I0924 00:38:57.928792 1874359 out.go:358] Setting ErrFile to fd 2...
	I0924 00:38:57.928797 1874359 out.go:392] TERM=,COLORTERM=, which probably does not support color
	I0924 00:39:07.930415 1874359 api_server.go:253] Checking apiserver healthz at https://192.168.49.2:8443/healthz ...
	I0924 00:39:07.937955 1874359 api_server.go:279] https://192.168.49.2:8443/healthz returned 200:
	ok
	I0924 00:39:07.938936 1874359 api_server.go:141] control plane version: v1.31.1
	I0924 00:39:07.938963 1874359 api_server.go:131] duration metric: took 11.129680462s to wait for apiserver health ...
	I0924 00:39:07.939008 1874359 system_pods.go:43] waiting for kube-system pods to appear ...
	I0924 00:39:07.939036 1874359 cri.go:54] listing CRI containers in root : {State:all Name:kube-apiserver Namespaces:[]}
	I0924 00:39:07.939099 1874359 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
	I0924 00:39:07.980230 1874359 cri.go:89] found id: "749045c42da2d61080a3969428ab514fa4047e831ebb9439b8511e518e9b1c04"
	I0924 00:39:07.980253 1874359 cri.go:89] found id: ""
	I0924 00:39:07.980261 1874359 logs.go:276] 1 containers: [749045c42da2d61080a3969428ab514fa4047e831ebb9439b8511e518e9b1c04]
	I0924 00:39:07.980315 1874359 ssh_runner.go:195] Run: which crictl
	I0924 00:39:07.983665 1874359 cri.go:54] listing CRI containers in root : {State:all Name:etcd Namespaces:[]}
	I0924 00:39:07.983734 1874359 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
	I0924 00:39:08.026928 1874359 cri.go:89] found id: "40d8a21a9712f40f598893c1aba5670ff43d964a7b5d9463400bf4a64836edb2"
	I0924 00:39:08.026955 1874359 cri.go:89] found id: ""
	I0924 00:39:08.026963 1874359 logs.go:276] 1 containers: [40d8a21a9712f40f598893c1aba5670ff43d964a7b5d9463400bf4a64836edb2]
	I0924 00:39:08.027024 1874359 ssh_runner.go:195] Run: which crictl
	I0924 00:39:08.030930 1874359 cri.go:54] listing CRI containers in root : {State:all Name:coredns Namespaces:[]}
	I0924 00:39:08.031008 1874359 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
	I0924 00:39:08.080344 1874359 cri.go:89] found id: "07152f00c7b5566d20be0e478631432f898e24fefada16283e2ca7028b046c61"
	I0924 00:39:08.080368 1874359 cri.go:89] found id: ""
	I0924 00:39:08.080377 1874359 logs.go:276] 1 containers: [07152f00c7b5566d20be0e478631432f898e24fefada16283e2ca7028b046c61]
	I0924 00:39:08.080439 1874359 ssh_runner.go:195] Run: which crictl
	I0924 00:39:08.087899 1874359 cri.go:54] listing CRI containers in root : {State:all Name:kube-scheduler Namespaces:[]}
	I0924 00:39:08.087974 1874359 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
	I0924 00:39:08.129013 1874359 cri.go:89] found id: "278db6b1284e1f1d66e55b827b5a4b51ea66ac4b399cfb13b724520fb0071730"
	I0924 00:39:08.129035 1874359 cri.go:89] found id: ""
	I0924 00:39:08.129042 1874359 logs.go:276] 1 containers: [278db6b1284e1f1d66e55b827b5a4b51ea66ac4b399cfb13b724520fb0071730]
	I0924 00:39:08.129098 1874359 ssh_runner.go:195] Run: which crictl
	I0924 00:39:08.133170 1874359 cri.go:54] listing CRI containers in root : {State:all Name:kube-proxy Namespaces:[]}
	I0924 00:39:08.133245 1874359 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
	I0924 00:39:08.170625 1874359 cri.go:89] found id: "8f2c47f2d8dc25f068087f5d0e702e1768f8714f22c484f1ebe13e92be684997"
	I0924 00:39:08.170647 1874359 cri.go:89] found id: ""
	I0924 00:39:08.170655 1874359 logs.go:276] 1 containers: [8f2c47f2d8dc25f068087f5d0e702e1768f8714f22c484f1ebe13e92be684997]
	I0924 00:39:08.170709 1874359 ssh_runner.go:195] Run: which crictl
	I0924 00:39:08.174051 1874359 cri.go:54] listing CRI containers in root : {State:all Name:kube-controller-manager Namespaces:[]}
	I0924 00:39:08.174119 1874359 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
	I0924 00:39:08.211609 1874359 cri.go:89] found id: "340d83c4a515af013d7e2f2cb8dd72a56a11c8be46e63481fd282573f250be80"
	I0924 00:39:08.211634 1874359 cri.go:89] found id: ""
	I0924 00:39:08.211642 1874359 logs.go:276] 1 containers: [340d83c4a515af013d7e2f2cb8dd72a56a11c8be46e63481fd282573f250be80]
	I0924 00:39:08.211717 1874359 ssh_runner.go:195] Run: which crictl
	I0924 00:39:08.215082 1874359 cri.go:54] listing CRI containers in root : {State:all Name:kindnet Namespaces:[]}
	I0924 00:39:08.215154 1874359 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet
	I0924 00:39:08.254829 1874359 cri.go:89] found id: "7adace27f5bf6fd0d07f44c3b2d9c4b94d8130080a2626aadc5ab73681d376ef"
	I0924 00:39:08.254856 1874359 cri.go:89] found id: ""
	I0924 00:39:08.254865 1874359 logs.go:276] 1 containers: [7adace27f5bf6fd0d07f44c3b2d9c4b94d8130080a2626aadc5ab73681d376ef]
	I0924 00:39:08.254943 1874359 ssh_runner.go:195] Run: which crictl
	I0924 00:39:08.258637 1874359 logs.go:123] Gathering logs for dmesg ...
	I0924 00:39:08.258663 1874359 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
	I0924 00:39:08.275195 1874359 logs.go:123] Gathering logs for describe nodes ...
	I0924 00:39:08.275221 1874359 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.31.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
	I0924 00:39:08.415558 1874359 logs.go:123] Gathering logs for kube-apiserver [749045c42da2d61080a3969428ab514fa4047e831ebb9439b8511e518e9b1c04] ...
	I0924 00:39:08.415587 1874359 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 749045c42da2d61080a3969428ab514fa4047e831ebb9439b8511e518e9b1c04"
	I0924 00:39:08.489572 1874359 logs.go:123] Gathering logs for kube-controller-manager [340d83c4a515af013d7e2f2cb8dd72a56a11c8be46e63481fd282573f250be80] ...
	I0924 00:39:08.489606 1874359 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 340d83c4a515af013d7e2f2cb8dd72a56a11c8be46e63481fd282573f250be80"
	I0924 00:39:08.578827 1874359 logs.go:123] Gathering logs for kindnet [7adace27f5bf6fd0d07f44c3b2d9c4b94d8130080a2626aadc5ab73681d376ef] ...
	I0924 00:39:08.578861 1874359 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 7adace27f5bf6fd0d07f44c3b2d9c4b94d8130080a2626aadc5ab73681d376ef"
	I0924 00:39:08.617163 1874359 logs.go:123] Gathering logs for CRI-O ...
	I0924 00:39:08.617194 1874359 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u crio -n 400"
	I0924 00:39:08.713202 1874359 logs.go:123] Gathering logs for kubelet ...
	I0924 00:39:08.713240 1874359 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
	W0924 00:39:08.755826 1874359 logs.go:138] Found kubelet problem: Sep 24 00:37:05 addons-371349 kubelet[1485]: W0924 00:37:05.058504    1485 reflector.go:561] object-"yakd-dashboard"/"kube-root-ca.crt": failed to list *v1.ConfigMap: configmaps "kube-root-ca.crt" is forbidden: User "system:node:addons-371349" cannot list resource "configmaps" in API group "" in the namespace "yakd-dashboard": no relationship found between node 'addons-371349' and this object
	W0924 00:39:08.756100 1874359 logs.go:138] Found kubelet problem: Sep 24 00:37:05 addons-371349 kubelet[1485]: E0924 00:37:05.058554    1485 reflector.go:158] "Unhandled Error" err="object-\"yakd-dashboard\"/\"kube-root-ca.crt\": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps \"kube-root-ca.crt\" is forbidden: User \"system:node:addons-371349\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"yakd-dashboard\": no relationship found between node 'addons-371349' and this object" logger="UnhandledError"
	W0924 00:39:08.756284 1874359 logs.go:138] Found kubelet problem: Sep 24 00:37:05 addons-371349 kubelet[1485]: W0924 00:37:05.100500    1485 reflector.go:561] object-"default"/"kube-root-ca.crt": failed to list *v1.ConfigMap: configmaps "kube-root-ca.crt" is forbidden: User "system:node:addons-371349" cannot list resource "configmaps" in API group "" in the namespace "default": no relationship found between node 'addons-371349' and this object
	W0924 00:39:08.756508 1874359 logs.go:138] Found kubelet problem: Sep 24 00:37:05 addons-371349 kubelet[1485]: E0924 00:37:05.100553    1485 reflector.go:158] "Unhandled Error" err="object-\"default\"/\"kube-root-ca.crt\": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps \"kube-root-ca.crt\" is forbidden: User \"system:node:addons-371349\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"default\": no relationship found between node 'addons-371349' and this object" logger="UnhandledError"
	W0924 00:39:08.756709 1874359 logs.go:138] Found kubelet problem: Sep 24 00:37:05 addons-371349 kubelet[1485]: W0924 00:37:05.100721    1485 reflector.go:561] object-"default"/"gcp-auth": failed to list *v1.Secret: secrets "gcp-auth" is forbidden: User "system:node:addons-371349" cannot list resource "secrets" in API group "" in the namespace "default": no relationship found between node 'addons-371349' and this object
	W0924 00:39:08.756918 1874359 logs.go:138] Found kubelet problem: Sep 24 00:37:05 addons-371349 kubelet[1485]: E0924 00:37:05.100750    1485 reflector.go:158] "Unhandled Error" err="object-\"default\"/\"gcp-auth\": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets \"gcp-auth\" is forbidden: User \"system:node:addons-371349\" cannot list resource \"secrets\" in API group \"\" in the namespace \"default\": no relationship found between node 'addons-371349' and this object" logger="UnhandledError"
	I0924 00:39:08.808148 1874359 logs.go:123] Gathering logs for etcd [40d8a21a9712f40f598893c1aba5670ff43d964a7b5d9463400bf4a64836edb2] ...
	I0924 00:39:08.808187 1874359 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 40d8a21a9712f40f598893c1aba5670ff43d964a7b5d9463400bf4a64836edb2"
	I0924 00:39:08.862714 1874359 logs.go:123] Gathering logs for coredns [07152f00c7b5566d20be0e478631432f898e24fefada16283e2ca7028b046c61] ...
	I0924 00:39:08.862758 1874359 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 07152f00c7b5566d20be0e478631432f898e24fefada16283e2ca7028b046c61"
	I0924 00:39:08.909116 1874359 logs.go:123] Gathering logs for kube-scheduler [278db6b1284e1f1d66e55b827b5a4b51ea66ac4b399cfb13b724520fb0071730] ...
	I0924 00:39:08.909154 1874359 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 278db6b1284e1f1d66e55b827b5a4b51ea66ac4b399cfb13b724520fb0071730"
	I0924 00:39:08.956136 1874359 logs.go:123] Gathering logs for kube-proxy [8f2c47f2d8dc25f068087f5d0e702e1768f8714f22c484f1ebe13e92be684997] ...
	I0924 00:39:08.956168 1874359 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 8f2c47f2d8dc25f068087f5d0e702e1768f8714f22c484f1ebe13e92be684997"
	I0924 00:39:08.992426 1874359 logs.go:123] Gathering logs for container status ...
	I0924 00:39:08.992455 1874359 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
	I0924 00:39:09.049468 1874359 out.go:358] Setting ErrFile to fd 2...
	I0924 00:39:09.049502 1874359 out.go:392] TERM=,COLORTERM=, which probably does not support color
	W0924 00:39:09.049568 1874359 out.go:270] X Problems detected in kubelet:
	W0924 00:39:09.049591 1874359 out.go:270]   Sep 24 00:37:05 addons-371349 kubelet[1485]: E0924 00:37:05.058554    1485 reflector.go:158] "Unhandled Error" err="object-\"yakd-dashboard\"/\"kube-root-ca.crt\": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps \"kube-root-ca.crt\" is forbidden: User \"system:node:addons-371349\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"yakd-dashboard\": no relationship found between node 'addons-371349' and this object" logger="UnhandledError"
	W0924 00:39:09.049606 1874359 out.go:270]   Sep 24 00:37:05 addons-371349 kubelet[1485]: W0924 00:37:05.100500    1485 reflector.go:561] object-"default"/"kube-root-ca.crt": failed to list *v1.ConfigMap: configmaps "kube-root-ca.crt" is forbidden: User "system:node:addons-371349" cannot list resource "configmaps" in API group "" in the namespace "default": no relationship found between node 'addons-371349' and this object
	W0924 00:39:09.049625 1874359 out.go:270]   Sep 24 00:37:05 addons-371349 kubelet[1485]: E0924 00:37:05.100553    1485 reflector.go:158] "Unhandled Error" err="object-\"default\"/\"kube-root-ca.crt\": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps \"kube-root-ca.crt\" is forbidden: User \"system:node:addons-371349\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"default\": no relationship found between node 'addons-371349' and this object" logger="UnhandledError"
	W0924 00:39:09.049633 1874359 out.go:270]   Sep 24 00:37:05 addons-371349 kubelet[1485]: W0924 00:37:05.100721    1485 reflector.go:561] object-"default"/"gcp-auth": failed to list *v1.Secret: secrets "gcp-auth" is forbidden: User "system:node:addons-371349" cannot list resource "secrets" in API group "" in the namespace "default": no relationship found between node 'addons-371349' and this object
	W0924 00:39:09.049643 1874359 out.go:270]   Sep 24 00:37:05 addons-371349 kubelet[1485]: E0924 00:37:05.100750    1485 reflector.go:158] "Unhandled Error" err="object-\"default\"/\"gcp-auth\": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets \"gcp-auth\" is forbidden: User \"system:node:addons-371349\" cannot list resource \"secrets\" in API group \"\" in the namespace \"default\": no relationship found between node 'addons-371349' and this object" logger="UnhandledError"
	I0924 00:39:09.049650 1874359 out.go:358] Setting ErrFile to fd 2...
	I0924 00:39:09.049661 1874359 out.go:392] TERM=,COLORTERM=, which probably does not support color
	I0924 00:39:19.063102 1874359 system_pods.go:59] 18 kube-system pods found
	I0924 00:39:19.063145 1874359 system_pods.go:61] "coredns-7c65d6cfc9-bsbwf" [a2c84f3b-bbc2-4ab5-85a2-5ff72508507b] Running
	I0924 00:39:19.063153 1874359 system_pods.go:61] "csi-hostpath-attacher-0" [c760f7fc-01e4-476e-8f71-c2907c20ea88] Running
	I0924 00:39:19.063157 1874359 system_pods.go:61] "csi-hostpath-resizer-0" [b318fac7-c7d5-418f-9f16-8e4991ea9f29] Running
	I0924 00:39:19.063163 1874359 system_pods.go:61] "csi-hostpathplugin-rg84v" [99420363-d35f-4aef-8752-cd70a8687aca] Running
	I0924 00:39:19.063168 1874359 system_pods.go:61] "etcd-addons-371349" [0db6f1c9-6b22-4e0f-bd38-64d6f64a5f2b] Running
	I0924 00:39:19.063173 1874359 system_pods.go:61] "kindnet-c2v8q" [d7d499b8-6318-4999-8666-172b227c9eb9] Running
	I0924 00:39:19.063178 1874359 system_pods.go:61] "kube-apiserver-addons-371349" [57643502-89d7-4cb0-9a99-b11046416306] Running
	I0924 00:39:19.063183 1874359 system_pods.go:61] "kube-controller-manager-addons-371349" [a223fefc-7277-4cb1-8373-e7751bc87f10] Running
	I0924 00:39:19.063195 1874359 system_pods.go:61] "kube-ingress-dns-minikube" [4c89d0f9-906f-451c-807f-4b809f2d3f54] Running
	I0924 00:39:19.063199 1874359 system_pods.go:61] "kube-proxy-qcb9f" [69abd079-88b6-4b9f-831c-e871d95d4464] Running
	I0924 00:39:19.063204 1874359 system_pods.go:61] "kube-scheduler-addons-371349" [ae310285-de23-4f27-8f12-35713956d260] Running
	I0924 00:39:19.063212 1874359 system_pods.go:61] "metrics-server-84c5f94fbc-wxd2s" [7c5e5bee-e3dc-43a0-a7b2-e1afa3197ce6] Running
	I0924 00:39:19.063216 1874359 system_pods.go:61] "nvidia-device-plugin-daemonset-t52r5" [6ee689eb-216e-49b6-b98b-04c4a8a2a717] Running
	I0924 00:39:19.063223 1874359 system_pods.go:61] "registry-66c9cd494c-vx6hr" [2d03a897-de38-4010-b9d3-7e455400c58d] Running
	I0924 00:39:19.063227 1874359 system_pods.go:61] "registry-proxy-9jrvf" [1cea29a0-a418-43ce-8a72-6439715dfdb4] Running
	I0924 00:39:19.063231 1874359 system_pods.go:61] "snapshot-controller-56fcc65765-trtb4" [71554140-ea26-4c02-8605-9e5a7a72c935] Running
	I0924 00:39:19.063236 1874359 system_pods.go:61] "snapshot-controller-56fcc65765-vprd4" [9bf3685a-c093-4efd-9385-9e2cd6ab2d77] Running
	I0924 00:39:19.063245 1874359 system_pods.go:61] "storage-provisioner" [3f9e83c7-275e-48af-b839-10cd00b637ad] Running
	I0924 00:39:19.063251 1874359 system_pods.go:74] duration metric: took 11.124230598s to wait for pod list to return data ...
	I0924 00:39:19.063263 1874359 default_sa.go:34] waiting for default service account to be created ...
	I0924 00:39:19.066150 1874359 default_sa.go:45] found service account: "default"
	I0924 00:39:19.066183 1874359 default_sa.go:55] duration metric: took 2.913765ms for default service account to be created ...
	I0924 00:39:19.066194 1874359 system_pods.go:116] waiting for k8s-apps to be running ...
	I0924 00:39:19.076136 1874359 system_pods.go:86] 18 kube-system pods found
	I0924 00:39:19.076174 1874359 system_pods.go:89] "coredns-7c65d6cfc9-bsbwf" [a2c84f3b-bbc2-4ab5-85a2-5ff72508507b] Running
	I0924 00:39:19.076182 1874359 system_pods.go:89] "csi-hostpath-attacher-0" [c760f7fc-01e4-476e-8f71-c2907c20ea88] Running
	I0924 00:39:19.076187 1874359 system_pods.go:89] "csi-hostpath-resizer-0" [b318fac7-c7d5-418f-9f16-8e4991ea9f29] Running
	I0924 00:39:19.076191 1874359 system_pods.go:89] "csi-hostpathplugin-rg84v" [99420363-d35f-4aef-8752-cd70a8687aca] Running
	I0924 00:39:19.076196 1874359 system_pods.go:89] "etcd-addons-371349" [0db6f1c9-6b22-4e0f-bd38-64d6f64a5f2b] Running
	I0924 00:39:19.076201 1874359 system_pods.go:89] "kindnet-c2v8q" [d7d499b8-6318-4999-8666-172b227c9eb9] Running
	I0924 00:39:19.076206 1874359 system_pods.go:89] "kube-apiserver-addons-371349" [57643502-89d7-4cb0-9a99-b11046416306] Running
	I0924 00:39:19.076211 1874359 system_pods.go:89] "kube-controller-manager-addons-371349" [a223fefc-7277-4cb1-8373-e7751bc87f10] Running
	I0924 00:39:19.076223 1874359 system_pods.go:89] "kube-ingress-dns-minikube" [4c89d0f9-906f-451c-807f-4b809f2d3f54] Running
	I0924 00:39:19.076227 1874359 system_pods.go:89] "kube-proxy-qcb9f" [69abd079-88b6-4b9f-831c-e871d95d4464] Running
	I0924 00:39:19.076232 1874359 system_pods.go:89] "kube-scheduler-addons-371349" [ae310285-de23-4f27-8f12-35713956d260] Running
	I0924 00:39:19.076241 1874359 system_pods.go:89] "metrics-server-84c5f94fbc-wxd2s" [7c5e5bee-e3dc-43a0-a7b2-e1afa3197ce6] Running
	I0924 00:39:19.076246 1874359 system_pods.go:89] "nvidia-device-plugin-daemonset-t52r5" [6ee689eb-216e-49b6-b98b-04c4a8a2a717] Running
	I0924 00:39:19.076250 1874359 system_pods.go:89] "registry-66c9cd494c-vx6hr" [2d03a897-de38-4010-b9d3-7e455400c58d] Running
	I0924 00:39:19.076254 1874359 system_pods.go:89] "registry-proxy-9jrvf" [1cea29a0-a418-43ce-8a72-6439715dfdb4] Running
	I0924 00:39:19.076259 1874359 system_pods.go:89] "snapshot-controller-56fcc65765-trtb4" [71554140-ea26-4c02-8605-9e5a7a72c935] Running
	I0924 00:39:19.076266 1874359 system_pods.go:89] "snapshot-controller-56fcc65765-vprd4" [9bf3685a-c093-4efd-9385-9e2cd6ab2d77] Running
	I0924 00:39:19.076271 1874359 system_pods.go:89] "storage-provisioner" [3f9e83c7-275e-48af-b839-10cd00b637ad] Running
	I0924 00:39:19.076278 1874359 system_pods.go:126] duration metric: took 10.078477ms to wait for k8s-apps to be running ...
	I0924 00:39:19.076291 1874359 system_svc.go:44] waiting for kubelet service to be running ....
	I0924 00:39:19.076352 1874359 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
	I0924 00:39:19.090090 1874359 system_svc.go:56] duration metric: took 13.789983ms WaitForService to wait for kubelet
	I0924 00:39:19.090120 1874359 kubeadm.go:582] duration metric: took 2m59.177267701s to wait for: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
	I0924 00:39:19.090142 1874359 node_conditions.go:102] verifying NodePressure condition ...
	I0924 00:39:19.093950 1874359 node_conditions.go:122] node storage ephemeral capacity is 203034800Ki
	I0924 00:39:19.093985 1874359 node_conditions.go:123] node cpu capacity is 2
	I0924 00:39:19.093996 1874359 node_conditions.go:105] duration metric: took 3.848216ms to run NodePressure ...
	I0924 00:39:19.094009 1874359 start.go:241] waiting for startup goroutines ...
	I0924 00:39:19.094016 1874359 start.go:246] waiting for cluster config update ...
	I0924 00:39:19.094032 1874359 start.go:255] writing updated cluster config ...
	I0924 00:39:19.094333 1874359 ssh_runner.go:195] Run: rm -f paused
	I0924 00:39:19.431140 1874359 start.go:600] kubectl: 1.31.1, cluster: 1.31.1 (minor skew: 0)
	I0924 00:39:19.432602 1874359 out.go:177] * Done! kubectl is now configured to use "addons-371349" cluster and "default" namespace by default
	
	
	==> CRI-O <==
	Sep 24 00:52:55 addons-371349 crio[964]: time="2024-09-24 00:52:55.141105488Z" level=info msg="Image gcr.io/k8s-minikube/busybox:1.28.4-glibc not found" id=4a73a2ae-af1e-4e5c-b4b0-584e08beaf82 name=/runtime.v1.ImageService/ImageStatus
	Sep 24 00:53:08 addons-371349 crio[964]: time="2024-09-24 00:53:08.140497586Z" level=info msg="Checking image status: gcr.io/k8s-minikube/busybox:1.28.4-glibc" id=381f44c6-349e-4d31-a6fe-2276c2ffeef7 name=/runtime.v1.ImageService/ImageStatus
	Sep 24 00:53:08 addons-371349 crio[964]: time="2024-09-24 00:53:08.140797732Z" level=info msg="Image gcr.io/k8s-minikube/busybox:1.28.4-glibc not found" id=381f44c6-349e-4d31-a6fe-2276c2ffeef7 name=/runtime.v1.ImageService/ImageStatus
	Sep 24 00:53:15 addons-371349 crio[964]: time="2024-09-24 00:53:15.589356266Z" level=info msg="Stopping pod sandbox: 3e49192aad6562db59d01493cdf9bf285fa2ba46866e01111bf18725fcfe1dda" id=2fc6a788-d576-4747-a42c-2abc8f1f31fb name=/runtime.v1.RuntimeService/StopPodSandbox
	Sep 24 00:53:15 addons-371349 crio[964]: time="2024-09-24 00:53:15.589404790Z" level=info msg="Stopped pod sandbox (already stopped): 3e49192aad6562db59d01493cdf9bf285fa2ba46866e01111bf18725fcfe1dda" id=2fc6a788-d576-4747-a42c-2abc8f1f31fb name=/runtime.v1.RuntimeService/StopPodSandbox
	Sep 24 00:53:15 addons-371349 crio[964]: time="2024-09-24 00:53:15.589978693Z" level=info msg="Removing pod sandbox: 3e49192aad6562db59d01493cdf9bf285fa2ba46866e01111bf18725fcfe1dda" id=e9a52763-918a-44cc-a6d1-db7a95e3be56 name=/runtime.v1.RuntimeService/RemovePodSandbox
	Sep 24 00:53:15 addons-371349 crio[964]: time="2024-09-24 00:53:15.599851097Z" level=info msg="Removed pod sandbox: 3e49192aad6562db59d01493cdf9bf285fa2ba46866e01111bf18725fcfe1dda" id=e9a52763-918a-44cc-a6d1-db7a95e3be56 name=/runtime.v1.RuntimeService/RemovePodSandbox
	Sep 24 00:53:15 addons-371349 crio[964]: time="2024-09-24 00:53:15.600402716Z" level=info msg="Stopping pod sandbox: 4c000f65cf36b0ece50b04c15ffa0b4b47829a0cdebaf59e2f76880ffae14246" id=10caffea-ac6b-4ebe-b61a-264646c300e7 name=/runtime.v1.RuntimeService/StopPodSandbox
	Sep 24 00:53:15 addons-371349 crio[964]: time="2024-09-24 00:53:15.600519973Z" level=info msg="Stopped pod sandbox (already stopped): 4c000f65cf36b0ece50b04c15ffa0b4b47829a0cdebaf59e2f76880ffae14246" id=10caffea-ac6b-4ebe-b61a-264646c300e7 name=/runtime.v1.RuntimeService/StopPodSandbox
	Sep 24 00:53:15 addons-371349 crio[964]: time="2024-09-24 00:53:15.600857246Z" level=info msg="Removing pod sandbox: 4c000f65cf36b0ece50b04c15ffa0b4b47829a0cdebaf59e2f76880ffae14246" id=e88590d7-fe46-41f2-8e61-35b53176ef33 name=/runtime.v1.RuntimeService/RemovePodSandbox
	Sep 24 00:53:15 addons-371349 crio[964]: time="2024-09-24 00:53:15.610514122Z" level=info msg="Removed pod sandbox: 4c000f65cf36b0ece50b04c15ffa0b4b47829a0cdebaf59e2f76880ffae14246" id=e88590d7-fe46-41f2-8e61-35b53176ef33 name=/runtime.v1.RuntimeService/RemovePodSandbox
	Sep 24 00:53:22 addons-371349 crio[964]: time="2024-09-24 00:53:22.140488394Z" level=info msg="Checking image status: gcr.io/k8s-minikube/busybox:1.28.4-glibc" id=182e1d07-e982-46fc-ad5b-eb9044ccaf78 name=/runtime.v1.ImageService/ImageStatus
	Sep 24 00:53:22 addons-371349 crio[964]: time="2024-09-24 00:53:22.140731703Z" level=info msg="Image gcr.io/k8s-minikube/busybox:1.28.4-glibc not found" id=182e1d07-e982-46fc-ad5b-eb9044ccaf78 name=/runtime.v1.ImageService/ImageStatus
	Sep 24 00:53:36 addons-371349 crio[964]: time="2024-09-24 00:53:36.140348114Z" level=info msg="Checking image status: gcr.io/k8s-minikube/busybox:1.28.4-glibc" id=547afc76-0722-4451-9106-61c95a72a410 name=/runtime.v1.ImageService/ImageStatus
	Sep 24 00:53:36 addons-371349 crio[964]: time="2024-09-24 00:53:36.140586443Z" level=info msg="Image gcr.io/k8s-minikube/busybox:1.28.4-glibc not found" id=547afc76-0722-4451-9106-61c95a72a410 name=/runtime.v1.ImageService/ImageStatus
	Sep 24 00:53:48 addons-371349 crio[964]: time="2024-09-24 00:53:48.140490442Z" level=info msg="Checking image status: gcr.io/k8s-minikube/busybox:1.28.4-glibc" id=c1fc0c4e-3971-46d1-a08a-755f0a9cb89d name=/runtime.v1.ImageService/ImageStatus
	Sep 24 00:53:48 addons-371349 crio[964]: time="2024-09-24 00:53:48.140737608Z" level=info msg="Image gcr.io/k8s-minikube/busybox:1.28.4-glibc not found" id=c1fc0c4e-3971-46d1-a08a-755f0a9cb89d name=/runtime.v1.ImageService/ImageStatus
	Sep 24 00:54:03 addons-371349 crio[964]: time="2024-09-24 00:54:03.141048647Z" level=info msg="Checking image status: gcr.io/k8s-minikube/busybox:1.28.4-glibc" id=f32ff664-a1aa-4fd5-bffd-a4e3a4d9d9fe name=/runtime.v1.ImageService/ImageStatus
	Sep 24 00:54:03 addons-371349 crio[964]: time="2024-09-24 00:54:03.141294353Z" level=info msg="Image gcr.io/k8s-minikube/busybox:1.28.4-glibc not found" id=f32ff664-a1aa-4fd5-bffd-a4e3a4d9d9fe name=/runtime.v1.ImageService/ImageStatus
	Sep 24 00:54:07 addons-371349 crio[964]: time="2024-09-24 00:54:07.405998621Z" level=info msg="Stopping container: 818b4f0b3744324f877190bb18798952c87007618b9774a41432790a22590c09 (timeout: 30s)" id=8f867665-4851-4bb8-9e72-5f8f3a710bc1 name=/runtime.v1.RuntimeService/StopContainer
	Sep 24 00:54:08 addons-371349 crio[964]: time="2024-09-24 00:54:08.555212714Z" level=info msg="Stopped container 818b4f0b3744324f877190bb18798952c87007618b9774a41432790a22590c09: kube-system/metrics-server-84c5f94fbc-wxd2s/metrics-server" id=8f867665-4851-4bb8-9e72-5f8f3a710bc1 name=/runtime.v1.RuntimeService/StopContainer
	Sep 24 00:54:08 addons-371349 crio[964]: time="2024-09-24 00:54:08.556117318Z" level=info msg="Stopping pod sandbox: d88787db1414c4625e743fb059d57f6709a6d007e4e3066cf4cc563782b5d21b" id=b4a933f0-bb0f-44ba-888e-4e422f49fc50 name=/runtime.v1.RuntimeService/StopPodSandbox
	Sep 24 00:54:08 addons-371349 crio[964]: time="2024-09-24 00:54:08.556352381Z" level=info msg="Got pod network &{Name:metrics-server-84c5f94fbc-wxd2s Namespace:kube-system ID:d88787db1414c4625e743fb059d57f6709a6d007e4e3066cf4cc563782b5d21b UID:7c5e5bee-e3dc-43a0-a7b2-e1afa3197ce6 NetNS:/var/run/netns/bef3c3ce-c182-4f75-8e05-3631d15d655c Networks:[{Name:kindnet Ifname:eth0}] RuntimeConfig:map[kindnet:{IP: MAC: PortMappings:[] Bandwidth:<nil> IpRanges:[]}] Aliases:map[]}"
	Sep 24 00:54:08 addons-371349 crio[964]: time="2024-09-24 00:54:08.556494565Z" level=info msg="Deleting pod kube-system_metrics-server-84c5f94fbc-wxd2s from CNI network \"kindnet\" (type=ptp)"
	Sep 24 00:54:08 addons-371349 crio[964]: time="2024-09-24 00:54:08.604141778Z" level=info msg="Stopped pod sandbox: d88787db1414c4625e743fb059d57f6709a6d007e4e3066cf4cc563782b5d21b" id=b4a933f0-bb0f-44ba-888e-4e422f49fc50 name=/runtime.v1.RuntimeService/StopPodSandbox
	
	
	==> container status <==
	CONTAINER           IMAGE                                                                                                          CREATED             STATE               NAME                      ATTEMPT             POD ID              POD
	e8c49b533dcd4       docker.io/kicbase/echo-server@sha256:127ac38a2bb9537b7f252addff209ea6801edcac8a92c8b1104dacd66a583ed6          2 minutes ago       Running             hello-world-app           0                   9be0d5bc67fd5       hello-world-app-55bf9c44b4-jd6dh
	146f7add64605       docker.io/library/nginx@sha256:19db381c08a95b2040d5637a65c7a59af6c2f21444b0c8730505280a0255fb53                5 minutes ago       Running             nginx                     0                   e66e2cb3f3976       nginx
	e149e451e3126       gcr.io/k8s-minikube/gcp-auth-webhook@sha256:a40e1a121ee367d1712ac3a54ec9c38c405a65dde923c98e5fa6368fa82c4b69   16 minutes ago      Running             gcp-auth                  0                   c4f48f413c25f       gcp-auth-89d5ffd79-d948l
	07152f00c7b55       2f6c962e7b8311337352d9fdea917da2184d9919f4da7695bc2a6517cf392fe4                                               17 minutes ago      Running             coredns                   0                   3ba7cebb00be1       coredns-7c65d6cfc9-bsbwf
	f1f18e06d2168       ba04bb24b95753201135cbc420b233c1b0b9fa2e1fd21d28319c348c33fbcde6                                               17 minutes ago      Running             storage-provisioner       0                   c3ea98ab822e0       storage-provisioner
	8f2c47f2d8dc2       24a140c548c075e487e45d0ee73b1aa89f8bfb40c08a57e05975559728822b1d                                               17 minutes ago      Running             kube-proxy                0                   2489a6eed4e31       kube-proxy-qcb9f
	7adace27f5bf6       6a23fa8fd2b78ab58e42ba273808edc936a9c53d8ac4a919f6337be094843a51                                               17 minutes ago      Running             kindnet-cni               0                   2495b8a3a9496       kindnet-c2v8q
	749045c42da2d       d3f53a98c0a9d9163c4848bcf34b2d2f5e1e3691b79f3d1dd6d0206809e02853                                               17 minutes ago      Running             kube-apiserver            0                   6cdf84a4b6fee       kube-apiserver-addons-371349
	278db6b1284e1       7f8aa378bb47dffcf430f3a601abe39137e88aee0238e23ed8530fdd18dab82d                                               17 minutes ago      Running             kube-scheduler            0                   b82c8f825daff       kube-scheduler-addons-371349
	40d8a21a9712f       27e3830e1402783674d8b594038967deea9d51f0d91b34c93c8f39d2f68af7da                                               17 minutes ago      Running             etcd                      0                   d6149f16a9e9c       etcd-addons-371349
	340d83c4a515a       279f381cb37365bbbcd133c9531fba9c2beb0f38dbbe6ddfcd0b1b1643d3450e                                               17 minutes ago      Running             kube-controller-manager   0                   aad17fb9b4c3f       kube-controller-manager-addons-371349
	
	
	==> coredns [07152f00c7b5566d20be0e478631432f898e24fefada16283e2ca7028b046c61] <==
	[INFO] 10.244.0.11:48609 - 27216 "A IN registry.kube-system.svc.cluster.local.cluster.local. udp 70 false 512" NXDOMAIN qr,aa,rd 163 0.000038178s
	[INFO] 10.244.0.11:38318 - 42285 "AAAA IN registry.kube-system.svc.cluster.local.us-east-2.compute.internal. udp 83 false 512" NXDOMAIN qr,rd,ra 83 0.00156723s
	[INFO] 10.244.0.11:38318 - 14127 "A IN registry.kube-system.svc.cluster.local.us-east-2.compute.internal. udp 83 false 512" NXDOMAIN qr,rd,ra 83 0.001620136s
	[INFO] 10.244.0.11:44250 - 19435 "AAAA IN registry.kube-system.svc.cluster.local. udp 56 false 512" NOERROR qr,aa,rd 149 0.000072589s
	[INFO] 10.244.0.11:44250 - 37865 "A IN registry.kube-system.svc.cluster.local. udp 56 false 512" NOERROR qr,aa,rd 110 0.000080277s
	[INFO] 10.244.0.11:44447 - 10882 "AAAA IN registry.kube-system.svc.cluster.local.kube-system.svc.cluster.local. udp 86 false 512" NXDOMAIN qr,aa,rd 179 0.000091764s
	[INFO] 10.244.0.11:44447 - 64414 "A IN registry.kube-system.svc.cluster.local.kube-system.svc.cluster.local. udp 86 false 512" NXDOMAIN qr,aa,rd 179 0.0000421s
	[INFO] 10.244.0.11:56763 - 16602 "A IN registry.kube-system.svc.cluster.local.svc.cluster.local. udp 74 false 512" NXDOMAIN qr,aa,rd 167 0.000073598s
	[INFO] 10.244.0.11:56763 - 7384 "AAAA IN registry.kube-system.svc.cluster.local.svc.cluster.local. udp 74 false 512" NXDOMAIN qr,aa,rd 167 0.00005828s
	[INFO] 10.244.0.11:57197 - 45264 "A IN registry.kube-system.svc.cluster.local.cluster.local. udp 70 false 512" NXDOMAIN qr,aa,rd 163 0.000080121s
	[INFO] 10.244.0.11:57197 - 13267 "AAAA IN registry.kube-system.svc.cluster.local.cluster.local. udp 70 false 512" NXDOMAIN qr,aa,rd 163 0.000119915s
	[INFO] 10.244.0.11:39794 - 42327 "A IN registry.kube-system.svc.cluster.local.us-east-2.compute.internal. udp 83 false 512" NXDOMAIN qr,rd,ra 83 0.001858752s
	[INFO] 10.244.0.11:39794 - 29017 "AAAA IN registry.kube-system.svc.cluster.local.us-east-2.compute.internal. udp 83 false 512" NXDOMAIN qr,rd,ra 83 0.002064112s
	[INFO] 10.244.0.11:34677 - 56184 "AAAA IN registry.kube-system.svc.cluster.local. udp 56 false 512" NOERROR qr,aa,rd 149 0.000062341s
	[INFO] 10.244.0.11:34677 - 8827 "A IN registry.kube-system.svc.cluster.local. udp 56 false 512" NOERROR qr,aa,rd 110 0.000037554s
	[INFO] 10.244.0.20:56840 - 63749 "A IN storage.googleapis.com.gcp-auth.svc.cluster.local. udp 78 false 1232" NXDOMAIN qr,aa,rd 160 0.004884802s
	[INFO] 10.244.0.20:49691 - 10017 "AAAA IN storage.googleapis.com.gcp-auth.svc.cluster.local. udp 78 false 1232" NXDOMAIN qr,aa,rd 160 0.004779089s
	[INFO] 10.244.0.20:34378 - 59763 "AAAA IN storage.googleapis.com.svc.cluster.local. udp 69 false 1232" NXDOMAIN qr,aa,rd 151 0.000111111s
	[INFO] 10.244.0.20:35355 - 24664 "A IN storage.googleapis.com.svc.cluster.local. udp 69 false 1232" NXDOMAIN qr,aa,rd 151 0.0001304s
	[INFO] 10.244.0.20:49361 - 45456 "A IN storage.googleapis.com.cluster.local. udp 65 false 1232" NXDOMAIN qr,aa,rd 147 0.000152095s
	[INFO] 10.244.0.20:51037 - 55739 "AAAA IN storage.googleapis.com.cluster.local. udp 65 false 1232" NXDOMAIN qr,aa,rd 147 0.000066607s
	[INFO] 10.244.0.20:48455 - 44296 "A IN storage.googleapis.com.us-east-2.compute.internal. udp 78 false 1232" NXDOMAIN qr,rd,ra 67 0.007091482s
	[INFO] 10.244.0.20:53491 - 40826 "AAAA IN storage.googleapis.com.us-east-2.compute.internal. udp 78 false 1232" NXDOMAIN qr,rd,ra 67 0.006788458s
	[INFO] 10.244.0.20:49373 - 48596 "AAAA IN storage.googleapis.com. udp 51 false 1232" NOERROR qr,rd,ra 240 0.001932063s
	[INFO] 10.244.0.20:49671 - 38666 "A IN storage.googleapis.com. udp 51 false 1232" NOERROR qr,rd,ra 648 0.00145365s
	
	
	==> describe nodes <==
	Name:               addons-371349
	Roles:              control-plane
	Labels:             beta.kubernetes.io/arch=arm64
	                    beta.kubernetes.io/os=linux
	                    kubernetes.io/arch=arm64
	                    kubernetes.io/hostname=addons-371349
	                    kubernetes.io/os=linux
	                    minikube.k8s.io/commit=41795ff643dcbe39cdf81f27d064464d20ae8e7c
	                    minikube.k8s.io/name=addons-371349
	                    minikube.k8s.io/primary=true
	                    minikube.k8s.io/updated_at=2024_09_24T00_36_16_0700
	                    minikube.k8s.io/version=v1.34.0
	                    node-role.kubernetes.io/control-plane=
	                    node.kubernetes.io/exclude-from-external-load-balancers=
	                    topology.hostpath.csi/node=addons-371349
	Annotations:        kubeadm.alpha.kubernetes.io/cri-socket: unix:///var/run/crio/crio.sock
	                    node.alpha.kubernetes.io/ttl: 0
	                    volumes.kubernetes.io/controller-managed-attach-detach: true
	CreationTimestamp:  Tue, 24 Sep 2024 00:36:12 +0000
	Taints:             <none>
	Unschedulable:      false
	Lease:
	  HolderIdentity:  addons-371349
	  AcquireTime:     <unset>
	  RenewTime:       Tue, 24 Sep 2024 00:54:05 +0000
	Conditions:
	  Type             Status  LastHeartbeatTime                 LastTransitionTime                Reason                       Message
	  ----             ------  -----------------                 ------------------                ------                       -------
	  MemoryPressure   False   Tue, 24 Sep 2024 00:52:25 +0000   Tue, 24 Sep 2024 00:36:10 +0000   KubeletHasSufficientMemory   kubelet has sufficient memory available
	  DiskPressure     False   Tue, 24 Sep 2024 00:52:25 +0000   Tue, 24 Sep 2024 00:36:10 +0000   KubeletHasNoDiskPressure     kubelet has no disk pressure
	  PIDPressure      False   Tue, 24 Sep 2024 00:52:25 +0000   Tue, 24 Sep 2024 00:36:10 +0000   KubeletHasSufficientPID      kubelet has sufficient PID available
	  Ready            True    Tue, 24 Sep 2024 00:52:25 +0000   Tue, 24 Sep 2024 00:37:04 +0000   KubeletReady                 kubelet is posting ready status
	Addresses:
	  InternalIP:  192.168.49.2
	  Hostname:    addons-371349
	Capacity:
	  cpu:                2
	  ephemeral-storage:  203034800Ki
	  hugepages-1Gi:      0
	  hugepages-2Mi:      0
	  hugepages-32Mi:     0
	  hugepages-64Ki:     0
	  memory:             8022296Ki
	  pods:               110
	Allocatable:
	  cpu:                2
	  ephemeral-storage:  203034800Ki
	  hugepages-1Gi:      0
	  hugepages-2Mi:      0
	  hugepages-32Mi:     0
	  hugepages-64Ki:     0
	  memory:             8022296Ki
	  pods:               110
	System Info:
	  Machine ID:                 7aa8545f283e470b93293e30cac1a65d
	  System UUID:                c56a6457-0c21-4897-8a88-d64df490f5dc
	  Boot ID:                    2adb9b4a-25b4-46c0-b3e7-a2955d81a12f
	  Kernel Version:             5.15.0-1070-aws
	  OS Image:                   Ubuntu 22.04.5 LTS
	  Operating System:           linux
	  Architecture:               arm64
	  Container Runtime Version:  cri-o://1.24.6
	  Kubelet Version:            v1.31.1
	  Kube-Proxy Version:         v1.31.1
	PodCIDR:                      10.244.0.0/24
	PodCIDRs:                     10.244.0.0/24
	Non-terminated Pods:          (12 in total)
	  Namespace                   Name                                     CPU Requests  CPU Limits  Memory Requests  Memory Limits  Age
	  ---------                   ----                                     ------------  ----------  ---------------  -------------  ---
	  default                     busybox                                  0 (0%)        0 (0%)      0 (0%)           0 (0%)         14m
	  default                     hello-world-app-55bf9c44b4-jd6dh         0 (0%)        0 (0%)      0 (0%)           0 (0%)         2m58s
	  default                     nginx                                    0 (0%)        0 (0%)      0 (0%)           0 (0%)         5m19s
	  gcp-auth                    gcp-auth-89d5ffd79-d948l                 0 (0%)        0 (0%)      0 (0%)           0 (0%)         17m
	  kube-system                 coredns-7c65d6cfc9-bsbwf                 100m (5%)     0 (0%)      70Mi (0%)        170Mi (2%)     17m
	  kube-system                 etcd-addons-371349                       100m (5%)     0 (0%)      100Mi (1%)       0 (0%)         17m
	  kube-system                 kindnet-c2v8q                            100m (5%)     100m (5%)   50Mi (0%)        50Mi (0%)      17m
	  kube-system                 kube-apiserver-addons-371349             250m (12%)    0 (0%)      0 (0%)           0 (0%)         17m
	  kube-system                 kube-controller-manager-addons-371349    200m (10%)    0 (0%)      0 (0%)           0 (0%)         17m
	  kube-system                 kube-proxy-qcb9f                         0 (0%)        0 (0%)      0 (0%)           0 (0%)         17m
	  kube-system                 kube-scheduler-addons-371349             100m (5%)     0 (0%)      0 (0%)           0 (0%)         17m
	  kube-system                 storage-provisioner                      0 (0%)        0 (0%)      0 (0%)           0 (0%)         17m
	Allocated resources:
	  (Total limits may be over 100 percent, i.e., overcommitted.)
	  Resource           Requests    Limits
	  --------           --------    ------
	  cpu                850m (42%)  100m (5%)
	  memory             220Mi (2%)  220Mi (2%)
	  ephemeral-storage  0 (0%)      0 (0%)
	  hugepages-1Gi      0 (0%)      0 (0%)
	  hugepages-2Mi      0 (0%)      0 (0%)
	  hugepages-32Mi     0 (0%)      0 (0%)
	  hugepages-64Ki     0 (0%)      0 (0%)
	Events:
	  Type     Reason                   Age                From             Message
	  ----     ------                   ----               ----             -------
	  Normal   Starting                 17m                kube-proxy       
	  Normal   NodeHasSufficientMemory  18m (x8 over 18m)  kubelet          Node addons-371349 status is now: NodeHasSufficientMemory
	  Normal   NodeHasNoDiskPressure    18m (x8 over 18m)  kubelet          Node addons-371349 status is now: NodeHasNoDiskPressure
	  Normal   NodeHasSufficientPID     18m (x7 over 18m)  kubelet          Node addons-371349 status is now: NodeHasSufficientPID
	  Normal   Starting                 17m                kubelet          Starting kubelet.
	  Warning  CgroupV1                 17m                kubelet          Cgroup v1 support is in maintenance mode, please migrate to Cgroup v2.
	  Normal   NodeHasSufficientMemory  17m                kubelet          Node addons-371349 status is now: NodeHasSufficientMemory
	  Normal   NodeHasNoDiskPressure    17m                kubelet          Node addons-371349 status is now: NodeHasNoDiskPressure
	  Normal   NodeHasSufficientPID     17m                kubelet          Node addons-371349 status is now: NodeHasSufficientPID
	  Normal   RegisteredNode           17m                node-controller  Node addons-371349 event: Registered Node addons-371349 in Controller
	  Normal   NodeReady                17m                kubelet          Node addons-371349 status is now: NodeReady
	
	
	==> dmesg <==
	[Sep23 22:30] hrtimer: interrupt took 9485972 ns
	[Sep24 00:08] overlayfs: '/var/lib/containers/storage/overlay/l/7FOWQIVXOWACA56BLQVF4JJOLY' not a directory
	[  +0.687175] overlayfs: '/var/lib/containers/storage/overlay/l/ZLTOCNGE2IGM6DT7VP2QP7OV3M' not a directory
	
	
	==> etcd [40d8a21a9712f40f598893c1aba5670ff43d964a7b5d9463400bf4a64836edb2] <==
	{"level":"info","ts":"2024-09-24T00:36:09.764104Z","caller":"v3rpc/health.go:61","msg":"grpc service status changed","service":"","status":"SERVING"}
	{"level":"info","ts":"2024-09-24T00:36:09.765015Z","caller":"embed/serve.go:250","msg":"serving client traffic securely","traffic":"grpc+http","address":"192.168.49.2:2379"}
	{"level":"info","ts":"2024-09-24T00:36:09.769951Z","caller":"v3rpc/health.go:61","msg":"grpc service status changed","service":"","status":"SERVING"}
	{"level":"info","ts":"2024-09-24T00:36:09.771591Z","caller":"embed/serve.go:250","msg":"serving client traffic securely","traffic":"grpc+http","address":"127.0.0.1:2379"}
	{"level":"info","ts":"2024-09-24T00:36:20.632723Z","caller":"traceutil/trace.go:171","msg":"trace[773032134] transaction","detail":"{read_only:false; response_revision:337; number_of_response:1; }","duration":"103.686352ms","start":"2024-09-24T00:36:20.529020Z","end":"2024-09-24T00:36:20.632707Z","steps":["trace[773032134] 'process raft request'  (duration: 103.584422ms)"],"step_count":1}
	{"level":"info","ts":"2024-09-24T00:36:20.688729Z","caller":"traceutil/trace.go:171","msg":"trace[1378336386] transaction","detail":"{read_only:false; response_revision:338; number_of_response:1; }","duration":"159.451203ms","start":"2024-09-24T00:36:20.529260Z","end":"2024-09-24T00:36:20.688711Z","steps":["trace[1378336386] 'process raft request'  (duration: 156.488906ms)"],"step_count":1}
	{"level":"info","ts":"2024-09-24T00:36:20.708331Z","caller":"traceutil/trace.go:171","msg":"trace[1784308832] transaction","detail":"{read_only:false; response_revision:339; number_of_response:1; }","duration":"178.882143ms","start":"2024-09-24T00:36:20.529425Z","end":"2024-09-24T00:36:20.708307Z","steps":["trace[1784308832] 'process raft request'  (duration: 159.09506ms)"],"step_count":1}
	{"level":"info","ts":"2024-09-24T00:36:20.708902Z","caller":"traceutil/trace.go:171","msg":"trace[1518002914] linearizableReadLoop","detail":"{readStateIndex:348; appliedIndex:347; }","duration":"179.503099ms","start":"2024-09-24T00:36:20.529388Z","end":"2024-09-24T00:36:20.708891Z","steps":["trace[1518002914] 'read index received'  (duration: 103.522869ms)","trace[1518002914] 'applied index is now lower than readState.Index'  (duration: 75.979664ms)"],"step_count":2}
	{"level":"warn","ts":"2024-09-24T00:36:20.709094Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"179.677462ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/serviceaccounts/kube-system/ttl-controller\" ","response":"range_response_count:1 size:193"}
	{"level":"info","ts":"2024-09-24T00:36:20.709133Z","caller":"traceutil/trace.go:171","msg":"trace[1395871771] range","detail":"{range_begin:/registry/serviceaccounts/kube-system/ttl-controller; range_end:; response_count:1; response_revision:341; }","duration":"179.738343ms","start":"2024-09-24T00:36:20.529384Z","end":"2024-09-24T00:36:20.709122Z","steps":["trace[1395871771] 'agreement among raft nodes before linearized reading'  (duration: 179.649443ms)"],"step_count":1}
	{"level":"info","ts":"2024-09-24T00:36:21.611273Z","caller":"traceutil/trace.go:171","msg":"trace[662860870] transaction","detail":"{read_only:false; response_revision:345; number_of_response:1; }","duration":"106.953913ms","start":"2024-09-24T00:36:21.504299Z","end":"2024-09-24T00:36:21.611253Z","steps":["trace[662860870] 'process raft request'  (duration: 101.338407ms)"],"step_count":1}
	{"level":"info","ts":"2024-09-24T00:36:23.201763Z","caller":"traceutil/trace.go:171","msg":"trace[1579303640] transaction","detail":"{read_only:false; response_revision:363; number_of_response:1; }","duration":"247.066318ms","start":"2024-09-24T00:36:22.954673Z","end":"2024-09-24T00:36:23.201740Z","steps":["trace[1579303640] 'process raft request'  (duration: 246.933841ms)"],"step_count":1}
	{"level":"info","ts":"2024-09-24T00:36:23.205834Z","caller":"traceutil/trace.go:171","msg":"trace[578334532] transaction","detail":"{read_only:false; response_revision:364; number_of_response:1; }","duration":"101.109154ms","start":"2024-09-24T00:36:23.104699Z","end":"2024-09-24T00:36:23.205808Z","steps":["trace[578334532] 'process raft request'  (duration: 101.019022ms)"],"step_count":1}
	{"level":"info","ts":"2024-09-24T00:36:23.209377Z","caller":"traceutil/trace.go:171","msg":"trace[634610568] linearizableReadLoop","detail":"{readStateIndex:374; appliedIndex:374; }","duration":"104.566675ms","start":"2024-09-24T00:36:23.104792Z","end":"2024-09-24T00:36:23.209359Z","steps":["trace[634610568] 'read index received'  (duration: 104.557379ms)","trace[634610568] 'applied index is now lower than readState.Index'  (duration: 7.926µs)"],"step_count":2}
	{"level":"warn","ts":"2024-09-24T00:36:23.209761Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"104.957533ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/deployments/kube-system/registry\" ","response":"range_response_count:0 size:5"}
	{"level":"info","ts":"2024-09-24T00:36:23.209860Z","caller":"traceutil/trace.go:171","msg":"trace[589915269] range","detail":"{range_begin:/registry/deployments/kube-system/registry; range_end:; response_count:0; response_revision:364; }","duration":"105.061851ms","start":"2024-09-24T00:36:23.104788Z","end":"2024-09-24T00:36:23.209850Z","steps":["trace[589915269] 'agreement among raft nodes before linearized reading'  (duration: 104.923737ms)"],"step_count":1}
	{"level":"warn","ts":"2024-09-24T00:36:23.217249Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"109.080301ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/serviceaccounts/kube-system/kindnet\" ","response":"range_response_count:1 size:520"}
	{"level":"info","ts":"2024-09-24T00:36:23.217391Z","caller":"traceutil/trace.go:171","msg":"trace[1037015755] range","detail":"{range_begin:/registry/serviceaccounts/kube-system/kindnet; range_end:; response_count:1; response_revision:365; }","duration":"109.229213ms","start":"2024-09-24T00:36:23.108151Z","end":"2024-09-24T00:36:23.217380Z","steps":["trace[1037015755] 'agreement among raft nodes before linearized reading'  (duration: 109.058739ms)"],"step_count":1}
	{"level":"info","ts":"2024-09-24T00:36:23.826883Z","caller":"traceutil/trace.go:171","msg":"trace[275907741] transaction","detail":"{read_only:false; response_revision:394; number_of_response:1; }","duration":"111.28535ms","start":"2024-09-24T00:36:23.715585Z","end":"2024-09-24T00:36:23.826870Z","steps":["trace[275907741] 'process raft request'  (duration: 111.027855ms)"],"step_count":1}
	{"level":"info","ts":"2024-09-24T00:46:10.181655Z","caller":"mvcc/index.go:214","msg":"compact tree index","revision":1545}
	{"level":"info","ts":"2024-09-24T00:46:10.223346Z","caller":"mvcc/kvstore_compaction.go:69","msg":"finished scheduled compaction","compact-revision":1545,"took":"41.164636ms","hash":4261425463,"current-db-size-bytes":6520832,"current-db-size":"6.5 MB","current-db-size-in-use-bytes":3383296,"current-db-size-in-use":"3.4 MB"}
	{"level":"info","ts":"2024-09-24T00:46:10.223469Z","caller":"mvcc/hash.go:137","msg":"storing new hash","hash":4261425463,"revision":1545,"compact-revision":-1}
	{"level":"info","ts":"2024-09-24T00:51:10.211113Z","caller":"mvcc/index.go:214","msg":"compact tree index","revision":1964}
	{"level":"info","ts":"2024-09-24T00:51:10.238560Z","caller":"mvcc/kvstore_compaction.go:69","msg":"finished scheduled compaction","compact-revision":1964,"took":"26.87627ms","hash":2345089157,"current-db-size-bytes":6520832,"current-db-size":"6.5 MB","current-db-size-in-use-bytes":4173824,"current-db-size-in-use":"4.2 MB"}
	{"level":"info","ts":"2024-09-24T00:51:10.238693Z","caller":"mvcc/hash.go:137","msg":"storing new hash","hash":2345089157,"revision":1964,"compact-revision":1545}
	
	
	==> gcp-auth [e149e451e3126d1f31e6122bc09312613e217e7626fd798777f48f923270c222] <==
	2024/09/24 00:39:19 Ready to write response ...
	2024/09/24 00:39:19 Ready to marshal response ...
	2024/09/24 00:39:19 Ready to write response ...
	2024/09/24 00:47:23 Ready to marshal response ...
	2024/09/24 00:47:23 Ready to write response ...
	2024/09/24 00:47:23 Ready to marshal response ...
	2024/09/24 00:47:23 Ready to write response ...
	2024/09/24 00:47:23 Ready to marshal response ...
	2024/09/24 00:47:23 Ready to write response ...
	2024/09/24 00:47:33 Ready to marshal response ...
	2024/09/24 00:47:33 Ready to write response ...
	2024/09/24 00:47:49 Ready to marshal response ...
	2024/09/24 00:47:49 Ready to write response ...
	2024/09/24 00:48:19 Ready to marshal response ...
	2024/09/24 00:48:19 Ready to write response ...
	2024/09/24 00:48:49 Ready to marshal response ...
	2024/09/24 00:48:49 Ready to write response ...
	2024/09/24 00:51:10 Ready to marshal response ...
	2024/09/24 00:51:10 Ready to write response ...
	2024/09/24 00:51:41 Ready to marshal response ...
	2024/09/24 00:51:41 Ready to write response ...
	2024/09/24 00:51:41 Ready to marshal response ...
	2024/09/24 00:51:41 Ready to write response ...
	2024/09/24 00:51:50 Ready to marshal response ...
	2024/09/24 00:51:50 Ready to write response ...
	
	
	==> kernel <==
	 00:54:09 up  8:36,  0 users,  load average: 0.55, 0.52, 1.01
	Linux addons-371349 5.15.0-1070-aws #76~20.04.1-Ubuntu SMP Mon Sep 2 12:20:48 UTC 2024 aarch64 aarch64 aarch64 GNU/Linux
	PRETTY_NAME="Ubuntu 22.04.5 LTS"
	
	
	==> kindnet [7adace27f5bf6fd0d07f44c3b2d9c4b94d8130080a2626aadc5ab73681d376ef] <==
	I0924 00:52:04.866696       1 main.go:299] handling current node
	I0924 00:52:14.866551       1 main.go:295] Handling node with IPs: map[192.168.49.2:{}]
	I0924 00:52:14.866585       1 main.go:299] handling current node
	I0924 00:52:24.867541       1 main.go:295] Handling node with IPs: map[192.168.49.2:{}]
	I0924 00:52:24.867575       1 main.go:299] handling current node
	I0924 00:52:34.867373       1 main.go:295] Handling node with IPs: map[192.168.49.2:{}]
	I0924 00:52:34.867409       1 main.go:299] handling current node
	I0924 00:52:44.866966       1 main.go:295] Handling node with IPs: map[192.168.49.2:{}]
	I0924 00:52:44.866999       1 main.go:299] handling current node
	I0924 00:52:54.867962       1 main.go:295] Handling node with IPs: map[192.168.49.2:{}]
	I0924 00:52:54.867996       1 main.go:299] handling current node
	I0924 00:53:04.866558       1 main.go:295] Handling node with IPs: map[192.168.49.2:{}]
	I0924 00:53:04.866591       1 main.go:299] handling current node
	I0924 00:53:14.869256       1 main.go:295] Handling node with IPs: map[192.168.49.2:{}]
	I0924 00:53:14.869368       1 main.go:299] handling current node
	I0924 00:53:24.867340       1 main.go:295] Handling node with IPs: map[192.168.49.2:{}]
	I0924 00:53:24.867375       1 main.go:299] handling current node
	I0924 00:53:34.874534       1 main.go:295] Handling node with IPs: map[192.168.49.2:{}]
	I0924 00:53:34.874648       1 main.go:299] handling current node
	I0924 00:53:44.866591       1 main.go:295] Handling node with IPs: map[192.168.49.2:{}]
	I0924 00:53:44.866710       1 main.go:299] handling current node
	I0924 00:53:54.872910       1 main.go:295] Handling node with IPs: map[192.168.49.2:{}]
	I0924 00:53:54.872952       1 main.go:299] handling current node
	I0924 00:54:04.866568       1 main.go:295] Handling node with IPs: map[192.168.49.2:{}]
	I0924 00:54:04.866697       1 main.go:299] handling current node
	
	
	==> kube-apiserver [749045c42da2d61080a3969428ab514fa4047e831ebb9439b8511e518e9b1c04] <==
	I0924 00:48:36.745795       1 handler.go:286] Adding GroupVersion snapshot.storage.k8s.io v1beta1 to ResourceManager
	I0924 00:48:36.783900       1 handler.go:286] Adding GroupVersion snapshot.storage.k8s.io v1 to ResourceManager
	I0924 00:48:36.784082       1 handler.go:286] Adding GroupVersion snapshot.storage.k8s.io v1beta1 to ResourceManager
	I0924 00:48:36.952645       1 handler.go:286] Adding GroupVersion snapshot.storage.k8s.io v1 to ResourceManager
	I0924 00:48:36.952811       1 handler.go:286] Adding GroupVersion snapshot.storage.k8s.io v1beta1 to ResourceManager
	I0924 00:48:36.952859       1 handler.go:286] Adding GroupVersion snapshot.storage.k8s.io v1 to ResourceManager
	I0924 00:48:37.018886       1 handler.go:286] Adding GroupVersion snapshot.storage.k8s.io v1 to ResourceManager
	I0924 00:48:37.019016       1 handler.go:286] Adding GroupVersion snapshot.storage.k8s.io v1beta1 to ResourceManager
	W0924 00:48:37.945516       1 cacher.go:171] Terminating all watchers from cacher volumesnapshotclasses.snapshot.storage.k8s.io
	W0924 00:48:38.018934       1 cacher.go:171] Terminating all watchers from cacher volumesnapshots.snapshot.storage.k8s.io
	W0924 00:48:38.045455       1 cacher.go:171] Terminating all watchers from cacher volumesnapshotcontents.snapshot.storage.k8s.io
	I0924 00:48:43.815830       1 handler.go:286] Adding GroupVersion gadget.kinvolk.io v1alpha1 to ResourceManager
	W0924 00:48:44.935663       1 cacher.go:171] Terminating all watchers from cacher traces.gadget.kinvolk.io
	I0924 00:48:49.462606       1 controller.go:615] quota admission added evaluator for: ingresses.networking.k8s.io
	I0924 00:48:49.779386       1 alloc.go:330] "allocated clusterIPs" service="default/nginx" clusterIPs={"IPv4":"10.98.176.210"}
	I0924 00:51:10.368010       1 alloc.go:330] "allocated clusterIPs" service="default/hello-world-app" clusterIPs={"IPv4":"10.100.198.90"}
	E0924 00:51:12.905099       1 repair.go:325] "Unhandled Error" err="the cluster IP 10.106.165.243 may have leaked: flagging for later clean up" logger="UnhandledError"
	E0924 00:51:13.043749       1 authentication.go:73] "Unable to authenticate the request" err="[invalid bearer token, serviceaccounts \"ingress-nginx\" not found]"
	E0924 00:51:15.783571       1 authentication.go:73] "Unable to authenticate the request" err="[invalid bearer token, serviceaccounts \"ingress-nginx\" not found]"
	E0924 00:51:15.793239       1 authentication.go:73] "Unable to authenticate the request" err="[invalid bearer token, serviceaccounts \"ingress-nginx\" not found]"
	E0924 00:51:51.874118       1 authentication.go:73] "Unable to authenticate the request" err="[invalid bearer token, serviceaccounts \"local-path-provisioner-service-account\" not found]"
	E0924 00:51:51.885312       1 authentication.go:73] "Unable to authenticate the request" err="[invalid bearer token, serviceaccounts \"local-path-provisioner-service-account\" not found]"
	E0924 00:51:51.895498       1 authentication.go:73] "Unable to authenticate the request" err="[invalid bearer token, serviceaccounts \"local-path-provisioner-service-account\" not found]"
	E0924 00:52:06.897045       1 authentication.go:73] "Unable to authenticate the request" err="[invalid bearer token, serviceaccounts \"local-path-provisioner-service-account\" not found]"
	E0924 00:52:19.924321       1 authentication.go:73] "Unable to authenticate the request" err="[invalid bearer token, serviceaccounts \"local-path-provisioner-service-account\" not found]"
	
	
	==> kube-controller-manager [340d83c4a515af013d7e2f2cb8dd72a56a11c8be46e63481fd282573f250be80] <==
	E0924 00:52:10.722497       1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/metadata/metadatainformer/informer.go:138: Failed to watch *v1.PartialObjectMetadata: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource" logger="UnhandledError"
	W0924 00:52:20.937060       1 reflector.go:561] k8s.io/client-go/metadata/metadatainformer/informer.go:138: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource
	E0924 00:52:20.937100       1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/metadata/metadatainformer/informer.go:138: Failed to watch *v1.PartialObjectMetadata: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource" logger="UnhandledError"
	I0924 00:52:25.493090       1 range_allocator.go:241] "Successfully synced" logger="node-ipam-controller" key="addons-371349"
	I0924 00:52:39.028885       1 namespace_controller.go:187] "Namespace has been deleted" logger="namespace-controller" namespace="local-path-storage"
	I0924 00:52:40.553918       1 replica_set.go:679] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="default/cloud-spanner-emulator-5b584cc74" duration="7.885µs"
	W0924 00:52:42.836283       1 reflector.go:561] k8s.io/client-go/metadata/metadatainformer/informer.go:138: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource
	E0924 00:52:42.836325       1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/metadata/metadatainformer/informer.go:138: Failed to watch *v1.PartialObjectMetadata: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource" logger="UnhandledError"
	W0924 00:52:43.274110       1 reflector.go:561] k8s.io/client-go/metadata/metadatainformer/informer.go:138: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource
	E0924 00:52:43.275118       1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/metadata/metadatainformer/informer.go:138: Failed to watch *v1.PartialObjectMetadata: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource" logger="UnhandledError"
	W0924 00:53:08.829705       1 reflector.go:561] k8s.io/client-go/metadata/metadatainformer/informer.go:138: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource
	E0924 00:53:08.829747       1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/metadata/metadatainformer/informer.go:138: Failed to watch *v1.PartialObjectMetadata: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource" logger="UnhandledError"
	W0924 00:53:16.836911       1 reflector.go:561] k8s.io/client-go/metadata/metadatainformer/informer.go:138: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource
	E0924 00:53:16.836959       1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/metadata/metadatainformer/informer.go:138: Failed to watch *v1.PartialObjectMetadata: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource" logger="UnhandledError"
	W0924 00:53:22.001650       1 reflector.go:561] k8s.io/client-go/metadata/metadatainformer/informer.go:138: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource
	E0924 00:53:22.001693       1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/metadata/metadatainformer/informer.go:138: Failed to watch *v1.PartialObjectMetadata: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource" logger="UnhandledError"
	W0924 00:53:40.324802       1 reflector.go:561] k8s.io/client-go/metadata/metadatainformer/informer.go:138: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource
	E0924 00:53:40.324847       1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/metadata/metadatainformer/informer.go:138: Failed to watch *v1.PartialObjectMetadata: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource" logger="UnhandledError"
	W0924 00:53:57.577762       1 reflector.go:561] k8s.io/client-go/metadata/metadatainformer/informer.go:138: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource
	E0924 00:53:57.577946       1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/metadata/metadatainformer/informer.go:138: Failed to watch *v1.PartialObjectMetadata: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource" logger="UnhandledError"
	W0924 00:54:04.676751       1 reflector.go:561] k8s.io/client-go/metadata/metadatainformer/informer.go:138: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource
	E0924 00:54:04.676795       1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/metadata/metadatainformer/informer.go:138: Failed to watch *v1.PartialObjectMetadata: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource" logger="UnhandledError"
	W0924 00:54:06.829374       1 reflector.go:561] k8s.io/client-go/metadata/metadatainformer/informer.go:138: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource
	E0924 00:54:06.829484       1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/metadata/metadatainformer/informer.go:138: Failed to watch *v1.PartialObjectMetadata: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource" logger="UnhandledError"
	I0924 00:54:07.380313       1 replica_set.go:679] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="kube-system/metrics-server-84c5f94fbc" duration="5.029µs"
	
	
	==> kube-proxy [8f2c47f2d8dc25f068087f5d0e702e1768f8714f22c484f1ebe13e92be684997] <==
	I0924 00:36:25.074970       1 server_linux.go:66] "Using iptables proxy"
	I0924 00:36:25.515603       1 server.go:677] "Successfully retrieved node IP(s)" IPs=["192.168.49.2"]
	E0924 00:36:25.515901       1 server.go:234] "Kube-proxy configuration may be incomplete or incorrect" err="nodePortAddresses is unset; NodePort connections will be accepted on all local IPs. Consider using `--nodeport-addresses primary`"
	I0924 00:36:25.628068       1 server.go:243] "kube-proxy running in dual-stack mode" primary ipFamily="IPv4"
	I0924 00:36:25.628119       1 server_linux.go:169] "Using iptables Proxier"
	I0924 00:36:25.648842       1 proxier.go:255] "Setting route_localnet=1 to allow node-ports on localhost; to change this either disable iptables.localhostNodePorts (--iptables-localhost-nodeports) or set nodePortAddresses (--nodeport-addresses) to filter loopback addresses" ipFamily="IPv4"
	I0924 00:36:25.653049       1 server.go:483] "Version info" version="v1.31.1"
	I0924 00:36:25.653080       1 server.go:485] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
	I0924 00:36:25.700056       1 config.go:199] "Starting service config controller"
	I0924 00:36:25.700112       1 shared_informer.go:313] Waiting for caches to sync for service config
	I0924 00:36:25.700145       1 config.go:105] "Starting endpoint slice config controller"
	I0924 00:36:25.700151       1 shared_informer.go:313] Waiting for caches to sync for endpoint slice config
	I0924 00:36:25.700699       1 config.go:328] "Starting node config controller"
	I0924 00:36:25.700719       1 shared_informer.go:313] Waiting for caches to sync for node config
	I0924 00:36:26.004104       1 shared_informer.go:320] Caches are synced for node config
	I0924 00:36:26.004226       1 shared_informer.go:320] Caches are synced for service config
	I0924 00:36:26.004259       1 shared_informer.go:320] Caches are synced for endpoint slice config
	
	
	==> kube-scheduler [278db6b1284e1f1d66e55b827b5a4b51ea66ac4b399cfb13b724520fb0071730] <==
	W0924 00:36:12.854573       1 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.Service: services is forbidden: User "system:kube-scheduler" cannot list resource "services" in API group "" at the cluster scope
	E0924 00:36:12.858043       1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.Service: failed to list *v1.Service: services is forbidden: User \"system:kube-scheduler\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError"
	W0924 00:36:13.660480       1 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.PersistentVolume: persistentvolumes is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumes" in API group "" at the cluster scope
	E0924 00:36:13.660619       1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.PersistentVolume: failed to list *v1.PersistentVolume: persistentvolumes is forbidden: User \"system:kube-scheduler\" cannot list resource \"persistentvolumes\" in API group \"\" at the cluster scope" logger="UnhandledError"
	W0924 00:36:13.671582       1 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.ReplicationController: replicationcontrollers is forbidden: User "system:kube-scheduler" cannot list resource "replicationcontrollers" in API group "" at the cluster scope
	E0924 00:36:13.671700       1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.ReplicationController: failed to list *v1.ReplicationController: replicationcontrollers is forbidden: User \"system:kube-scheduler\" cannot list resource \"replicationcontrollers\" in API group \"\" at the cluster scope" logger="UnhandledError"
	W0924 00:36:13.680036       1 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.ReplicaSet: replicasets.apps is forbidden: User "system:kube-scheduler" cannot list resource "replicasets" in API group "apps" at the cluster scope
	E0924 00:36:13.680155       1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.ReplicaSet: failed to list *v1.ReplicaSet: replicasets.apps is forbidden: User \"system:kube-scheduler\" cannot list resource \"replicasets\" in API group \"apps\" at the cluster scope" logger="UnhandledError"
	W0924 00:36:13.738765       1 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.CSIStorageCapacity: csistoragecapacities.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csistoragecapacities" in API group "storage.k8s.io" at the cluster scope
	E0924 00:36:13.738807       1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.CSIStorageCapacity: failed to list *v1.CSIStorageCapacity: csistoragecapacities.storage.k8s.io is forbidden: User \"system:kube-scheduler\" cannot list resource \"csistoragecapacities\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError"
	W0924 00:36:13.767667       1 reflector.go:561] runtime/asm_arm64.s:1222: failed to list *v1.ConfigMap: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot list resource "configmaps" in API group "" in the namespace "kube-system"
	E0924 00:36:13.767800       1 reflector.go:158] "Unhandled Error" err="runtime/asm_arm64.s:1222: Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps \"extension-apiserver-authentication\" is forbidden: User \"system:kube-scheduler\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"kube-system\"" logger="UnhandledError"
	W0924 00:36:13.793760       1 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csidrivers" in API group "storage.k8s.io" at the cluster scope
	E0924 00:36:13.793802       1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.CSIDriver: failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:kube-scheduler\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError"
	W0924 00:36:13.833453       1 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.CSINode: csinodes.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csinodes" in API group "storage.k8s.io" at the cluster scope
	E0924 00:36:13.833510       1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.CSINode: failed to list *v1.CSINode: csinodes.storage.k8s.io is forbidden: User \"system:kube-scheduler\" cannot list resource \"csinodes\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError"
	W0924 00:36:13.843267       1 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.PersistentVolumeClaim: persistentvolumeclaims is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumeclaims" in API group "" at the cluster scope
	E0924 00:36:13.843320       1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.PersistentVolumeClaim: failed to list *v1.PersistentVolumeClaim: persistentvolumeclaims is forbidden: User \"system:kube-scheduler\" cannot list resource \"persistentvolumeclaims\" in API group \"\" at the cluster scope" logger="UnhandledError"
	W0924 00:36:13.901524       1 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.Pod: pods is forbidden: User "system:kube-scheduler" cannot list resource "pods" in API group "" at the cluster scope
	E0924 00:36:13.901892       1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.Pod: failed to list *v1.Pod: pods is forbidden: User \"system:kube-scheduler\" cannot list resource \"pods\" in API group \"\" at the cluster scope" logger="UnhandledError"
	W0924 00:36:13.930111       1 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.PodDisruptionBudget: poddisruptionbudgets.policy is forbidden: User "system:kube-scheduler" cannot list resource "poddisruptionbudgets" in API group "policy" at the cluster scope
	E0924 00:36:13.930255       1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.PodDisruptionBudget: failed to list *v1.PodDisruptionBudget: poddisruptionbudgets.policy is forbidden: User \"system:kube-scheduler\" cannot list resource \"poddisruptionbudgets\" in API group \"policy\" at the cluster scope" logger="UnhandledError"
	W0924 00:36:13.937226       1 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.Namespace: namespaces is forbidden: User "system:kube-scheduler" cannot list resource "namespaces" in API group "" at the cluster scope
	E0924 00:36:13.937281       1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.Namespace: failed to list *v1.Namespace: namespaces is forbidden: User \"system:kube-scheduler\" cannot list resource \"namespaces\" in API group \"\" at the cluster scope" logger="UnhandledError"
	I0924 00:36:15.547144       1 shared_informer.go:320] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file
	
	
	==> kubelet <==
	Sep 24 00:53:22 addons-371349 kubelet[1485]: E0924 00:53:22.140977    1485 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"busybox\" with ImagePullBackOff: \"Back-off pulling image \\\"gcr.io/k8s-minikube/busybox:1.28.4-glibc\\\"\"" pod="default/busybox" podUID="def0bba6-9421-4415-af6a-669a0e12a16e"
	Sep 24 00:53:25 addons-371349 kubelet[1485]: E0924 00:53:25.505767    1485 eviction_manager.go:257] "Eviction manager: failed to get HasDedicatedImageFs" err="missing image stats: &ImageFsInfoResponse{ImageFilesystems:[]*FilesystemUsage{&FilesystemUsage{Timestamp:1727139205505474754,FsId:&FilesystemIdentifier{Mountpoint:/var/lib/containers/storage/overlay-images,},UsedBytes:&UInt64Value{Value:572294,},InodesUsed:&UInt64Value{Value:219,},},},ContainerFilesystems:[]*FilesystemUsage{},}"
	Sep 24 00:53:25 addons-371349 kubelet[1485]: E0924 00:53:25.505829    1485 eviction_manager.go:212] "Eviction manager: failed to synchronize" err="eviction manager: failed to get HasDedicatedImageFs: missing image stats: &ImageFsInfoResponse{ImageFilesystems:[]*FilesystemUsage{&FilesystemUsage{Timestamp:1727139205505474754,FsId:&FilesystemIdentifier{Mountpoint:/var/lib/containers/storage/overlay-images,},UsedBytes:&UInt64Value{Value:572294,},InodesUsed:&UInt64Value{Value:219,},},},ContainerFilesystems:[]*FilesystemUsage{},}"
	Sep 24 00:53:35 addons-371349 kubelet[1485]: E0924 00:53:35.508517    1485 eviction_manager.go:257] "Eviction manager: failed to get HasDedicatedImageFs" err="missing image stats: &ImageFsInfoResponse{ImageFilesystems:[]*FilesystemUsage{&FilesystemUsage{Timestamp:1727139215508289272,FsId:&FilesystemIdentifier{Mountpoint:/var/lib/containers/storage/overlay-images,},UsedBytes:&UInt64Value{Value:572294,},InodesUsed:&UInt64Value{Value:219,},},},ContainerFilesystems:[]*FilesystemUsage{},}"
	Sep 24 00:53:35 addons-371349 kubelet[1485]: E0924 00:53:35.508558    1485 eviction_manager.go:212] "Eviction manager: failed to synchronize" err="eviction manager: failed to get HasDedicatedImageFs: missing image stats: &ImageFsInfoResponse{ImageFilesystems:[]*FilesystemUsage{&FilesystemUsage{Timestamp:1727139215508289272,FsId:&FilesystemIdentifier{Mountpoint:/var/lib/containers/storage/overlay-images,},UsedBytes:&UInt64Value{Value:572294,},InodesUsed:&UInt64Value{Value:219,},},},ContainerFilesystems:[]*FilesystemUsage{},}"
	Sep 24 00:53:36 addons-371349 kubelet[1485]: E0924 00:53:36.141316    1485 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"busybox\" with ImagePullBackOff: \"Back-off pulling image \\\"gcr.io/k8s-minikube/busybox:1.28.4-glibc\\\"\"" pod="default/busybox" podUID="def0bba6-9421-4415-af6a-669a0e12a16e"
	Sep 24 00:53:45 addons-371349 kubelet[1485]: E0924 00:53:45.511379    1485 eviction_manager.go:257] "Eviction manager: failed to get HasDedicatedImageFs" err="missing image stats: &ImageFsInfoResponse{ImageFilesystems:[]*FilesystemUsage{&FilesystemUsage{Timestamp:1727139225511149672,FsId:&FilesystemIdentifier{Mountpoint:/var/lib/containers/storage/overlay-images,},UsedBytes:&UInt64Value{Value:572294,},InodesUsed:&UInt64Value{Value:219,},},},ContainerFilesystems:[]*FilesystemUsage{},}"
	Sep 24 00:53:45 addons-371349 kubelet[1485]: E0924 00:53:45.511417    1485 eviction_manager.go:212] "Eviction manager: failed to synchronize" err="eviction manager: failed to get HasDedicatedImageFs: missing image stats: &ImageFsInfoResponse{ImageFilesystems:[]*FilesystemUsage{&FilesystemUsage{Timestamp:1727139225511149672,FsId:&FilesystemIdentifier{Mountpoint:/var/lib/containers/storage/overlay-images,},UsedBytes:&UInt64Value{Value:572294,},InodesUsed:&UInt64Value{Value:219,},},},ContainerFilesystems:[]*FilesystemUsage{},}"
	Sep 24 00:53:48 addons-371349 kubelet[1485]: E0924 00:53:48.141187    1485 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"busybox\" with ImagePullBackOff: \"Back-off pulling image \\\"gcr.io/k8s-minikube/busybox:1.28.4-glibc\\\"\"" pod="default/busybox" podUID="def0bba6-9421-4415-af6a-669a0e12a16e"
	Sep 24 00:53:55 addons-371349 kubelet[1485]: E0924 00:53:55.514381    1485 eviction_manager.go:257] "Eviction manager: failed to get HasDedicatedImageFs" err="missing image stats: &ImageFsInfoResponse{ImageFilesystems:[]*FilesystemUsage{&FilesystemUsage{Timestamp:1727139235514135051,FsId:&FilesystemIdentifier{Mountpoint:/var/lib/containers/storage/overlay-images,},UsedBytes:&UInt64Value{Value:572294,},InodesUsed:&UInt64Value{Value:219,},},},ContainerFilesystems:[]*FilesystemUsage{},}"
	Sep 24 00:53:55 addons-371349 kubelet[1485]: E0924 00:53:55.514421    1485 eviction_manager.go:212] "Eviction manager: failed to synchronize" err="eviction manager: failed to get HasDedicatedImageFs: missing image stats: &ImageFsInfoResponse{ImageFilesystems:[]*FilesystemUsage{&FilesystemUsage{Timestamp:1727139235514135051,FsId:&FilesystemIdentifier{Mountpoint:/var/lib/containers/storage/overlay-images,},UsedBytes:&UInt64Value{Value:572294,},InodesUsed:&UInt64Value{Value:219,},},},ContainerFilesystems:[]*FilesystemUsage{},}"
	Sep 24 00:54:03 addons-371349 kubelet[1485]: E0924 00:54:03.142675    1485 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"busybox\" with ImagePullBackOff: \"Back-off pulling image \\\"gcr.io/k8s-minikube/busybox:1.28.4-glibc\\\"\"" pod="default/busybox" podUID="def0bba6-9421-4415-af6a-669a0e12a16e"
	Sep 24 00:54:05 addons-371349 kubelet[1485]: E0924 00:54:05.516808    1485 eviction_manager.go:257] "Eviction manager: failed to get HasDedicatedImageFs" err="missing image stats: &ImageFsInfoResponse{ImageFilesystems:[]*FilesystemUsage{&FilesystemUsage{Timestamp:1727139245516563122,FsId:&FilesystemIdentifier{Mountpoint:/var/lib/containers/storage/overlay-images,},UsedBytes:&UInt64Value{Value:572294,},InodesUsed:&UInt64Value{Value:219,},},},ContainerFilesystems:[]*FilesystemUsage{},}"
	Sep 24 00:54:05 addons-371349 kubelet[1485]: E0924 00:54:05.516848    1485 eviction_manager.go:212] "Eviction manager: failed to synchronize" err="eviction manager: failed to get HasDedicatedImageFs: missing image stats: &ImageFsInfoResponse{ImageFilesystems:[]*FilesystemUsage{&FilesystemUsage{Timestamp:1727139245516563122,FsId:&FilesystemIdentifier{Mountpoint:/var/lib/containers/storage/overlay-images,},UsedBytes:&UInt64Value{Value:572294,},InodesUsed:&UInt64Value{Value:219,},},},ContainerFilesystems:[]*FilesystemUsage{},}"
	Sep 24 00:54:08 addons-371349 kubelet[1485]: I0924 00:54:08.684214    1485 scope.go:117] "RemoveContainer" containerID="818b4f0b3744324f877190bb18798952c87007618b9774a41432790a22590c09"
	Sep 24 00:54:08 addons-371349 kubelet[1485]: I0924 00:54:08.687528    1485 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7c5e5bee-e3dc-43a0-a7b2-e1afa3197ce6-tmp-dir\") pod \"7c5e5bee-e3dc-43a0-a7b2-e1afa3197ce6\" (UID: \"7c5e5bee-e3dc-43a0-a7b2-e1afa3197ce6\") "
	Sep 24 00:54:08 addons-371349 kubelet[1485]: I0924 00:54:08.687973    1485 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j2hjb\" (UniqueName: \"kubernetes.io/projected/7c5e5bee-e3dc-43a0-a7b2-e1afa3197ce6-kube-api-access-j2hjb\") pod \"7c5e5bee-e3dc-43a0-a7b2-e1afa3197ce6\" (UID: \"7c5e5bee-e3dc-43a0-a7b2-e1afa3197ce6\") "
	Sep 24 00:54:08 addons-371349 kubelet[1485]: I0924 00:54:08.687823    1485 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7c5e5bee-e3dc-43a0-a7b2-e1afa3197ce6-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "7c5e5bee-e3dc-43a0-a7b2-e1afa3197ce6" (UID: "7c5e5bee-e3dc-43a0-a7b2-e1afa3197ce6"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGidValue ""
	Sep 24 00:54:08 addons-371349 kubelet[1485]: I0924 00:54:08.688379    1485 reconciler_common.go:288] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7c5e5bee-e3dc-43a0-a7b2-e1afa3197ce6-tmp-dir\") on node \"addons-371349\" DevicePath \"\""
	Sep 24 00:54:08 addons-371349 kubelet[1485]: I0924 00:54:08.700929    1485 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7c5e5bee-e3dc-43a0-a7b2-e1afa3197ce6-kube-api-access-j2hjb" (OuterVolumeSpecName: "kube-api-access-j2hjb") pod "7c5e5bee-e3dc-43a0-a7b2-e1afa3197ce6" (UID: "7c5e5bee-e3dc-43a0-a7b2-e1afa3197ce6"). InnerVolumeSpecName "kube-api-access-j2hjb". PluginName "kubernetes.io/projected", VolumeGidValue ""
	Sep 24 00:54:08 addons-371349 kubelet[1485]: I0924 00:54:08.719055    1485 scope.go:117] "RemoveContainer" containerID="818b4f0b3744324f877190bb18798952c87007618b9774a41432790a22590c09"
	Sep 24 00:54:08 addons-371349 kubelet[1485]: E0924 00:54:08.719803    1485 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"818b4f0b3744324f877190bb18798952c87007618b9774a41432790a22590c09\": container with ID starting with 818b4f0b3744324f877190bb18798952c87007618b9774a41432790a22590c09 not found: ID does not exist" containerID="818b4f0b3744324f877190bb18798952c87007618b9774a41432790a22590c09"
	Sep 24 00:54:08 addons-371349 kubelet[1485]: I0924 00:54:08.719839    1485 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"818b4f0b3744324f877190bb18798952c87007618b9774a41432790a22590c09"} err="failed to get container status \"818b4f0b3744324f877190bb18798952c87007618b9774a41432790a22590c09\": rpc error: code = NotFound desc = could not find container \"818b4f0b3744324f877190bb18798952c87007618b9774a41432790a22590c09\": container with ID starting with 818b4f0b3744324f877190bb18798952c87007618b9774a41432790a22590c09 not found: ID does not exist"
	Sep 24 00:54:08 addons-371349 kubelet[1485]: I0924 00:54:08.789496    1485 reconciler_common.go:288] "Volume detached for volume \"kube-api-access-j2hjb\" (UniqueName: \"kubernetes.io/projected/7c5e5bee-e3dc-43a0-a7b2-e1afa3197ce6-kube-api-access-j2hjb\") on node \"addons-371349\" DevicePath \"\""
	Sep 24 00:54:09 addons-371349 kubelet[1485]: I0924 00:54:09.141933    1485 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7c5e5bee-e3dc-43a0-a7b2-e1afa3197ce6" path="/var/lib/kubelet/pods/7c5e5bee-e3dc-43a0-a7b2-e1afa3197ce6/volumes"
	
	
	==> storage-provisioner [f1f18e06d2168b28d189eb5c666ad7d131f5f957d56fade8478d775c15870ec6] <==
	I0924 00:37:05.969239       1 storage_provisioner.go:116] Initializing the minikube storage provisioner...
	I0924 00:37:05.993268       1 storage_provisioner.go:141] Storage provisioner initialized, now starting service!
	I0924 00:37:05.993402       1 leaderelection.go:243] attempting to acquire leader lease kube-system/k8s.io-minikube-hostpath...
	I0924 00:37:06.013890       1 leaderelection.go:253] successfully acquired lease kube-system/k8s.io-minikube-hostpath
	I0924 00:37:06.014216       1 controller.go:835] Starting provisioner controller k8s.io/minikube-hostpath_addons-371349_c1c71ef6-3afa-4b5e-932a-ce8168f67da3!
	I0924 00:37:06.015491       1 event.go:282] Event(v1.ObjectReference{Kind:"Endpoints", Namespace:"kube-system", Name:"k8s.io-minikube-hostpath", UID:"f1de51ca-2882-4f64-af09-93e4790263f0", APIVersion:"v1", ResourceVersion:"937", FieldPath:""}): type: 'Normal' reason: 'LeaderElection' addons-371349_c1c71ef6-3afa-4b5e-932a-ce8168f67da3 became leader
	I0924 00:37:06.115267       1 controller.go:884] Started provisioner controller k8s.io/minikube-hostpath_addons-371349_c1c71ef6-3afa-4b5e-932a-ce8168f67da3!
	

                                                
                                                
-- /stdout --
helpers_test.go:254: (dbg) Run:  out/minikube-linux-arm64 status --format={{.APIServer}} -p addons-371349 -n addons-371349
helpers_test.go:261: (dbg) Run:  kubectl --context addons-371349 get po -o=jsonpath={.items[*].metadata.name} -A --field-selector=status.phase!=Running
helpers_test.go:272: non-running pods: busybox
helpers_test.go:274: ======> post-mortem[TestAddons/parallel/MetricsServer]: describe non-running pods <======
helpers_test.go:277: (dbg) Run:  kubectl --context addons-371349 describe pod busybox
helpers_test.go:282: (dbg) kubectl --context addons-371349 describe pod busybox:

                                                
                                                
-- stdout --
	Name:             busybox
	Namespace:        default
	Priority:         0
	Service Account:  default
	Node:             addons-371349/192.168.49.2
	Start Time:       Tue, 24 Sep 2024 00:39:19 +0000
	Labels:           integration-test=busybox
	Annotations:      <none>
	Status:           Pending
	IP:               10.244.0.21
	IPs:
	  IP:  10.244.0.21
	Containers:
	  busybox:
	    Container ID:  
	    Image:         gcr.io/k8s-minikube/busybox:1.28.4-glibc
	    Image ID:      
	    Port:          <none>
	    Host Port:     <none>
	    Command:
	      sleep
	      3600
	    State:          Waiting
	      Reason:       ImagePullBackOff
	    Ready:          False
	    Restart Count:  0
	    Environment:
	      GOOGLE_APPLICATION_CREDENTIALS:  /google-app-creds.json
	      PROJECT_ID:                      this_is_fake
	      GCP_PROJECT:                     this_is_fake
	      GCLOUD_PROJECT:                  this_is_fake
	      GOOGLE_CLOUD_PROJECT:            this_is_fake
	      CLOUDSDK_CORE_PROJECT:           this_is_fake
	    Mounts:
	      /google-app-creds.json from gcp-creds (ro)
	      /var/run/secrets/kubernetes.io/serviceaccount from kube-api-access-fffwl (ro)
	Conditions:
	  Type                        Status
	  PodReadyToStartContainers   True 
	  Initialized                 True 
	  Ready                       False 
	  ContainersReady             False 
	  PodScheduled                True 
	Volumes:
	  kube-api-access-fffwl:
	    Type:                    Projected (a volume that contains injected data from multiple sources)
	    TokenExpirationSeconds:  3607
	    ConfigMapName:           kube-root-ca.crt
	    ConfigMapOptional:       <nil>
	    DownwardAPI:             true
	  gcp-creds:
	    Type:          HostPath (bare host directory volume)
	    Path:          /var/lib/minikube/google_application_credentials.json
	    HostPathType:  File
	QoS Class:         BestEffort
	Node-Selectors:    <none>
	Tolerations:       node.kubernetes.io/not-ready:NoExecute op=Exists for 300s
	                   node.kubernetes.io/unreachable:NoExecute op=Exists for 300s
	Events:
	  Type     Reason     Age                   From               Message
	  ----     ------     ----                  ----               -------
	  Normal   Scheduled  14m                   default-scheduler  Successfully assigned default/busybox to addons-371349
	  Normal   Pulling    13m (x4 over 14m)     kubelet            Pulling image "gcr.io/k8s-minikube/busybox:1.28.4-glibc"
	  Warning  Failed     13m (x4 over 14m)     kubelet            Failed to pull image "gcr.io/k8s-minikube/busybox:1.28.4-glibc": unable to retrieve auth token: invalid username/password: unauthorized: authentication failed
	  Warning  Failed     13m (x4 over 14m)     kubelet            Error: ErrImagePull
	  Warning  Failed     13m (x6 over 14m)     kubelet            Error: ImagePullBackOff
	  Normal   BackOff    4m42s (x44 over 14m)  kubelet            Back-off pulling image "gcr.io/k8s-minikube/busybox:1.28.4-glibc"

                                                
                                                
-- /stdout --
helpers_test.go:285: <<< TestAddons/parallel/MetricsServer FAILED: end of post-mortem logs <<<
helpers_test.go:286: ---------------------/post-mortem---------------------------------
--- FAIL: TestAddons/parallel/MetricsServer (332.84s)

                                                
                                    

Test pass (295/327)

Order passed test Duration
3 TestDownloadOnly/v1.20.0/json-events 12.63
4 TestDownloadOnly/v1.20.0/preload-exists 0
8 TestDownloadOnly/v1.20.0/LogsDuration 0.08
9 TestDownloadOnly/v1.20.0/DeleteAll 0.21
10 TestDownloadOnly/v1.20.0/DeleteAlwaysSucceeds 0.15
12 TestDownloadOnly/v1.31.1/json-events 8.04
13 TestDownloadOnly/v1.31.1/preload-exists 0
17 TestDownloadOnly/v1.31.1/LogsDuration 0.08
18 TestDownloadOnly/v1.31.1/DeleteAll 0.2
19 TestDownloadOnly/v1.31.1/DeleteAlwaysSucceeds 0.13
21 TestBinaryMirror 0.58
25 TestAddons/PreSetup/EnablingAddonOnNonExistingCluster 0.07
26 TestAddons/PreSetup/DisablingAddonOnNonExistingCluster 0.07
27 TestAddons/Setup 228.39
31 TestAddons/serial/GCPAuth/Namespaces 0.2
35 TestAddons/parallel/InspektorGadget 11.86
38 TestAddons/parallel/CSI 58.37
39 TestAddons/parallel/Headlamp 15.81
40 TestAddons/parallel/CloudSpanner 6.54
41 TestAddons/parallel/LocalPath 53.22
42 TestAddons/parallel/NvidiaDevicePlugin 6.49
43 TestAddons/parallel/Yakd 11.71
44 TestAddons/StoppedEnableDisable 6.18
45 TestCertOptions 36.46
46 TestCertExpiration 263.01
48 TestForceSystemdFlag 42.01
49 TestForceSystemdEnv 35.86
55 TestErrorSpam/setup 33.04
56 TestErrorSpam/start 0.74
57 TestErrorSpam/status 1
58 TestErrorSpam/pause 1.74
59 TestErrorSpam/unpause 1.96
60 TestErrorSpam/stop 1.48
63 TestFunctional/serial/CopySyncFile 0
64 TestFunctional/serial/StartWithProxy 77.25
65 TestFunctional/serial/AuditLog 0
66 TestFunctional/serial/SoftStart 39.52
67 TestFunctional/serial/KubeContext 0.07
68 TestFunctional/serial/KubectlGetPods 0.09
71 TestFunctional/serial/CacheCmd/cache/add_remote 4.39
72 TestFunctional/serial/CacheCmd/cache/add_local 1.38
73 TestFunctional/serial/CacheCmd/cache/CacheDelete 0.05
74 TestFunctional/serial/CacheCmd/cache/list 0.05
75 TestFunctional/serial/CacheCmd/cache/verify_cache_inside_node 0.31
76 TestFunctional/serial/CacheCmd/cache/cache_reload 2.09
77 TestFunctional/serial/CacheCmd/cache/delete 0.11
78 TestFunctional/serial/MinikubeKubectlCmd 0.14
79 TestFunctional/serial/MinikubeKubectlCmdDirectly 0.13
80 TestFunctional/serial/ExtraConfig 39.25
81 TestFunctional/serial/ComponentHealth 0.09
82 TestFunctional/serial/LogsCmd 1.65
83 TestFunctional/serial/LogsFileCmd 1.65
84 TestFunctional/serial/InvalidService 4.23
86 TestFunctional/parallel/ConfigCmd 0.48
87 TestFunctional/parallel/DashboardCmd 10.68
88 TestFunctional/parallel/DryRun 0.5
89 TestFunctional/parallel/InternationalLanguage 0.22
90 TestFunctional/parallel/StatusCmd 0.91
94 TestFunctional/parallel/ServiceCmdConnect 6.57
95 TestFunctional/parallel/AddonsCmd 0.14
96 TestFunctional/parallel/PersistentVolumeClaim 24.87
98 TestFunctional/parallel/SSHCmd 0.51
99 TestFunctional/parallel/CpCmd 1.86
101 TestFunctional/parallel/FileSync 0.33
102 TestFunctional/parallel/CertSync 1.99
106 TestFunctional/parallel/NodeLabels 0.08
108 TestFunctional/parallel/NonActiveRuntimeDisabled 0.68
110 TestFunctional/parallel/License 0.31
111 TestFunctional/parallel/Version/short 0.08
112 TestFunctional/parallel/Version/components 1.07
113 TestFunctional/parallel/ImageCommands/ImageListShort 0.28
114 TestFunctional/parallel/ImageCommands/ImageListTable 0.28
115 TestFunctional/parallel/ImageCommands/ImageListJson 0.25
116 TestFunctional/parallel/ImageCommands/ImageListYaml 0.27
117 TestFunctional/parallel/ImageCommands/ImageBuild 5.74
118 TestFunctional/parallel/ImageCommands/Setup 0.85
119 TestFunctional/parallel/UpdateContextCmd/no_changes 0.21
120 TestFunctional/parallel/UpdateContextCmd/no_minikube_cluster 0.23
121 TestFunctional/parallel/UpdateContextCmd/no_clusters 0.21
122 TestFunctional/parallel/ImageCommands/ImageLoadDaemon 1.61
123 TestFunctional/parallel/ImageCommands/ImageReloadDaemon 1.07
124 TestFunctional/parallel/ServiceCmd/DeployApp 10.31
125 TestFunctional/parallel/ImageCommands/ImageTagAndLoadDaemon 1.54
126 TestFunctional/parallel/ImageCommands/ImageSaveToFile 1.88
127 TestFunctional/parallel/ImageCommands/ImageRemove 0.55
128 TestFunctional/parallel/ImageCommands/ImageLoadFromFile 0.8
129 TestFunctional/parallel/ImageCommands/ImageSaveDaemon 0.58
131 TestFunctional/parallel/TunnelCmd/serial/RunSecondTunnel 0.47
132 TestFunctional/parallel/TunnelCmd/serial/StartTunnel 0
134 TestFunctional/parallel/TunnelCmd/serial/WaitService/Setup 9.33
135 TestFunctional/parallel/ServiceCmd/List 0.33
136 TestFunctional/parallel/ServiceCmd/JSONOutput 0.34
137 TestFunctional/parallel/ServiceCmd/HTTPS 0.37
138 TestFunctional/parallel/ServiceCmd/Format 0.35
139 TestFunctional/parallel/ServiceCmd/URL 0.34
140 TestFunctional/parallel/TunnelCmd/serial/WaitService/IngressIP 0.08
141 TestFunctional/parallel/TunnelCmd/serial/AccessDirect 0
145 TestFunctional/parallel/TunnelCmd/serial/DeleteTunnel 0.11
146 TestFunctional/parallel/ProfileCmd/profile_not_create 0.41
147 TestFunctional/parallel/ProfileCmd/profile_list 0.37
148 TestFunctional/parallel/ProfileCmd/profile_json_output 0.38
149 TestFunctional/parallel/MountCmd/any-port 8.55
150 TestFunctional/parallel/MountCmd/specific-port 1.99
151 TestFunctional/parallel/MountCmd/VerifyCleanup 2.13
152 TestFunctional/delete_echo-server_images 0.03
153 TestFunctional/delete_my-image_image 0.01
154 TestFunctional/delete_minikube_cached_images 0.01
158 TestMultiControlPlane/serial/StartCluster 165.89
159 TestMultiControlPlane/serial/DeployApp 7.97
160 TestMultiControlPlane/serial/PingHostFromPods 1.59
161 TestMultiControlPlane/serial/AddWorkerNode 63.19
162 TestMultiControlPlane/serial/NodeLabels 0.11
163 TestMultiControlPlane/serial/HAppyAfterClusterStart 0.95
164 TestMultiControlPlane/serial/CopyFile 17.72
165 TestMultiControlPlane/serial/StopSecondaryNode 12.7
166 TestMultiControlPlane/serial/DegradedAfterControlPlaneNodeStop 0.72
167 TestMultiControlPlane/serial/RestartSecondaryNode 23.51
168 TestMultiControlPlane/serial/HAppyAfterSecondaryNodeRestart 1.29
169 TestMultiControlPlane/serial/RestartClusterKeepsNodes 190.46
170 TestMultiControlPlane/serial/DeleteSecondaryNode 12.36
171 TestMultiControlPlane/serial/DegradedAfterSecondaryNodeDelete 0.71
172 TestMultiControlPlane/serial/StopCluster 35.79
173 TestMultiControlPlane/serial/RestartCluster 109.57
174 TestMultiControlPlane/serial/DegradedAfterClusterRestart 0.71
175 TestMultiControlPlane/serial/AddSecondaryNode 69.9
176 TestMultiControlPlane/serial/HAppyAfterSecondaryNodeAdd 0.94
180 TestJSONOutput/start/Command 76.17
181 TestJSONOutput/start/Audit 0
183 TestJSONOutput/start/parallel/DistinctCurrentSteps 0
184 TestJSONOutput/start/parallel/IncreasingCurrentSteps 0
186 TestJSONOutput/pause/Command 0.74
187 TestJSONOutput/pause/Audit 0
189 TestJSONOutput/pause/parallel/DistinctCurrentSteps 0
190 TestJSONOutput/pause/parallel/IncreasingCurrentSteps 0
192 TestJSONOutput/unpause/Command 0.65
193 TestJSONOutput/unpause/Audit 0
195 TestJSONOutput/unpause/parallel/DistinctCurrentSteps 0
196 TestJSONOutput/unpause/parallel/IncreasingCurrentSteps 0
198 TestJSONOutput/stop/Command 5.9
199 TestJSONOutput/stop/Audit 0
201 TestJSONOutput/stop/parallel/DistinctCurrentSteps 0
202 TestJSONOutput/stop/parallel/IncreasingCurrentSteps 0
203 TestErrorJSONOutput 0.21
205 TestKicCustomNetwork/create_custom_network 38.56
206 TestKicCustomNetwork/use_default_bridge_network 35.02
207 TestKicExistingNetwork 33.14
208 TestKicCustomSubnet 36.81
209 TestKicStaticIP 31.78
210 TestMainNoArgs 0.05
211 TestMinikubeProfile 72.78
214 TestMountStart/serial/StartWithMountFirst 7.13
215 TestMountStart/serial/VerifyMountFirst 0.25
216 TestMountStart/serial/StartWithMountSecond 6.6
217 TestMountStart/serial/VerifyMountSecond 0.25
218 TestMountStart/serial/DeleteFirst 1.62
219 TestMountStart/serial/VerifyMountPostDelete 0.25
220 TestMountStart/serial/Stop 1.21
221 TestMountStart/serial/RestartStopped 7.99
222 TestMountStart/serial/VerifyMountPostStop 0.26
225 TestMultiNode/serial/FreshStart2Nodes 78.85
226 TestMultiNode/serial/DeployApp2Nodes 7.11
227 TestMultiNode/serial/PingHostFrom2Pods 0.92
228 TestMultiNode/serial/AddNode 57.22
229 TestMultiNode/serial/MultiNodeLabels 0.09
230 TestMultiNode/serial/ProfileList 0.65
231 TestMultiNode/serial/CopyFile 9.4
232 TestMultiNode/serial/StopNode 2.24
233 TestMultiNode/serial/StartAfterStop 9.62
234 TestMultiNode/serial/RestartKeepsNodes 81.06
235 TestMultiNode/serial/DeleteNode 5.2
236 TestMultiNode/serial/StopMultiNode 23.79
237 TestMultiNode/serial/RestartMultiNode 52.35
238 TestMultiNode/serial/ValidateNameConflict 31.74
243 TestPreload 128.06
245 TestScheduledStopUnix 107.89
248 TestInsufficientStorage 12.79
249 TestRunningBinaryUpgrade 61.78
251 TestKubernetesUpgrade 392.23
252 TestMissingContainerUpgrade 153.38
254 TestNoKubernetes/serial/StartNoK8sWithVersion 0.08
255 TestNoKubernetes/serial/StartWithK8s 38.69
256 TestNoKubernetes/serial/StartWithStopK8s 19.34
257 TestNoKubernetes/serial/Start 9.28
258 TestNoKubernetes/serial/VerifyK8sNotRunning 0.32
259 TestNoKubernetes/serial/ProfileList 8.89
260 TestNoKubernetes/serial/Stop 1.3
261 TestNoKubernetes/serial/StartNoArgs 6.96
262 TestNoKubernetes/serial/VerifyK8sNotRunningSecond 0.25
263 TestStoppedBinaryUpgrade/Setup 0.82
264 TestStoppedBinaryUpgrade/Upgrade 73.14
265 TestStoppedBinaryUpgrade/MinikubeLogs 1.04
274 TestPause/serial/Start 79.22
275 TestPause/serial/SecondStartNoReconfiguration 27.25
276 TestPause/serial/Pause 0.81
277 TestPause/serial/VerifyStatus 0.39
278 TestPause/serial/Unpause 0.75
279 TestPause/serial/PauseAgain 0.86
280 TestPause/serial/DeletePaused 2.65
281 TestPause/serial/VerifyDeletedResources 0.35
289 TestNetworkPlugins/group/false 3.7
294 TestStartStop/group/old-k8s-version/serial/FirstStart 128.54
295 TestStartStop/group/old-k8s-version/serial/DeployApp 11.57
296 TestStartStop/group/old-k8s-version/serial/EnableAddonWhileActive 1
297 TestStartStop/group/old-k8s-version/serial/Stop 12
298 TestStartStop/group/old-k8s-version/serial/EnableAddonAfterStop 0.2
299 TestStartStop/group/old-k8s-version/serial/SecondStart 133.83
301 TestStartStop/group/no-preload/serial/FirstStart 66.05
302 TestStartStop/group/no-preload/serial/DeployApp 10.42
303 TestStartStop/group/no-preload/serial/EnableAddonWhileActive 1.09
304 TestStartStop/group/old-k8s-version/serial/UserAppExistsAfterStop 6.01
305 TestStartStop/group/no-preload/serial/Stop 11.95
306 TestStartStop/group/old-k8s-version/serial/AddonExistsAfterStop 5.1
307 TestStartStop/group/old-k8s-version/serial/VerifyKubernetesImages 0.23
308 TestStartStop/group/old-k8s-version/serial/Pause 3.3
309 TestStartStop/group/no-preload/serial/EnableAddonAfterStop 0.25
310 TestStartStop/group/no-preload/serial/SecondStart 304.73
312 TestStartStop/group/embed-certs/serial/FirstStart 56.82
313 TestStartStop/group/embed-certs/serial/DeployApp 10.32
314 TestStartStop/group/embed-certs/serial/EnableAddonWhileActive 1.08
315 TestStartStop/group/embed-certs/serial/Stop 11.99
316 TestStartStop/group/embed-certs/serial/EnableAddonAfterStop 0.21
317 TestStartStop/group/embed-certs/serial/SecondStart 267.99
318 TestStartStop/group/no-preload/serial/UserAppExistsAfterStop 6
319 TestStartStop/group/no-preload/serial/AddonExistsAfterStop 6.1
320 TestStartStop/group/no-preload/serial/VerifyKubernetesImages 0.24
321 TestStartStop/group/no-preload/serial/Pause 2.9
323 TestStartStop/group/default-k8s-diff-port/serial/FirstStart 83.83
324 TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop 6.01
325 TestStartStop/group/embed-certs/serial/AddonExistsAfterStop 5.1
326 TestStartStop/group/embed-certs/serial/VerifyKubernetesImages 0.23
327 TestStartStop/group/embed-certs/serial/Pause 2.91
329 TestStartStop/group/newest-cni/serial/FirstStart 35.86
330 TestStartStop/group/newest-cni/serial/DeployApp 0
331 TestStartStop/group/newest-cni/serial/EnableAddonWhileActive 1.23
332 TestStartStop/group/default-k8s-diff-port/serial/DeployApp 10.56
333 TestStartStop/group/newest-cni/serial/Stop 1.32
334 TestStartStop/group/newest-cni/serial/EnableAddonAfterStop 0.18
335 TestStartStop/group/newest-cni/serial/SecondStart 16.21
336 TestStartStop/group/default-k8s-diff-port/serial/EnableAddonWhileActive 1.81
337 TestStartStop/group/default-k8s-diff-port/serial/Stop 12.48
338 TestStartStop/group/newest-cni/serial/UserAppExistsAfterStop 0
339 TestStartStop/group/newest-cni/serial/AddonExistsAfterStop 0
340 TestStartStop/group/newest-cni/serial/VerifyKubernetesImages 0.23
341 TestStartStop/group/newest-cni/serial/Pause 2.82
342 TestNetworkPlugins/group/auto/Start 88.67
343 TestStartStop/group/default-k8s-diff-port/serial/EnableAddonAfterStop 0.2
344 TestStartStop/group/default-k8s-diff-port/serial/SecondStart 282.19
345 TestNetworkPlugins/group/auto/KubeletFlags 0.28
346 TestNetworkPlugins/group/auto/NetCatPod 10.29
347 TestNetworkPlugins/group/auto/DNS 0.16
348 TestNetworkPlugins/group/auto/Localhost 0.14
349 TestNetworkPlugins/group/auto/HairPin 0.19
350 TestNetworkPlugins/group/kindnet/Start 77.81
351 TestNetworkPlugins/group/kindnet/ControllerPod 6.01
352 TestNetworkPlugins/group/kindnet/KubeletFlags 0.27
353 TestNetworkPlugins/group/kindnet/NetCatPod 10.26
354 TestNetworkPlugins/group/kindnet/DNS 0.17
355 TestNetworkPlugins/group/kindnet/Localhost 0.16
356 TestNetworkPlugins/group/kindnet/HairPin 0.14
357 TestNetworkPlugins/group/calico/Start 61.34
358 TestStartStop/group/default-k8s-diff-port/serial/UserAppExistsAfterStop 6.01
359 TestStartStop/group/default-k8s-diff-port/serial/AddonExistsAfterStop 5.09
360 TestNetworkPlugins/group/calico/ControllerPod 6.01
361 TestStartStop/group/default-k8s-diff-port/serial/VerifyKubernetesImages 0.23
362 TestStartStop/group/default-k8s-diff-port/serial/Pause 2.91
363 TestNetworkPlugins/group/calico/KubeletFlags 0.34
364 TestNetworkPlugins/group/custom-flannel/Start 62
365 TestNetworkPlugins/group/calico/NetCatPod 14.39
366 TestNetworkPlugins/group/calico/DNS 0.25
367 TestNetworkPlugins/group/calico/Localhost 0.19
368 TestNetworkPlugins/group/calico/HairPin 0.2
369 TestNetworkPlugins/group/enable-default-cni/Start 76.75
370 TestNetworkPlugins/group/custom-flannel/KubeletFlags 0.34
371 TestNetworkPlugins/group/custom-flannel/NetCatPod 12.34
372 TestNetworkPlugins/group/custom-flannel/DNS 0.2
373 TestNetworkPlugins/group/custom-flannel/Localhost 0.16
374 TestNetworkPlugins/group/custom-flannel/HairPin 0.16
375 TestNetworkPlugins/group/flannel/Start 55.23
376 TestNetworkPlugins/group/enable-default-cni/KubeletFlags 0.32
377 TestNetworkPlugins/group/enable-default-cni/NetCatPod 13.35
378 TestNetworkPlugins/group/enable-default-cni/DNS 0.28
379 TestNetworkPlugins/group/enable-default-cni/Localhost 0.23
380 TestNetworkPlugins/group/enable-default-cni/HairPin 0.26
381 TestNetworkPlugins/group/bridge/Start 77.45
382 TestNetworkPlugins/group/flannel/ControllerPod 6.01
383 TestNetworkPlugins/group/flannel/KubeletFlags 0.38
384 TestNetworkPlugins/group/flannel/NetCatPod 11.32
385 TestNetworkPlugins/group/flannel/DNS 0.23
386 TestNetworkPlugins/group/flannel/Localhost 0.17
387 TestNetworkPlugins/group/flannel/HairPin 0.18
388 TestNetworkPlugins/group/bridge/KubeletFlags 0.27
389 TestNetworkPlugins/group/bridge/NetCatPod 11.25
390 TestNetworkPlugins/group/bridge/DNS 0.16
391 TestNetworkPlugins/group/bridge/Localhost 0.14
392 TestNetworkPlugins/group/bridge/HairPin 0.15
x
+
TestDownloadOnly/v1.20.0/json-events (12.63s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.20.0/json-events
aaa_download_only_test.go:81: (dbg) Run:  out/minikube-linux-arm64 start -o=json --download-only -p download-only-927064 --force --alsologtostderr --kubernetes-version=v1.20.0 --container-runtime=crio --driver=docker  --container-runtime=crio
aaa_download_only_test.go:81: (dbg) Done: out/minikube-linux-arm64 start -o=json --download-only -p download-only-927064 --force --alsologtostderr --kubernetes-version=v1.20.0 --container-runtime=crio --driver=docker  --container-runtime=crio: (12.624937836s)
--- PASS: TestDownloadOnly/v1.20.0/json-events (12.63s)

                                                
                                    
x
+
TestDownloadOnly/v1.20.0/preload-exists (0s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.20.0/preload-exists
I0924 00:35:20.717332 1873600 preload.go:131] Checking if preload exists for k8s version v1.20.0 and runtime crio
I0924 00:35:20.717424 1873600 preload.go:146] Found local preload: /home/jenkins/minikube-integration/19696-1868219/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-cri-o-overlay-arm64.tar.lz4
--- PASS: TestDownloadOnly/v1.20.0/preload-exists (0.00s)

                                                
                                    
x
+
TestDownloadOnly/v1.20.0/LogsDuration (0.08s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.20.0/LogsDuration
aaa_download_only_test.go:184: (dbg) Run:  out/minikube-linux-arm64 logs -p download-only-927064
aaa_download_only_test.go:184: (dbg) Non-zero exit: out/minikube-linux-arm64 logs -p download-only-927064: exit status 85 (76.827409ms)

                                                
                                                
-- stdout --
	
	==> Audit <==
	|---------|--------------------------------|----------------------|---------|---------|---------------------|----------|
	| Command |              Args              |       Profile        |  User   | Version |     Start Time      | End Time |
	|---------|--------------------------------|----------------------|---------|---------|---------------------|----------|
	| start   | -o=json --download-only        | download-only-927064 | jenkins | v1.34.0 | 24 Sep 24 00:35 UTC |          |
	|         | -p download-only-927064        |                      |         |         |                     |          |
	|         | --force --alsologtostderr      |                      |         |         |                     |          |
	|         | --kubernetes-version=v1.20.0   |                      |         |         |                     |          |
	|         | --container-runtime=crio       |                      |         |         |                     |          |
	|         | --driver=docker                |                      |         |         |                     |          |
	|         | --container-runtime=crio       |                      |         |         |                     |          |
	|---------|--------------------------------|----------------------|---------|---------|---------------------|----------|
	
	
	==> Last Start <==
	Log file created at: 2024/09/24 00:35:08
	Running on machine: ip-172-31-21-244
	Binary: Built with gc go1.23.0 for linux/arm64
	Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg
	I0924 00:35:08.136705 1873605 out.go:345] Setting OutFile to fd 1 ...
	I0924 00:35:08.136839 1873605 out.go:392] TERM=,COLORTERM=, which probably does not support color
	I0924 00:35:08.136850 1873605 out.go:358] Setting ErrFile to fd 2...
	I0924 00:35:08.136855 1873605 out.go:392] TERM=,COLORTERM=, which probably does not support color
	I0924 00:35:08.137120 1873605 root.go:338] Updating PATH: /home/jenkins/minikube-integration/19696-1868219/.minikube/bin
	W0924 00:35:08.137252 1873605 root.go:314] Error reading config file at /home/jenkins/minikube-integration/19696-1868219/.minikube/config/config.json: open /home/jenkins/minikube-integration/19696-1868219/.minikube/config/config.json: no such file or directory
	I0924 00:35:08.137697 1873605 out.go:352] Setting JSON to true
	I0924 00:35:08.138615 1873605 start.go:129] hostinfo: {"hostname":"ip-172-31-21-244","uptime":29858,"bootTime":1727108250,"procs":157,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1070-aws","kernelArch":"aarch64","virtualizationSystem":"","virtualizationRole":"","hostId":"da8ac1fd-6236-412a-a346-95873c98230d"}
	I0924 00:35:08.138690 1873605 start.go:139] virtualization:  
	I0924 00:35:08.142567 1873605 out.go:97] [download-only-927064] minikube v1.34.0 on Ubuntu 20.04 (arm64)
	W0924 00:35:08.142744 1873605 preload.go:293] Failed to list preload files: open /home/jenkins/minikube-integration/19696-1868219/.minikube/cache/preloaded-tarball: no such file or directory
	I0924 00:35:08.142807 1873605 notify.go:220] Checking for updates...
	I0924 00:35:08.145440 1873605 out.go:169] MINIKUBE_LOCATION=19696
	I0924 00:35:08.148429 1873605 out.go:169] MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I0924 00:35:08.151116 1873605 out.go:169] KUBECONFIG=/home/jenkins/minikube-integration/19696-1868219/kubeconfig
	I0924 00:35:08.153696 1873605 out.go:169] MINIKUBE_HOME=/home/jenkins/minikube-integration/19696-1868219/.minikube
	I0924 00:35:08.156225 1873605 out.go:169] MINIKUBE_BIN=out/minikube-linux-arm64
	W0924 00:35:08.161360 1873605 out.go:321] minikube skips various validations when --force is supplied; this may lead to unexpected behavior
	I0924 00:35:08.161590 1873605 driver.go:394] Setting default libvirt URI to qemu:///system
	I0924 00:35:08.184044 1873605 docker.go:123] docker version: linux-27.3.1:Docker Engine - Community
	I0924 00:35:08.184154 1873605 cli_runner.go:164] Run: docker system info --format "{{json .}}"
	I0924 00:35:08.245611 1873605 info.go:266] docker info: {ID:5FDH:SA5P:5GCT:NLAS:B73P:SGDQ:PBG5:UBVH:UZY3:RXGO:CI7S:WAIH Containers:0 ContainersRunning:0 ContainersPaused:0 ContainersStopped:0 Images:1 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:false BridgeNfIP6Tables:false Debug:false NFd:29 OomKillDisable:true NGoroutines:52 SystemTime:2024-09-24 00:35:08.23601234 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1070-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Architecture:aa
rch64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8214831104 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-21-244 Labels:[] ExperimentalBuild:false ServerVersion:27.3.1 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:7f7fdf5fed64eb6a7caf99b3e12efcf9d60e311c Expected:7f7fdf5fed64eb6a7caf99b3e12efcf9d60e311c} RuncCommit:{ID:v1.1.14-0-g2c9f560 Expected:v1.1.14-0-g2c9f560} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:[WARNING: bridg
e-nf-call-iptables is disabled WARNING: bridge-nf-call-ip6tables is disabled] ServerErrors:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.17.1] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.29.7]] Warnings:<nil>}}
	I0924 00:35:08.245718 1873605 docker.go:318] overlay module found
	I0924 00:35:08.248498 1873605 out.go:97] Using the docker driver based on user configuration
	I0924 00:35:08.248526 1873605 start.go:297] selected driver: docker
	I0924 00:35:08.248533 1873605 start.go:901] validating driver "docker" against <nil>
	I0924 00:35:08.248630 1873605 cli_runner.go:164] Run: docker system info --format "{{json .}}"
	I0924 00:35:08.292322 1873605 info.go:266] docker info: {ID:5FDH:SA5P:5GCT:NLAS:B73P:SGDQ:PBG5:UBVH:UZY3:RXGO:CI7S:WAIH Containers:0 ContainersRunning:0 ContainersPaused:0 ContainersStopped:0 Images:1 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:false BridgeNfIP6Tables:false Debug:false NFd:29 OomKillDisable:true NGoroutines:52 SystemTime:2024-09-24 00:35:08.283337497 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1070-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Architecture:a
arch64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8214831104 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-21-244 Labels:[] ExperimentalBuild:false ServerVersion:27.3.1 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:7f7fdf5fed64eb6a7caf99b3e12efcf9d60e311c Expected:7f7fdf5fed64eb6a7caf99b3e12efcf9d60e311c} RuncCommit:{ID:v1.1.14-0-g2c9f560 Expected:v1.1.14-0-g2c9f560} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:[WARNING: brid
ge-nf-call-iptables is disabled WARNING: bridge-nf-call-ip6tables is disabled] ServerErrors:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.17.1] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.29.7]] Warnings:<nil>}}
	I0924 00:35:08.292539 1873605 start_flags.go:310] no existing cluster config was found, will generate one from the flags 
	I0924 00:35:08.292791 1873605 start_flags.go:393] Using suggested 2200MB memory alloc based on sys=7834MB, container=7834MB
	I0924 00:35:08.292948 1873605 start_flags.go:929] Wait components to verify : map[apiserver:true system_pods:true]
	I0924 00:35:08.295710 1873605 out.go:169] Using Docker driver with root privileges
	I0924 00:35:08.298296 1873605 cni.go:84] Creating CNI manager for ""
	I0924 00:35:08.298352 1873605 cni.go:143] "docker" driver + "crio" runtime found, recommending kindnet
	I0924 00:35:08.298366 1873605 start_flags.go:319] Found "CNI" CNI - setting NetworkPlugin=cni
	I0924 00:35:08.298451 1873605 start.go:340] cluster config:
	{Name:download-only-927064 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1727108449-19696@sha256:c662152d8855bc4c62a3b5786a68adf99e04794e7f8f374a3859703004ef1d21 Memory:2200 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:download-only-927064 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local Co
ntainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I0924 00:35:08.301151 1873605 out.go:97] Starting "download-only-927064" primary control-plane node in "download-only-927064" cluster
	I0924 00:35:08.301174 1873605 cache.go:121] Beginning downloading kic base image for docker with crio
	I0924 00:35:08.303735 1873605 out.go:97] Pulling base image v0.0.45-1727108449-19696 ...
	I0924 00:35:08.303766 1873605 preload.go:131] Checking if preload exists for k8s version v1.20.0 and runtime crio
	I0924 00:35:08.303869 1873605 image.go:79] Checking for gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1727108449-19696@sha256:c662152d8855bc4c62a3b5786a68adf99e04794e7f8f374a3859703004ef1d21 in local docker daemon
	I0924 00:35:08.319706 1873605 cache.go:149] Downloading gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1727108449-19696@sha256:c662152d8855bc4c62a3b5786a68adf99e04794e7f8f374a3859703004ef1d21 to local cache
	I0924 00:35:08.319893 1873605 image.go:63] Checking for gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1727108449-19696@sha256:c662152d8855bc4c62a3b5786a68adf99e04794e7f8f374a3859703004ef1d21 in local cache directory
	I0924 00:35:08.320010 1873605 image.go:148] Writing gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1727108449-19696@sha256:c662152d8855bc4c62a3b5786a68adf99e04794e7f8f374a3859703004ef1d21 to local cache
	I0924 00:35:08.393912 1873605 preload.go:118] Found remote preload: https://storage.googleapis.com/minikube-preloaded-volume-tarballs/v18/v1.20.0/preloaded-images-k8s-v18-v1.20.0-cri-o-overlay-arm64.tar.lz4
	I0924 00:35:08.393939 1873605 cache.go:56] Caching tarball of preloaded images
	I0924 00:35:08.394093 1873605 preload.go:131] Checking if preload exists for k8s version v1.20.0 and runtime crio
	I0924 00:35:08.397159 1873605 out.go:97] Downloading Kubernetes v1.20.0 preload ...
	I0924 00:35:08.397186 1873605 preload.go:236] getting checksum for preloaded-images-k8s-v18-v1.20.0-cri-o-overlay-arm64.tar.lz4 ...
	I0924 00:35:08.481991 1873605 download.go:107] Downloading: https://storage.googleapis.com/minikube-preloaded-volume-tarballs/v18/v1.20.0/preloaded-images-k8s-v18-v1.20.0-cri-o-overlay-arm64.tar.lz4?checksum=md5:59cd2ef07b53f039bfd1761b921f2a02 -> /home/jenkins/minikube-integration/19696-1868219/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-cri-o-overlay-arm64.tar.lz4
	
	
	* The control-plane node download-only-927064 host does not exist
	  To start a cluster, run: "minikube start -p download-only-927064"

                                                
                                                
-- /stdout --
aaa_download_only_test.go:185: minikube logs failed with error: exit status 85
--- PASS: TestDownloadOnly/v1.20.0/LogsDuration (0.08s)

                                                
                                    
x
+
TestDownloadOnly/v1.20.0/DeleteAll (0.21s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.20.0/DeleteAll
aaa_download_only_test.go:197: (dbg) Run:  out/minikube-linux-arm64 delete --all
--- PASS: TestDownloadOnly/v1.20.0/DeleteAll (0.21s)

                                                
                                    
x
+
TestDownloadOnly/v1.20.0/DeleteAlwaysSucceeds (0.15s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.20.0/DeleteAlwaysSucceeds
aaa_download_only_test.go:208: (dbg) Run:  out/minikube-linux-arm64 delete -p download-only-927064
--- PASS: TestDownloadOnly/v1.20.0/DeleteAlwaysSucceeds (0.15s)

                                                
                                    
x
+
TestDownloadOnly/v1.31.1/json-events (8.04s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.31.1/json-events
aaa_download_only_test.go:81: (dbg) Run:  out/minikube-linux-arm64 start -o=json --download-only -p download-only-684560 --force --alsologtostderr --kubernetes-version=v1.31.1 --container-runtime=crio --driver=docker  --container-runtime=crio
aaa_download_only_test.go:81: (dbg) Done: out/minikube-linux-arm64 start -o=json --download-only -p download-only-684560 --force --alsologtostderr --kubernetes-version=v1.31.1 --container-runtime=crio --driver=docker  --container-runtime=crio: (8.038882147s)
--- PASS: TestDownloadOnly/v1.31.1/json-events (8.04s)

                                                
                                    
x
+
TestDownloadOnly/v1.31.1/preload-exists (0s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.31.1/preload-exists
I0924 00:35:29.186896 1873600 preload.go:131] Checking if preload exists for k8s version v1.31.1 and runtime crio
I0924 00:35:29.186934 1873600 preload.go:146] Found local preload: /home/jenkins/minikube-integration/19696-1868219/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.1-cri-o-overlay-arm64.tar.lz4
--- PASS: TestDownloadOnly/v1.31.1/preload-exists (0.00s)

                                                
                                    
x
+
TestDownloadOnly/v1.31.1/LogsDuration (0.08s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.31.1/LogsDuration
aaa_download_only_test.go:184: (dbg) Run:  out/minikube-linux-arm64 logs -p download-only-684560
aaa_download_only_test.go:184: (dbg) Non-zero exit: out/minikube-linux-arm64 logs -p download-only-684560: exit status 85 (80.914167ms)

                                                
                                                
-- stdout --
	
	==> Audit <==
	|---------|--------------------------------|----------------------|---------|---------|---------------------|---------------------|
	| Command |              Args              |       Profile        |  User   | Version |     Start Time      |      End Time       |
	|---------|--------------------------------|----------------------|---------|---------|---------------------|---------------------|
	| start   | -o=json --download-only        | download-only-927064 | jenkins | v1.34.0 | 24 Sep 24 00:35 UTC |                     |
	|         | -p download-only-927064        |                      |         |         |                     |                     |
	|         | --force --alsologtostderr      |                      |         |         |                     |                     |
	|         | --kubernetes-version=v1.20.0   |                      |         |         |                     |                     |
	|         | --container-runtime=crio       |                      |         |         |                     |                     |
	|         | --driver=docker                |                      |         |         |                     |                     |
	|         | --container-runtime=crio       |                      |         |         |                     |                     |
	| delete  | --all                          | minikube             | jenkins | v1.34.0 | 24 Sep 24 00:35 UTC | 24 Sep 24 00:35 UTC |
	| delete  | -p download-only-927064        | download-only-927064 | jenkins | v1.34.0 | 24 Sep 24 00:35 UTC | 24 Sep 24 00:35 UTC |
	| start   | -o=json --download-only        | download-only-684560 | jenkins | v1.34.0 | 24 Sep 24 00:35 UTC |                     |
	|         | -p download-only-684560        |                      |         |         |                     |                     |
	|         | --force --alsologtostderr      |                      |         |         |                     |                     |
	|         | --kubernetes-version=v1.31.1   |                      |         |         |                     |                     |
	|         | --container-runtime=crio       |                      |         |         |                     |                     |
	|         | --driver=docker                |                      |         |         |                     |                     |
	|         | --container-runtime=crio       |                      |         |         |                     |                     |
	|---------|--------------------------------|----------------------|---------|---------|---------------------|---------------------|
	
	
	==> Last Start <==
	Log file created at: 2024/09/24 00:35:21
	Running on machine: ip-172-31-21-244
	Binary: Built with gc go1.23.0 for linux/arm64
	Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg
	I0924 00:35:21.195340 1873810 out.go:345] Setting OutFile to fd 1 ...
	I0924 00:35:21.195455 1873810 out.go:392] TERM=,COLORTERM=, which probably does not support color
	I0924 00:35:21.195463 1873810 out.go:358] Setting ErrFile to fd 2...
	I0924 00:35:21.195470 1873810 out.go:392] TERM=,COLORTERM=, which probably does not support color
	I0924 00:35:21.195724 1873810 root.go:338] Updating PATH: /home/jenkins/minikube-integration/19696-1868219/.minikube/bin
	I0924 00:35:21.196134 1873810 out.go:352] Setting JSON to true
	I0924 00:35:21.197070 1873810 start.go:129] hostinfo: {"hostname":"ip-172-31-21-244","uptime":29871,"bootTime":1727108250,"procs":155,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1070-aws","kernelArch":"aarch64","virtualizationSystem":"","virtualizationRole":"","hostId":"da8ac1fd-6236-412a-a346-95873c98230d"}
	I0924 00:35:21.197154 1873810 start.go:139] virtualization:  
	I0924 00:35:21.200390 1873810 out.go:97] [download-only-684560] minikube v1.34.0 on Ubuntu 20.04 (arm64)
	I0924 00:35:21.200598 1873810 notify.go:220] Checking for updates...
	I0924 00:35:21.203310 1873810 out.go:169] MINIKUBE_LOCATION=19696
	I0924 00:35:21.206201 1873810 out.go:169] MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I0924 00:35:21.208876 1873810 out.go:169] KUBECONFIG=/home/jenkins/minikube-integration/19696-1868219/kubeconfig
	I0924 00:35:21.211506 1873810 out.go:169] MINIKUBE_HOME=/home/jenkins/minikube-integration/19696-1868219/.minikube
	I0924 00:35:21.214084 1873810 out.go:169] MINIKUBE_BIN=out/minikube-linux-arm64
	W0924 00:35:21.219300 1873810 out.go:321] minikube skips various validations when --force is supplied; this may lead to unexpected behavior
	I0924 00:35:21.219582 1873810 driver.go:394] Setting default libvirt URI to qemu:///system
	I0924 00:35:21.241920 1873810 docker.go:123] docker version: linux-27.3.1:Docker Engine - Community
	I0924 00:35:21.242029 1873810 cli_runner.go:164] Run: docker system info --format "{{json .}}"
	I0924 00:35:21.299165 1873810 info.go:266] docker info: {ID:5FDH:SA5P:5GCT:NLAS:B73P:SGDQ:PBG5:UBVH:UZY3:RXGO:CI7S:WAIH Containers:0 ContainersRunning:0 ContainersPaused:0 ContainersStopped:0 Images:1 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:false BridgeNfIP6Tables:false Debug:false NFd:29 OomKillDisable:true NGoroutines:44 SystemTime:2024-09-24 00:35:21.289071486 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1070-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Architecture:a
arch64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8214831104 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-21-244 Labels:[] ExperimentalBuild:false ServerVersion:27.3.1 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:7f7fdf5fed64eb6a7caf99b3e12efcf9d60e311c Expected:7f7fdf5fed64eb6a7caf99b3e12efcf9d60e311c} RuncCommit:{ID:v1.1.14-0-g2c9f560 Expected:v1.1.14-0-g2c9f560} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:[WARNING: brid
ge-nf-call-iptables is disabled WARNING: bridge-nf-call-ip6tables is disabled] ServerErrors:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.17.1] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.29.7]] Warnings:<nil>}}
	I0924 00:35:21.299273 1873810 docker.go:318] overlay module found
	I0924 00:35:21.302102 1873810 out.go:97] Using the docker driver based on user configuration
	I0924 00:35:21.302131 1873810 start.go:297] selected driver: docker
	I0924 00:35:21.302138 1873810 start.go:901] validating driver "docker" against <nil>
	I0924 00:35:21.302251 1873810 cli_runner.go:164] Run: docker system info --format "{{json .}}"
	I0924 00:35:21.358485 1873810 info.go:266] docker info: {ID:5FDH:SA5P:5GCT:NLAS:B73P:SGDQ:PBG5:UBVH:UZY3:RXGO:CI7S:WAIH Containers:0 ContainersRunning:0 ContainersPaused:0 ContainersStopped:0 Images:1 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:false BridgeNfIP6Tables:false Debug:false NFd:29 OomKillDisable:true NGoroutines:44 SystemTime:2024-09-24 00:35:21.349015322 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1070-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Architecture:a
arch64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8214831104 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-21-244 Labels:[] ExperimentalBuild:false ServerVersion:27.3.1 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:7f7fdf5fed64eb6a7caf99b3e12efcf9d60e311c Expected:7f7fdf5fed64eb6a7caf99b3e12efcf9d60e311c} RuncCommit:{ID:v1.1.14-0-g2c9f560 Expected:v1.1.14-0-g2c9f560} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:[WARNING: brid
ge-nf-call-iptables is disabled WARNING: bridge-nf-call-ip6tables is disabled] ServerErrors:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.17.1] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.29.7]] Warnings:<nil>}}
	I0924 00:35:21.358713 1873810 start_flags.go:310] no existing cluster config was found, will generate one from the flags 
	I0924 00:35:21.359021 1873810 start_flags.go:393] Using suggested 2200MB memory alloc based on sys=7834MB, container=7834MB
	I0924 00:35:21.359174 1873810 start_flags.go:929] Wait components to verify : map[apiserver:true system_pods:true]
	I0924 00:35:21.361976 1873810 out.go:169] Using Docker driver with root privileges
	I0924 00:35:21.364532 1873810 cni.go:84] Creating CNI manager for ""
	I0924 00:35:21.364595 1873810 cni.go:143] "docker" driver + "crio" runtime found, recommending kindnet
	I0924 00:35:21.364608 1873810 start_flags.go:319] Found "CNI" CNI - setting NetworkPlugin=cni
	I0924 00:35:21.364694 1873810 start.go:340] cluster config:
	{Name:download-only-684560 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1727108449-19696@sha256:c662152d8855bc4c62a3b5786a68adf99e04794e7f8f374a3859703004ef1d21 Memory:2200 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.31.1 ClusterName:download-only-684560 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local Co
ntainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.31.1 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I0924 00:35:21.367412 1873810 out.go:97] Starting "download-only-684560" primary control-plane node in "download-only-684560" cluster
	I0924 00:35:21.367439 1873810 cache.go:121] Beginning downloading kic base image for docker with crio
	I0924 00:35:21.369923 1873810 out.go:97] Pulling base image v0.0.45-1727108449-19696 ...
	I0924 00:35:21.369951 1873810 preload.go:131] Checking if preload exists for k8s version v1.31.1 and runtime crio
	I0924 00:35:21.370059 1873810 image.go:79] Checking for gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1727108449-19696@sha256:c662152d8855bc4c62a3b5786a68adf99e04794e7f8f374a3859703004ef1d21 in local docker daemon
	I0924 00:35:21.383634 1873810 cache.go:149] Downloading gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1727108449-19696@sha256:c662152d8855bc4c62a3b5786a68adf99e04794e7f8f374a3859703004ef1d21 to local cache
	I0924 00:35:21.383743 1873810 image.go:63] Checking for gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1727108449-19696@sha256:c662152d8855bc4c62a3b5786a68adf99e04794e7f8f374a3859703004ef1d21 in local cache directory
	I0924 00:35:21.383762 1873810 image.go:66] Found gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1727108449-19696@sha256:c662152d8855bc4c62a3b5786a68adf99e04794e7f8f374a3859703004ef1d21 in local cache directory, skipping pull
	I0924 00:35:21.383767 1873810 image.go:135] gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1727108449-19696@sha256:c662152d8855bc4c62a3b5786a68adf99e04794e7f8f374a3859703004ef1d21 exists in cache, skipping pull
	I0924 00:35:21.383774 1873810 cache.go:152] successfully saved gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1727108449-19696@sha256:c662152d8855bc4c62a3b5786a68adf99e04794e7f8f374a3859703004ef1d21 as a tarball
	I0924 00:35:21.441197 1873810 preload.go:118] Found remote preload: https://storage.googleapis.com/minikube-preloaded-volume-tarballs/v18/v1.31.1/preloaded-images-k8s-v18-v1.31.1-cri-o-overlay-arm64.tar.lz4
	I0924 00:35:21.441227 1873810 cache.go:56] Caching tarball of preloaded images
	I0924 00:35:21.441396 1873810 preload.go:131] Checking if preload exists for k8s version v1.31.1 and runtime crio
	I0924 00:35:21.444236 1873810 out.go:97] Downloading Kubernetes v1.31.1 preload ...
	I0924 00:35:21.444263 1873810 preload.go:236] getting checksum for preloaded-images-k8s-v18-v1.31.1-cri-o-overlay-arm64.tar.lz4 ...
	I0924 00:35:21.530357 1873810 download.go:107] Downloading: https://storage.googleapis.com/minikube-preloaded-volume-tarballs/v18/v1.31.1/preloaded-images-k8s-v18-v1.31.1-cri-o-overlay-arm64.tar.lz4?checksum=md5:8285fc512c7462f100de137f91fcd0ae -> /home/jenkins/minikube-integration/19696-1868219/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.1-cri-o-overlay-arm64.tar.lz4
	
	
	* The control-plane node download-only-684560 host does not exist
	  To start a cluster, run: "minikube start -p download-only-684560"

                                                
                                                
-- /stdout --
aaa_download_only_test.go:185: minikube logs failed with error: exit status 85
--- PASS: TestDownloadOnly/v1.31.1/LogsDuration (0.08s)

                                                
                                    
x
+
TestDownloadOnly/v1.31.1/DeleteAll (0.2s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.31.1/DeleteAll
aaa_download_only_test.go:197: (dbg) Run:  out/minikube-linux-arm64 delete --all
--- PASS: TestDownloadOnly/v1.31.1/DeleteAll (0.20s)

                                                
                                    
x
+
TestDownloadOnly/v1.31.1/DeleteAlwaysSucceeds (0.13s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.31.1/DeleteAlwaysSucceeds
aaa_download_only_test.go:208: (dbg) Run:  out/minikube-linux-arm64 delete -p download-only-684560
--- PASS: TestDownloadOnly/v1.31.1/DeleteAlwaysSucceeds (0.13s)

                                                
                                    
x
+
TestBinaryMirror (0.58s)

                                                
                                                
=== RUN   TestBinaryMirror
I0924 00:35:30.411837 1873600 binary.go:74] Not caching binary, using https://dl.k8s.io/release/v1.31.1/bin/linux/arm64/kubectl?checksum=file:https://dl.k8s.io/release/v1.31.1/bin/linux/arm64/kubectl.sha256
aaa_download_only_test.go:314: (dbg) Run:  out/minikube-linux-arm64 start --download-only -p binary-mirror-425965 --alsologtostderr --binary-mirror http://127.0.0.1:41845 --driver=docker  --container-runtime=crio
helpers_test.go:175: Cleaning up "binary-mirror-425965" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-arm64 delete -p binary-mirror-425965
--- PASS: TestBinaryMirror (0.58s)

                                                
                                    
x
+
TestAddons/PreSetup/EnablingAddonOnNonExistingCluster (0.07s)

                                                
                                                
=== RUN   TestAddons/PreSetup/EnablingAddonOnNonExistingCluster
=== PAUSE TestAddons/PreSetup/EnablingAddonOnNonExistingCluster

                                                
                                                

                                                
                                                
=== CONT  TestAddons/PreSetup/EnablingAddonOnNonExistingCluster
addons_test.go:975: (dbg) Run:  out/minikube-linux-arm64 addons enable dashboard -p addons-371349
addons_test.go:975: (dbg) Non-zero exit: out/minikube-linux-arm64 addons enable dashboard -p addons-371349: exit status 85 (66.86277ms)

                                                
                                                
-- stdout --
	* Profile "addons-371349" not found. Run "minikube profile list" to view all profiles.
	  To start a cluster, run: "minikube start -p addons-371349"

                                                
                                                
-- /stdout --
--- PASS: TestAddons/PreSetup/EnablingAddonOnNonExistingCluster (0.07s)

                                                
                                    
x
+
TestAddons/PreSetup/DisablingAddonOnNonExistingCluster (0.07s)

                                                
                                                
=== RUN   TestAddons/PreSetup/DisablingAddonOnNonExistingCluster
=== PAUSE TestAddons/PreSetup/DisablingAddonOnNonExistingCluster

                                                
                                                

                                                
                                                
=== CONT  TestAddons/PreSetup/DisablingAddonOnNonExistingCluster
addons_test.go:986: (dbg) Run:  out/minikube-linux-arm64 addons disable dashboard -p addons-371349
addons_test.go:986: (dbg) Non-zero exit: out/minikube-linux-arm64 addons disable dashboard -p addons-371349: exit status 85 (70.905466ms)

                                                
                                                
-- stdout --
	* Profile "addons-371349" not found. Run "minikube profile list" to view all profiles.
	  To start a cluster, run: "minikube start -p addons-371349"

                                                
                                                
-- /stdout --
--- PASS: TestAddons/PreSetup/DisablingAddonOnNonExistingCluster (0.07s)

                                                
                                    
x
+
TestAddons/Setup (228.39s)

                                                
                                                
=== RUN   TestAddons/Setup
addons_test.go:107: (dbg) Run:  out/minikube-linux-arm64 start -p addons-371349 --wait=true --memory=4000 --alsologtostderr --addons=registry --addons=metrics-server --addons=volumesnapshots --addons=csi-hostpath-driver --addons=gcp-auth --addons=cloud-spanner --addons=inspektor-gadget --addons=storage-provisioner-rancher --addons=nvidia-device-plugin --addons=yakd --addons=volcano --driver=docker  --container-runtime=crio --addons=ingress --addons=ingress-dns
addons_test.go:107: (dbg) Done: out/minikube-linux-arm64 start -p addons-371349 --wait=true --memory=4000 --alsologtostderr --addons=registry --addons=metrics-server --addons=volumesnapshots --addons=csi-hostpath-driver --addons=gcp-auth --addons=cloud-spanner --addons=inspektor-gadget --addons=storage-provisioner-rancher --addons=nvidia-device-plugin --addons=yakd --addons=volcano --driver=docker  --container-runtime=crio --addons=ingress --addons=ingress-dns: (3m48.386298883s)
--- PASS: TestAddons/Setup (228.39s)

                                                
                                    
x
+
TestAddons/serial/GCPAuth/Namespaces (0.2s)

                                                
                                                
=== RUN   TestAddons/serial/GCPAuth/Namespaces
addons_test.go:594: (dbg) Run:  kubectl --context addons-371349 create ns new-namespace
addons_test.go:608: (dbg) Run:  kubectl --context addons-371349 get secret gcp-auth -n new-namespace
--- PASS: TestAddons/serial/GCPAuth/Namespaces (0.20s)

                                                
                                    
x
+
TestAddons/parallel/InspektorGadget (11.86s)

                                                
                                                
=== RUN   TestAddons/parallel/InspektorGadget
=== PAUSE TestAddons/parallel/InspektorGadget

                                                
                                                

                                                
                                                
=== CONT  TestAddons/parallel/InspektorGadget
addons_test.go:786: (dbg) TestAddons/parallel/InspektorGadget: waiting 8m0s for pods matching "k8s-app=gadget" in namespace "gadget" ...
helpers_test.go:344: "gadget-fs9jc" [48168bf4-f1e5-42ac-b971-b3997b37b61c] Running / Ready:ContainersNotReady (containers with unready status: [gadget]) / ContainersReady:ContainersNotReady (containers with unready status: [gadget])
addons_test.go:786: (dbg) TestAddons/parallel/InspektorGadget: k8s-app=gadget healthy within 6.008581177s
addons_test.go:789: (dbg) Run:  out/minikube-linux-arm64 addons disable inspektor-gadget -p addons-371349
addons_test.go:789: (dbg) Done: out/minikube-linux-arm64 addons disable inspektor-gadget -p addons-371349: (5.850892328s)
--- PASS: TestAddons/parallel/InspektorGadget (11.86s)

                                                
                                    
x
+
TestAddons/parallel/CSI (58.37s)

                                                
                                                
=== RUN   TestAddons/parallel/CSI
=== PAUSE TestAddons/parallel/CSI

                                                
                                                

                                                
                                                
=== CONT  TestAddons/parallel/CSI
I0924 00:47:38.862323 1873600 kapi.go:75] Waiting for pod with label "kubernetes.io/minikube-addons=csi-hostpath-driver" in ns "kube-system" ...
I0924 00:47:38.869353 1873600 kapi.go:86] Found 3 Pods for label selector kubernetes.io/minikube-addons=csi-hostpath-driver
I0924 00:47:38.869383 1873600 kapi.go:107] duration metric: took 7.073647ms to wait for kubernetes.io/minikube-addons=csi-hostpath-driver ...
addons_test.go:505: csi-hostpath-driver pods stabilized in 7.084141ms
addons_test.go:508: (dbg) Run:  kubectl --context addons-371349 create -f testdata/csi-hostpath-driver/pvc.yaml
addons_test.go:513: (dbg) TestAddons/parallel/CSI: waiting 6m0s for pvc "hpvc" in namespace "default" ...
helpers_test.go:394: (dbg) Run:  kubectl --context addons-371349 get pvc hpvc -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-371349 get pvc hpvc -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-371349 get pvc hpvc -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-371349 get pvc hpvc -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-371349 get pvc hpvc -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-371349 get pvc hpvc -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-371349 get pvc hpvc -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-371349 get pvc hpvc -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-371349 get pvc hpvc -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-371349 get pvc hpvc -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-371349 get pvc hpvc -o jsonpath={.status.phase} -n default
addons_test.go:518: (dbg) Run:  kubectl --context addons-371349 create -f testdata/csi-hostpath-driver/pv-pod.yaml
addons_test.go:523: (dbg) TestAddons/parallel/CSI: waiting 6m0s for pods matching "app=task-pv-pod" in namespace "default" ...
helpers_test.go:344: "task-pv-pod" [08ae6ef7-a900-465a-8e7a-f102812f5605] Pending
helpers_test.go:344: "task-pv-pod" [08ae6ef7-a900-465a-8e7a-f102812f5605] Pending / Ready:ContainersNotReady (containers with unready status: [task-pv-container]) / ContainersReady:ContainersNotReady (containers with unready status: [task-pv-container])
helpers_test.go:344: "task-pv-pod" [08ae6ef7-a900-465a-8e7a-f102812f5605] Running
addons_test.go:523: (dbg) TestAddons/parallel/CSI: app=task-pv-pod healthy within 11.004648479s
addons_test.go:528: (dbg) Run:  kubectl --context addons-371349 create -f testdata/csi-hostpath-driver/snapshot.yaml
addons_test.go:533: (dbg) TestAddons/parallel/CSI: waiting 6m0s for volume snapshot "new-snapshot-demo" in namespace "default" ...
helpers_test.go:419: (dbg) Run:  kubectl --context addons-371349 get volumesnapshot new-snapshot-demo -o jsonpath={.status.readyToUse} -n default
helpers_test.go:419: (dbg) Run:  kubectl --context addons-371349 get volumesnapshot new-snapshot-demo -o jsonpath={.status.readyToUse} -n default
addons_test.go:538: (dbg) Run:  kubectl --context addons-371349 delete pod task-pv-pod
addons_test.go:544: (dbg) Run:  kubectl --context addons-371349 delete pvc hpvc
addons_test.go:550: (dbg) Run:  kubectl --context addons-371349 create -f testdata/csi-hostpath-driver/pvc-restore.yaml
addons_test.go:555: (dbg) TestAddons/parallel/CSI: waiting 6m0s for pvc "hpvc-restore" in namespace "default" ...
helpers_test.go:394: (dbg) Run:  kubectl --context addons-371349 get pvc hpvc-restore -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-371349 get pvc hpvc-restore -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-371349 get pvc hpvc-restore -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-371349 get pvc hpvc-restore -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-371349 get pvc hpvc-restore -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-371349 get pvc hpvc-restore -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-371349 get pvc hpvc-restore -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-371349 get pvc hpvc-restore -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-371349 get pvc hpvc-restore -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-371349 get pvc hpvc-restore -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-371349 get pvc hpvc-restore -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-371349 get pvc hpvc-restore -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-371349 get pvc hpvc-restore -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-371349 get pvc hpvc-restore -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-371349 get pvc hpvc-restore -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-371349 get pvc hpvc-restore -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-371349 get pvc hpvc-restore -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-371349 get pvc hpvc-restore -o jsonpath={.status.phase} -n default
addons_test.go:560: (dbg) Run:  kubectl --context addons-371349 create -f testdata/csi-hostpath-driver/pv-pod-restore.yaml
addons_test.go:565: (dbg) TestAddons/parallel/CSI: waiting 6m0s for pods matching "app=task-pv-pod-restore" in namespace "default" ...
helpers_test.go:344: "task-pv-pod-restore" [56c60ff0-824c-46f9-ac67-517a9f811145] Pending
helpers_test.go:344: "task-pv-pod-restore" [56c60ff0-824c-46f9-ac67-517a9f811145] Pending / Ready:ContainersNotReady (containers with unready status: [task-pv-container]) / ContainersReady:ContainersNotReady (containers with unready status: [task-pv-container])
helpers_test.go:344: "task-pv-pod-restore" [56c60ff0-824c-46f9-ac67-517a9f811145] Running
addons_test.go:565: (dbg) TestAddons/parallel/CSI: app=task-pv-pod-restore healthy within 8.00402652s
addons_test.go:570: (dbg) Run:  kubectl --context addons-371349 delete pod task-pv-pod-restore
addons_test.go:570: (dbg) Done: kubectl --context addons-371349 delete pod task-pv-pod-restore: (1.192138636s)
addons_test.go:574: (dbg) Run:  kubectl --context addons-371349 delete pvc hpvc-restore
addons_test.go:578: (dbg) Run:  kubectl --context addons-371349 delete volumesnapshot new-snapshot-demo
addons_test.go:582: (dbg) Run:  out/minikube-linux-arm64 -p addons-371349 addons disable csi-hostpath-driver --alsologtostderr -v=1
addons_test.go:582: (dbg) Done: out/minikube-linux-arm64 -p addons-371349 addons disable csi-hostpath-driver --alsologtostderr -v=1: (6.761712027s)
addons_test.go:586: (dbg) Run:  out/minikube-linux-arm64 -p addons-371349 addons disable volumesnapshots --alsologtostderr -v=1
addons_test.go:586: (dbg) Done: out/minikube-linux-arm64 -p addons-371349 addons disable volumesnapshots --alsologtostderr -v=1: (1.151749162s)
--- PASS: TestAddons/parallel/CSI (58.37s)

                                                
                                    
x
+
TestAddons/parallel/Headlamp (15.81s)

                                                
                                                
=== RUN   TestAddons/parallel/Headlamp
=== PAUSE TestAddons/parallel/Headlamp

                                                
                                                

                                                
                                                
=== CONT  TestAddons/parallel/Headlamp
addons_test.go:768: (dbg) Run:  out/minikube-linux-arm64 addons enable headlamp -p addons-371349 --alsologtostderr -v=1
addons_test.go:773: (dbg) TestAddons/parallel/Headlamp: waiting 8m0s for pods matching "app.kubernetes.io/name=headlamp" in namespace "headlamp" ...
helpers_test.go:344: "headlamp-7b5c95b59d-xpjw9" [82bcd46c-82f3-4900-bcc1-813543bca043] Pending
helpers_test.go:344: "headlamp-7b5c95b59d-xpjw9" [82bcd46c-82f3-4900-bcc1-813543bca043] Pending / Ready:ContainersNotReady (containers with unready status: [headlamp]) / ContainersReady:ContainersNotReady (containers with unready status: [headlamp])
helpers_test.go:344: "headlamp-7b5c95b59d-xpjw9" [82bcd46c-82f3-4900-bcc1-813543bca043] Running
addons_test.go:773: (dbg) TestAddons/parallel/Headlamp: app.kubernetes.io/name=headlamp healthy within 9.003429653s
addons_test.go:777: (dbg) Run:  out/minikube-linux-arm64 -p addons-371349 addons disable headlamp --alsologtostderr -v=1
addons_test.go:777: (dbg) Done: out/minikube-linux-arm64 -p addons-371349 addons disable headlamp --alsologtostderr -v=1: (5.87558582s)
--- PASS: TestAddons/parallel/Headlamp (15.81s)

                                                
                                    
x
+
TestAddons/parallel/CloudSpanner (6.54s)

                                                
                                                
=== RUN   TestAddons/parallel/CloudSpanner
=== PAUSE TestAddons/parallel/CloudSpanner

                                                
                                                

                                                
                                                
=== CONT  TestAddons/parallel/CloudSpanner
addons_test.go:805: (dbg) TestAddons/parallel/CloudSpanner: waiting 6m0s for pods matching "app=cloud-spanner-emulator" in namespace "default" ...
helpers_test.go:344: "cloud-spanner-emulator-5b584cc74-hfmlx" [66df265c-abf5-4bc4-bf6b-e56e03a61810] Running
addons_test.go:805: (dbg) TestAddons/parallel/CloudSpanner: app=cloud-spanner-emulator healthy within 6.006644932s
addons_test.go:808: (dbg) Run:  out/minikube-linux-arm64 addons disable cloud-spanner -p addons-371349
--- PASS: TestAddons/parallel/CloudSpanner (6.54s)

                                                
                                    
x
+
TestAddons/parallel/LocalPath (53.22s)

                                                
                                                
=== RUN   TestAddons/parallel/LocalPath
=== PAUSE TestAddons/parallel/LocalPath

                                                
                                                

                                                
                                                
=== CONT  TestAddons/parallel/LocalPath
addons_test.go:920: (dbg) Run:  kubectl --context addons-371349 apply -f testdata/storage-provisioner-rancher/pvc.yaml
addons_test.go:926: (dbg) Run:  kubectl --context addons-371349 apply -f testdata/storage-provisioner-rancher/pod.yaml
addons_test.go:930: (dbg) TestAddons/parallel/LocalPath: waiting 5m0s for pvc "test-pvc" in namespace "default" ...
helpers_test.go:394: (dbg) Run:  kubectl --context addons-371349 get pvc test-pvc -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-371349 get pvc test-pvc -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-371349 get pvc test-pvc -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-371349 get pvc test-pvc -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-371349 get pvc test-pvc -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-371349 get pvc test-pvc -o jsonpath={.status.phase} -n default
addons_test.go:933: (dbg) TestAddons/parallel/LocalPath: waiting 3m0s for pods matching "run=test-local-path" in namespace "default" ...
helpers_test.go:344: "test-local-path" [8313f490-5084-4b50-b8c0-7d138c9c5a9a] Pending / Ready:ContainersNotReady (containers with unready status: [busybox]) / ContainersReady:ContainersNotReady (containers with unready status: [busybox])
helpers_test.go:344: "test-local-path" [8313f490-5084-4b50-b8c0-7d138c9c5a9a] Pending / Initialized:PodCompleted / Ready:PodCompleted / ContainersReady:PodCompleted
helpers_test.go:344: "test-local-path" [8313f490-5084-4b50-b8c0-7d138c9c5a9a] Succeeded / Initialized:PodCompleted / Ready:PodCompleted / ContainersReady:PodCompleted
addons_test.go:933: (dbg) TestAddons/parallel/LocalPath: run=test-local-path healthy within 4.004133908s
addons_test.go:938: (dbg) Run:  kubectl --context addons-371349 get pvc test-pvc -o=json
addons_test.go:947: (dbg) Run:  out/minikube-linux-arm64 -p addons-371349 ssh "cat /opt/local-path-provisioner/pvc-d27a0d1d-621b-4281-ad84-3736d4ad810f_default_test-pvc/file1"
addons_test.go:959: (dbg) Run:  kubectl --context addons-371349 delete pod test-local-path
addons_test.go:963: (dbg) Run:  kubectl --context addons-371349 delete pvc test-pvc
addons_test.go:967: (dbg) Run:  out/minikube-linux-arm64 -p addons-371349 addons disable storage-provisioner-rancher --alsologtostderr -v=1
addons_test.go:967: (dbg) Done: out/minikube-linux-arm64 -p addons-371349 addons disable storage-provisioner-rancher --alsologtostderr -v=1: (43.139559497s)
--- PASS: TestAddons/parallel/LocalPath (53.22s)

                                                
                                    
x
+
TestAddons/parallel/NvidiaDevicePlugin (6.49s)

                                                
                                                
=== RUN   TestAddons/parallel/NvidiaDevicePlugin
=== PAUSE TestAddons/parallel/NvidiaDevicePlugin

                                                
                                                

                                                
                                                
=== CONT  TestAddons/parallel/NvidiaDevicePlugin
addons_test.go:999: (dbg) TestAddons/parallel/NvidiaDevicePlugin: waiting 6m0s for pods matching "name=nvidia-device-plugin-ds" in namespace "kube-system" ...
helpers_test.go:344: "nvidia-device-plugin-daemonset-t52r5" [6ee689eb-216e-49b6-b98b-04c4a8a2a717] Running
addons_test.go:999: (dbg) TestAddons/parallel/NvidiaDevicePlugin: name=nvidia-device-plugin-ds healthy within 6.004965028s
addons_test.go:1002: (dbg) Run:  out/minikube-linux-arm64 addons disable nvidia-device-plugin -p addons-371349
--- PASS: TestAddons/parallel/NvidiaDevicePlugin (6.49s)

                                                
                                    
x
+
TestAddons/parallel/Yakd (11.71s)

                                                
                                                
=== RUN   TestAddons/parallel/Yakd
=== PAUSE TestAddons/parallel/Yakd

                                                
                                                

                                                
                                                
=== CONT  TestAddons/parallel/Yakd
addons_test.go:1010: (dbg) TestAddons/parallel/Yakd: waiting 2m0s for pods matching "app.kubernetes.io/name=yakd-dashboard" in namespace "yakd-dashboard" ...
helpers_test.go:344: "yakd-dashboard-67d98fc6b-2rl8g" [0763a13a-330f-41ab-95e7-a55cfd1b056d] Running
addons_test.go:1010: (dbg) TestAddons/parallel/Yakd: app.kubernetes.io/name=yakd-dashboard healthy within 6.003798039s
addons_test.go:1014: (dbg) Run:  out/minikube-linux-arm64 -p addons-371349 addons disable yakd --alsologtostderr -v=1
addons_test.go:1014: (dbg) Done: out/minikube-linux-arm64 -p addons-371349 addons disable yakd --alsologtostderr -v=1: (5.701077848s)
--- PASS: TestAddons/parallel/Yakd (11.71s)

                                                
                                    
x
+
TestAddons/StoppedEnableDisable (6.18s)

                                                
                                                
=== RUN   TestAddons/StoppedEnableDisable
addons_test.go:170: (dbg) Run:  out/minikube-linux-arm64 stop -p addons-371349
addons_test.go:170: (dbg) Done: out/minikube-linux-arm64 stop -p addons-371349: (5.920859359s)
addons_test.go:174: (dbg) Run:  out/minikube-linux-arm64 addons enable dashboard -p addons-371349
addons_test.go:178: (dbg) Run:  out/minikube-linux-arm64 addons disable dashboard -p addons-371349
addons_test.go:183: (dbg) Run:  out/minikube-linux-arm64 addons disable gvisor -p addons-371349
--- PASS: TestAddons/StoppedEnableDisable (6.18s)

                                                
                                    
x
+
TestCertOptions (36.46s)

                                                
                                                
=== RUN   TestCertOptions
=== PAUSE TestCertOptions

                                                
                                                

                                                
                                                
=== CONT  TestCertOptions
cert_options_test.go:49: (dbg) Run:  out/minikube-linux-arm64 start -p cert-options-219464 --memory=2048 --apiserver-ips=127.0.0.1 --apiserver-ips=192.168.15.15 --apiserver-names=localhost --apiserver-names=www.google.com --apiserver-port=8555 --driver=docker  --container-runtime=crio
cert_options_test.go:49: (dbg) Done: out/minikube-linux-arm64 start -p cert-options-219464 --memory=2048 --apiserver-ips=127.0.0.1 --apiserver-ips=192.168.15.15 --apiserver-names=localhost --apiserver-names=www.google.com --apiserver-port=8555 --driver=docker  --container-runtime=crio: (33.850565521s)
cert_options_test.go:60: (dbg) Run:  out/minikube-linux-arm64 -p cert-options-219464 ssh "openssl x509 -text -noout -in /var/lib/minikube/certs/apiserver.crt"
cert_options_test.go:88: (dbg) Run:  kubectl --context cert-options-219464 config view
cert_options_test.go:100: (dbg) Run:  out/minikube-linux-arm64 ssh -p cert-options-219464 -- "sudo cat /etc/kubernetes/admin.conf"
helpers_test.go:175: Cleaning up "cert-options-219464" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-arm64 delete -p cert-options-219464
helpers_test.go:178: (dbg) Done: out/minikube-linux-arm64 delete -p cert-options-219464: (1.971888521s)
--- PASS: TestCertOptions (36.46s)

                                                
                                    
x
+
TestCertExpiration (263.01s)

                                                
                                                
=== RUN   TestCertExpiration
=== PAUSE TestCertExpiration

                                                
                                                

                                                
                                                
=== CONT  TestCertExpiration
cert_options_test.go:123: (dbg) Run:  out/minikube-linux-arm64 start -p cert-expiration-784124 --memory=2048 --cert-expiration=3m --driver=docker  --container-runtime=crio
cert_options_test.go:123: (dbg) Done: out/minikube-linux-arm64 start -p cert-expiration-784124 --memory=2048 --cert-expiration=3m --driver=docker  --container-runtime=crio: (42.247812172s)
cert_options_test.go:131: (dbg) Run:  out/minikube-linux-arm64 start -p cert-expiration-784124 --memory=2048 --cert-expiration=8760h --driver=docker  --container-runtime=crio
E0924 01:39:19.924945 1873600 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /home/jenkins/minikube-integration/19696-1868219/.minikube/profiles/addons-371349/client.crt: no such file or directory" logger="UnhandledError"
cert_options_test.go:131: (dbg) Done: out/minikube-linux-arm64 start -p cert-expiration-784124 --memory=2048 --cert-expiration=8760h --driver=docker  --container-runtime=crio: (37.851126817s)
helpers_test.go:175: Cleaning up "cert-expiration-784124" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-arm64 delete -p cert-expiration-784124
helpers_test.go:178: (dbg) Done: out/minikube-linux-arm64 delete -p cert-expiration-784124: (2.909237334s)
--- PASS: TestCertExpiration (263.01s)

                                                
                                    
x
+
TestForceSystemdFlag (42.01s)

                                                
                                                
=== RUN   TestForceSystemdFlag
=== PAUSE TestForceSystemdFlag

                                                
                                                

                                                
                                                
=== CONT  TestForceSystemdFlag
docker_test.go:91: (dbg) Run:  out/minikube-linux-arm64 start -p force-systemd-flag-835311 --memory=2048 --force-systemd --alsologtostderr -v=5 --driver=docker  --container-runtime=crio
E0924 01:34:19.924542 1873600 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /home/jenkins/minikube-integration/19696-1868219/.minikube/profiles/addons-371349/client.crt: no such file or directory" logger="UnhandledError"
docker_test.go:91: (dbg) Done: out/minikube-linux-arm64 start -p force-systemd-flag-835311 --memory=2048 --force-systemd --alsologtostderr -v=5 --driver=docker  --container-runtime=crio: (38.780650218s)
docker_test.go:132: (dbg) Run:  out/minikube-linux-arm64 -p force-systemd-flag-835311 ssh "cat /etc/crio/crio.conf.d/02-crio.conf"
helpers_test.go:175: Cleaning up "force-systemd-flag-835311" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-arm64 delete -p force-systemd-flag-835311
helpers_test.go:178: (dbg) Done: out/minikube-linux-arm64 delete -p force-systemd-flag-835311: (2.809225179s)
--- PASS: TestForceSystemdFlag (42.01s)

                                                
                                    
x
+
TestForceSystemdEnv (35.86s)

                                                
                                                
=== RUN   TestForceSystemdEnv
=== PAUSE TestForceSystemdEnv

                                                
                                                

                                                
                                                
=== CONT  TestForceSystemdEnv
docker_test.go:155: (dbg) Run:  out/minikube-linux-arm64 start -p force-systemd-env-661742 --memory=2048 --alsologtostderr -v=5 --driver=docker  --container-runtime=crio
docker_test.go:155: (dbg) Done: out/minikube-linux-arm64 start -p force-systemd-env-661742 --memory=2048 --alsologtostderr -v=5 --driver=docker  --container-runtime=crio: (33.377332574s)
helpers_test.go:175: Cleaning up "force-systemd-env-661742" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-arm64 delete -p force-systemd-env-661742
helpers_test.go:178: (dbg) Done: out/minikube-linux-arm64 delete -p force-systemd-env-661742: (2.483981896s)
--- PASS: TestForceSystemdEnv (35.86s)

                                                
                                    
x
+
TestErrorSpam/setup (33.04s)

                                                
                                                
=== RUN   TestErrorSpam/setup
error_spam_test.go:81: (dbg) Run:  out/minikube-linux-arm64 start -p nospam-896405 -n=1 --memory=2250 --wait=false --log_dir=/tmp/nospam-896405 --driver=docker  --container-runtime=crio
error_spam_test.go:81: (dbg) Done: out/minikube-linux-arm64 start -p nospam-896405 -n=1 --memory=2250 --wait=false --log_dir=/tmp/nospam-896405 --driver=docker  --container-runtime=crio: (33.043671694s)
--- PASS: TestErrorSpam/setup (33.04s)

                                                
                                    
x
+
TestErrorSpam/start (0.74s)

                                                
                                                
=== RUN   TestErrorSpam/start
error_spam_test.go:216: Cleaning up 1 logfile(s) ...
error_spam_test.go:159: (dbg) Run:  out/minikube-linux-arm64 -p nospam-896405 --log_dir /tmp/nospam-896405 start --dry-run
error_spam_test.go:159: (dbg) Run:  out/minikube-linux-arm64 -p nospam-896405 --log_dir /tmp/nospam-896405 start --dry-run
error_spam_test.go:182: (dbg) Run:  out/minikube-linux-arm64 -p nospam-896405 --log_dir /tmp/nospam-896405 start --dry-run
--- PASS: TestErrorSpam/start (0.74s)

                                                
                                    
x
+
TestErrorSpam/status (1s)

                                                
                                                
=== RUN   TestErrorSpam/status
error_spam_test.go:216: Cleaning up 0 logfile(s) ...
error_spam_test.go:159: (dbg) Run:  out/minikube-linux-arm64 -p nospam-896405 --log_dir /tmp/nospam-896405 status
error_spam_test.go:159: (dbg) Run:  out/minikube-linux-arm64 -p nospam-896405 --log_dir /tmp/nospam-896405 status
error_spam_test.go:182: (dbg) Run:  out/minikube-linux-arm64 -p nospam-896405 --log_dir /tmp/nospam-896405 status
--- PASS: TestErrorSpam/status (1.00s)

                                                
                                    
x
+
TestErrorSpam/pause (1.74s)

                                                
                                                
=== RUN   TestErrorSpam/pause
error_spam_test.go:216: Cleaning up 0 logfile(s) ...
error_spam_test.go:159: (dbg) Run:  out/minikube-linux-arm64 -p nospam-896405 --log_dir /tmp/nospam-896405 pause
error_spam_test.go:159: (dbg) Run:  out/minikube-linux-arm64 -p nospam-896405 --log_dir /tmp/nospam-896405 pause
error_spam_test.go:182: (dbg) Run:  out/minikube-linux-arm64 -p nospam-896405 --log_dir /tmp/nospam-896405 pause
--- PASS: TestErrorSpam/pause (1.74s)

                                                
                                    
x
+
TestErrorSpam/unpause (1.96s)

                                                
                                                
=== RUN   TestErrorSpam/unpause
error_spam_test.go:216: Cleaning up 0 logfile(s) ...
error_spam_test.go:159: (dbg) Run:  out/minikube-linux-arm64 -p nospam-896405 --log_dir /tmp/nospam-896405 unpause
error_spam_test.go:159: (dbg) Run:  out/minikube-linux-arm64 -p nospam-896405 --log_dir /tmp/nospam-896405 unpause
error_spam_test.go:182: (dbg) Run:  out/minikube-linux-arm64 -p nospam-896405 --log_dir /tmp/nospam-896405 unpause
--- PASS: TestErrorSpam/unpause (1.96s)

                                                
                                    
x
+
TestErrorSpam/stop (1.48s)

                                                
                                                
=== RUN   TestErrorSpam/stop
error_spam_test.go:216: Cleaning up 0 logfile(s) ...
error_spam_test.go:159: (dbg) Run:  out/minikube-linux-arm64 -p nospam-896405 --log_dir /tmp/nospam-896405 stop
error_spam_test.go:159: (dbg) Done: out/minikube-linux-arm64 -p nospam-896405 --log_dir /tmp/nospam-896405 stop: (1.276627166s)
error_spam_test.go:159: (dbg) Run:  out/minikube-linux-arm64 -p nospam-896405 --log_dir /tmp/nospam-896405 stop
error_spam_test.go:182: (dbg) Run:  out/minikube-linux-arm64 -p nospam-896405 --log_dir /tmp/nospam-896405 stop
--- PASS: TestErrorSpam/stop (1.48s)

                                                
                                    
x
+
TestFunctional/serial/CopySyncFile (0s)

                                                
                                                
=== RUN   TestFunctional/serial/CopySyncFile
functional_test.go:1855: local sync path: /home/jenkins/minikube-integration/19696-1868219/.minikube/files/etc/test/nested/copy/1873600/hosts
--- PASS: TestFunctional/serial/CopySyncFile (0.00s)

                                                
                                    
x
+
TestFunctional/serial/StartWithProxy (77.25s)

                                                
                                                
=== RUN   TestFunctional/serial/StartWithProxy
functional_test.go:2234: (dbg) Run:  out/minikube-linux-arm64 start -p functional-838183 --memory=4000 --apiserver-port=8441 --wait=all --driver=docker  --container-runtime=crio
functional_test.go:2234: (dbg) Done: out/minikube-linux-arm64 start -p functional-838183 --memory=4000 --apiserver-port=8441 --wait=all --driver=docker  --container-runtime=crio: (1m17.245295783s)
--- PASS: TestFunctional/serial/StartWithProxy (77.25s)

                                                
                                    
x
+
TestFunctional/serial/AuditLog (0s)

                                                
                                                
=== RUN   TestFunctional/serial/AuditLog
--- PASS: TestFunctional/serial/AuditLog (0.00s)

                                                
                                    
x
+
TestFunctional/serial/SoftStart (39.52s)

                                                
                                                
=== RUN   TestFunctional/serial/SoftStart
I0924 00:56:24.970623 1873600 config.go:182] Loaded profile config "functional-838183": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.31.1
functional_test.go:659: (dbg) Run:  out/minikube-linux-arm64 start -p functional-838183 --alsologtostderr -v=8
functional_test.go:659: (dbg) Done: out/minikube-linux-arm64 start -p functional-838183 --alsologtostderr -v=8: (39.517842821s)
functional_test.go:663: soft start took 39.518371367s for "functional-838183" cluster.
I0924 00:57:04.488766 1873600 config.go:182] Loaded profile config "functional-838183": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.31.1
--- PASS: TestFunctional/serial/SoftStart (39.52s)

                                                
                                    
x
+
TestFunctional/serial/KubeContext (0.07s)

                                                
                                                
=== RUN   TestFunctional/serial/KubeContext
functional_test.go:681: (dbg) Run:  kubectl config current-context
--- PASS: TestFunctional/serial/KubeContext (0.07s)

                                                
                                    
x
+
TestFunctional/serial/KubectlGetPods (0.09s)

                                                
                                                
=== RUN   TestFunctional/serial/KubectlGetPods
functional_test.go:696: (dbg) Run:  kubectl --context functional-838183 get po -A
--- PASS: TestFunctional/serial/KubectlGetPods (0.09s)

                                                
                                    
x
+
TestFunctional/serial/CacheCmd/cache/add_remote (4.39s)

                                                
                                                
=== RUN   TestFunctional/serial/CacheCmd/cache/add_remote
functional_test.go:1049: (dbg) Run:  out/minikube-linux-arm64 -p functional-838183 cache add registry.k8s.io/pause:3.1
functional_test.go:1049: (dbg) Done: out/minikube-linux-arm64 -p functional-838183 cache add registry.k8s.io/pause:3.1: (1.483211329s)
functional_test.go:1049: (dbg) Run:  out/minikube-linux-arm64 -p functional-838183 cache add registry.k8s.io/pause:3.3
functional_test.go:1049: (dbg) Done: out/minikube-linux-arm64 -p functional-838183 cache add registry.k8s.io/pause:3.3: (1.584356214s)
functional_test.go:1049: (dbg) Run:  out/minikube-linux-arm64 -p functional-838183 cache add registry.k8s.io/pause:latest
functional_test.go:1049: (dbg) Done: out/minikube-linux-arm64 -p functional-838183 cache add registry.k8s.io/pause:latest: (1.32610323s)
--- PASS: TestFunctional/serial/CacheCmd/cache/add_remote (4.39s)

                                                
                                    
x
+
TestFunctional/serial/CacheCmd/cache/add_local (1.38s)

                                                
                                                
=== RUN   TestFunctional/serial/CacheCmd/cache/add_local
functional_test.go:1077: (dbg) Run:  docker build -t minikube-local-cache-test:functional-838183 /tmp/TestFunctionalserialCacheCmdcacheadd_local2306804651/001
functional_test.go:1089: (dbg) Run:  out/minikube-linux-arm64 -p functional-838183 cache add minikube-local-cache-test:functional-838183
functional_test.go:1094: (dbg) Run:  out/minikube-linux-arm64 -p functional-838183 cache delete minikube-local-cache-test:functional-838183
functional_test.go:1083: (dbg) Run:  docker rmi minikube-local-cache-test:functional-838183
--- PASS: TestFunctional/serial/CacheCmd/cache/add_local (1.38s)

                                                
                                    
x
+
TestFunctional/serial/CacheCmd/cache/CacheDelete (0.05s)

                                                
                                                
=== RUN   TestFunctional/serial/CacheCmd/cache/CacheDelete
functional_test.go:1102: (dbg) Run:  out/minikube-linux-arm64 cache delete registry.k8s.io/pause:3.3
--- PASS: TestFunctional/serial/CacheCmd/cache/CacheDelete (0.05s)

                                                
                                    
x
+
TestFunctional/serial/CacheCmd/cache/list (0.05s)

                                                
                                                
=== RUN   TestFunctional/serial/CacheCmd/cache/list
functional_test.go:1110: (dbg) Run:  out/minikube-linux-arm64 cache list
--- PASS: TestFunctional/serial/CacheCmd/cache/list (0.05s)

                                                
                                    
x
+
TestFunctional/serial/CacheCmd/cache/verify_cache_inside_node (0.31s)

                                                
                                                
=== RUN   TestFunctional/serial/CacheCmd/cache/verify_cache_inside_node
functional_test.go:1124: (dbg) Run:  out/minikube-linux-arm64 -p functional-838183 ssh sudo crictl images
--- PASS: TestFunctional/serial/CacheCmd/cache/verify_cache_inside_node (0.31s)

                                                
                                    
x
+
TestFunctional/serial/CacheCmd/cache/cache_reload (2.09s)

                                                
                                                
=== RUN   TestFunctional/serial/CacheCmd/cache/cache_reload
functional_test.go:1147: (dbg) Run:  out/minikube-linux-arm64 -p functional-838183 ssh sudo crictl rmi registry.k8s.io/pause:latest
functional_test.go:1153: (dbg) Run:  out/minikube-linux-arm64 -p functional-838183 ssh sudo crictl inspecti registry.k8s.io/pause:latest
functional_test.go:1153: (dbg) Non-zero exit: out/minikube-linux-arm64 -p functional-838183 ssh sudo crictl inspecti registry.k8s.io/pause:latest: exit status 1 (292.640461ms)

                                                
                                                
-- stdout --
	FATA[0000] no such image "registry.k8s.io/pause:latest" present 

                                                
                                                
-- /stdout --
** stderr ** 
	ssh: Process exited with status 1

                                                
                                                
** /stderr **
functional_test.go:1158: (dbg) Run:  out/minikube-linux-arm64 -p functional-838183 cache reload
functional_test.go:1158: (dbg) Done: out/minikube-linux-arm64 -p functional-838183 cache reload: (1.222652725s)
functional_test.go:1163: (dbg) Run:  out/minikube-linux-arm64 -p functional-838183 ssh sudo crictl inspecti registry.k8s.io/pause:latest
--- PASS: TestFunctional/serial/CacheCmd/cache/cache_reload (2.09s)

                                                
                                    
x
+
TestFunctional/serial/CacheCmd/cache/delete (0.11s)

                                                
                                                
=== RUN   TestFunctional/serial/CacheCmd/cache/delete
functional_test.go:1172: (dbg) Run:  out/minikube-linux-arm64 cache delete registry.k8s.io/pause:3.1
functional_test.go:1172: (dbg) Run:  out/minikube-linux-arm64 cache delete registry.k8s.io/pause:latest
--- PASS: TestFunctional/serial/CacheCmd/cache/delete (0.11s)

                                                
                                    
x
+
TestFunctional/serial/MinikubeKubectlCmd (0.14s)

                                                
                                                
=== RUN   TestFunctional/serial/MinikubeKubectlCmd
functional_test.go:716: (dbg) Run:  out/minikube-linux-arm64 -p functional-838183 kubectl -- --context functional-838183 get pods
--- PASS: TestFunctional/serial/MinikubeKubectlCmd (0.14s)

                                                
                                    
x
+
TestFunctional/serial/MinikubeKubectlCmdDirectly (0.13s)

                                                
                                                
=== RUN   TestFunctional/serial/MinikubeKubectlCmdDirectly
functional_test.go:741: (dbg) Run:  out/kubectl --context functional-838183 get pods
--- PASS: TestFunctional/serial/MinikubeKubectlCmdDirectly (0.13s)

                                                
                                    
x
+
TestFunctional/serial/ExtraConfig (39.25s)

                                                
                                                
=== RUN   TestFunctional/serial/ExtraConfig
functional_test.go:757: (dbg) Run:  out/minikube-linux-arm64 start -p functional-838183 --extra-config=apiserver.enable-admission-plugins=NamespaceAutoProvision --wait=all
functional_test.go:757: (dbg) Done: out/minikube-linux-arm64 start -p functional-838183 --extra-config=apiserver.enable-admission-plugins=NamespaceAutoProvision --wait=all: (39.25191825s)
functional_test.go:761: restart took 39.252018227s for "functional-838183" cluster.
I0924 00:57:52.571625 1873600 config.go:182] Loaded profile config "functional-838183": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.31.1
--- PASS: TestFunctional/serial/ExtraConfig (39.25s)

                                                
                                    
x
+
TestFunctional/serial/ComponentHealth (0.09s)

                                                
                                                
=== RUN   TestFunctional/serial/ComponentHealth
functional_test.go:810: (dbg) Run:  kubectl --context functional-838183 get po -l tier=control-plane -n kube-system -o=json
functional_test.go:825: etcd phase: Running
functional_test.go:835: etcd status: Ready
functional_test.go:825: kube-apiserver phase: Running
functional_test.go:835: kube-apiserver status: Ready
functional_test.go:825: kube-controller-manager phase: Running
functional_test.go:835: kube-controller-manager status: Ready
functional_test.go:825: kube-scheduler phase: Running
functional_test.go:835: kube-scheduler status: Ready
--- PASS: TestFunctional/serial/ComponentHealth (0.09s)

                                                
                                    
x
+
TestFunctional/serial/LogsCmd (1.65s)

                                                
                                                
=== RUN   TestFunctional/serial/LogsCmd
functional_test.go:1236: (dbg) Run:  out/minikube-linux-arm64 -p functional-838183 logs
functional_test.go:1236: (dbg) Done: out/minikube-linux-arm64 -p functional-838183 logs: (1.648179542s)
--- PASS: TestFunctional/serial/LogsCmd (1.65s)

                                                
                                    
x
+
TestFunctional/serial/LogsFileCmd (1.65s)

                                                
                                                
=== RUN   TestFunctional/serial/LogsFileCmd
functional_test.go:1250: (dbg) Run:  out/minikube-linux-arm64 -p functional-838183 logs --file /tmp/TestFunctionalserialLogsFileCmd58866360/001/logs.txt
functional_test.go:1250: (dbg) Done: out/minikube-linux-arm64 -p functional-838183 logs --file /tmp/TestFunctionalserialLogsFileCmd58866360/001/logs.txt: (1.65060453s)
--- PASS: TestFunctional/serial/LogsFileCmd (1.65s)

                                                
                                    
x
+
TestFunctional/serial/InvalidService (4.23s)

                                                
                                                
=== RUN   TestFunctional/serial/InvalidService
functional_test.go:2321: (dbg) Run:  kubectl --context functional-838183 apply -f testdata/invalidsvc.yaml
functional_test.go:2335: (dbg) Run:  out/minikube-linux-arm64 service invalid-svc -p functional-838183
functional_test.go:2335: (dbg) Non-zero exit: out/minikube-linux-arm64 service invalid-svc -p functional-838183: exit status 115 (455.095339ms)

                                                
                                                
-- stdout --
	|-----------|-------------|-------------|---------------------------|
	| NAMESPACE |    NAME     | TARGET PORT |            URL            |
	|-----------|-------------|-------------|---------------------------|
	| default   | invalid-svc |          80 | http://192.168.49.2:30146 |
	|-----------|-------------|-------------|---------------------------|
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	X Exiting due to SVC_UNREACHABLE: service not available: no running pod for service invalid-svc found
	* 
	╭─────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                             │
	│    * If the above advice does not help, please let us know:                                 │
	│      https://github.com/kubernetes/minikube/issues/new/choose                               │
	│                                                                                             │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │
	│    * Please also attach the following file to the GitHub issue:                             │
	│    * - /tmp/minikube_service_96b204199e3191fa1740d4430b018a3c8028d52d_0.log                 │
	│                                                                                             │
	╰─────────────────────────────────────────────────────────────────────────────────────────────╯

                                                
                                                
** /stderr **
functional_test.go:2327: (dbg) Run:  kubectl --context functional-838183 delete -f testdata/invalidsvc.yaml
--- PASS: TestFunctional/serial/InvalidService (4.23s)

                                                
                                    
x
+
TestFunctional/parallel/ConfigCmd (0.48s)

                                                
                                                
=== RUN   TestFunctional/parallel/ConfigCmd
=== PAUSE TestFunctional/parallel/ConfigCmd

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/ConfigCmd
functional_test.go:1199: (dbg) Run:  out/minikube-linux-arm64 -p functional-838183 config unset cpus
functional_test.go:1199: (dbg) Run:  out/minikube-linux-arm64 -p functional-838183 config get cpus
functional_test.go:1199: (dbg) Non-zero exit: out/minikube-linux-arm64 -p functional-838183 config get cpus: exit status 14 (97.784007ms)

                                                
                                                
** stderr ** 
	Error: specified key could not be found in config

                                                
                                                
** /stderr **
functional_test.go:1199: (dbg) Run:  out/minikube-linux-arm64 -p functional-838183 config set cpus 2
functional_test.go:1199: (dbg) Run:  out/minikube-linux-arm64 -p functional-838183 config get cpus
functional_test.go:1199: (dbg) Run:  out/minikube-linux-arm64 -p functional-838183 config unset cpus
functional_test.go:1199: (dbg) Run:  out/minikube-linux-arm64 -p functional-838183 config get cpus
functional_test.go:1199: (dbg) Non-zero exit: out/minikube-linux-arm64 -p functional-838183 config get cpus: exit status 14 (60.871462ms)

                                                
                                                
** stderr ** 
	Error: specified key could not be found in config

                                                
                                                
** /stderr **
--- PASS: TestFunctional/parallel/ConfigCmd (0.48s)

                                                
                                    
x
+
TestFunctional/parallel/DashboardCmd (10.68s)

                                                
                                                
=== RUN   TestFunctional/parallel/DashboardCmd
=== PAUSE TestFunctional/parallel/DashboardCmd

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/DashboardCmd
functional_test.go:905: (dbg) daemon: [out/minikube-linux-arm64 dashboard --url --port 36195 -p functional-838183 --alsologtostderr -v=1]
functional_test.go:910: (dbg) stopping [out/minikube-linux-arm64 dashboard --url --port 36195 -p functional-838183 --alsologtostderr -v=1] ...
helpers_test.go:508: unable to kill pid 1904415: os: process already finished
--- PASS: TestFunctional/parallel/DashboardCmd (10.68s)

                                                
                                    
x
+
TestFunctional/parallel/DryRun (0.5s)

                                                
                                                
=== RUN   TestFunctional/parallel/DryRun
=== PAUSE TestFunctional/parallel/DryRun

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/DryRun
functional_test.go:974: (dbg) Run:  out/minikube-linux-arm64 start -p functional-838183 --dry-run --memory 250MB --alsologtostderr --driver=docker  --container-runtime=crio
functional_test.go:974: (dbg) Non-zero exit: out/minikube-linux-arm64 start -p functional-838183 --dry-run --memory 250MB --alsologtostderr --driver=docker  --container-runtime=crio: exit status 23 (229.324475ms)

                                                
                                                
-- stdout --
	* [functional-838183] minikube v1.34.0 on Ubuntu 20.04 (arm64)
	  - MINIKUBE_LOCATION=19696
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - KUBECONFIG=/home/jenkins/minikube-integration/19696-1868219/kubeconfig
	  - MINIKUBE_HOME=/home/jenkins/minikube-integration/19696-1868219/.minikube
	  - MINIKUBE_BIN=out/minikube-linux-arm64
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the docker driver based on existing profile
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0924 00:58:41.397632 1903698 out.go:345] Setting OutFile to fd 1 ...
	I0924 00:58:41.397753 1903698 out.go:392] TERM=,COLORTERM=, which probably does not support color
	I0924 00:58:41.397764 1903698 out.go:358] Setting ErrFile to fd 2...
	I0924 00:58:41.397771 1903698 out.go:392] TERM=,COLORTERM=, which probably does not support color
	I0924 00:58:41.398032 1903698 root.go:338] Updating PATH: /home/jenkins/minikube-integration/19696-1868219/.minikube/bin
	I0924 00:58:41.398382 1903698 out.go:352] Setting JSON to false
	I0924 00:58:41.399303 1903698 start.go:129] hostinfo: {"hostname":"ip-172-31-21-244","uptime":31271,"bootTime":1727108250,"procs":203,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1070-aws","kernelArch":"aarch64","virtualizationSystem":"","virtualizationRole":"","hostId":"da8ac1fd-6236-412a-a346-95873c98230d"}
	I0924 00:58:41.399378 1903698 start.go:139] virtualization:  
	I0924 00:58:41.402732 1903698 out.go:177] * [functional-838183] minikube v1.34.0 on Ubuntu 20.04 (arm64)
	I0924 00:58:41.405366 1903698 out.go:177]   - MINIKUBE_LOCATION=19696
	I0924 00:58:41.405501 1903698 notify.go:220] Checking for updates...
	I0924 00:58:41.410785 1903698 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I0924 00:58:41.413367 1903698 out.go:177]   - KUBECONFIG=/home/jenkins/minikube-integration/19696-1868219/kubeconfig
	I0924 00:58:41.415933 1903698 out.go:177]   - MINIKUBE_HOME=/home/jenkins/minikube-integration/19696-1868219/.minikube
	I0924 00:58:41.418524 1903698 out.go:177]   - MINIKUBE_BIN=out/minikube-linux-arm64
	I0924 00:58:41.421106 1903698 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=
	I0924 00:58:41.424150 1903698 config.go:182] Loaded profile config "functional-838183": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.31.1
	I0924 00:58:41.424664 1903698 driver.go:394] Setting default libvirt URI to qemu:///system
	I0924 00:58:41.480771 1903698 docker.go:123] docker version: linux-27.3.1:Docker Engine - Community
	I0924 00:58:41.480890 1903698 cli_runner.go:164] Run: docker system info --format "{{json .}}"
	I0924 00:58:41.561291 1903698 info.go:266] docker info: {ID:5FDH:SA5P:5GCT:NLAS:B73P:SGDQ:PBG5:UBVH:UZY3:RXGO:CI7S:WAIH Containers:1 ContainersRunning:1 ContainersPaused:0 ContainersStopped:0 Images:3 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:false BridgeNfIP6Tables:false Debug:false NFd:32 OomKillDisable:true NGoroutines:52 SystemTime:2024-09-24 00:58:41.550859017 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1070-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Architecture:a
arch64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8214831104 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-21-244 Labels:[] ExperimentalBuild:false ServerVersion:27.3.1 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:7f7fdf5fed64eb6a7caf99b3e12efcf9d60e311c Expected:7f7fdf5fed64eb6a7caf99b3e12efcf9d60e311c} RuncCommit:{ID:v1.1.14-0-g2c9f560 Expected:v1.1.14-0-g2c9f560} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:[WARNING: brid
ge-nf-call-iptables is disabled WARNING: bridge-nf-call-ip6tables is disabled] ServerErrors:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.17.1] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.29.7]] Warnings:<nil>}}
	I0924 00:58:41.561403 1903698 docker.go:318] overlay module found
	I0924 00:58:41.564297 1903698 out.go:177] * Using the docker driver based on existing profile
	I0924 00:58:41.567030 1903698 start.go:297] selected driver: docker
	I0924 00:58:41.567047 1903698 start.go:901] validating driver "docker" against &{Name:functional-838183 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1727108449-19696@sha256:c662152d8855bc4c62a3b5786a68adf99e04794e7f8f374a3859703004ef1d21 Memory:4000 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8441 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.31.1 ClusterName:functional-838183 Namespace:default APIServerHAVIP: APIServerNa
me:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[{Component:apiserver Key:enable-admission-plugins Value:NamespaceAutoProvision}] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.49.2 Port:8441 KubernetesVersion:v1.31.1 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[default-storageclass:true storage-provisioner:true] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP
: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I0924 00:58:41.567253 1903698 start.go:912] status for docker: {Installed:true Healthy:true Running:false NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I0924 00:58:41.571461 1903698 out.go:201] 
	W0924 00:58:41.574035 1903698 out.go:270] X Exiting due to RSRC_INSUFFICIENT_REQ_MEMORY: Requested memory allocation 250MiB is less than the usable minimum of 1800MB
	X Exiting due to RSRC_INSUFFICIENT_REQ_MEMORY: Requested memory allocation 250MiB is less than the usable minimum of 1800MB
	I0924 00:58:41.576895 1903698 out.go:201] 

                                                
                                                
** /stderr **
functional_test.go:991: (dbg) Run:  out/minikube-linux-arm64 start -p functional-838183 --dry-run --alsologtostderr -v=1 --driver=docker  --container-runtime=crio
--- PASS: TestFunctional/parallel/DryRun (0.50s)

                                                
                                    
x
+
TestFunctional/parallel/InternationalLanguage (0.22s)

                                                
                                                
=== RUN   TestFunctional/parallel/InternationalLanguage
=== PAUSE TestFunctional/parallel/InternationalLanguage

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/InternationalLanguage
functional_test.go:1020: (dbg) Run:  out/minikube-linux-arm64 start -p functional-838183 --dry-run --memory 250MB --alsologtostderr --driver=docker  --container-runtime=crio
functional_test.go:1020: (dbg) Non-zero exit: out/minikube-linux-arm64 start -p functional-838183 --dry-run --memory 250MB --alsologtostderr --driver=docker  --container-runtime=crio: exit status 23 (217.777045ms)

                                                
                                                
-- stdout --
	* [functional-838183] minikube v1.34.0 sur Ubuntu 20.04 (arm64)
	  - MINIKUBE_LOCATION=19696
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - KUBECONFIG=/home/jenkins/minikube-integration/19696-1868219/kubeconfig
	  - MINIKUBE_HOME=/home/jenkins/minikube-integration/19696-1868219/.minikube
	  - MINIKUBE_BIN=out/minikube-linux-arm64
	  - MINIKUBE_FORCE_SYSTEMD=
	* Utilisation du pilote docker basé sur le profil existant
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0924 00:58:41.919923 1903887 out.go:345] Setting OutFile to fd 1 ...
	I0924 00:58:41.920223 1903887 out.go:392] TERM=,COLORTERM=, which probably does not support color
	I0924 00:58:41.920254 1903887 out.go:358] Setting ErrFile to fd 2...
	I0924 00:58:41.920274 1903887 out.go:392] TERM=,COLORTERM=, which probably does not support color
	I0924 00:58:41.920687 1903887 root.go:338] Updating PATH: /home/jenkins/minikube-integration/19696-1868219/.minikube/bin
	I0924 00:58:41.921150 1903887 out.go:352] Setting JSON to false
	I0924 00:58:41.922364 1903887 start.go:129] hostinfo: {"hostname":"ip-172-31-21-244","uptime":31272,"bootTime":1727108250,"procs":205,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1070-aws","kernelArch":"aarch64","virtualizationSystem":"","virtualizationRole":"","hostId":"da8ac1fd-6236-412a-a346-95873c98230d"}
	I0924 00:58:41.922460 1903887 start.go:139] virtualization:  
	I0924 00:58:41.927608 1903887 out.go:177] * [functional-838183] minikube v1.34.0 sur Ubuntu 20.04 (arm64)
	I0924 00:58:41.930237 1903887 out.go:177]   - MINIKUBE_LOCATION=19696
	I0924 00:58:41.930338 1903887 notify.go:220] Checking for updates...
	I0924 00:58:41.935266 1903887 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I0924 00:58:41.938146 1903887 out.go:177]   - KUBECONFIG=/home/jenkins/minikube-integration/19696-1868219/kubeconfig
	I0924 00:58:41.940867 1903887 out.go:177]   - MINIKUBE_HOME=/home/jenkins/minikube-integration/19696-1868219/.minikube
	I0924 00:58:41.943451 1903887 out.go:177]   - MINIKUBE_BIN=out/minikube-linux-arm64
	I0924 00:58:41.946537 1903887 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=
	I0924 00:58:41.949906 1903887 config.go:182] Loaded profile config "functional-838183": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.31.1
	I0924 00:58:41.950523 1903887 driver.go:394] Setting default libvirt URI to qemu:///system
	I0924 00:58:41.984661 1903887 docker.go:123] docker version: linux-27.3.1:Docker Engine - Community
	I0924 00:58:41.984773 1903887 cli_runner.go:164] Run: docker system info --format "{{json .}}"
	I0924 00:58:42.045916 1903887 info.go:266] docker info: {ID:5FDH:SA5P:5GCT:NLAS:B73P:SGDQ:PBG5:UBVH:UZY3:RXGO:CI7S:WAIH Containers:1 ContainersRunning:1 ContainersPaused:0 ContainersStopped:0 Images:3 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:false BridgeNfIP6Tables:false Debug:false NFd:32 OomKillDisable:true NGoroutines:52 SystemTime:2024-09-24 00:58:42.032763464 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1070-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Architecture:a
arch64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8214831104 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-21-244 Labels:[] ExperimentalBuild:false ServerVersion:27.3.1 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:7f7fdf5fed64eb6a7caf99b3e12efcf9d60e311c Expected:7f7fdf5fed64eb6a7caf99b3e12efcf9d60e311c} RuncCommit:{ID:v1.1.14-0-g2c9f560 Expected:v1.1.14-0-g2c9f560} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:[WARNING: brid
ge-nf-call-iptables is disabled WARNING: bridge-nf-call-ip6tables is disabled] ServerErrors:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.17.1] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.29.7]] Warnings:<nil>}}
	I0924 00:58:42.046212 1903887 docker.go:318] overlay module found
	I0924 00:58:42.049040 1903887 out.go:177] * Utilisation du pilote docker basé sur le profil existant
	I0924 00:58:42.051678 1903887 start.go:297] selected driver: docker
	I0924 00:58:42.051699 1903887 start.go:901] validating driver "docker" against &{Name:functional-838183 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1727108449-19696@sha256:c662152d8855bc4c62a3b5786a68adf99e04794e7f8f374a3859703004ef1d21 Memory:4000 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8441 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.31.1 ClusterName:functional-838183 Namespace:default APIServerHAVIP: APIServerNa
me:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[{Component:apiserver Key:enable-admission-plugins Value:NamespaceAutoProvision}] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.49.2 Port:8441 KubernetesVersion:v1.31.1 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[default-storageclass:true storage-provisioner:true] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP
: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I0924 00:58:42.051824 1903887 start.go:912] status for docker: {Installed:true Healthy:true Running:false NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I0924 00:58:42.056282 1903887 out.go:201] 
	W0924 00:58:42.059309 1903887 out.go:270] X Fermeture en raison de RSRC_INSUFFICIENT_REQ_MEMORY : L'allocation de mémoire demandée 250 Mio est inférieure au minimum utilisable de 1800 Mo
	X Fermeture en raison de RSRC_INSUFFICIENT_REQ_MEMORY : L'allocation de mémoire demandée 250 Mio est inférieure au minimum utilisable de 1800 Mo
	I0924 00:58:42.061882 1903887 out.go:201] 

                                                
                                                
** /stderr **
--- PASS: TestFunctional/parallel/InternationalLanguage (0.22s)

                                                
                                    
x
+
TestFunctional/parallel/StatusCmd (0.91s)

                                                
                                                
=== RUN   TestFunctional/parallel/StatusCmd
=== PAUSE TestFunctional/parallel/StatusCmd

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/StatusCmd
functional_test.go:854: (dbg) Run:  out/minikube-linux-arm64 -p functional-838183 status
functional_test.go:860: (dbg) Run:  out/minikube-linux-arm64 -p functional-838183 status -f host:{{.Host}},kublet:{{.Kubelet}},apiserver:{{.APIServer}},kubeconfig:{{.Kubeconfig}}
functional_test.go:872: (dbg) Run:  out/minikube-linux-arm64 -p functional-838183 status -o json
--- PASS: TestFunctional/parallel/StatusCmd (0.91s)

                                                
                                    
x
+
TestFunctional/parallel/ServiceCmdConnect (6.57s)

                                                
                                                
=== RUN   TestFunctional/parallel/ServiceCmdConnect
=== PAUSE TestFunctional/parallel/ServiceCmdConnect

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/ServiceCmdConnect
functional_test.go:1627: (dbg) Run:  kubectl --context functional-838183 create deployment hello-node-connect --image=registry.k8s.io/echoserver-arm:1.8
functional_test.go:1635: (dbg) Run:  kubectl --context functional-838183 expose deployment hello-node-connect --type=NodePort --port=8080
functional_test.go:1640: (dbg) TestFunctional/parallel/ServiceCmdConnect: waiting 10m0s for pods matching "app=hello-node-connect" in namespace "default" ...
helpers_test.go:344: "hello-node-connect-65d86f57f4-ndfzn" [e579b4bb-cf52-4cd4-81dd-20324642bdca] Pending / Ready:ContainersNotReady (containers with unready status: [echoserver-arm]) / ContainersReady:ContainersNotReady (containers with unready status: [echoserver-arm])
helpers_test.go:344: "hello-node-connect-65d86f57f4-ndfzn" [e579b4bb-cf52-4cd4-81dd-20324642bdca] Running
functional_test.go:1640: (dbg) TestFunctional/parallel/ServiceCmdConnect: app=hello-node-connect healthy within 6.003909592s
functional_test.go:1649: (dbg) Run:  out/minikube-linux-arm64 -p functional-838183 service hello-node-connect --url
functional_test.go:1655: found endpoint for hello-node-connect: http://192.168.49.2:31213
functional_test.go:1675: http://192.168.49.2:31213: success! body:

                                                
                                                

                                                
                                                
Hostname: hello-node-connect-65d86f57f4-ndfzn

                                                
                                                
Pod Information:
	-no pod information available-

                                                
                                                
Server values:
	server_version=nginx: 1.13.3 - lua: 10008

                                                
                                                
Request Information:
	client_address=10.244.0.1
	method=GET
	real path=/
	query=
	request_version=1.1
	request_uri=http://192.168.49.2:8080/

                                                
                                                
Request Headers:
	accept-encoding=gzip
	host=192.168.49.2:31213
	user-agent=Go-http-client/1.1

                                                
                                                
Request Body:
	-no body in request-

                                                
                                                
--- PASS: TestFunctional/parallel/ServiceCmdConnect (6.57s)

                                                
                                    
x
+
TestFunctional/parallel/AddonsCmd (0.14s)

                                                
                                                
=== RUN   TestFunctional/parallel/AddonsCmd
=== PAUSE TestFunctional/parallel/AddonsCmd

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/AddonsCmd
functional_test.go:1690: (dbg) Run:  out/minikube-linux-arm64 -p functional-838183 addons list
functional_test.go:1702: (dbg) Run:  out/minikube-linux-arm64 -p functional-838183 addons list -o json
--- PASS: TestFunctional/parallel/AddonsCmd (0.14s)

                                                
                                    
x
+
TestFunctional/parallel/PersistentVolumeClaim (24.87s)

                                                
                                                
=== RUN   TestFunctional/parallel/PersistentVolumeClaim
=== PAUSE TestFunctional/parallel/PersistentVolumeClaim

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/PersistentVolumeClaim
functional_test_pvc_test.go:44: (dbg) TestFunctional/parallel/PersistentVolumeClaim: waiting 4m0s for pods matching "integration-test=storage-provisioner" in namespace "kube-system" ...
helpers_test.go:344: "storage-provisioner" [4954b548-2354-4fa8-8782-9089a607ce73] Running
functional_test_pvc_test.go:44: (dbg) TestFunctional/parallel/PersistentVolumeClaim: integration-test=storage-provisioner healthy within 5.003770632s
functional_test_pvc_test.go:49: (dbg) Run:  kubectl --context functional-838183 get storageclass -o=json
functional_test_pvc_test.go:69: (dbg) Run:  kubectl --context functional-838183 apply -f testdata/storage-provisioner/pvc.yaml
functional_test_pvc_test.go:76: (dbg) Run:  kubectl --context functional-838183 get pvc myclaim -o=json
functional_test_pvc_test.go:125: (dbg) Run:  kubectl --context functional-838183 apply -f testdata/storage-provisioner/pod.yaml
functional_test_pvc_test.go:130: (dbg) TestFunctional/parallel/PersistentVolumeClaim: waiting 3m0s for pods matching "test=storage-provisioner" in namespace "default" ...
helpers_test.go:344: "sp-pod" [5974363f-3975-4930-9cdc-fff6e0837d90] Pending
helpers_test.go:344: "sp-pod" [5974363f-3975-4930-9cdc-fff6e0837d90] Pending / Ready:ContainersNotReady (containers with unready status: [myfrontend]) / ContainersReady:ContainersNotReady (containers with unready status: [myfrontend])
helpers_test.go:344: "sp-pod" [5974363f-3975-4930-9cdc-fff6e0837d90] Running
functional_test_pvc_test.go:130: (dbg) TestFunctional/parallel/PersistentVolumeClaim: test=storage-provisioner healthy within 11.003960507s
functional_test_pvc_test.go:100: (dbg) Run:  kubectl --context functional-838183 exec sp-pod -- touch /tmp/mount/foo
functional_test_pvc_test.go:106: (dbg) Run:  kubectl --context functional-838183 delete -f testdata/storage-provisioner/pod.yaml
functional_test_pvc_test.go:125: (dbg) Run:  kubectl --context functional-838183 apply -f testdata/storage-provisioner/pod.yaml
functional_test_pvc_test.go:130: (dbg) TestFunctional/parallel/PersistentVolumeClaim: waiting 3m0s for pods matching "test=storage-provisioner" in namespace "default" ...
helpers_test.go:344: "sp-pod" [327bc2be-6111-4f07-be1b-315442d41a70] Pending
helpers_test.go:344: "sp-pod" [327bc2be-6111-4f07-be1b-315442d41a70] Pending / Ready:ContainersNotReady (containers with unready status: [myfrontend]) / ContainersReady:ContainersNotReady (containers with unready status: [myfrontend])
helpers_test.go:344: "sp-pod" [327bc2be-6111-4f07-be1b-315442d41a70] Running
functional_test_pvc_test.go:130: (dbg) TestFunctional/parallel/PersistentVolumeClaim: test=storage-provisioner healthy within 7.003682347s
functional_test_pvc_test.go:114: (dbg) Run:  kubectl --context functional-838183 exec sp-pod -- ls /tmp/mount
--- PASS: TestFunctional/parallel/PersistentVolumeClaim (24.87s)

                                                
                                    
x
+
TestFunctional/parallel/SSHCmd (0.51s)

                                                
                                                
=== RUN   TestFunctional/parallel/SSHCmd
=== PAUSE TestFunctional/parallel/SSHCmd

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/SSHCmd
functional_test.go:1725: (dbg) Run:  out/minikube-linux-arm64 -p functional-838183 ssh "echo hello"
functional_test.go:1742: (dbg) Run:  out/minikube-linux-arm64 -p functional-838183 ssh "cat /etc/hostname"
--- PASS: TestFunctional/parallel/SSHCmd (0.51s)

                                                
                                    
x
+
TestFunctional/parallel/CpCmd (1.86s)

                                                
                                                
=== RUN   TestFunctional/parallel/CpCmd
=== PAUSE TestFunctional/parallel/CpCmd

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/CpCmd
helpers_test.go:556: (dbg) Run:  out/minikube-linux-arm64 -p functional-838183 cp testdata/cp-test.txt /home/docker/cp-test.txt
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p functional-838183 ssh -n functional-838183 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:556: (dbg) Run:  out/minikube-linux-arm64 -p functional-838183 cp functional-838183:/home/docker/cp-test.txt /tmp/TestFunctionalparallelCpCmd3224274255/001/cp-test.txt
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p functional-838183 ssh -n functional-838183 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:556: (dbg) Run:  out/minikube-linux-arm64 -p functional-838183 cp testdata/cp-test.txt /tmp/does/not/exist/cp-test.txt
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p functional-838183 ssh -n functional-838183 "sudo cat /tmp/does/not/exist/cp-test.txt"
--- PASS: TestFunctional/parallel/CpCmd (1.86s)

                                                
                                    
x
+
TestFunctional/parallel/FileSync (0.33s)

                                                
                                                
=== RUN   TestFunctional/parallel/FileSync
=== PAUSE TestFunctional/parallel/FileSync

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/FileSync
functional_test.go:1929: Checking for existence of /etc/test/nested/copy/1873600/hosts within VM
functional_test.go:1931: (dbg) Run:  out/minikube-linux-arm64 -p functional-838183 ssh "sudo cat /etc/test/nested/copy/1873600/hosts"
functional_test.go:1936: file sync test content: Test file for checking file sync process
--- PASS: TestFunctional/parallel/FileSync (0.33s)

                                                
                                    
x
+
TestFunctional/parallel/CertSync (1.99s)

                                                
                                                
=== RUN   TestFunctional/parallel/CertSync
=== PAUSE TestFunctional/parallel/CertSync

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/CertSync
functional_test.go:1972: Checking for existence of /etc/ssl/certs/1873600.pem within VM
functional_test.go:1973: (dbg) Run:  out/minikube-linux-arm64 -p functional-838183 ssh "sudo cat /etc/ssl/certs/1873600.pem"
functional_test.go:1972: Checking for existence of /usr/share/ca-certificates/1873600.pem within VM
functional_test.go:1973: (dbg) Run:  out/minikube-linux-arm64 -p functional-838183 ssh "sudo cat /usr/share/ca-certificates/1873600.pem"
functional_test.go:1972: Checking for existence of /etc/ssl/certs/51391683.0 within VM
functional_test.go:1973: (dbg) Run:  out/minikube-linux-arm64 -p functional-838183 ssh "sudo cat /etc/ssl/certs/51391683.0"
functional_test.go:1999: Checking for existence of /etc/ssl/certs/18736002.pem within VM
functional_test.go:2000: (dbg) Run:  out/minikube-linux-arm64 -p functional-838183 ssh "sudo cat /etc/ssl/certs/18736002.pem"
functional_test.go:1999: Checking for existence of /usr/share/ca-certificates/18736002.pem within VM
functional_test.go:2000: (dbg) Run:  out/minikube-linux-arm64 -p functional-838183 ssh "sudo cat /usr/share/ca-certificates/18736002.pem"
functional_test.go:1999: Checking for existence of /etc/ssl/certs/3ec20f2e.0 within VM
functional_test.go:2000: (dbg) Run:  out/minikube-linux-arm64 -p functional-838183 ssh "sudo cat /etc/ssl/certs/3ec20f2e.0"
--- PASS: TestFunctional/parallel/CertSync (1.99s)

                                                
                                    
x
+
TestFunctional/parallel/NodeLabels (0.08s)

                                                
                                                
=== RUN   TestFunctional/parallel/NodeLabels
=== PAUSE TestFunctional/parallel/NodeLabels

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/NodeLabels
functional_test.go:219: (dbg) Run:  kubectl --context functional-838183 get nodes --output=go-template "--template='{{range $k, $v := (index .items 0).metadata.labels}}{{$k}} {{end}}'"
--- PASS: TestFunctional/parallel/NodeLabels (0.08s)

                                                
                                    
x
+
TestFunctional/parallel/NonActiveRuntimeDisabled (0.68s)

                                                
                                                
=== RUN   TestFunctional/parallel/NonActiveRuntimeDisabled
=== PAUSE TestFunctional/parallel/NonActiveRuntimeDisabled

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/NonActiveRuntimeDisabled
functional_test.go:2027: (dbg) Run:  out/minikube-linux-arm64 -p functional-838183 ssh "sudo systemctl is-active docker"
functional_test.go:2027: (dbg) Non-zero exit: out/minikube-linux-arm64 -p functional-838183 ssh "sudo systemctl is-active docker": exit status 1 (350.658082ms)

                                                
                                                
-- stdout --
	inactive

                                                
                                                
-- /stdout --
** stderr ** 
	ssh: Process exited with status 3

                                                
                                                
** /stderr **
functional_test.go:2027: (dbg) Run:  out/minikube-linux-arm64 -p functional-838183 ssh "sudo systemctl is-active containerd"
functional_test.go:2027: (dbg) Non-zero exit: out/minikube-linux-arm64 -p functional-838183 ssh "sudo systemctl is-active containerd": exit status 1 (327.352212ms)

                                                
                                                
-- stdout --
	inactive

                                                
                                                
-- /stdout --
** stderr ** 
	ssh: Process exited with status 3

                                                
                                                
** /stderr **
--- PASS: TestFunctional/parallel/NonActiveRuntimeDisabled (0.68s)

                                                
                                    
x
+
TestFunctional/parallel/License (0.31s)

                                                
                                                
=== RUN   TestFunctional/parallel/License
=== PAUSE TestFunctional/parallel/License

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/License
functional_test.go:2288: (dbg) Run:  out/minikube-linux-arm64 license
--- PASS: TestFunctional/parallel/License (0.31s)

                                                
                                    
x
+
TestFunctional/parallel/Version/short (0.08s)

                                                
                                                
=== RUN   TestFunctional/parallel/Version/short
=== PAUSE TestFunctional/parallel/Version/short

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/Version/short
functional_test.go:2256: (dbg) Run:  out/minikube-linux-arm64 -p functional-838183 version --short
--- PASS: TestFunctional/parallel/Version/short (0.08s)

                                                
                                    
x
+
TestFunctional/parallel/Version/components (1.07s)

                                                
                                                
=== RUN   TestFunctional/parallel/Version/components
=== PAUSE TestFunctional/parallel/Version/components

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/Version/components
functional_test.go:2270: (dbg) Run:  out/minikube-linux-arm64 -p functional-838183 version -o=json --components
functional_test.go:2270: (dbg) Done: out/minikube-linux-arm64 -p functional-838183 version -o=json --components: (1.065333082s)
--- PASS: TestFunctional/parallel/Version/components (1.07s)

                                                
                                    
x
+
TestFunctional/parallel/ImageCommands/ImageListShort (0.28s)

                                                
                                                
=== RUN   TestFunctional/parallel/ImageCommands/ImageListShort
=== PAUSE TestFunctional/parallel/ImageCommands/ImageListShort

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/ImageCommands/ImageListShort
functional_test.go:261: (dbg) Run:  out/minikube-linux-arm64 -p functional-838183 image ls --format short --alsologtostderr
functional_test.go:266: (dbg) Stdout: out/minikube-linux-arm64 -p functional-838183 image ls --format short --alsologtostderr:
registry.k8s.io/pause:latest
registry.k8s.io/pause:3.3
registry.k8s.io/pause:3.10
registry.k8s.io/pause:3.1
registry.k8s.io/kube-scheduler:v1.31.1
registry.k8s.io/kube-proxy:v1.31.1
registry.k8s.io/kube-controller-manager:v1.31.1
registry.k8s.io/kube-apiserver:v1.31.1
registry.k8s.io/etcd:3.5.15-0
registry.k8s.io/echoserver-arm:1.8
registry.k8s.io/coredns/coredns:v1.11.3
localhost/minikube-local-cache-test:functional-838183
localhost/kicbase/echo-server:functional-838183
gcr.io/k8s-minikube/storage-provisioner:v5
gcr.io/k8s-minikube/busybox:1.28.4-glibc
docker.io/library/nginx:latest
docker.io/library/nginx:alpine
docker.io/kindest/kindnetd:v20240813-c6f155d6
functional_test.go:269: (dbg) Stderr: out/minikube-linux-arm64 -p functional-838183 image ls --format short --alsologtostderr:
I0924 00:58:44.367395 1904426 out.go:345] Setting OutFile to fd 1 ...
I0924 00:58:44.367613 1904426 out.go:392] TERM=,COLORTERM=, which probably does not support color
I0924 00:58:44.367647 1904426 out.go:358] Setting ErrFile to fd 2...
I0924 00:58:44.367670 1904426 out.go:392] TERM=,COLORTERM=, which probably does not support color
I0924 00:58:44.368037 1904426 root.go:338] Updating PATH: /home/jenkins/minikube-integration/19696-1868219/.minikube/bin
I0924 00:58:44.370516 1904426 config.go:182] Loaded profile config "functional-838183": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.31.1
I0924 00:58:44.371301 1904426 config.go:182] Loaded profile config "functional-838183": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.31.1
I0924 00:58:44.373834 1904426 cli_runner.go:164] Run: docker container inspect functional-838183 --format={{.State.Status}}
I0924 00:58:44.400473 1904426 ssh_runner.go:195] Run: systemctl --version
I0924 00:58:44.400532 1904426 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" functional-838183
I0924 00:58:44.423570 1904426 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:34701 SSHKeyPath:/home/jenkins/minikube-integration/19696-1868219/.minikube/machines/functional-838183/id_rsa Username:docker}
I0924 00:58:44.514338 1904426 ssh_runner.go:195] Run: sudo crictl images --output json
--- PASS: TestFunctional/parallel/ImageCommands/ImageListShort (0.28s)

                                                
                                    
x
+
TestFunctional/parallel/ImageCommands/ImageListTable (0.28s)

                                                
                                                
=== RUN   TestFunctional/parallel/ImageCommands/ImageListTable
=== PAUSE TestFunctional/parallel/ImageCommands/ImageListTable

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/ImageCommands/ImageListTable
functional_test.go:261: (dbg) Run:  out/minikube-linux-arm64 -p functional-838183 image ls --format table --alsologtostderr
functional_test.go:266: (dbg) Stdout: out/minikube-linux-arm64 -p functional-838183 image ls --format table --alsologtostderr:
|-----------------------------------------|--------------------|---------------|--------|
|                  Image                  |        Tag         |   Image ID    |  Size  |
|-----------------------------------------|--------------------|---------------|--------|
| docker.io/library/nginx                 | latest             | 195245f0c7927 | 197MB  |
| registry.k8s.io/echoserver-arm          | 1.8                | 72565bf5bbedf | 87.5MB |
| registry.k8s.io/kube-apiserver          | v1.31.1            | d3f53a98c0a9d | 92.6MB |
| docker.io/kindest/kindnetd              | v20240813-c6f155d6 | 6a23fa8fd2b78 | 90.3MB |
| registry.k8s.io/kube-proxy              | v1.31.1            | 24a140c548c07 | 96MB   |
| registry.k8s.io/pause                   | 3.1                | 8057e0500773a | 529kB  |
| registry.k8s.io/pause                   | 3.3                | 3d18732f8686c | 487kB  |
| registry.k8s.io/pause                   | latest             | 8cb2091f603e7 | 246kB  |
| registry.k8s.io/etcd                    | 3.5.15-0           | 27e3830e14027 | 140MB  |
| docker.io/library/nginx                 | alpine             | b887aca7aed61 | 48.4MB |
| gcr.io/k8s-minikube/storage-provisioner | v5                 | ba04bb24b9575 | 29MB   |
| localhost/kicbase/echo-server           | functional-838183  | ce2d2cda2d858 | 4.79MB |
| localhost/minikube-local-cache-test     | functional-838183  | 2b2c6a8985c07 | 3.33kB |
| localhost/my-image                      | functional-838183  | 432f08b7d9160 | 1.64MB |
| registry.k8s.io/pause                   | 3.10               | afb61768ce381 | 520kB  |
| gcr.io/k8s-minikube/busybox             | 1.28.4-glibc       | 1611cd07b61d5 | 3.77MB |
| gcr.io/k8s-minikube/busybox             | latest             | 71a676dd070f4 | 1.63MB |
| registry.k8s.io/coredns/coredns         | v1.11.3            | 2f6c962e7b831 | 61.6MB |
| registry.k8s.io/kube-controller-manager | v1.31.1            | 279f381cb3736 | 86.9MB |
| registry.k8s.io/kube-scheduler          | v1.31.1            | 7f8aa378bb47d | 67MB   |
|-----------------------------------------|--------------------|---------------|--------|
functional_test.go:269: (dbg) Stderr: out/minikube-linux-arm64 -p functional-838183 image ls --format table --alsologtostderr:
I0924 00:58:50.885918 1904877 out.go:345] Setting OutFile to fd 1 ...
I0924 00:58:50.886146 1904877 out.go:392] TERM=,COLORTERM=, which probably does not support color
I0924 00:58:50.886172 1904877 out.go:358] Setting ErrFile to fd 2...
I0924 00:58:50.886192 1904877 out.go:392] TERM=,COLORTERM=, which probably does not support color
I0924 00:58:50.886472 1904877 root.go:338] Updating PATH: /home/jenkins/minikube-integration/19696-1868219/.minikube/bin
I0924 00:58:50.887116 1904877 config.go:182] Loaded profile config "functional-838183": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.31.1
I0924 00:58:50.887297 1904877 config.go:182] Loaded profile config "functional-838183": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.31.1
I0924 00:58:50.887812 1904877 cli_runner.go:164] Run: docker container inspect functional-838183 --format={{.State.Status}}
I0924 00:58:50.920867 1904877 ssh_runner.go:195] Run: systemctl --version
I0924 00:58:50.920929 1904877 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" functional-838183
I0924 00:58:50.943411 1904877 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:34701 SSHKeyPath:/home/jenkins/minikube-integration/19696-1868219/.minikube/machines/functional-838183/id_rsa Username:docker}
I0924 00:58:51.038652 1904877 ssh_runner.go:195] Run: sudo crictl images --output json
2024/09/24 00:58:52 [DEBUG] GET http://127.0.0.1:36195/api/v1/namespaces/kubernetes-dashboard/services/http:kubernetes-dashboard:/proxy/
--- PASS: TestFunctional/parallel/ImageCommands/ImageListTable (0.28s)

                                                
                                    
x
+
TestFunctional/parallel/ImageCommands/ImageListJson (0.25s)

                                                
                                                
=== RUN   TestFunctional/parallel/ImageCommands/ImageListJson
=== PAUSE TestFunctional/parallel/ImageCommands/ImageListJson

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/ImageCommands/ImageListJson
functional_test.go:261: (dbg) Run:  out/minikube-linux-arm64 -p functional-838183 image ls --format json --alsologtostderr
functional_test.go:266: (dbg) Stdout: out/minikube-linux-arm64 -p functional-838183 image ls --format json --alsologtostderr:
[{"id":"72565bf5bbedfb62e9d21afa2b1221b2c7a5e05b746dae33430bc550d3f87beb","repoDigests":["registry.k8s.io/echoserver-arm@sha256:b33d4cdf6ed097f4e9b77b135d83a596ab73c6268b0342648818eb85f5edfdb5"],"repoTags":["registry.k8s.io/echoserver-arm:1.8"],"size":"87536549"},{"id":"24a140c548c075e487e45d0ee73b1aa89f8bfb40c08a57e05975559728822b1d","repoDigests":["registry.k8s.io/kube-proxy@sha256:4ee50b00484d7f39a90fc4cda92251177ef5ad8fdf2f2a0c768f9e634b4c6d44","registry.k8s.io/kube-proxy@sha256:7b3bf9f1e260ccb1fd543570e1e9869a373f716fb050cd23a6a2771aa4e06ae9"],"repoTags":["registry.k8s.io/kube-proxy:v1.31.1"],"size":"95951255"},{"id":"7f8aa378bb47dffcf430f3a601abe39137e88aee0238e23ed8530fdd18dab82d","repoDigests":["registry.k8s.io/kube-scheduler@sha256:65212209347a96b08a97e679b98dca46885f09cf3a53e8d13b28d2c083a5b690","registry.k8s.io/kube-scheduler@sha256:969a7e96340f3a927b3d652582edec2d6d82a083871d81ef5064b7edaab430d0"],"repoTags":["registry.k8s.io/kube-scheduler:v1.31.1"],"size":"67007814"},{"id":"8cb2091f603e7
5187e2f6226c5901d12e00b1d1f778c6471ae4578e8a1c4724a","repoDigests":["registry.k8s.io/pause@sha256:f5e31d44aa14d5669e030380b656463a7e45934c03994e72e3dbf83d4a645cca"],"repoTags":["registry.k8s.io/pause:latest"],"size":"246070"},{"id":"20b332c9a70d8516d849d1ac23eff5800cbb2f263d379f0ec11ee908db6b25a8","repoDigests":["docker.io/kubernetesui/dashboard@sha256:2e500d29e9d5f4a086b908eb8dfe7ecac57d2ab09d65b24f588b1d449841ef93","docker.io/kubernetesui/dashboard@sha256:5c52c60663b473628bd98e4ffee7a747ef1f88d8c7bcee957b089fb3f61bdedf"],"repoTags":[],"size":"247562353"},{"id":"195245f0c79279e8b8e012efa02c91dad4cf7d0e44c0f4382fea68cd93088e6c","repoDigests":["docker.io/library/nginx@sha256:04ba374043ccd2fc5c593885c0eacddebabd5ca375f9323666f28dfd5a9710e3","docker.io/library/nginx@sha256:9f661996f4d1cea788f329b8145660a1124a5a94eec8cea1dba0d564423ad171"],"repoTags":["docker.io/library/nginx:latest"],"size":"197172029"},{"id":"432f08b7d91605b7859db7ca40ccf24a73e9e34917dc5f67f63d062fcaf2cc4e","repoDigests":["localhost/my-image@sh
a256:5f784ae8af6df64f3d5d3eeb17f31a67e86666dd8754c504169812dfb3b7d4db"],"repoTags":["localhost/my-image:functional-838183"],"size":"1640226"},{"id":"279f381cb37365bbbcd133c9531fba9c2beb0f38dbbe6ddfcd0b1b1643d3450e","repoDigests":["registry.k8s.io/kube-controller-manager@sha256:9f9da5b27e03f89599cc40ba89150aebf3b4cff001e6db6d998674b34181e1a1","registry.k8s.io/kube-controller-manager@sha256:a9a0505b7d0caca0edd18e37bacc9425b2c8824546b26f5b286e8cb144669849"],"repoTags":["registry.k8s.io/kube-controller-manager:v1.31.1"],"size":"86930758"},{"id":"8057e0500773a37cde2cff041eb13ebd68c748419a2fbfd1dfb5bf38696cc8e5","repoDigests":["registry.k8s.io/pause@sha256:b0602c9f938379133ff8017007894b48c1112681c9468f82a1e4cbf8a4498b67"],"repoTags":["registry.k8s.io/pause:3.1"],"size":"528622"},{"id":"ba04bb24b95753201135cbc420b233c1b0b9fa2e1fd21d28319c348c33fbcde6","repoDigests":["gcr.io/k8s-minikube/storage-provisioner@sha256:0ba370588274b88531ab311a5d2e645d240a853555c1e58fd1dd428fc333c9d2","gcr.io/k8s-minikube/storage-provision
er@sha256:18eb69d1418e854ad5a19e399310e52808a8321e4c441c1dddad8977a0d7a944"],"repoTags":["gcr.io/k8s-minikube/storage-provisioner:v5"],"size":"29037500"},{"id":"2b2c6a8985c0768d0ae2ef6ad669ebaa0765fce5e1fb51bbc42a80bce0142dfc","repoDigests":["localhost/minikube-local-cache-test@sha256:b4c0bdd260ef15b6619881e76c430507db0bd5bdda1b6e960c4a74b8c31594ac"],"repoTags":["localhost/minikube-local-cache-test:functional-838183"],"size":"3330"},{"id":"27e3830e1402783674d8b594038967deea9d51f0d91b34c93c8f39d2f68af7da","repoDigests":["registry.k8s.io/etcd@sha256:a6dc63e6e8cfa0307d7851762fa6b629afb18f28d8aa3fab5a6e91b4af60026a","registry.k8s.io/etcd@sha256:e3ee3ca2dbaf511385000dbd54123629c71b6cfaabd469e658d76a116b7f43da"],"repoTags":["registry.k8s.io/etcd:3.5.15-0"],"size":"139912446"},{"id":"b887aca7aed6134b029401507d27ac9c8fbfc5a6cf510d254bdf4ac841cf1552","repoDigests":["docker.io/library/nginx@sha256:19db381c08a95b2040d5637a65c7a59af6c2f21444b0c8730505280a0255fb53","docker.io/library/nginx@sha256:a5127daff3d6f4606be3100a2
52419bfa84fd6ee5cd74d0feaca1a5068f97dcf"],"repoTags":["docker.io/library/nginx:alpine"],"size":"48375489"},{"id":"1611cd07b61d57dbbfebe6db242513fd51e1c02d20ba08af17a45837d86a8a8c","repoDigests":["gcr.io/k8s-minikube/busybox@sha256:2d03e6ceeb99250061dd110530b0ece7998cd84121f952adef120ea7c5a6f00e","gcr.io/k8s-minikube/busybox@sha256:580b0aa58b210f512f818b7b7ef4f63c803f7a8cd6baf571b1462b79f7b7719e"],"repoTags":["gcr.io/k8s-minikube/busybox:1.28.4-glibc"],"size":"3774172"},{"id":"71a676dd070f4b701c3272e566d84951362f1326ea07d5bbad119d1c4f6b3d02","repoDigests":["gcr.io/k8s-minikube/busybox@sha256:a77fe109c026308f149d36484d795b42efe0fd29b332be9071f63e1634c36ac9","gcr.io/k8s-minikube/busybox@sha256:ca5ae90100d50772da31f3b5016209e25ad61972404e2ccd83d44f10dee7e79b"],"repoTags":["gcr.io/k8s-minikube/busybox:latest"],"size":"1634527"},{"id":"ce2d2cda2d858fdaea84129deb86d18e5dbf1c548f230b79fdca74cc91729d17","repoDigests":["localhost/kicbase/echo-server@sha256:49260110d6ce1914d3de292ed370ee11a2e34ab577b97e6011d795cb13534d4
a"],"repoTags":["localhost/kicbase/echo-server:functional-838183"],"size":"4788229"},{"id":"afb61768ce381961ca0beff95337601f29dc70ff3ed14e5e4b3e5699057e6aa8","repoDigests":["registry.k8s.io/pause@sha256:e50b7059b633caf3c1449b8da680d11845cda4506b513ee7a2de00725f0a34a7","registry.k8s.io/pause@sha256:ee6521f290b2168b6e0935a181d4cff9be1ac3f505666ef0e3c98fae8199917a"],"repoTags":["registry.k8s.io/pause:3.10"],"size":"519877"},{"id":"6a23fa8fd2b78ab58e42ba273808edc936a9c53d8ac4a919f6337be094843a51","repoDigests":["docker.io/kindest/kindnetd@sha256:4d39335073da9a0b82be8e01028f0aa75aff16caff2e2d8889d0effd579a6f64","docker.io/kindest/kindnetd@sha256:e59a687ca28ae274a2fc92f1e2f5f1c739f353178a43a23aafc71adb802ed166"],"repoTags":["docker.io/kindest/kindnetd:v20240813-c6f155d6"],"size":"90295858"},{"id":"a422e0e982356f6c1cf0e5bb7b733363caae3992a07c99951fbcc73e58ed656a","repoDigests":["docker.io/kubernetesui/metrics-scraper@sha256:76049887f07a0476dc93efc2d3569b9529bf982b22d29f356092ce206e98765c","docker.io/kubernetesui/met
rics-scraper@sha256:853c43f3cced687cb211708aa0024304a5adb33ec45ebf5915d318358822e09a"],"repoTags":[],"size":"42263767"},{"id":"068079fe3d29b0b1d6ac904f18f267f86bbfcf833d93bcbcc670e0c419bbe518","repoDigests":["docker.io/library/591beff10091022b5c8cc07ebbc70ea00b311f176bc1ae73338a00d4918806ae-tmp@sha256:50d70721adc90d52a92217179c1346436a064a24bf11454dd250ed4b56be1326"],"repoTags":[],"size":"1637644"},{"id":"3d18732f8686cc3c878055d99a05fa80289502fa496b36b6a0fe0f77206a7300","repoDigests":["registry.k8s.io/pause@sha256:e59730b14890252c14f85976e22ab1c47ec28b111ffed407f34bca1b44447476"],"repoTags":["registry.k8s.io/pause:3.3"],"size":"487479"},{"id":"2f6c962e7b8311337352d9fdea917da2184d9919f4da7695bc2a6517cf392fe4","repoDigests":["registry.k8s.io/coredns/coredns@sha256:31440a2bef59e2f1ffb600113b557103740ff851e27b0aef5b849f6e3ab994a6","registry.k8s.io/coredns/coredns@sha256:9caabbf6238b189a65d0d6e6ac138de60d6a1c419e5a341fbbb7c78382559c6e"],"repoTags":["registry.k8s.io/coredns/coredns:v1.11.3"],"size":"61647114"},{"id
":"d3f53a98c0a9d9163c4848bcf34b2d2f5e1e3691b79f3d1dd6d0206809e02853","repoDigests":["registry.k8s.io/kube-apiserver@sha256:2409c23dbb5a2b7a81adbb184d3eac43ac653e9b97a7c0ee121b89bb3ef61fdb","registry.k8s.io/kube-apiserver@sha256:e3a40e6c6e99ba4a4d72432b3eda702099a2926e49d4afeb6138f2d95e6371ef"],"repoTags":["registry.k8s.io/kube-apiserver:v1.31.1"],"size":"92632544"}]
functional_test.go:269: (dbg) Stderr: out/minikube-linux-arm64 -p functional-838183 image ls --format json --alsologtostderr:
I0924 00:58:50.630217 1904844 out.go:345] Setting OutFile to fd 1 ...
I0924 00:58:50.630447 1904844 out.go:392] TERM=,COLORTERM=, which probably does not support color
I0924 00:58:50.630495 1904844 out.go:358] Setting ErrFile to fd 2...
I0924 00:58:50.630515 1904844 out.go:392] TERM=,COLORTERM=, which probably does not support color
I0924 00:58:50.630752 1904844 root.go:338] Updating PATH: /home/jenkins/minikube-integration/19696-1868219/.minikube/bin
I0924 00:58:50.631404 1904844 config.go:182] Loaded profile config "functional-838183": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.31.1
I0924 00:58:50.631596 1904844 config.go:182] Loaded profile config "functional-838183": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.31.1
I0924 00:58:50.632111 1904844 cli_runner.go:164] Run: docker container inspect functional-838183 --format={{.State.Status}}
I0924 00:58:50.657415 1904844 ssh_runner.go:195] Run: systemctl --version
I0924 00:58:50.657468 1904844 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" functional-838183
I0924 00:58:50.676374 1904844 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:34701 SSHKeyPath:/home/jenkins/minikube-integration/19696-1868219/.minikube/machines/functional-838183/id_rsa Username:docker}
I0924 00:58:50.766929 1904844 ssh_runner.go:195] Run: sudo crictl images --output json
--- PASS: TestFunctional/parallel/ImageCommands/ImageListJson (0.25s)

                                                
                                    
x
+
TestFunctional/parallel/ImageCommands/ImageListYaml (0.27s)

                                                
                                                
=== RUN   TestFunctional/parallel/ImageCommands/ImageListYaml
=== PAUSE TestFunctional/parallel/ImageCommands/ImageListYaml

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/ImageCommands/ImageListYaml
functional_test.go:261: (dbg) Run:  out/minikube-linux-arm64 -p functional-838183 image ls --format yaml --alsologtostderr
functional_test.go:266: (dbg) Stdout: out/minikube-linux-arm64 -p functional-838183 image ls --format yaml --alsologtostderr:
- id: a422e0e982356f6c1cf0e5bb7b733363caae3992a07c99951fbcc73e58ed656a
repoDigests:
- docker.io/kubernetesui/metrics-scraper@sha256:76049887f07a0476dc93efc2d3569b9529bf982b22d29f356092ce206e98765c
- docker.io/kubernetesui/metrics-scraper@sha256:853c43f3cced687cb211708aa0024304a5adb33ec45ebf5915d318358822e09a
repoTags: []
size: "42263767"
- id: 068079fe3d29b0b1d6ac904f18f267f86bbfcf833d93bcbcc670e0c419bbe518
repoDigests:
- docker.io/library/591beff10091022b5c8cc07ebbc70ea00b311f176bc1ae73338a00d4918806ae-tmp@sha256:50d70721adc90d52a92217179c1346436a064a24bf11454dd250ed4b56be1326
repoTags: []
size: "1637644"
- id: 1611cd07b61d57dbbfebe6db242513fd51e1c02d20ba08af17a45837d86a8a8c
repoDigests:
- gcr.io/k8s-minikube/busybox@sha256:2d03e6ceeb99250061dd110530b0ece7998cd84121f952adef120ea7c5a6f00e
- gcr.io/k8s-minikube/busybox@sha256:580b0aa58b210f512f818b7b7ef4f63c803f7a8cd6baf571b1462b79f7b7719e
repoTags:
- gcr.io/k8s-minikube/busybox:1.28.4-glibc
size: "3774172"
- id: 2b2c6a8985c0768d0ae2ef6ad669ebaa0765fce5e1fb51bbc42a80bce0142dfc
repoDigests:
- localhost/minikube-local-cache-test@sha256:b4c0bdd260ef15b6619881e76c430507db0bd5bdda1b6e960c4a74b8c31594ac
repoTags:
- localhost/minikube-local-cache-test:functional-838183
size: "3330"
- id: 8cb2091f603e75187e2f6226c5901d12e00b1d1f778c6471ae4578e8a1c4724a
repoDigests:
- registry.k8s.io/pause@sha256:f5e31d44aa14d5669e030380b656463a7e45934c03994e72e3dbf83d4a645cca
repoTags:
- registry.k8s.io/pause:latest
size: "246070"
- id: 6a23fa8fd2b78ab58e42ba273808edc936a9c53d8ac4a919f6337be094843a51
repoDigests:
- docker.io/kindest/kindnetd@sha256:4d39335073da9a0b82be8e01028f0aa75aff16caff2e2d8889d0effd579a6f64
- docker.io/kindest/kindnetd@sha256:e59a687ca28ae274a2fc92f1e2f5f1c739f353178a43a23aafc71adb802ed166
repoTags:
- docker.io/kindest/kindnetd:v20240813-c6f155d6
size: "90295858"
- id: b887aca7aed6134b029401507d27ac9c8fbfc5a6cf510d254bdf4ac841cf1552
repoDigests:
- docker.io/library/nginx@sha256:19db381c08a95b2040d5637a65c7a59af6c2f21444b0c8730505280a0255fb53
- docker.io/library/nginx@sha256:a5127daff3d6f4606be3100a252419bfa84fd6ee5cd74d0feaca1a5068f97dcf
repoTags:
- docker.io/library/nginx:alpine
size: "48375489"
- id: 71a676dd070f4b701c3272e566d84951362f1326ea07d5bbad119d1c4f6b3d02
repoDigests:
- gcr.io/k8s-minikube/busybox@sha256:a77fe109c026308f149d36484d795b42efe0fd29b332be9071f63e1634c36ac9
- gcr.io/k8s-minikube/busybox@sha256:ca5ae90100d50772da31f3b5016209e25ad61972404e2ccd83d44f10dee7e79b
repoTags:
- gcr.io/k8s-minikube/busybox:latest
size: "1634527"
- id: ce2d2cda2d858fdaea84129deb86d18e5dbf1c548f230b79fdca74cc91729d17
repoDigests:
- localhost/kicbase/echo-server@sha256:49260110d6ce1914d3de292ed370ee11a2e34ab577b97e6011d795cb13534d4a
repoTags:
- localhost/kicbase/echo-server:functional-838183
size: "4788229"
- id: d3f53a98c0a9d9163c4848bcf34b2d2f5e1e3691b79f3d1dd6d0206809e02853
repoDigests:
- registry.k8s.io/kube-apiserver@sha256:2409c23dbb5a2b7a81adbb184d3eac43ac653e9b97a7c0ee121b89bb3ef61fdb
- registry.k8s.io/kube-apiserver@sha256:e3a40e6c6e99ba4a4d72432b3eda702099a2926e49d4afeb6138f2d95e6371ef
repoTags:
- registry.k8s.io/kube-apiserver:v1.31.1
size: "92632544"
- id: 279f381cb37365bbbcd133c9531fba9c2beb0f38dbbe6ddfcd0b1b1643d3450e
repoDigests:
- registry.k8s.io/kube-controller-manager@sha256:9f9da5b27e03f89599cc40ba89150aebf3b4cff001e6db6d998674b34181e1a1
- registry.k8s.io/kube-controller-manager@sha256:a9a0505b7d0caca0edd18e37bacc9425b2c8824546b26f5b286e8cb144669849
repoTags:
- registry.k8s.io/kube-controller-manager:v1.31.1
size: "86930758"
- id: 20b332c9a70d8516d849d1ac23eff5800cbb2f263d379f0ec11ee908db6b25a8
repoDigests:
- docker.io/kubernetesui/dashboard@sha256:2e500d29e9d5f4a086b908eb8dfe7ecac57d2ab09d65b24f588b1d449841ef93
- docker.io/kubernetesui/dashboard@sha256:5c52c60663b473628bd98e4ffee7a747ef1f88d8c7bcee957b089fb3f61bdedf
repoTags: []
size: "247562353"
- id: 195245f0c79279e8b8e012efa02c91dad4cf7d0e44c0f4382fea68cd93088e6c
repoDigests:
- docker.io/library/nginx@sha256:04ba374043ccd2fc5c593885c0eacddebabd5ca375f9323666f28dfd5a9710e3
- docker.io/library/nginx@sha256:9f661996f4d1cea788f329b8145660a1124a5a94eec8cea1dba0d564423ad171
repoTags:
- docker.io/library/nginx:latest
size: "197172029"
- id: 24a140c548c075e487e45d0ee73b1aa89f8bfb40c08a57e05975559728822b1d
repoDigests:
- registry.k8s.io/kube-proxy@sha256:4ee50b00484d7f39a90fc4cda92251177ef5ad8fdf2f2a0c768f9e634b4c6d44
- registry.k8s.io/kube-proxy@sha256:7b3bf9f1e260ccb1fd543570e1e9869a373f716fb050cd23a6a2771aa4e06ae9
repoTags:
- registry.k8s.io/kube-proxy:v1.31.1
size: "95951255"
- id: 7f8aa378bb47dffcf430f3a601abe39137e88aee0238e23ed8530fdd18dab82d
repoDigests:
- registry.k8s.io/kube-scheduler@sha256:65212209347a96b08a97e679b98dca46885f09cf3a53e8d13b28d2c083a5b690
- registry.k8s.io/kube-scheduler@sha256:969a7e96340f3a927b3d652582edec2d6d82a083871d81ef5064b7edaab430d0
repoTags:
- registry.k8s.io/kube-scheduler:v1.31.1
size: "67007814"
- id: 8057e0500773a37cde2cff041eb13ebd68c748419a2fbfd1dfb5bf38696cc8e5
repoDigests:
- registry.k8s.io/pause@sha256:b0602c9f938379133ff8017007894b48c1112681c9468f82a1e4cbf8a4498b67
repoTags:
- registry.k8s.io/pause:3.1
size: "528622"
- id: afb61768ce381961ca0beff95337601f29dc70ff3ed14e5e4b3e5699057e6aa8
repoDigests:
- registry.k8s.io/pause@sha256:e50b7059b633caf3c1449b8da680d11845cda4506b513ee7a2de00725f0a34a7
- registry.k8s.io/pause@sha256:ee6521f290b2168b6e0935a181d4cff9be1ac3f505666ef0e3c98fae8199917a
repoTags:
- registry.k8s.io/pause:3.10
size: "519877"
- id: 3d18732f8686cc3c878055d99a05fa80289502fa496b36b6a0fe0f77206a7300
repoDigests:
- registry.k8s.io/pause@sha256:e59730b14890252c14f85976e22ab1c47ec28b111ffed407f34bca1b44447476
repoTags:
- registry.k8s.io/pause:3.3
size: "487479"
- id: ba04bb24b95753201135cbc420b233c1b0b9fa2e1fd21d28319c348c33fbcde6
repoDigests:
- gcr.io/k8s-minikube/storage-provisioner@sha256:0ba370588274b88531ab311a5d2e645d240a853555c1e58fd1dd428fc333c9d2
- gcr.io/k8s-minikube/storage-provisioner@sha256:18eb69d1418e854ad5a19e399310e52808a8321e4c441c1dddad8977a0d7a944
repoTags:
- gcr.io/k8s-minikube/storage-provisioner:v5
size: "29037500"
- id: 432f08b7d91605b7859db7ca40ccf24a73e9e34917dc5f67f63d062fcaf2cc4e
repoDigests:
- localhost/my-image@sha256:5f784ae8af6df64f3d5d3eeb17f31a67e86666dd8754c504169812dfb3b7d4db
repoTags:
- localhost/my-image:functional-838183
size: "1640226"
- id: 2f6c962e7b8311337352d9fdea917da2184d9919f4da7695bc2a6517cf392fe4
repoDigests:
- registry.k8s.io/coredns/coredns@sha256:31440a2bef59e2f1ffb600113b557103740ff851e27b0aef5b849f6e3ab994a6
- registry.k8s.io/coredns/coredns@sha256:9caabbf6238b189a65d0d6e6ac138de60d6a1c419e5a341fbbb7c78382559c6e
repoTags:
- registry.k8s.io/coredns/coredns:v1.11.3
size: "61647114"
- id: 72565bf5bbedfb62e9d21afa2b1221b2c7a5e05b746dae33430bc550d3f87beb
repoDigests:
- registry.k8s.io/echoserver-arm@sha256:b33d4cdf6ed097f4e9b77b135d83a596ab73c6268b0342648818eb85f5edfdb5
repoTags:
- registry.k8s.io/echoserver-arm:1.8
size: "87536549"
- id: 27e3830e1402783674d8b594038967deea9d51f0d91b34c93c8f39d2f68af7da
repoDigests:
- registry.k8s.io/etcd@sha256:a6dc63e6e8cfa0307d7851762fa6b629afb18f28d8aa3fab5a6e91b4af60026a
- registry.k8s.io/etcd@sha256:e3ee3ca2dbaf511385000dbd54123629c71b6cfaabd469e658d76a116b7f43da
repoTags:
- registry.k8s.io/etcd:3.5.15-0
size: "139912446"

                                                
                                                
functional_test.go:269: (dbg) Stderr: out/minikube-linux-arm64 -p functional-838183 image ls --format yaml --alsologtostderr:
I0924 00:58:50.353510 1904774 out.go:345] Setting OutFile to fd 1 ...
I0924 00:58:50.353681 1904774 out.go:392] TERM=,COLORTERM=, which probably does not support color
I0924 00:58:50.353702 1904774 out.go:358] Setting ErrFile to fd 2...
I0924 00:58:50.353725 1904774 out.go:392] TERM=,COLORTERM=, which probably does not support color
I0924 00:58:50.354021 1904774 root.go:338] Updating PATH: /home/jenkins/minikube-integration/19696-1868219/.minikube/bin
I0924 00:58:50.354708 1904774 config.go:182] Loaded profile config "functional-838183": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.31.1
I0924 00:58:50.354855 1904774 config.go:182] Loaded profile config "functional-838183": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.31.1
I0924 00:58:50.355385 1904774 cli_runner.go:164] Run: docker container inspect functional-838183 --format={{.State.Status}}
I0924 00:58:50.378056 1904774 ssh_runner.go:195] Run: systemctl --version
I0924 00:58:50.378112 1904774 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" functional-838183
I0924 00:58:50.406496 1904774 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:34701 SSHKeyPath:/home/jenkins/minikube-integration/19696-1868219/.minikube/machines/functional-838183/id_rsa Username:docker}
I0924 00:58:50.517580 1904774 ssh_runner.go:195] Run: sudo crictl images --output json
--- PASS: TestFunctional/parallel/ImageCommands/ImageListYaml (0.27s)

                                                
                                    
x
+
TestFunctional/parallel/ImageCommands/ImageBuild (5.74s)

                                                
                                                
=== RUN   TestFunctional/parallel/ImageCommands/ImageBuild
=== PAUSE TestFunctional/parallel/ImageCommands/ImageBuild

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/ImageCommands/ImageBuild
functional_test.go:308: (dbg) Run:  out/minikube-linux-arm64 -p functional-838183 ssh pgrep buildkitd
functional_test.go:308: (dbg) Non-zero exit: out/minikube-linux-arm64 -p functional-838183 ssh pgrep buildkitd: exit status 1 (267.277005ms)

                                                
                                                
** stderr ** 
	ssh: Process exited with status 1

                                                
                                                
** /stderr **
functional_test.go:315: (dbg) Run:  out/minikube-linux-arm64 -p functional-838183 image build -t localhost/my-image:functional-838183 testdata/build --alsologtostderr
functional_test.go:315: (dbg) Done: out/minikube-linux-arm64 -p functional-838183 image build -t localhost/my-image:functional-838183 testdata/build --alsologtostderr: (3.45868442s)
functional_test.go:320: (dbg) Stdout: out/minikube-linux-arm64 -p functional-838183 image build -t localhost/my-image:functional-838183 testdata/build --alsologtostderr:
STEP 1/3: FROM gcr.io/k8s-minikube/busybox
STEP 2/3: RUN true
--> 068079fe3d2
STEP 3/3: ADD content.txt /
COMMIT localhost/my-image:functional-838183
--> 432f08b7d91
Successfully tagged localhost/my-image:functional-838183
432f08b7d91605b7859db7ca40ccf24a73e9e34917dc5f67f63d062fcaf2cc4e
functional_test.go:323: (dbg) Stderr: out/minikube-linux-arm64 -p functional-838183 image build -t localhost/my-image:functional-838183 testdata/build --alsologtostderr:
I0924 00:58:44.883183 1904515 out.go:345] Setting OutFile to fd 1 ...
I0924 00:58:44.884062 1904515 out.go:392] TERM=,COLORTERM=, which probably does not support color
I0924 00:58:44.884100 1904515 out.go:358] Setting ErrFile to fd 2...
I0924 00:58:44.884123 1904515 out.go:392] TERM=,COLORTERM=, which probably does not support color
I0924 00:58:44.884395 1904515 root.go:338] Updating PATH: /home/jenkins/minikube-integration/19696-1868219/.minikube/bin
I0924 00:58:44.885103 1904515 config.go:182] Loaded profile config "functional-838183": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.31.1
I0924 00:58:44.885687 1904515 config.go:182] Loaded profile config "functional-838183": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.31.1
I0924 00:58:44.886253 1904515 cli_runner.go:164] Run: docker container inspect functional-838183 --format={{.State.Status}}
I0924 00:58:44.906405 1904515 ssh_runner.go:195] Run: systemctl --version
I0924 00:58:44.906463 1904515 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" functional-838183
I0924 00:58:44.925455 1904515 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:34701 SSHKeyPath:/home/jenkins/minikube-integration/19696-1868219/.minikube/machines/functional-838183/id_rsa Username:docker}
I0924 00:58:45.019314 1904515 build_images.go:161] Building image from path: /tmp/build.866713416.tar
I0924 00:58:45.019452 1904515 ssh_runner.go:195] Run: sudo mkdir -p /var/lib/minikube/build
I0924 00:58:45.033620 1904515 ssh_runner.go:195] Run: stat -c "%s %y" /var/lib/minikube/build/build.866713416.tar
I0924 00:58:45.039852 1904515 ssh_runner.go:352] existence check for /var/lib/minikube/build/build.866713416.tar: stat -c "%s %y" /var/lib/minikube/build/build.866713416.tar: Process exited with status 1
stdout:

                                                
                                                
stderr:
stat: cannot statx '/var/lib/minikube/build/build.866713416.tar': No such file or directory
I0924 00:58:45.039888 1904515 ssh_runner.go:362] scp /tmp/build.866713416.tar --> /var/lib/minikube/build/build.866713416.tar (3072 bytes)
I0924 00:58:45.120588 1904515 ssh_runner.go:195] Run: sudo mkdir -p /var/lib/minikube/build/build.866713416
I0924 00:58:45.139998 1904515 ssh_runner.go:195] Run: sudo tar -C /var/lib/minikube/build/build.866713416 -xf /var/lib/minikube/build/build.866713416.tar
I0924 00:58:45.157591 1904515 crio.go:315] Building image: /var/lib/minikube/build/build.866713416
I0924 00:58:45.157672 1904515 ssh_runner.go:195] Run: sudo podman build -t localhost/my-image:functional-838183 /var/lib/minikube/build/build.866713416 --cgroup-manager=cgroupfs
Trying to pull gcr.io/k8s-minikube/busybox:latest...
Getting image source signatures
Copying blob sha256:a01966dde7f8d5ba10b6d87e776c7c8fb5a5f6bfa678874bd28b33b1fc6dba34
Copying blob sha256:a01966dde7f8d5ba10b6d87e776c7c8fb5a5f6bfa678874bd28b33b1fc6dba34
Copying config sha256:71a676dd070f4b701c3272e566d84951362f1326ea07d5bbad119d1c4f6b3d02
Writing manifest to image destination
Storing signatures
I0924 00:58:48.263006 1904515 ssh_runner.go:235] Completed: sudo podman build -t localhost/my-image:functional-838183 /var/lib/minikube/build/build.866713416 --cgroup-manager=cgroupfs: (3.105305035s)
I0924 00:58:48.263074 1904515 ssh_runner.go:195] Run: sudo rm -rf /var/lib/minikube/build/build.866713416
I0924 00:58:48.273022 1904515 ssh_runner.go:195] Run: sudo rm -f /var/lib/minikube/build/build.866713416.tar
I0924 00:58:48.282788 1904515 build_images.go:217] Built localhost/my-image:functional-838183 from /tmp/build.866713416.tar
I0924 00:58:48.282823 1904515 build_images.go:133] succeeded building to: functional-838183
I0924 00:58:48.282828 1904515 build_images.go:134] failed building to: 
functional_test.go:451: (dbg) Run:  out/minikube-linux-arm64 -p functional-838183 image ls
functional_test.go:451: (dbg) Done: out/minikube-linux-arm64 -p functional-838183 image ls: (2.008940015s)
--- PASS: TestFunctional/parallel/ImageCommands/ImageBuild (5.74s)

                                                
                                    
x
+
TestFunctional/parallel/ImageCommands/Setup (0.85s)

                                                
                                                
=== RUN   TestFunctional/parallel/ImageCommands/Setup
functional_test.go:342: (dbg) Run:  docker pull kicbase/echo-server:1.0
functional_test.go:347: (dbg) Run:  docker tag kicbase/echo-server:1.0 kicbase/echo-server:functional-838183
--- PASS: TestFunctional/parallel/ImageCommands/Setup (0.85s)

                                                
                                    
x
+
TestFunctional/parallel/UpdateContextCmd/no_changes (0.21s)

                                                
                                                
=== RUN   TestFunctional/parallel/UpdateContextCmd/no_changes
=== PAUSE TestFunctional/parallel/UpdateContextCmd/no_changes

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/UpdateContextCmd/no_changes
functional_test.go:2119: (dbg) Run:  out/minikube-linux-arm64 -p functional-838183 update-context --alsologtostderr -v=2
--- PASS: TestFunctional/parallel/UpdateContextCmd/no_changes (0.21s)

                                                
                                    
x
+
TestFunctional/parallel/UpdateContextCmd/no_minikube_cluster (0.23s)

                                                
                                                
=== RUN   TestFunctional/parallel/UpdateContextCmd/no_minikube_cluster
=== PAUSE TestFunctional/parallel/UpdateContextCmd/no_minikube_cluster

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/UpdateContextCmd/no_minikube_cluster
functional_test.go:2119: (dbg) Run:  out/minikube-linux-arm64 -p functional-838183 update-context --alsologtostderr -v=2
--- PASS: TestFunctional/parallel/UpdateContextCmd/no_minikube_cluster (0.23s)

                                                
                                    
x
+
TestFunctional/parallel/UpdateContextCmd/no_clusters (0.21s)

                                                
                                                
=== RUN   TestFunctional/parallel/UpdateContextCmd/no_clusters
=== PAUSE TestFunctional/parallel/UpdateContextCmd/no_clusters

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/UpdateContextCmd/no_clusters
functional_test.go:2119: (dbg) Run:  out/minikube-linux-arm64 -p functional-838183 update-context --alsologtostderr -v=2
--- PASS: TestFunctional/parallel/UpdateContextCmd/no_clusters (0.21s)

                                                
                                    
x
+
TestFunctional/parallel/ImageCommands/ImageLoadDaemon (1.61s)

                                                
                                                
=== RUN   TestFunctional/parallel/ImageCommands/ImageLoadDaemon
functional_test.go:355: (dbg) Run:  out/minikube-linux-arm64 -p functional-838183 image load --daemon kicbase/echo-server:functional-838183 --alsologtostderr
functional_test.go:355: (dbg) Done: out/minikube-linux-arm64 -p functional-838183 image load --daemon kicbase/echo-server:functional-838183 --alsologtostderr: (1.314355323s)
functional_test.go:451: (dbg) Run:  out/minikube-linux-arm64 -p functional-838183 image ls
--- PASS: TestFunctional/parallel/ImageCommands/ImageLoadDaemon (1.61s)

                                                
                                    
x
+
TestFunctional/parallel/ImageCommands/ImageReloadDaemon (1.07s)

                                                
                                                
=== RUN   TestFunctional/parallel/ImageCommands/ImageReloadDaemon
functional_test.go:365: (dbg) Run:  out/minikube-linux-arm64 -p functional-838183 image load --daemon kicbase/echo-server:functional-838183 --alsologtostderr
functional_test.go:451: (dbg) Run:  out/minikube-linux-arm64 -p functional-838183 image ls
--- PASS: TestFunctional/parallel/ImageCommands/ImageReloadDaemon (1.07s)

                                                
                                    
x
+
TestFunctional/parallel/ServiceCmd/DeployApp (10.31s)

                                                
                                                
=== RUN   TestFunctional/parallel/ServiceCmd/DeployApp
functional_test.go:1437: (dbg) Run:  kubectl --context functional-838183 create deployment hello-node --image=registry.k8s.io/echoserver-arm:1.8
functional_test.go:1445: (dbg) Run:  kubectl --context functional-838183 expose deployment hello-node --type=NodePort --port=8080
functional_test.go:1450: (dbg) TestFunctional/parallel/ServiceCmd/DeployApp: waiting 10m0s for pods matching "app=hello-node" in namespace "default" ...
helpers_test.go:344: "hello-node-64b4f8f9ff-5tsck" [61225cf4-36e1-4530-bc90-ddd99c50f11a] Pending / Ready:ContainersNotReady (containers with unready status: [echoserver-arm]) / ContainersReady:ContainersNotReady (containers with unready status: [echoserver-arm])
helpers_test.go:344: "hello-node-64b4f8f9ff-5tsck" [61225cf4-36e1-4530-bc90-ddd99c50f11a] Running
functional_test.go:1450: (dbg) TestFunctional/parallel/ServiceCmd/DeployApp: app=hello-node healthy within 10.00423208s
--- PASS: TestFunctional/parallel/ServiceCmd/DeployApp (10.31s)

                                                
                                    
x
+
TestFunctional/parallel/ImageCommands/ImageTagAndLoadDaemon (1.54s)

                                                
                                                
=== RUN   TestFunctional/parallel/ImageCommands/ImageTagAndLoadDaemon
functional_test.go:235: (dbg) Run:  docker pull kicbase/echo-server:latest
functional_test.go:240: (dbg) Run:  docker tag kicbase/echo-server:latest kicbase/echo-server:functional-838183
functional_test.go:245: (dbg) Run:  out/minikube-linux-arm64 -p functional-838183 image load --daemon kicbase/echo-server:functional-838183 --alsologtostderr
functional_test.go:451: (dbg) Run:  out/minikube-linux-arm64 -p functional-838183 image ls
--- PASS: TestFunctional/parallel/ImageCommands/ImageTagAndLoadDaemon (1.54s)

                                                
                                    
x
+
TestFunctional/parallel/ImageCommands/ImageSaveToFile (1.88s)

                                                
                                                
=== RUN   TestFunctional/parallel/ImageCommands/ImageSaveToFile
functional_test.go:380: (dbg) Run:  out/minikube-linux-arm64 -p functional-838183 image save kicbase/echo-server:functional-838183 /home/jenkins/workspace/Docker_Linux_crio_arm64/echo-server-save.tar --alsologtostderr
functional_test.go:380: (dbg) Done: out/minikube-linux-arm64 -p functional-838183 image save kicbase/echo-server:functional-838183 /home/jenkins/workspace/Docker_Linux_crio_arm64/echo-server-save.tar --alsologtostderr: (1.883807768s)
--- PASS: TestFunctional/parallel/ImageCommands/ImageSaveToFile (1.88s)

                                                
                                    
x
+
TestFunctional/parallel/ImageCommands/ImageRemove (0.55s)

                                                
                                                
=== RUN   TestFunctional/parallel/ImageCommands/ImageRemove
functional_test.go:392: (dbg) Run:  out/minikube-linux-arm64 -p functional-838183 image rm kicbase/echo-server:functional-838183 --alsologtostderr
functional_test.go:451: (dbg) Run:  out/minikube-linux-arm64 -p functional-838183 image ls
--- PASS: TestFunctional/parallel/ImageCommands/ImageRemove (0.55s)

                                                
                                    
x
+
TestFunctional/parallel/ImageCommands/ImageLoadFromFile (0.8s)

                                                
                                                
=== RUN   TestFunctional/parallel/ImageCommands/ImageLoadFromFile
functional_test.go:409: (dbg) Run:  out/minikube-linux-arm64 -p functional-838183 image load /home/jenkins/workspace/Docker_Linux_crio_arm64/echo-server-save.tar --alsologtostderr
functional_test.go:451: (dbg) Run:  out/minikube-linux-arm64 -p functional-838183 image ls
--- PASS: TestFunctional/parallel/ImageCommands/ImageLoadFromFile (0.80s)

                                                
                                    
x
+
TestFunctional/parallel/ImageCommands/ImageSaveDaemon (0.58s)

                                                
                                                
=== RUN   TestFunctional/parallel/ImageCommands/ImageSaveDaemon
functional_test.go:419: (dbg) Run:  docker rmi kicbase/echo-server:functional-838183
functional_test.go:424: (dbg) Run:  out/minikube-linux-arm64 -p functional-838183 image save --daemon kicbase/echo-server:functional-838183 --alsologtostderr
functional_test.go:432: (dbg) Run:  docker image inspect localhost/kicbase/echo-server:functional-838183
--- PASS: TestFunctional/parallel/ImageCommands/ImageSaveDaemon (0.58s)

                                                
                                    
x
+
TestFunctional/parallel/TunnelCmd/serial/RunSecondTunnel (0.47s)

                                                
                                                
=== RUN   TestFunctional/parallel/TunnelCmd/serial/RunSecondTunnel
functional_test_tunnel_test.go:154: (dbg) daemon: [out/minikube-linux-arm64 -p functional-838183 tunnel --alsologtostderr]
functional_test_tunnel_test.go:154: (dbg) daemon: [out/minikube-linux-arm64 -p functional-838183 tunnel --alsologtostderr]
functional_test_tunnel_test.go:194: (dbg) stopping [out/minikube-linux-arm64 -p functional-838183 tunnel --alsologtostderr] ...
helpers_test.go:508: unable to kill pid 1901007: os: process already finished
helpers_test.go:502: unable to terminate pid 1900890: os: process already finished
functional_test_tunnel_test.go:194: (dbg) stopping [out/minikube-linux-arm64 -p functional-838183 tunnel --alsologtostderr] ...
helpers_test.go:490: unable to find parent, assuming dead: process does not exist
--- PASS: TestFunctional/parallel/TunnelCmd/serial/RunSecondTunnel (0.47s)

                                                
                                    
x
+
TestFunctional/parallel/TunnelCmd/serial/StartTunnel (0s)

                                                
                                                
=== RUN   TestFunctional/parallel/TunnelCmd/serial/StartTunnel
functional_test_tunnel_test.go:129: (dbg) daemon: [out/minikube-linux-arm64 -p functional-838183 tunnel --alsologtostderr]
--- PASS: TestFunctional/parallel/TunnelCmd/serial/StartTunnel (0.00s)

                                                
                                    
x
+
TestFunctional/parallel/TunnelCmd/serial/WaitService/Setup (9.33s)

                                                
                                                
=== RUN   TestFunctional/parallel/TunnelCmd/serial/WaitService/Setup
functional_test_tunnel_test.go:212: (dbg) Run:  kubectl --context functional-838183 apply -f testdata/testsvc.yaml
functional_test_tunnel_test.go:216: (dbg) TestFunctional/parallel/TunnelCmd/serial/WaitService/Setup: waiting 4m0s for pods matching "run=nginx-svc" in namespace "default" ...
helpers_test.go:344: "nginx-svc" [a644fcd7-ddb5-4f09-b43f-e0673f09ea56] Pending / Ready:ContainersNotReady (containers with unready status: [nginx]) / ContainersReady:ContainersNotReady (containers with unready status: [nginx])
helpers_test.go:344: "nginx-svc" [a644fcd7-ddb5-4f09-b43f-e0673f09ea56] Running
functional_test_tunnel_test.go:216: (dbg) TestFunctional/parallel/TunnelCmd/serial/WaitService/Setup: run=nginx-svc healthy within 9.003953179s
I0924 00:58:20.850562 1873600 kapi.go:150] Service nginx-svc in namespace default found.
--- PASS: TestFunctional/parallel/TunnelCmd/serial/WaitService/Setup (9.33s)

                                                
                                    
x
+
TestFunctional/parallel/ServiceCmd/List (0.33s)

                                                
                                                
=== RUN   TestFunctional/parallel/ServiceCmd/List
functional_test.go:1459: (dbg) Run:  out/minikube-linux-arm64 -p functional-838183 service list
--- PASS: TestFunctional/parallel/ServiceCmd/List (0.33s)

                                                
                                    
x
+
TestFunctional/parallel/ServiceCmd/JSONOutput (0.34s)

                                                
                                                
=== RUN   TestFunctional/parallel/ServiceCmd/JSONOutput
functional_test.go:1489: (dbg) Run:  out/minikube-linux-arm64 -p functional-838183 service list -o json
functional_test.go:1494: Took "340.659737ms" to run "out/minikube-linux-arm64 -p functional-838183 service list -o json"
--- PASS: TestFunctional/parallel/ServiceCmd/JSONOutput (0.34s)

                                                
                                    
x
+
TestFunctional/parallel/ServiceCmd/HTTPS (0.37s)

                                                
                                                
=== RUN   TestFunctional/parallel/ServiceCmd/HTTPS
functional_test.go:1509: (dbg) Run:  out/minikube-linux-arm64 -p functional-838183 service --namespace=default --https --url hello-node
functional_test.go:1522: found endpoint: https://192.168.49.2:30853
--- PASS: TestFunctional/parallel/ServiceCmd/HTTPS (0.37s)

                                                
                                    
x
+
TestFunctional/parallel/ServiceCmd/Format (0.35s)

                                                
                                                
=== RUN   TestFunctional/parallel/ServiceCmd/Format
functional_test.go:1540: (dbg) Run:  out/minikube-linux-arm64 -p functional-838183 service hello-node --url --format={{.IP}}
--- PASS: TestFunctional/parallel/ServiceCmd/Format (0.35s)

                                                
                                    
x
+
TestFunctional/parallel/ServiceCmd/URL (0.34s)

                                                
                                                
=== RUN   TestFunctional/parallel/ServiceCmd/URL
functional_test.go:1559: (dbg) Run:  out/minikube-linux-arm64 -p functional-838183 service hello-node --url
functional_test.go:1565: found endpoint for hello-node: http://192.168.49.2:30853
--- PASS: TestFunctional/parallel/ServiceCmd/URL (0.34s)

                                                
                                    
x
+
TestFunctional/parallel/TunnelCmd/serial/WaitService/IngressIP (0.08s)

                                                
                                                
=== RUN   TestFunctional/parallel/TunnelCmd/serial/WaitService/IngressIP
functional_test_tunnel_test.go:234: (dbg) Run:  kubectl --context functional-838183 get svc nginx-svc -o jsonpath={.status.loadBalancer.ingress[0].ip}
--- PASS: TestFunctional/parallel/TunnelCmd/serial/WaitService/IngressIP (0.08s)

                                                
                                    
x
+
TestFunctional/parallel/TunnelCmd/serial/AccessDirect (0s)

                                                
                                                
=== RUN   TestFunctional/parallel/TunnelCmd/serial/AccessDirect
functional_test_tunnel_test.go:299: tunnel at http://10.98.140.31 is working!
--- PASS: TestFunctional/parallel/TunnelCmd/serial/AccessDirect (0.00s)

                                                
                                    
x
+
TestFunctional/parallel/TunnelCmd/serial/DeleteTunnel (0.11s)

                                                
                                                
=== RUN   TestFunctional/parallel/TunnelCmd/serial/DeleteTunnel
functional_test_tunnel_test.go:434: (dbg) stopping [out/minikube-linux-arm64 -p functional-838183 tunnel --alsologtostderr] ...
--- PASS: TestFunctional/parallel/TunnelCmd/serial/DeleteTunnel (0.11s)

                                                
                                    
x
+
TestFunctional/parallel/ProfileCmd/profile_not_create (0.41s)

                                                
                                                
=== RUN   TestFunctional/parallel/ProfileCmd/profile_not_create
functional_test.go:1270: (dbg) Run:  out/minikube-linux-arm64 profile lis
functional_test.go:1275: (dbg) Run:  out/minikube-linux-arm64 profile list --output json
--- PASS: TestFunctional/parallel/ProfileCmd/profile_not_create (0.41s)

                                                
                                    
x
+
TestFunctional/parallel/ProfileCmd/profile_list (0.37s)

                                                
                                                
=== RUN   TestFunctional/parallel/ProfileCmd/profile_list
functional_test.go:1310: (dbg) Run:  out/minikube-linux-arm64 profile list
functional_test.go:1315: Took "319.366454ms" to run "out/minikube-linux-arm64 profile list"
functional_test.go:1324: (dbg) Run:  out/minikube-linux-arm64 profile list -l
functional_test.go:1329: Took "52.750607ms" to run "out/minikube-linux-arm64 profile list -l"
--- PASS: TestFunctional/parallel/ProfileCmd/profile_list (0.37s)

                                                
                                    
x
+
TestFunctional/parallel/ProfileCmd/profile_json_output (0.38s)

                                                
                                                
=== RUN   TestFunctional/parallel/ProfileCmd/profile_json_output
functional_test.go:1361: (dbg) Run:  out/minikube-linux-arm64 profile list -o json
functional_test.go:1366: Took "325.193374ms" to run "out/minikube-linux-arm64 profile list -o json"
functional_test.go:1374: (dbg) Run:  out/minikube-linux-arm64 profile list -o json --light
functional_test.go:1379: Took "50.365857ms" to run "out/minikube-linux-arm64 profile list -o json --light"
--- PASS: TestFunctional/parallel/ProfileCmd/profile_json_output (0.38s)

                                                
                                    
x
+
TestFunctional/parallel/MountCmd/any-port (8.55s)

                                                
                                                
=== RUN   TestFunctional/parallel/MountCmd/any-port
functional_test_mount_test.go:73: (dbg) daemon: [out/minikube-linux-arm64 mount -p functional-838183 /tmp/TestFunctionalparallelMountCmdany-port2263779312/001:/mount-9p --alsologtostderr -v=1]
functional_test_mount_test.go:107: wrote "test-1727139509820486411" to /tmp/TestFunctionalparallelMountCmdany-port2263779312/001/created-by-test
functional_test_mount_test.go:107: wrote "test-1727139509820486411" to /tmp/TestFunctionalparallelMountCmdany-port2263779312/001/created-by-test-removed-by-pod
functional_test_mount_test.go:107: wrote "test-1727139509820486411" to /tmp/TestFunctionalparallelMountCmdany-port2263779312/001/test-1727139509820486411
functional_test_mount_test.go:115: (dbg) Run:  out/minikube-linux-arm64 -p functional-838183 ssh "findmnt -T /mount-9p | grep 9p"
functional_test_mount_test.go:115: (dbg) Non-zero exit: out/minikube-linux-arm64 -p functional-838183 ssh "findmnt -T /mount-9p | grep 9p": exit status 1 (344.960966ms)

                                                
                                                
** stderr ** 
	ssh: Process exited with status 1

                                                
                                                
** /stderr **
I0924 00:58:30.165683 1873600 retry.go:31] will retry after 280.967113ms: exit status 1
functional_test_mount_test.go:115: (dbg) Run:  out/minikube-linux-arm64 -p functional-838183 ssh "findmnt -T /mount-9p | grep 9p"
functional_test_mount_test.go:129: (dbg) Run:  out/minikube-linux-arm64 -p functional-838183 ssh -- ls -la /mount-9p
functional_test_mount_test.go:133: guest mount directory contents
total 2
-rw-r--r-- 1 docker docker 24 Sep 24 00:58 created-by-test
-rw-r--r-- 1 docker docker 24 Sep 24 00:58 created-by-test-removed-by-pod
-rw-r--r-- 1 docker docker 24 Sep 24 00:58 test-1727139509820486411
functional_test_mount_test.go:137: (dbg) Run:  out/minikube-linux-arm64 -p functional-838183 ssh cat /mount-9p/test-1727139509820486411
functional_test_mount_test.go:148: (dbg) Run:  kubectl --context functional-838183 replace --force -f testdata/busybox-mount-test.yaml
functional_test_mount_test.go:153: (dbg) TestFunctional/parallel/MountCmd/any-port: waiting 4m0s for pods matching "integration-test=busybox-mount" in namespace "default" ...
helpers_test.go:344: "busybox-mount" [98bdd741-8f47-4b52-8926-6d7f69f91279] Pending
helpers_test.go:344: "busybox-mount" [98bdd741-8f47-4b52-8926-6d7f69f91279] Pending / Ready:ContainersNotReady (containers with unready status: [mount-munger]) / ContainersReady:ContainersNotReady (containers with unready status: [mount-munger])
helpers_test.go:344: "busybox-mount" [98bdd741-8f47-4b52-8926-6d7f69f91279] Pending / Initialized:PodCompleted / Ready:PodCompleted / ContainersReady:PodCompleted
helpers_test.go:344: "busybox-mount" [98bdd741-8f47-4b52-8926-6d7f69f91279] Succeeded / Initialized:PodCompleted / Ready:PodCompleted / ContainersReady:PodCompleted
functional_test_mount_test.go:153: (dbg) TestFunctional/parallel/MountCmd/any-port: integration-test=busybox-mount healthy within 6.003486363s
functional_test_mount_test.go:169: (dbg) Run:  kubectl --context functional-838183 logs busybox-mount
functional_test_mount_test.go:181: (dbg) Run:  out/minikube-linux-arm64 -p functional-838183 ssh stat /mount-9p/created-by-test
functional_test_mount_test.go:181: (dbg) Run:  out/minikube-linux-arm64 -p functional-838183 ssh stat /mount-9p/created-by-pod
functional_test_mount_test.go:90: (dbg) Run:  out/minikube-linux-arm64 -p functional-838183 ssh "sudo umount -f /mount-9p"
functional_test_mount_test.go:94: (dbg) stopping [out/minikube-linux-arm64 mount -p functional-838183 /tmp/TestFunctionalparallelMountCmdany-port2263779312/001:/mount-9p --alsologtostderr -v=1] ...
--- PASS: TestFunctional/parallel/MountCmd/any-port (8.55s)

                                                
                                    
x
+
TestFunctional/parallel/MountCmd/specific-port (1.99s)

                                                
                                                
=== RUN   TestFunctional/parallel/MountCmd/specific-port
functional_test_mount_test.go:213: (dbg) daemon: [out/minikube-linux-arm64 mount -p functional-838183 /tmp/TestFunctionalparallelMountCmdspecific-port4108008487/001:/mount-9p --alsologtostderr -v=1 --port 46464]
functional_test_mount_test.go:243: (dbg) Run:  out/minikube-linux-arm64 -p functional-838183 ssh "findmnt -T /mount-9p | grep 9p"
functional_test_mount_test.go:243: (dbg) Non-zero exit: out/minikube-linux-arm64 -p functional-838183 ssh "findmnt -T /mount-9p | grep 9p": exit status 1 (334.448384ms)

                                                
                                                
** stderr ** 
	ssh: Process exited with status 1

                                                
                                                
** /stderr **
I0924 00:58:38.704605 1873600 retry.go:31] will retry after 660.841642ms: exit status 1
functional_test_mount_test.go:243: (dbg) Run:  out/minikube-linux-arm64 -p functional-838183 ssh "findmnt -T /mount-9p | grep 9p"
functional_test_mount_test.go:257: (dbg) Run:  out/minikube-linux-arm64 -p functional-838183 ssh -- ls -la /mount-9p
functional_test_mount_test.go:261: guest mount directory contents
total 0
functional_test_mount_test.go:263: (dbg) stopping [out/minikube-linux-arm64 mount -p functional-838183 /tmp/TestFunctionalparallelMountCmdspecific-port4108008487/001:/mount-9p --alsologtostderr -v=1 --port 46464] ...
functional_test_mount_test.go:264: reading mount text
functional_test_mount_test.go:278: done reading mount text
functional_test_mount_test.go:230: (dbg) Run:  out/minikube-linux-arm64 -p functional-838183 ssh "sudo umount -f /mount-9p"
functional_test_mount_test.go:230: (dbg) Non-zero exit: out/minikube-linux-arm64 -p functional-838183 ssh "sudo umount -f /mount-9p": exit status 1 (266.799194ms)

                                                
                                                
-- stdout --
	umount: /mount-9p: not mounted.

                                                
                                                
-- /stdout --
** stderr ** 
	ssh: Process exited with status 32

                                                
                                                
** /stderr **
functional_test_mount_test.go:232: "out/minikube-linux-arm64 -p functional-838183 ssh \"sudo umount -f /mount-9p\"": exit status 1
functional_test_mount_test.go:234: (dbg) stopping [out/minikube-linux-arm64 mount -p functional-838183 /tmp/TestFunctionalparallelMountCmdspecific-port4108008487/001:/mount-9p --alsologtostderr -v=1 --port 46464] ...
--- PASS: TestFunctional/parallel/MountCmd/specific-port (1.99s)

                                                
                                    
x
+
TestFunctional/parallel/MountCmd/VerifyCleanup (2.13s)

                                                
                                                
=== RUN   TestFunctional/parallel/MountCmd/VerifyCleanup
functional_test_mount_test.go:298: (dbg) daemon: [out/minikube-linux-arm64 mount -p functional-838183 /tmp/TestFunctionalparallelMountCmdVerifyCleanup2974549467/001:/mount1 --alsologtostderr -v=1]
functional_test_mount_test.go:298: (dbg) daemon: [out/minikube-linux-arm64 mount -p functional-838183 /tmp/TestFunctionalparallelMountCmdVerifyCleanup2974549467/001:/mount2 --alsologtostderr -v=1]
functional_test_mount_test.go:298: (dbg) daemon: [out/minikube-linux-arm64 mount -p functional-838183 /tmp/TestFunctionalparallelMountCmdVerifyCleanup2974549467/001:/mount3 --alsologtostderr -v=1]
functional_test_mount_test.go:325: (dbg) Run:  out/minikube-linux-arm64 -p functional-838183 ssh "findmnt -T" /mount1
functional_test_mount_test.go:325: (dbg) Non-zero exit: out/minikube-linux-arm64 -p functional-838183 ssh "findmnt -T" /mount1: exit status 1 (536.437758ms)

                                                
                                                
** stderr ** 
	ssh: Process exited with status 1

                                                
                                                
** /stderr **
I0924 00:58:40.898810 1873600 retry.go:31] will retry after 514.428676ms: exit status 1
functional_test_mount_test.go:325: (dbg) Run:  out/minikube-linux-arm64 -p functional-838183 ssh "findmnt -T" /mount1
functional_test_mount_test.go:325: (dbg) Run:  out/minikube-linux-arm64 -p functional-838183 ssh "findmnt -T" /mount2
functional_test_mount_test.go:325: (dbg) Run:  out/minikube-linux-arm64 -p functional-838183 ssh "findmnt -T" /mount3
functional_test_mount_test.go:370: (dbg) Run:  out/minikube-linux-arm64 mount -p functional-838183 --kill=true
functional_test_mount_test.go:313: (dbg) stopping [out/minikube-linux-arm64 mount -p functional-838183 /tmp/TestFunctionalparallelMountCmdVerifyCleanup2974549467/001:/mount1 --alsologtostderr -v=1] ...
helpers_test.go:490: unable to find parent, assuming dead: process does not exist
functional_test_mount_test.go:313: (dbg) stopping [out/minikube-linux-arm64 mount -p functional-838183 /tmp/TestFunctionalparallelMountCmdVerifyCleanup2974549467/001:/mount2 --alsologtostderr -v=1] ...
helpers_test.go:490: unable to find parent, assuming dead: process does not exist
functional_test_mount_test.go:313: (dbg) stopping [out/minikube-linux-arm64 mount -p functional-838183 /tmp/TestFunctionalparallelMountCmdVerifyCleanup2974549467/001:/mount3 --alsologtostderr -v=1] ...
helpers_test.go:490: unable to find parent, assuming dead: process does not exist
--- PASS: TestFunctional/parallel/MountCmd/VerifyCleanup (2.13s)

                                                
                                    
x
+
TestFunctional/delete_echo-server_images (0.03s)

                                                
                                                
=== RUN   TestFunctional/delete_echo-server_images
functional_test.go:190: (dbg) Run:  docker rmi -f kicbase/echo-server:1.0
functional_test.go:190: (dbg) Run:  docker rmi -f kicbase/echo-server:functional-838183
--- PASS: TestFunctional/delete_echo-server_images (0.03s)

                                                
                                    
x
+
TestFunctional/delete_my-image_image (0.01s)

                                                
                                                
=== RUN   TestFunctional/delete_my-image_image
functional_test.go:198: (dbg) Run:  docker rmi -f localhost/my-image:functional-838183
--- PASS: TestFunctional/delete_my-image_image (0.01s)

                                                
                                    
x
+
TestFunctional/delete_minikube_cached_images (0.01s)

                                                
                                                
=== RUN   TestFunctional/delete_minikube_cached_images
functional_test.go:206: (dbg) Run:  docker rmi -f minikube-local-cache-test:functional-838183
--- PASS: TestFunctional/delete_minikube_cached_images (0.01s)

                                                
                                    
x
+
TestMultiControlPlane/serial/StartCluster (165.89s)

                                                
                                                
=== RUN   TestMultiControlPlane/serial/StartCluster
ha_test.go:101: (dbg) Run:  out/minikube-linux-arm64 start -p ha-089065 --wait=true --memory=2200 --ha -v=7 --alsologtostderr --driver=docker  --container-runtime=crio
E0924 00:59:19.924869 1873600 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /home/jenkins/minikube-integration/19696-1868219/.minikube/profiles/addons-371349/client.crt: no such file or directory" logger="UnhandledError"
E0924 00:59:19.931209 1873600 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /home/jenkins/minikube-integration/19696-1868219/.minikube/profiles/addons-371349/client.crt: no such file or directory" logger="UnhandledError"
E0924 00:59:19.942534 1873600 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /home/jenkins/minikube-integration/19696-1868219/.minikube/profiles/addons-371349/client.crt: no such file or directory" logger="UnhandledError"
E0924 00:59:19.963906 1873600 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /home/jenkins/minikube-integration/19696-1868219/.minikube/profiles/addons-371349/client.crt: no such file or directory" logger="UnhandledError"
E0924 00:59:20.005285 1873600 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /home/jenkins/minikube-integration/19696-1868219/.minikube/profiles/addons-371349/client.crt: no such file or directory" logger="UnhandledError"
E0924 00:59:20.086692 1873600 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /home/jenkins/minikube-integration/19696-1868219/.minikube/profiles/addons-371349/client.crt: no such file or directory" logger="UnhandledError"
E0924 00:59:20.248175 1873600 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /home/jenkins/minikube-integration/19696-1868219/.minikube/profiles/addons-371349/client.crt: no such file or directory" logger="UnhandledError"
E0924 00:59:20.569799 1873600 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /home/jenkins/minikube-integration/19696-1868219/.minikube/profiles/addons-371349/client.crt: no such file or directory" logger="UnhandledError"
E0924 00:59:21.211792 1873600 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /home/jenkins/minikube-integration/19696-1868219/.minikube/profiles/addons-371349/client.crt: no such file or directory" logger="UnhandledError"
E0924 00:59:22.493233 1873600 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /home/jenkins/minikube-integration/19696-1868219/.minikube/profiles/addons-371349/client.crt: no such file or directory" logger="UnhandledError"
E0924 00:59:25.055057 1873600 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /home/jenkins/minikube-integration/19696-1868219/.minikube/profiles/addons-371349/client.crt: no such file or directory" logger="UnhandledError"
E0924 00:59:30.176855 1873600 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /home/jenkins/minikube-integration/19696-1868219/.minikube/profiles/addons-371349/client.crt: no such file or directory" logger="UnhandledError"
E0924 00:59:40.418788 1873600 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /home/jenkins/minikube-integration/19696-1868219/.minikube/profiles/addons-371349/client.crt: no such file or directory" logger="UnhandledError"
E0924 01:00:00.900831 1873600 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /home/jenkins/minikube-integration/19696-1868219/.minikube/profiles/addons-371349/client.crt: no such file or directory" logger="UnhandledError"
E0924 01:00:41.862972 1873600 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /home/jenkins/minikube-integration/19696-1868219/.minikube/profiles/addons-371349/client.crt: no such file or directory" logger="UnhandledError"
ha_test.go:101: (dbg) Done: out/minikube-linux-arm64 start -p ha-089065 --wait=true --memory=2200 --ha -v=7 --alsologtostderr --driver=docker  --container-runtime=crio: (2m45.117764976s)
ha_test.go:107: (dbg) Run:  out/minikube-linux-arm64 -p ha-089065 status -v=7 --alsologtostderr
--- PASS: TestMultiControlPlane/serial/StartCluster (165.89s)

                                                
                                    
x
+
TestMultiControlPlane/serial/DeployApp (7.97s)

                                                
                                                
=== RUN   TestMultiControlPlane/serial/DeployApp
ha_test.go:128: (dbg) Run:  out/minikube-linux-arm64 kubectl -p ha-089065 -- apply -f ./testdata/ha/ha-pod-dns-test.yaml
ha_test.go:133: (dbg) Run:  out/minikube-linux-arm64 kubectl -p ha-089065 -- rollout status deployment/busybox
ha_test.go:133: (dbg) Done: out/minikube-linux-arm64 kubectl -p ha-089065 -- rollout status deployment/busybox: (5.237616931s)
ha_test.go:140: (dbg) Run:  out/minikube-linux-arm64 kubectl -p ha-089065 -- get pods -o jsonpath='{.items[*].status.podIP}'
ha_test.go:163: (dbg) Run:  out/minikube-linux-arm64 kubectl -p ha-089065 -- get pods -o jsonpath='{.items[*].metadata.name}'
ha_test.go:171: (dbg) Run:  out/minikube-linux-arm64 kubectl -p ha-089065 -- exec busybox-7dff88458-2c2zd -- nslookup kubernetes.io
ha_test.go:171: (dbg) Run:  out/minikube-linux-arm64 kubectl -p ha-089065 -- exec busybox-7dff88458-skbfg -- nslookup kubernetes.io
ha_test.go:171: (dbg) Run:  out/minikube-linux-arm64 kubectl -p ha-089065 -- exec busybox-7dff88458-z2747 -- nslookup kubernetes.io
ha_test.go:181: (dbg) Run:  out/minikube-linux-arm64 kubectl -p ha-089065 -- exec busybox-7dff88458-2c2zd -- nslookup kubernetes.default
ha_test.go:181: (dbg) Run:  out/minikube-linux-arm64 kubectl -p ha-089065 -- exec busybox-7dff88458-skbfg -- nslookup kubernetes.default
ha_test.go:181: (dbg) Run:  out/minikube-linux-arm64 kubectl -p ha-089065 -- exec busybox-7dff88458-z2747 -- nslookup kubernetes.default
ha_test.go:189: (dbg) Run:  out/minikube-linux-arm64 kubectl -p ha-089065 -- exec busybox-7dff88458-2c2zd -- nslookup kubernetes.default.svc.cluster.local
ha_test.go:189: (dbg) Run:  out/minikube-linux-arm64 kubectl -p ha-089065 -- exec busybox-7dff88458-skbfg -- nslookup kubernetes.default.svc.cluster.local
ha_test.go:189: (dbg) Run:  out/minikube-linux-arm64 kubectl -p ha-089065 -- exec busybox-7dff88458-z2747 -- nslookup kubernetes.default.svc.cluster.local
--- PASS: TestMultiControlPlane/serial/DeployApp (7.97s)

                                                
                                    
x
+
TestMultiControlPlane/serial/PingHostFromPods (1.59s)

                                                
                                                
=== RUN   TestMultiControlPlane/serial/PingHostFromPods
ha_test.go:199: (dbg) Run:  out/minikube-linux-arm64 kubectl -p ha-089065 -- get pods -o jsonpath='{.items[*].metadata.name}'
ha_test.go:207: (dbg) Run:  out/minikube-linux-arm64 kubectl -p ha-089065 -- exec busybox-7dff88458-2c2zd -- sh -c "nslookup host.minikube.internal | awk 'NR==5' | cut -d' ' -f3"
ha_test.go:218: (dbg) Run:  out/minikube-linux-arm64 kubectl -p ha-089065 -- exec busybox-7dff88458-2c2zd -- sh -c "ping -c 1 192.168.49.1"
ha_test.go:207: (dbg) Run:  out/minikube-linux-arm64 kubectl -p ha-089065 -- exec busybox-7dff88458-skbfg -- sh -c "nslookup host.minikube.internal | awk 'NR==5' | cut -d' ' -f3"
ha_test.go:218: (dbg) Run:  out/minikube-linux-arm64 kubectl -p ha-089065 -- exec busybox-7dff88458-skbfg -- sh -c "ping -c 1 192.168.49.1"
ha_test.go:207: (dbg) Run:  out/minikube-linux-arm64 kubectl -p ha-089065 -- exec busybox-7dff88458-z2747 -- sh -c "nslookup host.minikube.internal | awk 'NR==5' | cut -d' ' -f3"
ha_test.go:218: (dbg) Run:  out/minikube-linux-arm64 kubectl -p ha-089065 -- exec busybox-7dff88458-z2747 -- sh -c "ping -c 1 192.168.49.1"
--- PASS: TestMultiControlPlane/serial/PingHostFromPods (1.59s)

                                                
                                    
x
+
TestMultiControlPlane/serial/AddWorkerNode (63.19s)

                                                
                                                
=== RUN   TestMultiControlPlane/serial/AddWorkerNode
ha_test.go:228: (dbg) Run:  out/minikube-linux-arm64 node add -p ha-089065 -v=7 --alsologtostderr
E0924 01:02:03.784972 1873600 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /home/jenkins/minikube-integration/19696-1868219/.minikube/profiles/addons-371349/client.crt: no such file or directory" logger="UnhandledError"
ha_test.go:228: (dbg) Done: out/minikube-linux-arm64 node add -p ha-089065 -v=7 --alsologtostderr: (1m2.28000578s)
ha_test.go:234: (dbg) Run:  out/minikube-linux-arm64 -p ha-089065 status -v=7 --alsologtostderr
--- PASS: TestMultiControlPlane/serial/AddWorkerNode (63.19s)

                                                
                                    
x
+
TestMultiControlPlane/serial/NodeLabels (0.11s)

                                                
                                                
=== RUN   TestMultiControlPlane/serial/NodeLabels
ha_test.go:255: (dbg) Run:  kubectl --context ha-089065 get nodes -o "jsonpath=[{range .items[*]}{.metadata.labels},{end}]"
--- PASS: TestMultiControlPlane/serial/NodeLabels (0.11s)

                                                
                                    
x
+
TestMultiControlPlane/serial/HAppyAfterClusterStart (0.95s)

                                                
                                                
=== RUN   TestMultiControlPlane/serial/HAppyAfterClusterStart
ha_test.go:281: (dbg) Run:  out/minikube-linux-arm64 profile list --output json
--- PASS: TestMultiControlPlane/serial/HAppyAfterClusterStart (0.95s)

                                                
                                    
x
+
TestMultiControlPlane/serial/CopyFile (17.72s)

                                                
                                                
=== RUN   TestMultiControlPlane/serial/CopyFile
ha_test.go:326: (dbg) Run:  out/minikube-linux-arm64 -p ha-089065 status --output json -v=7 --alsologtostderr
helpers_test.go:556: (dbg) Run:  out/minikube-linux-arm64 -p ha-089065 cp testdata/cp-test.txt ha-089065:/home/docker/cp-test.txt
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p ha-089065 ssh -n ha-089065 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:556: (dbg) Run:  out/minikube-linux-arm64 -p ha-089065 cp ha-089065:/home/docker/cp-test.txt /tmp/TestMultiControlPlaneserialCopyFile1562279025/001/cp-test_ha-089065.txt
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p ha-089065 ssh -n ha-089065 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:556: (dbg) Run:  out/minikube-linux-arm64 -p ha-089065 cp ha-089065:/home/docker/cp-test.txt ha-089065-m02:/home/docker/cp-test_ha-089065_ha-089065-m02.txt
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p ha-089065 ssh -n ha-089065 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p ha-089065 ssh -n ha-089065-m02 "sudo cat /home/docker/cp-test_ha-089065_ha-089065-m02.txt"
helpers_test.go:556: (dbg) Run:  out/minikube-linux-arm64 -p ha-089065 cp ha-089065:/home/docker/cp-test.txt ha-089065-m03:/home/docker/cp-test_ha-089065_ha-089065-m03.txt
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p ha-089065 ssh -n ha-089065 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p ha-089065 ssh -n ha-089065-m03 "sudo cat /home/docker/cp-test_ha-089065_ha-089065-m03.txt"
helpers_test.go:556: (dbg) Run:  out/minikube-linux-arm64 -p ha-089065 cp ha-089065:/home/docker/cp-test.txt ha-089065-m04:/home/docker/cp-test_ha-089065_ha-089065-m04.txt
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p ha-089065 ssh -n ha-089065 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p ha-089065 ssh -n ha-089065-m04 "sudo cat /home/docker/cp-test_ha-089065_ha-089065-m04.txt"
helpers_test.go:556: (dbg) Run:  out/minikube-linux-arm64 -p ha-089065 cp testdata/cp-test.txt ha-089065-m02:/home/docker/cp-test.txt
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p ha-089065 ssh -n ha-089065-m02 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:556: (dbg) Run:  out/minikube-linux-arm64 -p ha-089065 cp ha-089065-m02:/home/docker/cp-test.txt /tmp/TestMultiControlPlaneserialCopyFile1562279025/001/cp-test_ha-089065-m02.txt
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p ha-089065 ssh -n ha-089065-m02 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:556: (dbg) Run:  out/minikube-linux-arm64 -p ha-089065 cp ha-089065-m02:/home/docker/cp-test.txt ha-089065:/home/docker/cp-test_ha-089065-m02_ha-089065.txt
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p ha-089065 ssh -n ha-089065-m02 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p ha-089065 ssh -n ha-089065 "sudo cat /home/docker/cp-test_ha-089065-m02_ha-089065.txt"
helpers_test.go:556: (dbg) Run:  out/minikube-linux-arm64 -p ha-089065 cp ha-089065-m02:/home/docker/cp-test.txt ha-089065-m03:/home/docker/cp-test_ha-089065-m02_ha-089065-m03.txt
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p ha-089065 ssh -n ha-089065-m02 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p ha-089065 ssh -n ha-089065-m03 "sudo cat /home/docker/cp-test_ha-089065-m02_ha-089065-m03.txt"
helpers_test.go:556: (dbg) Run:  out/minikube-linux-arm64 -p ha-089065 cp ha-089065-m02:/home/docker/cp-test.txt ha-089065-m04:/home/docker/cp-test_ha-089065-m02_ha-089065-m04.txt
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p ha-089065 ssh -n ha-089065-m02 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p ha-089065 ssh -n ha-089065-m04 "sudo cat /home/docker/cp-test_ha-089065-m02_ha-089065-m04.txt"
helpers_test.go:556: (dbg) Run:  out/minikube-linux-arm64 -p ha-089065 cp testdata/cp-test.txt ha-089065-m03:/home/docker/cp-test.txt
E0924 01:03:04.752657 1873600 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /home/jenkins/minikube-integration/19696-1868219/.minikube/profiles/functional-838183/client.crt: no such file or directory" logger="UnhandledError"
E0924 01:03:04.758975 1873600 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /home/jenkins/minikube-integration/19696-1868219/.minikube/profiles/functional-838183/client.crt: no such file or directory" logger="UnhandledError"
E0924 01:03:04.770311 1873600 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /home/jenkins/minikube-integration/19696-1868219/.minikube/profiles/functional-838183/client.crt: no such file or directory" logger="UnhandledError"
E0924 01:03:04.792512 1873600 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /home/jenkins/minikube-integration/19696-1868219/.minikube/profiles/functional-838183/client.crt: no such file or directory" logger="UnhandledError"
E0924 01:03:04.834220 1873600 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /home/jenkins/minikube-integration/19696-1868219/.minikube/profiles/functional-838183/client.crt: no such file or directory" logger="UnhandledError"
E0924 01:03:04.915616 1873600 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /home/jenkins/minikube-integration/19696-1868219/.minikube/profiles/functional-838183/client.crt: no such file or directory" logger="UnhandledError"
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p ha-089065 ssh -n ha-089065-m03 "sudo cat /home/docker/cp-test.txt"
E0924 01:03:05.077926 1873600 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /home/jenkins/minikube-integration/19696-1868219/.minikube/profiles/functional-838183/client.crt: no such file or directory" logger="UnhandledError"
helpers_test.go:556: (dbg) Run:  out/minikube-linux-arm64 -p ha-089065 cp ha-089065-m03:/home/docker/cp-test.txt /tmp/TestMultiControlPlaneserialCopyFile1562279025/001/cp-test_ha-089065-m03.txt
E0924 01:03:05.400679 1873600 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /home/jenkins/minikube-integration/19696-1868219/.minikube/profiles/functional-838183/client.crt: no such file or directory" logger="UnhandledError"
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p ha-089065 ssh -n ha-089065-m03 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:556: (dbg) Run:  out/minikube-linux-arm64 -p ha-089065 cp ha-089065-m03:/home/docker/cp-test.txt ha-089065:/home/docker/cp-test_ha-089065-m03_ha-089065.txt
E0924 01:03:06.042533 1873600 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /home/jenkins/minikube-integration/19696-1868219/.minikube/profiles/functional-838183/client.crt: no such file or directory" logger="UnhandledError"
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p ha-089065 ssh -n ha-089065-m03 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p ha-089065 ssh -n ha-089065 "sudo cat /home/docker/cp-test_ha-089065-m03_ha-089065.txt"
helpers_test.go:556: (dbg) Run:  out/minikube-linux-arm64 -p ha-089065 cp ha-089065-m03:/home/docker/cp-test.txt ha-089065-m02:/home/docker/cp-test_ha-089065-m03_ha-089065-m02.txt
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p ha-089065 ssh -n ha-089065-m03 "sudo cat /home/docker/cp-test.txt"
E0924 01:03:07.325079 1873600 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /home/jenkins/minikube-integration/19696-1868219/.minikube/profiles/functional-838183/client.crt: no such file or directory" logger="UnhandledError"
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p ha-089065 ssh -n ha-089065-m02 "sudo cat /home/docker/cp-test_ha-089065-m03_ha-089065-m02.txt"
helpers_test.go:556: (dbg) Run:  out/minikube-linux-arm64 -p ha-089065 cp ha-089065-m03:/home/docker/cp-test.txt ha-089065-m04:/home/docker/cp-test_ha-089065-m03_ha-089065-m04.txt
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p ha-089065 ssh -n ha-089065-m03 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p ha-089065 ssh -n ha-089065-m04 "sudo cat /home/docker/cp-test_ha-089065-m03_ha-089065-m04.txt"
helpers_test.go:556: (dbg) Run:  out/minikube-linux-arm64 -p ha-089065 cp testdata/cp-test.txt ha-089065-m04:/home/docker/cp-test.txt
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p ha-089065 ssh -n ha-089065-m04 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:556: (dbg) Run:  out/minikube-linux-arm64 -p ha-089065 cp ha-089065-m04:/home/docker/cp-test.txt /tmp/TestMultiControlPlaneserialCopyFile1562279025/001/cp-test_ha-089065-m04.txt
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p ha-089065 ssh -n ha-089065-m04 "sudo cat /home/docker/cp-test.txt"
E0924 01:03:09.887933 1873600 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /home/jenkins/minikube-integration/19696-1868219/.minikube/profiles/functional-838183/client.crt: no such file or directory" logger="UnhandledError"
helpers_test.go:556: (dbg) Run:  out/minikube-linux-arm64 -p ha-089065 cp ha-089065-m04:/home/docker/cp-test.txt ha-089065:/home/docker/cp-test_ha-089065-m04_ha-089065.txt
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p ha-089065 ssh -n ha-089065-m04 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p ha-089065 ssh -n ha-089065 "sudo cat /home/docker/cp-test_ha-089065-m04_ha-089065.txt"
helpers_test.go:556: (dbg) Run:  out/minikube-linux-arm64 -p ha-089065 cp ha-089065-m04:/home/docker/cp-test.txt ha-089065-m02:/home/docker/cp-test_ha-089065-m04_ha-089065-m02.txt
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p ha-089065 ssh -n ha-089065-m04 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p ha-089065 ssh -n ha-089065-m02 "sudo cat /home/docker/cp-test_ha-089065-m04_ha-089065-m02.txt"
helpers_test.go:556: (dbg) Run:  out/minikube-linux-arm64 -p ha-089065 cp ha-089065-m04:/home/docker/cp-test.txt ha-089065-m03:/home/docker/cp-test_ha-089065-m04_ha-089065-m03.txt
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p ha-089065 ssh -n ha-089065-m04 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p ha-089065 ssh -n ha-089065-m03 "sudo cat /home/docker/cp-test_ha-089065-m04_ha-089065-m03.txt"
--- PASS: TestMultiControlPlane/serial/CopyFile (17.72s)

                                                
                                    
x
+
TestMultiControlPlane/serial/StopSecondaryNode (12.7s)

                                                
                                                
=== RUN   TestMultiControlPlane/serial/StopSecondaryNode
ha_test.go:363: (dbg) Run:  out/minikube-linux-arm64 -p ha-089065 node stop m02 -v=7 --alsologtostderr
E0924 01:03:15.010153 1873600 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /home/jenkins/minikube-integration/19696-1868219/.minikube/profiles/functional-838183/client.crt: no such file or directory" logger="UnhandledError"
ha_test.go:363: (dbg) Done: out/minikube-linux-arm64 -p ha-089065 node stop m02 -v=7 --alsologtostderr: (11.991431802s)
ha_test.go:369: (dbg) Run:  out/minikube-linux-arm64 -p ha-089065 status -v=7 --alsologtostderr
E0924 01:03:25.252657 1873600 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /home/jenkins/minikube-integration/19696-1868219/.minikube/profiles/functional-838183/client.crt: no such file or directory" logger="UnhandledError"
ha_test.go:369: (dbg) Non-zero exit: out/minikube-linux-arm64 -p ha-089065 status -v=7 --alsologtostderr: exit status 7 (711.442631ms)

                                                
                                                
-- stdout --
	ha-089065
	type: Control Plane
	host: Running
	kubelet: Running
	apiserver: Running
	kubeconfig: Configured
	
	ha-089065-m02
	type: Control Plane
	host: Stopped
	kubelet: Stopped
	apiserver: Stopped
	kubeconfig: Stopped
	
	ha-089065-m03
	type: Control Plane
	host: Running
	kubelet: Running
	apiserver: Running
	kubeconfig: Configured
	
	ha-089065-m04
	type: Worker
	host: Running
	kubelet: Running
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0924 01:03:25.013642 1920479 out.go:345] Setting OutFile to fd 1 ...
	I0924 01:03:25.014112 1920479 out.go:392] TERM=,COLORTERM=, which probably does not support color
	I0924 01:03:25.014170 1920479 out.go:358] Setting ErrFile to fd 2...
	I0924 01:03:25.014192 1920479 out.go:392] TERM=,COLORTERM=, which probably does not support color
	I0924 01:03:25.014668 1920479 root.go:338] Updating PATH: /home/jenkins/minikube-integration/19696-1868219/.minikube/bin
	I0924 01:03:25.014976 1920479 out.go:352] Setting JSON to false
	I0924 01:03:25.015045 1920479 mustload.go:65] Loading cluster: ha-089065
	I0924 01:03:25.015126 1920479 notify.go:220] Checking for updates...
	I0924 01:03:25.016935 1920479 config.go:182] Loaded profile config "ha-089065": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.31.1
	I0924 01:03:25.017006 1920479 status.go:174] checking status of ha-089065 ...
	I0924 01:03:25.018120 1920479 cli_runner.go:164] Run: docker container inspect ha-089065 --format={{.State.Status}}
	I0924 01:03:25.039693 1920479 status.go:364] ha-089065 host status = "Running" (err=<nil>)
	I0924 01:03:25.039716 1920479 host.go:66] Checking if "ha-089065" exists ...
	I0924 01:03:25.040184 1920479 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" ha-089065
	I0924 01:03:25.070470 1920479 host.go:66] Checking if "ha-089065" exists ...
	I0924 01:03:25.070785 1920479 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
	I0924 01:03:25.070825 1920479 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-089065
	I0924 01:03:25.090084 1920479 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:34706 SSHKeyPath:/home/jenkins/minikube-integration/19696-1868219/.minikube/machines/ha-089065/id_rsa Username:docker}
	I0924 01:03:25.183519 1920479 ssh_runner.go:195] Run: systemctl --version
	I0924 01:03:25.188046 1920479 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
	I0924 01:03:25.200069 1920479 cli_runner.go:164] Run: docker system info --format "{{json .}}"
	I0924 01:03:25.256439 1920479 info.go:266] docker info: {ID:5FDH:SA5P:5GCT:NLAS:B73P:SGDQ:PBG5:UBVH:UZY3:RXGO:CI7S:WAIH Containers:4 ContainersRunning:3 ContainersPaused:0 ContainersStopped:1 Images:3 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:false BridgeNfIP6Tables:false Debug:false NFd:49 OomKillDisable:true NGoroutines:71 SystemTime:2024-09-24 01:03:25.245767105 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1070-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Architecture:a
arch64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8214831104 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-21-244 Labels:[] ExperimentalBuild:false ServerVersion:27.3.1 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:7f7fdf5fed64eb6a7caf99b3e12efcf9d60e311c Expected:7f7fdf5fed64eb6a7caf99b3e12efcf9d60e311c} RuncCommit:{ID:v1.1.14-0-g2c9f560 Expected:v1.1.14-0-g2c9f560} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:[WARNING: brid
ge-nf-call-iptables is disabled WARNING: bridge-nf-call-ip6tables is disabled] ServerErrors:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.17.1] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.29.7]] Warnings:<nil>}}
	I0924 01:03:25.257150 1920479 kubeconfig.go:125] found "ha-089065" server: "https://192.168.49.254:8443"
	I0924 01:03:25.257193 1920479 api_server.go:166] Checking apiserver status ...
	I0924 01:03:25.257244 1920479 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0924 01:03:25.268979 1920479 ssh_runner.go:195] Run: sudo egrep ^[0-9]+:freezer: /proc/1401/cgroup
	I0924 01:03:25.278964 1920479 api_server.go:182] apiserver freezer: "6:freezer:/docker/ccc439a9d3f4b2418e2db964a4f5b1e760985259efe2d78ee089adfb4b98d28d/crio/crio-f09451e32f48b35f5ff4b42fdf28ac9dd56ffad04415ea4913991da6ec124194"
	I0924 01:03:25.279031 1920479 ssh_runner.go:195] Run: sudo cat /sys/fs/cgroup/freezer/docker/ccc439a9d3f4b2418e2db964a4f5b1e760985259efe2d78ee089adfb4b98d28d/crio/crio-f09451e32f48b35f5ff4b42fdf28ac9dd56ffad04415ea4913991da6ec124194/freezer.state
	I0924 01:03:25.287918 1920479 api_server.go:204] freezer state: "THAWED"
	I0924 01:03:25.287949 1920479 api_server.go:253] Checking apiserver healthz at https://192.168.49.254:8443/healthz ...
	I0924 01:03:25.295846 1920479 api_server.go:279] https://192.168.49.254:8443/healthz returned 200:
	ok
	I0924 01:03:25.295872 1920479 status.go:456] ha-089065 apiserver status = Running (err=<nil>)
	I0924 01:03:25.295884 1920479 status.go:176] ha-089065 status: &{Name:ha-089065 Host:Running Kubelet:Running APIServer:Running Kubeconfig:Configured Worker:false TimeToStop: DockerEnv: PodManEnv:}
	I0924 01:03:25.295901 1920479 status.go:174] checking status of ha-089065-m02 ...
	I0924 01:03:25.296224 1920479 cli_runner.go:164] Run: docker container inspect ha-089065-m02 --format={{.State.Status}}
	I0924 01:03:25.313888 1920479 status.go:364] ha-089065-m02 host status = "Stopped" (err=<nil>)
	I0924 01:03:25.313915 1920479 status.go:377] host is not running, skipping remaining checks
	I0924 01:03:25.313923 1920479 status.go:176] ha-089065-m02 status: &{Name:ha-089065-m02 Host:Stopped Kubelet:Stopped APIServer:Stopped Kubeconfig:Stopped Worker:false TimeToStop: DockerEnv: PodManEnv:}
	I0924 01:03:25.313951 1920479 status.go:174] checking status of ha-089065-m03 ...
	I0924 01:03:25.314336 1920479 cli_runner.go:164] Run: docker container inspect ha-089065-m03 --format={{.State.Status}}
	I0924 01:03:25.332122 1920479 status.go:364] ha-089065-m03 host status = "Running" (err=<nil>)
	I0924 01:03:25.332149 1920479 host.go:66] Checking if "ha-089065-m03" exists ...
	I0924 01:03:25.332464 1920479 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" ha-089065-m03
	I0924 01:03:25.350261 1920479 host.go:66] Checking if "ha-089065-m03" exists ...
	I0924 01:03:25.350576 1920479 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
	I0924 01:03:25.350629 1920479 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-089065-m03
	I0924 01:03:25.367565 1920479 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:34716 SSHKeyPath:/home/jenkins/minikube-integration/19696-1868219/.minikube/machines/ha-089065-m03/id_rsa Username:docker}
	I0924 01:03:25.458980 1920479 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
	I0924 01:03:25.471341 1920479 kubeconfig.go:125] found "ha-089065" server: "https://192.168.49.254:8443"
	I0924 01:03:25.471372 1920479 api_server.go:166] Checking apiserver status ...
	I0924 01:03:25.471422 1920479 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0924 01:03:25.482044 1920479 ssh_runner.go:195] Run: sudo egrep ^[0-9]+:freezer: /proc/1326/cgroup
	I0924 01:03:25.491661 1920479 api_server.go:182] apiserver freezer: "6:freezer:/docker/9b8f7bb4cd645358fd238edc431636501584a435f50df839d196116fa8c4701b/crio/crio-d513355509739c520e107c8d58ea067921aebad5e95492ebacd52dbfe896b5c5"
	I0924 01:03:25.491782 1920479 ssh_runner.go:195] Run: sudo cat /sys/fs/cgroup/freezer/docker/9b8f7bb4cd645358fd238edc431636501584a435f50df839d196116fa8c4701b/crio/crio-d513355509739c520e107c8d58ea067921aebad5e95492ebacd52dbfe896b5c5/freezer.state
	I0924 01:03:25.500254 1920479 api_server.go:204] freezer state: "THAWED"
	I0924 01:03:25.500284 1920479 api_server.go:253] Checking apiserver healthz at https://192.168.49.254:8443/healthz ...
	I0924 01:03:25.507918 1920479 api_server.go:279] https://192.168.49.254:8443/healthz returned 200:
	ok
	I0924 01:03:25.507945 1920479 status.go:456] ha-089065-m03 apiserver status = Running (err=<nil>)
	I0924 01:03:25.507955 1920479 status.go:176] ha-089065-m03 status: &{Name:ha-089065-m03 Host:Running Kubelet:Running APIServer:Running Kubeconfig:Configured Worker:false TimeToStop: DockerEnv: PodManEnv:}
	I0924 01:03:25.507972 1920479 status.go:174] checking status of ha-089065-m04 ...
	I0924 01:03:25.508290 1920479 cli_runner.go:164] Run: docker container inspect ha-089065-m04 --format={{.State.Status}}
	I0924 01:03:25.530022 1920479 status.go:364] ha-089065-m04 host status = "Running" (err=<nil>)
	I0924 01:03:25.530049 1920479 host.go:66] Checking if "ha-089065-m04" exists ...
	I0924 01:03:25.530367 1920479 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" ha-089065-m04
	I0924 01:03:25.548166 1920479 host.go:66] Checking if "ha-089065-m04" exists ...
	I0924 01:03:25.548474 1920479 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
	I0924 01:03:25.548520 1920479 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-089065-m04
	I0924 01:03:25.565123 1920479 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:34721 SSHKeyPath:/home/jenkins/minikube-integration/19696-1868219/.minikube/machines/ha-089065-m04/id_rsa Username:docker}
	I0924 01:03:25.654796 1920479 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
	I0924 01:03:25.666353 1920479 status.go:176] ha-089065-m04 status: &{Name:ha-089065-m04 Host:Running Kubelet:Running APIServer:Irrelevant Kubeconfig:Irrelevant Worker:true TimeToStop: DockerEnv: PodManEnv:}

                                                
                                                
** /stderr **
--- PASS: TestMultiControlPlane/serial/StopSecondaryNode (12.70s)

                                                
                                    
x
+
TestMultiControlPlane/serial/DegradedAfterControlPlaneNodeStop (0.72s)

                                                
                                                
=== RUN   TestMultiControlPlane/serial/DegradedAfterControlPlaneNodeStop
ha_test.go:390: (dbg) Run:  out/minikube-linux-arm64 profile list --output json
--- PASS: TestMultiControlPlane/serial/DegradedAfterControlPlaneNodeStop (0.72s)

                                                
                                    
x
+
TestMultiControlPlane/serial/RestartSecondaryNode (23.51s)

                                                
                                                
=== RUN   TestMultiControlPlane/serial/RestartSecondaryNode
ha_test.go:420: (dbg) Run:  out/minikube-linux-arm64 -p ha-089065 node start m02 -v=7 --alsologtostderr
E0924 01:03:45.736665 1873600 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /home/jenkins/minikube-integration/19696-1868219/.minikube/profiles/functional-838183/client.crt: no such file or directory" logger="UnhandledError"
ha_test.go:420: (dbg) Done: out/minikube-linux-arm64 -p ha-089065 node start m02 -v=7 --alsologtostderr: (22.084755163s)
ha_test.go:428: (dbg) Run:  out/minikube-linux-arm64 -p ha-089065 status -v=7 --alsologtostderr
ha_test.go:428: (dbg) Done: out/minikube-linux-arm64 -p ha-089065 status -v=7 --alsologtostderr: (1.304543111s)
ha_test.go:448: (dbg) Run:  kubectl get nodes
--- PASS: TestMultiControlPlane/serial/RestartSecondaryNode (23.51s)

                                                
                                    
x
+
TestMultiControlPlane/serial/HAppyAfterSecondaryNodeRestart (1.29s)

                                                
                                                
=== RUN   TestMultiControlPlane/serial/HAppyAfterSecondaryNodeRestart
ha_test.go:281: (dbg) Run:  out/minikube-linux-arm64 profile list --output json
ha_test.go:281: (dbg) Done: out/minikube-linux-arm64 profile list --output json: (1.287720075s)
--- PASS: TestMultiControlPlane/serial/HAppyAfterSecondaryNodeRestart (1.29s)

                                                
                                    
x
+
TestMultiControlPlane/serial/RestartClusterKeepsNodes (190.46s)

                                                
                                                
=== RUN   TestMultiControlPlane/serial/RestartClusterKeepsNodes
ha_test.go:456: (dbg) Run:  out/minikube-linux-arm64 node list -p ha-089065 -v=7 --alsologtostderr
ha_test.go:462: (dbg) Run:  out/minikube-linux-arm64 stop -p ha-089065 -v=7 --alsologtostderr
E0924 01:04:19.924161 1873600 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /home/jenkins/minikube-integration/19696-1868219/.minikube/profiles/addons-371349/client.crt: no such file or directory" logger="UnhandledError"
E0924 01:04:26.698162 1873600 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /home/jenkins/minikube-integration/19696-1868219/.minikube/profiles/functional-838183/client.crt: no such file or directory" logger="UnhandledError"
ha_test.go:462: (dbg) Done: out/minikube-linux-arm64 stop -p ha-089065 -v=7 --alsologtostderr: (37.207285419s)
ha_test.go:467: (dbg) Run:  out/minikube-linux-arm64 start -p ha-089065 --wait=true -v=7 --alsologtostderr
E0924 01:04:47.627000 1873600 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /home/jenkins/minikube-integration/19696-1868219/.minikube/profiles/addons-371349/client.crt: no such file or directory" logger="UnhandledError"
E0924 01:05:48.619661 1873600 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /home/jenkins/minikube-integration/19696-1868219/.minikube/profiles/functional-838183/client.crt: no such file or directory" logger="UnhandledError"
ha_test.go:467: (dbg) Done: out/minikube-linux-arm64 start -p ha-089065 --wait=true -v=7 --alsologtostderr: (2m33.089991202s)
ha_test.go:472: (dbg) Run:  out/minikube-linux-arm64 node list -p ha-089065
--- PASS: TestMultiControlPlane/serial/RestartClusterKeepsNodes (190.46s)

                                                
                                    
x
+
TestMultiControlPlane/serial/DeleteSecondaryNode (12.36s)

                                                
                                                
=== RUN   TestMultiControlPlane/serial/DeleteSecondaryNode
ha_test.go:487: (dbg) Run:  out/minikube-linux-arm64 -p ha-089065 node delete m03 -v=7 --alsologtostderr
ha_test.go:487: (dbg) Done: out/minikube-linux-arm64 -p ha-089065 node delete m03 -v=7 --alsologtostderr: (11.443816623s)
ha_test.go:493: (dbg) Run:  out/minikube-linux-arm64 -p ha-089065 status -v=7 --alsologtostderr
ha_test.go:511: (dbg) Run:  kubectl get nodes
ha_test.go:519: (dbg) Run:  kubectl get nodes -o "go-template='{{range .items}}{{range .status.conditions}}{{if eq .type "Ready"}} {{.status}}{{"\n"}}{{end}}{{end}}{{end}}'"
--- PASS: TestMultiControlPlane/serial/DeleteSecondaryNode (12.36s)

                                                
                                    
x
+
TestMultiControlPlane/serial/DegradedAfterSecondaryNodeDelete (0.71s)

                                                
                                                
=== RUN   TestMultiControlPlane/serial/DegradedAfterSecondaryNodeDelete
ha_test.go:390: (dbg) Run:  out/minikube-linux-arm64 profile list --output json
--- PASS: TestMultiControlPlane/serial/DegradedAfterSecondaryNodeDelete (0.71s)

                                                
                                    
x
+
TestMultiControlPlane/serial/StopCluster (35.79s)

                                                
                                                
=== RUN   TestMultiControlPlane/serial/StopCluster
ha_test.go:531: (dbg) Run:  out/minikube-linux-arm64 -p ha-089065 stop -v=7 --alsologtostderr
ha_test.go:531: (dbg) Done: out/minikube-linux-arm64 -p ha-089065 stop -v=7 --alsologtostderr: (35.666995545s)
ha_test.go:537: (dbg) Run:  out/minikube-linux-arm64 -p ha-089065 status -v=7 --alsologtostderr
ha_test.go:537: (dbg) Non-zero exit: out/minikube-linux-arm64 -p ha-089065 status -v=7 --alsologtostderr: exit status 7 (123.304923ms)

                                                
                                                
-- stdout --
	ha-089065
	type: Control Plane
	host: Stopped
	kubelet: Stopped
	apiserver: Stopped
	kubeconfig: Stopped
	
	ha-089065-m02
	type: Control Plane
	host: Stopped
	kubelet: Stopped
	apiserver: Stopped
	kubeconfig: Stopped
	
	ha-089065-m04
	type: Worker
	host: Stopped
	kubelet: Stopped
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0924 01:07:50.441959 1935044 out.go:345] Setting OutFile to fd 1 ...
	I0924 01:07:50.442091 1935044 out.go:392] TERM=,COLORTERM=, which probably does not support color
	I0924 01:07:50.442100 1935044 out.go:358] Setting ErrFile to fd 2...
	I0924 01:07:50.442105 1935044 out.go:392] TERM=,COLORTERM=, which probably does not support color
	I0924 01:07:50.442379 1935044 root.go:338] Updating PATH: /home/jenkins/minikube-integration/19696-1868219/.minikube/bin
	I0924 01:07:50.442585 1935044 out.go:352] Setting JSON to false
	I0924 01:07:50.442626 1935044 mustload.go:65] Loading cluster: ha-089065
	I0924 01:07:50.442713 1935044 notify.go:220] Checking for updates...
	I0924 01:07:50.443093 1935044 config.go:182] Loaded profile config "ha-089065": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.31.1
	I0924 01:07:50.443109 1935044 status.go:174] checking status of ha-089065 ...
	I0924 01:07:50.443676 1935044 cli_runner.go:164] Run: docker container inspect ha-089065 --format={{.State.Status}}
	I0924 01:07:50.461784 1935044 status.go:364] ha-089065 host status = "Stopped" (err=<nil>)
	I0924 01:07:50.461809 1935044 status.go:377] host is not running, skipping remaining checks
	I0924 01:07:50.461843 1935044 status.go:176] ha-089065 status: &{Name:ha-089065 Host:Stopped Kubelet:Stopped APIServer:Stopped Kubeconfig:Stopped Worker:false TimeToStop: DockerEnv: PodManEnv:}
	I0924 01:07:50.461893 1935044 status.go:174] checking status of ha-089065-m02 ...
	I0924 01:07:50.462224 1935044 cli_runner.go:164] Run: docker container inspect ha-089065-m02 --format={{.State.Status}}
	I0924 01:07:50.492255 1935044 status.go:364] ha-089065-m02 host status = "Stopped" (err=<nil>)
	I0924 01:07:50.492278 1935044 status.go:377] host is not running, skipping remaining checks
	I0924 01:07:50.492285 1935044 status.go:176] ha-089065-m02 status: &{Name:ha-089065-m02 Host:Stopped Kubelet:Stopped APIServer:Stopped Kubeconfig:Stopped Worker:false TimeToStop: DockerEnv: PodManEnv:}
	I0924 01:07:50.492304 1935044 status.go:174] checking status of ha-089065-m04 ...
	I0924 01:07:50.492624 1935044 cli_runner.go:164] Run: docker container inspect ha-089065-m04 --format={{.State.Status}}
	I0924 01:07:50.511778 1935044 status.go:364] ha-089065-m04 host status = "Stopped" (err=<nil>)
	I0924 01:07:50.511800 1935044 status.go:377] host is not running, skipping remaining checks
	I0924 01:07:50.511808 1935044 status.go:176] ha-089065-m04 status: &{Name:ha-089065-m04 Host:Stopped Kubelet:Stopped APIServer:Stopped Kubeconfig:Stopped Worker:true TimeToStop: DockerEnv: PodManEnv:}

                                                
                                                
** /stderr **
--- PASS: TestMultiControlPlane/serial/StopCluster (35.79s)

                                                
                                    
x
+
TestMultiControlPlane/serial/RestartCluster (109.57s)

                                                
                                                
=== RUN   TestMultiControlPlane/serial/RestartCluster
ha_test.go:560: (dbg) Run:  out/minikube-linux-arm64 start -p ha-089065 --wait=true -v=7 --alsologtostderr --driver=docker  --container-runtime=crio
E0924 01:08:04.750696 1873600 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /home/jenkins/minikube-integration/19696-1868219/.minikube/profiles/functional-838183/client.crt: no such file or directory" logger="UnhandledError"
E0924 01:08:32.461145 1873600 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /home/jenkins/minikube-integration/19696-1868219/.minikube/profiles/functional-838183/client.crt: no such file or directory" logger="UnhandledError"
E0924 01:09:19.925140 1873600 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /home/jenkins/minikube-integration/19696-1868219/.minikube/profiles/addons-371349/client.crt: no such file or directory" logger="UnhandledError"
ha_test.go:560: (dbg) Done: out/minikube-linux-arm64 start -p ha-089065 --wait=true -v=7 --alsologtostderr --driver=docker  --container-runtime=crio: (1m48.679963811s)
ha_test.go:566: (dbg) Run:  out/minikube-linux-arm64 -p ha-089065 status -v=7 --alsologtostderr
ha_test.go:584: (dbg) Run:  kubectl get nodes
ha_test.go:592: (dbg) Run:  kubectl get nodes -o "go-template='{{range .items}}{{range .status.conditions}}{{if eq .type "Ready"}} {{.status}}{{"\n"}}{{end}}{{end}}{{end}}'"
--- PASS: TestMultiControlPlane/serial/RestartCluster (109.57s)

                                                
                                    
x
+
TestMultiControlPlane/serial/DegradedAfterClusterRestart (0.71s)

                                                
                                                
=== RUN   TestMultiControlPlane/serial/DegradedAfterClusterRestart
ha_test.go:390: (dbg) Run:  out/minikube-linux-arm64 profile list --output json
--- PASS: TestMultiControlPlane/serial/DegradedAfterClusterRestart (0.71s)

                                                
                                    
x
+
TestMultiControlPlane/serial/AddSecondaryNode (69.9s)

                                                
                                                
=== RUN   TestMultiControlPlane/serial/AddSecondaryNode
ha_test.go:605: (dbg) Run:  out/minikube-linux-arm64 node add -p ha-089065 --control-plane -v=7 --alsologtostderr
ha_test.go:605: (dbg) Done: out/minikube-linux-arm64 node add -p ha-089065 --control-plane -v=7 --alsologtostderr: (1m8.987157707s)
ha_test.go:611: (dbg) Run:  out/minikube-linux-arm64 -p ha-089065 status -v=7 --alsologtostderr
--- PASS: TestMultiControlPlane/serial/AddSecondaryNode (69.90s)

                                                
                                    
x
+
TestMultiControlPlane/serial/HAppyAfterSecondaryNodeAdd (0.94s)

                                                
                                                
=== RUN   TestMultiControlPlane/serial/HAppyAfterSecondaryNodeAdd
ha_test.go:281: (dbg) Run:  out/minikube-linux-arm64 profile list --output json
--- PASS: TestMultiControlPlane/serial/HAppyAfterSecondaryNodeAdd (0.94s)

                                                
                                    
x
+
TestJSONOutput/start/Command (76.17s)

                                                
                                                
=== RUN   TestJSONOutput/start/Command
json_output_test.go:63: (dbg) Run:  out/minikube-linux-arm64 start -p json-output-844748 --output=json --user=testUser --memory=2200 --wait=true --driver=docker  --container-runtime=crio
json_output_test.go:63: (dbg) Done: out/minikube-linux-arm64 start -p json-output-844748 --output=json --user=testUser --memory=2200 --wait=true --driver=docker  --container-runtime=crio: (1m16.163881619s)
--- PASS: TestJSONOutput/start/Command (76.17s)

                                                
                                    
x
+
TestJSONOutput/start/Audit (0s)

                                                
                                                
=== RUN   TestJSONOutput/start/Audit
--- PASS: TestJSONOutput/start/Audit (0.00s)

                                                
                                    
x
+
TestJSONOutput/start/parallel/DistinctCurrentSteps (0s)

                                                
                                                
=== RUN   TestJSONOutput/start/parallel/DistinctCurrentSteps
=== PAUSE TestJSONOutput/start/parallel/DistinctCurrentSteps

                                                
                                                

                                                
                                                
=== CONT  TestJSONOutput/start/parallel/DistinctCurrentSteps
--- PASS: TestJSONOutput/start/parallel/DistinctCurrentSteps (0.00s)

                                                
                                    
x
+
TestJSONOutput/start/parallel/IncreasingCurrentSteps (0s)

                                                
                                                
=== RUN   TestJSONOutput/start/parallel/IncreasingCurrentSteps
=== PAUSE TestJSONOutput/start/parallel/IncreasingCurrentSteps

                                                
                                                

                                                
                                                
=== CONT  TestJSONOutput/start/parallel/IncreasingCurrentSteps
--- PASS: TestJSONOutput/start/parallel/IncreasingCurrentSteps (0.00s)

                                                
                                    
x
+
TestJSONOutput/pause/Command (0.74s)

                                                
                                                
=== RUN   TestJSONOutput/pause/Command
json_output_test.go:63: (dbg) Run:  out/minikube-linux-arm64 pause -p json-output-844748 --output=json --user=testUser
--- PASS: TestJSONOutput/pause/Command (0.74s)

                                                
                                    
x
+
TestJSONOutput/pause/Audit (0s)

                                                
                                                
=== RUN   TestJSONOutput/pause/Audit
--- PASS: TestJSONOutput/pause/Audit (0.00s)

                                                
                                    
x
+
TestJSONOutput/pause/parallel/DistinctCurrentSteps (0s)

                                                
                                                
=== RUN   TestJSONOutput/pause/parallel/DistinctCurrentSteps
=== PAUSE TestJSONOutput/pause/parallel/DistinctCurrentSteps

                                                
                                                

                                                
                                                
=== CONT  TestJSONOutput/pause/parallel/DistinctCurrentSteps
--- PASS: TestJSONOutput/pause/parallel/DistinctCurrentSteps (0.00s)

                                                
                                    
x
+
TestJSONOutput/pause/parallel/IncreasingCurrentSteps (0s)

                                                
                                                
=== RUN   TestJSONOutput/pause/parallel/IncreasingCurrentSteps
=== PAUSE TestJSONOutput/pause/parallel/IncreasingCurrentSteps

                                                
                                                

                                                
                                                
=== CONT  TestJSONOutput/pause/parallel/IncreasingCurrentSteps
--- PASS: TestJSONOutput/pause/parallel/IncreasingCurrentSteps (0.00s)

                                                
                                    
x
+
TestJSONOutput/unpause/Command (0.65s)

                                                
                                                
=== RUN   TestJSONOutput/unpause/Command
json_output_test.go:63: (dbg) Run:  out/minikube-linux-arm64 unpause -p json-output-844748 --output=json --user=testUser
--- PASS: TestJSONOutput/unpause/Command (0.65s)

                                                
                                    
x
+
TestJSONOutput/unpause/Audit (0s)

                                                
                                                
=== RUN   TestJSONOutput/unpause/Audit
--- PASS: TestJSONOutput/unpause/Audit (0.00s)

                                                
                                    
x
+
TestJSONOutput/unpause/parallel/DistinctCurrentSteps (0s)

                                                
                                                
=== RUN   TestJSONOutput/unpause/parallel/DistinctCurrentSteps
=== PAUSE TestJSONOutput/unpause/parallel/DistinctCurrentSteps

                                                
                                                

                                                
                                                
=== CONT  TestJSONOutput/unpause/parallel/DistinctCurrentSteps
--- PASS: TestJSONOutput/unpause/parallel/DistinctCurrentSteps (0.00s)

                                                
                                    
x
+
TestJSONOutput/unpause/parallel/IncreasingCurrentSteps (0s)

                                                
                                                
=== RUN   TestJSONOutput/unpause/parallel/IncreasingCurrentSteps
=== PAUSE TestJSONOutput/unpause/parallel/IncreasingCurrentSteps

                                                
                                                

                                                
                                                
=== CONT  TestJSONOutput/unpause/parallel/IncreasingCurrentSteps
--- PASS: TestJSONOutput/unpause/parallel/IncreasingCurrentSteps (0.00s)

                                                
                                    
x
+
TestJSONOutput/stop/Command (5.9s)

                                                
                                                
=== RUN   TestJSONOutput/stop/Command
json_output_test.go:63: (dbg) Run:  out/minikube-linux-arm64 stop -p json-output-844748 --output=json --user=testUser
json_output_test.go:63: (dbg) Done: out/minikube-linux-arm64 stop -p json-output-844748 --output=json --user=testUser: (5.902515952s)
--- PASS: TestJSONOutput/stop/Command (5.90s)

                                                
                                    
x
+
TestJSONOutput/stop/Audit (0s)

                                                
                                                
=== RUN   TestJSONOutput/stop/Audit
--- PASS: TestJSONOutput/stop/Audit (0.00s)

                                                
                                    
x
+
TestJSONOutput/stop/parallel/DistinctCurrentSteps (0s)

                                                
                                                
=== RUN   TestJSONOutput/stop/parallel/DistinctCurrentSteps
=== PAUSE TestJSONOutput/stop/parallel/DistinctCurrentSteps

                                                
                                                

                                                
                                                
=== CONT  TestJSONOutput/stop/parallel/DistinctCurrentSteps
--- PASS: TestJSONOutput/stop/parallel/DistinctCurrentSteps (0.00s)

                                                
                                    
x
+
TestJSONOutput/stop/parallel/IncreasingCurrentSteps (0s)

                                                
                                                
=== RUN   TestJSONOutput/stop/parallel/IncreasingCurrentSteps
=== PAUSE TestJSONOutput/stop/parallel/IncreasingCurrentSteps

                                                
                                                

                                                
                                                
=== CONT  TestJSONOutput/stop/parallel/IncreasingCurrentSteps
--- PASS: TestJSONOutput/stop/parallel/IncreasingCurrentSteps (0.00s)

                                                
                                    
x
+
TestErrorJSONOutput (0.21s)

                                                
                                                
=== RUN   TestErrorJSONOutput
json_output_test.go:160: (dbg) Run:  out/minikube-linux-arm64 start -p json-output-error-452805 --memory=2200 --output=json --wait=true --driver=fail
json_output_test.go:160: (dbg) Non-zero exit: out/minikube-linux-arm64 start -p json-output-error-452805 --memory=2200 --output=json --wait=true --driver=fail: exit status 56 (76.555481ms)

                                                
                                                
-- stdout --
	{"specversion":"1.0","id":"70df52e3-51a0-4de5-8fa9-eb14909051f6","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.step","datacontenttype":"application/json","data":{"currentstep":"0","message":"[json-output-error-452805] minikube v1.34.0 on Ubuntu 20.04 (arm64)","name":"Initial Minikube Setup","totalsteps":"19"}}
	{"specversion":"1.0","id":"d5e12a56-79ee-41e1-9779-1a6bb408dea4","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_LOCATION=19696"}}
	{"specversion":"1.0","id":"3c933dc0-edc6-41b8-b48c-76ad7b19a4f4","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true"}}
	{"specversion":"1.0","id":"2d698553-f959-46c8-a75c-08d8776cbb88","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"KUBECONFIG=/home/jenkins/minikube-integration/19696-1868219/kubeconfig"}}
	{"specversion":"1.0","id":"fba10eb2-0911-44cf-a6d5-69436de6d042","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_HOME=/home/jenkins/minikube-integration/19696-1868219/.minikube"}}
	{"specversion":"1.0","id":"0195b892-0ab6-441c-829a-6df856db83ac","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_BIN=out/minikube-linux-arm64"}}
	{"specversion":"1.0","id":"adb12c46-8e5a-4978-a300-eeba31e987ae","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_FORCE_SYSTEMD="}}
	{"specversion":"1.0","id":"8ecfeea6-a4f5-407f-aa4e-a98bfac6ca9a","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.error","datacontenttype":"application/json","data":{"advice":"","exitcode":"56","issues":"","message":"The driver 'fail' is not supported on linux/arm64","name":"DRV_UNSUPPORTED_OS","url":""}}

                                                
                                                
-- /stdout --
helpers_test.go:175: Cleaning up "json-output-error-452805" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-arm64 delete -p json-output-error-452805
--- PASS: TestErrorJSONOutput (0.21s)

                                                
                                    
x
+
TestKicCustomNetwork/create_custom_network (38.56s)

                                                
                                                
=== RUN   TestKicCustomNetwork/create_custom_network
kic_custom_network_test.go:57: (dbg) Run:  out/minikube-linux-arm64 start -p docker-network-881481 --network=
kic_custom_network_test.go:57: (dbg) Done: out/minikube-linux-arm64 start -p docker-network-881481 --network=: (36.502339721s)
kic_custom_network_test.go:150: (dbg) Run:  docker network ls --format {{.Name}}
helpers_test.go:175: Cleaning up "docker-network-881481" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-arm64 delete -p docker-network-881481
E0924 01:13:04.751303 1873600 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /home/jenkins/minikube-integration/19696-1868219/.minikube/profiles/functional-838183/client.crt: no such file or directory" logger="UnhandledError"
helpers_test.go:178: (dbg) Done: out/minikube-linux-arm64 delete -p docker-network-881481: (2.037327494s)
--- PASS: TestKicCustomNetwork/create_custom_network (38.56s)

                                                
                                    
x
+
TestKicCustomNetwork/use_default_bridge_network (35.02s)

                                                
                                                
=== RUN   TestKicCustomNetwork/use_default_bridge_network
kic_custom_network_test.go:57: (dbg) Run:  out/minikube-linux-arm64 start -p docker-network-078276 --network=bridge
kic_custom_network_test.go:57: (dbg) Done: out/minikube-linux-arm64 start -p docker-network-078276 --network=bridge: (33.08224497s)
kic_custom_network_test.go:150: (dbg) Run:  docker network ls --format {{.Name}}
helpers_test.go:175: Cleaning up "docker-network-078276" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-arm64 delete -p docker-network-078276
helpers_test.go:178: (dbg) Done: out/minikube-linux-arm64 delete -p docker-network-078276: (1.918403121s)
--- PASS: TestKicCustomNetwork/use_default_bridge_network (35.02s)

                                                
                                    
x
+
TestKicExistingNetwork (33.14s)

                                                
                                                
=== RUN   TestKicExistingNetwork
I0924 01:13:40.705268 1873600 cli_runner.go:164] Run: docker network inspect existing-network --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
W0924 01:13:40.718551 1873600 cli_runner.go:211] docker network inspect existing-network --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}" returned with exit code 1
I0924 01:13:40.718638 1873600 network_create.go:284] running [docker network inspect existing-network] to gather additional debugging logs...
I0924 01:13:40.718656 1873600 cli_runner.go:164] Run: docker network inspect existing-network
W0924 01:13:40.732186 1873600 cli_runner.go:211] docker network inspect existing-network returned with exit code 1
I0924 01:13:40.732220 1873600 network_create.go:287] error running [docker network inspect existing-network]: docker network inspect existing-network: exit status 1
stdout:
[]

                                                
                                                
stderr:
Error response from daemon: network existing-network not found
I0924 01:13:40.732233 1873600 network_create.go:289] output of [docker network inspect existing-network]: -- stdout --
[]

                                                
                                                
-- /stdout --
** stderr ** 
Error response from daemon: network existing-network not found

                                                
                                                
** /stderr **
I0924 01:13:40.733126 1873600 cli_runner.go:164] Run: docker network inspect bridge --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
I0924 01:13:40.748621 1873600 network.go:211] skipping subnet 192.168.49.0/24 that is taken: &{IP:192.168.49.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.49.0/24 Gateway:192.168.49.1 ClientMin:192.168.49.2 ClientMax:192.168.49.254 Broadcast:192.168.49.255 IsPrivate:true Interface:{IfaceName:br-026d292615bf IfaceIPv4:192.168.49.1 IfaceMTU:1500 IfaceMAC:02:42:19:a6:02:49} reservation:<nil>}
I0924 01:13:40.749027 1873600 network.go:206] using free private subnet 192.168.58.0/24: &{IP:192.168.58.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.58.0/24 Gateway:192.168.58.1 ClientMin:192.168.58.2 ClientMax:192.168.58.254 Broadcast:192.168.58.255 IsPrivate:true Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:} reservation:0x400184b850}
I0924 01:13:40.749051 1873600 network_create.go:124] attempt to create docker network existing-network 192.168.58.0/24 with gateway 192.168.58.1 and MTU of 1500 ...
I0924 01:13:40.749106 1873600 cli_runner.go:164] Run: docker network create --driver=bridge --subnet=192.168.58.0/24 --gateway=192.168.58.1 -o --ip-masq -o --icc -o com.docker.network.driver.mtu=1500 --label=created_by.minikube.sigs.k8s.io=true --label=name.minikube.sigs.k8s.io=existing-network existing-network
I0924 01:13:40.820188 1873600 network_create.go:108] docker network existing-network 192.168.58.0/24 created
kic_custom_network_test.go:150: (dbg) Run:  docker network ls --format {{.Name}}
kic_custom_network_test.go:93: (dbg) Run:  out/minikube-linux-arm64 start -p existing-network-213895 --network=existing-network
kic_custom_network_test.go:93: (dbg) Done: out/minikube-linux-arm64 start -p existing-network-213895 --network=existing-network: (31.083386322s)
helpers_test.go:175: Cleaning up "existing-network-213895" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-arm64 delete -p existing-network-213895
helpers_test.go:178: (dbg) Done: out/minikube-linux-arm64 delete -p existing-network-213895: (1.910874959s)
I0924 01:14:13.830057 1873600 cli_runner.go:164] Run: docker network ls --filter=label=existing-network --format {{.Name}}
--- PASS: TestKicExistingNetwork (33.14s)

                                                
                                    
x
+
TestKicCustomSubnet (36.81s)

                                                
                                                
=== RUN   TestKicCustomSubnet
kic_custom_network_test.go:112: (dbg) Run:  out/minikube-linux-arm64 start -p custom-subnet-369518 --subnet=192.168.60.0/24
E0924 01:14:19.924147 1873600 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /home/jenkins/minikube-integration/19696-1868219/.minikube/profiles/addons-371349/client.crt: no such file or directory" logger="UnhandledError"
kic_custom_network_test.go:112: (dbg) Done: out/minikube-linux-arm64 start -p custom-subnet-369518 --subnet=192.168.60.0/24: (34.703947608s)
kic_custom_network_test.go:161: (dbg) Run:  docker network inspect custom-subnet-369518 --format "{{(index .IPAM.Config 0).Subnet}}"
helpers_test.go:175: Cleaning up "custom-subnet-369518" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-arm64 delete -p custom-subnet-369518
helpers_test.go:178: (dbg) Done: out/minikube-linux-arm64 delete -p custom-subnet-369518: (2.086264961s)
--- PASS: TestKicCustomSubnet (36.81s)

                                                
                                    
x
+
TestKicStaticIP (31.78s)

                                                
                                                
=== RUN   TestKicStaticIP
kic_custom_network_test.go:132: (dbg) Run:  out/minikube-linux-arm64 start -p static-ip-477070 --static-ip=192.168.200.200
kic_custom_network_test.go:132: (dbg) Done: out/minikube-linux-arm64 start -p static-ip-477070 --static-ip=192.168.200.200: (29.483934841s)
kic_custom_network_test.go:138: (dbg) Run:  out/minikube-linux-arm64 -p static-ip-477070 ip
helpers_test.go:175: Cleaning up "static-ip-477070" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-arm64 delete -p static-ip-477070
helpers_test.go:178: (dbg) Done: out/minikube-linux-arm64 delete -p static-ip-477070: (2.152986117s)
--- PASS: TestKicStaticIP (31.78s)

                                                
                                    
x
+
TestMainNoArgs (0.05s)

                                                
                                                
=== RUN   TestMainNoArgs
main_test.go:68: (dbg) Run:  out/minikube-linux-arm64
--- PASS: TestMainNoArgs (0.05s)

                                                
                                    
x
+
TestMinikubeProfile (72.78s)

                                                
                                                
=== RUN   TestMinikubeProfile
minikube_profile_test.go:44: (dbg) Run:  out/minikube-linux-arm64 start -p first-599858 --driver=docker  --container-runtime=crio
E0924 01:15:42.989980 1873600 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /home/jenkins/minikube-integration/19696-1868219/.minikube/profiles/addons-371349/client.crt: no such file or directory" logger="UnhandledError"
minikube_profile_test.go:44: (dbg) Done: out/minikube-linux-arm64 start -p first-599858 --driver=docker  --container-runtime=crio: (33.675415209s)
minikube_profile_test.go:44: (dbg) Run:  out/minikube-linux-arm64 start -p second-602401 --driver=docker  --container-runtime=crio
minikube_profile_test.go:44: (dbg) Done: out/minikube-linux-arm64 start -p second-602401 --driver=docker  --container-runtime=crio: (33.874926873s)
minikube_profile_test.go:51: (dbg) Run:  out/minikube-linux-arm64 profile first-599858
minikube_profile_test.go:55: (dbg) Run:  out/minikube-linux-arm64 profile list -ojson
minikube_profile_test.go:51: (dbg) Run:  out/minikube-linux-arm64 profile second-602401
minikube_profile_test.go:55: (dbg) Run:  out/minikube-linux-arm64 profile list -ojson
helpers_test.go:175: Cleaning up "second-602401" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-arm64 delete -p second-602401
helpers_test.go:178: (dbg) Done: out/minikube-linux-arm64 delete -p second-602401: (1.979610197s)
helpers_test.go:175: Cleaning up "first-599858" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-arm64 delete -p first-599858
helpers_test.go:178: (dbg) Done: out/minikube-linux-arm64 delete -p first-599858: (1.913724907s)
--- PASS: TestMinikubeProfile (72.78s)

                                                
                                    
x
+
TestMountStart/serial/StartWithMountFirst (7.13s)

                                                
                                                
=== RUN   TestMountStart/serial/StartWithMountFirst
mount_start_test.go:98: (dbg) Run:  out/minikube-linux-arm64 start -p mount-start-1-286709 --memory=2048 --mount --mount-gid 0 --mount-msize 6543 --mount-port 46464 --mount-uid 0 --no-kubernetes --driver=docker  --container-runtime=crio
mount_start_test.go:98: (dbg) Done: out/minikube-linux-arm64 start -p mount-start-1-286709 --memory=2048 --mount --mount-gid 0 --mount-msize 6543 --mount-port 46464 --mount-uid 0 --no-kubernetes --driver=docker  --container-runtime=crio: (6.134000667s)
--- PASS: TestMountStart/serial/StartWithMountFirst (7.13s)

                                                
                                    
x
+
TestMountStart/serial/VerifyMountFirst (0.25s)

                                                
                                                
=== RUN   TestMountStart/serial/VerifyMountFirst
mount_start_test.go:114: (dbg) Run:  out/minikube-linux-arm64 -p mount-start-1-286709 ssh -- ls /minikube-host
--- PASS: TestMountStart/serial/VerifyMountFirst (0.25s)

                                                
                                    
x
+
TestMountStart/serial/StartWithMountSecond (6.6s)

                                                
                                                
=== RUN   TestMountStart/serial/StartWithMountSecond
mount_start_test.go:98: (dbg) Run:  out/minikube-linux-arm64 start -p mount-start-2-288588 --memory=2048 --mount --mount-gid 0 --mount-msize 6543 --mount-port 46465 --mount-uid 0 --no-kubernetes --driver=docker  --container-runtime=crio
mount_start_test.go:98: (dbg) Done: out/minikube-linux-arm64 start -p mount-start-2-288588 --memory=2048 --mount --mount-gid 0 --mount-msize 6543 --mount-port 46465 --mount-uid 0 --no-kubernetes --driver=docker  --container-runtime=crio: (5.601416937s)
--- PASS: TestMountStart/serial/StartWithMountSecond (6.60s)

                                                
                                    
x
+
TestMountStart/serial/VerifyMountSecond (0.25s)

                                                
                                                
=== RUN   TestMountStart/serial/VerifyMountSecond
mount_start_test.go:114: (dbg) Run:  out/minikube-linux-arm64 -p mount-start-2-288588 ssh -- ls /minikube-host
--- PASS: TestMountStart/serial/VerifyMountSecond (0.25s)

                                                
                                    
x
+
TestMountStart/serial/DeleteFirst (1.62s)

                                                
                                                
=== RUN   TestMountStart/serial/DeleteFirst
pause_test.go:132: (dbg) Run:  out/minikube-linux-arm64 delete -p mount-start-1-286709 --alsologtostderr -v=5
pause_test.go:132: (dbg) Done: out/minikube-linux-arm64 delete -p mount-start-1-286709 --alsologtostderr -v=5: (1.619489197s)
--- PASS: TestMountStart/serial/DeleteFirst (1.62s)

                                                
                                    
x
+
TestMountStart/serial/VerifyMountPostDelete (0.25s)

                                                
                                                
=== RUN   TestMountStart/serial/VerifyMountPostDelete
mount_start_test.go:114: (dbg) Run:  out/minikube-linux-arm64 -p mount-start-2-288588 ssh -- ls /minikube-host
--- PASS: TestMountStart/serial/VerifyMountPostDelete (0.25s)

                                                
                                    
x
+
TestMountStart/serial/Stop (1.21s)

                                                
                                                
=== RUN   TestMountStart/serial/Stop
mount_start_test.go:155: (dbg) Run:  out/minikube-linux-arm64 stop -p mount-start-2-288588
mount_start_test.go:155: (dbg) Done: out/minikube-linux-arm64 stop -p mount-start-2-288588: (1.205931945s)
--- PASS: TestMountStart/serial/Stop (1.21s)

                                                
                                    
x
+
TestMountStart/serial/RestartStopped (7.99s)

                                                
                                                
=== RUN   TestMountStart/serial/RestartStopped
mount_start_test.go:166: (dbg) Run:  out/minikube-linux-arm64 start -p mount-start-2-288588
mount_start_test.go:166: (dbg) Done: out/minikube-linux-arm64 start -p mount-start-2-288588: (6.987242137s)
--- PASS: TestMountStart/serial/RestartStopped (7.99s)

                                                
                                    
x
+
TestMountStart/serial/VerifyMountPostStop (0.26s)

                                                
                                                
=== RUN   TestMountStart/serial/VerifyMountPostStop
mount_start_test.go:114: (dbg) Run:  out/minikube-linux-arm64 -p mount-start-2-288588 ssh -- ls /minikube-host
--- PASS: TestMountStart/serial/VerifyMountPostStop (0.26s)

                                                
                                    
x
+
TestMultiNode/serial/FreshStart2Nodes (78.85s)

                                                
                                                
=== RUN   TestMultiNode/serial/FreshStart2Nodes
multinode_test.go:96: (dbg) Run:  out/minikube-linux-arm64 start -p multinode-081867 --wait=true --memory=2200 --nodes=2 -v=8 --alsologtostderr --driver=docker  --container-runtime=crio
E0924 01:18:04.750655 1873600 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /home/jenkins/minikube-integration/19696-1868219/.minikube/profiles/functional-838183/client.crt: no such file or directory" logger="UnhandledError"
multinode_test.go:96: (dbg) Done: out/minikube-linux-arm64 start -p multinode-081867 --wait=true --memory=2200 --nodes=2 -v=8 --alsologtostderr --driver=docker  --container-runtime=crio: (1m18.372196553s)
multinode_test.go:102: (dbg) Run:  out/minikube-linux-arm64 -p multinode-081867 status --alsologtostderr
--- PASS: TestMultiNode/serial/FreshStart2Nodes (78.85s)

                                                
                                    
x
+
TestMultiNode/serial/DeployApp2Nodes (7.11s)

                                                
                                                
=== RUN   TestMultiNode/serial/DeployApp2Nodes
multinode_test.go:493: (dbg) Run:  out/minikube-linux-arm64 kubectl -p multinode-081867 -- apply -f ./testdata/multinodes/multinode-pod-dns-test.yaml
multinode_test.go:498: (dbg) Run:  out/minikube-linux-arm64 kubectl -p multinode-081867 -- rollout status deployment/busybox
multinode_test.go:498: (dbg) Done: out/minikube-linux-arm64 kubectl -p multinode-081867 -- rollout status deployment/busybox: (5.332665558s)
multinode_test.go:505: (dbg) Run:  out/minikube-linux-arm64 kubectl -p multinode-081867 -- get pods -o jsonpath='{.items[*].status.podIP}'
multinode_test.go:528: (dbg) Run:  out/minikube-linux-arm64 kubectl -p multinode-081867 -- get pods -o jsonpath='{.items[*].metadata.name}'
multinode_test.go:536: (dbg) Run:  out/minikube-linux-arm64 kubectl -p multinode-081867 -- exec busybox-7dff88458-984r9 -- nslookup kubernetes.io
multinode_test.go:536: (dbg) Run:  out/minikube-linux-arm64 kubectl -p multinode-081867 -- exec busybox-7dff88458-xq7fp -- nslookup kubernetes.io
multinode_test.go:546: (dbg) Run:  out/minikube-linux-arm64 kubectl -p multinode-081867 -- exec busybox-7dff88458-984r9 -- nslookup kubernetes.default
multinode_test.go:546: (dbg) Run:  out/minikube-linux-arm64 kubectl -p multinode-081867 -- exec busybox-7dff88458-xq7fp -- nslookup kubernetes.default
multinode_test.go:554: (dbg) Run:  out/minikube-linux-arm64 kubectl -p multinode-081867 -- exec busybox-7dff88458-984r9 -- nslookup kubernetes.default.svc.cluster.local
multinode_test.go:554: (dbg) Run:  out/minikube-linux-arm64 kubectl -p multinode-081867 -- exec busybox-7dff88458-xq7fp -- nslookup kubernetes.default.svc.cluster.local
--- PASS: TestMultiNode/serial/DeployApp2Nodes (7.11s)

                                                
                                    
x
+
TestMultiNode/serial/PingHostFrom2Pods (0.92s)

                                                
                                                
=== RUN   TestMultiNode/serial/PingHostFrom2Pods
multinode_test.go:564: (dbg) Run:  out/minikube-linux-arm64 kubectl -p multinode-081867 -- get pods -o jsonpath='{.items[*].metadata.name}'
multinode_test.go:572: (dbg) Run:  out/minikube-linux-arm64 kubectl -p multinode-081867 -- exec busybox-7dff88458-984r9 -- sh -c "nslookup host.minikube.internal | awk 'NR==5' | cut -d' ' -f3"
multinode_test.go:583: (dbg) Run:  out/minikube-linux-arm64 kubectl -p multinode-081867 -- exec busybox-7dff88458-984r9 -- sh -c "ping -c 1 192.168.67.1"
multinode_test.go:572: (dbg) Run:  out/minikube-linux-arm64 kubectl -p multinode-081867 -- exec busybox-7dff88458-xq7fp -- sh -c "nslookup host.minikube.internal | awk 'NR==5' | cut -d' ' -f3"
multinode_test.go:583: (dbg) Run:  out/minikube-linux-arm64 kubectl -p multinode-081867 -- exec busybox-7dff88458-xq7fp -- sh -c "ping -c 1 192.168.67.1"
--- PASS: TestMultiNode/serial/PingHostFrom2Pods (0.92s)

                                                
                                    
x
+
TestMultiNode/serial/AddNode (57.22s)

                                                
                                                
=== RUN   TestMultiNode/serial/AddNode
multinode_test.go:121: (dbg) Run:  out/minikube-linux-arm64 node add -p multinode-081867 -v 3 --alsologtostderr
E0924 01:19:19.925139 1873600 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /home/jenkins/minikube-integration/19696-1868219/.minikube/profiles/addons-371349/client.crt: no such file or directory" logger="UnhandledError"
multinode_test.go:121: (dbg) Done: out/minikube-linux-arm64 node add -p multinode-081867 -v 3 --alsologtostderr: (56.59365031s)
multinode_test.go:127: (dbg) Run:  out/minikube-linux-arm64 -p multinode-081867 status --alsologtostderr
--- PASS: TestMultiNode/serial/AddNode (57.22s)

                                                
                                    
x
+
TestMultiNode/serial/MultiNodeLabels (0.09s)

                                                
                                                
=== RUN   TestMultiNode/serial/MultiNodeLabels
multinode_test.go:221: (dbg) Run:  kubectl --context multinode-081867 get nodes -o "jsonpath=[{range .items[*]}{.metadata.labels},{end}]"
--- PASS: TestMultiNode/serial/MultiNodeLabels (0.09s)

                                                
                                    
x
+
TestMultiNode/serial/ProfileList (0.65s)

                                                
                                                
=== RUN   TestMultiNode/serial/ProfileList
multinode_test.go:143: (dbg) Run:  out/minikube-linux-arm64 profile list --output json
--- PASS: TestMultiNode/serial/ProfileList (0.65s)

                                                
                                    
x
+
TestMultiNode/serial/CopyFile (9.4s)

                                                
                                                
=== RUN   TestMultiNode/serial/CopyFile
multinode_test.go:184: (dbg) Run:  out/minikube-linux-arm64 -p multinode-081867 status --output json --alsologtostderr
E0924 01:19:27.823174 1873600 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /home/jenkins/minikube-integration/19696-1868219/.minikube/profiles/functional-838183/client.crt: no such file or directory" logger="UnhandledError"
helpers_test.go:556: (dbg) Run:  out/minikube-linux-arm64 -p multinode-081867 cp testdata/cp-test.txt multinode-081867:/home/docker/cp-test.txt
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p multinode-081867 ssh -n multinode-081867 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:556: (dbg) Run:  out/minikube-linux-arm64 -p multinode-081867 cp multinode-081867:/home/docker/cp-test.txt /tmp/TestMultiNodeserialCopyFile2231963600/001/cp-test_multinode-081867.txt
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p multinode-081867 ssh -n multinode-081867 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:556: (dbg) Run:  out/minikube-linux-arm64 -p multinode-081867 cp multinode-081867:/home/docker/cp-test.txt multinode-081867-m02:/home/docker/cp-test_multinode-081867_multinode-081867-m02.txt
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p multinode-081867 ssh -n multinode-081867 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p multinode-081867 ssh -n multinode-081867-m02 "sudo cat /home/docker/cp-test_multinode-081867_multinode-081867-m02.txt"
helpers_test.go:556: (dbg) Run:  out/minikube-linux-arm64 -p multinode-081867 cp multinode-081867:/home/docker/cp-test.txt multinode-081867-m03:/home/docker/cp-test_multinode-081867_multinode-081867-m03.txt
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p multinode-081867 ssh -n multinode-081867 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p multinode-081867 ssh -n multinode-081867-m03 "sudo cat /home/docker/cp-test_multinode-081867_multinode-081867-m03.txt"
helpers_test.go:556: (dbg) Run:  out/minikube-linux-arm64 -p multinode-081867 cp testdata/cp-test.txt multinode-081867-m02:/home/docker/cp-test.txt
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p multinode-081867 ssh -n multinode-081867-m02 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:556: (dbg) Run:  out/minikube-linux-arm64 -p multinode-081867 cp multinode-081867-m02:/home/docker/cp-test.txt /tmp/TestMultiNodeserialCopyFile2231963600/001/cp-test_multinode-081867-m02.txt
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p multinode-081867 ssh -n multinode-081867-m02 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:556: (dbg) Run:  out/minikube-linux-arm64 -p multinode-081867 cp multinode-081867-m02:/home/docker/cp-test.txt multinode-081867:/home/docker/cp-test_multinode-081867-m02_multinode-081867.txt
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p multinode-081867 ssh -n multinode-081867-m02 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p multinode-081867 ssh -n multinode-081867 "sudo cat /home/docker/cp-test_multinode-081867-m02_multinode-081867.txt"
helpers_test.go:556: (dbg) Run:  out/minikube-linux-arm64 -p multinode-081867 cp multinode-081867-m02:/home/docker/cp-test.txt multinode-081867-m03:/home/docker/cp-test_multinode-081867-m02_multinode-081867-m03.txt
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p multinode-081867 ssh -n multinode-081867-m02 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p multinode-081867 ssh -n multinode-081867-m03 "sudo cat /home/docker/cp-test_multinode-081867-m02_multinode-081867-m03.txt"
helpers_test.go:556: (dbg) Run:  out/minikube-linux-arm64 -p multinode-081867 cp testdata/cp-test.txt multinode-081867-m03:/home/docker/cp-test.txt
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p multinode-081867 ssh -n multinode-081867-m03 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:556: (dbg) Run:  out/minikube-linux-arm64 -p multinode-081867 cp multinode-081867-m03:/home/docker/cp-test.txt /tmp/TestMultiNodeserialCopyFile2231963600/001/cp-test_multinode-081867-m03.txt
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p multinode-081867 ssh -n multinode-081867-m03 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:556: (dbg) Run:  out/minikube-linux-arm64 -p multinode-081867 cp multinode-081867-m03:/home/docker/cp-test.txt multinode-081867:/home/docker/cp-test_multinode-081867-m03_multinode-081867.txt
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p multinode-081867 ssh -n multinode-081867-m03 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p multinode-081867 ssh -n multinode-081867 "sudo cat /home/docker/cp-test_multinode-081867-m03_multinode-081867.txt"
helpers_test.go:556: (dbg) Run:  out/minikube-linux-arm64 -p multinode-081867 cp multinode-081867-m03:/home/docker/cp-test.txt multinode-081867-m02:/home/docker/cp-test_multinode-081867-m03_multinode-081867-m02.txt
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p multinode-081867 ssh -n multinode-081867-m03 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p multinode-081867 ssh -n multinode-081867-m02 "sudo cat /home/docker/cp-test_multinode-081867-m03_multinode-081867-m02.txt"
--- PASS: TestMultiNode/serial/CopyFile (9.40s)

                                                
                                    
x
+
TestMultiNode/serial/StopNode (2.24s)

                                                
                                                
=== RUN   TestMultiNode/serial/StopNode
multinode_test.go:248: (dbg) Run:  out/minikube-linux-arm64 -p multinode-081867 node stop m03
multinode_test.go:248: (dbg) Done: out/minikube-linux-arm64 -p multinode-081867 node stop m03: (1.206829655s)
multinode_test.go:254: (dbg) Run:  out/minikube-linux-arm64 -p multinode-081867 status
multinode_test.go:254: (dbg) Non-zero exit: out/minikube-linux-arm64 -p multinode-081867 status: exit status 7 (533.60887ms)

                                                
                                                
-- stdout --
	multinode-081867
	type: Control Plane
	host: Running
	kubelet: Running
	apiserver: Running
	kubeconfig: Configured
	
	multinode-081867-m02
	type: Worker
	host: Running
	kubelet: Running
	
	multinode-081867-m03
	type: Worker
	host: Stopped
	kubelet: Stopped
	

                                                
                                                
-- /stdout --
multinode_test.go:261: (dbg) Run:  out/minikube-linux-arm64 -p multinode-081867 status --alsologtostderr
multinode_test.go:261: (dbg) Non-zero exit: out/minikube-linux-arm64 -p multinode-081867 status --alsologtostderr: exit status 7 (498.933543ms)

                                                
                                                
-- stdout --
	multinode-081867
	type: Control Plane
	host: Running
	kubelet: Running
	apiserver: Running
	kubeconfig: Configured
	
	multinode-081867-m02
	type: Worker
	host: Running
	kubelet: Running
	
	multinode-081867-m03
	type: Worker
	host: Stopped
	kubelet: Stopped
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0924 01:19:38.621101 1988714 out.go:345] Setting OutFile to fd 1 ...
	I0924 01:19:38.621356 1988714 out.go:392] TERM=,COLORTERM=, which probably does not support color
	I0924 01:19:38.621395 1988714 out.go:358] Setting ErrFile to fd 2...
	I0924 01:19:38.621419 1988714 out.go:392] TERM=,COLORTERM=, which probably does not support color
	I0924 01:19:38.621691 1988714 root.go:338] Updating PATH: /home/jenkins/minikube-integration/19696-1868219/.minikube/bin
	I0924 01:19:38.621980 1988714 out.go:352] Setting JSON to false
	I0924 01:19:38.622047 1988714 mustload.go:65] Loading cluster: multinode-081867
	I0924 01:19:38.622155 1988714 notify.go:220] Checking for updates...
	I0924 01:19:38.622586 1988714 config.go:182] Loaded profile config "multinode-081867": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.31.1
	I0924 01:19:38.622627 1988714 status.go:174] checking status of multinode-081867 ...
	I0924 01:19:38.623226 1988714 cli_runner.go:164] Run: docker container inspect multinode-081867 --format={{.State.Status}}
	I0924 01:19:38.643175 1988714 status.go:364] multinode-081867 host status = "Running" (err=<nil>)
	I0924 01:19:38.643196 1988714 host.go:66] Checking if "multinode-081867" exists ...
	I0924 01:19:38.643508 1988714 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" multinode-081867
	I0924 01:19:38.668900 1988714 host.go:66] Checking if "multinode-081867" exists ...
	I0924 01:19:38.669204 1988714 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
	I0924 01:19:38.669260 1988714 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" multinode-081867
	I0924 01:19:38.689656 1988714 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:34826 SSHKeyPath:/home/jenkins/minikube-integration/19696-1868219/.minikube/machines/multinode-081867/id_rsa Username:docker}
	I0924 01:19:38.779578 1988714 ssh_runner.go:195] Run: systemctl --version
	I0924 01:19:38.783913 1988714 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
	I0924 01:19:38.796513 1988714 cli_runner.go:164] Run: docker system info --format "{{json .}}"
	I0924 01:19:38.854994 1988714 info.go:266] docker info: {ID:5FDH:SA5P:5GCT:NLAS:B73P:SGDQ:PBG5:UBVH:UZY3:RXGO:CI7S:WAIH Containers:3 ContainersRunning:2 ContainersPaused:0 ContainersStopped:1 Images:3 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:false BridgeNfIP6Tables:false Debug:false NFd:40 OomKillDisable:true NGoroutines:61 SystemTime:2024-09-24 01:19:38.844027419 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1070-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Architecture:a
arch64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8214831104 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-21-244 Labels:[] ExperimentalBuild:false ServerVersion:27.3.1 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:7f7fdf5fed64eb6a7caf99b3e12efcf9d60e311c Expected:7f7fdf5fed64eb6a7caf99b3e12efcf9d60e311c} RuncCommit:{ID:v1.1.14-0-g2c9f560 Expected:v1.1.14-0-g2c9f560} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:[WARNING: brid
ge-nf-call-iptables is disabled WARNING: bridge-nf-call-ip6tables is disabled] ServerErrors:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.17.1] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.29.7]] Warnings:<nil>}}
	I0924 01:19:38.855650 1988714 kubeconfig.go:125] found "multinode-081867" server: "https://192.168.67.2:8443"
	I0924 01:19:38.855685 1988714 api_server.go:166] Checking apiserver status ...
	I0924 01:19:38.855733 1988714 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0924 01:19:38.867892 1988714 ssh_runner.go:195] Run: sudo egrep ^[0-9]+:freezer: /proc/1391/cgroup
	I0924 01:19:38.877505 1988714 api_server.go:182] apiserver freezer: "6:freezer:/docker/447e57bfce3ddde0a0a216399bd3f4785ec5421c521e74d2def0d293aa447c40/crio/crio-caac14cad4d72adefcd2afbd53eafdd624fd3945337c8170acbc6eea94efbf76"
	I0924 01:19:38.877575 1988714 ssh_runner.go:195] Run: sudo cat /sys/fs/cgroup/freezer/docker/447e57bfce3ddde0a0a216399bd3f4785ec5421c521e74d2def0d293aa447c40/crio/crio-caac14cad4d72adefcd2afbd53eafdd624fd3945337c8170acbc6eea94efbf76/freezer.state
	I0924 01:19:38.886385 1988714 api_server.go:204] freezer state: "THAWED"
	I0924 01:19:38.886415 1988714 api_server.go:253] Checking apiserver healthz at https://192.168.67.2:8443/healthz ...
	I0924 01:19:38.894132 1988714 api_server.go:279] https://192.168.67.2:8443/healthz returned 200:
	ok
	I0924 01:19:38.894160 1988714 status.go:456] multinode-081867 apiserver status = Running (err=<nil>)
	I0924 01:19:38.894180 1988714 status.go:176] multinode-081867 status: &{Name:multinode-081867 Host:Running Kubelet:Running APIServer:Running Kubeconfig:Configured Worker:false TimeToStop: DockerEnv: PodManEnv:}
	I0924 01:19:38.894202 1988714 status.go:174] checking status of multinode-081867-m02 ...
	I0924 01:19:38.894514 1988714 cli_runner.go:164] Run: docker container inspect multinode-081867-m02 --format={{.State.Status}}
	I0924 01:19:38.911093 1988714 status.go:364] multinode-081867-m02 host status = "Running" (err=<nil>)
	I0924 01:19:38.911121 1988714 host.go:66] Checking if "multinode-081867-m02" exists ...
	I0924 01:19:38.911427 1988714 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" multinode-081867-m02
	I0924 01:19:38.927460 1988714 host.go:66] Checking if "multinode-081867-m02" exists ...
	I0924 01:19:38.927795 1988714 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
	I0924 01:19:38.927852 1988714 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" multinode-081867-m02
	I0924 01:19:38.944834 1988714 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:34831 SSHKeyPath:/home/jenkins/minikube-integration/19696-1868219/.minikube/machines/multinode-081867-m02/id_rsa Username:docker}
	I0924 01:19:39.034657 1988714 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
	I0924 01:19:39.045734 1988714 status.go:176] multinode-081867-m02 status: &{Name:multinode-081867-m02 Host:Running Kubelet:Running APIServer:Irrelevant Kubeconfig:Irrelevant Worker:true TimeToStop: DockerEnv: PodManEnv:}
	I0924 01:19:39.045778 1988714 status.go:174] checking status of multinode-081867-m03 ...
	I0924 01:19:39.046126 1988714 cli_runner.go:164] Run: docker container inspect multinode-081867-m03 --format={{.State.Status}}
	I0924 01:19:39.063245 1988714 status.go:364] multinode-081867-m03 host status = "Stopped" (err=<nil>)
	I0924 01:19:39.063271 1988714 status.go:377] host is not running, skipping remaining checks
	I0924 01:19:39.063289 1988714 status.go:176] multinode-081867-m03 status: &{Name:multinode-081867-m03 Host:Stopped Kubelet:Stopped APIServer:Stopped Kubeconfig:Stopped Worker:true TimeToStop: DockerEnv: PodManEnv:}

                                                
                                                
** /stderr **
--- PASS: TestMultiNode/serial/StopNode (2.24s)

                                                
                                    
x
+
TestMultiNode/serial/StartAfterStop (9.62s)

                                                
                                                
=== RUN   TestMultiNode/serial/StartAfterStop
multinode_test.go:282: (dbg) Run:  out/minikube-linux-arm64 -p multinode-081867 node start m03 -v=7 --alsologtostderr
multinode_test.go:282: (dbg) Done: out/minikube-linux-arm64 -p multinode-081867 node start m03 -v=7 --alsologtostderr: (8.875522836s)
multinode_test.go:290: (dbg) Run:  out/minikube-linux-arm64 -p multinode-081867 status -v=7 --alsologtostderr
multinode_test.go:306: (dbg) Run:  kubectl get nodes
--- PASS: TestMultiNode/serial/StartAfterStop (9.62s)

                                                
                                    
x
+
TestMultiNode/serial/RestartKeepsNodes (81.06s)

                                                
                                                
=== RUN   TestMultiNode/serial/RestartKeepsNodes
multinode_test.go:314: (dbg) Run:  out/minikube-linux-arm64 node list -p multinode-081867
multinode_test.go:321: (dbg) Run:  out/minikube-linux-arm64 stop -p multinode-081867
multinode_test.go:321: (dbg) Done: out/minikube-linux-arm64 stop -p multinode-081867: (24.857833274s)
multinode_test.go:326: (dbg) Run:  out/minikube-linux-arm64 start -p multinode-081867 --wait=true -v=8 --alsologtostderr
multinode_test.go:326: (dbg) Done: out/minikube-linux-arm64 start -p multinode-081867 --wait=true -v=8 --alsologtostderr: (56.084962842s)
multinode_test.go:331: (dbg) Run:  out/minikube-linux-arm64 node list -p multinode-081867
--- PASS: TestMultiNode/serial/RestartKeepsNodes (81.06s)

                                                
                                    
x
+
TestMultiNode/serial/DeleteNode (5.2s)

                                                
                                                
=== RUN   TestMultiNode/serial/DeleteNode
multinode_test.go:416: (dbg) Run:  out/minikube-linux-arm64 -p multinode-081867 node delete m03
multinode_test.go:416: (dbg) Done: out/minikube-linux-arm64 -p multinode-081867 node delete m03: (4.554483242s)
multinode_test.go:422: (dbg) Run:  out/minikube-linux-arm64 -p multinode-081867 status --alsologtostderr
multinode_test.go:436: (dbg) Run:  kubectl get nodes
multinode_test.go:444: (dbg) Run:  kubectl get nodes -o "go-template='{{range .items}}{{range .status.conditions}}{{if eq .type "Ready"}} {{.status}}{{"\n"}}{{end}}{{end}}{{end}}'"
--- PASS: TestMultiNode/serial/DeleteNode (5.20s)

                                                
                                    
x
+
TestMultiNode/serial/StopMultiNode (23.79s)

                                                
                                                
=== RUN   TestMultiNode/serial/StopMultiNode
multinode_test.go:345: (dbg) Run:  out/minikube-linux-arm64 -p multinode-081867 stop
multinode_test.go:345: (dbg) Done: out/minikube-linux-arm64 -p multinode-081867 stop: (23.603960747s)
multinode_test.go:351: (dbg) Run:  out/minikube-linux-arm64 -p multinode-081867 status
multinode_test.go:351: (dbg) Non-zero exit: out/minikube-linux-arm64 -p multinode-081867 status: exit status 7 (90.410067ms)

                                                
                                                
-- stdout --
	multinode-081867
	type: Control Plane
	host: Stopped
	kubelet: Stopped
	apiserver: Stopped
	kubeconfig: Stopped
	
	multinode-081867-m02
	type: Worker
	host: Stopped
	kubelet: Stopped
	

                                                
                                                
-- /stdout --
multinode_test.go:358: (dbg) Run:  out/minikube-linux-arm64 -p multinode-081867 status --alsologtostderr
multinode_test.go:358: (dbg) Non-zero exit: out/minikube-linux-arm64 -p multinode-081867 status --alsologtostderr: exit status 7 (94.151261ms)

                                                
                                                
-- stdout --
	multinode-081867
	type: Control Plane
	host: Stopped
	kubelet: Stopped
	apiserver: Stopped
	kubeconfig: Stopped
	
	multinode-081867-m02
	type: Worker
	host: Stopped
	kubelet: Stopped
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0924 01:21:38.700067 1996130 out.go:345] Setting OutFile to fd 1 ...
	I0924 01:21:38.700485 1996130 out.go:392] TERM=,COLORTERM=, which probably does not support color
	I0924 01:21:38.700525 1996130 out.go:358] Setting ErrFile to fd 2...
	I0924 01:21:38.700547 1996130 out.go:392] TERM=,COLORTERM=, which probably does not support color
	I0924 01:21:38.700859 1996130 root.go:338] Updating PATH: /home/jenkins/minikube-integration/19696-1868219/.minikube/bin
	I0924 01:21:38.701079 1996130 out.go:352] Setting JSON to false
	I0924 01:21:38.701155 1996130 mustload.go:65] Loading cluster: multinode-081867
	I0924 01:21:38.701218 1996130 notify.go:220] Checking for updates...
	I0924 01:21:38.702305 1996130 config.go:182] Loaded profile config "multinode-081867": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.31.1
	I0924 01:21:38.702356 1996130 status.go:174] checking status of multinode-081867 ...
	I0924 01:21:38.703033 1996130 cli_runner.go:164] Run: docker container inspect multinode-081867 --format={{.State.Status}}
	I0924 01:21:38.722003 1996130 status.go:364] multinode-081867 host status = "Stopped" (err=<nil>)
	I0924 01:21:38.722023 1996130 status.go:377] host is not running, skipping remaining checks
	I0924 01:21:38.722030 1996130 status.go:176] multinode-081867 status: &{Name:multinode-081867 Host:Stopped Kubelet:Stopped APIServer:Stopped Kubeconfig:Stopped Worker:false TimeToStop: DockerEnv: PodManEnv:}
	I0924 01:21:38.722070 1996130 status.go:174] checking status of multinode-081867-m02 ...
	I0924 01:21:38.722365 1996130 cli_runner.go:164] Run: docker container inspect multinode-081867-m02 --format={{.State.Status}}
	I0924 01:21:38.750691 1996130 status.go:364] multinode-081867-m02 host status = "Stopped" (err=<nil>)
	I0924 01:21:38.750714 1996130 status.go:377] host is not running, skipping remaining checks
	I0924 01:21:38.750722 1996130 status.go:176] multinode-081867-m02 status: &{Name:multinode-081867-m02 Host:Stopped Kubelet:Stopped APIServer:Stopped Kubeconfig:Stopped Worker:true TimeToStop: DockerEnv: PodManEnv:}

                                                
                                                
** /stderr **
--- PASS: TestMultiNode/serial/StopMultiNode (23.79s)

                                                
                                    
x
+
TestMultiNode/serial/RestartMultiNode (52.35s)

                                                
                                                
=== RUN   TestMultiNode/serial/RestartMultiNode
multinode_test.go:376: (dbg) Run:  out/minikube-linux-arm64 start -p multinode-081867 --wait=true -v=8 --alsologtostderr --driver=docker  --container-runtime=crio
multinode_test.go:376: (dbg) Done: out/minikube-linux-arm64 start -p multinode-081867 --wait=true -v=8 --alsologtostderr --driver=docker  --container-runtime=crio: (51.672978915s)
multinode_test.go:382: (dbg) Run:  out/minikube-linux-arm64 -p multinode-081867 status --alsologtostderr
multinode_test.go:396: (dbg) Run:  kubectl get nodes
multinode_test.go:404: (dbg) Run:  kubectl get nodes -o "go-template='{{range .items}}{{range .status.conditions}}{{if eq .type "Ready"}} {{.status}}{{"\n"}}{{end}}{{end}}{{end}}'"
--- PASS: TestMultiNode/serial/RestartMultiNode (52.35s)

                                                
                                    
x
+
TestMultiNode/serial/ValidateNameConflict (31.74s)

                                                
                                                
=== RUN   TestMultiNode/serial/ValidateNameConflict
multinode_test.go:455: (dbg) Run:  out/minikube-linux-arm64 node list -p multinode-081867
multinode_test.go:464: (dbg) Run:  out/minikube-linux-arm64 start -p multinode-081867-m02 --driver=docker  --container-runtime=crio
multinode_test.go:464: (dbg) Non-zero exit: out/minikube-linux-arm64 start -p multinode-081867-m02 --driver=docker  --container-runtime=crio: exit status 14 (85.192953ms)

                                                
                                                
-- stdout --
	* [multinode-081867-m02] minikube v1.34.0 on Ubuntu 20.04 (arm64)
	  - MINIKUBE_LOCATION=19696
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - KUBECONFIG=/home/jenkins/minikube-integration/19696-1868219/kubeconfig
	  - MINIKUBE_HOME=/home/jenkins/minikube-integration/19696-1868219/.minikube
	  - MINIKUBE_BIN=out/minikube-linux-arm64
	  - MINIKUBE_FORCE_SYSTEMD=
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	! Profile name 'multinode-081867-m02' is duplicated with machine name 'multinode-081867-m02' in profile 'multinode-081867'
	X Exiting due to MK_USAGE: Profile name should be unique

                                                
                                                
** /stderr **
multinode_test.go:472: (dbg) Run:  out/minikube-linux-arm64 start -p multinode-081867-m03 --driver=docker  --container-runtime=crio
multinode_test.go:472: (dbg) Done: out/minikube-linux-arm64 start -p multinode-081867-m03 --driver=docker  --container-runtime=crio: (29.369283763s)
multinode_test.go:479: (dbg) Run:  out/minikube-linux-arm64 node add -p multinode-081867
multinode_test.go:479: (dbg) Non-zero exit: out/minikube-linux-arm64 node add -p multinode-081867: exit status 80 (316.534649ms)

                                                
                                                
-- stdout --
	* Adding node m03 to cluster multinode-081867 as [worker]
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	X Exiting due to GUEST_NODE_ADD: failed to add node: Node multinode-081867-m03 already exists in multinode-081867-m03 profile
	* 
	╭─────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                             │
	│    * If the above advice does not help, please let us know:                                 │
	│      https://github.com/kubernetes/minikube/issues/new/choose                               │
	│                                                                                             │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │
	│    * Please also attach the following file to the GitHub issue:                             │
	│    * - /tmp/minikube_node_040ea7097fd6ed71e65be9a474587f81f0ccd21d_1.log                    │
	│                                                                                             │
	╰─────────────────────────────────────────────────────────────────────────────────────────────╯

                                                
                                                
** /stderr **
multinode_test.go:484: (dbg) Run:  out/minikube-linux-arm64 delete -p multinode-081867-m03
multinode_test.go:484: (dbg) Done: out/minikube-linux-arm64 delete -p multinode-081867-m03: (1.925021422s)
--- PASS: TestMultiNode/serial/ValidateNameConflict (31.74s)

                                                
                                    
x
+
TestPreload (128.06s)

                                                
                                                
=== RUN   TestPreload
preload_test.go:44: (dbg) Run:  out/minikube-linux-arm64 start -p test-preload-241037 --memory=2200 --alsologtostderr --wait=true --preload=false --driver=docker  --container-runtime=crio --kubernetes-version=v1.24.4
E0924 01:24:19.924681 1873600 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /home/jenkins/minikube-integration/19696-1868219/.minikube/profiles/addons-371349/client.crt: no such file or directory" logger="UnhandledError"
preload_test.go:44: (dbg) Done: out/minikube-linux-arm64 start -p test-preload-241037 --memory=2200 --alsologtostderr --wait=true --preload=false --driver=docker  --container-runtime=crio --kubernetes-version=v1.24.4: (1m34.368626709s)
preload_test.go:52: (dbg) Run:  out/minikube-linux-arm64 -p test-preload-241037 image pull gcr.io/k8s-minikube/busybox
preload_test.go:52: (dbg) Done: out/minikube-linux-arm64 -p test-preload-241037 image pull gcr.io/k8s-minikube/busybox: (3.487188522s)
preload_test.go:58: (dbg) Run:  out/minikube-linux-arm64 stop -p test-preload-241037
preload_test.go:58: (dbg) Done: out/minikube-linux-arm64 stop -p test-preload-241037: (5.741899767s)
preload_test.go:66: (dbg) Run:  out/minikube-linux-arm64 start -p test-preload-241037 --memory=2200 --alsologtostderr -v=1 --wait=true --driver=docker  --container-runtime=crio
preload_test.go:66: (dbg) Done: out/minikube-linux-arm64 start -p test-preload-241037 --memory=2200 --alsologtostderr -v=1 --wait=true --driver=docker  --container-runtime=crio: (21.643428643s)
preload_test.go:71: (dbg) Run:  out/minikube-linux-arm64 -p test-preload-241037 image list
helpers_test.go:175: Cleaning up "test-preload-241037" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-arm64 delete -p test-preload-241037
helpers_test.go:178: (dbg) Done: out/minikube-linux-arm64 delete -p test-preload-241037: (2.469613971s)
--- PASS: TestPreload (128.06s)

                                                
                                    
x
+
TestScheduledStopUnix (107.89s)

                                                
                                                
=== RUN   TestScheduledStopUnix
scheduled_stop_test.go:128: (dbg) Run:  out/minikube-linux-arm64 start -p scheduled-stop-393385 --memory=2048 --driver=docker  --container-runtime=crio
scheduled_stop_test.go:128: (dbg) Done: out/minikube-linux-arm64 start -p scheduled-stop-393385 --memory=2048 --driver=docker  --container-runtime=crio: (31.27010749s)
scheduled_stop_test.go:137: (dbg) Run:  out/minikube-linux-arm64 stop -p scheduled-stop-393385 --schedule 5m
scheduled_stop_test.go:191: (dbg) Run:  out/minikube-linux-arm64 status --format={{.TimeToStop}} -p scheduled-stop-393385 -n scheduled-stop-393385
scheduled_stop_test.go:169: signal error was:  <nil>
scheduled_stop_test.go:137: (dbg) Run:  out/minikube-linux-arm64 stop -p scheduled-stop-393385 --schedule 15s
scheduled_stop_test.go:169: signal error was:  os: process already finished
I0924 01:25:46.630703 1873600 retry.go:31] will retry after 51.65µs: open /home/jenkins/minikube-integration/19696-1868219/.minikube/profiles/scheduled-stop-393385/pid: no such file or directory
I0924 01:25:46.630818 1873600 retry.go:31] will retry after 95.951µs: open /home/jenkins/minikube-integration/19696-1868219/.minikube/profiles/scheduled-stop-393385/pid: no such file or directory
I0924 01:25:46.633077 1873600 retry.go:31] will retry after 261.301µs: open /home/jenkins/minikube-integration/19696-1868219/.minikube/profiles/scheduled-stop-393385/pid: no such file or directory
I0924 01:25:46.633887 1873600 retry.go:31] will retry after 284.289µs: open /home/jenkins/minikube-integration/19696-1868219/.minikube/profiles/scheduled-stop-393385/pid: no such file or directory
I0924 01:25:46.635010 1873600 retry.go:31] will retry after 738.324µs: open /home/jenkins/minikube-integration/19696-1868219/.minikube/profiles/scheduled-stop-393385/pid: no such file or directory
I0924 01:25:46.636115 1873600 retry.go:31] will retry after 860.07µs: open /home/jenkins/minikube-integration/19696-1868219/.minikube/profiles/scheduled-stop-393385/pid: no such file or directory
I0924 01:25:46.637234 1873600 retry.go:31] will retry after 900.592µs: open /home/jenkins/minikube-integration/19696-1868219/.minikube/profiles/scheduled-stop-393385/pid: no such file or directory
I0924 01:25:46.638336 1873600 retry.go:31] will retry after 1.745111ms: open /home/jenkins/minikube-integration/19696-1868219/.minikube/profiles/scheduled-stop-393385/pid: no such file or directory
I0924 01:25:46.640528 1873600 retry.go:31] will retry after 1.330455ms: open /home/jenkins/minikube-integration/19696-1868219/.minikube/profiles/scheduled-stop-393385/pid: no such file or directory
I0924 01:25:46.641979 1873600 retry.go:31] will retry after 2.625406ms: open /home/jenkins/minikube-integration/19696-1868219/.minikube/profiles/scheduled-stop-393385/pid: no such file or directory
I0924 01:25:46.645184 1873600 retry.go:31] will retry after 5.765746ms: open /home/jenkins/minikube-integration/19696-1868219/.minikube/profiles/scheduled-stop-393385/pid: no such file or directory
I0924 01:25:46.651402 1873600 retry.go:31] will retry after 8.515676ms: open /home/jenkins/minikube-integration/19696-1868219/.minikube/profiles/scheduled-stop-393385/pid: no such file or directory
I0924 01:25:46.662185 1873600 retry.go:31] will retry after 17.504931ms: open /home/jenkins/minikube-integration/19696-1868219/.minikube/profiles/scheduled-stop-393385/pid: no such file or directory
I0924 01:25:46.680438 1873600 retry.go:31] will retry after 24.948129ms: open /home/jenkins/minikube-integration/19696-1868219/.minikube/profiles/scheduled-stop-393385/pid: no such file or directory
I0924 01:25:46.705669 1873600 retry.go:31] will retry after 17.414079ms: open /home/jenkins/minikube-integration/19696-1868219/.minikube/profiles/scheduled-stop-393385/pid: no such file or directory
I0924 01:25:46.723885 1873600 retry.go:31] will retry after 47.416393ms: open /home/jenkins/minikube-integration/19696-1868219/.minikube/profiles/scheduled-stop-393385/pid: no such file or directory
scheduled_stop_test.go:137: (dbg) Run:  out/minikube-linux-arm64 stop -p scheduled-stop-393385 --cancel-scheduled
scheduled_stop_test.go:176: (dbg) Run:  out/minikube-linux-arm64 status --format={{.Host}} -p scheduled-stop-393385 -n scheduled-stop-393385
scheduled_stop_test.go:205: (dbg) Run:  out/minikube-linux-arm64 status -p scheduled-stop-393385
scheduled_stop_test.go:137: (dbg) Run:  out/minikube-linux-arm64 stop -p scheduled-stop-393385 --schedule 15s
scheduled_stop_test.go:169: signal error was:  os: process already finished
scheduled_stop_test.go:205: (dbg) Run:  out/minikube-linux-arm64 status -p scheduled-stop-393385
scheduled_stop_test.go:205: (dbg) Non-zero exit: out/minikube-linux-arm64 status -p scheduled-stop-393385: exit status 7 (66.251817ms)

                                                
                                                
-- stdout --
	scheduled-stop-393385
	type: Control Plane
	host: Stopped
	kubelet: Stopped
	apiserver: Stopped
	kubeconfig: Stopped
	

                                                
                                                
-- /stdout --
scheduled_stop_test.go:176: (dbg) Run:  out/minikube-linux-arm64 status --format={{.Host}} -p scheduled-stop-393385 -n scheduled-stop-393385
scheduled_stop_test.go:176: (dbg) Non-zero exit: out/minikube-linux-arm64 status --format={{.Host}} -p scheduled-stop-393385 -n scheduled-stop-393385: exit status 7 (69.480918ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
scheduled_stop_test.go:176: status error: exit status 7 (may be ok)
helpers_test.go:175: Cleaning up "scheduled-stop-393385" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-arm64 delete -p scheduled-stop-393385
helpers_test.go:178: (dbg) Done: out/minikube-linux-arm64 delete -p scheduled-stop-393385: (5.120652878s)
--- PASS: TestScheduledStopUnix (107.89s)

                                                
                                    
x
+
TestInsufficientStorage (12.79s)

                                                
                                                
=== RUN   TestInsufficientStorage
status_test.go:50: (dbg) Run:  out/minikube-linux-arm64 start -p insufficient-storage-007087 --memory=2048 --output=json --wait=true --driver=docker  --container-runtime=crio
status_test.go:50: (dbg) Non-zero exit: out/minikube-linux-arm64 start -p insufficient-storage-007087 --memory=2048 --output=json --wait=true --driver=docker  --container-runtime=crio: exit status 26 (10.327834329s)

                                                
                                                
-- stdout --
	{"specversion":"1.0","id":"5205523d-d22b-4a53-a0a6-99271d079649","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.step","datacontenttype":"application/json","data":{"currentstep":"0","message":"[insufficient-storage-007087] minikube v1.34.0 on Ubuntu 20.04 (arm64)","name":"Initial Minikube Setup","totalsteps":"19"}}
	{"specversion":"1.0","id":"4fc2e898-4ecb-44b9-939f-4e10d7ab4c67","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_LOCATION=19696"}}
	{"specversion":"1.0","id":"8aad76ae-25bb-4a6a-80b3-db755c5e4040","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true"}}
	{"specversion":"1.0","id":"9d6844c6-89bc-4cb3-a384-74ce88c4c7d4","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"KUBECONFIG=/home/jenkins/minikube-integration/19696-1868219/kubeconfig"}}
	{"specversion":"1.0","id":"ae074380-8314-435e-8a0f-c4be86ac0c5e","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_HOME=/home/jenkins/minikube-integration/19696-1868219/.minikube"}}
	{"specversion":"1.0","id":"f33a54da-b62c-4a4c-b627-8b6bbfddfa2e","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_BIN=out/minikube-linux-arm64"}}
	{"specversion":"1.0","id":"f07cd3cc-16f5-4fec-a1b5-0eae33b967ed","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_FORCE_SYSTEMD="}}
	{"specversion":"1.0","id":"feae0420-aecb-43ed-a8b9-51baa86164eb","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_TEST_STORAGE_CAPACITY=100"}}
	{"specversion":"1.0","id":"09d4c02e-655c-48fb-bf3d-50091feca5f4","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_TEST_AVAILABLE_STORAGE=19"}}
	{"specversion":"1.0","id":"3c70c40c-b56e-423f-9bb3-fe24aefd5822","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.step","datacontenttype":"application/json","data":{"currentstep":"1","message":"Using the docker driver based on user configuration","name":"Selecting Driver","totalsteps":"19"}}
	{"specversion":"1.0","id":"0ec6278c-9a0d-4747-be77-e40520797804","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"Using Docker driver with root privileges"}}
	{"specversion":"1.0","id":"b69502a2-0474-4598-bc0c-d70be4b575f1","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.step","datacontenttype":"application/json","data":{"currentstep":"3","message":"Starting \"insufficient-storage-007087\" primary control-plane node in \"insufficient-storage-007087\" cluster","name":"Starting Node","totalsteps":"19"}}
	{"specversion":"1.0","id":"f9ab1a7b-7cff-44f3-8a88-23d480fdc99a","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.step","datacontenttype":"application/json","data":{"currentstep":"5","message":"Pulling base image v0.0.45-1727108449-19696 ...","name":"Pulling Base Image","totalsteps":"19"}}
	{"specversion":"1.0","id":"9de847ef-40a1-4a1b-aaf2-73785b765b79","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.step","datacontenttype":"application/json","data":{"currentstep":"8","message":"Creating docker container (CPUs=2, Memory=2048MB) ...","name":"Creating Container","totalsteps":"19"}}
	{"specversion":"1.0","id":"c3e529fb-2cd5-40dc-bff4-631d2fb1c3fb","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.error","datacontenttype":"application/json","data":{"advice":"Try one or more of the following to free up space on the device:\n\t\n\t\t\t1. Run \"docker system prune\" to remove unused Docker data (optionally with \"-a\")\n\t\t\t2. Increase the storage allocated to Docker for Desktop by clicking on:\n\t\t\t\tDocker icon \u003e Preferences \u003e Resources \u003e Disk Image Size\n\t\t\t3. Run \"minikube ssh -- docker system prune\" if using the Docker container runtime","exitcode":"26","issues":"https://github.com/kubernetes/minikube/issues/9024","message":"Docker is out of disk space! (/var is at 100% of capacity). You can pass '--force' to skip this check.","name":"RSRC_DOCKER_STORAGE","url":""}}

                                                
                                                
-- /stdout --
status_test.go:76: (dbg) Run:  out/minikube-linux-arm64 status -p insufficient-storage-007087 --output=json --layout=cluster
status_test.go:76: (dbg) Non-zero exit: out/minikube-linux-arm64 status -p insufficient-storage-007087 --output=json --layout=cluster: exit status 7 (272.456725ms)

                                                
                                                
-- stdout --
	{"Name":"insufficient-storage-007087","StatusCode":507,"StatusName":"InsufficientStorage","StatusDetail":"/var is almost out of disk space","Step":"Creating Container","StepDetail":"Creating docker container (CPUs=2, Memory=2048MB) ...","BinaryVersion":"v1.34.0","Components":{"kubeconfig":{"Name":"kubeconfig","StatusCode":500,"StatusName":"Error"}},"Nodes":[{"Name":"insufficient-storage-007087","StatusCode":507,"StatusName":"InsufficientStorage","Components":{"apiserver":{"Name":"apiserver","StatusCode":405,"StatusName":"Stopped"},"kubelet":{"Name":"kubelet","StatusCode":405,"StatusName":"Stopped"}}}]}

                                                
                                                
-- /stdout --
** stderr ** 
	E0924 01:27:13.356315 2013583 status.go:451] kubeconfig endpoint: get endpoint: "insufficient-storage-007087" does not appear in /home/jenkins/minikube-integration/19696-1868219/kubeconfig

                                                
                                                
** /stderr **
status_test.go:76: (dbg) Run:  out/minikube-linux-arm64 status -p insufficient-storage-007087 --output=json --layout=cluster
status_test.go:76: (dbg) Non-zero exit: out/minikube-linux-arm64 status -p insufficient-storage-007087 --output=json --layout=cluster: exit status 7 (277.901927ms)

                                                
                                                
-- stdout --
	{"Name":"insufficient-storage-007087","StatusCode":507,"StatusName":"InsufficientStorage","StatusDetail":"/var is almost out of disk space","BinaryVersion":"v1.34.0","Components":{"kubeconfig":{"Name":"kubeconfig","StatusCode":500,"StatusName":"Error"}},"Nodes":[{"Name":"insufficient-storage-007087","StatusCode":507,"StatusName":"InsufficientStorage","Components":{"apiserver":{"Name":"apiserver","StatusCode":405,"StatusName":"Stopped"},"kubelet":{"Name":"kubelet","StatusCode":405,"StatusName":"Stopped"}}}]}

                                                
                                                
-- /stdout --
** stderr ** 
	E0924 01:27:13.634635 2013646 status.go:451] kubeconfig endpoint: get endpoint: "insufficient-storage-007087" does not appear in /home/jenkins/minikube-integration/19696-1868219/kubeconfig
	E0924 01:27:13.644919 2013646 status.go:258] unable to read event log: stat: stat /home/jenkins/minikube-integration/19696-1868219/.minikube/profiles/insufficient-storage-007087/events.json: no such file or directory

                                                
                                                
** /stderr **
helpers_test.go:175: Cleaning up "insufficient-storage-007087" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-arm64 delete -p insufficient-storage-007087
helpers_test.go:178: (dbg) Done: out/minikube-linux-arm64 delete -p insufficient-storage-007087: (1.906077941s)
--- PASS: TestInsufficientStorage (12.79s)

                                                
                                    
x
+
TestRunningBinaryUpgrade (61.78s)

                                                
                                                
=== RUN   TestRunningBinaryUpgrade
=== PAUSE TestRunningBinaryUpgrade

                                                
                                                

                                                
                                                
=== CONT  TestRunningBinaryUpgrade
version_upgrade_test.go:120: (dbg) Run:  /tmp/minikube-v1.26.0.2648040250 start -p running-upgrade-624609 --memory=2200 --vm-driver=docker  --container-runtime=crio
version_upgrade_test.go:120: (dbg) Done: /tmp/minikube-v1.26.0.2648040250 start -p running-upgrade-624609 --memory=2200 --vm-driver=docker  --container-runtime=crio: (32.07833093s)
version_upgrade_test.go:130: (dbg) Run:  out/minikube-linux-arm64 start -p running-upgrade-624609 --memory=2200 --alsologtostderr -v=1 --driver=docker  --container-runtime=crio
version_upgrade_test.go:130: (dbg) Done: out/minikube-linux-arm64 start -p running-upgrade-624609 --memory=2200 --alsologtostderr -v=1 --driver=docker  --container-runtime=crio: (25.390045296s)
helpers_test.go:175: Cleaning up "running-upgrade-624609" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-arm64 delete -p running-upgrade-624609
helpers_test.go:178: (dbg) Done: out/minikube-linux-arm64 delete -p running-upgrade-624609: (3.101093948s)
--- PASS: TestRunningBinaryUpgrade (61.78s)

                                                
                                    
x
+
TestKubernetesUpgrade (392.23s)

                                                
                                                
=== RUN   TestKubernetesUpgrade
=== PAUSE TestKubernetesUpgrade

                                                
                                                

                                                
                                                
=== CONT  TestKubernetesUpgrade
version_upgrade_test.go:222: (dbg) Run:  out/minikube-linux-arm64 start -p kubernetes-upgrade-156319 --memory=2200 --kubernetes-version=v1.20.0 --alsologtostderr -v=1 --driver=docker  --container-runtime=crio
version_upgrade_test.go:222: (dbg) Done: out/minikube-linux-arm64 start -p kubernetes-upgrade-156319 --memory=2200 --kubernetes-version=v1.20.0 --alsologtostderr -v=1 --driver=docker  --container-runtime=crio: (1m17.259850702s)
version_upgrade_test.go:227: (dbg) Run:  out/minikube-linux-arm64 stop -p kubernetes-upgrade-156319
version_upgrade_test.go:227: (dbg) Done: out/minikube-linux-arm64 stop -p kubernetes-upgrade-156319: (1.251411041s)
version_upgrade_test.go:232: (dbg) Run:  out/minikube-linux-arm64 -p kubernetes-upgrade-156319 status --format={{.Host}}
version_upgrade_test.go:232: (dbg) Non-zero exit: out/minikube-linux-arm64 -p kubernetes-upgrade-156319 status --format={{.Host}}: exit status 7 (90.63768ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
version_upgrade_test.go:234: status error: exit status 7 (may be ok)
version_upgrade_test.go:243: (dbg) Run:  out/minikube-linux-arm64 start -p kubernetes-upgrade-156319 --memory=2200 --kubernetes-version=v1.31.1 --alsologtostderr -v=1 --driver=docker  --container-runtime=crio
version_upgrade_test.go:243: (dbg) Done: out/minikube-linux-arm64 start -p kubernetes-upgrade-156319 --memory=2200 --kubernetes-version=v1.31.1 --alsologtostderr -v=1 --driver=docker  --container-runtime=crio: (4m38.363393527s)
version_upgrade_test.go:248: (dbg) Run:  kubectl --context kubernetes-upgrade-156319 version --output=json
version_upgrade_test.go:267: Attempting to downgrade Kubernetes (should fail)
version_upgrade_test.go:269: (dbg) Run:  out/minikube-linux-arm64 start -p kubernetes-upgrade-156319 --memory=2200 --kubernetes-version=v1.20.0 --driver=docker  --container-runtime=crio
version_upgrade_test.go:269: (dbg) Non-zero exit: out/minikube-linux-arm64 start -p kubernetes-upgrade-156319 --memory=2200 --kubernetes-version=v1.20.0 --driver=docker  --container-runtime=crio: exit status 106 (189.852789ms)

                                                
                                                
-- stdout --
	* [kubernetes-upgrade-156319] minikube v1.34.0 on Ubuntu 20.04 (arm64)
	  - MINIKUBE_LOCATION=19696
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - KUBECONFIG=/home/jenkins/minikube-integration/19696-1868219/kubeconfig
	  - MINIKUBE_HOME=/home/jenkins/minikube-integration/19696-1868219/.minikube
	  - MINIKUBE_BIN=out/minikube-linux-arm64
	  - MINIKUBE_FORCE_SYSTEMD=
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	X Exiting due to K8S_DOWNGRADE_UNSUPPORTED: Unable to safely downgrade existing Kubernetes v1.31.1 cluster to v1.20.0
	* Suggestion: 
	
	    1) Recreate the cluster with Kubernetes 1.20.0, by running:
	    
	    minikube delete -p kubernetes-upgrade-156319
	    minikube start -p kubernetes-upgrade-156319 --kubernetes-version=v1.20.0
	    
	    2) Create a second cluster with Kubernetes 1.20.0, by running:
	    
	    minikube start -p kubernetes-upgrade-1563192 --kubernetes-version=v1.20.0
	    
	    3) Use the existing cluster at version Kubernetes 1.31.1, by running:
	    
	    minikube start -p kubernetes-upgrade-156319 --kubernetes-version=v1.31.1
	    

                                                
                                                
** /stderr **
version_upgrade_test.go:273: Attempting restart after unsuccessful downgrade
version_upgrade_test.go:275: (dbg) Run:  out/minikube-linux-arm64 start -p kubernetes-upgrade-156319 --memory=2200 --kubernetes-version=v1.31.1 --alsologtostderr -v=1 --driver=docker  --container-runtime=crio
version_upgrade_test.go:275: (dbg) Done: out/minikube-linux-arm64 start -p kubernetes-upgrade-156319 --memory=2200 --kubernetes-version=v1.31.1 --alsologtostderr -v=1 --driver=docker  --container-runtime=crio: (32.551850414s)
helpers_test.go:175: Cleaning up "kubernetes-upgrade-156319" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-arm64 delete -p kubernetes-upgrade-156319
helpers_test.go:178: (dbg) Done: out/minikube-linux-arm64 delete -p kubernetes-upgrade-156319: (2.390203346s)
--- PASS: TestKubernetesUpgrade (392.23s)

                                                
                                    
x
+
TestMissingContainerUpgrade (153.38s)

                                                
                                                
=== RUN   TestMissingContainerUpgrade
=== PAUSE TestMissingContainerUpgrade

                                                
                                                

                                                
                                                
=== CONT  TestMissingContainerUpgrade
version_upgrade_test.go:309: (dbg) Run:  /tmp/minikube-v1.26.0.3253559855 start -p missing-upgrade-179197 --memory=2200 --driver=docker  --container-runtime=crio
version_upgrade_test.go:309: (dbg) Done: /tmp/minikube-v1.26.0.3253559855 start -p missing-upgrade-179197 --memory=2200 --driver=docker  --container-runtime=crio: (1m19.137459694s)
version_upgrade_test.go:318: (dbg) Run:  docker stop missing-upgrade-179197
version_upgrade_test.go:318: (dbg) Done: docker stop missing-upgrade-179197: (14.461413409s)
version_upgrade_test.go:323: (dbg) Run:  docker rm missing-upgrade-179197
version_upgrade_test.go:329: (dbg) Run:  out/minikube-linux-arm64 start -p missing-upgrade-179197 --memory=2200 --alsologtostderr -v=1 --driver=docker  --container-runtime=crio
E0924 01:29:19.924792 1873600 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /home/jenkins/minikube-integration/19696-1868219/.minikube/profiles/addons-371349/client.crt: no such file or directory" logger="UnhandledError"
version_upgrade_test.go:329: (dbg) Done: out/minikube-linux-arm64 start -p missing-upgrade-179197 --memory=2200 --alsologtostderr -v=1 --driver=docker  --container-runtime=crio: (56.562890489s)
helpers_test.go:175: Cleaning up "missing-upgrade-179197" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-arm64 delete -p missing-upgrade-179197
helpers_test.go:178: (dbg) Done: out/minikube-linux-arm64 delete -p missing-upgrade-179197: (2.120155601s)
--- PASS: TestMissingContainerUpgrade (153.38s)

                                                
                                    
x
+
TestNoKubernetes/serial/StartNoK8sWithVersion (0.08s)

                                                
                                                
=== RUN   TestNoKubernetes/serial/StartNoK8sWithVersion
no_kubernetes_test.go:83: (dbg) Run:  out/minikube-linux-arm64 start -p NoKubernetes-550292 --no-kubernetes --kubernetes-version=1.20 --driver=docker  --container-runtime=crio
no_kubernetes_test.go:83: (dbg) Non-zero exit: out/minikube-linux-arm64 start -p NoKubernetes-550292 --no-kubernetes --kubernetes-version=1.20 --driver=docker  --container-runtime=crio: exit status 14 (83.760101ms)

                                                
                                                
-- stdout --
	* [NoKubernetes-550292] minikube v1.34.0 on Ubuntu 20.04 (arm64)
	  - MINIKUBE_LOCATION=19696
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - KUBECONFIG=/home/jenkins/minikube-integration/19696-1868219/kubeconfig
	  - MINIKUBE_HOME=/home/jenkins/minikube-integration/19696-1868219/.minikube
	  - MINIKUBE_BIN=out/minikube-linux-arm64
	  - MINIKUBE_FORCE_SYSTEMD=
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	X Exiting due to MK_USAGE: cannot specify --kubernetes-version with --no-kubernetes,
	to unset a global config run:
	
	$ minikube config unset kubernetes-version

                                                
                                                
** /stderr **
--- PASS: TestNoKubernetes/serial/StartNoK8sWithVersion (0.08s)

                                                
                                    
x
+
TestNoKubernetes/serial/StartWithK8s (38.69s)

                                                
                                                
=== RUN   TestNoKubernetes/serial/StartWithK8s
no_kubernetes_test.go:95: (dbg) Run:  out/minikube-linux-arm64 start -p NoKubernetes-550292 --driver=docker  --container-runtime=crio
no_kubernetes_test.go:95: (dbg) Done: out/minikube-linux-arm64 start -p NoKubernetes-550292 --driver=docker  --container-runtime=crio: (38.318474424s)
no_kubernetes_test.go:200: (dbg) Run:  out/minikube-linux-arm64 -p NoKubernetes-550292 status -o json
--- PASS: TestNoKubernetes/serial/StartWithK8s (38.69s)

                                                
                                    
x
+
TestNoKubernetes/serial/StartWithStopK8s (19.34s)

                                                
                                                
=== RUN   TestNoKubernetes/serial/StartWithStopK8s
no_kubernetes_test.go:112: (dbg) Run:  out/minikube-linux-arm64 start -p NoKubernetes-550292 --no-kubernetes --driver=docker  --container-runtime=crio
E0924 01:28:04.753952 1873600 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /home/jenkins/minikube-integration/19696-1868219/.minikube/profiles/functional-838183/client.crt: no such file or directory" logger="UnhandledError"
no_kubernetes_test.go:112: (dbg) Done: out/minikube-linux-arm64 start -p NoKubernetes-550292 --no-kubernetes --driver=docker  --container-runtime=crio: (17.031216746s)
no_kubernetes_test.go:200: (dbg) Run:  out/minikube-linux-arm64 -p NoKubernetes-550292 status -o json
no_kubernetes_test.go:200: (dbg) Non-zero exit: out/minikube-linux-arm64 -p NoKubernetes-550292 status -o json: exit status 2 (341.361385ms)

                                                
                                                
-- stdout --
	{"Name":"NoKubernetes-550292","Host":"Running","Kubelet":"Stopped","APIServer":"Stopped","Kubeconfig":"Configured","Worker":false}

                                                
                                                
-- /stdout --
no_kubernetes_test.go:124: (dbg) Run:  out/minikube-linux-arm64 delete -p NoKubernetes-550292
no_kubernetes_test.go:124: (dbg) Done: out/minikube-linux-arm64 delete -p NoKubernetes-550292: (1.962635365s)
--- PASS: TestNoKubernetes/serial/StartWithStopK8s (19.34s)

                                                
                                    
x
+
TestNoKubernetes/serial/Start (9.28s)

                                                
                                                
=== RUN   TestNoKubernetes/serial/Start
no_kubernetes_test.go:136: (dbg) Run:  out/minikube-linux-arm64 start -p NoKubernetes-550292 --no-kubernetes --driver=docker  --container-runtime=crio
no_kubernetes_test.go:136: (dbg) Done: out/minikube-linux-arm64 start -p NoKubernetes-550292 --no-kubernetes --driver=docker  --container-runtime=crio: (9.281791402s)
--- PASS: TestNoKubernetes/serial/Start (9.28s)

                                                
                                    
x
+
TestNoKubernetes/serial/VerifyK8sNotRunning (0.32s)

                                                
                                                
=== RUN   TestNoKubernetes/serial/VerifyK8sNotRunning
no_kubernetes_test.go:147: (dbg) Run:  out/minikube-linux-arm64 ssh -p NoKubernetes-550292 "sudo systemctl is-active --quiet service kubelet"
no_kubernetes_test.go:147: (dbg) Non-zero exit: out/minikube-linux-arm64 ssh -p NoKubernetes-550292 "sudo systemctl is-active --quiet service kubelet": exit status 1 (321.99858ms)

                                                
                                                
** stderr ** 
	ssh: Process exited with status 3

                                                
                                                
** /stderr **
--- PASS: TestNoKubernetes/serial/VerifyK8sNotRunning (0.32s)

                                                
                                    
x
+
TestNoKubernetes/serial/ProfileList (8.89s)

                                                
                                                
=== RUN   TestNoKubernetes/serial/ProfileList
no_kubernetes_test.go:169: (dbg) Run:  out/minikube-linux-arm64 profile list
no_kubernetes_test.go:169: (dbg) Done: out/minikube-linux-arm64 profile list: (8.354029377s)
no_kubernetes_test.go:179: (dbg) Run:  out/minikube-linux-arm64 profile list --output=json
--- PASS: TestNoKubernetes/serial/ProfileList (8.89s)

                                                
                                    
x
+
TestNoKubernetes/serial/Stop (1.3s)

                                                
                                                
=== RUN   TestNoKubernetes/serial/Stop
no_kubernetes_test.go:158: (dbg) Run:  out/minikube-linux-arm64 stop -p NoKubernetes-550292
no_kubernetes_test.go:158: (dbg) Done: out/minikube-linux-arm64 stop -p NoKubernetes-550292: (1.295145236s)
--- PASS: TestNoKubernetes/serial/Stop (1.30s)

                                                
                                    
x
+
TestNoKubernetes/serial/StartNoArgs (6.96s)

                                                
                                                
=== RUN   TestNoKubernetes/serial/StartNoArgs
no_kubernetes_test.go:191: (dbg) Run:  out/minikube-linux-arm64 start -p NoKubernetes-550292 --driver=docker  --container-runtime=crio
no_kubernetes_test.go:191: (dbg) Done: out/minikube-linux-arm64 start -p NoKubernetes-550292 --driver=docker  --container-runtime=crio: (6.956412582s)
--- PASS: TestNoKubernetes/serial/StartNoArgs (6.96s)

                                                
                                    
x
+
TestNoKubernetes/serial/VerifyK8sNotRunningSecond (0.25s)

                                                
                                                
=== RUN   TestNoKubernetes/serial/VerifyK8sNotRunningSecond
no_kubernetes_test.go:147: (dbg) Run:  out/minikube-linux-arm64 ssh -p NoKubernetes-550292 "sudo systemctl is-active --quiet service kubelet"
no_kubernetes_test.go:147: (dbg) Non-zero exit: out/minikube-linux-arm64 ssh -p NoKubernetes-550292 "sudo systemctl is-active --quiet service kubelet": exit status 1 (252.388155ms)

                                                
                                                
** stderr ** 
	ssh: Process exited with status 3

                                                
                                                
** /stderr **
--- PASS: TestNoKubernetes/serial/VerifyK8sNotRunningSecond (0.25s)

                                                
                                    
x
+
TestStoppedBinaryUpgrade/Setup (0.82s)

                                                
                                                
=== RUN   TestStoppedBinaryUpgrade/Setup
--- PASS: TestStoppedBinaryUpgrade/Setup (0.82s)

                                                
                                    
x
+
TestStoppedBinaryUpgrade/Upgrade (73.14s)

                                                
                                                
=== RUN   TestStoppedBinaryUpgrade/Upgrade
version_upgrade_test.go:183: (dbg) Run:  /tmp/minikube-v1.26.0.3315914369 start -p stopped-upgrade-924947 --memory=2200 --vm-driver=docker  --container-runtime=crio
version_upgrade_test.go:183: (dbg) Done: /tmp/minikube-v1.26.0.3315914369 start -p stopped-upgrade-924947 --memory=2200 --vm-driver=docker  --container-runtime=crio: (41.589066399s)
version_upgrade_test.go:192: (dbg) Run:  /tmp/minikube-v1.26.0.3315914369 -p stopped-upgrade-924947 stop
version_upgrade_test.go:192: (dbg) Done: /tmp/minikube-v1.26.0.3315914369 -p stopped-upgrade-924947 stop: (2.487528546s)
version_upgrade_test.go:198: (dbg) Run:  out/minikube-linux-arm64 start -p stopped-upgrade-924947 --memory=2200 --alsologtostderr -v=1 --driver=docker  --container-runtime=crio
version_upgrade_test.go:198: (dbg) Done: out/minikube-linux-arm64 start -p stopped-upgrade-924947 --memory=2200 --alsologtostderr -v=1 --driver=docker  --container-runtime=crio: (29.058660074s)
--- PASS: TestStoppedBinaryUpgrade/Upgrade (73.14s)

                                                
                                    
x
+
TestStoppedBinaryUpgrade/MinikubeLogs (1.04s)

                                                
                                                
=== RUN   TestStoppedBinaryUpgrade/MinikubeLogs
version_upgrade_test.go:206: (dbg) Run:  out/minikube-linux-arm64 logs -p stopped-upgrade-924947
version_upgrade_test.go:206: (dbg) Done: out/minikube-linux-arm64 logs -p stopped-upgrade-924947: (1.042000356s)
--- PASS: TestStoppedBinaryUpgrade/MinikubeLogs (1.04s)

                                                
                                    
x
+
TestPause/serial/Start (79.22s)

                                                
                                                
=== RUN   TestPause/serial/Start
pause_test.go:80: (dbg) Run:  out/minikube-linux-arm64 start -p pause-433442 --memory=2048 --install-addons=false --wait=all --driver=docker  --container-runtime=crio
E0924 01:32:22.992284 1873600 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /home/jenkins/minikube-integration/19696-1868219/.minikube/profiles/addons-371349/client.crt: no such file or directory" logger="UnhandledError"
E0924 01:33:04.751093 1873600 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /home/jenkins/minikube-integration/19696-1868219/.minikube/profiles/functional-838183/client.crt: no such file or directory" logger="UnhandledError"
pause_test.go:80: (dbg) Done: out/minikube-linux-arm64 start -p pause-433442 --memory=2048 --install-addons=false --wait=all --driver=docker  --container-runtime=crio: (1m19.219555803s)
--- PASS: TestPause/serial/Start (79.22s)

                                                
                                    
x
+
TestPause/serial/SecondStartNoReconfiguration (27.25s)

                                                
                                                
=== RUN   TestPause/serial/SecondStartNoReconfiguration
pause_test.go:92: (dbg) Run:  out/minikube-linux-arm64 start -p pause-433442 --alsologtostderr -v=1 --driver=docker  --container-runtime=crio
pause_test.go:92: (dbg) Done: out/minikube-linux-arm64 start -p pause-433442 --alsologtostderr -v=1 --driver=docker  --container-runtime=crio: (27.235170951s)
--- PASS: TestPause/serial/SecondStartNoReconfiguration (27.25s)

                                                
                                    
x
+
TestPause/serial/Pause (0.81s)

                                                
                                                
=== RUN   TestPause/serial/Pause
pause_test.go:110: (dbg) Run:  out/minikube-linux-arm64 pause -p pause-433442 --alsologtostderr -v=5
--- PASS: TestPause/serial/Pause (0.81s)

                                                
                                    
x
+
TestPause/serial/VerifyStatus (0.39s)

                                                
                                                
=== RUN   TestPause/serial/VerifyStatus
status_test.go:76: (dbg) Run:  out/minikube-linux-arm64 status -p pause-433442 --output=json --layout=cluster
status_test.go:76: (dbg) Non-zero exit: out/minikube-linux-arm64 status -p pause-433442 --output=json --layout=cluster: exit status 2 (386.013257ms)

                                                
                                                
-- stdout --
	{"Name":"pause-433442","StatusCode":418,"StatusName":"Paused","Step":"Done","StepDetail":"* Paused 7 containers in: kube-system, kubernetes-dashboard, storage-gluster, istio-operator","BinaryVersion":"v1.34.0","Components":{"kubeconfig":{"Name":"kubeconfig","StatusCode":200,"StatusName":"OK"}},"Nodes":[{"Name":"pause-433442","StatusCode":200,"StatusName":"OK","Components":{"apiserver":{"Name":"apiserver","StatusCode":418,"StatusName":"Paused"},"kubelet":{"Name":"kubelet","StatusCode":405,"StatusName":"Stopped"}}}]}

                                                
                                                
-- /stdout --
--- PASS: TestPause/serial/VerifyStatus (0.39s)

                                                
                                    
x
+
TestPause/serial/Unpause (0.75s)

                                                
                                                
=== RUN   TestPause/serial/Unpause
pause_test.go:121: (dbg) Run:  out/minikube-linux-arm64 unpause -p pause-433442 --alsologtostderr -v=5
--- PASS: TestPause/serial/Unpause (0.75s)

                                                
                                    
x
+
TestPause/serial/PauseAgain (0.86s)

                                                
                                                
=== RUN   TestPause/serial/PauseAgain
pause_test.go:110: (dbg) Run:  out/minikube-linux-arm64 pause -p pause-433442 --alsologtostderr -v=5
--- PASS: TestPause/serial/PauseAgain (0.86s)

                                                
                                    
x
+
TestPause/serial/DeletePaused (2.65s)

                                                
                                                
=== RUN   TestPause/serial/DeletePaused
pause_test.go:132: (dbg) Run:  out/minikube-linux-arm64 delete -p pause-433442 --alsologtostderr -v=5
pause_test.go:132: (dbg) Done: out/minikube-linux-arm64 delete -p pause-433442 --alsologtostderr -v=5: (2.645363359s)
--- PASS: TestPause/serial/DeletePaused (2.65s)

                                                
                                    
x
+
TestPause/serial/VerifyDeletedResources (0.35s)

                                                
                                                
=== RUN   TestPause/serial/VerifyDeletedResources
pause_test.go:142: (dbg) Run:  out/minikube-linux-arm64 profile list --output json
pause_test.go:168: (dbg) Run:  docker ps -a
pause_test.go:173: (dbg) Run:  docker volume inspect pause-433442
pause_test.go:173: (dbg) Non-zero exit: docker volume inspect pause-433442: exit status 1 (16.582872ms)

                                                
                                                
-- stdout --
	[]

                                                
                                                
-- /stdout --
** stderr ** 
	Error response from daemon: get pause-433442: no such volume

                                                
                                                
** /stderr **
pause_test.go:178: (dbg) Run:  docker network ls
--- PASS: TestPause/serial/VerifyDeletedResources (0.35s)

                                                
                                    
x
+
TestNetworkPlugins/group/false (3.7s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/false
net_test.go:246: (dbg) Run:  out/minikube-linux-arm64 start -p false-150947 --memory=2048 --alsologtostderr --cni=false --driver=docker  --container-runtime=crio
net_test.go:246: (dbg) Non-zero exit: out/minikube-linux-arm64 start -p false-150947 --memory=2048 --alsologtostderr --cni=false --driver=docker  --container-runtime=crio: exit status 14 (211.067628ms)

                                                
                                                
-- stdout --
	* [false-150947] minikube v1.34.0 on Ubuntu 20.04 (arm64)
	  - MINIKUBE_LOCATION=19696
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - KUBECONFIG=/home/jenkins/minikube-integration/19696-1868219/kubeconfig
	  - MINIKUBE_HOME=/home/jenkins/minikube-integration/19696-1868219/.minikube
	  - MINIKUBE_BIN=out/minikube-linux-arm64
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the docker driver based on user configuration
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0924 01:34:47.327087 2053087 out.go:345] Setting OutFile to fd 1 ...
	I0924 01:34:47.327267 2053087 out.go:392] TERM=,COLORTERM=, which probably does not support color
	I0924 01:34:47.327281 2053087 out.go:358] Setting ErrFile to fd 2...
	I0924 01:34:47.327287 2053087 out.go:392] TERM=,COLORTERM=, which probably does not support color
	I0924 01:34:47.327594 2053087 root.go:338] Updating PATH: /home/jenkins/minikube-integration/19696-1868219/.minikube/bin
	I0924 01:34:47.328037 2053087 out.go:352] Setting JSON to false
	I0924 01:34:47.329054 2053087 start.go:129] hostinfo: {"hostname":"ip-172-31-21-244","uptime":33437,"bootTime":1727108250,"procs":186,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1070-aws","kernelArch":"aarch64","virtualizationSystem":"","virtualizationRole":"","hostId":"da8ac1fd-6236-412a-a346-95873c98230d"}
	I0924 01:34:47.329122 2053087 start.go:139] virtualization:  
	I0924 01:34:47.332558 2053087 out.go:177] * [false-150947] minikube v1.34.0 on Ubuntu 20.04 (arm64)
	I0924 01:34:47.335136 2053087 out.go:177]   - MINIKUBE_LOCATION=19696
	I0924 01:34:47.335274 2053087 notify.go:220] Checking for updates...
	I0924 01:34:47.340369 2053087 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I0924 01:34:47.343036 2053087 out.go:177]   - KUBECONFIG=/home/jenkins/minikube-integration/19696-1868219/kubeconfig
	I0924 01:34:47.345826 2053087 out.go:177]   - MINIKUBE_HOME=/home/jenkins/minikube-integration/19696-1868219/.minikube
	I0924 01:34:47.348531 2053087 out.go:177]   - MINIKUBE_BIN=out/minikube-linux-arm64
	I0924 01:34:47.351209 2053087 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=
	I0924 01:34:47.354281 2053087 config.go:182] Loaded profile config "kubernetes-upgrade-156319": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.31.1
	I0924 01:34:47.354451 2053087 driver.go:394] Setting default libvirt URI to qemu:///system
	I0924 01:34:47.377198 2053087 docker.go:123] docker version: linux-27.3.1:Docker Engine - Community
	I0924 01:34:47.377303 2053087 cli_runner.go:164] Run: docker system info --format "{{json .}}"
	I0924 01:34:47.468854 2053087 info.go:266] docker info: {ID:5FDH:SA5P:5GCT:NLAS:B73P:SGDQ:PBG5:UBVH:UZY3:RXGO:CI7S:WAIH Containers:1 ContainersRunning:1 ContainersPaused:0 ContainersStopped:0 Images:4 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:false BridgeNfIP6Tables:false Debug:false NFd:33 OomKillDisable:true NGoroutines:52 SystemTime:2024-09-24 01:34:47.456477163 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1070-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Architecture:a
arch64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8214831104 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-21-244 Labels:[] ExperimentalBuild:false ServerVersion:27.3.1 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:7f7fdf5fed64eb6a7caf99b3e12efcf9d60e311c Expected:7f7fdf5fed64eb6a7caf99b3e12efcf9d60e311c} RuncCommit:{ID:v1.1.14-0-g2c9f560 Expected:v1.1.14-0-g2c9f560} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:[WARNING: brid
ge-nf-call-iptables is disabled WARNING: bridge-nf-call-ip6tables is disabled] ServerErrors:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.17.1] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.29.7]] Warnings:<nil>}}
	I0924 01:34:47.472004 2053087 docker.go:318] overlay module found
	I0924 01:34:47.475024 2053087 out.go:177] * Using the docker driver based on user configuration
	I0924 01:34:47.477538 2053087 start.go:297] selected driver: docker
	I0924 01:34:47.477558 2053087 start.go:901] validating driver "docker" against <nil>
	I0924 01:34:47.477572 2053087 start.go:912] status for docker: {Installed:true Healthy:true Running:false NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I0924 01:34:47.480593 2053087 out.go:201] 
	W0924 01:34:47.483162 2053087 out.go:270] X Exiting due to MK_USAGE: The "crio" container runtime requires CNI
	X Exiting due to MK_USAGE: The "crio" container runtime requires CNI
	I0924 01:34:47.485742 2053087 out.go:201] 

                                                
                                                
** /stderr **
net_test.go:88: 
----------------------- debugLogs start: false-150947 [pass: true] --------------------------------
>>> netcat: nslookup kubernetes.default:
Error in configuration: context was not found for specified context: false-150947

                                                
                                                

                                                
                                                
>>> netcat: nslookup debug kubernetes.default a-records:
Error in configuration: context was not found for specified context: false-150947

                                                
                                                

                                                
                                                
>>> netcat: dig search kubernetes.default:
Error in configuration: context was not found for specified context: false-150947

                                                
                                                

                                                
                                                
>>> netcat: dig @10.96.0.10 kubernetes.default.svc.cluster.local udp/53:
Error in configuration: context was not found for specified context: false-150947

                                                
                                                

                                                
                                                
>>> netcat: dig @10.96.0.10 kubernetes.default.svc.cluster.local tcp/53:
Error in configuration: context was not found for specified context: false-150947

                                                
                                                

                                                
                                                
>>> netcat: nc 10.96.0.10 udp/53:
Error in configuration: context was not found for specified context: false-150947

                                                
                                                

                                                
                                                
>>> netcat: nc 10.96.0.10 tcp/53:
Error in configuration: context was not found for specified context: false-150947

                                                
                                                

                                                
                                                
>>> netcat: /etc/nsswitch.conf:
Error in configuration: context was not found for specified context: false-150947

                                                
                                                

                                                
                                                
>>> netcat: /etc/hosts:
Error in configuration: context was not found for specified context: false-150947

                                                
                                                

                                                
                                                
>>> netcat: /etc/resolv.conf:
Error in configuration: context was not found for specified context: false-150947

                                                
                                                

                                                
                                                
>>> host: /etc/nsswitch.conf:
* Profile "false-150947" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-150947"

                                                
                                                

                                                
                                                
>>> host: /etc/hosts:
* Profile "false-150947" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-150947"

                                                
                                                

                                                
                                                
>>> host: /etc/resolv.conf:
* Profile "false-150947" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-150947"

                                                
                                                

                                                
                                                
>>> k8s: nodes, services, endpoints, daemon sets, deployments and pods, :
Error in configuration: context was not found for specified context: false-150947

                                                
                                                

                                                
                                                
>>> host: crictl pods:
* Profile "false-150947" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-150947"

                                                
                                                

                                                
                                                
>>> host: crictl containers:
* Profile "false-150947" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-150947"

                                                
                                                

                                                
                                                
>>> k8s: describe netcat deployment:
error: context "false-150947" does not exist

                                                
                                                

                                                
                                                
>>> k8s: describe netcat pod(s):
error: context "false-150947" does not exist

                                                
                                                

                                                
                                                
>>> k8s: netcat logs:
error: context "false-150947" does not exist

                                                
                                                

                                                
                                                
>>> k8s: describe coredns deployment:
error: context "false-150947" does not exist

                                                
                                                

                                                
                                                
>>> k8s: describe coredns pods:
error: context "false-150947" does not exist

                                                
                                                

                                                
                                                
>>> k8s: coredns logs:
error: context "false-150947" does not exist

                                                
                                                

                                                
                                                
>>> k8s: describe api server pod(s):
error: context "false-150947" does not exist

                                                
                                                

                                                
                                                
>>> k8s: api server logs:
error: context "false-150947" does not exist

                                                
                                                

                                                
                                                
>>> host: /etc/cni:
* Profile "false-150947" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-150947"

                                                
                                                

                                                
                                                
>>> host: ip a s:
* Profile "false-150947" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-150947"

                                                
                                                

                                                
                                                
>>> host: ip r s:
* Profile "false-150947" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-150947"

                                                
                                                

                                                
                                                
>>> host: iptables-save:
* Profile "false-150947" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-150947"

                                                
                                                

                                                
                                                
>>> host: iptables table nat:
* Profile "false-150947" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-150947"

                                                
                                                

                                                
                                                
>>> k8s: describe kube-proxy daemon set:
error: context "false-150947" does not exist

                                                
                                                

                                                
                                                
>>> k8s: describe kube-proxy pod(s):
error: context "false-150947" does not exist

                                                
                                                

                                                
                                                
>>> k8s: kube-proxy logs:
error: context "false-150947" does not exist

                                                
                                                

                                                
                                                
>>> host: kubelet daemon status:
* Profile "false-150947" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-150947"

                                                
                                                

                                                
                                                
>>> host: kubelet daemon config:
* Profile "false-150947" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-150947"

                                                
                                                

                                                
                                                
>>> k8s: kubelet logs:
* Profile "false-150947" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-150947"

                                                
                                                

                                                
                                                
>>> host: /etc/kubernetes/kubelet.conf:
* Profile "false-150947" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-150947"

                                                
                                                

                                                
                                                
>>> host: /var/lib/kubelet/config.yaml:
* Profile "false-150947" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-150947"

                                                
                                                

                                                
                                                
>>> k8s: kubectl config:
apiVersion: v1
clusters:
- cluster:
certificate-authority: /home/jenkins/minikube-integration/19696-1868219/.minikube/ca.crt
extensions:
- extension:
last-update: Tue, 24 Sep 2024 01:34:46 UTC
provider: minikube.sigs.k8s.io
version: v1.34.0
name: cluster_info
server: https://192.168.76.2:8443
name: kubernetes-upgrade-156319
contexts:
- context:
cluster: kubernetes-upgrade-156319
extensions:
- extension:
last-update: Tue, 24 Sep 2024 01:34:46 UTC
provider: minikube.sigs.k8s.io
version: v1.34.0
name: context_info
namespace: default
user: kubernetes-upgrade-156319
name: kubernetes-upgrade-156319
current-context: kubernetes-upgrade-156319
kind: Config
preferences: {}
users:
- name: kubernetes-upgrade-156319
user:
client-certificate: /home/jenkins/minikube-integration/19696-1868219/.minikube/profiles/kubernetes-upgrade-156319/client.crt
client-key: /home/jenkins/minikube-integration/19696-1868219/.minikube/profiles/kubernetes-upgrade-156319/client.key

                                                
                                                

                                                
                                                
>>> k8s: cms:
Error in configuration: context was not found for specified context: false-150947

                                                
                                                

                                                
                                                
>>> host: docker daemon status:
* Profile "false-150947" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-150947"

                                                
                                                

                                                
                                                
>>> host: docker daemon config:
* Profile "false-150947" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-150947"

                                                
                                                

                                                
                                                
>>> host: /etc/docker/daemon.json:
* Profile "false-150947" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-150947"

                                                
                                                

                                                
                                                
>>> host: docker system info:
* Profile "false-150947" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-150947"

                                                
                                                

                                                
                                                
>>> host: cri-docker daemon status:
* Profile "false-150947" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-150947"

                                                
                                                

                                                
                                                
>>> host: cri-docker daemon config:
* Profile "false-150947" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-150947"

                                                
                                                

                                                
                                                
>>> host: /etc/systemd/system/cri-docker.service.d/10-cni.conf:
* Profile "false-150947" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-150947"

                                                
                                                

                                                
                                                
>>> host: /usr/lib/systemd/system/cri-docker.service:
* Profile "false-150947" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-150947"

                                                
                                                

                                                
                                                
>>> host: cri-dockerd version:
* Profile "false-150947" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-150947"

                                                
                                                

                                                
                                                
>>> host: containerd daemon status:
* Profile "false-150947" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-150947"

                                                
                                                

                                                
                                                
>>> host: containerd daemon config:
* Profile "false-150947" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-150947"

                                                
                                                

                                                
                                                
>>> host: /lib/systemd/system/containerd.service:
* Profile "false-150947" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-150947"

                                                
                                                

                                                
                                                
>>> host: /etc/containerd/config.toml:
* Profile "false-150947" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-150947"

                                                
                                                

                                                
                                                
>>> host: containerd config dump:
* Profile "false-150947" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-150947"

                                                
                                                

                                                
                                                
>>> host: crio daemon status:
* Profile "false-150947" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-150947"

                                                
                                                

                                                
                                                
>>> host: crio daemon config:
* Profile "false-150947" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-150947"

                                                
                                                

                                                
                                                
>>> host: /etc/crio:
* Profile "false-150947" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-150947"

                                                
                                                

                                                
                                                
>>> host: crio config:
* Profile "false-150947" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-150947"

                                                
                                                
----------------------- debugLogs end: false-150947 [took: 3.333271168s] --------------------------------
helpers_test.go:175: Cleaning up "false-150947" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-arm64 delete -p false-150947
--- PASS: TestNetworkPlugins/group/false (3.70s)

                                                
                                    
x
+
TestStartStop/group/old-k8s-version/serial/FirstStart (128.54s)

                                                
                                                
=== RUN   TestStartStop/group/old-k8s-version/serial/FirstStart
start_stop_delete_test.go:186: (dbg) Run:  out/minikube-linux-arm64 start -p old-k8s-version-215342 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=docker  --container-runtime=crio --kubernetes-version=v1.20.0
E0924 01:36:07.824713 1873600 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /home/jenkins/minikube-integration/19696-1868219/.minikube/profiles/functional-838183/client.crt: no such file or directory" logger="UnhandledError"
E0924 01:38:04.750838 1873600 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /home/jenkins/minikube-integration/19696-1868219/.minikube/profiles/functional-838183/client.crt: no such file or directory" logger="UnhandledError"
start_stop_delete_test.go:186: (dbg) Done: out/minikube-linux-arm64 start -p old-k8s-version-215342 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=docker  --container-runtime=crio --kubernetes-version=v1.20.0: (2m8.540872367s)
--- PASS: TestStartStop/group/old-k8s-version/serial/FirstStart (128.54s)

                                                
                                    
x
+
TestStartStop/group/old-k8s-version/serial/DeployApp (11.57s)

                                                
                                                
=== RUN   TestStartStop/group/old-k8s-version/serial/DeployApp
start_stop_delete_test.go:196: (dbg) Run:  kubectl --context old-k8s-version-215342 create -f testdata/busybox.yaml
start_stop_delete_test.go:196: (dbg) TestStartStop/group/old-k8s-version/serial/DeployApp: waiting 8m0s for pods matching "integration-test=busybox" in namespace "default" ...
helpers_test.go:344: "busybox" [7535f3dd-7d50-4a40-b685-5e3e2c5098d9] Pending / Ready:ContainersNotReady (containers with unready status: [busybox]) / ContainersReady:ContainersNotReady (containers with unready status: [busybox])
helpers_test.go:344: "busybox" [7535f3dd-7d50-4a40-b685-5e3e2c5098d9] Running
start_stop_delete_test.go:196: (dbg) TestStartStop/group/old-k8s-version/serial/DeployApp: integration-test=busybox healthy within 11.00385068s
start_stop_delete_test.go:196: (dbg) Run:  kubectl --context old-k8s-version-215342 exec busybox -- /bin/sh -c "ulimit -n"
--- PASS: TestStartStop/group/old-k8s-version/serial/DeployApp (11.57s)

                                                
                                    
x
+
TestStartStop/group/old-k8s-version/serial/EnableAddonWhileActive (1s)

                                                
                                                
=== RUN   TestStartStop/group/old-k8s-version/serial/EnableAddonWhileActive
start_stop_delete_test.go:205: (dbg) Run:  out/minikube-linux-arm64 addons enable metrics-server -p old-k8s-version-215342 --images=MetricsServer=registry.k8s.io/echoserver:1.4 --registries=MetricsServer=fake.domain
start_stop_delete_test.go:215: (dbg) Run:  kubectl --context old-k8s-version-215342 describe deploy/metrics-server -n kube-system
--- PASS: TestStartStop/group/old-k8s-version/serial/EnableAddonWhileActive (1.00s)

                                                
                                    
x
+
TestStartStop/group/old-k8s-version/serial/Stop (12s)

                                                
                                                
=== RUN   TestStartStop/group/old-k8s-version/serial/Stop
start_stop_delete_test.go:228: (dbg) Run:  out/minikube-linux-arm64 stop -p old-k8s-version-215342 --alsologtostderr -v=3
start_stop_delete_test.go:228: (dbg) Done: out/minikube-linux-arm64 stop -p old-k8s-version-215342 --alsologtostderr -v=3: (11.996729105s)
--- PASS: TestStartStop/group/old-k8s-version/serial/Stop (12.00s)

                                                
                                    
x
+
TestStartStop/group/old-k8s-version/serial/EnableAddonAfterStop (0.2s)

                                                
                                                
=== RUN   TestStartStop/group/old-k8s-version/serial/EnableAddonAfterStop
start_stop_delete_test.go:239: (dbg) Run:  out/minikube-linux-arm64 status --format={{.Host}} -p old-k8s-version-215342 -n old-k8s-version-215342
start_stop_delete_test.go:239: (dbg) Non-zero exit: out/minikube-linux-arm64 status --format={{.Host}} -p old-k8s-version-215342 -n old-k8s-version-215342: exit status 7 (72.533616ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
start_stop_delete_test.go:239: status error: exit status 7 (may be ok)
start_stop_delete_test.go:246: (dbg) Run:  out/minikube-linux-arm64 addons enable dashboard -p old-k8s-version-215342 --images=MetricsScraper=registry.k8s.io/echoserver:1.4
--- PASS: TestStartStop/group/old-k8s-version/serial/EnableAddonAfterStop (0.20s)

                                                
                                    
x
+
TestStartStop/group/old-k8s-version/serial/SecondStart (133.83s)

                                                
                                                
=== RUN   TestStartStop/group/old-k8s-version/serial/SecondStart
start_stop_delete_test.go:256: (dbg) Run:  out/minikube-linux-arm64 start -p old-k8s-version-215342 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=docker  --container-runtime=crio --kubernetes-version=v1.20.0
start_stop_delete_test.go:256: (dbg) Done: out/minikube-linux-arm64 start -p old-k8s-version-215342 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=docker  --container-runtime=crio --kubernetes-version=v1.20.0: (2m13.390134669s)
start_stop_delete_test.go:262: (dbg) Run:  out/minikube-linux-arm64 status --format={{.Host}} -p old-k8s-version-215342 -n old-k8s-version-215342
--- PASS: TestStartStop/group/old-k8s-version/serial/SecondStart (133.83s)

                                                
                                    
x
+
TestStartStop/group/no-preload/serial/FirstStart (66.05s)

                                                
                                                
=== RUN   TestStartStop/group/no-preload/serial/FirstStart
start_stop_delete_test.go:186: (dbg) Run:  out/minikube-linux-arm64 start -p no-preload-397870 --memory=2200 --alsologtostderr --wait=true --preload=false --driver=docker  --container-runtime=crio --kubernetes-version=v1.31.1
start_stop_delete_test.go:186: (dbg) Done: out/minikube-linux-arm64 start -p no-preload-397870 --memory=2200 --alsologtostderr --wait=true --preload=false --driver=docker  --container-runtime=crio --kubernetes-version=v1.31.1: (1m6.044905835s)
--- PASS: TestStartStop/group/no-preload/serial/FirstStart (66.05s)

                                                
                                    
x
+
TestStartStop/group/no-preload/serial/DeployApp (10.42s)

                                                
                                                
=== RUN   TestStartStop/group/no-preload/serial/DeployApp
start_stop_delete_test.go:196: (dbg) Run:  kubectl --context no-preload-397870 create -f testdata/busybox.yaml
start_stop_delete_test.go:196: (dbg) TestStartStop/group/no-preload/serial/DeployApp: waiting 8m0s for pods matching "integration-test=busybox" in namespace "default" ...
helpers_test.go:344: "busybox" [a95ac23a-ffd0-4fad-b230-c98f232325bb] Pending / Ready:ContainersNotReady (containers with unready status: [busybox]) / ContainersReady:ContainersNotReady (containers with unready status: [busybox])
helpers_test.go:344: "busybox" [a95ac23a-ffd0-4fad-b230-c98f232325bb] Running
start_stop_delete_test.go:196: (dbg) TestStartStop/group/no-preload/serial/DeployApp: integration-test=busybox healthy within 10.007380591s
start_stop_delete_test.go:196: (dbg) Run:  kubectl --context no-preload-397870 exec busybox -- /bin/sh -c "ulimit -n"
--- PASS: TestStartStop/group/no-preload/serial/DeployApp (10.42s)

                                                
                                    
x
+
TestStartStop/group/no-preload/serial/EnableAddonWhileActive (1.09s)

                                                
                                                
=== RUN   TestStartStop/group/no-preload/serial/EnableAddonWhileActive
start_stop_delete_test.go:205: (dbg) Run:  out/minikube-linux-arm64 addons enable metrics-server -p no-preload-397870 --images=MetricsServer=registry.k8s.io/echoserver:1.4 --registries=MetricsServer=fake.domain
start_stop_delete_test.go:215: (dbg) Run:  kubectl --context no-preload-397870 describe deploy/metrics-server -n kube-system
--- PASS: TestStartStop/group/no-preload/serial/EnableAddonWhileActive (1.09s)

                                                
                                    
x
+
TestStartStop/group/old-k8s-version/serial/UserAppExistsAfterStop (6.01s)

                                                
                                                
=== RUN   TestStartStop/group/old-k8s-version/serial/UserAppExistsAfterStop
start_stop_delete_test.go:274: (dbg) TestStartStop/group/old-k8s-version/serial/UserAppExistsAfterStop: waiting 9m0s for pods matching "k8s-app=kubernetes-dashboard" in namespace "kubernetes-dashboard" ...
helpers_test.go:344: "kubernetes-dashboard-cd95d586-7nq58" [62fc5e98-2af5-4ce7-8309-b35f2ada6133] Running
start_stop_delete_test.go:274: (dbg) TestStartStop/group/old-k8s-version/serial/UserAppExistsAfterStop: k8s-app=kubernetes-dashboard healthy within 6.004567687s
--- PASS: TestStartStop/group/old-k8s-version/serial/UserAppExistsAfterStop (6.01s)

                                                
                                    
x
+
TestStartStop/group/no-preload/serial/Stop (11.95s)

                                                
                                                
=== RUN   TestStartStop/group/no-preload/serial/Stop
start_stop_delete_test.go:228: (dbg) Run:  out/minikube-linux-arm64 stop -p no-preload-397870 --alsologtostderr -v=3
start_stop_delete_test.go:228: (dbg) Done: out/minikube-linux-arm64 stop -p no-preload-397870 --alsologtostderr -v=3: (11.95439072s)
--- PASS: TestStartStop/group/no-preload/serial/Stop (11.95s)

                                                
                                    
x
+
TestStartStop/group/old-k8s-version/serial/AddonExistsAfterStop (5.1s)

                                                
                                                
=== RUN   TestStartStop/group/old-k8s-version/serial/AddonExistsAfterStop
start_stop_delete_test.go:287: (dbg) TestStartStop/group/old-k8s-version/serial/AddonExistsAfterStop: waiting 9m0s for pods matching "k8s-app=kubernetes-dashboard" in namespace "kubernetes-dashboard" ...
helpers_test.go:344: "kubernetes-dashboard-cd95d586-7nq58" [62fc5e98-2af5-4ce7-8309-b35f2ada6133] Running
start_stop_delete_test.go:287: (dbg) TestStartStop/group/old-k8s-version/serial/AddonExistsAfterStop: k8s-app=kubernetes-dashboard healthy within 5.00436895s
start_stop_delete_test.go:291: (dbg) Run:  kubectl --context old-k8s-version-215342 describe deploy/dashboard-metrics-scraper -n kubernetes-dashboard
--- PASS: TestStartStop/group/old-k8s-version/serial/AddonExistsAfterStop (5.10s)

                                                
                                    
x
+
TestStartStop/group/old-k8s-version/serial/VerifyKubernetesImages (0.23s)

                                                
                                                
=== RUN   TestStartStop/group/old-k8s-version/serial/VerifyKubernetesImages
start_stop_delete_test.go:304: (dbg) Run:  out/minikube-linux-arm64 -p old-k8s-version-215342 image list --format=json
start_stop_delete_test.go:304: Found non-minikube image: kindest/kindnetd:v20240202-8f1494ea
start_stop_delete_test.go:304: Found non-minikube image: kindest/kindnetd:v20240813-c6f155d6
start_stop_delete_test.go:304: Found non-minikube image: gcr.io/k8s-minikube/busybox:1.28.4-glibc
--- PASS: TestStartStop/group/old-k8s-version/serial/VerifyKubernetesImages (0.23s)

                                                
                                    
x
+
TestStartStop/group/old-k8s-version/serial/Pause (3.3s)

                                                
                                                
=== RUN   TestStartStop/group/old-k8s-version/serial/Pause
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 pause -p old-k8s-version-215342 --alsologtostderr -v=1
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 status --format={{.APIServer}} -p old-k8s-version-215342 -n old-k8s-version-215342
start_stop_delete_test.go:311: (dbg) Non-zero exit: out/minikube-linux-arm64 status --format={{.APIServer}} -p old-k8s-version-215342 -n old-k8s-version-215342: exit status 2 (299.258957ms)

                                                
                                                
-- stdout --
	Paused

                                                
                                                
-- /stdout --
start_stop_delete_test.go:311: status error: exit status 2 (may be ok)
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 status --format={{.Kubelet}} -p old-k8s-version-215342 -n old-k8s-version-215342
start_stop_delete_test.go:311: (dbg) Non-zero exit: out/minikube-linux-arm64 status --format={{.Kubelet}} -p old-k8s-version-215342 -n old-k8s-version-215342: exit status 2 (413.050409ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
start_stop_delete_test.go:311: status error: exit status 2 (may be ok)
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 unpause -p old-k8s-version-215342 --alsologtostderr -v=1
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 status --format={{.APIServer}} -p old-k8s-version-215342 -n old-k8s-version-215342
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 status --format={{.Kubelet}} -p old-k8s-version-215342 -n old-k8s-version-215342
--- PASS: TestStartStop/group/old-k8s-version/serial/Pause (3.30s)

                                                
                                    
x
+
TestStartStop/group/no-preload/serial/EnableAddonAfterStop (0.25s)

                                                
                                                
=== RUN   TestStartStop/group/no-preload/serial/EnableAddonAfterStop
start_stop_delete_test.go:239: (dbg) Run:  out/minikube-linux-arm64 status --format={{.Host}} -p no-preload-397870 -n no-preload-397870
start_stop_delete_test.go:239: (dbg) Non-zero exit: out/minikube-linux-arm64 status --format={{.Host}} -p no-preload-397870 -n no-preload-397870: exit status 7 (100.805388ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
start_stop_delete_test.go:239: status error: exit status 7 (may be ok)
start_stop_delete_test.go:246: (dbg) Run:  out/minikube-linux-arm64 addons enable dashboard -p no-preload-397870 --images=MetricsScraper=registry.k8s.io/echoserver:1.4
--- PASS: TestStartStop/group/no-preload/serial/EnableAddonAfterStop (0.25s)

                                                
                                    
x
+
TestStartStop/group/no-preload/serial/SecondStart (304.73s)

                                                
                                                
=== RUN   TestStartStop/group/no-preload/serial/SecondStart
start_stop_delete_test.go:256: (dbg) Run:  out/minikube-linux-arm64 start -p no-preload-397870 --memory=2200 --alsologtostderr --wait=true --preload=false --driver=docker  --container-runtime=crio --kubernetes-version=v1.31.1
start_stop_delete_test.go:256: (dbg) Done: out/minikube-linux-arm64 start -p no-preload-397870 --memory=2200 --alsologtostderr --wait=true --preload=false --driver=docker  --container-runtime=crio --kubernetes-version=v1.31.1: (5m4.397740091s)
start_stop_delete_test.go:262: (dbg) Run:  out/minikube-linux-arm64 status --format={{.Host}} -p no-preload-397870 -n no-preload-397870
--- PASS: TestStartStop/group/no-preload/serial/SecondStart (304.73s)

                                                
                                    
x
+
TestStartStop/group/embed-certs/serial/FirstStart (56.82s)

                                                
                                                
=== RUN   TestStartStop/group/embed-certs/serial/FirstStart
start_stop_delete_test.go:186: (dbg) Run:  out/minikube-linux-arm64 start -p embed-certs-414597 --memory=2200 --alsologtostderr --wait=true --embed-certs --driver=docker  --container-runtime=crio --kubernetes-version=v1.31.1
start_stop_delete_test.go:186: (dbg) Done: out/minikube-linux-arm64 start -p embed-certs-414597 --memory=2200 --alsologtostderr --wait=true --embed-certs --driver=docker  --container-runtime=crio --kubernetes-version=v1.31.1: (56.819487846s)
--- PASS: TestStartStop/group/embed-certs/serial/FirstStart (56.82s)

                                                
                                    
x
+
TestStartStop/group/embed-certs/serial/DeployApp (10.32s)

                                                
                                                
=== RUN   TestStartStop/group/embed-certs/serial/DeployApp
start_stop_delete_test.go:196: (dbg) Run:  kubectl --context embed-certs-414597 create -f testdata/busybox.yaml
start_stop_delete_test.go:196: (dbg) TestStartStop/group/embed-certs/serial/DeployApp: waiting 8m0s for pods matching "integration-test=busybox" in namespace "default" ...
helpers_test.go:344: "busybox" [46b4aeba-10be-4e8c-ace2-24c14ad4bebc] Pending / Ready:ContainersNotReady (containers with unready status: [busybox]) / ContainersReady:ContainersNotReady (containers with unready status: [busybox])
helpers_test.go:344: "busybox" [46b4aeba-10be-4e8c-ace2-24c14ad4bebc] Running
start_stop_delete_test.go:196: (dbg) TestStartStop/group/embed-certs/serial/DeployApp: integration-test=busybox healthy within 10.004205843s
start_stop_delete_test.go:196: (dbg) Run:  kubectl --context embed-certs-414597 exec busybox -- /bin/sh -c "ulimit -n"
--- PASS: TestStartStop/group/embed-certs/serial/DeployApp (10.32s)

                                                
                                    
x
+
TestStartStop/group/embed-certs/serial/EnableAddonWhileActive (1.08s)

                                                
                                                
=== RUN   TestStartStop/group/embed-certs/serial/EnableAddonWhileActive
start_stop_delete_test.go:205: (dbg) Run:  out/minikube-linux-arm64 addons enable metrics-server -p embed-certs-414597 --images=MetricsServer=registry.k8s.io/echoserver:1.4 --registries=MetricsServer=fake.domain
start_stop_delete_test.go:215: (dbg) Run:  kubectl --context embed-certs-414597 describe deploy/metrics-server -n kube-system
--- PASS: TestStartStop/group/embed-certs/serial/EnableAddonWhileActive (1.08s)

                                                
                                    
x
+
TestStartStop/group/embed-certs/serial/Stop (11.99s)

                                                
                                                
=== RUN   TestStartStop/group/embed-certs/serial/Stop
start_stop_delete_test.go:228: (dbg) Run:  out/minikube-linux-arm64 stop -p embed-certs-414597 --alsologtostderr -v=3
start_stop_delete_test.go:228: (dbg) Done: out/minikube-linux-arm64 stop -p embed-certs-414597 --alsologtostderr -v=3: (11.98668227s)
--- PASS: TestStartStop/group/embed-certs/serial/Stop (11.99s)

                                                
                                    
x
+
TestStartStop/group/embed-certs/serial/EnableAddonAfterStop (0.21s)

                                                
                                                
=== RUN   TestStartStop/group/embed-certs/serial/EnableAddonAfterStop
start_stop_delete_test.go:239: (dbg) Run:  out/minikube-linux-arm64 status --format={{.Host}} -p embed-certs-414597 -n embed-certs-414597
start_stop_delete_test.go:239: (dbg) Non-zero exit: out/minikube-linux-arm64 status --format={{.Host}} -p embed-certs-414597 -n embed-certs-414597: exit status 7 (73.585814ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
start_stop_delete_test.go:239: status error: exit status 7 (may be ok)
start_stop_delete_test.go:246: (dbg) Run:  out/minikube-linux-arm64 addons enable dashboard -p embed-certs-414597 --images=MetricsScraper=registry.k8s.io/echoserver:1.4
--- PASS: TestStartStop/group/embed-certs/serial/EnableAddonAfterStop (0.21s)

                                                
                                    
x
+
TestStartStop/group/embed-certs/serial/SecondStart (267.99s)

                                                
                                                
=== RUN   TestStartStop/group/embed-certs/serial/SecondStart
start_stop_delete_test.go:256: (dbg) Run:  out/minikube-linux-arm64 start -p embed-certs-414597 --memory=2200 --alsologtostderr --wait=true --embed-certs --driver=docker  --container-runtime=crio --kubernetes-version=v1.31.1
E0924 01:43:04.751323 1873600 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /home/jenkins/minikube-integration/19696-1868219/.minikube/profiles/functional-838183/client.crt: no such file or directory" logger="UnhandledError"
E0924 01:43:15.937903 1873600 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /home/jenkins/minikube-integration/19696-1868219/.minikube/profiles/old-k8s-version-215342/client.crt: no such file or directory" logger="UnhandledError"
E0924 01:43:15.944375 1873600 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /home/jenkins/minikube-integration/19696-1868219/.minikube/profiles/old-k8s-version-215342/client.crt: no such file or directory" logger="UnhandledError"
E0924 01:43:15.955832 1873600 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /home/jenkins/minikube-integration/19696-1868219/.minikube/profiles/old-k8s-version-215342/client.crt: no such file or directory" logger="UnhandledError"
E0924 01:43:15.977294 1873600 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /home/jenkins/minikube-integration/19696-1868219/.minikube/profiles/old-k8s-version-215342/client.crt: no such file or directory" logger="UnhandledError"
E0924 01:43:16.018730 1873600 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /home/jenkins/minikube-integration/19696-1868219/.minikube/profiles/old-k8s-version-215342/client.crt: no such file or directory" logger="UnhandledError"
E0924 01:43:16.100061 1873600 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /home/jenkins/minikube-integration/19696-1868219/.minikube/profiles/old-k8s-version-215342/client.crt: no such file or directory" logger="UnhandledError"
E0924 01:43:16.261933 1873600 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /home/jenkins/minikube-integration/19696-1868219/.minikube/profiles/old-k8s-version-215342/client.crt: no such file or directory" logger="UnhandledError"
E0924 01:43:16.583554 1873600 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /home/jenkins/minikube-integration/19696-1868219/.minikube/profiles/old-k8s-version-215342/client.crt: no such file or directory" logger="UnhandledError"
E0924 01:43:17.224850 1873600 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /home/jenkins/minikube-integration/19696-1868219/.minikube/profiles/old-k8s-version-215342/client.crt: no such file or directory" logger="UnhandledError"
E0924 01:43:18.507065 1873600 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /home/jenkins/minikube-integration/19696-1868219/.minikube/profiles/old-k8s-version-215342/client.crt: no such file or directory" logger="UnhandledError"
E0924 01:43:21.068736 1873600 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /home/jenkins/minikube-integration/19696-1868219/.minikube/profiles/old-k8s-version-215342/client.crt: no such file or directory" logger="UnhandledError"
E0924 01:43:26.190611 1873600 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /home/jenkins/minikube-integration/19696-1868219/.minikube/profiles/old-k8s-version-215342/client.crt: no such file or directory" logger="UnhandledError"
E0924 01:43:36.431964 1873600 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /home/jenkins/minikube-integration/19696-1868219/.minikube/profiles/old-k8s-version-215342/client.crt: no such file or directory" logger="UnhandledError"
E0924 01:43:56.913329 1873600 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /home/jenkins/minikube-integration/19696-1868219/.minikube/profiles/old-k8s-version-215342/client.crt: no such file or directory" logger="UnhandledError"
E0924 01:44:19.924904 1873600 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /home/jenkins/minikube-integration/19696-1868219/.minikube/profiles/addons-371349/client.crt: no such file or directory" logger="UnhandledError"
E0924 01:44:37.874653 1873600 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /home/jenkins/minikube-integration/19696-1868219/.minikube/profiles/old-k8s-version-215342/client.crt: no such file or directory" logger="UnhandledError"
E0924 01:45:59.796869 1873600 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /home/jenkins/minikube-integration/19696-1868219/.minikube/profiles/old-k8s-version-215342/client.crt: no such file or directory" logger="UnhandledError"
start_stop_delete_test.go:256: (dbg) Done: out/minikube-linux-arm64 start -p embed-certs-414597 --memory=2200 --alsologtostderr --wait=true --embed-certs --driver=docker  --container-runtime=crio --kubernetes-version=v1.31.1: (4m27.493487411s)
start_stop_delete_test.go:262: (dbg) Run:  out/minikube-linux-arm64 status --format={{.Host}} -p embed-certs-414597 -n embed-certs-414597
--- PASS: TestStartStop/group/embed-certs/serial/SecondStart (267.99s)

                                                
                                    
x
+
TestStartStop/group/no-preload/serial/UserAppExistsAfterStop (6s)

                                                
                                                
=== RUN   TestStartStop/group/no-preload/serial/UserAppExistsAfterStop
start_stop_delete_test.go:274: (dbg) TestStartStop/group/no-preload/serial/UserAppExistsAfterStop: waiting 9m0s for pods matching "k8s-app=kubernetes-dashboard" in namespace "kubernetes-dashboard" ...
helpers_test.go:344: "kubernetes-dashboard-695b96c756-bspwq" [f9057796-45a7-48dd-9155-50e1b39241b9] Running
start_stop_delete_test.go:274: (dbg) TestStartStop/group/no-preload/serial/UserAppExistsAfterStop: k8s-app=kubernetes-dashboard healthy within 6.003189666s
--- PASS: TestStartStop/group/no-preload/serial/UserAppExistsAfterStop (6.00s)

                                                
                                    
x
+
TestStartStop/group/no-preload/serial/AddonExistsAfterStop (6.1s)

                                                
                                                
=== RUN   TestStartStop/group/no-preload/serial/AddonExistsAfterStop
start_stop_delete_test.go:287: (dbg) TestStartStop/group/no-preload/serial/AddonExistsAfterStop: waiting 9m0s for pods matching "k8s-app=kubernetes-dashboard" in namespace "kubernetes-dashboard" ...
helpers_test.go:344: "kubernetes-dashboard-695b96c756-bspwq" [f9057796-45a7-48dd-9155-50e1b39241b9] Running
start_stop_delete_test.go:287: (dbg) TestStartStop/group/no-preload/serial/AddonExistsAfterStop: k8s-app=kubernetes-dashboard healthy within 6.003457351s
start_stop_delete_test.go:291: (dbg) Run:  kubectl --context no-preload-397870 describe deploy/dashboard-metrics-scraper -n kubernetes-dashboard
--- PASS: TestStartStop/group/no-preload/serial/AddonExistsAfterStop (6.10s)

                                                
                                    
x
+
TestStartStop/group/no-preload/serial/VerifyKubernetesImages (0.24s)

                                                
                                                
=== RUN   TestStartStop/group/no-preload/serial/VerifyKubernetesImages
start_stop_delete_test.go:304: (dbg) Run:  out/minikube-linux-arm64 -p no-preload-397870 image list --format=json
start_stop_delete_test.go:304: Found non-minikube image: gcr.io/k8s-minikube/busybox:1.28.4-glibc
start_stop_delete_test.go:304: Found non-minikube image: kindest/kindnetd:v20240813-c6f155d6
--- PASS: TestStartStop/group/no-preload/serial/VerifyKubernetesImages (0.24s)

                                                
                                    
x
+
TestStartStop/group/no-preload/serial/Pause (2.9s)

                                                
                                                
=== RUN   TestStartStop/group/no-preload/serial/Pause
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 pause -p no-preload-397870 --alsologtostderr -v=1
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 status --format={{.APIServer}} -p no-preload-397870 -n no-preload-397870
start_stop_delete_test.go:311: (dbg) Non-zero exit: out/minikube-linux-arm64 status --format={{.APIServer}} -p no-preload-397870 -n no-preload-397870: exit status 2 (306.577766ms)

                                                
                                                
-- stdout --
	Paused

                                                
                                                
-- /stdout --
start_stop_delete_test.go:311: status error: exit status 2 (may be ok)
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 status --format={{.Kubelet}} -p no-preload-397870 -n no-preload-397870
start_stop_delete_test.go:311: (dbg) Non-zero exit: out/minikube-linux-arm64 status --format={{.Kubelet}} -p no-preload-397870 -n no-preload-397870: exit status 2 (301.761439ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
start_stop_delete_test.go:311: status error: exit status 2 (may be ok)
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 unpause -p no-preload-397870 --alsologtostderr -v=1
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 status --format={{.APIServer}} -p no-preload-397870 -n no-preload-397870
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 status --format={{.Kubelet}} -p no-preload-397870 -n no-preload-397870
--- PASS: TestStartStop/group/no-preload/serial/Pause (2.90s)

                                                
                                    
x
+
TestStartStop/group/default-k8s-diff-port/serial/FirstStart (83.83s)

                                                
                                                
=== RUN   TestStartStop/group/default-k8s-diff-port/serial/FirstStart
start_stop_delete_test.go:186: (dbg) Run:  out/minikube-linux-arm64 start -p default-k8s-diff-port-614769 --memory=2200 --alsologtostderr --wait=true --apiserver-port=8444 --driver=docker  --container-runtime=crio --kubernetes-version=v1.31.1
start_stop_delete_test.go:186: (dbg) Done: out/minikube-linux-arm64 start -p default-k8s-diff-port-614769 --memory=2200 --alsologtostderr --wait=true --apiserver-port=8444 --driver=docker  --container-runtime=crio --kubernetes-version=v1.31.1: (1m23.831719251s)
--- PASS: TestStartStop/group/default-k8s-diff-port/serial/FirstStart (83.83s)

                                                
                                    
x
+
TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop (6.01s)

                                                
                                                
=== RUN   TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop
start_stop_delete_test.go:274: (dbg) TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: waiting 9m0s for pods matching "k8s-app=kubernetes-dashboard" in namespace "kubernetes-dashboard" ...
helpers_test.go:344: "kubernetes-dashboard-695b96c756-hk4t6" [d610753d-e97f-4fcd-803c-d5e73f973e03] Running
start_stop_delete_test.go:274: (dbg) TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: k8s-app=kubernetes-dashboard healthy within 6.004312445s
--- PASS: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop (6.01s)

                                                
                                    
x
+
TestStartStop/group/embed-certs/serial/AddonExistsAfterStop (5.1s)

                                                
                                                
=== RUN   TestStartStop/group/embed-certs/serial/AddonExistsAfterStop
start_stop_delete_test.go:287: (dbg) TestStartStop/group/embed-certs/serial/AddonExistsAfterStop: waiting 9m0s for pods matching "k8s-app=kubernetes-dashboard" in namespace "kubernetes-dashboard" ...
helpers_test.go:344: "kubernetes-dashboard-695b96c756-hk4t6" [d610753d-e97f-4fcd-803c-d5e73f973e03] Running
start_stop_delete_test.go:287: (dbg) TestStartStop/group/embed-certs/serial/AddonExistsAfterStop: k8s-app=kubernetes-dashboard healthy within 5.004022695s
start_stop_delete_test.go:291: (dbg) Run:  kubectl --context embed-certs-414597 describe deploy/dashboard-metrics-scraper -n kubernetes-dashboard
--- PASS: TestStartStop/group/embed-certs/serial/AddonExistsAfterStop (5.10s)

                                                
                                    
x
+
TestStartStop/group/embed-certs/serial/VerifyKubernetesImages (0.23s)

                                                
                                                
=== RUN   TestStartStop/group/embed-certs/serial/VerifyKubernetesImages
start_stop_delete_test.go:304: (dbg) Run:  out/minikube-linux-arm64 -p embed-certs-414597 image list --format=json
start_stop_delete_test.go:304: Found non-minikube image: kindest/kindnetd:v20240813-c6f155d6
start_stop_delete_test.go:304: Found non-minikube image: gcr.io/k8s-minikube/busybox:1.28.4-glibc
--- PASS: TestStartStop/group/embed-certs/serial/VerifyKubernetesImages (0.23s)

                                                
                                    
x
+
TestStartStop/group/embed-certs/serial/Pause (2.91s)

                                                
                                                
=== RUN   TestStartStop/group/embed-certs/serial/Pause
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 pause -p embed-certs-414597 --alsologtostderr -v=1
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 status --format={{.APIServer}} -p embed-certs-414597 -n embed-certs-414597
start_stop_delete_test.go:311: (dbg) Non-zero exit: out/minikube-linux-arm64 status --format={{.APIServer}} -p embed-certs-414597 -n embed-certs-414597: exit status 2 (320.053301ms)

                                                
                                                
-- stdout --
	Paused

                                                
                                                
-- /stdout --
start_stop_delete_test.go:311: status error: exit status 2 (may be ok)
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 status --format={{.Kubelet}} -p embed-certs-414597 -n embed-certs-414597
start_stop_delete_test.go:311: (dbg) Non-zero exit: out/minikube-linux-arm64 status --format={{.Kubelet}} -p embed-certs-414597 -n embed-certs-414597: exit status 2 (306.014314ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
start_stop_delete_test.go:311: status error: exit status 2 (may be ok)
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 unpause -p embed-certs-414597 --alsologtostderr -v=1
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 status --format={{.APIServer}} -p embed-certs-414597 -n embed-certs-414597
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 status --format={{.Kubelet}} -p embed-certs-414597 -n embed-certs-414597
--- PASS: TestStartStop/group/embed-certs/serial/Pause (2.91s)

                                                
                                    
x
+
TestStartStop/group/newest-cni/serial/FirstStart (35.86s)

                                                
                                                
=== RUN   TestStartStop/group/newest-cni/serial/FirstStart
start_stop_delete_test.go:186: (dbg) Run:  out/minikube-linux-arm64 start -p newest-cni-425545 --memory=2200 --alsologtostderr --wait=apiserver,system_pods,default_sa --feature-gates ServerSideApply=true --network-plugin=cni --extra-config=kubeadm.pod-network-cidr=10.42.0.0/16 --driver=docker  --container-runtime=crio --kubernetes-version=v1.31.1
start_stop_delete_test.go:186: (dbg) Done: out/minikube-linux-arm64 start -p newest-cni-425545 --memory=2200 --alsologtostderr --wait=apiserver,system_pods,default_sa --feature-gates ServerSideApply=true --network-plugin=cni --extra-config=kubeadm.pod-network-cidr=10.42.0.0/16 --driver=docker  --container-runtime=crio --kubernetes-version=v1.31.1: (35.862435541s)
--- PASS: TestStartStop/group/newest-cni/serial/FirstStart (35.86s)

                                                
                                    
x
+
TestStartStop/group/newest-cni/serial/DeployApp (0s)

                                                
                                                
=== RUN   TestStartStop/group/newest-cni/serial/DeployApp
--- PASS: TestStartStop/group/newest-cni/serial/DeployApp (0.00s)

                                                
                                    
x
+
TestStartStop/group/newest-cni/serial/EnableAddonWhileActive (1.23s)

                                                
                                                
=== RUN   TestStartStop/group/newest-cni/serial/EnableAddonWhileActive
start_stop_delete_test.go:205: (dbg) Run:  out/minikube-linux-arm64 addons enable metrics-server -p newest-cni-425545 --images=MetricsServer=registry.k8s.io/echoserver:1.4 --registries=MetricsServer=fake.domain
start_stop_delete_test.go:205: (dbg) Done: out/minikube-linux-arm64 addons enable metrics-server -p newest-cni-425545 --images=MetricsServer=registry.k8s.io/echoserver:1.4 --registries=MetricsServer=fake.domain: (1.230763316s)
start_stop_delete_test.go:211: WARNING: cni mode requires additional setup before pods can schedule :(
--- PASS: TestStartStop/group/newest-cni/serial/EnableAddonWhileActive (1.23s)

                                                
                                    
x
+
TestStartStop/group/default-k8s-diff-port/serial/DeployApp (10.56s)

                                                
                                                
=== RUN   TestStartStop/group/default-k8s-diff-port/serial/DeployApp
start_stop_delete_test.go:196: (dbg) Run:  kubectl --context default-k8s-diff-port-614769 create -f testdata/busybox.yaml
start_stop_delete_test.go:196: (dbg) TestStartStop/group/default-k8s-diff-port/serial/DeployApp: waiting 8m0s for pods matching "integration-test=busybox" in namespace "default" ...
helpers_test.go:344: "busybox" [100dbb4e-adcc-441d-b5d7-c1a5eb96b7c0] Pending
helpers_test.go:344: "busybox" [100dbb4e-adcc-441d-b5d7-c1a5eb96b7c0] Pending / Ready:ContainersNotReady (containers with unready status: [busybox]) / ContainersReady:ContainersNotReady (containers with unready status: [busybox])
helpers_test.go:344: "busybox" [100dbb4e-adcc-441d-b5d7-c1a5eb96b7c0] Running
start_stop_delete_test.go:196: (dbg) TestStartStop/group/default-k8s-diff-port/serial/DeployApp: integration-test=busybox healthy within 10.004201685s
start_stop_delete_test.go:196: (dbg) Run:  kubectl --context default-k8s-diff-port-614769 exec busybox -- /bin/sh -c "ulimit -n"
--- PASS: TestStartStop/group/default-k8s-diff-port/serial/DeployApp (10.56s)

                                                
                                    
x
+
TestStartStop/group/newest-cni/serial/Stop (1.32s)

                                                
                                                
=== RUN   TestStartStop/group/newest-cni/serial/Stop
start_stop_delete_test.go:228: (dbg) Run:  out/minikube-linux-arm64 stop -p newest-cni-425545 --alsologtostderr -v=3
start_stop_delete_test.go:228: (dbg) Done: out/minikube-linux-arm64 stop -p newest-cni-425545 --alsologtostderr -v=3: (1.318958124s)
--- PASS: TestStartStop/group/newest-cni/serial/Stop (1.32s)

                                                
                                    
x
+
TestStartStop/group/newest-cni/serial/EnableAddonAfterStop (0.18s)

                                                
                                                
=== RUN   TestStartStop/group/newest-cni/serial/EnableAddonAfterStop
start_stop_delete_test.go:239: (dbg) Run:  out/minikube-linux-arm64 status --format={{.Host}} -p newest-cni-425545 -n newest-cni-425545
start_stop_delete_test.go:239: (dbg) Non-zero exit: out/minikube-linux-arm64 status --format={{.Host}} -p newest-cni-425545 -n newest-cni-425545: exit status 7 (65.599149ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
start_stop_delete_test.go:239: status error: exit status 7 (may be ok)
start_stop_delete_test.go:246: (dbg) Run:  out/minikube-linux-arm64 addons enable dashboard -p newest-cni-425545 --images=MetricsScraper=registry.k8s.io/echoserver:1.4
--- PASS: TestStartStop/group/newest-cni/serial/EnableAddonAfterStop (0.18s)

                                                
                                    
x
+
TestStartStop/group/newest-cni/serial/SecondStart (16.21s)

                                                
                                                
=== RUN   TestStartStop/group/newest-cni/serial/SecondStart
start_stop_delete_test.go:256: (dbg) Run:  out/minikube-linux-arm64 start -p newest-cni-425545 --memory=2200 --alsologtostderr --wait=apiserver,system_pods,default_sa --feature-gates ServerSideApply=true --network-plugin=cni --extra-config=kubeadm.pod-network-cidr=10.42.0.0/16 --driver=docker  --container-runtime=crio --kubernetes-version=v1.31.1
start_stop_delete_test.go:256: (dbg) Done: out/minikube-linux-arm64 start -p newest-cni-425545 --memory=2200 --alsologtostderr --wait=apiserver,system_pods,default_sa --feature-gates ServerSideApply=true --network-plugin=cni --extra-config=kubeadm.pod-network-cidr=10.42.0.0/16 --driver=docker  --container-runtime=crio --kubernetes-version=v1.31.1: (15.861694785s)
start_stop_delete_test.go:262: (dbg) Run:  out/minikube-linux-arm64 status --format={{.Host}} -p newest-cni-425545 -n newest-cni-425545
--- PASS: TestStartStop/group/newest-cni/serial/SecondStart (16.21s)

                                                
                                    
x
+
TestStartStop/group/default-k8s-diff-port/serial/EnableAddonWhileActive (1.81s)

                                                
                                                
=== RUN   TestStartStop/group/default-k8s-diff-port/serial/EnableAddonWhileActive
start_stop_delete_test.go:205: (dbg) Run:  out/minikube-linux-arm64 addons enable metrics-server -p default-k8s-diff-port-614769 --images=MetricsServer=registry.k8s.io/echoserver:1.4 --registries=MetricsServer=fake.domain
E0924 01:48:04.751335 1873600 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /home/jenkins/minikube-integration/19696-1868219/.minikube/profiles/functional-838183/client.crt: no such file or directory" logger="UnhandledError"
start_stop_delete_test.go:205: (dbg) Done: out/minikube-linux-arm64 addons enable metrics-server -p default-k8s-diff-port-614769 --images=MetricsServer=registry.k8s.io/echoserver:1.4 --registries=MetricsServer=fake.domain: (1.586514806s)
start_stop_delete_test.go:215: (dbg) Run:  kubectl --context default-k8s-diff-port-614769 describe deploy/metrics-server -n kube-system
--- PASS: TestStartStop/group/default-k8s-diff-port/serial/EnableAddonWhileActive (1.81s)

                                                
                                    
x
+
TestStartStop/group/default-k8s-diff-port/serial/Stop (12.48s)

                                                
                                                
=== RUN   TestStartStop/group/default-k8s-diff-port/serial/Stop
start_stop_delete_test.go:228: (dbg) Run:  out/minikube-linux-arm64 stop -p default-k8s-diff-port-614769 --alsologtostderr -v=3
start_stop_delete_test.go:228: (dbg) Done: out/minikube-linux-arm64 stop -p default-k8s-diff-port-614769 --alsologtostderr -v=3: (12.482041038s)
--- PASS: TestStartStop/group/default-k8s-diff-port/serial/Stop (12.48s)

                                                
                                    
x
+
TestStartStop/group/newest-cni/serial/UserAppExistsAfterStop (0s)

                                                
                                                
=== RUN   TestStartStop/group/newest-cni/serial/UserAppExistsAfterStop
start_stop_delete_test.go:273: WARNING: cni mode requires additional setup before pods can schedule :(
--- PASS: TestStartStop/group/newest-cni/serial/UserAppExistsAfterStop (0.00s)

                                                
                                    
x
+
TestStartStop/group/newest-cni/serial/AddonExistsAfterStop (0s)

                                                
                                                
=== RUN   TestStartStop/group/newest-cni/serial/AddonExistsAfterStop
start_stop_delete_test.go:284: WARNING: cni mode requires additional setup before pods can schedule :(
--- PASS: TestStartStop/group/newest-cni/serial/AddonExistsAfterStop (0.00s)

                                                
                                    
x
+
TestStartStop/group/newest-cni/serial/VerifyKubernetesImages (0.23s)

                                                
                                                
=== RUN   TestStartStop/group/newest-cni/serial/VerifyKubernetesImages
start_stop_delete_test.go:304: (dbg) Run:  out/minikube-linux-arm64 -p newest-cni-425545 image list --format=json
start_stop_delete_test.go:304: Found non-minikube image: kindest/kindnetd:v20240813-c6f155d6
--- PASS: TestStartStop/group/newest-cni/serial/VerifyKubernetesImages (0.23s)

                                                
                                    
x
+
TestStartStop/group/newest-cni/serial/Pause (2.82s)

                                                
                                                
=== RUN   TestStartStop/group/newest-cni/serial/Pause
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 pause -p newest-cni-425545 --alsologtostderr -v=1
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 status --format={{.APIServer}} -p newest-cni-425545 -n newest-cni-425545
start_stop_delete_test.go:311: (dbg) Non-zero exit: out/minikube-linux-arm64 status --format={{.APIServer}} -p newest-cni-425545 -n newest-cni-425545: exit status 2 (298.265707ms)

                                                
                                                
-- stdout --
	Paused

                                                
                                                
-- /stdout --
start_stop_delete_test.go:311: status error: exit status 2 (may be ok)
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 status --format={{.Kubelet}} -p newest-cni-425545 -n newest-cni-425545
start_stop_delete_test.go:311: (dbg) Non-zero exit: out/minikube-linux-arm64 status --format={{.Kubelet}} -p newest-cni-425545 -n newest-cni-425545: exit status 2 (297.169297ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
start_stop_delete_test.go:311: status error: exit status 2 (may be ok)
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 unpause -p newest-cni-425545 --alsologtostderr -v=1
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 status --format={{.APIServer}} -p newest-cni-425545 -n newest-cni-425545
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 status --format={{.Kubelet}} -p newest-cni-425545 -n newest-cni-425545
--- PASS: TestStartStop/group/newest-cni/serial/Pause (2.82s)

                                                
                                    
x
+
TestNetworkPlugins/group/auto/Start (88.67s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/auto/Start
net_test.go:112: (dbg) Run:  out/minikube-linux-arm64 start -p auto-150947 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --driver=docker  --container-runtime=crio
net_test.go:112: (dbg) Done: out/minikube-linux-arm64 start -p auto-150947 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --driver=docker  --container-runtime=crio: (1m28.674274456s)
--- PASS: TestNetworkPlugins/group/auto/Start (88.67s)

                                                
                                    
x
+
TestStartStop/group/default-k8s-diff-port/serial/EnableAddonAfterStop (0.2s)

                                                
                                                
=== RUN   TestStartStop/group/default-k8s-diff-port/serial/EnableAddonAfterStop
start_stop_delete_test.go:239: (dbg) Run:  out/minikube-linux-arm64 status --format={{.Host}} -p default-k8s-diff-port-614769 -n default-k8s-diff-port-614769
start_stop_delete_test.go:239: (dbg) Non-zero exit: out/minikube-linux-arm64 status --format={{.Host}} -p default-k8s-diff-port-614769 -n default-k8s-diff-port-614769: exit status 7 (82.870766ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
start_stop_delete_test.go:239: status error: exit status 7 (may be ok)
start_stop_delete_test.go:246: (dbg) Run:  out/minikube-linux-arm64 addons enable dashboard -p default-k8s-diff-port-614769 --images=MetricsScraper=registry.k8s.io/echoserver:1.4
--- PASS: TestStartStop/group/default-k8s-diff-port/serial/EnableAddonAfterStop (0.20s)

                                                
                                    
x
+
TestStartStop/group/default-k8s-diff-port/serial/SecondStart (282.19s)

                                                
                                                
=== RUN   TestStartStop/group/default-k8s-diff-port/serial/SecondStart
start_stop_delete_test.go:256: (dbg) Run:  out/minikube-linux-arm64 start -p default-k8s-diff-port-614769 --memory=2200 --alsologtostderr --wait=true --apiserver-port=8444 --driver=docker  --container-runtime=crio --kubernetes-version=v1.31.1
E0924 01:48:43.638189 1873600 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /home/jenkins/minikube-integration/19696-1868219/.minikube/profiles/old-k8s-version-215342/client.crt: no such file or directory" logger="UnhandledError"
E0924 01:49:02.994547 1873600 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /home/jenkins/minikube-integration/19696-1868219/.minikube/profiles/addons-371349/client.crt: no such file or directory" logger="UnhandledError"
E0924 01:49:19.924479 1873600 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /home/jenkins/minikube-integration/19696-1868219/.minikube/profiles/addons-371349/client.crt: no such file or directory" logger="UnhandledError"
start_stop_delete_test.go:256: (dbg) Done: out/minikube-linux-arm64 start -p default-k8s-diff-port-614769 --memory=2200 --alsologtostderr --wait=true --apiserver-port=8444 --driver=docker  --container-runtime=crio --kubernetes-version=v1.31.1: (4m41.72518792s)
start_stop_delete_test.go:262: (dbg) Run:  out/minikube-linux-arm64 status --format={{.Host}} -p default-k8s-diff-port-614769 -n default-k8s-diff-port-614769
--- PASS: TestStartStop/group/default-k8s-diff-port/serial/SecondStart (282.19s)

                                                
                                    
x
+
TestNetworkPlugins/group/auto/KubeletFlags (0.28s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/auto/KubeletFlags
net_test.go:133: (dbg) Run:  out/minikube-linux-arm64 ssh -p auto-150947 "pgrep -a kubelet"
I0924 01:49:46.211089 1873600 config.go:182] Loaded profile config "auto-150947": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.31.1
--- PASS: TestNetworkPlugins/group/auto/KubeletFlags (0.28s)

                                                
                                    
x
+
TestNetworkPlugins/group/auto/NetCatPod (10.29s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/auto/NetCatPod
net_test.go:149: (dbg) Run:  kubectl --context auto-150947 replace --force -f testdata/netcat-deployment.yaml
net_test.go:163: (dbg) TestNetworkPlugins/group/auto/NetCatPod: waiting 15m0s for pods matching "app=netcat" in namespace "default" ...
helpers_test.go:344: "netcat-6fc964789b-2xww7" [87be43e6-958f-4bd7-ac12-e9eea729e454] Pending / Ready:ContainersNotReady (containers with unready status: [dnsutils]) / ContainersReady:ContainersNotReady (containers with unready status: [dnsutils])
helpers_test.go:344: "netcat-6fc964789b-2xww7" [87be43e6-958f-4bd7-ac12-e9eea729e454] Running
net_test.go:163: (dbg) TestNetworkPlugins/group/auto/NetCatPod: app=netcat healthy within 10.004227319s
--- PASS: TestNetworkPlugins/group/auto/NetCatPod (10.29s)

                                                
                                    
x
+
TestNetworkPlugins/group/auto/DNS (0.16s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/auto/DNS
net_test.go:175: (dbg) Run:  kubectl --context auto-150947 exec deployment/netcat -- nslookup kubernetes.default
--- PASS: TestNetworkPlugins/group/auto/DNS (0.16s)

                                                
                                    
x
+
TestNetworkPlugins/group/auto/Localhost (0.14s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/auto/Localhost
net_test.go:194: (dbg) Run:  kubectl --context auto-150947 exec deployment/netcat -- /bin/sh -c "nc -w 5 -i 5 -z localhost 8080"
--- PASS: TestNetworkPlugins/group/auto/Localhost (0.14s)

                                                
                                    
x
+
TestNetworkPlugins/group/auto/HairPin (0.19s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/auto/HairPin
net_test.go:264: (dbg) Run:  kubectl --context auto-150947 exec deployment/netcat -- /bin/sh -c "nc -w 5 -i 5 -z netcat 8080"
--- PASS: TestNetworkPlugins/group/auto/HairPin (0.19s)

                                                
                                    
x
+
TestNetworkPlugins/group/kindnet/Start (77.81s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/kindnet/Start
net_test.go:112: (dbg) Run:  out/minikube-linux-arm64 start -p kindnet-150947 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --cni=kindnet --driver=docker  --container-runtime=crio
E0924 01:50:43.791199 1873600 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /home/jenkins/minikube-integration/19696-1868219/.minikube/profiles/no-preload-397870/client.crt: no such file or directory" logger="UnhandledError"
E0924 01:50:43.797924 1873600 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /home/jenkins/minikube-integration/19696-1868219/.minikube/profiles/no-preload-397870/client.crt: no such file or directory" logger="UnhandledError"
E0924 01:50:43.809796 1873600 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /home/jenkins/minikube-integration/19696-1868219/.minikube/profiles/no-preload-397870/client.crt: no such file or directory" logger="UnhandledError"
E0924 01:50:43.831758 1873600 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /home/jenkins/minikube-integration/19696-1868219/.minikube/profiles/no-preload-397870/client.crt: no such file or directory" logger="UnhandledError"
E0924 01:50:43.873141 1873600 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /home/jenkins/minikube-integration/19696-1868219/.minikube/profiles/no-preload-397870/client.crt: no such file or directory" logger="UnhandledError"
E0924 01:50:43.954536 1873600 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /home/jenkins/minikube-integration/19696-1868219/.minikube/profiles/no-preload-397870/client.crt: no such file or directory" logger="UnhandledError"
E0924 01:50:44.115979 1873600 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /home/jenkins/minikube-integration/19696-1868219/.minikube/profiles/no-preload-397870/client.crt: no such file or directory" logger="UnhandledError"
E0924 01:50:44.437336 1873600 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /home/jenkins/minikube-integration/19696-1868219/.minikube/profiles/no-preload-397870/client.crt: no such file or directory" logger="UnhandledError"
E0924 01:50:45.079425 1873600 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /home/jenkins/minikube-integration/19696-1868219/.minikube/profiles/no-preload-397870/client.crt: no such file or directory" logger="UnhandledError"
E0924 01:50:46.360821 1873600 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /home/jenkins/minikube-integration/19696-1868219/.minikube/profiles/no-preload-397870/client.crt: no such file or directory" logger="UnhandledError"
E0924 01:50:48.922760 1873600 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /home/jenkins/minikube-integration/19696-1868219/.minikube/profiles/no-preload-397870/client.crt: no such file or directory" logger="UnhandledError"
E0924 01:50:54.044058 1873600 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /home/jenkins/minikube-integration/19696-1868219/.minikube/profiles/no-preload-397870/client.crt: no such file or directory" logger="UnhandledError"
E0924 01:51:04.285957 1873600 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /home/jenkins/minikube-integration/19696-1868219/.minikube/profiles/no-preload-397870/client.crt: no such file or directory" logger="UnhandledError"
E0924 01:51:24.768044 1873600 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /home/jenkins/minikube-integration/19696-1868219/.minikube/profiles/no-preload-397870/client.crt: no such file or directory" logger="UnhandledError"
net_test.go:112: (dbg) Done: out/minikube-linux-arm64 start -p kindnet-150947 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --cni=kindnet --driver=docker  --container-runtime=crio: (1m17.809467198s)
--- PASS: TestNetworkPlugins/group/kindnet/Start (77.81s)

                                                
                                    
x
+
TestNetworkPlugins/group/kindnet/ControllerPod (6.01s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/kindnet/ControllerPod
net_test.go:120: (dbg) TestNetworkPlugins/group/kindnet/ControllerPod: waiting 10m0s for pods matching "app=kindnet" in namespace "kube-system" ...
helpers_test.go:344: "kindnet-lxcbw" [71b46e35-d168-4171-8473-2f2531917c81] Running
net_test.go:120: (dbg) TestNetworkPlugins/group/kindnet/ControllerPod: app=kindnet healthy within 6.003719872s
--- PASS: TestNetworkPlugins/group/kindnet/ControllerPod (6.01s)

                                                
                                    
x
+
TestNetworkPlugins/group/kindnet/KubeletFlags (0.27s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/kindnet/KubeletFlags
net_test.go:133: (dbg) Run:  out/minikube-linux-arm64 ssh -p kindnet-150947 "pgrep -a kubelet"
I0924 01:51:40.627379 1873600 config.go:182] Loaded profile config "kindnet-150947": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.31.1
--- PASS: TestNetworkPlugins/group/kindnet/KubeletFlags (0.27s)

                                                
                                    
x
+
TestNetworkPlugins/group/kindnet/NetCatPod (10.26s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/kindnet/NetCatPod
net_test.go:149: (dbg) Run:  kubectl --context kindnet-150947 replace --force -f testdata/netcat-deployment.yaml
net_test.go:163: (dbg) TestNetworkPlugins/group/kindnet/NetCatPod: waiting 15m0s for pods matching "app=netcat" in namespace "default" ...
helpers_test.go:344: "netcat-6fc964789b-v49cc" [5006d5f3-d244-4606-8e85-2b842f1b9177] Pending / Ready:ContainersNotReady (containers with unready status: [dnsutils]) / ContainersReady:ContainersNotReady (containers with unready status: [dnsutils])
helpers_test.go:344: "netcat-6fc964789b-v49cc" [5006d5f3-d244-4606-8e85-2b842f1b9177] Running
net_test.go:163: (dbg) TestNetworkPlugins/group/kindnet/NetCatPod: app=netcat healthy within 10.003887925s
--- PASS: TestNetworkPlugins/group/kindnet/NetCatPod (10.26s)

                                                
                                    
x
+
TestNetworkPlugins/group/kindnet/DNS (0.17s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/kindnet/DNS
net_test.go:175: (dbg) Run:  kubectl --context kindnet-150947 exec deployment/netcat -- nslookup kubernetes.default
--- PASS: TestNetworkPlugins/group/kindnet/DNS (0.17s)

                                                
                                    
x
+
TestNetworkPlugins/group/kindnet/Localhost (0.16s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/kindnet/Localhost
net_test.go:194: (dbg) Run:  kubectl --context kindnet-150947 exec deployment/netcat -- /bin/sh -c "nc -w 5 -i 5 -z localhost 8080"
--- PASS: TestNetworkPlugins/group/kindnet/Localhost (0.16s)

                                                
                                    
x
+
TestNetworkPlugins/group/kindnet/HairPin (0.14s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/kindnet/HairPin
net_test.go:264: (dbg) Run:  kubectl --context kindnet-150947 exec deployment/netcat -- /bin/sh -c "nc -w 5 -i 5 -z netcat 8080"
--- PASS: TestNetworkPlugins/group/kindnet/HairPin (0.14s)

                                                
                                    
x
+
TestNetworkPlugins/group/calico/Start (61.34s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/calico/Start
net_test.go:112: (dbg) Run:  out/minikube-linux-arm64 start -p calico-150947 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --cni=calico --driver=docker  --container-runtime=crio
E0924 01:52:47.826852 1873600 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /home/jenkins/minikube-integration/19696-1868219/.minikube/profiles/functional-838183/client.crt: no such file or directory" logger="UnhandledError"
net_test.go:112: (dbg) Done: out/minikube-linux-arm64 start -p calico-150947 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --cni=calico --driver=docker  --container-runtime=crio: (1m1.330246258s)
--- PASS: TestNetworkPlugins/group/calico/Start (61.34s)

                                                
                                    
x
+
TestStartStop/group/default-k8s-diff-port/serial/UserAppExistsAfterStop (6.01s)

                                                
                                                
=== RUN   TestStartStop/group/default-k8s-diff-port/serial/UserAppExistsAfterStop
start_stop_delete_test.go:274: (dbg) TestStartStop/group/default-k8s-diff-port/serial/UserAppExistsAfterStop: waiting 9m0s for pods matching "k8s-app=kubernetes-dashboard" in namespace "kubernetes-dashboard" ...
helpers_test.go:344: "kubernetes-dashboard-695b96c756-fvnsg" [1b82ec64-95d7-414c-b389-a3791075d7cf] Running
E0924 01:53:04.750773 1873600 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /home/jenkins/minikube-integration/19696-1868219/.minikube/profiles/functional-838183/client.crt: no such file or directory" logger="UnhandledError"
start_stop_delete_test.go:274: (dbg) TestStartStop/group/default-k8s-diff-port/serial/UserAppExistsAfterStop: k8s-app=kubernetes-dashboard healthy within 6.004520857s
--- PASS: TestStartStop/group/default-k8s-diff-port/serial/UserAppExistsAfterStop (6.01s)

                                                
                                    
x
+
TestStartStop/group/default-k8s-diff-port/serial/AddonExistsAfterStop (5.09s)

                                                
                                                
=== RUN   TestStartStop/group/default-k8s-diff-port/serial/AddonExistsAfterStop
start_stop_delete_test.go:287: (dbg) TestStartStop/group/default-k8s-diff-port/serial/AddonExistsAfterStop: waiting 9m0s for pods matching "k8s-app=kubernetes-dashboard" in namespace "kubernetes-dashboard" ...
helpers_test.go:344: "kubernetes-dashboard-695b96c756-fvnsg" [1b82ec64-95d7-414c-b389-a3791075d7cf] Running
start_stop_delete_test.go:287: (dbg) TestStartStop/group/default-k8s-diff-port/serial/AddonExistsAfterStop: k8s-app=kubernetes-dashboard healthy within 5.004354168s
start_stop_delete_test.go:291: (dbg) Run:  kubectl --context default-k8s-diff-port-614769 describe deploy/dashboard-metrics-scraper -n kubernetes-dashboard
--- PASS: TestStartStop/group/default-k8s-diff-port/serial/AddonExistsAfterStop (5.09s)

                                                
                                    
x
+
TestNetworkPlugins/group/calico/ControllerPod (6.01s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/calico/ControllerPod
net_test.go:120: (dbg) TestNetworkPlugins/group/calico/ControllerPod: waiting 10m0s for pods matching "k8s-app=calico-node" in namespace "kube-system" ...
helpers_test.go:344: "calico-node-dhl5v" [b3964cc2-fa87-416b-acf3-6e46d46ec0af] Running
net_test.go:120: (dbg) TestNetworkPlugins/group/calico/ControllerPod: k8s-app=calico-node healthy within 6.008655031s
--- PASS: TestNetworkPlugins/group/calico/ControllerPod (6.01s)

                                                
                                    
x
+
TestStartStop/group/default-k8s-diff-port/serial/VerifyKubernetesImages (0.23s)

                                                
                                                
=== RUN   TestStartStop/group/default-k8s-diff-port/serial/VerifyKubernetesImages
start_stop_delete_test.go:304: (dbg) Run:  out/minikube-linux-arm64 -p default-k8s-diff-port-614769 image list --format=json
start_stop_delete_test.go:304: Found non-minikube image: gcr.io/k8s-minikube/busybox:1.28.4-glibc
start_stop_delete_test.go:304: Found non-minikube image: kindest/kindnetd:v20240813-c6f155d6
--- PASS: TestStartStop/group/default-k8s-diff-port/serial/VerifyKubernetesImages (0.23s)

                                                
                                    
x
+
TestStartStop/group/default-k8s-diff-port/serial/Pause (2.91s)

                                                
                                                
=== RUN   TestStartStop/group/default-k8s-diff-port/serial/Pause
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 pause -p default-k8s-diff-port-614769 --alsologtostderr -v=1
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 status --format={{.APIServer}} -p default-k8s-diff-port-614769 -n default-k8s-diff-port-614769
start_stop_delete_test.go:311: (dbg) Non-zero exit: out/minikube-linux-arm64 status --format={{.APIServer}} -p default-k8s-diff-port-614769 -n default-k8s-diff-port-614769: exit status 2 (306.157367ms)

                                                
                                                
-- stdout --
	Paused

                                                
                                                
-- /stdout --
start_stop_delete_test.go:311: status error: exit status 2 (may be ok)
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 status --format={{.Kubelet}} -p default-k8s-diff-port-614769 -n default-k8s-diff-port-614769
start_stop_delete_test.go:311: (dbg) Non-zero exit: out/minikube-linux-arm64 status --format={{.Kubelet}} -p default-k8s-diff-port-614769 -n default-k8s-diff-port-614769: exit status 2 (313.225112ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
start_stop_delete_test.go:311: status error: exit status 2 (may be ok)
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 unpause -p default-k8s-diff-port-614769 --alsologtostderr -v=1
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 status --format={{.APIServer}} -p default-k8s-diff-port-614769 -n default-k8s-diff-port-614769
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 status --format={{.Kubelet}} -p default-k8s-diff-port-614769 -n default-k8s-diff-port-614769
--- PASS: TestStartStop/group/default-k8s-diff-port/serial/Pause (2.91s)
E0924 01:56:34.355260 1873600 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /home/jenkins/minikube-integration/19696-1868219/.minikube/profiles/kindnet-150947/client.crt: no such file or directory" logger="UnhandledError"
E0924 01:56:34.361711 1873600 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /home/jenkins/minikube-integration/19696-1868219/.minikube/profiles/kindnet-150947/client.crt: no such file or directory" logger="UnhandledError"
E0924 01:56:34.373142 1873600 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /home/jenkins/minikube-integration/19696-1868219/.minikube/profiles/kindnet-150947/client.crt: no such file or directory" logger="UnhandledError"
E0924 01:56:34.394566 1873600 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /home/jenkins/minikube-integration/19696-1868219/.minikube/profiles/kindnet-150947/client.crt: no such file or directory" logger="UnhandledError"
E0924 01:56:34.436191 1873600 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /home/jenkins/minikube-integration/19696-1868219/.minikube/profiles/kindnet-150947/client.crt: no such file or directory" logger="UnhandledError"
E0924 01:56:34.517631 1873600 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /home/jenkins/minikube-integration/19696-1868219/.minikube/profiles/kindnet-150947/client.crt: no such file or directory" logger="UnhandledError"
E0924 01:56:34.679022 1873600 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /home/jenkins/minikube-integration/19696-1868219/.minikube/profiles/kindnet-150947/client.crt: no such file or directory" logger="UnhandledError"
E0924 01:56:35.000829 1873600 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /home/jenkins/minikube-integration/19696-1868219/.minikube/profiles/kindnet-150947/client.crt: no such file or directory" logger="UnhandledError"
E0924 01:56:35.642872 1873600 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /home/jenkins/minikube-integration/19696-1868219/.minikube/profiles/kindnet-150947/client.crt: no such file or directory" logger="UnhandledError"
E0924 01:56:36.925021 1873600 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /home/jenkins/minikube-integration/19696-1868219/.minikube/profiles/kindnet-150947/client.crt: no such file or directory" logger="UnhandledError"
E0924 01:56:39.487121 1873600 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /home/jenkins/minikube-integration/19696-1868219/.minikube/profiles/kindnet-150947/client.crt: no such file or directory" logger="UnhandledError"
E0924 01:56:44.609410 1873600 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /home/jenkins/minikube-integration/19696-1868219/.minikube/profiles/kindnet-150947/client.crt: no such file or directory" logger="UnhandledError"
E0924 01:56:54.851329 1873600 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /home/jenkins/minikube-integration/19696-1868219/.minikube/profiles/kindnet-150947/client.crt: no such file or directory" logger="UnhandledError"

                                                
                                    
x
+
TestNetworkPlugins/group/calico/KubeletFlags (0.34s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/calico/KubeletFlags
net_test.go:133: (dbg) Run:  out/minikube-linux-arm64 ssh -p calico-150947 "pgrep -a kubelet"
--- PASS: TestNetworkPlugins/group/calico/KubeletFlags (0.34s)

                                                
                                    
x
+
TestNetworkPlugins/group/custom-flannel/Start (62s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/custom-flannel/Start
net_test.go:112: (dbg) Run:  out/minikube-linux-arm64 start -p custom-flannel-150947 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --cni=testdata/kube-flannel.yaml --driver=docker  --container-runtime=crio
I0924 01:53:18.708432 1873600 config.go:182] Loaded profile config "calico-150947": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.31.1
net_test.go:112: (dbg) Done: out/minikube-linux-arm64 start -p custom-flannel-150947 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --cni=testdata/kube-flannel.yaml --driver=docker  --container-runtime=crio: (1m2.001409512s)
--- PASS: TestNetworkPlugins/group/custom-flannel/Start (62.00s)

                                                
                                    
x
+
TestNetworkPlugins/group/calico/NetCatPod (14.39s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/calico/NetCatPod
net_test.go:149: (dbg) Run:  kubectl --context calico-150947 replace --force -f testdata/netcat-deployment.yaml
I0924 01:53:19.077435 1873600 kapi.go:136] Waiting for deployment netcat to stabilize, generation 1 observed generation 1 spec.replicas 1 status.replicas 0
net_test.go:163: (dbg) TestNetworkPlugins/group/calico/NetCatPod: waiting 15m0s for pods matching "app=netcat" in namespace "default" ...
helpers_test.go:344: "netcat-6fc964789b-9ngrg" [697778c0-1e45-45ea-acb4-187e6fc84af7] Pending / Ready:ContainersNotReady (containers with unready status: [dnsutils]) / ContainersReady:ContainersNotReady (containers with unready status: [dnsutils])
helpers_test.go:344: "netcat-6fc964789b-9ngrg" [697778c0-1e45-45ea-acb4-187e6fc84af7] Running
E0924 01:53:27.651927 1873600 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /home/jenkins/minikube-integration/19696-1868219/.minikube/profiles/no-preload-397870/client.crt: no such file or directory" logger="UnhandledError"
net_test.go:163: (dbg) TestNetworkPlugins/group/calico/NetCatPod: app=netcat healthy within 14.005071659s
--- PASS: TestNetworkPlugins/group/calico/NetCatPod (14.39s)

                                                
                                    
x
+
TestNetworkPlugins/group/calico/DNS (0.25s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/calico/DNS
net_test.go:175: (dbg) Run:  kubectl --context calico-150947 exec deployment/netcat -- nslookup kubernetes.default
--- PASS: TestNetworkPlugins/group/calico/DNS (0.25s)

                                                
                                    
x
+
TestNetworkPlugins/group/calico/Localhost (0.19s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/calico/Localhost
net_test.go:194: (dbg) Run:  kubectl --context calico-150947 exec deployment/netcat -- /bin/sh -c "nc -w 5 -i 5 -z localhost 8080"
--- PASS: TestNetworkPlugins/group/calico/Localhost (0.19s)

                                                
                                    
x
+
TestNetworkPlugins/group/calico/HairPin (0.2s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/calico/HairPin
net_test.go:264: (dbg) Run:  kubectl --context calico-150947 exec deployment/netcat -- /bin/sh -c "nc -w 5 -i 5 -z netcat 8080"
--- PASS: TestNetworkPlugins/group/calico/HairPin (0.20s)

                                                
                                    
x
+
TestNetworkPlugins/group/enable-default-cni/Start (76.75s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/enable-default-cni/Start
net_test.go:112: (dbg) Run:  out/minikube-linux-arm64 start -p enable-default-cni-150947 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --enable-default-cni=true --driver=docker  --container-runtime=crio
E0924 01:54:19.924220 1873600 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /home/jenkins/minikube-integration/19696-1868219/.minikube/profiles/addons-371349/client.crt: no such file or directory" logger="UnhandledError"
net_test.go:112: (dbg) Done: out/minikube-linux-arm64 start -p enable-default-cni-150947 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --enable-default-cni=true --driver=docker  --container-runtime=crio: (1m16.750191163s)
--- PASS: TestNetworkPlugins/group/enable-default-cni/Start (76.75s)

                                                
                                    
x
+
TestNetworkPlugins/group/custom-flannel/KubeletFlags (0.34s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/custom-flannel/KubeletFlags
net_test.go:133: (dbg) Run:  out/minikube-linux-arm64 ssh -p custom-flannel-150947 "pgrep -a kubelet"
I0924 01:54:20.717678 1873600 config.go:182] Loaded profile config "custom-flannel-150947": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.31.1
--- PASS: TestNetworkPlugins/group/custom-flannel/KubeletFlags (0.34s)

                                                
                                    
x
+
TestNetworkPlugins/group/custom-flannel/NetCatPod (12.34s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/custom-flannel/NetCatPod
net_test.go:149: (dbg) Run:  kubectl --context custom-flannel-150947 replace --force -f testdata/netcat-deployment.yaml
net_test.go:163: (dbg) TestNetworkPlugins/group/custom-flannel/NetCatPod: waiting 15m0s for pods matching "app=netcat" in namespace "default" ...
helpers_test.go:344: "netcat-6fc964789b-4xv2c" [94e1a05e-0e75-4957-b62c-34014e36acc9] Pending / Ready:ContainersNotReady (containers with unready status: [dnsutils]) / ContainersReady:ContainersNotReady (containers with unready status: [dnsutils])
helpers_test.go:344: "netcat-6fc964789b-4xv2c" [94e1a05e-0e75-4957-b62c-34014e36acc9] Running
net_test.go:163: (dbg) TestNetworkPlugins/group/custom-flannel/NetCatPod: app=netcat healthy within 12.004112791s
--- PASS: TestNetworkPlugins/group/custom-flannel/NetCatPod (12.34s)

                                                
                                    
x
+
TestNetworkPlugins/group/custom-flannel/DNS (0.2s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/custom-flannel/DNS
net_test.go:175: (dbg) Run:  kubectl --context custom-flannel-150947 exec deployment/netcat -- nslookup kubernetes.default
--- PASS: TestNetworkPlugins/group/custom-flannel/DNS (0.20s)

                                                
                                    
x
+
TestNetworkPlugins/group/custom-flannel/Localhost (0.16s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/custom-flannel/Localhost
net_test.go:194: (dbg) Run:  kubectl --context custom-flannel-150947 exec deployment/netcat -- /bin/sh -c "nc -w 5 -i 5 -z localhost 8080"
--- PASS: TestNetworkPlugins/group/custom-flannel/Localhost (0.16s)

                                                
                                    
x
+
TestNetworkPlugins/group/custom-flannel/HairPin (0.16s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/custom-flannel/HairPin
net_test.go:264: (dbg) Run:  kubectl --context custom-flannel-150947 exec deployment/netcat -- /bin/sh -c "nc -w 5 -i 5 -z netcat 8080"
--- PASS: TestNetworkPlugins/group/custom-flannel/HairPin (0.16s)

                                                
                                    
x
+
TestNetworkPlugins/group/flannel/Start (55.23s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/flannel/Start
net_test.go:112: (dbg) Run:  out/minikube-linux-arm64 start -p flannel-150947 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --cni=flannel --driver=docker  --container-runtime=crio
E0924 01:54:56.727816 1873600 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /home/jenkins/minikube-integration/19696-1868219/.minikube/profiles/auto-150947/client.crt: no such file or directory" logger="UnhandledError"
E0924 01:55:06.969673 1873600 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /home/jenkins/minikube-integration/19696-1868219/.minikube/profiles/auto-150947/client.crt: no such file or directory" logger="UnhandledError"
net_test.go:112: (dbg) Done: out/minikube-linux-arm64 start -p flannel-150947 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --cni=flannel --driver=docker  --container-runtime=crio: (55.231971664s)
--- PASS: TestNetworkPlugins/group/flannel/Start (55.23s)

                                                
                                    
x
+
TestNetworkPlugins/group/enable-default-cni/KubeletFlags (0.32s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/enable-default-cni/KubeletFlags
net_test.go:133: (dbg) Run:  out/minikube-linux-arm64 ssh -p enable-default-cni-150947 "pgrep -a kubelet"
I0924 01:55:15.760670 1873600 config.go:182] Loaded profile config "enable-default-cni-150947": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.31.1
--- PASS: TestNetworkPlugins/group/enable-default-cni/KubeletFlags (0.32s)

                                                
                                    
x
+
TestNetworkPlugins/group/enable-default-cni/NetCatPod (13.35s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/enable-default-cni/NetCatPod
net_test.go:149: (dbg) Run:  kubectl --context enable-default-cni-150947 replace --force -f testdata/netcat-deployment.yaml
net_test.go:163: (dbg) TestNetworkPlugins/group/enable-default-cni/NetCatPod: waiting 15m0s for pods matching "app=netcat" in namespace "default" ...
helpers_test.go:344: "netcat-6fc964789b-57hgv" [c218108d-3000-4d55-a68e-9834cde4bb6b] Pending / Ready:ContainersNotReady (containers with unready status: [dnsutils]) / ContainersReady:ContainersNotReady (containers with unready status: [dnsutils])
helpers_test.go:344: "netcat-6fc964789b-57hgv" [c218108d-3000-4d55-a68e-9834cde4bb6b] Running
E0924 01:55:27.451441 1873600 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /home/jenkins/minikube-integration/19696-1868219/.minikube/profiles/auto-150947/client.crt: no such file or directory" logger="UnhandledError"
net_test.go:163: (dbg) TestNetworkPlugins/group/enable-default-cni/NetCatPod: app=netcat healthy within 13.003677636s
--- PASS: TestNetworkPlugins/group/enable-default-cni/NetCatPod (13.35s)

                                                
                                    
x
+
TestNetworkPlugins/group/enable-default-cni/DNS (0.28s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/enable-default-cni/DNS
net_test.go:175: (dbg) Run:  kubectl --context enable-default-cni-150947 exec deployment/netcat -- nslookup kubernetes.default
--- PASS: TestNetworkPlugins/group/enable-default-cni/DNS (0.28s)

                                                
                                    
x
+
TestNetworkPlugins/group/enable-default-cni/Localhost (0.23s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/enable-default-cni/Localhost
net_test.go:194: (dbg) Run:  kubectl --context enable-default-cni-150947 exec deployment/netcat -- /bin/sh -c "nc -w 5 -i 5 -z localhost 8080"
--- PASS: TestNetworkPlugins/group/enable-default-cni/Localhost (0.23s)

                                                
                                    
x
+
TestNetworkPlugins/group/enable-default-cni/HairPin (0.26s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/enable-default-cni/HairPin
net_test.go:264: (dbg) Run:  kubectl --context enable-default-cni-150947 exec deployment/netcat -- /bin/sh -c "nc -w 5 -i 5 -z netcat 8080"
--- PASS: TestNetworkPlugins/group/enable-default-cni/HairPin (0.26s)

                                                
                                    
x
+
TestNetworkPlugins/group/bridge/Start (77.45s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/bridge/Start
net_test.go:112: (dbg) Run:  out/minikube-linux-arm64 start -p bridge-150947 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --cni=bridge --driver=docker  --container-runtime=crio
net_test.go:112: (dbg) Done: out/minikube-linux-arm64 start -p bridge-150947 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --cni=bridge --driver=docker  --container-runtime=crio: (1m17.453689719s)
--- PASS: TestNetworkPlugins/group/bridge/Start (77.45s)

                                                
                                    
x
+
TestNetworkPlugins/group/flannel/ControllerPod (6.01s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/flannel/ControllerPod
net_test.go:120: (dbg) TestNetworkPlugins/group/flannel/ControllerPod: waiting 10m0s for pods matching "app=flannel" in namespace "kube-flannel" ...
helpers_test.go:344: "kube-flannel-ds-cskkw" [80948872-4e99-4e83-b634-53a05efe6b92] Running
net_test.go:120: (dbg) TestNetworkPlugins/group/flannel/ControllerPod: app=flannel healthy within 6.005053571s
--- PASS: TestNetworkPlugins/group/flannel/ControllerPod (6.01s)

                                                
                                    
x
+
TestNetworkPlugins/group/flannel/KubeletFlags (0.38s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/flannel/KubeletFlags
net_test.go:133: (dbg) Run:  out/minikube-linux-arm64 ssh -p flannel-150947 "pgrep -a kubelet"
I0924 01:55:56.149133 1873600 config.go:182] Loaded profile config "flannel-150947": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.31.1
--- PASS: TestNetworkPlugins/group/flannel/KubeletFlags (0.38s)

                                                
                                    
x
+
TestNetworkPlugins/group/flannel/NetCatPod (11.32s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/flannel/NetCatPod
net_test.go:149: (dbg) Run:  kubectl --context flannel-150947 replace --force -f testdata/netcat-deployment.yaml
net_test.go:163: (dbg) TestNetworkPlugins/group/flannel/NetCatPod: waiting 15m0s for pods matching "app=netcat" in namespace "default" ...
helpers_test.go:344: "netcat-6fc964789b-nhggh" [6f55bec4-03dd-426a-8d73-b6aa224d9eb5] Pending / Ready:ContainersNotReady (containers with unready status: [dnsutils]) / ContainersReady:ContainersNotReady (containers with unready status: [dnsutils])
helpers_test.go:344: "netcat-6fc964789b-nhggh" [6f55bec4-03dd-426a-8d73-b6aa224d9eb5] Running
net_test.go:163: (dbg) TestNetworkPlugins/group/flannel/NetCatPod: app=netcat healthy within 11.00523764s
--- PASS: TestNetworkPlugins/group/flannel/NetCatPod (11.32s)

                                                
                                    
x
+
TestNetworkPlugins/group/flannel/DNS (0.23s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/flannel/DNS
net_test.go:175: (dbg) Run:  kubectl --context flannel-150947 exec deployment/netcat -- nslookup kubernetes.default
--- PASS: TestNetworkPlugins/group/flannel/DNS (0.23s)

                                                
                                    
x
+
TestNetworkPlugins/group/flannel/Localhost (0.17s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/flannel/Localhost
net_test.go:194: (dbg) Run:  kubectl --context flannel-150947 exec deployment/netcat -- /bin/sh -c "nc -w 5 -i 5 -z localhost 8080"
--- PASS: TestNetworkPlugins/group/flannel/Localhost (0.17s)

                                                
                                    
x
+
TestNetworkPlugins/group/flannel/HairPin (0.18s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/flannel/HairPin
net_test.go:264: (dbg) Run:  kubectl --context flannel-150947 exec deployment/netcat -- /bin/sh -c "nc -w 5 -i 5 -z netcat 8080"
--- PASS: TestNetworkPlugins/group/flannel/HairPin (0.18s)

                                                
                                    
x
+
TestNetworkPlugins/group/bridge/KubeletFlags (0.27s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/bridge/KubeletFlags
net_test.go:133: (dbg) Run:  out/minikube-linux-arm64 ssh -p bridge-150947 "pgrep -a kubelet"
I0924 01:57:07.205114 1873600 config.go:182] Loaded profile config "bridge-150947": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.31.1
--- PASS: TestNetworkPlugins/group/bridge/KubeletFlags (0.27s)

                                                
                                    
x
+
TestNetworkPlugins/group/bridge/NetCatPod (11.25s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/bridge/NetCatPod
net_test.go:149: (dbg) Run:  kubectl --context bridge-150947 replace --force -f testdata/netcat-deployment.yaml
net_test.go:163: (dbg) TestNetworkPlugins/group/bridge/NetCatPod: waiting 15m0s for pods matching "app=netcat" in namespace "default" ...
helpers_test.go:344: "netcat-6fc964789b-kwnml" [e8f66939-a422-4884-a286-9a917cda3c53] Pending / Ready:ContainersNotReady (containers with unready status: [dnsutils]) / ContainersReady:ContainersNotReady (containers with unready status: [dnsutils])
helpers_test.go:344: "netcat-6fc964789b-kwnml" [e8f66939-a422-4884-a286-9a917cda3c53] Running
E0924 01:57:15.332745 1873600 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /home/jenkins/minikube-integration/19696-1868219/.minikube/profiles/kindnet-150947/client.crt: no such file or directory" logger="UnhandledError"
net_test.go:163: (dbg) TestNetworkPlugins/group/bridge/NetCatPod: app=netcat healthy within 11.00423505s
--- PASS: TestNetworkPlugins/group/bridge/NetCatPod (11.25s)

                                                
                                    
x
+
TestNetworkPlugins/group/bridge/DNS (0.16s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/bridge/DNS
net_test.go:175: (dbg) Run:  kubectl --context bridge-150947 exec deployment/netcat -- nslookup kubernetes.default
--- PASS: TestNetworkPlugins/group/bridge/DNS (0.16s)

                                                
                                    
x
+
TestNetworkPlugins/group/bridge/Localhost (0.14s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/bridge/Localhost
net_test.go:194: (dbg) Run:  kubectl --context bridge-150947 exec deployment/netcat -- /bin/sh -c "nc -w 5 -i 5 -z localhost 8080"
--- PASS: TestNetworkPlugins/group/bridge/Localhost (0.14s)

                                                
                                    
x
+
TestNetworkPlugins/group/bridge/HairPin (0.15s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/bridge/HairPin
net_test.go:264: (dbg) Run:  kubectl --context bridge-150947 exec deployment/netcat -- /bin/sh -c "nc -w 5 -i 5 -z netcat 8080"
--- PASS: TestNetworkPlugins/group/bridge/HairPin (0.15s)

                                                
                                    

Test skip (29/327)

x
+
TestDownloadOnly/v1.20.0/cached-images (0s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.20.0/cached-images
aaa_download_only_test.go:129: Preload exists, images won't be cached
--- SKIP: TestDownloadOnly/v1.20.0/cached-images (0.00s)

                                                
                                    
x
+
TestDownloadOnly/v1.20.0/binaries (0s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.20.0/binaries
aaa_download_only_test.go:151: Preload exists, binaries are present within.
--- SKIP: TestDownloadOnly/v1.20.0/binaries (0.00s)

                                                
                                    
x
+
TestDownloadOnly/v1.20.0/kubectl (0s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.20.0/kubectl
aaa_download_only_test.go:167: Test for darwin and windows
--- SKIP: TestDownloadOnly/v1.20.0/kubectl (0.00s)

                                                
                                    
x
+
TestDownloadOnly/v1.31.1/cached-images (0s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.31.1/cached-images
aaa_download_only_test.go:129: Preload exists, images won't be cached
--- SKIP: TestDownloadOnly/v1.31.1/cached-images (0.00s)

                                                
                                    
x
+
TestDownloadOnly/v1.31.1/binaries (0s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.31.1/binaries
aaa_download_only_test.go:151: Preload exists, binaries are present within.
--- SKIP: TestDownloadOnly/v1.31.1/binaries (0.00s)

                                                
                                    
x
+
TestDownloadOnly/v1.31.1/kubectl (0s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.31.1/kubectl
aaa_download_only_test.go:167: Test for darwin and windows
--- SKIP: TestDownloadOnly/v1.31.1/kubectl (0.00s)

                                                
                                    
x
+
TestDownloadOnlyKic (0.56s)

                                                
                                                
=== RUN   TestDownloadOnlyKic
aaa_download_only_test.go:232: (dbg) Run:  out/minikube-linux-arm64 start --download-only -p download-docker-626931 --alsologtostderr --driver=docker  --container-runtime=crio
aaa_download_only_test.go:244: Skip for arm64 platform. See https://github.com/kubernetes/minikube/issues/10144
helpers_test.go:175: Cleaning up "download-docker-626931" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-arm64 delete -p download-docker-626931
--- SKIP: TestDownloadOnlyKic (0.56s)

                                                
                                    
x
+
TestOffline (0s)

                                                
                                                
=== RUN   TestOffline
=== PAUSE TestOffline

                                                
                                                

                                                
                                                
=== CONT  TestOffline
aab_offline_test.go:35: skipping TestOffline - only docker runtime supported on arm64. See https://github.com/kubernetes/minikube/issues/10144
--- SKIP: TestOffline (0.00s)

                                                
                                    
x
+
TestAddons/serial/Volcano (0s)

                                                
                                                
=== RUN   TestAddons/serial/Volcano
addons_test.go:817: skipping: crio not supported
--- SKIP: TestAddons/serial/Volcano (0.00s)

                                                
                                    
x
+
TestAddons/parallel/Olm (0s)

                                                
                                                
=== RUN   TestAddons/parallel/Olm
=== PAUSE TestAddons/parallel/Olm

                                                
                                                

                                                
                                                
=== CONT  TestAddons/parallel/Olm
addons_test.go:438: Skipping OLM addon test until https://github.com/operator-framework/operator-lifecycle-manager/issues/2534 is resolved
--- SKIP: TestAddons/parallel/Olm (0.00s)

                                                
                                    
x
+
TestDockerFlags (0s)

                                                
                                                
=== RUN   TestDockerFlags
docker_test.go:41: skipping: only runs with docker container runtime, currently testing crio
--- SKIP: TestDockerFlags (0.00s)

                                                
                                    
x
+
TestDockerEnvContainerd (0s)

                                                
                                                
=== RUN   TestDockerEnvContainerd
docker_test.go:170: running with crio true linux arm64
docker_test.go:172: skipping: TestDockerEnvContainerd can only be run with the containerd runtime on Docker driver
--- SKIP: TestDockerEnvContainerd (0.00s)

                                                
                                    
x
+
TestKVMDriverInstallOrUpdate (0s)

                                                
                                                
=== RUN   TestKVMDriverInstallOrUpdate
driver_install_or_update_test.go:45: Skip if arm64. See https://github.com/kubernetes/minikube/issues/10144
--- SKIP: TestKVMDriverInstallOrUpdate (0.00s)

                                                
                                    
x
+
TestHyperKitDriverInstallOrUpdate (0s)

                                                
                                                
=== RUN   TestHyperKitDriverInstallOrUpdate
driver_install_or_update_test.go:105: Skip if not darwin.
--- SKIP: TestHyperKitDriverInstallOrUpdate (0.00s)

                                                
                                    
x
+
TestHyperkitDriverSkipUpgrade (0s)

                                                
                                                
=== RUN   TestHyperkitDriverSkipUpgrade
driver_install_or_update_test.go:169: Skip if not darwin.
--- SKIP: TestHyperkitDriverSkipUpgrade (0.00s)

                                                
                                    
x
+
TestFunctional/parallel/MySQL (0s)

                                                
                                                
=== RUN   TestFunctional/parallel/MySQL
=== PAUSE TestFunctional/parallel/MySQL

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/MySQL
functional_test.go:1787: arm64 is not supported by mysql. Skip the test. See https://github.com/kubernetes/minikube/issues/10144
--- SKIP: TestFunctional/parallel/MySQL (0.00s)

                                                
                                    
x
+
TestFunctional/parallel/DockerEnv (0s)

                                                
                                                
=== RUN   TestFunctional/parallel/DockerEnv
=== PAUSE TestFunctional/parallel/DockerEnv

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/DockerEnv
functional_test.go:463: only validate docker env with docker container runtime, currently testing crio
--- SKIP: TestFunctional/parallel/DockerEnv (0.00s)

                                                
                                    
x
+
TestFunctional/parallel/PodmanEnv (0s)

                                                
                                                
=== RUN   TestFunctional/parallel/PodmanEnv
=== PAUSE TestFunctional/parallel/PodmanEnv

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/PodmanEnv
functional_test.go:550: only validate podman env with docker container runtime, currently testing crio
--- SKIP: TestFunctional/parallel/PodmanEnv (0.00s)

                                                
                                    
x
+
TestFunctional/parallel/TunnelCmd/serial/DNSResolutionByDig (0s)

                                                
                                                
=== RUN   TestFunctional/parallel/TunnelCmd/serial/DNSResolutionByDig
functional_test_tunnel_test.go:99: DNS forwarding is only supported for Hyperkit on Darwin, skipping test DNS forwarding
--- SKIP: TestFunctional/parallel/TunnelCmd/serial/DNSResolutionByDig (0.00s)

                                                
                                    
x
+
TestFunctional/parallel/TunnelCmd/serial/DNSResolutionByDscacheutil (0s)

                                                
                                                
=== RUN   TestFunctional/parallel/TunnelCmd/serial/DNSResolutionByDscacheutil
functional_test_tunnel_test.go:99: DNS forwarding is only supported for Hyperkit on Darwin, skipping test DNS forwarding
--- SKIP: TestFunctional/parallel/TunnelCmd/serial/DNSResolutionByDscacheutil (0.00s)

                                                
                                    
x
+
TestFunctional/parallel/TunnelCmd/serial/AccessThroughDNS (0s)

                                                
                                                
=== RUN   TestFunctional/parallel/TunnelCmd/serial/AccessThroughDNS
functional_test_tunnel_test.go:99: DNS forwarding is only supported for Hyperkit on Darwin, skipping test DNS forwarding
--- SKIP: TestFunctional/parallel/TunnelCmd/serial/AccessThroughDNS (0.00s)

                                                
                                    
x
+
TestGvisorAddon (0s)

                                                
                                                
=== RUN   TestGvisorAddon
gvisor_addon_test.go:34: skipping test because --gvisor=false
--- SKIP: TestGvisorAddon (0.00s)

                                                
                                    
x
+
TestImageBuild (0s)

                                                
                                                
=== RUN   TestImageBuild
image_test.go:33: 
--- SKIP: TestImageBuild (0.00s)

                                                
                                    
x
+
TestChangeNoneUser (0s)

                                                
                                                
=== RUN   TestChangeNoneUser
none_test.go:38: Test requires none driver and SUDO_USER env to not be empty
--- SKIP: TestChangeNoneUser (0.00s)

                                                
                                    
x
+
TestScheduledStopWindows (0s)

                                                
                                                
=== RUN   TestScheduledStopWindows
scheduled_stop_test.go:42: test only runs on windows
--- SKIP: TestScheduledStopWindows (0.00s)

                                                
                                    
x
+
TestSkaffold (0s)

                                                
                                                
=== RUN   TestSkaffold
skaffold_test.go:45: skaffold requires docker-env, currently testing crio container runtime
--- SKIP: TestSkaffold (0.00s)

                                                
                                    
x
+
TestStartStop/group/disable-driver-mounts (0.15s)

                                                
                                                
=== RUN   TestStartStop/group/disable-driver-mounts
=== PAUSE TestStartStop/group/disable-driver-mounts

                                                
                                                

                                                
                                                
=== CONT  TestStartStop/group/disable-driver-mounts
start_stop_delete_test.go:103: skipping TestStartStop/group/disable-driver-mounts - only runs on virtualbox
helpers_test.go:175: Cleaning up "disable-driver-mounts-505990" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-arm64 delete -p disable-driver-mounts-505990
--- SKIP: TestStartStop/group/disable-driver-mounts (0.15s)

                                                
                                    
x
+
TestNetworkPlugins/group/kubenet (5.09s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/kubenet
net_test.go:93: Skipping the test as crio container runtimes requires CNI
panic.go:629: 
----------------------- debugLogs start: kubenet-150947 [pass: true] --------------------------------
>>> netcat: nslookup kubernetes.default:
Error in configuration: context was not found for specified context: kubenet-150947

                                                
                                                

                                                
                                                
>>> netcat: nslookup debug kubernetes.default a-records:
Error in configuration: context was not found for specified context: kubenet-150947

                                                
                                                

                                                
                                                
>>> netcat: dig search kubernetes.default:
Error in configuration: context was not found for specified context: kubenet-150947

                                                
                                                

                                                
                                                
>>> netcat: dig @10.96.0.10 kubernetes.default.svc.cluster.local udp/53:
Error in configuration: context was not found for specified context: kubenet-150947

                                                
                                                

                                                
                                                
>>> netcat: dig @10.96.0.10 kubernetes.default.svc.cluster.local tcp/53:
Error in configuration: context was not found for specified context: kubenet-150947

                                                
                                                

                                                
                                                
>>> netcat: nc 10.96.0.10 udp/53:
Error in configuration: context was not found for specified context: kubenet-150947

                                                
                                                

                                                
                                                
>>> netcat: nc 10.96.0.10 tcp/53:
Error in configuration: context was not found for specified context: kubenet-150947

                                                
                                                

                                                
                                                
>>> netcat: /etc/nsswitch.conf:
Error in configuration: context was not found for specified context: kubenet-150947

                                                
                                                

                                                
                                                
>>> netcat: /etc/hosts:
Error in configuration: context was not found for specified context: kubenet-150947

                                                
                                                

                                                
                                                
>>> netcat: /etc/resolv.conf:
Error in configuration: context was not found for specified context: kubenet-150947

                                                
                                                

                                                
                                                
>>> host: /etc/nsswitch.conf:
* Profile "kubenet-150947" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-150947"

                                                
                                                

                                                
                                                
>>> host: /etc/hosts:
* Profile "kubenet-150947" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-150947"

                                                
                                                

                                                
                                                
>>> host: /etc/resolv.conf:
* Profile "kubenet-150947" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-150947"

                                                
                                                

                                                
                                                
>>> k8s: nodes, services, endpoints, daemon sets, deployments and pods, :
Error in configuration: context was not found for specified context: kubenet-150947

                                                
                                                

                                                
                                                
>>> host: crictl pods:
* Profile "kubenet-150947" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-150947"

                                                
                                                

                                                
                                                
>>> host: crictl containers:
* Profile "kubenet-150947" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-150947"

                                                
                                                

                                                
                                                
>>> k8s: describe netcat deployment:
error: context "kubenet-150947" does not exist

                                                
                                                

                                                
                                                
>>> k8s: describe netcat pod(s):
error: context "kubenet-150947" does not exist

                                                
                                                

                                                
                                                
>>> k8s: netcat logs:
error: context "kubenet-150947" does not exist

                                                
                                                

                                                
                                                
>>> k8s: describe coredns deployment:
error: context "kubenet-150947" does not exist

                                                
                                                

                                                
                                                
>>> k8s: describe coredns pods:
error: context "kubenet-150947" does not exist

                                                
                                                

                                                
                                                
>>> k8s: coredns logs:
error: context "kubenet-150947" does not exist

                                                
                                                

                                                
                                                
>>> k8s: describe api server pod(s):
error: context "kubenet-150947" does not exist

                                                
                                                

                                                
                                                
>>> k8s: api server logs:
error: context "kubenet-150947" does not exist

                                                
                                                

                                                
                                                
>>> host: /etc/cni:
* Profile "kubenet-150947" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-150947"

                                                
                                                

                                                
                                                
>>> host: ip a s:
* Profile "kubenet-150947" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-150947"

                                                
                                                

                                                
                                                
>>> host: ip r s:
* Profile "kubenet-150947" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-150947"

                                                
                                                

                                                
                                                
>>> host: iptables-save:
* Profile "kubenet-150947" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-150947"

                                                
                                                

                                                
                                                
>>> host: iptables table nat:
* Profile "kubenet-150947" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-150947"

                                                
                                                

                                                
                                                
>>> k8s: describe kube-proxy daemon set:
error: context "kubenet-150947" does not exist

                                                
                                                

                                                
                                                
>>> k8s: describe kube-proxy pod(s):
error: context "kubenet-150947" does not exist

                                                
                                                

                                                
                                                
>>> k8s: kube-proxy logs:
error: context "kubenet-150947" does not exist

                                                
                                                

                                                
                                                
>>> host: kubelet daemon status:
* Profile "kubenet-150947" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-150947"

                                                
                                                

                                                
                                                
>>> host: kubelet daemon config:
* Profile "kubenet-150947" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-150947"

                                                
                                                

                                                
                                                
>>> k8s: kubelet logs:
* Profile "kubenet-150947" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-150947"

                                                
                                                

                                                
                                                
>>> host: /etc/kubernetes/kubelet.conf:
* Profile "kubenet-150947" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-150947"

                                                
                                                

                                                
                                                
>>> host: /var/lib/kubelet/config.yaml:
* Profile "kubenet-150947" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-150947"

                                                
                                                

                                                
                                                
>>> k8s: kubectl config:
apiVersion: v1
clusters:
- cluster:
certificate-authority: /home/jenkins/minikube-integration/19696-1868219/.minikube/ca.crt
extensions:
- extension:
last-update: Tue, 24 Sep 2024 01:34:38 UTC
provider: minikube.sigs.k8s.io
version: v1.34.0
name: cluster_info
server: https://192.168.76.2:8443
name: kubernetes-upgrade-156319
contexts:
- context:
cluster: kubernetes-upgrade-156319
extensions:
- extension:
last-update: Tue, 24 Sep 2024 01:34:38 UTC
provider: minikube.sigs.k8s.io
version: v1.34.0
name: context_info
namespace: default
user: kubernetes-upgrade-156319
name: kubernetes-upgrade-156319
current-context: kubernetes-upgrade-156319
kind: Config
preferences: {}
users:
- name: kubernetes-upgrade-156319
user:
client-certificate: /home/jenkins/minikube-integration/19696-1868219/.minikube/profiles/kubernetes-upgrade-156319/client.crt
client-key: /home/jenkins/minikube-integration/19696-1868219/.minikube/profiles/kubernetes-upgrade-156319/client.key

                                                
                                                

                                                
                                                
>>> k8s: cms:
Error in configuration: context was not found for specified context: kubenet-150947

                                                
                                                

                                                
                                                
>>> host: docker daemon status:
* Profile "kubenet-150947" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-150947"

                                                
                                                

                                                
                                                
>>> host: docker daemon config:
* Profile "kubenet-150947" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-150947"

                                                
                                                

                                                
                                                
>>> host: /etc/docker/daemon.json:
* Profile "kubenet-150947" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-150947"

                                                
                                                

                                                
                                                
>>> host: docker system info:
* Profile "kubenet-150947" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-150947"

                                                
                                                

                                                
                                                
>>> host: cri-docker daemon status:
* Profile "kubenet-150947" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-150947"

                                                
                                                

                                                
                                                
>>> host: cri-docker daemon config:
* Profile "kubenet-150947" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-150947"

                                                
                                                

                                                
                                                
>>> host: /etc/systemd/system/cri-docker.service.d/10-cni.conf:
* Profile "kubenet-150947" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-150947"

                                                
                                                

                                                
                                                
>>> host: /usr/lib/systemd/system/cri-docker.service:
* Profile "kubenet-150947" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-150947"

                                                
                                                

                                                
                                                
>>> host: cri-dockerd version:
* Profile "kubenet-150947" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-150947"

                                                
                                                

                                                
                                                
>>> host: containerd daemon status:
* Profile "kubenet-150947" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-150947"

                                                
                                                

                                                
                                                
>>> host: containerd daemon config:
* Profile "kubenet-150947" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-150947"

                                                
                                                

                                                
                                                
>>> host: /lib/systemd/system/containerd.service:
* Profile "kubenet-150947" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-150947"

                                                
                                                

                                                
                                                
>>> host: /etc/containerd/config.toml:
* Profile "kubenet-150947" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-150947"

                                                
                                                

                                                
                                                
>>> host: containerd config dump:
* Profile "kubenet-150947" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-150947"

                                                
                                                

                                                
                                                
>>> host: crio daemon status:
* Profile "kubenet-150947" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-150947"

                                                
                                                

                                                
                                                
>>> host: crio daemon config:
* Profile "kubenet-150947" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-150947"

                                                
                                                

                                                
                                                
>>> host: /etc/crio:
* Profile "kubenet-150947" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-150947"

                                                
                                                

                                                
                                                
>>> host: crio config:
* Profile "kubenet-150947" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-150947"

                                                
                                                
----------------------- debugLogs end: kubenet-150947 [took: 4.923396886s] --------------------------------
helpers_test.go:175: Cleaning up "kubenet-150947" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-arm64 delete -p kubenet-150947
--- SKIP: TestNetworkPlugins/group/kubenet (5.09s)

                                                
                                    
x
+
TestNetworkPlugins/group/cilium (3.78s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/cilium
net_test.go:102: Skipping the test as it's interfering with other tests and is outdated
panic.go:629: 
----------------------- debugLogs start: cilium-150947 [pass: true] --------------------------------
>>> netcat: nslookup kubernetes.default:
Error in configuration: context was not found for specified context: cilium-150947

                                                
                                                

                                                
                                                
>>> netcat: nslookup debug kubernetes.default a-records:
Error in configuration: context was not found for specified context: cilium-150947

                                                
                                                

                                                
                                                
>>> netcat: dig search kubernetes.default:
Error in configuration: context was not found for specified context: cilium-150947

                                                
                                                

                                                
                                                
>>> netcat: dig @10.96.0.10 kubernetes.default.svc.cluster.local udp/53:
Error in configuration: context was not found for specified context: cilium-150947

                                                
                                                

                                                
                                                
>>> netcat: dig @10.96.0.10 kubernetes.default.svc.cluster.local tcp/53:
Error in configuration: context was not found for specified context: cilium-150947

                                                
                                                

                                                
                                                
>>> netcat: nc 10.96.0.10 udp/53:
Error in configuration: context was not found for specified context: cilium-150947

                                                
                                                

                                                
                                                
>>> netcat: nc 10.96.0.10 tcp/53:
Error in configuration: context was not found for specified context: cilium-150947

                                                
                                                

                                                
                                                
>>> netcat: /etc/nsswitch.conf:
Error in configuration: context was not found for specified context: cilium-150947

                                                
                                                

                                                
                                                
>>> netcat: /etc/hosts:
Error in configuration: context was not found for specified context: cilium-150947

                                                
                                                

                                                
                                                
>>> netcat: /etc/resolv.conf:
Error in configuration: context was not found for specified context: cilium-150947

                                                
                                                

                                                
                                                
>>> host: /etc/nsswitch.conf:
* Profile "cilium-150947" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-150947"

                                                
                                                

                                                
                                                
>>> host: /etc/hosts:
* Profile "cilium-150947" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-150947"

                                                
                                                

                                                
                                                
>>> host: /etc/resolv.conf:
* Profile "cilium-150947" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-150947"

                                                
                                                

                                                
                                                
>>> k8s: nodes, services, endpoints, daemon sets, deployments and pods, :
Error in configuration: context was not found for specified context: cilium-150947

                                                
                                                

                                                
                                                
>>> host: crictl pods:
* Profile "cilium-150947" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-150947"

                                                
                                                

                                                
                                                
>>> host: crictl containers:
* Profile "cilium-150947" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-150947"

                                                
                                                

                                                
                                                
>>> k8s: describe netcat deployment:
error: context "cilium-150947" does not exist

                                                
                                                

                                                
                                                
>>> k8s: describe netcat pod(s):
error: context "cilium-150947" does not exist

                                                
                                                

                                                
                                                
>>> k8s: netcat logs:
error: context "cilium-150947" does not exist

                                                
                                                

                                                
                                                
>>> k8s: describe coredns deployment:
error: context "cilium-150947" does not exist

                                                
                                                

                                                
                                                
>>> k8s: describe coredns pods:
error: context "cilium-150947" does not exist

                                                
                                                

                                                
                                                
>>> k8s: coredns logs:
error: context "cilium-150947" does not exist

                                                
                                                

                                                
                                                
>>> k8s: describe api server pod(s):
error: context "cilium-150947" does not exist

                                                
                                                

                                                
                                                
>>> k8s: api server logs:
error: context "cilium-150947" does not exist

                                                
                                                

                                                
                                                
>>> host: /etc/cni:
* Profile "cilium-150947" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-150947"

                                                
                                                

                                                
                                                
>>> host: ip a s:
* Profile "cilium-150947" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-150947"

                                                
                                                

                                                
                                                
>>> host: ip r s:
* Profile "cilium-150947" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-150947"

                                                
                                                

                                                
                                                
>>> host: iptables-save:
* Profile "cilium-150947" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-150947"

                                                
                                                

                                                
                                                
>>> host: iptables table nat:
* Profile "cilium-150947" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-150947"

                                                
                                                

                                                
                                                
>>> k8s: describe cilium daemon set:
Error in configuration: context was not found for specified context: cilium-150947

                                                
                                                

                                                
                                                
>>> k8s: describe cilium daemon set pod(s):
Error in configuration: context was not found for specified context: cilium-150947

                                                
                                                

                                                
                                                
>>> k8s: cilium daemon set container(s) logs (current):
error: context "cilium-150947" does not exist

                                                
                                                

                                                
                                                
>>> k8s: cilium daemon set container(s) logs (previous):
error: context "cilium-150947" does not exist

                                                
                                                

                                                
                                                
>>> k8s: describe cilium deployment:
Error in configuration: context was not found for specified context: cilium-150947

                                                
                                                

                                                
                                                
>>> k8s: describe cilium deployment pod(s):
Error in configuration: context was not found for specified context: cilium-150947

                                                
                                                

                                                
                                                
>>> k8s: cilium deployment container(s) logs (current):
error: context "cilium-150947" does not exist

                                                
                                                

                                                
                                                
>>> k8s: cilium deployment container(s) logs (previous):
error: context "cilium-150947" does not exist

                                                
                                                

                                                
                                                
>>> k8s: describe kube-proxy daemon set:
error: context "cilium-150947" does not exist

                                                
                                                

                                                
                                                
>>> k8s: describe kube-proxy pod(s):
error: context "cilium-150947" does not exist

                                                
                                                

                                                
                                                
>>> k8s: kube-proxy logs:
error: context "cilium-150947" does not exist

                                                
                                                

                                                
                                                
>>> host: kubelet daemon status:
* Profile "cilium-150947" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-150947"

                                                
                                                

                                                
                                                
>>> host: kubelet daemon config:
* Profile "cilium-150947" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-150947"

                                                
                                                

                                                
                                                
>>> k8s: kubelet logs:
* Profile "cilium-150947" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-150947"

                                                
                                                

                                                
                                                
>>> host: /etc/kubernetes/kubelet.conf:
* Profile "cilium-150947" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-150947"

                                                
                                                

                                                
                                                
>>> host: /var/lib/kubelet/config.yaml:
* Profile "cilium-150947" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-150947"

                                                
                                                

                                                
                                                
>>> k8s: kubectl config:
apiVersion: v1
clusters:
- cluster:
certificate-authority: /home/jenkins/minikube-integration/19696-1868219/.minikube/ca.crt
extensions:
- extension:
last-update: Tue, 24 Sep 2024 01:34:46 UTC
provider: minikube.sigs.k8s.io
version: v1.34.0
name: cluster_info
server: https://192.168.76.2:8443
name: kubernetes-upgrade-156319
contexts:
- context:
cluster: kubernetes-upgrade-156319
extensions:
- extension:
last-update: Tue, 24 Sep 2024 01:34:46 UTC
provider: minikube.sigs.k8s.io
version: v1.34.0
name: context_info
namespace: default
user: kubernetes-upgrade-156319
name: kubernetes-upgrade-156319
current-context: kubernetes-upgrade-156319
kind: Config
preferences: {}
users:
- name: kubernetes-upgrade-156319
user:
client-certificate: /home/jenkins/minikube-integration/19696-1868219/.minikube/profiles/kubernetes-upgrade-156319/client.crt
client-key: /home/jenkins/minikube-integration/19696-1868219/.minikube/profiles/kubernetes-upgrade-156319/client.key

                                                
                                                

                                                
                                                
>>> k8s: cms:
Error in configuration: context was not found for specified context: cilium-150947

                                                
                                                

                                                
                                                
>>> host: docker daemon status:
* Profile "cilium-150947" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-150947"

                                                
                                                

                                                
                                                
>>> host: docker daemon config:
* Profile "cilium-150947" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-150947"

                                                
                                                

                                                
                                                
>>> host: /etc/docker/daemon.json:
* Profile "cilium-150947" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-150947"

                                                
                                                

                                                
                                                
>>> host: docker system info:
* Profile "cilium-150947" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-150947"

                                                
                                                

                                                
                                                
>>> host: cri-docker daemon status:
* Profile "cilium-150947" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-150947"

                                                
                                                

                                                
                                                
>>> host: cri-docker daemon config:
* Profile "cilium-150947" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-150947"

                                                
                                                

                                                
                                                
>>> host: /etc/systemd/system/cri-docker.service.d/10-cni.conf:
* Profile "cilium-150947" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-150947"

                                                
                                                

                                                
                                                
>>> host: /usr/lib/systemd/system/cri-docker.service:
* Profile "cilium-150947" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-150947"

                                                
                                                

                                                
                                                
>>> host: cri-dockerd version:
* Profile "cilium-150947" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-150947"

                                                
                                                

                                                
                                                
>>> host: containerd daemon status:
* Profile "cilium-150947" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-150947"

                                                
                                                

                                                
                                                
>>> host: containerd daemon config:
* Profile "cilium-150947" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-150947"

                                                
                                                

                                                
                                                
>>> host: /lib/systemd/system/containerd.service:
* Profile "cilium-150947" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-150947"

                                                
                                                

                                                
                                                
>>> host: /etc/containerd/config.toml:
* Profile "cilium-150947" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-150947"

                                                
                                                

                                                
                                                
>>> host: containerd config dump:
* Profile "cilium-150947" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-150947"

                                                
                                                

                                                
                                                
>>> host: crio daemon status:
* Profile "cilium-150947" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-150947"

                                                
                                                

                                                
                                                
>>> host: crio daemon config:
* Profile "cilium-150947" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-150947"

                                                
                                                

                                                
                                                
>>> host: /etc/crio:
* Profile "cilium-150947" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-150947"

                                                
                                                

                                                
                                                
>>> host: crio config:
* Profile "cilium-150947" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-150947"

                                                
                                                
----------------------- debugLogs end: cilium-150947 [took: 3.62630248s] --------------------------------
helpers_test.go:175: Cleaning up "cilium-150947" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-arm64 delete -p cilium-150947
--- SKIP: TestNetworkPlugins/group/cilium (3.78s)

                                                
                                    
Copied to clipboard