Test Report: Docker_Linux_crio_arm64 19313

                    
                      761b7fc65973460b6ca8311b028efa5f69b15d0b:2024-07-22:35453
                    
                

Test fail (3/336)

Order failed test Duration
39 TestAddons/parallel/Ingress 152.45
41 TestAddons/parallel/MetricsServer 353.93
316 TestStartStop/group/old-k8s-version/serial/SecondStart 374.83
x
+
TestAddons/parallel/Ingress (152.45s)

                                                
                                                
=== RUN   TestAddons/parallel/Ingress
=== PAUSE TestAddons/parallel/Ingress

                                                
                                                

                                                
                                                
=== CONT  TestAddons/parallel/Ingress
addons_test.go:209: (dbg) Run:  kubectl --context addons-578168 wait --for=condition=ready --namespace=ingress-nginx pod --selector=app.kubernetes.io/component=controller --timeout=90s
addons_test.go:234: (dbg) Run:  kubectl --context addons-578168 replace --force -f testdata/nginx-ingress-v1.yaml
addons_test.go:247: (dbg) Run:  kubectl --context addons-578168 replace --force -f testdata/nginx-pod-svc.yaml
addons_test.go:252: (dbg) TestAddons/parallel/Ingress: waiting 8m0s for pods matching "run=nginx" in namespace "default" ...
helpers_test.go:344: "nginx" [3184fe0a-97d6-41e2-81e9-cb9858182f39] Pending / Ready:ContainersNotReady (containers with unready status: [nginx]) / ContainersReady:ContainersNotReady (containers with unready status: [nginx])
helpers_test.go:344: "nginx" [3184fe0a-97d6-41e2-81e9-cb9858182f39] Running
addons_test.go:252: (dbg) TestAddons/parallel/Ingress: run=nginx healthy within 10.003275876s
addons_test.go:264: (dbg) Run:  out/minikube-linux-arm64 -p addons-578168 ssh "curl -s http://127.0.0.1/ -H 'Host: nginx.example.com'"
addons_test.go:264: (dbg) Non-zero exit: out/minikube-linux-arm64 -p addons-578168 ssh "curl -s http://127.0.0.1/ -H 'Host: nginx.example.com'": exit status 1 (2m9.6586442s)

                                                
                                                
** stderr ** 
	ssh: Process exited with status 28

                                                
                                                
** /stderr **
addons_test.go:280: failed to get expected response from http://127.0.0.1/ within minikube: exit status 1
addons_test.go:288: (dbg) Run:  kubectl --context addons-578168 replace --force -f testdata/ingress-dns-example-v1.yaml
addons_test.go:293: (dbg) Run:  out/minikube-linux-arm64 -p addons-578168 ip
addons_test.go:299: (dbg) Run:  nslookup hello-john.test 192.168.49.2
addons_test.go:308: (dbg) Run:  out/minikube-linux-arm64 -p addons-578168 addons disable ingress-dns --alsologtostderr -v=1
addons_test.go:308: (dbg) Done: out/minikube-linux-arm64 -p addons-578168 addons disable ingress-dns --alsologtostderr -v=1: (1.230288978s)
addons_test.go:313: (dbg) Run:  out/minikube-linux-arm64 -p addons-578168 addons disable ingress --alsologtostderr -v=1
addons_test.go:313: (dbg) Done: out/minikube-linux-arm64 -p addons-578168 addons disable ingress --alsologtostderr -v=1: (7.715307895s)
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:230: ======>  post-mortem[TestAddons/parallel/Ingress]: docker inspect <======
helpers_test.go:231: (dbg) Run:  docker inspect addons-578168
helpers_test.go:235: (dbg) docker inspect addons-578168:

                                                
                                                
-- stdout --
	[
	    {
	        "Id": "40bf57728062d55da8ed4ca764cac539ef1f3f90f65fc96f5a1b1ff997a2ffc0",
	        "Created": "2024-07-22T10:30:51.267539624Z",
	        "Path": "/usr/local/bin/entrypoint",
	        "Args": [
	            "/sbin/init"
	        ],
	        "State": {
	            "Status": "running",
	            "Running": true,
	            "Paused": false,
	            "Restarting": false,
	            "OOMKilled": false,
	            "Dead": false,
	            "Pid": 9081,
	            "ExitCode": 0,
	            "Error": "",
	            "StartedAt": "2024-07-22T10:30:51.414530689Z",
	            "FinishedAt": "0001-01-01T00:00:00Z"
	        },
	        "Image": "sha256:e2c91a2178aa1acdb3eade350c62303b0cf135b362b91c6aa21cd060c2dbfcac",
	        "ResolvConfPath": "/var/lib/docker/containers/40bf57728062d55da8ed4ca764cac539ef1f3f90f65fc96f5a1b1ff997a2ffc0/resolv.conf",
	        "HostnamePath": "/var/lib/docker/containers/40bf57728062d55da8ed4ca764cac539ef1f3f90f65fc96f5a1b1ff997a2ffc0/hostname",
	        "HostsPath": "/var/lib/docker/containers/40bf57728062d55da8ed4ca764cac539ef1f3f90f65fc96f5a1b1ff997a2ffc0/hosts",
	        "LogPath": "/var/lib/docker/containers/40bf57728062d55da8ed4ca764cac539ef1f3f90f65fc96f5a1b1ff997a2ffc0/40bf57728062d55da8ed4ca764cac539ef1f3f90f65fc96f5a1b1ff997a2ffc0-json.log",
	        "Name": "/addons-578168",
	        "RestartCount": 0,
	        "Driver": "overlay2",
	        "Platform": "linux",
	        "MountLabel": "",
	        "ProcessLabel": "",
	        "AppArmorProfile": "unconfined",
	        "ExecIDs": null,
	        "HostConfig": {
	            "Binds": [
	                "/lib/modules:/lib/modules:ro",
	                "addons-578168:/var"
	            ],
	            "ContainerIDFile": "",
	            "LogConfig": {
	                "Type": "json-file",
	                "Config": {}
	            },
	            "NetworkMode": "addons-578168",
	            "PortBindings": {
	                "22/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": ""
	                    }
	                ],
	                "2376/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": ""
	                    }
	                ],
	                "32443/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": ""
	                    }
	                ],
	                "5000/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": ""
	                    }
	                ],
	                "8443/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": ""
	                    }
	                ]
	            },
	            "RestartPolicy": {
	                "Name": "no",
	                "MaximumRetryCount": 0
	            },
	            "AutoRemove": false,
	            "VolumeDriver": "",
	            "VolumesFrom": null,
	            "ConsoleSize": [
	                0,
	                0
	            ],
	            "CapAdd": null,
	            "CapDrop": null,
	            "CgroupnsMode": "host",
	            "Dns": [],
	            "DnsOptions": [],
	            "DnsSearch": [],
	            "ExtraHosts": null,
	            "GroupAdd": null,
	            "IpcMode": "private",
	            "Cgroup": "",
	            "Links": null,
	            "OomScoreAdj": 0,
	            "PidMode": "",
	            "Privileged": true,
	            "PublishAllPorts": false,
	            "ReadonlyRootfs": false,
	            "SecurityOpt": [
	                "seccomp=unconfined",
	                "apparmor=unconfined",
	                "label=disable"
	            ],
	            "Tmpfs": {
	                "/run": "",
	                "/tmp": ""
	            },
	            "UTSMode": "",
	            "UsernsMode": "",
	            "ShmSize": 67108864,
	            "Runtime": "runc",
	            "Isolation": "",
	            "CpuShares": 0,
	            "Memory": 4194304000,
	            "NanoCpus": 2000000000,
	            "CgroupParent": "",
	            "BlkioWeight": 0,
	            "BlkioWeightDevice": [],
	            "BlkioDeviceReadBps": [],
	            "BlkioDeviceWriteBps": [],
	            "BlkioDeviceReadIOps": [],
	            "BlkioDeviceWriteIOps": [],
	            "CpuPeriod": 0,
	            "CpuQuota": 0,
	            "CpuRealtimePeriod": 0,
	            "CpuRealtimeRuntime": 0,
	            "CpusetCpus": "",
	            "CpusetMems": "",
	            "Devices": [],
	            "DeviceCgroupRules": null,
	            "DeviceRequests": null,
	            "MemoryReservation": 0,
	            "MemorySwap": 8388608000,
	            "MemorySwappiness": null,
	            "OomKillDisable": false,
	            "PidsLimit": null,
	            "Ulimits": [],
	            "CpuCount": 0,
	            "CpuPercent": 0,
	            "IOMaximumIOps": 0,
	            "IOMaximumBandwidth": 0,
	            "MaskedPaths": null,
	            "ReadonlyPaths": null
	        },
	        "GraphDriver": {
	            "Data": {
	                "LowerDir": "/var/lib/docker/overlay2/48f10ecf198ef9cf47dbfcf8b90201828b97572ce1398e1d17f0eb69f73a9a4c-init/diff:/var/lib/docker/overlay2/375eed0e332cee71fb41f23c3bebb2cf752289490317aab56b4bc0e86204dc16/diff",
	                "MergedDir": "/var/lib/docker/overlay2/48f10ecf198ef9cf47dbfcf8b90201828b97572ce1398e1d17f0eb69f73a9a4c/merged",
	                "UpperDir": "/var/lib/docker/overlay2/48f10ecf198ef9cf47dbfcf8b90201828b97572ce1398e1d17f0eb69f73a9a4c/diff",
	                "WorkDir": "/var/lib/docker/overlay2/48f10ecf198ef9cf47dbfcf8b90201828b97572ce1398e1d17f0eb69f73a9a4c/work"
	            },
	            "Name": "overlay2"
	        },
	        "Mounts": [
	            {
	                "Type": "bind",
	                "Source": "/lib/modules",
	                "Destination": "/lib/modules",
	                "Mode": "ro",
	                "RW": false,
	                "Propagation": "rprivate"
	            },
	            {
	                "Type": "volume",
	                "Name": "addons-578168",
	                "Source": "/var/lib/docker/volumes/addons-578168/_data",
	                "Destination": "/var",
	                "Driver": "local",
	                "Mode": "z",
	                "RW": true,
	                "Propagation": ""
	            }
	        ],
	        "Config": {
	            "Hostname": "addons-578168",
	            "Domainname": "",
	            "User": "",
	            "AttachStdin": false,
	            "AttachStdout": false,
	            "AttachStderr": false,
	            "ExposedPorts": {
	                "22/tcp": {},
	                "2376/tcp": {},
	                "32443/tcp": {},
	                "5000/tcp": {},
	                "8443/tcp": {}
	            },
	            "Tty": true,
	            "OpenStdin": false,
	            "StdinOnce": false,
	            "Env": [
	                "container=docker",
	                "PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin"
	            ],
	            "Cmd": null,
	            "Image": "gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721324606-19298@sha256:1c495b056df42bd3fd9a5c30d049e1802f9ed73a342611781f1ccc3c3853953f",
	            "Volumes": null,
	            "WorkingDir": "/",
	            "Entrypoint": [
	                "/usr/local/bin/entrypoint",
	                "/sbin/init"
	            ],
	            "OnBuild": null,
	            "Labels": {
	                "created_by.minikube.sigs.k8s.io": "true",
	                "mode.minikube.sigs.k8s.io": "addons-578168",
	                "name.minikube.sigs.k8s.io": "addons-578168",
	                "role.minikube.sigs.k8s.io": ""
	            },
	            "StopSignal": "SIGRTMIN+3"
	        },
	        "NetworkSettings": {
	            "Bridge": "",
	            "SandboxID": "04f9cbaa5854c7178efd3697ce48fae970941e26075b1c5824a16b821fd67eaf",
	            "SandboxKey": "/var/run/docker/netns/04f9cbaa5854",
	            "Ports": {
	                "22/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": "32768"
	                    }
	                ],
	                "2376/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": "32769"
	                    }
	                ],
	                "32443/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": "32772"
	                    }
	                ],
	                "5000/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": "32770"
	                    }
	                ],
	                "8443/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": "32771"
	                    }
	                ]
	            },
	            "HairpinMode": false,
	            "LinkLocalIPv6Address": "",
	            "LinkLocalIPv6PrefixLen": 0,
	            "SecondaryIPAddresses": null,
	            "SecondaryIPv6Addresses": null,
	            "EndpointID": "",
	            "Gateway": "",
	            "GlobalIPv6Address": "",
	            "GlobalIPv6PrefixLen": 0,
	            "IPAddress": "",
	            "IPPrefixLen": 0,
	            "IPv6Gateway": "",
	            "MacAddress": "",
	            "Networks": {
	                "addons-578168": {
	                    "IPAMConfig": {
	                        "IPv4Address": "192.168.49.2"
	                    },
	                    "Links": null,
	                    "Aliases": null,
	                    "MacAddress": "02:42:c0:a8:31:02",
	                    "DriverOpts": null,
	                    "NetworkID": "dfa62625aa072cff84687ae2020c802c4bb4741da8a3aa9bb82e88eaf74cdd14",
	                    "EndpointID": "ba3e15c0d4daeed295006ade44694678467285844a412dbfee0f77a6696f89a4",
	                    "Gateway": "192.168.49.1",
	                    "IPAddress": "192.168.49.2",
	                    "IPPrefixLen": 24,
	                    "IPv6Gateway": "",
	                    "GlobalIPv6Address": "",
	                    "GlobalIPv6PrefixLen": 0,
	                    "DNSNames": [
	                        "addons-578168",
	                        "40bf57728062"
	                    ]
	                }
	            }
	        }
	    }
	]

                                                
                                                
-- /stdout --
helpers_test.go:239: (dbg) Run:  out/minikube-linux-arm64 status --format={{.Host}} -p addons-578168 -n addons-578168
helpers_test.go:244: <<< TestAddons/parallel/Ingress FAILED: start of post-mortem logs <<<
helpers_test.go:245: ======>  post-mortem[TestAddons/parallel/Ingress]: minikube logs <======
helpers_test.go:247: (dbg) Run:  out/minikube-linux-arm64 -p addons-578168 logs -n 25
helpers_test.go:247: (dbg) Done: out/minikube-linux-arm64 -p addons-578168 logs -n 25: (1.431566182s)
helpers_test.go:252: TestAddons/parallel/Ingress logs: 
-- stdout --
	
	==> Audit <==
	|---------|---------------------------------------------------------------------------------------------|------------------------|---------|---------|---------------------|---------------------|
	| Command |                                            Args                                             |        Profile         |  User   | Version |     Start Time      |      End Time       |
	|---------|---------------------------------------------------------------------------------------------|------------------------|---------|---------|---------------------|---------------------|
	| delete  | -p download-only-121393                                                                     | download-only-121393   | jenkins | v1.33.1 | 22 Jul 24 10:30 UTC | 22 Jul 24 10:30 UTC |
	| delete  | -p download-only-465809                                                                     | download-only-465809   | jenkins | v1.33.1 | 22 Jul 24 10:30 UTC | 22 Jul 24 10:30 UTC |
	| delete  | -p download-only-516107                                                                     | download-only-516107   | jenkins | v1.33.1 | 22 Jul 24 10:30 UTC | 22 Jul 24 10:30 UTC |
	| delete  | -p download-only-121393                                                                     | download-only-121393   | jenkins | v1.33.1 | 22 Jul 24 10:30 UTC | 22 Jul 24 10:30 UTC |
	| start   | --download-only -p                                                                          | download-docker-568204 | jenkins | v1.33.1 | 22 Jul 24 10:30 UTC |                     |
	|         | download-docker-568204                                                                      |                        |         |         |                     |                     |
	|         | --alsologtostderr                                                                           |                        |         |         |                     |                     |
	|         | --driver=docker                                                                             |                        |         |         |                     |                     |
	|         | --container-runtime=crio                                                                    |                        |         |         |                     |                     |
	| delete  | -p download-docker-568204                                                                   | download-docker-568204 | jenkins | v1.33.1 | 22 Jul 24 10:30 UTC | 22 Jul 24 10:30 UTC |
	| start   | --download-only -p                                                                          | binary-mirror-754911   | jenkins | v1.33.1 | 22 Jul 24 10:30 UTC |                     |
	|         | binary-mirror-754911                                                                        |                        |         |         |                     |                     |
	|         | --alsologtostderr                                                                           |                        |         |         |                     |                     |
	|         | --binary-mirror                                                                             |                        |         |         |                     |                     |
	|         | http://127.0.0.1:34829                                                                      |                        |         |         |                     |                     |
	|         | --driver=docker                                                                             |                        |         |         |                     |                     |
	|         | --container-runtime=crio                                                                    |                        |         |         |                     |                     |
	| delete  | -p binary-mirror-754911                                                                     | binary-mirror-754911   | jenkins | v1.33.1 | 22 Jul 24 10:30 UTC | 22 Jul 24 10:30 UTC |
	| addons  | enable dashboard -p                                                                         | addons-578168          | jenkins | v1.33.1 | 22 Jul 24 10:30 UTC |                     |
	|         | addons-578168                                                                               |                        |         |         |                     |                     |
	| addons  | disable dashboard -p                                                                        | addons-578168          | jenkins | v1.33.1 | 22 Jul 24 10:30 UTC |                     |
	|         | addons-578168                                                                               |                        |         |         |                     |                     |
	| start   | -p addons-578168 --wait=true                                                                | addons-578168          | jenkins | v1.33.1 | 22 Jul 24 10:30 UTC | 22 Jul 24 10:33 UTC |
	|         | --memory=4000 --alsologtostderr                                                             |                        |         |         |                     |                     |
	|         | --addons=registry                                                                           |                        |         |         |                     |                     |
	|         | --addons=metrics-server                                                                     |                        |         |         |                     |                     |
	|         | --addons=volumesnapshots                                                                    |                        |         |         |                     |                     |
	|         | --addons=csi-hostpath-driver                                                                |                        |         |         |                     |                     |
	|         | --addons=gcp-auth                                                                           |                        |         |         |                     |                     |
	|         | --addons=cloud-spanner                                                                      |                        |         |         |                     |                     |
	|         | --addons=inspektor-gadget                                                                   |                        |         |         |                     |                     |
	|         | --addons=storage-provisioner-rancher                                                        |                        |         |         |                     |                     |
	|         | --addons=nvidia-device-plugin                                                               |                        |         |         |                     |                     |
	|         | --addons=yakd --addons=volcano                                                              |                        |         |         |                     |                     |
	|         | --driver=docker                                                                             |                        |         |         |                     |                     |
	|         | --container-runtime=crio                                                                    |                        |         |         |                     |                     |
	|         | --addons=ingress                                                                            |                        |         |         |                     |                     |
	|         | --addons=ingress-dns                                                                        |                        |         |         |                     |                     |
	| addons  | enable headlamp                                                                             | addons-578168          | jenkins | v1.33.1 | 22 Jul 24 10:33 UTC | 22 Jul 24 10:33 UTC |
	|         | -p addons-578168                                                                            |                        |         |         |                     |                     |
	|         | --alsologtostderr -v=1                                                                      |                        |         |         |                     |                     |
	| ip      | addons-578168 ip                                                                            | addons-578168          | jenkins | v1.33.1 | 22 Jul 24 10:33 UTC | 22 Jul 24 10:33 UTC |
	| addons  | addons-578168 addons disable                                                                | addons-578168          | jenkins | v1.33.1 | 22 Jul 24 10:33 UTC | 22 Jul 24 10:33 UTC |
	|         | registry --alsologtostderr                                                                  |                        |         |         |                     |                     |
	|         | -v=1                                                                                        |                        |         |         |                     |                     |
	| addons  | disable nvidia-device-plugin                                                                | addons-578168          | jenkins | v1.33.1 | 22 Jul 24 10:33 UTC | 22 Jul 24 10:33 UTC |
	|         | -p addons-578168                                                                            |                        |         |         |                     |                     |
	| ssh     | addons-578168 ssh cat                                                                       | addons-578168          | jenkins | v1.33.1 | 22 Jul 24 10:33 UTC | 22 Jul 24 10:33 UTC |
	|         | /opt/local-path-provisioner/pvc-3fa9736a-2470-4225-9ba0-57fda8a0f7a4_default_test-pvc/file1 |                        |         |         |                     |                     |
	| addons  | addons-578168 addons disable                                                                | addons-578168          | jenkins | v1.33.1 | 22 Jul 24 10:33 UTC | 22 Jul 24 10:34 UTC |
	|         | storage-provisioner-rancher                                                                 |                        |         |         |                     |                     |
	|         | --alsologtostderr -v=1                                                                      |                        |         |         |                     |                     |
	| addons  | disable cloud-spanner -p                                                                    | addons-578168          | jenkins | v1.33.1 | 22 Jul 24 10:33 UTC | 22 Jul 24 10:33 UTC |
	|         | addons-578168                                                                               |                        |         |         |                     |                     |
	| addons  | addons-578168 addons                                                                        | addons-578168          | jenkins | v1.33.1 | 22 Jul 24 10:34 UTC | 22 Jul 24 10:34 UTC |
	|         | disable csi-hostpath-driver                                                                 |                        |         |         |                     |                     |
	|         | --alsologtostderr -v=1                                                                      |                        |         |         |                     |                     |
	| addons  | disable inspektor-gadget -p                                                                 | addons-578168          | jenkins | v1.33.1 | 22 Jul 24 10:34 UTC | 22 Jul 24 10:34 UTC |
	|         | addons-578168                                                                               |                        |         |         |                     |                     |
	| addons  | addons-578168 addons                                                                        | addons-578168          | jenkins | v1.33.1 | 22 Jul 24 10:34 UTC | 22 Jul 24 10:34 UTC |
	|         | disable volumesnapshots                                                                     |                        |         |         |                     |                     |
	|         | --alsologtostderr -v=1                                                                      |                        |         |         |                     |                     |
	| ssh     | addons-578168 ssh curl -s                                                                   | addons-578168          | jenkins | v1.33.1 | 22 Jul 24 10:35 UTC |                     |
	|         | http://127.0.0.1/ -H 'Host:                                                                 |                        |         |         |                     |                     |
	|         | nginx.example.com'                                                                          |                        |         |         |                     |                     |
	| ip      | addons-578168 ip                                                                            | addons-578168          | jenkins | v1.33.1 | 22 Jul 24 10:37 UTC | 22 Jul 24 10:37 UTC |
	| addons  | addons-578168 addons disable                                                                | addons-578168          | jenkins | v1.33.1 | 22 Jul 24 10:37 UTC | 22 Jul 24 10:37 UTC |
	|         | ingress-dns --alsologtostderr                                                               |                        |         |         |                     |                     |
	|         | -v=1                                                                                        |                        |         |         |                     |                     |
	| addons  | addons-578168 addons disable                                                                | addons-578168          | jenkins | v1.33.1 | 22 Jul 24 10:37 UTC | 22 Jul 24 10:37 UTC |
	|         | ingress --alsologtostderr -v=1                                                              |                        |         |         |                     |                     |
	|---------|---------------------------------------------------------------------------------------------|------------------------|---------|---------|---------------------|---------------------|
	
	
	==> Last Start <==
	Log file created at: 2024/07/22 10:30:26
	Running on machine: ip-172-31-21-244
	Binary: Built with gc go1.22.5 for linux/arm64
	Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg
	I0722 10:30:26.968131    8575 out.go:291] Setting OutFile to fd 1 ...
	I0722 10:30:26.968266    8575 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0722 10:30:26.968278    8575 out.go:304] Setting ErrFile to fd 2...
	I0722 10:30:26.968283    8575 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0722 10:30:26.968509    8575 root.go:338] Updating PATH: /home/jenkins/minikube-integration/19313-2237/.minikube/bin
	I0722 10:30:26.968999    8575 out.go:298] Setting JSON to false
	I0722 10:30:26.969755    8575 start.go:129] hostinfo: {"hostname":"ip-172-31-21-244","uptime":772,"bootTime":1721643455,"procs":146,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1064-aws","kernelArch":"aarch64","virtualizationSystem":"","virtualizationRole":"","hostId":"da8ac1fd-6236-412a-a346-95873c98230d"}
	I0722 10:30:26.969823    8575 start.go:139] virtualization:  
	I0722 10:30:26.972292    8575 out.go:177] * [addons-578168] minikube v1.33.1 on Ubuntu 20.04 (arm64)
	I0722 10:30:26.974264    8575 out.go:177]   - MINIKUBE_LOCATION=19313
	I0722 10:30:26.974358    8575 notify.go:220] Checking for updates...
	I0722 10:30:26.978078    8575 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I0722 10:30:26.979746    8575 out.go:177]   - KUBECONFIG=/home/jenkins/minikube-integration/19313-2237/kubeconfig
	I0722 10:30:26.981549    8575 out.go:177]   - MINIKUBE_HOME=/home/jenkins/minikube-integration/19313-2237/.minikube
	I0722 10:30:26.983405    8575 out.go:177]   - MINIKUBE_BIN=out/minikube-linux-arm64
	I0722 10:30:26.984996    8575 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=
	I0722 10:30:26.986889    8575 driver.go:392] Setting default libvirt URI to qemu:///system
	I0722 10:30:27.019330    8575 docker.go:123] docker version: linux-27.0.3:Docker Engine - Community
	I0722 10:30:27.019445    8575 cli_runner.go:164] Run: docker system info --format "{{json .}}"
	I0722 10:30:27.074839    8575 info.go:266] docker info: {ID:5FDH:SA5P:5GCT:NLAS:B73P:SGDQ:PBG5:UBVH:UZY3:RXGO:CI7S:WAIH Containers:0 ContainersRunning:0 ContainersPaused:0 ContainersStopped:0 Images:1 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:25 OomKillDisable:true NGoroutines:44 SystemTime:2024-07-22 10:30:27.065927821 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1064-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Architecture:aar
ch64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8214896640 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-21-244 Labels:[] ExperimentalBuild:false ServerVersion:27.0.3 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:2bf793ef6dc9a18e00cb12efb64355c2c9d5eb41 Expected:2bf793ef6dc9a18e00cb12efb64355c2c9d5eb41} RuncCommit:{ID:v1.1.13-0-g58aa920 Expected:v1.1.13-0-g58aa920} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:<nil> ServerErro
rs:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.15.1] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.28.1]] Warnings:<nil>}}
	I0722 10:30:27.074950    8575 docker.go:307] overlay module found
	I0722 10:30:27.077014    8575 out.go:177] * Using the docker driver based on user configuration
	I0722 10:30:27.078792    8575 start.go:297] selected driver: docker
	I0722 10:30:27.078806    8575 start.go:901] validating driver "docker" against <nil>
	I0722 10:30:27.078819    8575 start.go:912] status for docker: {Installed:true Healthy:true Running:false NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I0722 10:30:27.079484    8575 cli_runner.go:164] Run: docker system info --format "{{json .}}"
	I0722 10:30:27.131448    8575 info.go:266] docker info: {ID:5FDH:SA5P:5GCT:NLAS:B73P:SGDQ:PBG5:UBVH:UZY3:RXGO:CI7S:WAIH Containers:0 ContainersRunning:0 ContainersPaused:0 ContainersStopped:0 Images:1 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:25 OomKillDisable:true NGoroutines:44 SystemTime:2024-07-22 10:30:27.122541746 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1064-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Architecture:aar
ch64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8214896640 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-21-244 Labels:[] ExperimentalBuild:false ServerVersion:27.0.3 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:2bf793ef6dc9a18e00cb12efb64355c2c9d5eb41 Expected:2bf793ef6dc9a18e00cb12efb64355c2c9d5eb41} RuncCommit:{ID:v1.1.13-0-g58aa920 Expected:v1.1.13-0-g58aa920} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:<nil> ServerErro
rs:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.15.1] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.28.1]] Warnings:<nil>}}
	I0722 10:30:27.131619    8575 start_flags.go:310] no existing cluster config was found, will generate one from the flags 
	I0722 10:30:27.131855    8575 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
	I0722 10:30:27.134056    8575 out.go:177] * Using Docker driver with root privileges
	I0722 10:30:27.135881    8575 cni.go:84] Creating CNI manager for ""
	I0722 10:30:27.135905    8575 cni.go:143] "docker" driver + "crio" runtime found, recommending kindnet
	I0722 10:30:27.135917    8575 start_flags.go:319] Found "CNI" CNI - setting NetworkPlugin=cni
	I0722 10:30:27.136010    8575 start.go:340] cluster config:
	{Name:addons-578168 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721324606-19298@sha256:1c495b056df42bd3fd9a5c30d049e1802f9ed73a342611781f1ccc3c3853953f Memory:4000 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.30.3 ClusterName:addons-578168 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime
:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.30.3 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSH
AgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I0722 10:30:27.138879    8575 out.go:177] * Starting "addons-578168" primary control-plane node in "addons-578168" cluster
	I0722 10:30:27.140655    8575 cache.go:121] Beginning downloading kic base image for docker with crio
	I0722 10:30:27.142985    8575 out.go:177] * Pulling base image v0.0.44-1721324606-19298 ...
	I0722 10:30:27.145244    8575 preload.go:131] Checking if preload exists for k8s version v1.30.3 and runtime crio
	I0722 10:30:27.145286    8575 image.go:79] Checking for gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721324606-19298@sha256:1c495b056df42bd3fd9a5c30d049e1802f9ed73a342611781f1ccc3c3853953f in local docker daemon
	I0722 10:30:27.145304    8575 preload.go:146] Found local preload: /home/jenkins/minikube-integration/19313-2237/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.30.3-cri-o-overlay-arm64.tar.lz4
	I0722 10:30:27.145314    8575 cache.go:56] Caching tarball of preloaded images
	I0722 10:30:27.145427    8575 preload.go:172] Found /home/jenkins/minikube-integration/19313-2237/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.30.3-cri-o-overlay-arm64.tar.lz4 in cache, skipping download
	I0722 10:30:27.145466    8575 cache.go:59] Finished verifying existence of preloaded tar for v1.30.3 on crio
	I0722 10:30:27.145878    8575 profile.go:143] Saving config to /home/jenkins/minikube-integration/19313-2237/.minikube/profiles/addons-578168/config.json ...
	I0722 10:30:27.145935    8575 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19313-2237/.minikube/profiles/addons-578168/config.json: {Name:mk7e0c748764fc54142663f8bc3b61db8b4c280f Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0722 10:30:27.160585    8575 cache.go:149] Downloading gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721324606-19298@sha256:1c495b056df42bd3fd9a5c30d049e1802f9ed73a342611781f1ccc3c3853953f to local cache
	I0722 10:30:27.160691    8575 image.go:63] Checking for gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721324606-19298@sha256:1c495b056df42bd3fd9a5c30d049e1802f9ed73a342611781f1ccc3c3853953f in local cache directory
	I0722 10:30:27.160715    8575 image.go:66] Found gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721324606-19298@sha256:1c495b056df42bd3fd9a5c30d049e1802f9ed73a342611781f1ccc3c3853953f in local cache directory, skipping pull
	I0722 10:30:27.160725    8575 image.go:135] gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721324606-19298@sha256:1c495b056df42bd3fd9a5c30d049e1802f9ed73a342611781f1ccc3c3853953f exists in cache, skipping pull
	I0722 10:30:27.160733    8575 cache.go:152] successfully saved gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721324606-19298@sha256:1c495b056df42bd3fd9a5c30d049e1802f9ed73a342611781f1ccc3c3853953f as a tarball
	I0722 10:30:27.160749    8575 cache.go:162] Loading gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721324606-19298@sha256:1c495b056df42bd3fd9a5c30d049e1802f9ed73a342611781f1ccc3c3853953f from local cache
	I0722 10:30:43.810516    8575 cache.go:164] successfully loaded and using gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721324606-19298@sha256:1c495b056df42bd3fd9a5c30d049e1802f9ed73a342611781f1ccc3c3853953f from cached tarball
	I0722 10:30:43.810556    8575 cache.go:194] Successfully downloaded all kic artifacts
	I0722 10:30:43.810592    8575 start.go:360] acquireMachinesLock for addons-578168: {Name:mk413af3133258b838feab4165830c0eccf18c0a Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0722 10:30:43.810721    8575 start.go:364] duration metric: took 105.945µs to acquireMachinesLock for "addons-578168"
	I0722 10:30:43.810754    8575 start.go:93] Provisioning new machine with config: &{Name:addons-578168 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721324606-19298@sha256:1c495b056df42bd3fd9a5c30d049e1802f9ed73a342611781f1ccc3c3853953f Memory:4000 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.30.3 ClusterName:addons-578168 Namespace:default APIServerHAVIP: APIServerName:min
ikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.30.3 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQe
muFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.30.3 ContainerRuntime:crio ControlPlane:true Worker:true}
	I0722 10:30:43.810842    8575 start.go:125] createHost starting for "" (driver="docker")
	I0722 10:30:43.813170    8575 out.go:204] * Creating docker container (CPUs=2, Memory=4000MB) ...
	I0722 10:30:43.813424    8575 start.go:159] libmachine.API.Create for "addons-578168" (driver="docker")
	I0722 10:30:43.813458    8575 client.go:168] LocalClient.Create starting
	I0722 10:30:43.813568    8575 main.go:141] libmachine: Creating CA: /home/jenkins/minikube-integration/19313-2237/.minikube/certs/ca.pem
	I0722 10:30:44.290335    8575 main.go:141] libmachine: Creating client certificate: /home/jenkins/minikube-integration/19313-2237/.minikube/certs/cert.pem
	I0722 10:30:44.630878    8575 cli_runner.go:164] Run: docker network inspect addons-578168 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
	W0722 10:30:44.645884    8575 cli_runner.go:211] docker network inspect addons-578168 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}" returned with exit code 1
	I0722 10:30:44.645964    8575 network_create.go:284] running [docker network inspect addons-578168] to gather additional debugging logs...
	I0722 10:30:44.645984    8575 cli_runner.go:164] Run: docker network inspect addons-578168
	W0722 10:30:44.660190    8575 cli_runner.go:211] docker network inspect addons-578168 returned with exit code 1
	I0722 10:30:44.660220    8575 network_create.go:287] error running [docker network inspect addons-578168]: docker network inspect addons-578168: exit status 1
	stdout:
	[]
	
	stderr:
	Error response from daemon: network addons-578168 not found
	I0722 10:30:44.660233    8575 network_create.go:289] output of [docker network inspect addons-578168]: -- stdout --
	[]
	
	-- /stdout --
	** stderr ** 
	Error response from daemon: network addons-578168 not found
	
	** /stderr **
	I0722 10:30:44.660338    8575 cli_runner.go:164] Run: docker network inspect bridge --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
	I0722 10:30:44.675884    8575 network.go:206] using free private subnet 192.168.49.0/24: &{IP:192.168.49.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.49.0/24 Gateway:192.168.49.1 ClientMin:192.168.49.2 ClientMax:192.168.49.254 Broadcast:192.168.49.255 IsPrivate:true Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:} reservation:0x4001836bd0}
	I0722 10:30:44.675926    8575 network_create.go:124] attempt to create docker network addons-578168 192.168.49.0/24 with gateway 192.168.49.1 and MTU of 1500 ...
	I0722 10:30:44.675986    8575 cli_runner.go:164] Run: docker network create --driver=bridge --subnet=192.168.49.0/24 --gateway=192.168.49.1 -o --ip-masq -o --icc -o com.docker.network.driver.mtu=1500 --label=created_by.minikube.sigs.k8s.io=true --label=name.minikube.sigs.k8s.io=addons-578168 addons-578168
	I0722 10:30:44.743386    8575 network_create.go:108] docker network addons-578168 192.168.49.0/24 created
	I0722 10:30:44.743431    8575 kic.go:121] calculated static IP "192.168.49.2" for the "addons-578168" container
	I0722 10:30:44.743502    8575 cli_runner.go:164] Run: docker ps -a --format {{.Names}}
	I0722 10:30:44.757203    8575 cli_runner.go:164] Run: docker volume create addons-578168 --label name.minikube.sigs.k8s.io=addons-578168 --label created_by.minikube.sigs.k8s.io=true
	I0722 10:30:44.773794    8575 oci.go:103] Successfully created a docker volume addons-578168
	I0722 10:30:44.773884    8575 cli_runner.go:164] Run: docker run --rm --name addons-578168-preload-sidecar --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=addons-578168 --entrypoint /usr/bin/test -v addons-578168:/var gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721324606-19298@sha256:1c495b056df42bd3fd9a5c30d049e1802f9ed73a342611781f1ccc3c3853953f -d /var/lib
	I0722 10:30:46.856782    8575 cli_runner.go:217] Completed: docker run --rm --name addons-578168-preload-sidecar --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=addons-578168 --entrypoint /usr/bin/test -v addons-578168:/var gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721324606-19298@sha256:1c495b056df42bd3fd9a5c30d049e1802f9ed73a342611781f1ccc3c3853953f -d /var/lib: (2.082845057s)
	I0722 10:30:46.856811    8575 oci.go:107] Successfully prepared a docker volume addons-578168
	I0722 10:30:46.856842    8575 preload.go:131] Checking if preload exists for k8s version v1.30.3 and runtime crio
	I0722 10:30:46.856864    8575 kic.go:194] Starting extracting preloaded images to volume ...
	I0722 10:30:46.856964    8575 cli_runner.go:164] Run: docker run --rm --entrypoint /usr/bin/tar -v /home/jenkins/minikube-integration/19313-2237/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.30.3-cri-o-overlay-arm64.tar.lz4:/preloaded.tar:ro -v addons-578168:/extractDir gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721324606-19298@sha256:1c495b056df42bd3fd9a5c30d049e1802f9ed73a342611781f1ccc3c3853953f -I lz4 -xf /preloaded.tar -C /extractDir
	I0722 10:30:51.196605    8575 cli_runner.go:217] Completed: docker run --rm --entrypoint /usr/bin/tar -v /home/jenkins/minikube-integration/19313-2237/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.30.3-cri-o-overlay-arm64.tar.lz4:/preloaded.tar:ro -v addons-578168:/extractDir gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721324606-19298@sha256:1c495b056df42bd3fd9a5c30d049e1802f9ed73a342611781f1ccc3c3853953f -I lz4 -xf /preloaded.tar -C /extractDir: (4.339601108s)
	I0722 10:30:51.196648    8575 kic.go:203] duration metric: took 4.339779399s to extract preloaded images to volume ...
	W0722 10:30:51.196781    8575 cgroups_linux.go:77] Your kernel does not support swap limit capabilities or the cgroup is not mounted.
	I0722 10:30:51.196951    8575 cli_runner.go:164] Run: docker info --format "'{{json .SecurityOptions}}'"
	I0722 10:30:51.252928    8575 cli_runner.go:164] Run: docker run -d -t --privileged --security-opt seccomp=unconfined --tmpfs /tmp --tmpfs /run -v /lib/modules:/lib/modules:ro --hostname addons-578168 --name addons-578168 --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=addons-578168 --label role.minikube.sigs.k8s.io= --label mode.minikube.sigs.k8s.io=addons-578168 --network addons-578168 --ip 192.168.49.2 --volume addons-578168:/var --security-opt apparmor=unconfined --memory=4000mb --cpus=2 -e container=docker --expose 8443 --publish=127.0.0.1::8443 --publish=127.0.0.1::22 --publish=127.0.0.1::2376 --publish=127.0.0.1::5000 --publish=127.0.0.1::32443 gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721324606-19298@sha256:1c495b056df42bd3fd9a5c30d049e1802f9ed73a342611781f1ccc3c3853953f
	I0722 10:30:51.598902    8575 cli_runner.go:164] Run: docker container inspect addons-578168 --format={{.State.Running}}
	I0722 10:30:51.621097    8575 cli_runner.go:164] Run: docker container inspect addons-578168 --format={{.State.Status}}
	I0722 10:30:51.652344    8575 cli_runner.go:164] Run: docker exec addons-578168 stat /var/lib/dpkg/alternatives/iptables
	I0722 10:30:51.725077    8575 oci.go:144] the created container "addons-578168" has a running status.
	I0722 10:30:51.725102    8575 kic.go:225] Creating ssh key for kic: /home/jenkins/minikube-integration/19313-2237/.minikube/machines/addons-578168/id_rsa...
	I0722 10:30:52.021725    8575 kic_runner.go:191] docker (temp): /home/jenkins/minikube-integration/19313-2237/.minikube/machines/addons-578168/id_rsa.pub --> /home/docker/.ssh/authorized_keys (381 bytes)
	I0722 10:30:52.054924    8575 cli_runner.go:164] Run: docker container inspect addons-578168 --format={{.State.Status}}
	I0722 10:30:52.077077    8575 kic_runner.go:93] Run: chown docker:docker /home/docker/.ssh/authorized_keys
	I0722 10:30:52.077098    8575 kic_runner.go:114] Args: [docker exec --privileged addons-578168 chown docker:docker /home/docker/.ssh/authorized_keys]
	I0722 10:30:52.170870    8575 cli_runner.go:164] Run: docker container inspect addons-578168 --format={{.State.Status}}
	I0722 10:30:52.197395    8575 machine.go:94] provisionDockerMachine start ...
	I0722 10:30:52.197490    8575 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-578168
	I0722 10:30:52.223654    8575 main.go:141] libmachine: Using SSH client type: native
	I0722 10:30:52.223932    8575 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x3e2cd0] 0x3e5530 <nil>  [] 0s} 127.0.0.1 32768 <nil> <nil>}
	I0722 10:30:52.223950    8575 main.go:141] libmachine: About to run SSH command:
	hostname
	I0722 10:30:52.225061    8575 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: EOF
	I0722 10:30:55.344269    8575 main.go:141] libmachine: SSH cmd err, output: <nil>: addons-578168
	
	I0722 10:30:55.344295    8575 ubuntu.go:169] provisioning hostname "addons-578168"
	I0722 10:30:55.344379    8575 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-578168
	I0722 10:30:55.360976    8575 main.go:141] libmachine: Using SSH client type: native
	I0722 10:30:55.361225    8575 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x3e2cd0] 0x3e5530 <nil>  [] 0s} 127.0.0.1 32768 <nil> <nil>}
	I0722 10:30:55.361242    8575 main.go:141] libmachine: About to run SSH command:
	sudo hostname addons-578168 && echo "addons-578168" | sudo tee /etc/hostname
	I0722 10:30:55.494271    8575 main.go:141] libmachine: SSH cmd err, output: <nil>: addons-578168
	
	I0722 10:30:55.494384    8575 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-578168
	I0722 10:30:55.512007    8575 main.go:141] libmachine: Using SSH client type: native
	I0722 10:30:55.512256    8575 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x3e2cd0] 0x3e5530 <nil>  [] 0s} 127.0.0.1 32768 <nil> <nil>}
	I0722 10:30:55.512278    8575 main.go:141] libmachine: About to run SSH command:
	
			if ! grep -xq '.*\saddons-578168' /etc/hosts; then
				if grep -xq '127.0.1.1\s.*' /etc/hosts; then
					sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 addons-578168/g' /etc/hosts;
				else 
					echo '127.0.1.1 addons-578168' | sudo tee -a /etc/hosts; 
				fi
			fi
	I0722 10:30:55.632724    8575 main.go:141] libmachine: SSH cmd err, output: <nil>: 
	I0722 10:30:55.632750    8575 ubuntu.go:175] set auth options {CertDir:/home/jenkins/minikube-integration/19313-2237/.minikube CaCertPath:/home/jenkins/minikube-integration/19313-2237/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/19313-2237/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/19313-2237/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/19313-2237/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/19313-2237/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/19313-2237/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/19313-2237/.minikube}
	I0722 10:30:55.632775    8575 ubuntu.go:177] setting up certificates
	I0722 10:30:55.632784    8575 provision.go:84] configureAuth start
	I0722 10:30:55.632842    8575 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" addons-578168
	I0722 10:30:55.648745    8575 provision.go:143] copyHostCerts
	I0722 10:30:55.648837    8575 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19313-2237/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/19313-2237/.minikube/cert.pem (1123 bytes)
	I0722 10:30:55.648984    8575 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19313-2237/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/19313-2237/.minikube/key.pem (1679 bytes)
	I0722 10:30:55.649053    8575 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19313-2237/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/19313-2237/.minikube/ca.pem (1078 bytes)
	I0722 10:30:55.649113    8575 provision.go:117] generating server cert: /home/jenkins/minikube-integration/19313-2237/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/19313-2237/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/19313-2237/.minikube/certs/ca-key.pem org=jenkins.addons-578168 san=[127.0.0.1 192.168.49.2 addons-578168 localhost minikube]
	I0722 10:30:56.130974    8575 provision.go:177] copyRemoteCerts
	I0722 10:30:56.131042    8575 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
	I0722 10:30:56.131091    8575 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-578168
	I0722 10:30:56.147824    8575 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32768 SSHKeyPath:/home/jenkins/minikube-integration/19313-2237/.minikube/machines/addons-578168/id_rsa Username:docker}
	I0722 10:30:56.237246    8575 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19313-2237/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1078 bytes)
	I0722 10:30:56.260294    8575 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19313-2237/.minikube/machines/server.pem --> /etc/docker/server.pem (1208 bytes)
	I0722 10:30:56.282254    8575 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19313-2237/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1675 bytes)
	I0722 10:30:56.304988    8575 provision.go:87] duration metric: took 672.190907ms to configureAuth
	I0722 10:30:56.305017    8575 ubuntu.go:193] setting minikube options for container-runtime
	I0722 10:30:56.305231    8575 config.go:182] Loaded profile config "addons-578168": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.30.3
	I0722 10:30:56.305345    8575 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-578168
	I0722 10:30:56.322711    8575 main.go:141] libmachine: Using SSH client type: native
	I0722 10:30:56.322948    8575 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x3e2cd0] 0x3e5530 <nil>  [] 0s} 127.0.0.1 32768 <nil> <nil>}
	I0722 10:30:56.322967    8575 main.go:141] libmachine: About to run SSH command:
	sudo mkdir -p /etc/sysconfig && printf %!s(MISSING) "
	CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
	" | sudo tee /etc/sysconfig/crio.minikube && sudo systemctl restart crio
	I0722 10:30:56.538914    8575 main.go:141] libmachine: SSH cmd err, output: <nil>: 
	CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
	
	I0722 10:30:56.538938    8575 machine.go:97] duration metric: took 4.341519592s to provisionDockerMachine
	I0722 10:30:56.538949    8575 client.go:171] duration metric: took 12.725479965s to LocalClient.Create
	I0722 10:30:56.538961    8575 start.go:167] duration metric: took 12.725537812s to libmachine.API.Create "addons-578168"
	I0722 10:30:56.538968    8575 start.go:293] postStartSetup for "addons-578168" (driver="docker")
	I0722 10:30:56.538979    8575 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
	I0722 10:30:56.539055    8575 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
	I0722 10:30:56.539106    8575 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-578168
	I0722 10:30:56.556857    8575 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32768 SSHKeyPath:/home/jenkins/minikube-integration/19313-2237/.minikube/machines/addons-578168/id_rsa Username:docker}
	I0722 10:30:56.645612    8575 ssh_runner.go:195] Run: cat /etc/os-release
	I0722 10:30:56.648582    8575 main.go:141] libmachine: Couldn't set key VERSION_CODENAME, no corresponding struct field found
	I0722 10:30:56.648616    8575 main.go:141] libmachine: Couldn't set key PRIVACY_POLICY_URL, no corresponding struct field found
	I0722 10:30:56.648626    8575 main.go:141] libmachine: Couldn't set key UBUNTU_CODENAME, no corresponding struct field found
	I0722 10:30:56.648633    8575 info.go:137] Remote host: Ubuntu 22.04.4 LTS
	I0722 10:30:56.648643    8575 filesync.go:126] Scanning /home/jenkins/minikube-integration/19313-2237/.minikube/addons for local assets ...
	I0722 10:30:56.648708    8575 filesync.go:126] Scanning /home/jenkins/minikube-integration/19313-2237/.minikube/files for local assets ...
	I0722 10:30:56.648730    8575 start.go:296] duration metric: took 109.756739ms for postStartSetup
	I0722 10:30:56.649056    8575 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" addons-578168
	I0722 10:30:56.664714    8575 profile.go:143] Saving config to /home/jenkins/minikube-integration/19313-2237/.minikube/profiles/addons-578168/config.json ...
	I0722 10:30:56.665239    8575 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
	I0722 10:30:56.665291    8575 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-578168
	I0722 10:30:56.686019    8575 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32768 SSHKeyPath:/home/jenkins/minikube-integration/19313-2237/.minikube/machines/addons-578168/id_rsa Username:docker}
	I0722 10:30:56.769397    8575 ssh_runner.go:195] Run: sh -c "df -BG /var | awk 'NR==2{print $4}'"
	I0722 10:30:56.773617    8575 start.go:128] duration metric: took 12.962759975s to createHost
	I0722 10:30:56.773643    8575 start.go:83] releasing machines lock for "addons-578168", held for 12.962905395s
	I0722 10:30:56.773724    8575 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" addons-578168
	I0722 10:30:56.790816    8575 ssh_runner.go:195] Run: cat /version.json
	I0722 10:30:56.790871    8575 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-578168
	I0722 10:30:56.791106    8575 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/
	I0722 10:30:56.791173    8575 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-578168
	I0722 10:30:56.807492    8575 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32768 SSHKeyPath:/home/jenkins/minikube-integration/19313-2237/.minikube/machines/addons-578168/id_rsa Username:docker}
	I0722 10:30:56.818503    8575 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32768 SSHKeyPath:/home/jenkins/minikube-integration/19313-2237/.minikube/machines/addons-578168/id_rsa Username:docker}
	I0722 10:30:57.013414    8575 ssh_runner.go:195] Run: systemctl --version
	I0722 10:30:57.017929    8575 ssh_runner.go:195] Run: sudo sh -c "podman version >/dev/null"
	I0722 10:30:57.158873    8575 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"
	I0722 10:30:57.163087    8575 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f -name *loopback.conf* -not -name *.mk_disabled -exec sh -c "sudo mv {} {}.mk_disabled" ;
	I0722 10:30:57.183590    8575 cni.go:221] loopback cni configuration disabled: "/etc/cni/net.d/*loopback.conf*" found
	I0722 10:30:57.183681    8575 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%!p(MISSING), " -exec sh -c "sudo mv {} {}.mk_disabled" ;
	I0722 10:30:57.217577    8575 cni.go:262] disabled [/etc/cni/net.d/87-podman-bridge.conflist, /etc/cni/net.d/100-crio-bridge.conf] bridge cni config(s)
	I0722 10:30:57.217599    8575 start.go:495] detecting cgroup driver to use...
	I0722 10:30:57.217632    8575 detect.go:187] detected "cgroupfs" cgroup driver on host os
	I0722 10:30:57.217678    8575 ssh_runner.go:195] Run: sudo systemctl stop -f containerd
	I0722 10:30:57.233837    8575 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd
	I0722 10:30:57.245925    8575 docker.go:217] disabling cri-docker service (if available) ...
	I0722 10:30:57.245993    8575 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.socket
	I0722 10:30:57.259356    8575 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.service
	I0722 10:30:57.274201    8575 ssh_runner.go:195] Run: sudo systemctl disable cri-docker.socket
	I0722 10:30:57.371580    8575 ssh_runner.go:195] Run: sudo systemctl mask cri-docker.service
	I0722 10:30:57.479342    8575 docker.go:233] disabling docker service ...
	I0722 10:30:57.479407    8575 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket
	I0722 10:30:57.499113    8575 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service
	I0722 10:30:57.511059    8575 ssh_runner.go:195] Run: sudo systemctl disable docker.socket
	I0722 10:30:57.606923    8575 ssh_runner.go:195] Run: sudo systemctl mask docker.service
	I0722 10:30:57.707187    8575 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker
	I0722 10:30:57.717891    8575 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %!s(MISSING) "runtime-endpoint: unix:///var/run/crio/crio.sock
	" | sudo tee /etc/crictl.yaml"
	I0722 10:30:57.734028    8575 crio.go:59] configure cri-o to use "registry.k8s.io/pause:3.9" pause image...
	I0722 10:30:57.734142    8575 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*pause_image = .*$|pause_image = "registry.k8s.io/pause:3.9"|' /etc/crio/crio.conf.d/02-crio.conf"
	I0722 10:30:57.743994    8575 crio.go:70] configuring cri-o to use "cgroupfs" as cgroup driver...
	I0722 10:30:57.744090    8575 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*cgroup_manager = .*$|cgroup_manager = "cgroupfs"|' /etc/crio/crio.conf.d/02-crio.conf"
	I0722 10:30:57.754058    8575 ssh_runner.go:195] Run: sh -c "sudo sed -i '/conmon_cgroup = .*/d' /etc/crio/crio.conf.d/02-crio.conf"
	I0722 10:30:57.763602    8575 ssh_runner.go:195] Run: sh -c "sudo sed -i '/cgroup_manager = .*/a conmon_cgroup = "pod"' /etc/crio/crio.conf.d/02-crio.conf"
	I0722 10:30:57.773751    8575 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"
	I0722 10:30:57.782907    8575 ssh_runner.go:195] Run: sh -c "sudo sed -i '/^ *"net.ipv4.ip_unprivileged_port_start=.*"/d' /etc/crio/crio.conf.d/02-crio.conf"
	I0722 10:30:57.792481    8575 ssh_runner.go:195] Run: sh -c "sudo grep -q "^ *default_sysctls" /etc/crio/crio.conf.d/02-crio.conf || sudo sed -i '/conmon_cgroup = .*/a default_sysctls = \[\n\]' /etc/crio/crio.conf.d/02-crio.conf"
	I0722 10:30:57.807577    8575 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^default_sysctls *= *\[|&\n  "net.ipv4.ip_unprivileged_port_start=0",|' /etc/crio/crio.conf.d/02-crio.conf"
	I0722 10:30:57.816820    8575 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
	I0722 10:30:57.825156    8575 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
	I0722 10:30:57.834328    8575 ssh_runner.go:195] Run: sudo systemctl daemon-reload
	I0722 10:30:57.928059    8575 ssh_runner.go:195] Run: sudo systemctl restart crio
	I0722 10:30:58.026741    8575 start.go:542] Will wait 60s for socket path /var/run/crio/crio.sock
	I0722 10:30:58.026833    8575 ssh_runner.go:195] Run: stat /var/run/crio/crio.sock
	I0722 10:30:58.030974    8575 start.go:563] Will wait 60s for crictl version
	I0722 10:30:58.031038    8575 ssh_runner.go:195] Run: which crictl
	I0722 10:30:58.034850    8575 ssh_runner.go:195] Run: sudo /usr/bin/crictl version
	I0722 10:30:58.074977    8575 start.go:579] Version:  0.1.0
	RuntimeName:  cri-o
	RuntimeVersion:  1.24.6
	RuntimeApiVersion:  v1
	I0722 10:30:58.075131    8575 ssh_runner.go:195] Run: crio --version
	I0722 10:30:58.111943    8575 ssh_runner.go:195] Run: crio --version
	I0722 10:30:58.152585    8575 out.go:177] * Preparing Kubernetes v1.30.3 on CRI-O 1.24.6 ...
	I0722 10:30:58.154384    8575 cli_runner.go:164] Run: docker network inspect addons-578168 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
	I0722 10:30:58.170741    8575 ssh_runner.go:195] Run: grep 192.168.49.1	host.minikube.internal$ /etc/hosts
	I0722 10:30:58.174912    8575 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.49.1	host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
	I0722 10:30:58.186166    8575 kubeadm.go:883] updating cluster {Name:addons-578168 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721324606-19298@sha256:1c495b056df42bd3fd9a5c30d049e1802f9ed73a342611781f1ccc3c3853953f Memory:4000 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.30.3 ClusterName:addons-578168 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNa
mes:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.49.2 Port:8443 KubernetesVersion:v1.30.3 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmw
arePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} ...
	I0722 10:30:58.186284    8575 preload.go:131] Checking if preload exists for k8s version v1.30.3 and runtime crio
	I0722 10:30:58.186345    8575 ssh_runner.go:195] Run: sudo crictl images --output json
	I0722 10:30:58.262342    8575 crio.go:514] all images are preloaded for cri-o runtime.
	I0722 10:30:58.262366    8575 crio.go:433] Images already preloaded, skipping extraction
	I0722 10:30:58.262424    8575 ssh_runner.go:195] Run: sudo crictl images --output json
	I0722 10:30:58.302279    8575 crio.go:514] all images are preloaded for cri-o runtime.
	I0722 10:30:58.302302    8575 cache_images.go:84] Images are preloaded, skipping loading
	I0722 10:30:58.302311    8575 kubeadm.go:934] updating node { 192.168.49.2 8443 v1.30.3 crio true true} ...
	I0722 10:30:58.302410    8575 kubeadm.go:946] kubelet [Unit]
	Wants=crio.service
	
	[Service]
	ExecStart=
	ExecStart=/var/lib/minikube/binaries/v1.30.3/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --cgroups-per-qos=false --config=/var/lib/kubelet/config.yaml --enforce-node-allocatable= --hostname-override=addons-578168 --kubeconfig=/etc/kubernetes/kubelet.conf --node-ip=192.168.49.2
	
	[Install]
	 config:
	{KubernetesVersion:v1.30.3 ClusterName:addons-578168 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:}
	I0722 10:30:58.302493    8575 ssh_runner.go:195] Run: crio config
	I0722 10:30:58.350774    8575 cni.go:84] Creating CNI manager for ""
	I0722 10:30:58.350797    8575 cni.go:143] "docker" driver + "crio" runtime found, recommending kindnet
	I0722 10:30:58.350807    8575 kubeadm.go:84] Using pod CIDR: 10.244.0.0/16
	I0722 10:30:58.350860    8575 kubeadm.go:181] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.49.2 APIServerPort:8443 KubernetesVersion:v1.30.3 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:addons-578168 NodeName:addons-578168 DNSDomain:cluster.local CRISocket:/var/run/crio/crio.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.49.2"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.49.2 CgroupDriver:cgroupfs ClientCAFile:/var/lib/minikube/certs/ca.crt StaticPodPath:/etc/kuberne
tes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[containerRuntimeEndpoint:unix:///var/run/crio/crio.sock hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:true}
	I0722 10:30:58.351030    8575 kubeadm.go:187] kubeadm config:
	apiVersion: kubeadm.k8s.io/v1beta3
	kind: InitConfiguration
	localAPIEndpoint:
	  advertiseAddress: 192.168.49.2
	  bindPort: 8443
	bootstrapTokens:
	  - groups:
	      - system:bootstrappers:kubeadm:default-node-token
	    ttl: 24h0m0s
	    usages:
	      - signing
	      - authentication
	nodeRegistration:
	  criSocket: unix:///var/run/crio/crio.sock
	  name: "addons-578168"
	  kubeletExtraArgs:
	    node-ip: 192.168.49.2
	  taints: []
	---
	apiVersion: kubeadm.k8s.io/v1beta3
	kind: ClusterConfiguration
	apiServer:
	  certSANs: ["127.0.0.1", "localhost", "192.168.49.2"]
	  extraArgs:
	    enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"
	controllerManager:
	  extraArgs:
	    allocate-node-cidrs: "true"
	    leader-elect: "false"
	scheduler:
	  extraArgs:
	    leader-elect: "false"
	certificatesDir: /var/lib/minikube/certs
	clusterName: mk
	controlPlaneEndpoint: control-plane.minikube.internal:8443
	etcd:
	  local:
	    dataDir: /var/lib/minikube/etcd
	    extraArgs:
	      proxy-refresh-interval: "70000"
	kubernetesVersion: v1.30.3
	networking:
	  dnsDomain: cluster.local
	  podSubnet: "10.244.0.0/16"
	  serviceSubnet: 10.96.0.0/12
	---
	apiVersion: kubelet.config.k8s.io/v1beta1
	kind: KubeletConfiguration
	authentication:
	  x509:
	    clientCAFile: /var/lib/minikube/certs/ca.crt
	cgroupDriver: cgroupfs
	containerRuntimeEndpoint: unix:///var/run/crio/crio.sock
	hairpinMode: hairpin-veth
	runtimeRequestTimeout: 15m
	clusterDomain: "cluster.local"
	# disable disk resource management by default
	imageGCHighThresholdPercent: 100
	evictionHard:
	  nodefs.available: "0%!"(MISSING)
	  nodefs.inodesFree: "0%!"(MISSING)
	  imagefs.available: "0%!"(MISSING)
	failSwapOn: false
	staticPodPath: /etc/kubernetes/manifests
	---
	apiVersion: kubeproxy.config.k8s.io/v1alpha1
	kind: KubeProxyConfiguration
	clusterCIDR: "10.244.0.0/16"
	metricsBindAddress: 0.0.0.0:10249
	conntrack:
	  maxPerCore: 0
	# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"
	  tcpEstablishedTimeout: 0s
	# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"
	  tcpCloseWaitTimeout: 0s
	
	I0722 10:30:58.351106    8575 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.30.3
	I0722 10:30:58.359781    8575 binaries.go:44] Found k8s binaries, skipping transfer
	I0722 10:30:58.359847    8575 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube
	I0722 10:30:58.368434    8575 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (363 bytes)
	I0722 10:30:58.385905    8575 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)
	I0722 10:30:58.403435    8575 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2151 bytes)
	I0722 10:30:58.421061    8575 ssh_runner.go:195] Run: grep 192.168.49.2	control-plane.minikube.internal$ /etc/hosts
	I0722 10:30:58.424305    8575 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.49.2	control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
	I0722 10:30:58.434682    8575 ssh_runner.go:195] Run: sudo systemctl daemon-reload
	I0722 10:30:58.512336    8575 ssh_runner.go:195] Run: sudo systemctl start kubelet
	I0722 10:30:58.525279    8575 certs.go:68] Setting up /home/jenkins/minikube-integration/19313-2237/.minikube/profiles/addons-578168 for IP: 192.168.49.2
	I0722 10:30:58.525348    8575 certs.go:194] generating shared ca certs ...
	I0722 10:30:58.525378    8575 certs.go:226] acquiring lock for ca certs: {Name:mkc633027ec1393c6f58c3260e76c1b2d2250318 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0722 10:30:58.525541    8575 certs.go:240] generating "minikubeCA" ca cert: /home/jenkins/minikube-integration/19313-2237/.minikube/ca.key
	I0722 10:30:58.833993    8575 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19313-2237/.minikube/ca.crt ...
	I0722 10:30:58.834025    8575 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19313-2237/.minikube/ca.crt: {Name:mke6783e5d1c24da41875b3d91804f1fce7194b3 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0722 10:30:58.834240    8575 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19313-2237/.minikube/ca.key ...
	I0722 10:30:58.834254    8575 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19313-2237/.minikube/ca.key: {Name:mk1aec15eb580808707f9cef78882bcdc57202c6 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0722 10:30:58.834345    8575 certs.go:240] generating "proxyClientCA" ca cert: /home/jenkins/minikube-integration/19313-2237/.minikube/proxy-client-ca.key
	I0722 10:30:59.013482    8575 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19313-2237/.minikube/proxy-client-ca.crt ...
	I0722 10:30:59.013512    8575 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19313-2237/.minikube/proxy-client-ca.crt: {Name:mka1e8f1ca8a47f5a164bc4d361dc2d2d08e90dc Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0722 10:30:59.013693    8575 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19313-2237/.minikube/proxy-client-ca.key ...
	I0722 10:30:59.013706    8575 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19313-2237/.minikube/proxy-client-ca.key: {Name:mk059b9fa89bec6064c6aa8e2e64d880b01f053c Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0722 10:30:59.013785    8575 certs.go:256] generating profile certs ...
	I0722 10:30:59.013843    8575 certs.go:363] generating signed profile cert for "minikube-user": /home/jenkins/minikube-integration/19313-2237/.minikube/profiles/addons-578168/client.key
	I0722 10:30:59.013860    8575 crypto.go:68] Generating cert /home/jenkins/minikube-integration/19313-2237/.minikube/profiles/addons-578168/client.crt with IP's: []
	I0722 10:30:59.239607    8575 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19313-2237/.minikube/profiles/addons-578168/client.crt ...
	I0722 10:30:59.239635    8575 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19313-2237/.minikube/profiles/addons-578168/client.crt: {Name:mkcf38a53aa3753ac08897bbf4084dd587b84e3f Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0722 10:30:59.239864    8575 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19313-2237/.minikube/profiles/addons-578168/client.key ...
	I0722 10:30:59.239884    8575 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19313-2237/.minikube/profiles/addons-578168/client.key: {Name:mk3e53fc9eca4d0d666de39e2337ba1ef108a749 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0722 10:30:59.239999    8575 certs.go:363] generating signed profile cert for "minikube": /home/jenkins/minikube-integration/19313-2237/.minikube/profiles/addons-578168/apiserver.key.cc699dbf
	I0722 10:30:59.240017    8575 crypto.go:68] Generating cert /home/jenkins/minikube-integration/19313-2237/.minikube/profiles/addons-578168/apiserver.crt.cc699dbf with IP's: [10.96.0.1 127.0.0.1 10.0.0.1 192.168.49.2]
	I0722 10:30:59.460422    8575 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19313-2237/.minikube/profiles/addons-578168/apiserver.crt.cc699dbf ...
	I0722 10:30:59.460449    8575 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19313-2237/.minikube/profiles/addons-578168/apiserver.crt.cc699dbf: {Name:mkdf79dbfd472931f5680351719311354842f85c Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0722 10:30:59.460635    8575 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19313-2237/.minikube/profiles/addons-578168/apiserver.key.cc699dbf ...
	I0722 10:30:59.460648    8575 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19313-2237/.minikube/profiles/addons-578168/apiserver.key.cc699dbf: {Name:mk3d9da7c82f66b2c1e6d90af7f3348b5a93d69e Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0722 10:30:59.460735    8575 certs.go:381] copying /home/jenkins/minikube-integration/19313-2237/.minikube/profiles/addons-578168/apiserver.crt.cc699dbf -> /home/jenkins/minikube-integration/19313-2237/.minikube/profiles/addons-578168/apiserver.crt
	I0722 10:30:59.460813    8575 certs.go:385] copying /home/jenkins/minikube-integration/19313-2237/.minikube/profiles/addons-578168/apiserver.key.cc699dbf -> /home/jenkins/minikube-integration/19313-2237/.minikube/profiles/addons-578168/apiserver.key
	I0722 10:30:59.460903    8575 certs.go:363] generating signed profile cert for "aggregator": /home/jenkins/minikube-integration/19313-2237/.minikube/profiles/addons-578168/proxy-client.key
	I0722 10:30:59.460927    8575 crypto.go:68] Generating cert /home/jenkins/minikube-integration/19313-2237/.minikube/profiles/addons-578168/proxy-client.crt with IP's: []
	I0722 10:30:59.667753    8575 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19313-2237/.minikube/profiles/addons-578168/proxy-client.crt ...
	I0722 10:30:59.667783    8575 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19313-2237/.minikube/profiles/addons-578168/proxy-client.crt: {Name:mkb5e2f3ea6918a46f2571f39d6f800c1327505c Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0722 10:30:59.667967    8575 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19313-2237/.minikube/profiles/addons-578168/proxy-client.key ...
	I0722 10:30:59.668003    8575 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19313-2237/.minikube/profiles/addons-578168/proxy-client.key: {Name:mke5d7c8f3279cfb246e8bb7a6444238316eb428 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0722 10:30:59.668197    8575 certs.go:484] found cert: /home/jenkins/minikube-integration/19313-2237/.minikube/certs/ca-key.pem (1675 bytes)
	I0722 10:30:59.668242    8575 certs.go:484] found cert: /home/jenkins/minikube-integration/19313-2237/.minikube/certs/ca.pem (1078 bytes)
	I0722 10:30:59.668271    8575 certs.go:484] found cert: /home/jenkins/minikube-integration/19313-2237/.minikube/certs/cert.pem (1123 bytes)
	I0722 10:30:59.668300    8575 certs.go:484] found cert: /home/jenkins/minikube-integration/19313-2237/.minikube/certs/key.pem (1679 bytes)
	I0722 10:30:59.668940    8575 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19313-2237/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
	I0722 10:30:59.694353    8575 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19313-2237/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1675 bytes)
	I0722 10:30:59.718590    8575 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19313-2237/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
	I0722 10:30:59.742186    8575 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19313-2237/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1675 bytes)
	I0722 10:30:59.768458    8575 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19313-2237/.minikube/profiles/addons-578168/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1419 bytes)
	I0722 10:30:59.792569    8575 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19313-2237/.minikube/profiles/addons-578168/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1679 bytes)
	I0722 10:30:59.816371    8575 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19313-2237/.minikube/profiles/addons-578168/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
	I0722 10:30:59.840767    8575 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19313-2237/.minikube/profiles/addons-578168/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1679 bytes)
	I0722 10:30:59.864457    8575 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19313-2237/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
	I0722 10:30:59.888444    8575 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)
	I0722 10:30:59.906524    8575 ssh_runner.go:195] Run: openssl version
	I0722 10:30:59.911766    8575 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
	I0722 10:30:59.921092    8575 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
	I0722 10:30:59.924525    8575 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 Jul 22 10:30 /usr/share/ca-certificates/minikubeCA.pem
	I0722 10:30:59.924618    8575 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
	I0722 10:30:59.931638    8575 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
	I0722 10:30:59.940967    8575 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt
	I0722 10:30:59.945583    8575 certs.go:399] 'apiserver-kubelet-client' cert doesn't exist, likely first start: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt: Process exited with status 1
	stdout:
	
	stderr:
	stat: cannot statx '/var/lib/minikube/certs/apiserver-kubelet-client.crt': No such file or directory
	I0722 10:30:59.945632    8575 kubeadm.go:392] StartCluster: {Name:addons-578168 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721324606-19298@sha256:1c495b056df42bd3fd9a5c30d049e1802f9ed73a342611781f1ccc3c3853953f Memory:4000 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.30.3 ClusterName:addons-578168 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames
:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.49.2 Port:8443 KubernetesVersion:v1.30.3 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmware
Path: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I0722 10:30:59.945713    8575 cri.go:54] listing CRI containers in root : {State:paused Name: Namespaces:[kube-system]}
	I0722 10:30:59.945784    8575 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"
	I0722 10:31:00.010427    8575 cri.go:89] found id: ""
	I0722 10:31:00.010508    8575 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd
	I0722 10:31:00.030501    8575 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml
	I0722 10:31:00.054116    8575 kubeadm.go:214] ignoring SystemVerification for kubeadm because of docker driver
	I0722 10:31:00.054192    8575 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
	I0722 10:31:00.074802    8575 kubeadm.go:155] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
	stdout:
	
	stderr:
	ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
	ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
	ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
	ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
	I0722 10:31:00.074887    8575 kubeadm.go:157] found existing configuration files:
	
	I0722 10:31:00.074991    8575 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf
	I0722 10:31:00.093913    8575 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/admin.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf: Process exited with status 2
	stdout:
	
	stderr:
	grep: /etc/kubernetes/admin.conf: No such file or directory
	I0722 10:31:00.093979    8575 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/admin.conf
	I0722 10:31:00.139553    8575 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf
	I0722 10:31:00.166741    8575 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/kubelet.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf: Process exited with status 2
	stdout:
	
	stderr:
	grep: /etc/kubernetes/kubelet.conf: No such file or directory
	I0722 10:31:00.166877    8575 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/kubelet.conf
	I0722 10:31:00.184917    8575 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf
	I0722 10:31:00.201315    8575 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/controller-manager.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf: Process exited with status 2
	stdout:
	
	stderr:
	grep: /etc/kubernetes/controller-manager.conf: No such file or directory
	I0722 10:31:00.201397    8575 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/controller-manager.conf
	I0722 10:31:00.217306    8575 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf
	I0722 10:31:00.239367    8575 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/scheduler.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf: Process exited with status 2
	stdout:
	
	stderr:
	grep: /etc/kubernetes/scheduler.conf: No such file or directory
	I0722 10:31:00.239435    8575 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/scheduler.conf
	I0722 10:31:00.252238    8575 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.30.3:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml  --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem,SystemVerification,FileContent--proc-sys-net-bridge-bridge-nf-call-iptables"
	I0722 10:31:00.346328    8575 kubeadm.go:310] 	[WARNING SystemVerification]: failed to parse kernel config: unable to load kernel module: "configs", output: "modprobe: FATAL: Module configs not found in directory /lib/modules/5.15.0-1064-aws\n", err: exit status 1
	I0722 10:31:00.413474    8575 kubeadm.go:310] 	[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
	I0722 10:31:16.303663    8575 kubeadm.go:310] [init] Using Kubernetes version: v1.30.3
	I0722 10:31:16.303728    8575 kubeadm.go:310] [preflight] Running pre-flight checks
	I0722 10:31:16.303821    8575 kubeadm.go:310] [preflight] The system verification failed. Printing the output from the verification:
	I0722 10:31:16.303879    8575 kubeadm.go:310] KERNEL_VERSION: 5.15.0-1064-aws
	I0722 10:31:16.303916    8575 kubeadm.go:310] OS: Linux
	I0722 10:31:16.303964    8575 kubeadm.go:310] CGROUPS_CPU: enabled
	I0722 10:31:16.304014    8575 kubeadm.go:310] CGROUPS_CPUACCT: enabled
	I0722 10:31:16.304062    8575 kubeadm.go:310] CGROUPS_CPUSET: enabled
	I0722 10:31:16.304112    8575 kubeadm.go:310] CGROUPS_DEVICES: enabled
	I0722 10:31:16.304177    8575 kubeadm.go:310] CGROUPS_FREEZER: enabled
	I0722 10:31:16.304231    8575 kubeadm.go:310] CGROUPS_MEMORY: enabled
	I0722 10:31:16.304279    8575 kubeadm.go:310] CGROUPS_PIDS: enabled
	I0722 10:31:16.304328    8575 kubeadm.go:310] CGROUPS_HUGETLB: enabled
	I0722 10:31:16.304376    8575 kubeadm.go:310] CGROUPS_BLKIO: enabled
	I0722 10:31:16.304449    8575 kubeadm.go:310] [preflight] Pulling images required for setting up a Kubernetes cluster
	I0722 10:31:16.304547    8575 kubeadm.go:310] [preflight] This might take a minute or two, depending on the speed of your internet connection
	I0722 10:31:16.304640    8575 kubeadm.go:310] [preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
	I0722 10:31:16.304708    8575 kubeadm.go:310] [certs] Using certificateDir folder "/var/lib/minikube/certs"
	I0722 10:31:16.306988    8575 out.go:204]   - Generating certificates and keys ...
	I0722 10:31:16.307105    8575 kubeadm.go:310] [certs] Using existing ca certificate authority
	I0722 10:31:16.307195    8575 kubeadm.go:310] [certs] Using existing apiserver certificate and key on disk
	I0722 10:31:16.307275    8575 kubeadm.go:310] [certs] Generating "apiserver-kubelet-client" certificate and key
	I0722 10:31:16.307351    8575 kubeadm.go:310] [certs] Generating "front-proxy-ca" certificate and key
	I0722 10:31:16.307415    8575 kubeadm.go:310] [certs] Generating "front-proxy-client" certificate and key
	I0722 10:31:16.307469    8575 kubeadm.go:310] [certs] Generating "etcd/ca" certificate and key
	I0722 10:31:16.307537    8575 kubeadm.go:310] [certs] Generating "etcd/server" certificate and key
	I0722 10:31:16.307682    8575 kubeadm.go:310] [certs] etcd/server serving cert is signed for DNS names [addons-578168 localhost] and IPs [192.168.49.2 127.0.0.1 ::1]
	I0722 10:31:16.307746    8575 kubeadm.go:310] [certs] Generating "etcd/peer" certificate and key
	I0722 10:31:16.307903    8575 kubeadm.go:310] [certs] etcd/peer serving cert is signed for DNS names [addons-578168 localhost] and IPs [192.168.49.2 127.0.0.1 ::1]
	I0722 10:31:16.307994    8575 kubeadm.go:310] [certs] Generating "etcd/healthcheck-client" certificate and key
	I0722 10:31:16.308111    8575 kubeadm.go:310] [certs] Generating "apiserver-etcd-client" certificate and key
	I0722 10:31:16.308177    8575 kubeadm.go:310] [certs] Generating "sa" key and public key
	I0722 10:31:16.308248    8575 kubeadm.go:310] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"
	I0722 10:31:16.308321    8575 kubeadm.go:310] [kubeconfig] Writing "admin.conf" kubeconfig file
	I0722 10:31:16.308400    8575 kubeadm.go:310] [kubeconfig] Writing "super-admin.conf" kubeconfig file
	I0722 10:31:16.308470    8575 kubeadm.go:310] [kubeconfig] Writing "kubelet.conf" kubeconfig file
	I0722 10:31:16.308547    8575 kubeadm.go:310] [kubeconfig] Writing "controller-manager.conf" kubeconfig file
	I0722 10:31:16.308623    8575 kubeadm.go:310] [kubeconfig] Writing "scheduler.conf" kubeconfig file
	I0722 10:31:16.308716    8575 kubeadm.go:310] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
	I0722 10:31:16.308806    8575 kubeadm.go:310] [control-plane] Using manifest folder "/etc/kubernetes/manifests"
	I0722 10:31:16.310650    8575 out.go:204]   - Booting up control plane ...
	I0722 10:31:16.310751    8575 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-apiserver"
	I0722 10:31:16.310832    8575 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-controller-manager"
	I0722 10:31:16.310904    8575 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-scheduler"
	I0722 10:31:16.311007    8575 kubeadm.go:310] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
	I0722 10:31:16.311097    8575 kubeadm.go:310] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
	I0722 10:31:16.311140    8575 kubeadm.go:310] [kubelet-start] Starting the kubelet
	I0722 10:31:16.311271    8575 kubeadm.go:310] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests"
	I0722 10:31:16.311345    8575 kubeadm.go:310] [kubelet-check] Waiting for a healthy kubelet. This can take up to 4m0s
	I0722 10:31:16.311405    8575 kubeadm.go:310] [kubelet-check] The kubelet is healthy after 2.002493623s
	I0722 10:31:16.311475    8575 kubeadm.go:310] [api-check] Waiting for a healthy API server. This can take up to 4m0s
	I0722 10:31:16.311534    8575 kubeadm.go:310] [api-check] The API server is healthy after 5.501369959s
	I0722 10:31:16.311639    8575 kubeadm.go:310] [upload-config] Storing the configuration used in ConfigMap "kubeadm-config" in the "kube-system" Namespace
	I0722 10:31:16.311762    8575 kubeadm.go:310] [kubelet] Creating a ConfigMap "kubelet-config" in namespace kube-system with the configuration for the kubelets in the cluster
	I0722 10:31:16.311827    8575 kubeadm.go:310] [upload-certs] Skipping phase. Please see --upload-certs
	I0722 10:31:16.312004    8575 kubeadm.go:310] [mark-control-plane] Marking the node addons-578168 as control-plane by adding the labels: [node-role.kubernetes.io/control-plane node.kubernetes.io/exclude-from-external-load-balancers]
	I0722 10:31:16.312062    8575 kubeadm.go:310] [bootstrap-token] Using token: 1hiflh.gzphognequh4f0si
	I0722 10:31:16.315434    8575 out.go:204]   - Configuring RBAC rules ...
	I0722 10:31:16.315553    8575 kubeadm.go:310] [bootstrap-token] Configuring bootstrap tokens, cluster-info ConfigMap, RBAC Roles
	I0722 10:31:16.315643    8575 kubeadm.go:310] [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to get nodes
	I0722 10:31:16.315782    8575 kubeadm.go:310] [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to post CSRs in order for nodes to get long term certificate credentials
	I0722 10:31:16.315929    8575 kubeadm.go:310] [bootstrap-token] Configured RBAC rules to allow the csrapprover controller automatically approve CSRs from a Node Bootstrap Token
	I0722 10:31:16.316044    8575 kubeadm.go:310] [bootstrap-token] Configured RBAC rules to allow certificate rotation for all node client certificates in the cluster
	I0722 10:31:16.316129    8575 kubeadm.go:310] [bootstrap-token] Creating the "cluster-info" ConfigMap in the "kube-public" namespace
	I0722 10:31:16.316256    8575 kubeadm.go:310] [kubelet-finalize] Updating "/etc/kubernetes/kubelet.conf" to point to a rotatable kubelet client certificate and key
	I0722 10:31:16.316302    8575 kubeadm.go:310] [addons] Applied essential addon: CoreDNS
	I0722 10:31:16.316360    8575 kubeadm.go:310] [addons] Applied essential addon: kube-proxy
	I0722 10:31:16.316370    8575 kubeadm.go:310] 
	I0722 10:31:16.316428    8575 kubeadm.go:310] Your Kubernetes control-plane has initialized successfully!
	I0722 10:31:16.316437    8575 kubeadm.go:310] 
	I0722 10:31:16.316516    8575 kubeadm.go:310] To start using your cluster, you need to run the following as a regular user:
	I0722 10:31:16.316525    8575 kubeadm.go:310] 
	I0722 10:31:16.316550    8575 kubeadm.go:310]   mkdir -p $HOME/.kube
	I0722 10:31:16.316615    8575 kubeadm.go:310]   sudo cp -i /etc/kubernetes/admin.conf $HOME/.kube/config
	I0722 10:31:16.316668    8575 kubeadm.go:310]   sudo chown $(id -u):$(id -g) $HOME/.kube/config
	I0722 10:31:16.316676    8575 kubeadm.go:310] 
	I0722 10:31:16.316728    8575 kubeadm.go:310] Alternatively, if you are the root user, you can run:
	I0722 10:31:16.316736    8575 kubeadm.go:310] 
	I0722 10:31:16.316781    8575 kubeadm.go:310]   export KUBECONFIG=/etc/kubernetes/admin.conf
	I0722 10:31:16.316790    8575 kubeadm.go:310] 
	I0722 10:31:16.316840    8575 kubeadm.go:310] You should now deploy a pod network to the cluster.
	I0722 10:31:16.316934    8575 kubeadm.go:310] Run "kubectl apply -f [podnetwork].yaml" with one of the options listed at:
	I0722 10:31:16.317025    8575 kubeadm.go:310]   https://kubernetes.io/docs/concepts/cluster-administration/addons/
	I0722 10:31:16.317036    8575 kubeadm.go:310] 
	I0722 10:31:16.317118    8575 kubeadm.go:310] You can now join any number of control-plane nodes by copying certificate authorities
	I0722 10:31:16.317192    8575 kubeadm.go:310] and service account keys on each node and then running the following as root:
	I0722 10:31:16.317196    8575 kubeadm.go:310] 
	I0722 10:31:16.317276    8575 kubeadm.go:310]   kubeadm join control-plane.minikube.internal:8443 --token 1hiflh.gzphognequh4f0si \
	I0722 10:31:16.317392    8575 kubeadm.go:310] 	--discovery-token-ca-cert-hash sha256:f7bc1c869ca0058fd4273fc1112c05a52361550e75cdb524f71ef7e71fc9b86a \
	I0722 10:31:16.317412    8575 kubeadm.go:310] 	--control-plane 
	I0722 10:31:16.317416    8575 kubeadm.go:310] 
	I0722 10:31:16.317498    8575 kubeadm.go:310] Then you can join any number of worker nodes by running the following on each as root:
	I0722 10:31:16.317517    8575 kubeadm.go:310] 
	I0722 10:31:16.317633    8575 kubeadm.go:310] kubeadm join control-plane.minikube.internal:8443 --token 1hiflh.gzphognequh4f0si \
	I0722 10:31:16.317757    8575 kubeadm.go:310] 	--discovery-token-ca-cert-hash sha256:f7bc1c869ca0058fd4273fc1112c05a52361550e75cdb524f71ef7e71fc9b86a 
	I0722 10:31:16.317770    8575 cni.go:84] Creating CNI manager for ""
	I0722 10:31:16.317778    8575 cni.go:143] "docker" driver + "crio" runtime found, recommending kindnet
	I0722 10:31:16.319956    8575 out.go:177] * Configuring CNI (Container Networking Interface) ...
	I0722 10:31:16.321985    8575 ssh_runner.go:195] Run: stat /opt/cni/bin/portmap
	I0722 10:31:16.325734    8575 cni.go:182] applying CNI manifest using /var/lib/minikube/binaries/v1.30.3/kubectl ...
	I0722 10:31:16.325757    8575 ssh_runner.go:362] scp memory --> /var/tmp/minikube/cni.yaml (2438 bytes)
	I0722 10:31:16.343694    8575 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.3/kubectl apply --kubeconfig=/var/lib/minikube/kubeconfig -f /var/tmp/minikube/cni.yaml
	I0722 10:31:16.600057    8575 ssh_runner.go:195] Run: /bin/bash -c "cat /proc/$(pgrep kube-apiserver)/oom_adj"
	I0722 10:31:16.600196    8575 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.3/kubectl create clusterrolebinding minikube-rbac --clusterrole=cluster-admin --serviceaccount=kube-system:default --kubeconfig=/var/lib/minikube/kubeconfig
	I0722 10:31:16.600289    8575 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.3/kubectl --kubeconfig=/var/lib/minikube/kubeconfig label --overwrite nodes addons-578168 minikube.k8s.io/updated_at=2024_07_22T10_31_16_0700 minikube.k8s.io/version=v1.33.1 minikube.k8s.io/commit=8e5b1d22910d5d447b525af478862a848159d7b7 minikube.k8s.io/name=addons-578168 minikube.k8s.io/primary=true
	I0722 10:31:16.724089    8575 ops.go:34] apiserver oom_adj: -16
	I0722 10:31:16.724194    8575 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0722 10:31:17.225277    8575 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0722 10:31:17.724253    8575 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0722 10:31:18.224278    8575 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0722 10:31:18.724854    8575 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0722 10:31:19.224487    8575 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0722 10:31:19.724936    8575 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0722 10:31:20.224468    8575 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0722 10:31:20.724376    8575 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0722 10:31:21.224335    8575 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0722 10:31:21.724842    8575 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0722 10:31:22.224599    8575 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0722 10:31:22.724832    8575 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0722 10:31:23.225019    8575 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0722 10:31:23.724903    8575 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0722 10:31:24.225069    8575 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0722 10:31:24.724783    8575 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0722 10:31:25.224910    8575 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0722 10:31:25.724392    8575 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0722 10:31:26.225277    8575 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0722 10:31:26.724603    8575 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0722 10:31:27.224670    8575 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0722 10:31:27.724989    8575 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0722 10:31:28.224494    8575 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0722 10:31:28.724838    8575 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0722 10:31:29.224315    8575 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0722 10:31:29.724842    8575 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0722 10:31:29.865961    8575 kubeadm.go:1113] duration metric: took 13.265820413s to wait for elevateKubeSystemPrivileges
	I0722 10:31:29.866000    8575 kubeadm.go:394] duration metric: took 29.920365856s to StartCluster
	I0722 10:31:29.866017    8575 settings.go:142] acquiring lock: {Name:mk5fbd205fde0f82abe2a5378554c5e9944b6110 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0722 10:31:29.866125    8575 settings.go:150] Updating kubeconfig:  /home/jenkins/minikube-integration/19313-2237/kubeconfig
	I0722 10:31:29.866492    8575 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19313-2237/kubeconfig: {Name:mkcc86b3f46ba469151bab0be6d762245d79cdb6 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0722 10:31:29.866681    8575 start.go:235] Will wait 6m0s for node &{Name: IP:192.168.49.2 Port:8443 KubernetesVersion:v1.30.3 ContainerRuntime:crio ControlPlane:true Worker:true}
	I0722 10:31:29.866783    8575 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.30.3/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml"
	I0722 10:31:29.867024    8575 config.go:182] Loaded profile config "addons-578168": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.30.3
	I0722 10:31:29.867060    8575 addons.go:507] enable addons start: toEnable=map[ambassador:false auto-pause:false cloud-spanner:true csi-hostpath-driver:true dashboard:false default-storageclass:true efk:false freshpod:false gcp-auth:true gvisor:false headlamp:false helm-tiller:false inaccel:false ingress:true ingress-dns:true inspektor-gadget:true istio:false istio-provisioner:false kong:false kubeflow:false kubevirt:false logviewer:false metallb:false metrics-server:true nvidia-device-plugin:true nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:true registry-aliases:false registry-creds:false storage-provisioner:true storage-provisioner-gluster:false storage-provisioner-rancher:true volcano:true volumesnapshots:true yakd:true]
	I0722 10:31:29.867135    8575 addons.go:69] Setting yakd=true in profile "addons-578168"
	I0722 10:31:29.867159    8575 addons.go:234] Setting addon yakd=true in "addons-578168"
	I0722 10:31:29.867204    8575 host.go:66] Checking if "addons-578168" exists ...
	I0722 10:31:29.867637    8575 cli_runner.go:164] Run: docker container inspect addons-578168 --format={{.State.Status}}
	I0722 10:31:29.868090    8575 addons.go:69] Setting inspektor-gadget=true in profile "addons-578168"
	I0722 10:31:29.868128    8575 addons.go:234] Setting addon inspektor-gadget=true in "addons-578168"
	I0722 10:31:29.868155    8575 host.go:66] Checking if "addons-578168" exists ...
	I0722 10:31:29.868562    8575 cli_runner.go:164] Run: docker container inspect addons-578168 --format={{.State.Status}}
	I0722 10:31:29.868705    8575 addons.go:69] Setting metrics-server=true in profile "addons-578168"
	I0722 10:31:29.868737    8575 addons.go:234] Setting addon metrics-server=true in "addons-578168"
	I0722 10:31:29.868764    8575 host.go:66] Checking if "addons-578168" exists ...
	I0722 10:31:29.868957    8575 addons.go:69] Setting nvidia-device-plugin=true in profile "addons-578168"
	I0722 10:31:29.868977    8575 addons.go:234] Setting addon nvidia-device-plugin=true in "addons-578168"
	I0722 10:31:29.868995    8575 host.go:66] Checking if "addons-578168" exists ...
	I0722 10:31:29.869359    8575 cli_runner.go:164] Run: docker container inspect addons-578168 --format={{.State.Status}}
	I0722 10:31:29.871859    8575 addons.go:69] Setting cloud-spanner=true in profile "addons-578168"
	I0722 10:31:29.874450    8575 addons.go:234] Setting addon cloud-spanner=true in "addons-578168"
	I0722 10:31:29.874495    8575 host.go:66] Checking if "addons-578168" exists ...
	I0722 10:31:29.874915    8575 cli_runner.go:164] Run: docker container inspect addons-578168 --format={{.State.Status}}
	I0722 10:31:29.875158    8575 addons.go:69] Setting registry=true in profile "addons-578168"
	I0722 10:31:29.875183    8575 addons.go:234] Setting addon registry=true in "addons-578168"
	I0722 10:31:29.875206    8575 host.go:66] Checking if "addons-578168" exists ...
	I0722 10:31:29.875573    8575 cli_runner.go:164] Run: docker container inspect addons-578168 --format={{.State.Status}}
	I0722 10:31:29.876223    8575 addons.go:69] Setting storage-provisioner=true in profile "addons-578168"
	I0722 10:31:29.876349    8575 addons.go:234] Setting addon storage-provisioner=true in "addons-578168"
	I0722 10:31:29.876395    8575 host.go:66] Checking if "addons-578168" exists ...
	I0722 10:31:29.876965    8575 cli_runner.go:164] Run: docker container inspect addons-578168 --format={{.State.Status}}
	I0722 10:31:29.872077    8575 addons.go:69] Setting csi-hostpath-driver=true in profile "addons-578168"
	I0722 10:31:29.888753    8575 addons.go:234] Setting addon csi-hostpath-driver=true in "addons-578168"
	I0722 10:31:29.888804    8575 host.go:66] Checking if "addons-578168" exists ...
	I0722 10:31:29.889275    8575 cli_runner.go:164] Run: docker container inspect addons-578168 --format={{.State.Status}}
	I0722 10:31:29.872090    8575 addons.go:69] Setting default-storageclass=true in profile "addons-578168"
	I0722 10:31:29.904777    8575 addons_storage_classes.go:33] enableOrDisableStorageClasses default-storageclass=true on "addons-578168"
	I0722 10:31:29.905221    8575 cli_runner.go:164] Run: docker container inspect addons-578168 --format={{.State.Status}}
	I0722 10:31:29.906562    8575 addons.go:69] Setting storage-provisioner-rancher=true in profile "addons-578168"
	I0722 10:31:29.906628    8575 addons_storage_classes.go:33] enableOrDisableStorageClasses storage-provisioner-rancher=true on "addons-578168"
	I0722 10:31:29.907005    8575 cli_runner.go:164] Run: docker container inspect addons-578168 --format={{.State.Status}}
	I0722 10:31:29.935580    8575 addons.go:69] Setting volcano=true in profile "addons-578168"
	I0722 10:31:29.935629    8575 addons.go:234] Setting addon volcano=true in "addons-578168"
	I0722 10:31:29.935676    8575 host.go:66] Checking if "addons-578168" exists ...
	I0722 10:31:29.936125    8575 cli_runner.go:164] Run: docker container inspect addons-578168 --format={{.State.Status}}
	I0722 10:31:29.872095    8575 addons.go:69] Setting gcp-auth=true in profile "addons-578168"
	I0722 10:31:29.950111    8575 mustload.go:65] Loading cluster: addons-578168
	I0722 10:31:29.950321    8575 config.go:182] Loaded profile config "addons-578168": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.30.3
	I0722 10:31:29.950638    8575 cli_runner.go:164] Run: docker container inspect addons-578168 --format={{.State.Status}}
	I0722 10:31:29.967793    8575 addons.go:69] Setting volumesnapshots=true in profile "addons-578168"
	I0722 10:31:29.967852    8575 addons.go:234] Setting addon volumesnapshots=true in "addons-578168"
	I0722 10:31:29.967890    8575 host.go:66] Checking if "addons-578168" exists ...
	I0722 10:31:29.872099    8575 addons.go:69] Setting ingress=true in profile "addons-578168"
	I0722 10:31:29.968135    8575 addons.go:234] Setting addon ingress=true in "addons-578168"
	I0722 10:31:29.872103    8575 addons.go:69] Setting ingress-dns=true in profile "addons-578168"
	I0722 10:31:29.968172    8575 addons.go:234] Setting addon ingress-dns=true in "addons-578168"
	I0722 10:31:29.968201    8575 host.go:66] Checking if "addons-578168" exists ...
	I0722 10:31:29.872604    8575 cli_runner.go:164] Run: docker container inspect addons-578168 --format={{.State.Status}}
	I0722 10:31:29.881634    8575 out.go:177] * Verifying Kubernetes components...
	I0722 10:31:29.968535    8575 cli_runner.go:164] Run: docker container inspect addons-578168 --format={{.State.Status}}
	I0722 10:31:30.008694    8575 out.go:177]   - Using image nvcr.io/nvidia/k8s-device-plugin:v0.16.0
	I0722 10:31:30.011605    8575 addons.go:431] installing /etc/kubernetes/addons/nvidia-device-plugin.yaml
	I0722 10:31:30.012035    8575 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/nvidia-device-plugin.yaml (1966 bytes)
	I0722 10:31:30.012115    8575 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-578168
	I0722 10:31:30.025090    8575 out.go:177]   - Using image ghcr.io/inspektor-gadget/inspektor-gadget:v0.30.0
	I0722 10:31:29.976626    8575 host.go:66] Checking if "addons-578168" exists ...
	I0722 10:31:30.028256    8575 cli_runner.go:164] Run: docker container inspect addons-578168 --format={{.State.Status}}
	I0722 10:31:29.976813    8575 ssh_runner.go:195] Run: sudo systemctl daemon-reload
	I0722 10:31:29.977000    8575 cli_runner.go:164] Run: docker container inspect addons-578168 --format={{.State.Status}}
	I0722 10:31:30.075745    8575 out.go:177]   - Using image gcr.io/cloud-spanner-emulator/emulator:1.5.17
	I0722 10:31:30.077846    8575 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.30.3/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml | sed -e '/^        forward . \/etc\/resolv.conf.*/i \        hosts {\n           192.168.49.1 host.minikube.internal\n           fallthrough\n        }' -e '/^        errors *$/i \        log' | sudo /var/lib/minikube/binaries/v1.30.3/kubectl --kubeconfig=/var/lib/minikube/kubeconfig replace -f -"
	I0722 10:31:30.078174    8575 addons.go:431] installing /etc/kubernetes/addons/deployment.yaml
	I0722 10:31:30.078187    8575 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/deployment.yaml (1004 bytes)
	I0722 10:31:30.078253    8575 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-578168
	I0722 10:31:30.027537    8575 addons.go:431] installing /etc/kubernetes/addons/ig-namespace.yaml
	I0722 10:31:30.078507    8575 ssh_runner.go:362] scp inspektor-gadget/ig-namespace.yaml --> /etc/kubernetes/addons/ig-namespace.yaml (55 bytes)
	I0722 10:31:30.027550    8575 out.go:177]   - Using image docker.io/marcnuri/yakd:0.0.5
	I0722 10:31:30.080788    8575 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-578168
	I0722 10:31:30.101092    8575 addons.go:431] installing /etc/kubernetes/addons/yakd-ns.yaml
	I0722 10:31:30.101122    8575 ssh_runner.go:362] scp yakd/yakd-ns.yaml --> /etc/kubernetes/addons/yakd-ns.yaml (171 bytes)
	I0722 10:31:30.101200    8575 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-578168
	I0722 10:31:30.135733    8575 addons.go:234] Setting addon storage-provisioner-rancher=true in "addons-578168"
	I0722 10:31:30.135775    8575 host.go:66] Checking if "addons-578168" exists ...
	I0722 10:31:30.136088    8575 addons.go:234] Setting addon default-storageclass=true in "addons-578168"
	I0722 10:31:30.136117    8575 host.go:66] Checking if "addons-578168" exists ...
	I0722 10:31:30.136189    8575 cli_runner.go:164] Run: docker container inspect addons-578168 --format={{.State.Status}}
	I0722 10:31:30.136481    8575 cli_runner.go:164] Run: docker container inspect addons-578168 --format={{.State.Status}}
	I0722 10:31:30.154899    8575 out.go:177]   - Using image docker.io/registry:2.8.3
	I0722 10:31:30.159674    8575 out.go:177]   - Using image gcr.io/k8s-minikube/kube-registry-proxy:0.0.6
	I0722 10:31:30.164634    8575 addons.go:431] installing /etc/kubernetes/addons/registry-rc.yaml
	I0722 10:31:30.164657    8575 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/registry-rc.yaml (860 bytes)
	I0722 10:31:30.164726    8575 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-578168
	I0722 10:31:30.194242    8575 out.go:177]   - Using image gcr.io/k8s-minikube/storage-provisioner:v5
	I0722 10:31:30.194417    8575 out.go:177]   - Using image registry.k8s.io/sig-storage/livenessprobe:v2.8.0
	I0722 10:31:30.196790    8575 out.go:177]   - Using image registry.k8s.io/sig-storage/csi-resizer:v1.6.0
	I0722 10:31:30.197196    8575 addons.go:431] installing /etc/kubernetes/addons/storage-provisioner.yaml
	I0722 10:31:30.197214    8575 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storage-provisioner.yaml (2676 bytes)
	I0722 10:31:30.197298    8575 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-578168
	I0722 10:31:30.218090    8575 out.go:177]   - Using image registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0
	I0722 10:31:30.219958    8575 out.go:177]   - Using image registry.k8s.io/metrics-server/metrics-server:v0.7.1
	I0722 10:31:30.221875    8575 addons.go:431] installing /etc/kubernetes/addons/metrics-apiservice.yaml
	I0722 10:31:30.221906    8575 ssh_runner.go:362] scp metrics-server/metrics-apiservice.yaml --> /etc/kubernetes/addons/metrics-apiservice.yaml (424 bytes)
	I0722 10:31:30.221985    8575 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-578168
	I0722 10:31:30.235942    8575 out.go:177]   - Using image registry.k8s.io/sig-storage/csi-provisioner:v3.3.0
	I0722 10:31:30.240705    8575 out.go:177]   - Using image registry.k8s.io/sig-storage/csi-attacher:v4.0.0
	I0722 10:31:30.242346    8575 out.go:177]   - Using image registry.k8s.io/sig-storage/csi-external-health-monitor-controller:v0.7.0
	I0722 10:31:30.249065    8575 out.go:177]   - Using image registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.6.0
	I0722 10:31:30.250980    8575 out.go:177]   - Using image registry.k8s.io/sig-storage/hostpathplugin:v1.9.0
	I0722 10:31:30.257368    8575 out.go:177]   - Using image registry.k8s.io/sig-storage/snapshot-controller:v6.1.0
	W0722 10:31:30.257699    8575 out.go:239] ! Enabling 'volcano' returned an error: running callbacks: [volcano addon does not support crio]
	I0722 10:31:30.257775    8575 addons.go:431] installing /etc/kubernetes/addons/rbac-external-attacher.yaml
	I0722 10:31:30.257785    8575 ssh_runner.go:362] scp csi-hostpath-driver/rbac/rbac-external-attacher.yaml --> /etc/kubernetes/addons/rbac-external-attacher.yaml (3073 bytes)
	I0722 10:31:30.257848    8575 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-578168
	I0722 10:31:30.259095    8575 addons.go:431] installing /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml
	I0722 10:31:30.259113    8575 ssh_runner.go:362] scp volumesnapshots/csi-hostpath-snapshotclass.yaml --> /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml (934 bytes)
	I0722 10:31:30.259175    8575 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-578168
	I0722 10:31:30.286324    8575 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32768 SSHKeyPath:/home/jenkins/minikube-integration/19313-2237/.minikube/machines/addons-578168/id_rsa Username:docker}
	I0722 10:31:30.298025    8575 host.go:66] Checking if "addons-578168" exists ...
	I0722 10:31:30.298309    8575 out.go:177]   - Using image registry.k8s.io/ingress-nginx/controller:v1.11.1
	I0722 10:31:30.303061    8575 out.go:177]   - Using image registry.k8s.io/ingress-nginx/kube-webhook-certgen:v1.4.1
	I0722 10:31:30.307782    8575 out.go:177]   - Using image registry.k8s.io/ingress-nginx/kube-webhook-certgen:v1.4.1
	I0722 10:31:30.310278    8575 addons.go:431] installing /etc/kubernetes/addons/ingress-deploy.yaml
	I0722 10:31:30.310297    8575 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/ingress-deploy.yaml (16078 bytes)
	I0722 10:31:30.310363    8575 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-578168
	I0722 10:31:30.356982    8575 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32768 SSHKeyPath:/home/jenkins/minikube-integration/19313-2237/.minikube/machines/addons-578168/id_rsa Username:docker}
	I0722 10:31:30.362522    8575 out.go:177]   - Using image gcr.io/k8s-minikube/minikube-ingress-dns:0.0.3
	I0722 10:31:30.364234    8575 addons.go:431] installing /etc/kubernetes/addons/ingress-dns-pod.yaml
	I0722 10:31:30.364256    8575 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/ingress-dns-pod.yaml (2442 bytes)
	I0722 10:31:30.364324    8575 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-578168
	I0722 10:31:30.397174    8575 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32768 SSHKeyPath:/home/jenkins/minikube-integration/19313-2237/.minikube/machines/addons-578168/id_rsa Username:docker}
	I0722 10:31:30.403983    8575 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32768 SSHKeyPath:/home/jenkins/minikube-integration/19313-2237/.minikube/machines/addons-578168/id_rsa Username:docker}
	I0722 10:31:30.409215    8575 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32768 SSHKeyPath:/home/jenkins/minikube-integration/19313-2237/.minikube/machines/addons-578168/id_rsa Username:docker}
	I0722 10:31:30.418605    8575 out.go:177]   - Using image docker.io/rancher/local-path-provisioner:v0.0.22
	I0722 10:31:30.420383    8575 out.go:177]   - Using image docker.io/busybox:stable
	I0722 10:31:30.421977    8575 addons.go:431] installing /etc/kubernetes/addons/storage-provisioner-rancher.yaml
	I0722 10:31:30.422002    8575 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storage-provisioner-rancher.yaml (3113 bytes)
	I0722 10:31:30.422066    8575 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-578168
	I0722 10:31:30.432332    8575 addons.go:431] installing /etc/kubernetes/addons/storageclass.yaml
	I0722 10:31:30.432355    8575 ssh_runner.go:362] scp storageclass/storageclass.yaml --> /etc/kubernetes/addons/storageclass.yaml (271 bytes)
	I0722 10:31:30.432421    8575 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-578168
	I0722 10:31:30.444784    8575 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32768 SSHKeyPath:/home/jenkins/minikube-integration/19313-2237/.minikube/machines/addons-578168/id_rsa Username:docker}
	I0722 10:31:30.445250    8575 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32768 SSHKeyPath:/home/jenkins/minikube-integration/19313-2237/.minikube/machines/addons-578168/id_rsa Username:docker}
	I0722 10:31:30.477346    8575 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32768 SSHKeyPath:/home/jenkins/minikube-integration/19313-2237/.minikube/machines/addons-578168/id_rsa Username:docker}
	I0722 10:31:30.489995    8575 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32768 SSHKeyPath:/home/jenkins/minikube-integration/19313-2237/.minikube/machines/addons-578168/id_rsa Username:docker}
	I0722 10:31:30.503340    8575 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32768 SSHKeyPath:/home/jenkins/minikube-integration/19313-2237/.minikube/machines/addons-578168/id_rsa Username:docker}
	I0722 10:31:30.505530    8575 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32768 SSHKeyPath:/home/jenkins/minikube-integration/19313-2237/.minikube/machines/addons-578168/id_rsa Username:docker}
	I0722 10:31:30.537044    8575 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32768 SSHKeyPath:/home/jenkins/minikube-integration/19313-2237/.minikube/machines/addons-578168/id_rsa Username:docker}
	I0722 10:31:30.539837    8575 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32768 SSHKeyPath:/home/jenkins/minikube-integration/19313-2237/.minikube/machines/addons-578168/id_rsa Username:docker}
	I0722 10:31:30.729029    8575 ssh_runner.go:195] Run: sudo systemctl start kubelet
	I0722 10:31:30.752061    8575 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.3/kubectl apply -f /etc/kubernetes/addons/deployment.yaml
	I0722 10:31:30.824250    8575 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.3/kubectl apply -f /etc/kubernetes/addons/nvidia-device-plugin.yaml
	I0722 10:31:30.939418    8575 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.3/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml
	I0722 10:31:30.951299    8575 addons.go:431] installing /etc/kubernetes/addons/ig-serviceaccount.yaml
	I0722 10:31:30.951372    8575 ssh_runner.go:362] scp inspektor-gadget/ig-serviceaccount.yaml --> /etc/kubernetes/addons/ig-serviceaccount.yaml (80 bytes)
	I0722 10:31:30.954252    8575 addons.go:431] installing /etc/kubernetes/addons/yakd-sa.yaml
	I0722 10:31:30.954311    8575 ssh_runner.go:362] scp yakd/yakd-sa.yaml --> /etc/kubernetes/addons/yakd-sa.yaml (247 bytes)
	I0722 10:31:30.957841    8575 addons.go:431] installing /etc/kubernetes/addons/metrics-server-deployment.yaml
	I0722 10:31:30.957908    8575 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-server-deployment.yaml (1907 bytes)
	I0722 10:31:30.964816    8575 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.3/kubectl apply -f /etc/kubernetes/addons/ingress-deploy.yaml
	I0722 10:31:30.967237    8575 addons.go:431] installing /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml
	I0722 10:31:30.967296    8575 ssh_runner.go:362] scp volumesnapshots/snapshot.storage.k8s.io_volumesnapshotclasses.yaml --> /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml (6471 bytes)
	I0722 10:31:31.039480    8575 addons.go:431] installing /etc/kubernetes/addons/rbac-hostpath.yaml
	I0722 10:31:31.039593    8575 ssh_runner.go:362] scp csi-hostpath-driver/rbac/rbac-hostpath.yaml --> /etc/kubernetes/addons/rbac-hostpath.yaml (4266 bytes)
	I0722 10:31:31.044651    8575 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.3/kubectl apply -f /etc/kubernetes/addons/ingress-dns-pod.yaml
	I0722 10:31:31.048137    8575 addons.go:431] installing /etc/kubernetes/addons/metrics-server-rbac.yaml
	I0722 10:31:31.048208    8575 ssh_runner.go:362] scp metrics-server/metrics-server-rbac.yaml --> /etc/kubernetes/addons/metrics-server-rbac.yaml (2175 bytes)
	I0722 10:31:31.056365    8575 addons.go:431] installing /etc/kubernetes/addons/registry-svc.yaml
	I0722 10:31:31.056440    8575 ssh_runner.go:362] scp registry/registry-svc.yaml --> /etc/kubernetes/addons/registry-svc.yaml (398 bytes)
	I0722 10:31:31.062961    8575 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.3/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml
	I0722 10:31:31.063954    8575 addons.go:431] installing /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml
	I0722 10:31:31.064037    8575 ssh_runner.go:362] scp volumesnapshots/snapshot.storage.k8s.io_volumesnapshotcontents.yaml --> /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml (23126 bytes)
	I0722 10:31:31.132461    8575 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.3/kubectl apply -f /etc/kubernetes/addons/storage-provisioner-rancher.yaml
	I0722 10:31:31.163088    8575 addons.go:431] installing /etc/kubernetes/addons/yakd-crb.yaml
	I0722 10:31:31.163160    8575 ssh_runner.go:362] scp yakd/yakd-crb.yaml --> /etc/kubernetes/addons/yakd-crb.yaml (422 bytes)
	I0722 10:31:31.176226    8575 addons.go:431] installing /etc/kubernetes/addons/metrics-server-service.yaml
	I0722 10:31:31.176298    8575 ssh_runner.go:362] scp metrics-server/metrics-server-service.yaml --> /etc/kubernetes/addons/metrics-server-service.yaml (446 bytes)
	I0722 10:31:31.184989    8575 addons.go:431] installing /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml
	I0722 10:31:31.185064    8575 ssh_runner.go:362] scp volumesnapshots/snapshot.storage.k8s.io_volumesnapshots.yaml --> /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml (19582 bytes)
	I0722 10:31:31.187158    8575 addons.go:431] installing /etc/kubernetes/addons/ig-role.yaml
	I0722 10:31:31.187229    8575 ssh_runner.go:362] scp inspektor-gadget/ig-role.yaml --> /etc/kubernetes/addons/ig-role.yaml (210 bytes)
	I0722 10:31:31.236692    8575 addons.go:431] installing /etc/kubernetes/addons/rbac-external-health-monitor-controller.yaml
	I0722 10:31:31.236765    8575 ssh_runner.go:362] scp csi-hostpath-driver/rbac/rbac-external-health-monitor-controller.yaml --> /etc/kubernetes/addons/rbac-external-health-monitor-controller.yaml (3038 bytes)
	I0722 10:31:31.242480    8575 addons.go:431] installing /etc/kubernetes/addons/registry-proxy.yaml
	I0722 10:31:31.242545    8575 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/registry-proxy.yaml (947 bytes)
	I0722 10:31:31.315175    8575 addons.go:431] installing /etc/kubernetes/addons/ig-rolebinding.yaml
	I0722 10:31:31.315246    8575 ssh_runner.go:362] scp inspektor-gadget/ig-rolebinding.yaml --> /etc/kubernetes/addons/ig-rolebinding.yaml (244 bytes)
	I0722 10:31:31.318592    8575 addons.go:431] installing /etc/kubernetes/addons/yakd-svc.yaml
	I0722 10:31:31.318660    8575 ssh_runner.go:362] scp yakd/yakd-svc.yaml --> /etc/kubernetes/addons/yakd-svc.yaml (412 bytes)
	I0722 10:31:31.321980    8575 addons.go:431] installing /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml
	I0722 10:31:31.322052    8575 ssh_runner.go:362] scp volumesnapshots/rbac-volume-snapshot-controller.yaml --> /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml (3545 bytes)
	I0722 10:31:31.325325    8575 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.3/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
	I0722 10:31:31.421464    8575 addons.go:431] installing /etc/kubernetes/addons/rbac-external-provisioner.yaml
	I0722 10:31:31.421537    8575 ssh_runner.go:362] scp csi-hostpath-driver/rbac/rbac-external-provisioner.yaml --> /etc/kubernetes/addons/rbac-external-provisioner.yaml (4442 bytes)
	I0722 10:31:31.427033    8575 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.3/kubectl apply -f /etc/kubernetes/addons/registry-rc.yaml -f /etc/kubernetes/addons/registry-svc.yaml -f /etc/kubernetes/addons/registry-proxy.yaml
	I0722 10:31:31.495741    8575 addons.go:431] installing /etc/kubernetes/addons/yakd-dp.yaml
	I0722 10:31:31.495812    8575 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/yakd-dp.yaml (2017 bytes)
	I0722 10:31:31.503657    8575 addons.go:431] installing /etc/kubernetes/addons/ig-clusterrole.yaml
	I0722 10:31:31.503728    8575 ssh_runner.go:362] scp inspektor-gadget/ig-clusterrole.yaml --> /etc/kubernetes/addons/ig-clusterrole.yaml (1485 bytes)
	I0722 10:31:31.514263    8575 addons.go:431] installing /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml
	I0722 10:31:31.514335    8575 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml (1475 bytes)
	I0722 10:31:31.678813    8575 addons.go:431] installing /etc/kubernetes/addons/rbac-external-resizer.yaml
	I0722 10:31:31.678889    8575 ssh_runner.go:362] scp csi-hostpath-driver/rbac/rbac-external-resizer.yaml --> /etc/kubernetes/addons/rbac-external-resizer.yaml (2943 bytes)
	I0722 10:31:31.712667    8575 addons.go:431] installing /etc/kubernetes/addons/ig-clusterrolebinding.yaml
	I0722 10:31:31.712697    8575 ssh_runner.go:362] scp inspektor-gadget/ig-clusterrolebinding.yaml --> /etc/kubernetes/addons/ig-clusterrolebinding.yaml (274 bytes)
	I0722 10:31:31.730209    8575 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.3/kubectl apply -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml
	I0722 10:31:31.737800    8575 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.3/kubectl apply -f /etc/kubernetes/addons/yakd-ns.yaml -f /etc/kubernetes/addons/yakd-sa.yaml -f /etc/kubernetes/addons/yakd-crb.yaml -f /etc/kubernetes/addons/yakd-svc.yaml -f /etc/kubernetes/addons/yakd-dp.yaml
	I0722 10:31:31.856625    8575 addons.go:431] installing /etc/kubernetes/addons/rbac-external-snapshotter.yaml
	I0722 10:31:31.856688    8575 ssh_runner.go:362] scp csi-hostpath-driver/rbac/rbac-external-snapshotter.yaml --> /etc/kubernetes/addons/rbac-external-snapshotter.yaml (3149 bytes)
	I0722 10:31:31.911587    8575 addons.go:431] installing /etc/kubernetes/addons/ig-crd.yaml
	I0722 10:31:31.911663    8575 ssh_runner.go:362] scp inspektor-gadget/ig-crd.yaml --> /etc/kubernetes/addons/ig-crd.yaml (5216 bytes)
	I0722 10:31:32.036061    8575 addons.go:431] installing /etc/kubernetes/addons/ig-daemonset.yaml
	I0722 10:31:32.036085    8575 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/ig-daemonset.yaml (7735 bytes)
	I0722 10:31:32.061923    8575 addons.go:431] installing /etc/kubernetes/addons/csi-hostpath-attacher.yaml
	I0722 10:31:32.061990    8575 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/csi-hostpath-attacher.yaml (2143 bytes)
	I0722 10:31:32.162328    8575 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.3/kubectl apply -f /etc/kubernetes/addons/ig-namespace.yaml -f /etc/kubernetes/addons/ig-serviceaccount.yaml -f /etc/kubernetes/addons/ig-role.yaml -f /etc/kubernetes/addons/ig-rolebinding.yaml -f /etc/kubernetes/addons/ig-clusterrole.yaml -f /etc/kubernetes/addons/ig-clusterrolebinding.yaml -f /etc/kubernetes/addons/ig-crd.yaml -f /etc/kubernetes/addons/ig-daemonset.yaml
	I0722 10:31:32.193568    8575 addons.go:431] installing /etc/kubernetes/addons/csi-hostpath-driverinfo.yaml
	I0722 10:31:32.193638    8575 ssh_runner.go:362] scp csi-hostpath-driver/deploy/csi-hostpath-driverinfo.yaml --> /etc/kubernetes/addons/csi-hostpath-driverinfo.yaml (1274 bytes)
	I0722 10:31:32.332035    8575 addons.go:431] installing /etc/kubernetes/addons/csi-hostpath-plugin.yaml
	I0722 10:31:32.332108    8575 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/csi-hostpath-plugin.yaml (8201 bytes)
	I0722 10:31:32.437092    8575 ssh_runner.go:235] Completed: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.30.3/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml | sed -e '/^        forward . \/etc\/resolv.conf.*/i \        hosts {\n           192.168.49.1 host.minikube.internal\n           fallthrough\n        }' -e '/^        errors *$/i \        log' | sudo /var/lib/minikube/binaries/v1.30.3/kubectl --kubeconfig=/var/lib/minikube/kubeconfig replace -f -": (2.35921009s)
	I0722 10:31:32.437165    8575 start.go:971] {"host.minikube.internal": 192.168.49.1} host record injected into CoreDNS's ConfigMap
	I0722 10:31:32.437356    8575 ssh_runner.go:235] Completed: sudo systemctl start kubelet: (1.708263724s)
	I0722 10:31:32.438955    8575 node_ready.go:35] waiting up to 6m0s for node "addons-578168" to be "Ready" ...
	I0722 10:31:32.467042    8575 addons.go:431] installing /etc/kubernetes/addons/csi-hostpath-resizer.yaml
	I0722 10:31:32.467108    8575 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/csi-hostpath-resizer.yaml (2191 bytes)
	I0722 10:31:32.577177    8575 addons.go:431] installing /etc/kubernetes/addons/csi-hostpath-storageclass.yaml
	I0722 10:31:32.577198    8575 ssh_runner.go:362] scp csi-hostpath-driver/deploy/csi-hostpath-storageclass.yaml --> /etc/kubernetes/addons/csi-hostpath-storageclass.yaml (846 bytes)
	I0722 10:31:32.700135    8575 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.3/kubectl apply -f /etc/kubernetes/addons/rbac-external-attacher.yaml -f /etc/kubernetes/addons/rbac-hostpath.yaml -f /etc/kubernetes/addons/rbac-external-health-monitor-controller.yaml -f /etc/kubernetes/addons/rbac-external-provisioner.yaml -f /etc/kubernetes/addons/rbac-external-resizer.yaml -f /etc/kubernetes/addons/rbac-external-snapshotter.yaml -f /etc/kubernetes/addons/csi-hostpath-attacher.yaml -f /etc/kubernetes/addons/csi-hostpath-driverinfo.yaml -f /etc/kubernetes/addons/csi-hostpath-plugin.yaml -f /etc/kubernetes/addons/csi-hostpath-resizer.yaml -f /etc/kubernetes/addons/csi-hostpath-storageclass.yaml
	I0722 10:31:33.555085    8575 kapi.go:214] "coredns" deployment in "kube-system" namespace and "addons-578168" context rescaled to 1 replicas
	I0722 10:31:34.460067    8575 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.3/kubectl apply -f /etc/kubernetes/addons/deployment.yaml: (3.707926701s)
	I0722 10:31:34.460129    8575 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.3/kubectl apply -f /etc/kubernetes/addons/nvidia-device-plugin.yaml: (3.635818428s)
	I0722 10:31:34.460167    8575 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.3/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml: (3.520688097s)
	I0722 10:31:34.712444    8575 node_ready.go:53] node "addons-578168" has status "Ready":"False"
	I0722 10:31:36.487379    8575 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.3/kubectl apply -f /etc/kubernetes/addons/ingress-deploy.yaml: (5.522470514s)
	I0722 10:31:36.487421    8575 addons.go:475] Verifying addon ingress=true in "addons-578168"
	I0722 10:31:36.487715    8575 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.3/kubectl apply -f /etc/kubernetes/addons/ingress-dns-pod.yaml: (5.44293282s)
	I0722 10:31:36.487789    8575 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.3/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml: (5.424768951s)
	I0722 10:31:36.487864    8575 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.3/kubectl apply -f /etc/kubernetes/addons/storage-provisioner-rancher.yaml: (5.355336624s)
	I0722 10:31:36.488112    8575 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.3/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: (5.162725841s)
	I0722 10:31:36.488134    8575 addons.go:475] Verifying addon metrics-server=true in "addons-578168"
	I0722 10:31:36.488169    8575 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.3/kubectl apply -f /etc/kubernetes/addons/registry-rc.yaml -f /etc/kubernetes/addons/registry-svc.yaml -f /etc/kubernetes/addons/registry-proxy.yaml: (5.06107312s)
	I0722 10:31:36.488183    8575 addons.go:475] Verifying addon registry=true in "addons-578168"
	I0722 10:31:36.489572    8575 out.go:177] * Verifying ingress addon...
	I0722 10:31:36.491903    8575 out.go:177] * Verifying registry addon...
	I0722 10:31:36.492913    8575 kapi.go:75] Waiting for pod with label "app.kubernetes.io/name=ingress-nginx" in ns "ingress-nginx" ...
	I0722 10:31:36.495216    8575 kapi.go:75] Waiting for pod with label "kubernetes.io/minikube-addons=registry" in ns "kube-system" ...
	I0722 10:31:36.528300    8575 kapi.go:86] Found 1 Pods for label selector kubernetes.io/minikube-addons=registry
	I0722 10:31:36.528335    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0722 10:31:36.531933    8575 kapi.go:86] Found 3 Pods for label selector app.kubernetes.io/name=ingress-nginx
	I0722 10:31:36.531980    8575 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0722 10:31:36.718316    8575 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.3/kubectl apply -f /etc/kubernetes/addons/yakd-ns.yaml -f /etc/kubernetes/addons/yakd-sa.yaml -f /etc/kubernetes/addons/yakd-crb.yaml -f /etc/kubernetes/addons/yakd-svc.yaml -f /etc/kubernetes/addons/yakd-dp.yaml: (4.980491542s)
	I0722 10:31:36.718265    8575 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.3/kubectl apply -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml: (4.988011589s)
	W0722 10:31:36.718481    8575 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.3/kubectl apply -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml: Process exited with status 1
	stdout:
	customresourcedefinition.apiextensions.k8s.io/volumesnapshotclasses.snapshot.storage.k8s.io created
	customresourcedefinition.apiextensions.k8s.io/volumesnapshotcontents.snapshot.storage.k8s.io created
	customresourcedefinition.apiextensions.k8s.io/volumesnapshots.snapshot.storage.k8s.io created
	serviceaccount/snapshot-controller created
	clusterrole.rbac.authorization.k8s.io/snapshot-controller-runner created
	clusterrolebinding.rbac.authorization.k8s.io/snapshot-controller-role created
	role.rbac.authorization.k8s.io/snapshot-controller-leaderelection created
	rolebinding.rbac.authorization.k8s.io/snapshot-controller-leaderelection created
	deployment.apps/snapshot-controller created
	
	stderr:
	error: resource mapping not found for name: "csi-hostpath-snapclass" namespace: "" from "/etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml": no matches for kind "VolumeSnapshotClass" in version "snapshot.storage.k8s.io/v1"
	ensure CRDs are installed first
	I0722 10:31:36.718505    8575 retry.go:31] will retry after 244.670902ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.3/kubectl apply -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml: Process exited with status 1
	stdout:
	customresourcedefinition.apiextensions.k8s.io/volumesnapshotclasses.snapshot.storage.k8s.io created
	customresourcedefinition.apiextensions.k8s.io/volumesnapshotcontents.snapshot.storage.k8s.io created
	customresourcedefinition.apiextensions.k8s.io/volumesnapshots.snapshot.storage.k8s.io created
	serviceaccount/snapshot-controller created
	clusterrole.rbac.authorization.k8s.io/snapshot-controller-runner created
	clusterrolebinding.rbac.authorization.k8s.io/snapshot-controller-role created
	role.rbac.authorization.k8s.io/snapshot-controller-leaderelection created
	rolebinding.rbac.authorization.k8s.io/snapshot-controller-leaderelection created
	deployment.apps/snapshot-controller created
	
	stderr:
	error: resource mapping not found for name: "csi-hostpath-snapclass" namespace: "" from "/etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml": no matches for kind "VolumeSnapshotClass" in version "snapshot.storage.k8s.io/v1"
	ensure CRDs are installed first
	I0722 10:31:36.718626    8575 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.3/kubectl apply -f /etc/kubernetes/addons/ig-namespace.yaml -f /etc/kubernetes/addons/ig-serviceaccount.yaml -f /etc/kubernetes/addons/ig-role.yaml -f /etc/kubernetes/addons/ig-rolebinding.yaml -f /etc/kubernetes/addons/ig-clusterrole.yaml -f /etc/kubernetes/addons/ig-clusterrolebinding.yaml -f /etc/kubernetes/addons/ig-crd.yaml -f /etc/kubernetes/addons/ig-daemonset.yaml: (4.556220769s)
	I0722 10:31:36.720205    8575 out.go:177] * To access YAKD - Kubernetes Dashboard, wait for Pod to be ready and run the following command:
	
		minikube -p addons-578168 service yakd-dashboard -n yakd-dashboard
	
	I0722 10:31:36.959101    8575 node_ready.go:53] node "addons-578168" has status "Ready":"False"
	I0722 10:31:36.964360    8575 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.3/kubectl apply --force -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml
	I0722 10:31:37.040130    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0722 10:31:37.046631    8575 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0722 10:31:37.264125    8575 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.3/kubectl apply -f /etc/kubernetes/addons/rbac-external-attacher.yaml -f /etc/kubernetes/addons/rbac-hostpath.yaml -f /etc/kubernetes/addons/rbac-external-health-monitor-controller.yaml -f /etc/kubernetes/addons/rbac-external-provisioner.yaml -f /etc/kubernetes/addons/rbac-external-resizer.yaml -f /etc/kubernetes/addons/rbac-external-snapshotter.yaml -f /etc/kubernetes/addons/csi-hostpath-attacher.yaml -f /etc/kubernetes/addons/csi-hostpath-driverinfo.yaml -f /etc/kubernetes/addons/csi-hostpath-plugin.yaml -f /etc/kubernetes/addons/csi-hostpath-resizer.yaml -f /etc/kubernetes/addons/csi-hostpath-storageclass.yaml: (4.563949856s)
	I0722 10:31:37.264174    8575 addons.go:475] Verifying addon csi-hostpath-driver=true in "addons-578168"
	I0722 10:31:37.266474    8575 out.go:177] * Verifying csi-hostpath-driver addon...
	I0722 10:31:37.269057    8575 kapi.go:75] Waiting for pod with label "kubernetes.io/minikube-addons=csi-hostpath-driver" in ns "kube-system" ...
	I0722 10:31:37.304160    8575 kapi.go:86] Found 2 Pods for label selector kubernetes.io/minikube-addons=csi-hostpath-driver
	I0722 10:31:37.304191    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0722 10:31:37.498921    8575 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0722 10:31:37.530717    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0722 10:31:37.618442    8575 ssh_runner.go:362] scp memory --> /var/lib/minikube/google_application_credentials.json (162 bytes)
	I0722 10:31:37.618569    8575 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-578168
	I0722 10:31:37.661165    8575 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32768 SSHKeyPath:/home/jenkins/minikube-integration/19313-2237/.minikube/machines/addons-578168/id_rsa Username:docker}
	I0722 10:31:37.774043    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0722 10:31:37.817584    8575 ssh_runner.go:362] scp memory --> /var/lib/minikube/google_cloud_project (12 bytes)
	I0722 10:31:37.871484    8575 addons.go:234] Setting addon gcp-auth=true in "addons-578168"
	I0722 10:31:37.871534    8575 host.go:66] Checking if "addons-578168" exists ...
	I0722 10:31:37.871976    8575 cli_runner.go:164] Run: docker container inspect addons-578168 --format={{.State.Status}}
	I0722 10:31:37.894848    8575 ssh_runner.go:195] Run: cat /var/lib/minikube/google_application_credentials.json
	I0722 10:31:37.894900    8575 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-578168
	I0722 10:31:37.926062    8575 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32768 SSHKeyPath:/home/jenkins/minikube-integration/19313-2237/.minikube/machines/addons-578168/id_rsa Username:docker}
	I0722 10:31:37.997036    8575 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0722 10:31:38.000382    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0722 10:31:38.276342    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0722 10:31:38.498059    8575 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0722 10:31:38.502821    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0722 10:31:38.775210    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0722 10:31:38.998005    8575 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0722 10:31:39.002861    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0722 10:31:39.273464    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0722 10:31:39.442892    8575 node_ready.go:53] node "addons-578168" has status "Ready":"False"
	I0722 10:31:39.497949    8575 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0722 10:31:39.499673    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0722 10:31:39.776214    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0722 10:31:39.998183    8575 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0722 10:31:40.002769    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0722 10:31:40.054210    8575 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.3/kubectl apply --force -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml: (3.089785177s)
	I0722 10:31:40.054372    8575 ssh_runner.go:235] Completed: cat /var/lib/minikube/google_application_credentials.json: (2.159478743s)
	I0722 10:31:40.056555    8575 out.go:177]   - Using image registry.k8s.io/ingress-nginx/kube-webhook-certgen:v1.4.1
	I0722 10:31:40.058444    8575 out.go:177]   - Using image gcr.io/k8s-minikube/gcp-auth-webhook:v0.1.2
	I0722 10:31:40.060091    8575 addons.go:431] installing /etc/kubernetes/addons/gcp-auth-ns.yaml
	I0722 10:31:40.060153    8575 ssh_runner.go:362] scp gcp-auth/gcp-auth-ns.yaml --> /etc/kubernetes/addons/gcp-auth-ns.yaml (700 bytes)
	I0722 10:31:40.083202    8575 addons.go:431] installing /etc/kubernetes/addons/gcp-auth-service.yaml
	I0722 10:31:40.083275    8575 ssh_runner.go:362] scp gcp-auth/gcp-auth-service.yaml --> /etc/kubernetes/addons/gcp-auth-service.yaml (788 bytes)
	I0722 10:31:40.111513    8575 addons.go:431] installing /etc/kubernetes/addons/gcp-auth-webhook.yaml
	I0722 10:31:40.111585    8575 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/gcp-auth-webhook.yaml (5421 bytes)
	I0722 10:31:40.140557    8575 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.3/kubectl apply -f /etc/kubernetes/addons/gcp-auth-ns.yaml -f /etc/kubernetes/addons/gcp-auth-service.yaml -f /etc/kubernetes/addons/gcp-auth-webhook.yaml
	I0722 10:31:40.282461    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0722 10:31:40.499308    8575 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0722 10:31:40.504593    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0722 10:31:40.738506    8575 addons.go:475] Verifying addon gcp-auth=true in "addons-578168"
	I0722 10:31:40.740443    8575 out.go:177] * Verifying gcp-auth addon...
	I0722 10:31:40.743012    8575 kapi.go:75] Waiting for pod with label "kubernetes.io/minikube-addons=gcp-auth" in ns "gcp-auth" ...
	I0722 10:31:40.748858    8575 kapi.go:86] Found 1 Pods for label selector kubernetes.io/minikube-addons=gcp-auth
	I0722 10:31:40.748933    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0722 10:31:40.774064    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0722 10:31:40.997591    8575 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0722 10:31:41.001329    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0722 10:31:41.246457    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0722 10:31:41.273481    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0722 10:31:41.497388    8575 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0722 10:31:41.499454    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0722 10:31:41.752863    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0722 10:31:41.779127    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0722 10:31:41.942365    8575 node_ready.go:53] node "addons-578168" has status "Ready":"False"
	I0722 10:31:42.008200    8575 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0722 10:31:42.017072    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0722 10:31:42.247785    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0722 10:31:42.275816    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0722 10:31:42.502580    8575 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0722 10:31:42.503490    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0722 10:31:42.748850    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0722 10:31:42.774752    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0722 10:31:42.999793    8575 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0722 10:31:43.002238    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0722 10:31:43.247076    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0722 10:31:43.273939    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0722 10:31:43.497076    8575 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0722 10:31:43.499395    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0722 10:31:43.746215    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0722 10:31:43.774091    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0722 10:31:43.942628    8575 node_ready.go:53] node "addons-578168" has status "Ready":"False"
	I0722 10:31:43.999269    8575 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0722 10:31:44.004316    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0722 10:31:44.247128    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0722 10:31:44.273201    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0722 10:31:44.498214    8575 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0722 10:31:44.499599    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0722 10:31:44.747123    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0722 10:31:44.773134    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0722 10:31:45.004765    8575 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0722 10:31:45.008295    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0722 10:31:45.247174    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0722 10:31:45.274006    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0722 10:31:45.497474    8575 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0722 10:31:45.499779    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0722 10:31:45.751295    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0722 10:31:45.777056    8575 kapi.go:86] Found 3 Pods for label selector kubernetes.io/minikube-addons=csi-hostpath-driver
	I0722 10:31:45.777128    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0722 10:31:45.980997    8575 node_ready.go:49] node "addons-578168" has status "Ready":"True"
	I0722 10:31:45.981067    8575 node_ready.go:38] duration metric: took 13.541724939s for node "addons-578168" to be "Ready" ...
	I0722 10:31:45.981094    8575 pod_ready.go:35] extra waiting up to 6m0s for all system-critical pods including labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
	I0722 10:31:45.997695    8575 pod_ready.go:78] waiting up to 6m0s for pod "coredns-7db6d8ff4d-dz9nf" in "kube-system" namespace to be "Ready" ...
	I0722 10:31:46.014434    8575 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0722 10:31:46.014881    8575 kapi.go:86] Found 2 Pods for label selector kubernetes.io/minikube-addons=registry
	I0722 10:31:46.014889    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0722 10:31:46.271575    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0722 10:31:46.304388    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0722 10:31:46.501757    8575 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0722 10:31:46.502853    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0722 10:31:46.746834    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0722 10:31:46.774502    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0722 10:31:46.997451    8575 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0722 10:31:47.001600    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0722 10:31:47.007746    8575 pod_ready.go:92] pod "coredns-7db6d8ff4d-dz9nf" in "kube-system" namespace has status "Ready":"True"
	I0722 10:31:47.007771    8575 pod_ready.go:81] duration metric: took 1.009990192s for pod "coredns-7db6d8ff4d-dz9nf" in "kube-system" namespace to be "Ready" ...
	I0722 10:31:47.007794    8575 pod_ready.go:78] waiting up to 6m0s for pod "etcd-addons-578168" in "kube-system" namespace to be "Ready" ...
	I0722 10:31:47.013889    8575 pod_ready.go:92] pod "etcd-addons-578168" in "kube-system" namespace has status "Ready":"True"
	I0722 10:31:47.013913    8575 pod_ready.go:81] duration metric: took 6.110001ms for pod "etcd-addons-578168" in "kube-system" namespace to be "Ready" ...
	I0722 10:31:47.013929    8575 pod_ready.go:78] waiting up to 6m0s for pod "kube-apiserver-addons-578168" in "kube-system" namespace to be "Ready" ...
	I0722 10:31:47.019201    8575 pod_ready.go:92] pod "kube-apiserver-addons-578168" in "kube-system" namespace has status "Ready":"True"
	I0722 10:31:47.019227    8575 pod_ready.go:81] duration metric: took 5.288747ms for pod "kube-apiserver-addons-578168" in "kube-system" namespace to be "Ready" ...
	I0722 10:31:47.019238    8575 pod_ready.go:78] waiting up to 6m0s for pod "kube-controller-manager-addons-578168" in "kube-system" namespace to be "Ready" ...
	I0722 10:31:47.024623    8575 pod_ready.go:92] pod "kube-controller-manager-addons-578168" in "kube-system" namespace has status "Ready":"True"
	I0722 10:31:47.024647    8575 pod_ready.go:81] duration metric: took 5.401913ms for pod "kube-controller-manager-addons-578168" in "kube-system" namespace to be "Ready" ...
	I0722 10:31:47.024658    8575 pod_ready.go:78] waiting up to 6m0s for pod "kube-proxy-qlrkl" in "kube-system" namespace to be "Ready" ...
	I0722 10:31:47.143020    8575 pod_ready.go:92] pod "kube-proxy-qlrkl" in "kube-system" namespace has status "Ready":"True"
	I0722 10:31:47.143051    8575 pod_ready.go:81] duration metric: took 118.379348ms for pod "kube-proxy-qlrkl" in "kube-system" namespace to be "Ready" ...
	I0722 10:31:47.143063    8575 pod_ready.go:78] waiting up to 6m0s for pod "kube-scheduler-addons-578168" in "kube-system" namespace to be "Ready" ...
	I0722 10:31:47.246627    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0722 10:31:47.274177    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0722 10:31:47.500175    8575 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0722 10:31:47.503355    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0722 10:31:47.542651    8575 pod_ready.go:92] pod "kube-scheduler-addons-578168" in "kube-system" namespace has status "Ready":"True"
	I0722 10:31:47.542714    8575 pod_ready.go:81] duration metric: took 399.642045ms for pod "kube-scheduler-addons-578168" in "kube-system" namespace to be "Ready" ...
	I0722 10:31:47.542742    8575 pod_ready.go:78] waiting up to 6m0s for pod "metrics-server-c59844bb4-qqltc" in "kube-system" namespace to be "Ready" ...
	I0722 10:31:47.748352    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0722 10:31:47.775438    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0722 10:31:47.999415    8575 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0722 10:31:48.011165    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0722 10:31:48.247477    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0722 10:31:48.276051    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0722 10:31:48.499926    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0722 10:31:48.501680    8575 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0722 10:31:48.747614    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0722 10:31:48.775156    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0722 10:31:48.997454    8575 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0722 10:31:49.002108    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0722 10:31:49.248902    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0722 10:31:49.276844    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0722 10:31:49.505240    8575 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0722 10:31:49.507781    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0722 10:31:49.550203    8575 pod_ready.go:102] pod "metrics-server-c59844bb4-qqltc" in "kube-system" namespace has status "Ready":"False"
	I0722 10:31:49.747451    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0722 10:31:49.779613    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0722 10:31:49.999190    8575 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0722 10:31:50.004641    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0722 10:31:50.255351    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0722 10:31:50.276915    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0722 10:31:50.522171    8575 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0722 10:31:50.522853    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0722 10:31:50.747466    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0722 10:31:50.775525    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0722 10:31:51.000475    8575 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0722 10:31:51.006214    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0722 10:31:51.248239    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0722 10:31:51.276797    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0722 10:31:51.509761    8575 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0722 10:31:51.510748    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0722 10:31:51.746933    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0722 10:31:51.780797    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0722 10:31:51.998043    8575 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0722 10:31:52.011460    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0722 10:31:52.056117    8575 pod_ready.go:102] pod "metrics-server-c59844bb4-qqltc" in "kube-system" namespace has status "Ready":"False"
	I0722 10:31:52.246698    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0722 10:31:52.274578    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0722 10:31:52.498509    8575 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0722 10:31:52.504535    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0722 10:31:52.747210    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0722 10:31:52.779117    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0722 10:31:52.998986    8575 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0722 10:31:53.006221    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0722 10:31:53.247170    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0722 10:31:53.278835    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0722 10:31:53.500436    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0722 10:31:53.501747    8575 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0722 10:31:53.747000    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0722 10:31:53.775088    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0722 10:31:53.999071    8575 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0722 10:31:54.003020    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0722 10:31:54.063457    8575 pod_ready.go:102] pod "metrics-server-c59844bb4-qqltc" in "kube-system" namespace has status "Ready":"False"
	I0722 10:31:54.247452    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0722 10:31:54.275185    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0722 10:31:54.501107    8575 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0722 10:31:54.514759    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0722 10:31:54.746955    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0722 10:31:54.774874    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0722 10:31:55.001853    8575 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0722 10:31:55.007342    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0722 10:31:55.247622    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0722 10:31:55.275893    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0722 10:31:55.501893    8575 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0722 10:31:55.513621    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0722 10:31:55.747964    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0722 10:31:55.784470    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0722 10:31:56.000809    8575 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0722 10:31:56.005414    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0722 10:31:56.249438    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0722 10:31:56.276396    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0722 10:31:56.502992    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0722 10:31:56.504357    8575 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0722 10:31:56.550215    8575 pod_ready.go:102] pod "metrics-server-c59844bb4-qqltc" in "kube-system" namespace has status "Ready":"False"
	I0722 10:31:56.748007    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0722 10:31:56.775020    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0722 10:31:57.001206    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0722 10:31:57.002960    8575 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0722 10:31:57.247074    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0722 10:31:57.274330    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0722 10:31:57.501048    8575 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0722 10:31:57.501939    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0722 10:31:57.746548    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0722 10:31:57.774911    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0722 10:31:57.998310    8575 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0722 10:31:58.005364    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0722 10:31:58.247480    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0722 10:31:58.274242    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0722 10:31:58.501612    8575 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0722 10:31:58.502729    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0722 10:31:58.550777    8575 pod_ready.go:102] pod "metrics-server-c59844bb4-qqltc" in "kube-system" namespace has status "Ready":"False"
	I0722 10:31:58.747516    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0722 10:31:58.777684    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0722 10:31:59.002036    8575 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0722 10:31:59.010914    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0722 10:31:59.258863    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0722 10:31:59.278806    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0722 10:31:59.553929    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0722 10:31:59.560474    8575 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0722 10:31:59.747381    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0722 10:31:59.775654    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0722 10:32:00.017304    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0722 10:32:00.018240    8575 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0722 10:32:00.281783    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0722 10:32:00.303238    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0722 10:32:00.505254    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0722 10:32:00.508579    8575 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0722 10:32:00.551421    8575 pod_ready.go:102] pod "metrics-server-c59844bb4-qqltc" in "kube-system" namespace has status "Ready":"False"
	I0722 10:32:00.747304    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0722 10:32:00.776519    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0722 10:32:00.998614    8575 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0722 10:32:01.012606    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0722 10:32:01.247939    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0722 10:32:01.275668    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0722 10:32:01.501391    8575 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0722 10:32:01.505216    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0722 10:32:01.747942    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0722 10:32:01.776014    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0722 10:32:02.000942    8575 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0722 10:32:02.004105    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0722 10:32:02.248466    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0722 10:32:02.281651    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0722 10:32:02.499106    8575 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0722 10:32:02.506700    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0722 10:32:02.554479    8575 pod_ready.go:102] pod "metrics-server-c59844bb4-qqltc" in "kube-system" namespace has status "Ready":"False"
	I0722 10:32:02.747302    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0722 10:32:02.775347    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0722 10:32:02.996962    8575 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0722 10:32:03.002335    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0722 10:32:03.247938    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0722 10:32:03.276592    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0722 10:32:03.498349    8575 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0722 10:32:03.501038    8575 kapi.go:107] duration metric: took 27.005816301s to wait for kubernetes.io/minikube-addons=registry ...
	I0722 10:32:03.747187    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0722 10:32:03.774908    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0722 10:32:03.997914    8575 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0722 10:32:04.246918    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0722 10:32:04.276661    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0722 10:32:04.498801    8575 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0722 10:32:04.750685    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0722 10:32:04.775902    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0722 10:32:05.002066    8575 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0722 10:32:05.049526    8575 pod_ready.go:102] pod "metrics-server-c59844bb4-qqltc" in "kube-system" namespace has status "Ready":"False"
	I0722 10:32:05.246976    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0722 10:32:05.274265    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0722 10:32:05.497173    8575 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0722 10:32:05.747069    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0722 10:32:05.775609    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0722 10:32:06.000967    8575 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0722 10:32:06.246462    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0722 10:32:06.276203    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0722 10:32:06.497104    8575 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0722 10:32:06.746481    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0722 10:32:06.774909    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0722 10:32:06.997369    8575 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0722 10:32:07.050077    8575 pod_ready.go:102] pod "metrics-server-c59844bb4-qqltc" in "kube-system" namespace has status "Ready":"False"
	I0722 10:32:07.248858    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0722 10:32:07.276777    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0722 10:32:07.497111    8575 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0722 10:32:07.748555    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0722 10:32:07.783379    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0722 10:32:08.000601    8575 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0722 10:32:08.247745    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0722 10:32:08.275285    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0722 10:32:08.498961    8575 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0722 10:32:08.752122    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0722 10:32:08.775439    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0722 10:32:08.998675    8575 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0722 10:32:09.051428    8575 pod_ready.go:102] pod "metrics-server-c59844bb4-qqltc" in "kube-system" namespace has status "Ready":"False"
	I0722 10:32:09.247391    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0722 10:32:09.289425    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0722 10:32:09.498014    8575 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0722 10:32:09.747772    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0722 10:32:09.776732    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0722 10:32:10.009741    8575 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0722 10:32:10.248191    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0722 10:32:10.279455    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0722 10:32:10.498308    8575 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0722 10:32:10.747522    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0722 10:32:10.776265    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0722 10:32:10.998014    8575 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0722 10:32:11.246568    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0722 10:32:11.276218    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0722 10:32:11.498838    8575 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0722 10:32:11.550048    8575 pod_ready.go:102] pod "metrics-server-c59844bb4-qqltc" in "kube-system" namespace has status "Ready":"False"
	I0722 10:32:11.747152    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0722 10:32:11.776727    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0722 10:32:11.998183    8575 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0722 10:32:12.246697    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0722 10:32:12.278024    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0722 10:32:12.511860    8575 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0722 10:32:12.747216    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0722 10:32:12.775367    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0722 10:32:12.997453    8575 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0722 10:32:13.247111    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0722 10:32:13.274897    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0722 10:32:13.497263    8575 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0722 10:32:13.747069    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0722 10:32:13.775186    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0722 10:32:13.997619    8575 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0722 10:32:14.049781    8575 pod_ready.go:102] pod "metrics-server-c59844bb4-qqltc" in "kube-system" namespace has status "Ready":"False"
	I0722 10:32:14.247055    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0722 10:32:14.275478    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0722 10:32:14.498000    8575 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0722 10:32:14.747932    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0722 10:32:14.776253    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0722 10:32:14.999686    8575 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0722 10:32:15.248551    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0722 10:32:15.274094    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0722 10:32:15.500018    8575 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0722 10:32:15.747184    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0722 10:32:15.774361    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0722 10:32:15.998263    8575 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0722 10:32:16.246916    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0722 10:32:16.275320    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0722 10:32:16.498130    8575 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0722 10:32:16.552366    8575 pod_ready.go:102] pod "metrics-server-c59844bb4-qqltc" in "kube-system" namespace has status "Ready":"False"
	I0722 10:32:16.746930    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0722 10:32:16.776639    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0722 10:32:16.998582    8575 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0722 10:32:17.249840    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0722 10:32:17.276469    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0722 10:32:17.497837    8575 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0722 10:32:17.747018    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0722 10:32:17.774795    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0722 10:32:17.998208    8575 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0722 10:32:18.247411    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0722 10:32:18.274942    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0722 10:32:18.499135    8575 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0722 10:32:18.747186    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0722 10:32:18.774921    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0722 10:32:18.997389    8575 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0722 10:32:19.050016    8575 pod_ready.go:102] pod "metrics-server-c59844bb4-qqltc" in "kube-system" namespace has status "Ready":"False"
	I0722 10:32:19.246959    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0722 10:32:19.275281    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0722 10:32:19.498317    8575 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0722 10:32:19.747135    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0722 10:32:19.775676    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0722 10:32:20.009488    8575 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0722 10:32:20.246888    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0722 10:32:20.283466    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0722 10:32:20.497468    8575 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0722 10:32:20.747136    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0722 10:32:20.774184    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0722 10:32:20.997906    8575 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0722 10:32:21.051613    8575 pod_ready.go:102] pod "metrics-server-c59844bb4-qqltc" in "kube-system" namespace has status "Ready":"False"
	I0722 10:32:21.247521    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0722 10:32:21.275535    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0722 10:32:21.498539    8575 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0722 10:32:21.747151    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0722 10:32:21.774720    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0722 10:32:21.997410    8575 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0722 10:32:22.247215    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0722 10:32:22.274911    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0722 10:32:22.497215    8575 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0722 10:32:22.746447    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0722 10:32:22.774994    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0722 10:32:23.000114    8575 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0722 10:32:23.247117    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0722 10:32:23.275336    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0722 10:32:23.501980    8575 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0722 10:32:23.549320    8575 pod_ready.go:102] pod "metrics-server-c59844bb4-qqltc" in "kube-system" namespace has status "Ready":"False"
	I0722 10:32:23.746525    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0722 10:32:23.778143    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0722 10:32:24.000441    8575 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0722 10:32:24.251579    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0722 10:32:24.275502    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0722 10:32:24.497557    8575 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0722 10:32:24.746685    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0722 10:32:24.774868    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0722 10:32:24.997480    8575 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0722 10:32:25.246386    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0722 10:32:25.275090    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0722 10:32:25.498114    8575 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0722 10:32:25.747993    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0722 10:32:25.774186    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0722 10:32:25.999160    8575 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0722 10:32:26.049917    8575 pod_ready.go:102] pod "metrics-server-c59844bb4-qqltc" in "kube-system" namespace has status "Ready":"False"
	I0722 10:32:26.249087    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0722 10:32:26.276475    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0722 10:32:26.517653    8575 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0722 10:32:26.747003    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0722 10:32:26.775984    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0722 10:32:26.999769    8575 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0722 10:32:27.248815    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0722 10:32:27.277088    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0722 10:32:27.498147    8575 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0722 10:32:27.752095    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0722 10:32:27.777729    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0722 10:32:28.001110    8575 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0722 10:32:28.050947    8575 pod_ready.go:102] pod "metrics-server-c59844bb4-qqltc" in "kube-system" namespace has status "Ready":"False"
	I0722 10:32:28.246705    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0722 10:32:28.275154    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0722 10:32:28.496836    8575 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0722 10:32:28.747248    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0722 10:32:28.775296    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0722 10:32:29.002336    8575 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0722 10:32:29.247881    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0722 10:32:29.277572    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0722 10:32:29.498584    8575 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0722 10:32:29.748461    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0722 10:32:29.775380    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0722 10:32:29.998518    8575 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0722 10:32:30.051440    8575 pod_ready.go:102] pod "metrics-server-c59844bb4-qqltc" in "kube-system" namespace has status "Ready":"False"
	I0722 10:32:30.247502    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0722 10:32:30.276231    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0722 10:32:30.504307    8575 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0722 10:32:30.747285    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0722 10:32:30.775272    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0722 10:32:30.998538    8575 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0722 10:32:31.247142    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0722 10:32:31.280221    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0722 10:32:31.498490    8575 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0722 10:32:31.747651    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0722 10:32:31.775498    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0722 10:32:31.998516    8575 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0722 10:32:32.053763    8575 pod_ready.go:102] pod "metrics-server-c59844bb4-qqltc" in "kube-system" namespace has status "Ready":"False"
	I0722 10:32:32.246795    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0722 10:32:32.274882    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0722 10:32:32.497107    8575 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0722 10:32:32.749077    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0722 10:32:32.774638    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0722 10:32:32.998069    8575 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0722 10:32:33.248928    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0722 10:32:33.279221    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0722 10:32:33.498220    8575 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0722 10:32:33.751394    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0722 10:32:33.788974    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0722 10:32:33.999745    8575 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0722 10:32:34.247084    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0722 10:32:34.276118    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0722 10:32:34.505298    8575 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0722 10:32:34.552818    8575 pod_ready.go:102] pod "metrics-server-c59844bb4-qqltc" in "kube-system" namespace has status "Ready":"False"
	I0722 10:32:34.747035    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0722 10:32:34.776179    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0722 10:32:34.999562    8575 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0722 10:32:35.247030    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0722 10:32:35.274604    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0722 10:32:35.505141    8575 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0722 10:32:35.751048    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0722 10:32:35.774849    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0722 10:32:35.999075    8575 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0722 10:32:36.247267    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0722 10:32:36.274670    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0722 10:32:36.501029    8575 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0722 10:32:36.747147    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0722 10:32:36.774863    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0722 10:32:36.997531    8575 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0722 10:32:37.049683    8575 pod_ready.go:102] pod "metrics-server-c59844bb4-qqltc" in "kube-system" namespace has status "Ready":"False"
	I0722 10:32:37.247470    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0722 10:32:37.275202    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0722 10:32:37.502136    8575 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0722 10:32:37.747066    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0722 10:32:37.774891    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0722 10:32:37.997036    8575 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0722 10:32:38.248138    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0722 10:32:38.279063    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0722 10:32:38.498613    8575 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0722 10:32:38.746579    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0722 10:32:38.775412    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0722 10:32:38.999350    8575 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0722 10:32:39.057332    8575 pod_ready.go:102] pod "metrics-server-c59844bb4-qqltc" in "kube-system" namespace has status "Ready":"False"
	I0722 10:32:39.246860    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0722 10:32:39.274927    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0722 10:32:39.499028    8575 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0722 10:32:39.747073    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0722 10:32:39.777578    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0722 10:32:40.010222    8575 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0722 10:32:40.246737    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0722 10:32:40.277042    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0722 10:32:40.498505    8575 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0722 10:32:40.746871    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0722 10:32:40.774996    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0722 10:32:40.997211    8575 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0722 10:32:41.246897    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0722 10:32:41.275728    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0722 10:32:41.497809    8575 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0722 10:32:41.549269    8575 pod_ready.go:102] pod "metrics-server-c59844bb4-qqltc" in "kube-system" namespace has status "Ready":"False"
	I0722 10:32:41.747775    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0722 10:32:41.776162    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0722 10:32:41.997887    8575 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0722 10:32:42.247744    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0722 10:32:42.276383    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0722 10:32:42.498350    8575 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0722 10:32:42.752648    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0722 10:32:42.777083    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0722 10:32:42.998011    8575 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0722 10:32:43.246753    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0722 10:32:43.275416    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0722 10:32:43.497563    8575 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0722 10:32:43.746872    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0722 10:32:43.775414    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0722 10:32:43.998224    8575 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0722 10:32:44.054057    8575 pod_ready.go:102] pod "metrics-server-c59844bb4-qqltc" in "kube-system" namespace has status "Ready":"False"
	I0722 10:32:44.250967    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0722 10:32:44.275497    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0722 10:32:44.497961    8575 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0722 10:32:44.748921    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0722 10:32:44.775890    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0722 10:32:44.998555    8575 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0722 10:32:45.247380    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0722 10:32:45.275496    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0722 10:32:45.497712    8575 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0722 10:32:45.747272    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0722 10:32:45.775099    8575 kapi.go:107] duration metric: took 1m8.506039227s to wait for kubernetes.io/minikube-addons=csi-hostpath-driver ...
	I0722 10:32:46.000493    8575 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0722 10:32:46.247322    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0722 10:32:46.497356    8575 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0722 10:32:46.549606    8575 pod_ready.go:102] pod "metrics-server-c59844bb4-qqltc" in "kube-system" namespace has status "Ready":"False"
	I0722 10:32:46.746739    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0722 10:32:46.997204    8575 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0722 10:32:47.247093    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0722 10:32:47.497259    8575 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0722 10:32:47.746968    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0722 10:32:47.998248    8575 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0722 10:32:48.247288    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0722 10:32:48.497575    8575 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0722 10:32:48.549692    8575 pod_ready.go:102] pod "metrics-server-c59844bb4-qqltc" in "kube-system" namespace has status "Ready":"False"
	I0722 10:32:48.746588    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0722 10:32:48.998718    8575 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0722 10:32:49.246510    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0722 10:32:49.497914    8575 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0722 10:32:49.746718    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0722 10:32:50.019516    8575 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0722 10:32:50.246769    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0722 10:32:50.498122    8575 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0722 10:32:50.748985    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0722 10:32:50.997485    8575 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0722 10:32:51.051160    8575 pod_ready.go:102] pod "metrics-server-c59844bb4-qqltc" in "kube-system" namespace has status "Ready":"False"
	I0722 10:32:51.247261    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0722 10:32:51.497972    8575 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0722 10:32:51.747134    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0722 10:32:51.999009    8575 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0722 10:32:52.246956    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0722 10:32:52.498520    8575 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0722 10:32:52.748798    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0722 10:32:52.998978    8575 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0722 10:32:53.247503    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0722 10:32:53.498294    8575 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0722 10:32:53.549534    8575 pod_ready.go:102] pod "metrics-server-c59844bb4-qqltc" in "kube-system" namespace has status "Ready":"False"
	I0722 10:32:53.747319    8575 kapi.go:107] duration metric: took 1m13.004303917s to wait for kubernetes.io/minikube-addons=gcp-auth ...
	I0722 10:32:53.749869    8575 out.go:177] * Your GCP credentials will now be mounted into every pod created in the addons-578168 cluster.
	I0722 10:32:53.751869    8575 out.go:177] * If you don't want your credentials mounted into a specific pod, add a label with the `gcp-auth-skip-secret` key to your pod configuration.
	I0722 10:32:53.753633    8575 out.go:177] * If you want existing pods to be mounted with credentials, either recreate them or rerun addons enable with --refresh.
	I0722 10:32:53.997603    8575 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0722 10:32:54.497549    8575 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0722 10:32:55.004722    8575 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0722 10:32:55.496987    8575 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0722 10:32:56.046433    8575 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0722 10:32:56.076923    8575 pod_ready.go:92] pod "metrics-server-c59844bb4-qqltc" in "kube-system" namespace has status "Ready":"True"
	I0722 10:32:56.076946    8575 pod_ready.go:81] duration metric: took 1m8.53418299s for pod "metrics-server-c59844bb4-qqltc" in "kube-system" namespace to be "Ready" ...
	I0722 10:32:56.076957    8575 pod_ready.go:78] waiting up to 6m0s for pod "nvidia-device-plugin-daemonset-l6frr" in "kube-system" namespace to be "Ready" ...
	I0722 10:32:56.100975    8575 pod_ready.go:92] pod "nvidia-device-plugin-daemonset-l6frr" in "kube-system" namespace has status "Ready":"True"
	I0722 10:32:56.101004    8575 pod_ready.go:81] duration metric: took 24.037928ms for pod "nvidia-device-plugin-daemonset-l6frr" in "kube-system" namespace to be "Ready" ...
	I0722 10:32:56.101025    8575 pod_ready.go:38] duration metric: took 1m10.119881415s for extra waiting for all system-critical and pods with labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
	I0722 10:32:56.101045    8575 api_server.go:52] waiting for apiserver process to appear ...
	I0722 10:32:56.101764    8575 cri.go:54] listing CRI containers in root : {State:all Name:kube-apiserver Namespaces:[]}
	I0722 10:32:56.101841    8575 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
	I0722 10:32:56.311159    8575 cri.go:89] found id: "3eaa36f65893e9ea154ad290476a76999e7fce5187e40f9b7dbac9b55955d25c"
	I0722 10:32:56.311182    8575 cri.go:89] found id: ""
	I0722 10:32:56.311191    8575 logs.go:276] 1 containers: [3eaa36f65893e9ea154ad290476a76999e7fce5187e40f9b7dbac9b55955d25c]
	I0722 10:32:56.311246    8575 ssh_runner.go:195] Run: which crictl
	I0722 10:32:56.327927    8575 cri.go:54] listing CRI containers in root : {State:all Name:etcd Namespaces:[]}
	I0722 10:32:56.327994    8575 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
	I0722 10:32:56.497988    8575 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0722 10:32:56.548042    8575 cri.go:89] found id: "7fd0f1e313e4efe8d94ceaf40a5d5c3f6bafcee15f4d9ae8fbd6a57bb89e2d32"
	I0722 10:32:56.548066    8575 cri.go:89] found id: ""
	I0722 10:32:56.548074    8575 logs.go:276] 1 containers: [7fd0f1e313e4efe8d94ceaf40a5d5c3f6bafcee15f4d9ae8fbd6a57bb89e2d32]
	I0722 10:32:56.548129    8575 ssh_runner.go:195] Run: which crictl
	I0722 10:32:56.551757    8575 cri.go:54] listing CRI containers in root : {State:all Name:coredns Namespaces:[]}
	I0722 10:32:56.551829    8575 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
	I0722 10:32:56.615021    8575 cri.go:89] found id: "fd14ed2fa3138ce3db1337fd1c8961db47db39d56a8f8f978e98aa5cb8f0e2a4"
	I0722 10:32:56.615044    8575 cri.go:89] found id: ""
	I0722 10:32:56.615052    8575 logs.go:276] 1 containers: [fd14ed2fa3138ce3db1337fd1c8961db47db39d56a8f8f978e98aa5cb8f0e2a4]
	I0722 10:32:56.615112    8575 ssh_runner.go:195] Run: which crictl
	I0722 10:32:56.623920    8575 cri.go:54] listing CRI containers in root : {State:all Name:kube-scheduler Namespaces:[]}
	I0722 10:32:56.623988    8575 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
	I0722 10:32:56.718854    8575 cri.go:89] found id: "be869384de7f9f26c6638b2090ca4d4ae3c4463e38549fcc1f474aa8077b8359"
	I0722 10:32:56.718876    8575 cri.go:89] found id: ""
	I0722 10:32:56.718884    8575 logs.go:276] 1 containers: [be869384de7f9f26c6638b2090ca4d4ae3c4463e38549fcc1f474aa8077b8359]
	I0722 10:32:56.718940    8575 ssh_runner.go:195] Run: which crictl
	I0722 10:32:56.724780    8575 cri.go:54] listing CRI containers in root : {State:all Name:kube-proxy Namespaces:[]}
	I0722 10:32:56.724852    8575 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
	I0722 10:32:56.797716    8575 cri.go:89] found id: "b89d03fa7e9ed0ffa3d2a61fb546963c18198c7a24c7257d93f144d4122fe61e"
	I0722 10:32:56.797739    8575 cri.go:89] found id: ""
	I0722 10:32:56.797747    8575 logs.go:276] 1 containers: [b89d03fa7e9ed0ffa3d2a61fb546963c18198c7a24c7257d93f144d4122fe61e]
	I0722 10:32:56.797806    8575 ssh_runner.go:195] Run: which crictl
	I0722 10:32:56.801828    8575 cri.go:54] listing CRI containers in root : {State:all Name:kube-controller-manager Namespaces:[]}
	I0722 10:32:56.801898    8575 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
	I0722 10:32:56.868558    8575 cri.go:89] found id: "d064c7ca8b93e4b380a00ab859233190e1fc369f5e15ecf5dfd9b54dbc650897"
	I0722 10:32:56.868582    8575 cri.go:89] found id: ""
	I0722 10:32:56.868590    8575 logs.go:276] 1 containers: [d064c7ca8b93e4b380a00ab859233190e1fc369f5e15ecf5dfd9b54dbc650897]
	I0722 10:32:56.868644    8575 ssh_runner.go:195] Run: which crictl
	I0722 10:32:56.872608    8575 cri.go:54] listing CRI containers in root : {State:all Name:kindnet Namespaces:[]}
	I0722 10:32:56.872676    8575 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet
	I0722 10:32:56.930150    8575 cri.go:89] found id: "872f619c51c416886aba341acb0c461d4f4aa14c0eb3a9141099b7525e942d7f"
	I0722 10:32:56.930220    8575 cri.go:89] found id: ""
	I0722 10:32:56.930241    8575 logs.go:276] 1 containers: [872f619c51c416886aba341acb0c461d4f4aa14c0eb3a9141099b7525e942d7f]
	I0722 10:32:56.930343    8575 ssh_runner.go:195] Run: which crictl
	I0722 10:32:56.935020    8575 logs.go:123] Gathering logs for dmesg ...
	I0722 10:32:56.935100    8575 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
	I0722 10:32:56.949341    8575 logs.go:123] Gathering logs for kube-proxy [b89d03fa7e9ed0ffa3d2a61fb546963c18198c7a24c7257d93f144d4122fe61e] ...
	I0722 10:32:56.949424    8575 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 b89d03fa7e9ed0ffa3d2a61fb546963c18198c7a24c7257d93f144d4122fe61e"
	I0722 10:32:57.002891    8575 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0722 10:32:57.072094    8575 logs.go:123] Gathering logs for kindnet [872f619c51c416886aba341acb0c461d4f4aa14c0eb3a9141099b7525e942d7f] ...
	I0722 10:32:57.072206    8575 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 872f619c51c416886aba341acb0c461d4f4aa14c0eb3a9141099b7525e942d7f"
	I0722 10:32:57.157642    8575 logs.go:123] Gathering logs for container status ...
	I0722 10:32:57.157674    8575 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
	I0722 10:32:57.251727    8575 logs.go:123] Gathering logs for coredns [fd14ed2fa3138ce3db1337fd1c8961db47db39d56a8f8f978e98aa5cb8f0e2a4] ...
	I0722 10:32:57.251761    8575 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 fd14ed2fa3138ce3db1337fd1c8961db47db39d56a8f8f978e98aa5cb8f0e2a4"
	I0722 10:32:57.313233    8575 logs.go:123] Gathering logs for kube-scheduler [be869384de7f9f26c6638b2090ca4d4ae3c4463e38549fcc1f474aa8077b8359] ...
	I0722 10:32:57.313261    8575 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 be869384de7f9f26c6638b2090ca4d4ae3c4463e38549fcc1f474aa8077b8359"
	I0722 10:32:57.388212    8575 logs.go:123] Gathering logs for kube-controller-manager [d064c7ca8b93e4b380a00ab859233190e1fc369f5e15ecf5dfd9b54dbc650897] ...
	I0722 10:32:57.388245    8575 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 d064c7ca8b93e4b380a00ab859233190e1fc369f5e15ecf5dfd9b54dbc650897"
	I0722 10:32:57.488974    8575 logs.go:123] Gathering logs for CRI-O ...
	I0722 10:32:57.489011    8575 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u crio -n 400"
	I0722 10:32:57.498751    8575 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0722 10:32:57.590704    8575 logs.go:123] Gathering logs for kubelet ...
	I0722 10:32:57.590797    8575 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
	W0722 10:32:57.699602    8575 logs.go:138] Found kubelet problem: Jul 22 10:31:45 addons-578168 kubelet[1541]: W0722 10:31:45.633933    1541 reflector.go:547] object-"default"/"kube-root-ca.crt": failed to list *v1.ConfigMap: configmaps "kube-root-ca.crt" is forbidden: User "system:node:addons-578168" cannot list resource "configmaps" in API group "" in the namespace "default": no relationship found between node 'addons-578168' and this object
	W0722 10:32:57.699799    8575 logs.go:138] Found kubelet problem: Jul 22 10:31:45 addons-578168 kubelet[1541]: W0722 10:31:45.633933    1541 reflector.go:547] object-"default"/"gcp-auth": failed to list *v1.Secret: secrets "gcp-auth" is forbidden: User "system:node:addons-578168" cannot list resource "secrets" in API group "" in the namespace "default": no relationship found between node 'addons-578168' and this object
	W0722 10:32:57.700045    8575 logs.go:138] Found kubelet problem: Jul 22 10:31:45 addons-578168 kubelet[1541]: E0722 10:31:45.634227    1541 reflector.go:150] object-"default"/"kube-root-ca.crt": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "kube-root-ca.crt" is forbidden: User "system:node:addons-578168" cannot list resource "configmaps" in API group "" in the namespace "default": no relationship found between node 'addons-578168' and this object
	W0722 10:32:57.700285    8575 logs.go:138] Found kubelet problem: Jul 22 10:31:45 addons-578168 kubelet[1541]: E0722 10:31:45.634236    1541 reflector.go:150] object-"default"/"gcp-auth": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "gcp-auth" is forbidden: User "system:node:addons-578168" cannot list resource "secrets" in API group "" in the namespace "default": no relationship found between node 'addons-578168' and this object
	W0722 10:32:57.702446    8575 logs.go:138] Found kubelet problem: Jul 22 10:31:45 addons-578168 kubelet[1541]: W0722 10:31:45.657618    1541 reflector.go:547] object-"ingress-nginx"/"ingress-nginx-admission": failed to list *v1.Secret: secrets "ingress-nginx-admission" is forbidden: User "system:node:addons-578168" cannot list resource "secrets" in API group "" in the namespace "ingress-nginx": no relationship found between node 'addons-578168' and this object
	W0722 10:32:57.702665    8575 logs.go:138] Found kubelet problem: Jul 22 10:31:45 addons-578168 kubelet[1541]: E0722 10:31:45.657656    1541 reflector.go:150] object-"ingress-nginx"/"ingress-nginx-admission": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "ingress-nginx-admission" is forbidden: User "system:node:addons-578168" cannot list resource "secrets" in API group "" in the namespace "ingress-nginx": no relationship found between node 'addons-578168' and this object
	W0722 10:32:57.703305    8575 logs.go:138] Found kubelet problem: Jul 22 10:31:45 addons-578168 kubelet[1541]: W0722 10:31:45.663542    1541 reflector.go:547] object-"yakd-dashboard"/"kube-root-ca.crt": failed to list *v1.ConfigMap: configmaps "kube-root-ca.crt" is forbidden: User "system:node:addons-578168" cannot list resource "configmaps" in API group "" in the namespace "yakd-dashboard": no relationship found between node 'addons-578168' and this object
	W0722 10:32:57.703523    8575 logs.go:138] Found kubelet problem: Jul 22 10:31:45 addons-578168 kubelet[1541]: E0722 10:31:45.663578    1541 reflector.go:150] object-"yakd-dashboard"/"kube-root-ca.crt": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "kube-root-ca.crt" is forbidden: User "system:node:addons-578168" cannot list resource "configmaps" in API group "" in the namespace "yakd-dashboard": no relationship found between node 'addons-578168' and this object
	W0722 10:32:57.703710    8575 logs.go:138] Found kubelet problem: Jul 22 10:31:45 addons-578168 kubelet[1541]: W0722 10:31:45.663834    1541 reflector.go:547] object-"ingress-nginx"/"kube-root-ca.crt": failed to list *v1.ConfigMap: configmaps "kube-root-ca.crt" is forbidden: User "system:node:addons-578168" cannot list resource "configmaps" in API group "" in the namespace "ingress-nginx": no relationship found between node 'addons-578168' and this object
	W0722 10:32:57.703919    8575 logs.go:138] Found kubelet problem: Jul 22 10:31:45 addons-578168 kubelet[1541]: E0722 10:31:45.663859    1541 reflector.go:150] object-"ingress-nginx"/"kube-root-ca.crt": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "kube-root-ca.crt" is forbidden: User "system:node:addons-578168" cannot list resource "configmaps" in API group "" in the namespace "ingress-nginx": no relationship found between node 'addons-578168' and this object
	W0722 10:32:57.704109    8575 logs.go:138] Found kubelet problem: Jul 22 10:31:45 addons-578168 kubelet[1541]: W0722 10:31:45.667585    1541 reflector.go:547] object-"local-path-storage"/"kube-root-ca.crt": failed to list *v1.ConfigMap: configmaps "kube-root-ca.crt" is forbidden: User "system:node:addons-578168" cannot list resource "configmaps" in API group "" in the namespace "local-path-storage": no relationship found between node 'addons-578168' and this object
	W0722 10:32:57.704320    8575 logs.go:138] Found kubelet problem: Jul 22 10:31:45 addons-578168 kubelet[1541]: E0722 10:31:45.667627    1541 reflector.go:150] object-"local-path-storage"/"kube-root-ca.crt": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "kube-root-ca.crt" is forbidden: User "system:node:addons-578168" cannot list resource "configmaps" in API group "" in the namespace "local-path-storage": no relationship found between node 'addons-578168' and this object
	W0722 10:32:57.704505    8575 logs.go:138] Found kubelet problem: Jul 22 10:31:45 addons-578168 kubelet[1541]: W0722 10:31:45.668640    1541 reflector.go:547] object-"gcp-auth"/"kube-root-ca.crt": failed to list *v1.ConfigMap: configmaps "kube-root-ca.crt" is forbidden: User "system:node:addons-578168" cannot list resource "configmaps" in API group "" in the namespace "gcp-auth": no relationship found between node 'addons-578168' and this object
	W0722 10:32:57.704707    8575 logs.go:138] Found kubelet problem: Jul 22 10:31:45 addons-578168 kubelet[1541]: E0722 10:31:45.668674    1541 reflector.go:150] object-"gcp-auth"/"kube-root-ca.crt": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "kube-root-ca.crt" is forbidden: User "system:node:addons-578168" cannot list resource "configmaps" in API group "" in the namespace "gcp-auth": no relationship found between node 'addons-578168' and this object
	W0722 10:32:57.704895    8575 logs.go:138] Found kubelet problem: Jul 22 10:31:45 addons-578168 kubelet[1541]: W0722 10:31:45.668822    1541 reflector.go:547] object-"gcp-auth"/"gcp-auth-certs": failed to list *v1.Secret: secrets "gcp-auth-certs" is forbidden: User "system:node:addons-578168" cannot list resource "secrets" in API group "" in the namespace "gcp-auth": no relationship found between node 'addons-578168' and this object
	W0722 10:32:57.705089    8575 logs.go:138] Found kubelet problem: Jul 22 10:31:45 addons-578168 kubelet[1541]: E0722 10:31:45.668852    1541 reflector.go:150] object-"gcp-auth"/"gcp-auth-certs": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "gcp-auth-certs" is forbidden: User "system:node:addons-578168" cannot list resource "secrets" in API group "" in the namespace "gcp-auth": no relationship found between node 'addons-578168' and this object
	I0722 10:32:57.743645    8575 logs.go:123] Gathering logs for describe nodes ...
	I0722 10:32:57.748953    8575 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.30.3/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
	I0722 10:32:57.966790    8575 logs.go:123] Gathering logs for kube-apiserver [3eaa36f65893e9ea154ad290476a76999e7fce5187e40f9b7dbac9b55955d25c] ...
	I0722 10:32:57.966898    8575 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 3eaa36f65893e9ea154ad290476a76999e7fce5187e40f9b7dbac9b55955d25c"
	I0722 10:32:57.997585    8575 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0722 10:32:58.093647    8575 logs.go:123] Gathering logs for etcd [7fd0f1e313e4efe8d94ceaf40a5d5c3f6bafcee15f4d9ae8fbd6a57bb89e2d32] ...
	I0722 10:32:58.093721    8575 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 7fd0f1e313e4efe8d94ceaf40a5d5c3f6bafcee15f4d9ae8fbd6a57bb89e2d32"
	I0722 10:32:58.162885    8575 out.go:304] Setting ErrFile to fd 2...
	I0722 10:32:58.162915    8575 out.go:338] TERM=,COLORTERM=, which probably does not support color
	W0722 10:32:58.162979    8575 out.go:239] X Problems detected in kubelet:
	W0722 10:32:58.162993    8575 out.go:239]   Jul 22 10:31:45 addons-578168 kubelet[1541]: E0722 10:31:45.667627    1541 reflector.go:150] object-"local-path-storage"/"kube-root-ca.crt": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "kube-root-ca.crt" is forbidden: User "system:node:addons-578168" cannot list resource "configmaps" in API group "" in the namespace "local-path-storage": no relationship found between node 'addons-578168' and this object
	W0722 10:32:58.163000    8575 out.go:239]   Jul 22 10:31:45 addons-578168 kubelet[1541]: W0722 10:31:45.668640    1541 reflector.go:547] object-"gcp-auth"/"kube-root-ca.crt": failed to list *v1.ConfigMap: configmaps "kube-root-ca.crt" is forbidden: User "system:node:addons-578168" cannot list resource "configmaps" in API group "" in the namespace "gcp-auth": no relationship found between node 'addons-578168' and this object
	W0722 10:32:58.163016    8575 out.go:239]   Jul 22 10:31:45 addons-578168 kubelet[1541]: E0722 10:31:45.668674    1541 reflector.go:150] object-"gcp-auth"/"kube-root-ca.crt": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "kube-root-ca.crt" is forbidden: User "system:node:addons-578168" cannot list resource "configmaps" in API group "" in the namespace "gcp-auth": no relationship found between node 'addons-578168' and this object
	W0722 10:32:58.163145    8575 out.go:239]   Jul 22 10:31:45 addons-578168 kubelet[1541]: W0722 10:31:45.668822    1541 reflector.go:547] object-"gcp-auth"/"gcp-auth-certs": failed to list *v1.Secret: secrets "gcp-auth-certs" is forbidden: User "system:node:addons-578168" cannot list resource "secrets" in API group "" in the namespace "gcp-auth": no relationship found between node 'addons-578168' and this object
	W0722 10:32:58.163160    8575 out.go:239]   Jul 22 10:31:45 addons-578168 kubelet[1541]: E0722 10:31:45.668852    1541 reflector.go:150] object-"gcp-auth"/"gcp-auth-certs": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "gcp-auth-certs" is forbidden: User "system:node:addons-578168" cannot list resource "secrets" in API group "" in the namespace "gcp-auth": no relationship found between node 'addons-578168' and this object
	I0722 10:32:58.163167    8575 out.go:304] Setting ErrFile to fd 2...
	I0722 10:32:58.163177    8575 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0722 10:32:58.497117    8575 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0722 10:32:59.000198    8575 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0722 10:32:59.498179    8575 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0722 10:33:00.009846    8575 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0722 10:33:00.498937    8575 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0722 10:33:00.998806    8575 kapi.go:107] duration metric: took 1m24.505886714s to wait for app.kubernetes.io/name=ingress-nginx ...
	I0722 10:33:01.002561    8575 out.go:177] * Enabled addons: cloud-spanner, nvidia-device-plugin, default-storageclass, ingress-dns, storage-provisioner, metrics-server, storage-provisioner-rancher, inspektor-gadget, yakd, volumesnapshots, registry, csi-hostpath-driver, gcp-auth, ingress
	I0722 10:33:01.004503    8575 addons.go:510] duration metric: took 1m31.137436164s for enable addons: enabled=[cloud-spanner nvidia-device-plugin default-storageclass ingress-dns storage-provisioner metrics-server storage-provisioner-rancher inspektor-gadget yakd volumesnapshots registry csi-hostpath-driver gcp-auth ingress]
	I0722 10:33:08.164528    8575 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0722 10:33:08.178405    8575 api_server.go:72] duration metric: took 1m38.311689002s to wait for apiserver process to appear ...
	I0722 10:33:08.178430    8575 api_server.go:88] waiting for apiserver healthz status ...
	I0722 10:33:08.178464    8575 cri.go:54] listing CRI containers in root : {State:all Name:kube-apiserver Namespaces:[]}
	I0722 10:33:08.178520    8575 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
	I0722 10:33:08.220549    8575 cri.go:89] found id: "3eaa36f65893e9ea154ad290476a76999e7fce5187e40f9b7dbac9b55955d25c"
	I0722 10:33:08.220571    8575 cri.go:89] found id: ""
	I0722 10:33:08.220579    8575 logs.go:276] 1 containers: [3eaa36f65893e9ea154ad290476a76999e7fce5187e40f9b7dbac9b55955d25c]
	I0722 10:33:08.220632    8575 ssh_runner.go:195] Run: which crictl
	I0722 10:33:08.224896    8575 cri.go:54] listing CRI containers in root : {State:all Name:etcd Namespaces:[]}
	I0722 10:33:08.224976    8575 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
	I0722 10:33:08.263502    8575 cri.go:89] found id: "7fd0f1e313e4efe8d94ceaf40a5d5c3f6bafcee15f4d9ae8fbd6a57bb89e2d32"
	I0722 10:33:08.263525    8575 cri.go:89] found id: ""
	I0722 10:33:08.263533    8575 logs.go:276] 1 containers: [7fd0f1e313e4efe8d94ceaf40a5d5c3f6bafcee15f4d9ae8fbd6a57bb89e2d32]
	I0722 10:33:08.263589    8575 ssh_runner.go:195] Run: which crictl
	I0722 10:33:08.267318    8575 cri.go:54] listing CRI containers in root : {State:all Name:coredns Namespaces:[]}
	I0722 10:33:08.267398    8575 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
	I0722 10:33:08.309611    8575 cri.go:89] found id: "fd14ed2fa3138ce3db1337fd1c8961db47db39d56a8f8f978e98aa5cb8f0e2a4"
	I0722 10:33:08.309632    8575 cri.go:89] found id: ""
	I0722 10:33:08.309647    8575 logs.go:276] 1 containers: [fd14ed2fa3138ce3db1337fd1c8961db47db39d56a8f8f978e98aa5cb8f0e2a4]
	I0722 10:33:08.309705    8575 ssh_runner.go:195] Run: which crictl
	I0722 10:33:08.313407    8575 cri.go:54] listing CRI containers in root : {State:all Name:kube-scheduler Namespaces:[]}
	I0722 10:33:08.313483    8575 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
	I0722 10:33:08.353390    8575 cri.go:89] found id: "be869384de7f9f26c6638b2090ca4d4ae3c4463e38549fcc1f474aa8077b8359"
	I0722 10:33:08.353412    8575 cri.go:89] found id: ""
	I0722 10:33:08.353419    8575 logs.go:276] 1 containers: [be869384de7f9f26c6638b2090ca4d4ae3c4463e38549fcc1f474aa8077b8359]
	I0722 10:33:08.353477    8575 ssh_runner.go:195] Run: which crictl
	I0722 10:33:08.356860    8575 cri.go:54] listing CRI containers in root : {State:all Name:kube-proxy Namespaces:[]}
	I0722 10:33:08.356973    8575 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
	I0722 10:33:08.394005    8575 cri.go:89] found id: "b89d03fa7e9ed0ffa3d2a61fb546963c18198c7a24c7257d93f144d4122fe61e"
	I0722 10:33:08.394029    8575 cri.go:89] found id: ""
	I0722 10:33:08.394037    8575 logs.go:276] 1 containers: [b89d03fa7e9ed0ffa3d2a61fb546963c18198c7a24c7257d93f144d4122fe61e]
	I0722 10:33:08.394139    8575 ssh_runner.go:195] Run: which crictl
	I0722 10:33:08.397666    8575 cri.go:54] listing CRI containers in root : {State:all Name:kube-controller-manager Namespaces:[]}
	I0722 10:33:08.397734    8575 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
	I0722 10:33:08.439326    8575 cri.go:89] found id: "d064c7ca8b93e4b380a00ab859233190e1fc369f5e15ecf5dfd9b54dbc650897"
	I0722 10:33:08.439399    8575 cri.go:89] found id: ""
	I0722 10:33:08.439411    8575 logs.go:276] 1 containers: [d064c7ca8b93e4b380a00ab859233190e1fc369f5e15ecf5dfd9b54dbc650897]
	I0722 10:33:08.439477    8575 ssh_runner.go:195] Run: which crictl
	I0722 10:33:08.442890    8575 cri.go:54] listing CRI containers in root : {State:all Name:kindnet Namespaces:[]}
	I0722 10:33:08.442958    8575 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet
	I0722 10:33:08.481522    8575 cri.go:89] found id: "872f619c51c416886aba341acb0c461d4f4aa14c0eb3a9141099b7525e942d7f"
	I0722 10:33:08.481544    8575 cri.go:89] found id: ""
	I0722 10:33:08.481552    8575 logs.go:276] 1 containers: [872f619c51c416886aba341acb0c461d4f4aa14c0eb3a9141099b7525e942d7f]
	I0722 10:33:08.481613    8575 ssh_runner.go:195] Run: which crictl
	I0722 10:33:08.485025    8575 logs.go:123] Gathering logs for kubelet ...
	I0722 10:33:08.485048    8575 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
	W0722 10:33:08.511518    8575 logs.go:138] Found kubelet problem: Jul 22 10:31:45 addons-578168 kubelet[1541]: W0722 10:31:45.633933    1541 reflector.go:547] object-"default"/"kube-root-ca.crt": failed to list *v1.ConfigMap: configmaps "kube-root-ca.crt" is forbidden: User "system:node:addons-578168" cannot list resource "configmaps" in API group "" in the namespace "default": no relationship found between node 'addons-578168' and this object
	W0722 10:33:08.511702    8575 logs.go:138] Found kubelet problem: Jul 22 10:31:45 addons-578168 kubelet[1541]: W0722 10:31:45.633933    1541 reflector.go:547] object-"default"/"gcp-auth": failed to list *v1.Secret: secrets "gcp-auth" is forbidden: User "system:node:addons-578168" cannot list resource "secrets" in API group "" in the namespace "default": no relationship found between node 'addons-578168' and this object
	W0722 10:33:08.511908    8575 logs.go:138] Found kubelet problem: Jul 22 10:31:45 addons-578168 kubelet[1541]: E0722 10:31:45.634227    1541 reflector.go:150] object-"default"/"kube-root-ca.crt": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "kube-root-ca.crt" is forbidden: User "system:node:addons-578168" cannot list resource "configmaps" in API group "" in the namespace "default": no relationship found between node 'addons-578168' and this object
	W0722 10:33:08.512095    8575 logs.go:138] Found kubelet problem: Jul 22 10:31:45 addons-578168 kubelet[1541]: E0722 10:31:45.634236    1541 reflector.go:150] object-"default"/"gcp-auth": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "gcp-auth" is forbidden: User "system:node:addons-578168" cannot list resource "secrets" in API group "" in the namespace "default": no relationship found between node 'addons-578168' and this object
	W0722 10:33:08.514182    8575 logs.go:138] Found kubelet problem: Jul 22 10:31:45 addons-578168 kubelet[1541]: W0722 10:31:45.657618    1541 reflector.go:547] object-"ingress-nginx"/"ingress-nginx-admission": failed to list *v1.Secret: secrets "ingress-nginx-admission" is forbidden: User "system:node:addons-578168" cannot list resource "secrets" in API group "" in the namespace "ingress-nginx": no relationship found between node 'addons-578168' and this object
	W0722 10:33:08.514402    8575 logs.go:138] Found kubelet problem: Jul 22 10:31:45 addons-578168 kubelet[1541]: E0722 10:31:45.657656    1541 reflector.go:150] object-"ingress-nginx"/"ingress-nginx-admission": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "ingress-nginx-admission" is forbidden: User "system:node:addons-578168" cannot list resource "secrets" in API group "" in the namespace "ingress-nginx": no relationship found between node 'addons-578168' and this object
	W0722 10:33:08.515047    8575 logs.go:138] Found kubelet problem: Jul 22 10:31:45 addons-578168 kubelet[1541]: W0722 10:31:45.663542    1541 reflector.go:547] object-"yakd-dashboard"/"kube-root-ca.crt": failed to list *v1.ConfigMap: configmaps "kube-root-ca.crt" is forbidden: User "system:node:addons-578168" cannot list resource "configmaps" in API group "" in the namespace "yakd-dashboard": no relationship found between node 'addons-578168' and this object
	W0722 10:33:08.515253    8575 logs.go:138] Found kubelet problem: Jul 22 10:31:45 addons-578168 kubelet[1541]: E0722 10:31:45.663578    1541 reflector.go:150] object-"yakd-dashboard"/"kube-root-ca.crt": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "kube-root-ca.crt" is forbidden: User "system:node:addons-578168" cannot list resource "configmaps" in API group "" in the namespace "yakd-dashboard": no relationship found between node 'addons-578168' and this object
	W0722 10:33:08.515443    8575 logs.go:138] Found kubelet problem: Jul 22 10:31:45 addons-578168 kubelet[1541]: W0722 10:31:45.663834    1541 reflector.go:547] object-"ingress-nginx"/"kube-root-ca.crt": failed to list *v1.ConfigMap: configmaps "kube-root-ca.crt" is forbidden: User "system:node:addons-578168" cannot list resource "configmaps" in API group "" in the namespace "ingress-nginx": no relationship found between node 'addons-578168' and this object
	W0722 10:33:08.515659    8575 logs.go:138] Found kubelet problem: Jul 22 10:31:45 addons-578168 kubelet[1541]: E0722 10:31:45.663859    1541 reflector.go:150] object-"ingress-nginx"/"kube-root-ca.crt": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "kube-root-ca.crt" is forbidden: User "system:node:addons-578168" cannot list resource "configmaps" in API group "" in the namespace "ingress-nginx": no relationship found between node 'addons-578168' and this object
	W0722 10:33:08.515847    8575 logs.go:138] Found kubelet problem: Jul 22 10:31:45 addons-578168 kubelet[1541]: W0722 10:31:45.667585    1541 reflector.go:547] object-"local-path-storage"/"kube-root-ca.crt": failed to list *v1.ConfigMap: configmaps "kube-root-ca.crt" is forbidden: User "system:node:addons-578168" cannot list resource "configmaps" in API group "" in the namespace "local-path-storage": no relationship found between node 'addons-578168' and this object
	W0722 10:33:08.516054    8575 logs.go:138] Found kubelet problem: Jul 22 10:31:45 addons-578168 kubelet[1541]: E0722 10:31:45.667627    1541 reflector.go:150] object-"local-path-storage"/"kube-root-ca.crt": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "kube-root-ca.crt" is forbidden: User "system:node:addons-578168" cannot list resource "configmaps" in API group "" in the namespace "local-path-storage": no relationship found between node 'addons-578168' and this object
	W0722 10:33:08.516236    8575 logs.go:138] Found kubelet problem: Jul 22 10:31:45 addons-578168 kubelet[1541]: W0722 10:31:45.668640    1541 reflector.go:547] object-"gcp-auth"/"kube-root-ca.crt": failed to list *v1.ConfigMap: configmaps "kube-root-ca.crt" is forbidden: User "system:node:addons-578168" cannot list resource "configmaps" in API group "" in the namespace "gcp-auth": no relationship found between node 'addons-578168' and this object
	W0722 10:33:08.516438    8575 logs.go:138] Found kubelet problem: Jul 22 10:31:45 addons-578168 kubelet[1541]: E0722 10:31:45.668674    1541 reflector.go:150] object-"gcp-auth"/"kube-root-ca.crt": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "kube-root-ca.crt" is forbidden: User "system:node:addons-578168" cannot list resource "configmaps" in API group "" in the namespace "gcp-auth": no relationship found between node 'addons-578168' and this object
	W0722 10:33:08.516612    8575 logs.go:138] Found kubelet problem: Jul 22 10:31:45 addons-578168 kubelet[1541]: W0722 10:31:45.668822    1541 reflector.go:547] object-"gcp-auth"/"gcp-auth-certs": failed to list *v1.Secret: secrets "gcp-auth-certs" is forbidden: User "system:node:addons-578168" cannot list resource "secrets" in API group "" in the namespace "gcp-auth": no relationship found between node 'addons-578168' and this object
	W0722 10:33:08.516805    8575 logs.go:138] Found kubelet problem: Jul 22 10:31:45 addons-578168 kubelet[1541]: E0722 10:31:45.668852    1541 reflector.go:150] object-"gcp-auth"/"gcp-auth-certs": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "gcp-auth-certs" is forbidden: User "system:node:addons-578168" cannot list resource "secrets" in API group "" in the namespace "gcp-auth": no relationship found between node 'addons-578168' and this object
	I0722 10:33:08.573317    8575 logs.go:123] Gathering logs for describe nodes ...
	I0722 10:33:08.573348    8575 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.30.3/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
	I0722 10:33:08.710352    8575 logs.go:123] Gathering logs for kube-apiserver [3eaa36f65893e9ea154ad290476a76999e7fce5187e40f9b7dbac9b55955d25c] ...
	I0722 10:33:08.710380    8575 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 3eaa36f65893e9ea154ad290476a76999e7fce5187e40f9b7dbac9b55955d25c"
	I0722 10:33:08.779316    8575 logs.go:123] Gathering logs for coredns [fd14ed2fa3138ce3db1337fd1c8961db47db39d56a8f8f978e98aa5cb8f0e2a4] ...
	I0722 10:33:08.779406    8575 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 fd14ed2fa3138ce3db1337fd1c8961db47db39d56a8f8f978e98aa5cb8f0e2a4"
	I0722 10:33:08.828235    8575 logs.go:123] Gathering logs for kube-scheduler [be869384de7f9f26c6638b2090ca4d4ae3c4463e38549fcc1f474aa8077b8359] ...
	I0722 10:33:08.828262    8575 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 be869384de7f9f26c6638b2090ca4d4ae3c4463e38549fcc1f474aa8077b8359"
	I0722 10:33:08.879699    8575 logs.go:123] Gathering logs for CRI-O ...
	I0722 10:33:08.879738    8575 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u crio -n 400"
	I0722 10:33:08.979451    8575 logs.go:123] Gathering logs for container status ...
	I0722 10:33:08.979492    8575 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
	I0722 10:33:09.039914    8575 logs.go:123] Gathering logs for dmesg ...
	I0722 10:33:09.039947    8575 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
	I0722 10:33:09.053991    8575 logs.go:123] Gathering logs for etcd [7fd0f1e313e4efe8d94ceaf40a5d5c3f6bafcee15f4d9ae8fbd6a57bb89e2d32] ...
	I0722 10:33:09.054058    8575 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 7fd0f1e313e4efe8d94ceaf40a5d5c3f6bafcee15f4d9ae8fbd6a57bb89e2d32"
	I0722 10:33:09.113984    8575 logs.go:123] Gathering logs for kube-proxy [b89d03fa7e9ed0ffa3d2a61fb546963c18198c7a24c7257d93f144d4122fe61e] ...
	I0722 10:33:09.114021    8575 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 b89d03fa7e9ed0ffa3d2a61fb546963c18198c7a24c7257d93f144d4122fe61e"
	I0722 10:33:09.161228    8575 logs.go:123] Gathering logs for kube-controller-manager [d064c7ca8b93e4b380a00ab859233190e1fc369f5e15ecf5dfd9b54dbc650897] ...
	I0722 10:33:09.161256    8575 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 d064c7ca8b93e4b380a00ab859233190e1fc369f5e15ecf5dfd9b54dbc650897"
	I0722 10:33:09.230811    8575 logs.go:123] Gathering logs for kindnet [872f619c51c416886aba341acb0c461d4f4aa14c0eb3a9141099b7525e942d7f] ...
	I0722 10:33:09.230850    8575 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 872f619c51c416886aba341acb0c461d4f4aa14c0eb3a9141099b7525e942d7f"
	I0722 10:33:09.277404    8575 out.go:304] Setting ErrFile to fd 2...
	I0722 10:33:09.277435    8575 out.go:338] TERM=,COLORTERM=, which probably does not support color
	W0722 10:33:09.277492    8575 out.go:239] X Problems detected in kubelet:
	W0722 10:33:09.277506    8575 out.go:239]   Jul 22 10:31:45 addons-578168 kubelet[1541]: E0722 10:31:45.667627    1541 reflector.go:150] object-"local-path-storage"/"kube-root-ca.crt": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "kube-root-ca.crt" is forbidden: User "system:node:addons-578168" cannot list resource "configmaps" in API group "" in the namespace "local-path-storage": no relationship found between node 'addons-578168' and this object
	W0722 10:33:09.277514    8575 out.go:239]   Jul 22 10:31:45 addons-578168 kubelet[1541]: W0722 10:31:45.668640    1541 reflector.go:547] object-"gcp-auth"/"kube-root-ca.crt": failed to list *v1.ConfigMap: configmaps "kube-root-ca.crt" is forbidden: User "system:node:addons-578168" cannot list resource "configmaps" in API group "" in the namespace "gcp-auth": no relationship found between node 'addons-578168' and this object
	W0722 10:33:09.277521    8575 out.go:239]   Jul 22 10:31:45 addons-578168 kubelet[1541]: E0722 10:31:45.668674    1541 reflector.go:150] object-"gcp-auth"/"kube-root-ca.crt": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "kube-root-ca.crt" is forbidden: User "system:node:addons-578168" cannot list resource "configmaps" in API group "" in the namespace "gcp-auth": no relationship found between node 'addons-578168' and this object
	W0722 10:33:09.277529    8575 out.go:239]   Jul 22 10:31:45 addons-578168 kubelet[1541]: W0722 10:31:45.668822    1541 reflector.go:547] object-"gcp-auth"/"gcp-auth-certs": failed to list *v1.Secret: secrets "gcp-auth-certs" is forbidden: User "system:node:addons-578168" cannot list resource "secrets" in API group "" in the namespace "gcp-auth": no relationship found between node 'addons-578168' and this object
	W0722 10:33:09.277536    8575 out.go:239]   Jul 22 10:31:45 addons-578168 kubelet[1541]: E0722 10:31:45.668852    1541 reflector.go:150] object-"gcp-auth"/"gcp-auth-certs": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "gcp-auth-certs" is forbidden: User "system:node:addons-578168" cannot list resource "secrets" in API group "" in the namespace "gcp-auth": no relationship found between node 'addons-578168' and this object
	I0722 10:33:09.277545    8575 out.go:304] Setting ErrFile to fd 2...
	I0722 10:33:09.277551    8575 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0722 10:33:19.278362    8575 api_server.go:253] Checking apiserver healthz at https://192.168.49.2:8443/healthz ...
	I0722 10:33:19.286692    8575 api_server.go:279] https://192.168.49.2:8443/healthz returned 200:
	ok
	I0722 10:33:19.288702    8575 api_server.go:141] control plane version: v1.30.3
	I0722 10:33:19.288732    8575 api_server.go:131] duration metric: took 11.110293012s to wait for apiserver health ...
	I0722 10:33:19.288740    8575 system_pods.go:43] waiting for kube-system pods to appear ...
	I0722 10:33:19.288764    8575 cri.go:54] listing CRI containers in root : {State:all Name:kube-apiserver Namespaces:[]}
	I0722 10:33:19.288827    8575 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
	I0722 10:33:19.327345    8575 cri.go:89] found id: "3eaa36f65893e9ea154ad290476a76999e7fce5187e40f9b7dbac9b55955d25c"
	I0722 10:33:19.327365    8575 cri.go:89] found id: ""
	I0722 10:33:19.327373    8575 logs.go:276] 1 containers: [3eaa36f65893e9ea154ad290476a76999e7fce5187e40f9b7dbac9b55955d25c]
	I0722 10:33:19.327456    8575 ssh_runner.go:195] Run: which crictl
	I0722 10:33:19.331113    8575 cri.go:54] listing CRI containers in root : {State:all Name:etcd Namespaces:[]}
	I0722 10:33:19.331201    8575 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
	I0722 10:33:19.368747    8575 cri.go:89] found id: "7fd0f1e313e4efe8d94ceaf40a5d5c3f6bafcee15f4d9ae8fbd6a57bb89e2d32"
	I0722 10:33:19.368768    8575 cri.go:89] found id: ""
	I0722 10:33:19.368776    8575 logs.go:276] 1 containers: [7fd0f1e313e4efe8d94ceaf40a5d5c3f6bafcee15f4d9ae8fbd6a57bb89e2d32]
	I0722 10:33:19.368831    8575 ssh_runner.go:195] Run: which crictl
	I0722 10:33:19.372261    8575 cri.go:54] listing CRI containers in root : {State:all Name:coredns Namespaces:[]}
	I0722 10:33:19.372329    8575 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
	I0722 10:33:19.410999    8575 cri.go:89] found id: "fd14ed2fa3138ce3db1337fd1c8961db47db39d56a8f8f978e98aa5cb8f0e2a4"
	I0722 10:33:19.411023    8575 cri.go:89] found id: ""
	I0722 10:33:19.411031    8575 logs.go:276] 1 containers: [fd14ed2fa3138ce3db1337fd1c8961db47db39d56a8f8f978e98aa5cb8f0e2a4]
	I0722 10:33:19.411087    8575 ssh_runner.go:195] Run: which crictl
	I0722 10:33:19.414587    8575 cri.go:54] listing CRI containers in root : {State:all Name:kube-scheduler Namespaces:[]}
	I0722 10:33:19.414660    8575 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
	I0722 10:33:19.457156    8575 cri.go:89] found id: "be869384de7f9f26c6638b2090ca4d4ae3c4463e38549fcc1f474aa8077b8359"
	I0722 10:33:19.457179    8575 cri.go:89] found id: ""
	I0722 10:33:19.457187    8575 logs.go:276] 1 containers: [be869384de7f9f26c6638b2090ca4d4ae3c4463e38549fcc1f474aa8077b8359]
	I0722 10:33:19.457242    8575 ssh_runner.go:195] Run: which crictl
	I0722 10:33:19.460720    8575 cri.go:54] listing CRI containers in root : {State:all Name:kube-proxy Namespaces:[]}
	I0722 10:33:19.460787    8575 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
	I0722 10:33:19.503298    8575 cri.go:89] found id: "b89d03fa7e9ed0ffa3d2a61fb546963c18198c7a24c7257d93f144d4122fe61e"
	I0722 10:33:19.503336    8575 cri.go:89] found id: ""
	I0722 10:33:19.503345    8575 logs.go:276] 1 containers: [b89d03fa7e9ed0ffa3d2a61fb546963c18198c7a24c7257d93f144d4122fe61e]
	I0722 10:33:19.503405    8575 ssh_runner.go:195] Run: which crictl
	I0722 10:33:19.506858    8575 cri.go:54] listing CRI containers in root : {State:all Name:kube-controller-manager Namespaces:[]}
	I0722 10:33:19.506932    8575 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
	I0722 10:33:19.543515    8575 cri.go:89] found id: "d064c7ca8b93e4b380a00ab859233190e1fc369f5e15ecf5dfd9b54dbc650897"
	I0722 10:33:19.543541    8575 cri.go:89] found id: ""
	I0722 10:33:19.543549    8575 logs.go:276] 1 containers: [d064c7ca8b93e4b380a00ab859233190e1fc369f5e15ecf5dfd9b54dbc650897]
	I0722 10:33:19.543608    8575 ssh_runner.go:195] Run: which crictl
	I0722 10:33:19.547131    8575 cri.go:54] listing CRI containers in root : {State:all Name:kindnet Namespaces:[]}
	I0722 10:33:19.547202    8575 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet
	I0722 10:33:19.585455    8575 cri.go:89] found id: "872f619c51c416886aba341acb0c461d4f4aa14c0eb3a9141099b7525e942d7f"
	I0722 10:33:19.585476    8575 cri.go:89] found id: ""
	I0722 10:33:19.585493    8575 logs.go:276] 1 containers: [872f619c51c416886aba341acb0c461d4f4aa14c0eb3a9141099b7525e942d7f]
	I0722 10:33:19.585552    8575 ssh_runner.go:195] Run: which crictl
	I0722 10:33:19.590360    8575 logs.go:123] Gathering logs for describe nodes ...
	I0722 10:33:19.590385    8575 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.30.3/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
	I0722 10:33:19.725238    8575 logs.go:123] Gathering logs for kube-apiserver [3eaa36f65893e9ea154ad290476a76999e7fce5187e40f9b7dbac9b55955d25c] ...
	I0722 10:33:19.725271    8575 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 3eaa36f65893e9ea154ad290476a76999e7fce5187e40f9b7dbac9b55955d25c"
	I0722 10:33:19.785062    8575 logs.go:123] Gathering logs for kube-proxy [b89d03fa7e9ed0ffa3d2a61fb546963c18198c7a24c7257d93f144d4122fe61e] ...
	I0722 10:33:19.785094    8575 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 b89d03fa7e9ed0ffa3d2a61fb546963c18198c7a24c7257d93f144d4122fe61e"
	I0722 10:33:19.821568    8575 logs.go:123] Gathering logs for kube-controller-manager [d064c7ca8b93e4b380a00ab859233190e1fc369f5e15ecf5dfd9b54dbc650897] ...
	I0722 10:33:19.821597    8575 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 d064c7ca8b93e4b380a00ab859233190e1fc369f5e15ecf5dfd9b54dbc650897"
	I0722 10:33:19.887290    8575 logs.go:123] Gathering logs for kindnet [872f619c51c416886aba341acb0c461d4f4aa14c0eb3a9141099b7525e942d7f] ...
	I0722 10:33:19.887327    8575 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 872f619c51c416886aba341acb0c461d4f4aa14c0eb3a9141099b7525e942d7f"
	I0722 10:33:19.935639    8575 logs.go:123] Gathering logs for dmesg ...
	I0722 10:33:19.935669    8575 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
	I0722 10:33:19.948308    8575 logs.go:123] Gathering logs for etcd [7fd0f1e313e4efe8d94ceaf40a5d5c3f6bafcee15f4d9ae8fbd6a57bb89e2d32] ...
	I0722 10:33:19.948333    8575 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 7fd0f1e313e4efe8d94ceaf40a5d5c3f6bafcee15f4d9ae8fbd6a57bb89e2d32"
	I0722 10:33:20.009491    8575 logs.go:123] Gathering logs for coredns [fd14ed2fa3138ce3db1337fd1c8961db47db39d56a8f8f978e98aa5cb8f0e2a4] ...
	I0722 10:33:20.009532    8575 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 fd14ed2fa3138ce3db1337fd1c8961db47db39d56a8f8f978e98aa5cb8f0e2a4"
	I0722 10:33:20.057417    8575 logs.go:123] Gathering logs for kube-scheduler [be869384de7f9f26c6638b2090ca4d4ae3c4463e38549fcc1f474aa8077b8359] ...
	I0722 10:33:20.057476    8575 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 be869384de7f9f26c6638b2090ca4d4ae3c4463e38549fcc1f474aa8077b8359"
	I0722 10:33:20.109956    8575 logs.go:123] Gathering logs for CRI-O ...
	I0722 10:33:20.109989    8575 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u crio -n 400"
	I0722 10:33:20.202118    8575 logs.go:123] Gathering logs for container status ...
	I0722 10:33:20.202148    8575 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
	I0722 10:33:20.252853    8575 logs.go:123] Gathering logs for kubelet ...
	I0722 10:33:20.252895    8575 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
	W0722 10:33:20.275476    8575 logs.go:138] Found kubelet problem: Jul 22 10:31:45 addons-578168 kubelet[1541]: W0722 10:31:45.633933    1541 reflector.go:547] object-"default"/"kube-root-ca.crt": failed to list *v1.ConfigMap: configmaps "kube-root-ca.crt" is forbidden: User "system:node:addons-578168" cannot list resource "configmaps" in API group "" in the namespace "default": no relationship found between node 'addons-578168' and this object
	W0722 10:33:20.275720    8575 logs.go:138] Found kubelet problem: Jul 22 10:31:45 addons-578168 kubelet[1541]: W0722 10:31:45.633933    1541 reflector.go:547] object-"default"/"gcp-auth": failed to list *v1.Secret: secrets "gcp-auth" is forbidden: User "system:node:addons-578168" cannot list resource "secrets" in API group "" in the namespace "default": no relationship found between node 'addons-578168' and this object
	W0722 10:33:20.275967    8575 logs.go:138] Found kubelet problem: Jul 22 10:31:45 addons-578168 kubelet[1541]: E0722 10:31:45.634227    1541 reflector.go:150] object-"default"/"kube-root-ca.crt": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "kube-root-ca.crt" is forbidden: User "system:node:addons-578168" cannot list resource "configmaps" in API group "" in the namespace "default": no relationship found between node 'addons-578168' and this object
	W0722 10:33:20.276215    8575 logs.go:138] Found kubelet problem: Jul 22 10:31:45 addons-578168 kubelet[1541]: E0722 10:31:45.634236    1541 reflector.go:150] object-"default"/"gcp-auth": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "gcp-auth" is forbidden: User "system:node:addons-578168" cannot list resource "secrets" in API group "" in the namespace "default": no relationship found between node 'addons-578168' and this object
	W0722 10:33:20.280026    8575 logs.go:138] Found kubelet problem: Jul 22 10:31:45 addons-578168 kubelet[1541]: W0722 10:31:45.657618    1541 reflector.go:547] object-"ingress-nginx"/"ingress-nginx-admission": failed to list *v1.Secret: secrets "ingress-nginx-admission" is forbidden: User "system:node:addons-578168" cannot list resource "secrets" in API group "" in the namespace "ingress-nginx": no relationship found between node 'addons-578168' and this object
	W0722 10:33:20.280281    8575 logs.go:138] Found kubelet problem: Jul 22 10:31:45 addons-578168 kubelet[1541]: E0722 10:31:45.657656    1541 reflector.go:150] object-"ingress-nginx"/"ingress-nginx-admission": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "ingress-nginx-admission" is forbidden: User "system:node:addons-578168" cannot list resource "secrets" in API group "" in the namespace "ingress-nginx": no relationship found between node 'addons-578168' and this object
	W0722 10:33:20.280963    8575 logs.go:138] Found kubelet problem: Jul 22 10:31:45 addons-578168 kubelet[1541]: W0722 10:31:45.663542    1541 reflector.go:547] object-"yakd-dashboard"/"kube-root-ca.crt": failed to list *v1.ConfigMap: configmaps "kube-root-ca.crt" is forbidden: User "system:node:addons-578168" cannot list resource "configmaps" in API group "" in the namespace "yakd-dashboard": no relationship found between node 'addons-578168' and this object
	W0722 10:33:20.281176    8575 logs.go:138] Found kubelet problem: Jul 22 10:31:45 addons-578168 kubelet[1541]: E0722 10:31:45.663578    1541 reflector.go:150] object-"yakd-dashboard"/"kube-root-ca.crt": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "kube-root-ca.crt" is forbidden: User "system:node:addons-578168" cannot list resource "configmaps" in API group "" in the namespace "yakd-dashboard": no relationship found between node 'addons-578168' and this object
	W0722 10:33:20.281363    8575 logs.go:138] Found kubelet problem: Jul 22 10:31:45 addons-578168 kubelet[1541]: W0722 10:31:45.663834    1541 reflector.go:547] object-"ingress-nginx"/"kube-root-ca.crt": failed to list *v1.ConfigMap: configmaps "kube-root-ca.crt" is forbidden: User "system:node:addons-578168" cannot list resource "configmaps" in API group "" in the namespace "ingress-nginx": no relationship found between node 'addons-578168' and this object
	W0722 10:33:20.281571    8575 logs.go:138] Found kubelet problem: Jul 22 10:31:45 addons-578168 kubelet[1541]: E0722 10:31:45.663859    1541 reflector.go:150] object-"ingress-nginx"/"kube-root-ca.crt": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "kube-root-ca.crt" is forbidden: User "system:node:addons-578168" cannot list resource "configmaps" in API group "" in the namespace "ingress-nginx": no relationship found between node 'addons-578168' and this object
	W0722 10:33:20.281766    8575 logs.go:138] Found kubelet problem: Jul 22 10:31:45 addons-578168 kubelet[1541]: W0722 10:31:45.667585    1541 reflector.go:547] object-"local-path-storage"/"kube-root-ca.crt": failed to list *v1.ConfigMap: configmaps "kube-root-ca.crt" is forbidden: User "system:node:addons-578168" cannot list resource "configmaps" in API group "" in the namespace "local-path-storage": no relationship found between node 'addons-578168' and this object
	W0722 10:33:20.281976    8575 logs.go:138] Found kubelet problem: Jul 22 10:31:45 addons-578168 kubelet[1541]: E0722 10:31:45.667627    1541 reflector.go:150] object-"local-path-storage"/"kube-root-ca.crt": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "kube-root-ca.crt" is forbidden: User "system:node:addons-578168" cannot list resource "configmaps" in API group "" in the namespace "local-path-storage": no relationship found between node 'addons-578168' and this object
	W0722 10:33:20.282158    8575 logs.go:138] Found kubelet problem: Jul 22 10:31:45 addons-578168 kubelet[1541]: W0722 10:31:45.668640    1541 reflector.go:547] object-"gcp-auth"/"kube-root-ca.crt": failed to list *v1.ConfigMap: configmaps "kube-root-ca.crt" is forbidden: User "system:node:addons-578168" cannot list resource "configmaps" in API group "" in the namespace "gcp-auth": no relationship found between node 'addons-578168' and this object
	W0722 10:33:20.282359    8575 logs.go:138] Found kubelet problem: Jul 22 10:31:45 addons-578168 kubelet[1541]: E0722 10:31:45.668674    1541 reflector.go:150] object-"gcp-auth"/"kube-root-ca.crt": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "kube-root-ca.crt" is forbidden: User "system:node:addons-578168" cannot list resource "configmaps" in API group "" in the namespace "gcp-auth": no relationship found between node 'addons-578168' and this object
	W0722 10:33:20.282534    8575 logs.go:138] Found kubelet problem: Jul 22 10:31:45 addons-578168 kubelet[1541]: W0722 10:31:45.668822    1541 reflector.go:547] object-"gcp-auth"/"gcp-auth-certs": failed to list *v1.Secret: secrets "gcp-auth-certs" is forbidden: User "system:node:addons-578168" cannot list resource "secrets" in API group "" in the namespace "gcp-auth": no relationship found between node 'addons-578168' and this object
	W0722 10:33:20.282729    8575 logs.go:138] Found kubelet problem: Jul 22 10:31:45 addons-578168 kubelet[1541]: E0722 10:31:45.668852    1541 reflector.go:150] object-"gcp-auth"/"gcp-auth-certs": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "gcp-auth-certs" is forbidden: User "system:node:addons-578168" cannot list resource "secrets" in API group "" in the namespace "gcp-auth": no relationship found between node 'addons-578168' and this object
	I0722 10:33:20.338879    8575 out.go:304] Setting ErrFile to fd 2...
	I0722 10:33:20.338911    8575 out.go:338] TERM=,COLORTERM=, which probably does not support color
	W0722 10:33:20.338968    8575 out.go:239] X Problems detected in kubelet:
	W0722 10:33:20.338981    8575 out.go:239]   Jul 22 10:31:45 addons-578168 kubelet[1541]: E0722 10:31:45.667627    1541 reflector.go:150] object-"local-path-storage"/"kube-root-ca.crt": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "kube-root-ca.crt" is forbidden: User "system:node:addons-578168" cannot list resource "configmaps" in API group "" in the namespace "local-path-storage": no relationship found between node 'addons-578168' and this object
	W0722 10:33:20.338995    8575 out.go:239]   Jul 22 10:31:45 addons-578168 kubelet[1541]: W0722 10:31:45.668640    1541 reflector.go:547] object-"gcp-auth"/"kube-root-ca.crt": failed to list *v1.ConfigMap: configmaps "kube-root-ca.crt" is forbidden: User "system:node:addons-578168" cannot list resource "configmaps" in API group "" in the namespace "gcp-auth": no relationship found between node 'addons-578168' and this object
	W0722 10:33:20.339005    8575 out.go:239]   Jul 22 10:31:45 addons-578168 kubelet[1541]: E0722 10:31:45.668674    1541 reflector.go:150] object-"gcp-auth"/"kube-root-ca.crt": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "kube-root-ca.crt" is forbidden: User "system:node:addons-578168" cannot list resource "configmaps" in API group "" in the namespace "gcp-auth": no relationship found between node 'addons-578168' and this object
	W0722 10:33:20.339017    8575 out.go:239]   Jul 22 10:31:45 addons-578168 kubelet[1541]: W0722 10:31:45.668822    1541 reflector.go:547] object-"gcp-auth"/"gcp-auth-certs": failed to list *v1.Secret: secrets "gcp-auth-certs" is forbidden: User "system:node:addons-578168" cannot list resource "secrets" in API group "" in the namespace "gcp-auth": no relationship found between node 'addons-578168' and this object
	W0722 10:33:20.339023    8575 out.go:239]   Jul 22 10:31:45 addons-578168 kubelet[1541]: E0722 10:31:45.668852    1541 reflector.go:150] object-"gcp-auth"/"gcp-auth-certs": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "gcp-auth-certs" is forbidden: User "system:node:addons-578168" cannot list resource "secrets" in API group "" in the namespace "gcp-auth": no relationship found between node 'addons-578168' and this object
	I0722 10:33:20.339028    8575 out.go:304] Setting ErrFile to fd 2...
	I0722 10:33:20.339035    8575 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0722 10:33:30.350545    8575 system_pods.go:59] 18 kube-system pods found
	I0722 10:33:30.350586    8575 system_pods.go:61] "coredns-7db6d8ff4d-dz9nf" [5b68c434-479c-4f3f-89ef-574ff93cad07] Running
	I0722 10:33:30.350592    8575 system_pods.go:61] "csi-hostpath-attacher-0" [efd4000b-6d36-4bf6-acc6-77dc5ee227ce] Running
	I0722 10:33:30.350598    8575 system_pods.go:61] "csi-hostpath-resizer-0" [1411c232-72bc-476b-bf59-1f7d8ebe108c] Running
	I0722 10:33:30.350603    8575 system_pods.go:61] "csi-hostpathplugin-l2bb9" [28b0890c-53ec-42e8-a34a-3cf71d7fd761] Running
	I0722 10:33:30.350607    8575 system_pods.go:61] "etcd-addons-578168" [2b70cf03-56ab-43c9-bb1f-dd424a315eb8] Running
	I0722 10:33:30.350616    8575 system_pods.go:61] "kindnet-pb6q8" [98221cf0-c8b1-41c7-802a-0bfecacc14b2] Running
	I0722 10:33:30.350621    8575 system_pods.go:61] "kube-apiserver-addons-578168" [818f1cc9-7bca-4bf2-bf1b-1f8d446bbfa6] Running
	I0722 10:33:30.350632    8575 system_pods.go:61] "kube-controller-manager-addons-578168" [a9c15e78-e8d6-4df9-a887-4d19603a0307] Running
	I0722 10:33:30.350648    8575 system_pods.go:61] "kube-ingress-dns-minikube" [9ea7b2d6-84ca-4b41-b838-277a02fbac6e] Running
	I0722 10:33:30.350653    8575 system_pods.go:61] "kube-proxy-qlrkl" [a4b76f6e-03ef-44b7-bc32-95afb9b54325] Running
	I0722 10:33:30.350660    8575 system_pods.go:61] "kube-scheduler-addons-578168" [6e6be899-0b7f-4bba-bc87-ce962e16a996] Running
	I0722 10:33:30.350664    8575 system_pods.go:61] "metrics-server-c59844bb4-qqltc" [25386e93-7dbb-4ba9-948a-f1aecb63987c] Running
	I0722 10:33:30.350671    8575 system_pods.go:61] "nvidia-device-plugin-daemonset-l6frr" [6baaf8fc-6bea-4c53-bfe3-053a25f4594d] Running
	I0722 10:33:30.350675    8575 system_pods.go:61] "registry-656c9c8d9c-c2dgx" [47d52a97-6fdc-4c57-882b-f6098503cfa3] Running
	I0722 10:33:30.350680    8575 system_pods.go:61] "registry-proxy-6fp26" [aa53a675-95b7-4a46-9478-32230bc47800] Running
	I0722 10:33:30.350684    8575 system_pods.go:61] "snapshot-controller-745499f584-pr62d" [47d3368a-136b-491b-b106-ab3bfe3c191d] Running
	I0722 10:33:30.350696    8575 system_pods.go:61] "snapshot-controller-745499f584-whpkh" [df9f9d3a-ca57-4c83-b30e-2c8b846c97cb] Running
	I0722 10:33:30.350700    8575 system_pods.go:61] "storage-provisioner" [332a1289-8294-4ea6-9292-4d1789302ab4] Running
	I0722 10:33:30.350756    8575 system_pods.go:74] duration metric: took 11.06200878s to wait for pod list to return data ...
	I0722 10:33:30.350780    8575 default_sa.go:34] waiting for default service account to be created ...
	I0722 10:33:30.353258    8575 default_sa.go:45] found service account: "default"
	I0722 10:33:30.353286    8575 default_sa.go:55] duration metric: took 2.496167ms for default service account to be created ...
	I0722 10:33:30.353308    8575 system_pods.go:116] waiting for k8s-apps to be running ...
	I0722 10:33:30.363875    8575 system_pods.go:86] 18 kube-system pods found
	I0722 10:33:30.363911    8575 system_pods.go:89] "coredns-7db6d8ff4d-dz9nf" [5b68c434-479c-4f3f-89ef-574ff93cad07] Running
	I0722 10:33:30.363920    8575 system_pods.go:89] "csi-hostpath-attacher-0" [efd4000b-6d36-4bf6-acc6-77dc5ee227ce] Running
	I0722 10:33:30.363925    8575 system_pods.go:89] "csi-hostpath-resizer-0" [1411c232-72bc-476b-bf59-1f7d8ebe108c] Running
	I0722 10:33:30.363935    8575 system_pods.go:89] "csi-hostpathplugin-l2bb9" [28b0890c-53ec-42e8-a34a-3cf71d7fd761] Running
	I0722 10:33:30.363941    8575 system_pods.go:89] "etcd-addons-578168" [2b70cf03-56ab-43c9-bb1f-dd424a315eb8] Running
	I0722 10:33:30.363945    8575 system_pods.go:89] "kindnet-pb6q8" [98221cf0-c8b1-41c7-802a-0bfecacc14b2] Running
	I0722 10:33:30.363965    8575 system_pods.go:89] "kube-apiserver-addons-578168" [818f1cc9-7bca-4bf2-bf1b-1f8d446bbfa6] Running
	I0722 10:33:30.363973    8575 system_pods.go:89] "kube-controller-manager-addons-578168" [a9c15e78-e8d6-4df9-a887-4d19603a0307] Running
	I0722 10:33:30.363978    8575 system_pods.go:89] "kube-ingress-dns-minikube" [9ea7b2d6-84ca-4b41-b838-277a02fbac6e] Running
	I0722 10:33:30.363982    8575 system_pods.go:89] "kube-proxy-qlrkl" [a4b76f6e-03ef-44b7-bc32-95afb9b54325] Running
	I0722 10:33:30.363986    8575 system_pods.go:89] "kube-scheduler-addons-578168" [6e6be899-0b7f-4bba-bc87-ce962e16a996] Running
	I0722 10:33:30.363993    8575 system_pods.go:89] "metrics-server-c59844bb4-qqltc" [25386e93-7dbb-4ba9-948a-f1aecb63987c] Running
	I0722 10:33:30.364001    8575 system_pods.go:89] "nvidia-device-plugin-daemonset-l6frr" [6baaf8fc-6bea-4c53-bfe3-053a25f4594d] Running
	I0722 10:33:30.364011    8575 system_pods.go:89] "registry-656c9c8d9c-c2dgx" [47d52a97-6fdc-4c57-882b-f6098503cfa3] Running
	I0722 10:33:30.364015    8575 system_pods.go:89] "registry-proxy-6fp26" [aa53a675-95b7-4a46-9478-32230bc47800] Running
	I0722 10:33:30.364019    8575 system_pods.go:89] "snapshot-controller-745499f584-pr62d" [47d3368a-136b-491b-b106-ab3bfe3c191d] Running
	I0722 10:33:30.364025    8575 system_pods.go:89] "snapshot-controller-745499f584-whpkh" [df9f9d3a-ca57-4c83-b30e-2c8b846c97cb] Running
	I0722 10:33:30.364029    8575 system_pods.go:89] "storage-provisioner" [332a1289-8294-4ea6-9292-4d1789302ab4] Running
	I0722 10:33:30.364035    8575 system_pods.go:126] duration metric: took 10.721948ms to wait for k8s-apps to be running ...
	I0722 10:33:30.364045    8575 system_svc.go:44] waiting for kubelet service to be running ....
	I0722 10:33:30.364104    8575 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
	I0722 10:33:30.375759    8575 system_svc.go:56] duration metric: took 11.703574ms WaitForService to wait for kubelet
	I0722 10:33:30.375834    8575 kubeadm.go:582] duration metric: took 2m0.509121746s to wait for: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
	I0722 10:33:30.375863    8575 node_conditions.go:102] verifying NodePressure condition ...
	I0722 10:33:30.379593    8575 node_conditions.go:122] node storage ephemeral capacity is 203034800Ki
	I0722 10:33:30.379628    8575 node_conditions.go:123] node cpu capacity is 2
	I0722 10:33:30.379641    8575 node_conditions.go:105] duration metric: took 3.7712ms to run NodePressure ...
	I0722 10:33:30.379653    8575 start.go:241] waiting for startup goroutines ...
	I0722 10:33:30.379661    8575 start.go:246] waiting for cluster config update ...
	I0722 10:33:30.379678    8575 start.go:255] writing updated cluster config ...
	I0722 10:33:30.380006    8575 ssh_runner.go:195] Run: rm -f paused
	I0722 10:33:30.704520    8575 start.go:600] kubectl: 1.30.3, cluster: 1.30.3 (minor skew: 0)
	I0722 10:33:30.707082    8575 out.go:177] * Done! kubectl is now configured to use "addons-578168" cluster and "default" namespace by default
	
	
	==> CRI-O <==
	Jul 22 10:37:16 addons-578168 crio[968]: time="2024-07-22 10:37:16.085568711Z" level=info msg="Stopped pod sandbox (already stopped): fb4718078fa7e653ac950dc0034a8849a5e7de5db1c87bc3b1ac2bce382516bd" id=34cef2a0-d3bf-420b-811c-c7bc95142f55 name=/runtime.v1.RuntimeService/StopPodSandbox
	Jul 22 10:37:16 addons-578168 crio[968]: time="2024-07-22 10:37:16.085944984Z" level=info msg="Removing pod sandbox: fb4718078fa7e653ac950dc0034a8849a5e7de5db1c87bc3b1ac2bce382516bd" id=aa745394-d40b-4033-bf1f-edcc10a5b553 name=/runtime.v1.RuntimeService/RemovePodSandbox
	Jul 22 10:37:16 addons-578168 crio[968]: time="2024-07-22 10:37:16.094566827Z" level=info msg="Removed pod sandbox: fb4718078fa7e653ac950dc0034a8849a5e7de5db1c87bc3b1ac2bce382516bd" id=aa745394-d40b-4033-bf1f-edcc10a5b553 name=/runtime.v1.RuntimeService/RemovePodSandbox
	Jul 22 10:37:16 addons-578168 crio[968]: time="2024-07-22 10:37:16.095085295Z" level=info msg="Stopping pod sandbox: 94eaf8e168e0bf3145aa10bbc8972e2398f15c5d8793d5bce2ec125f401d6ec8" id=a120b61f-905d-49c7-9d53-b5caa2e5f0c6 name=/runtime.v1.RuntimeService/StopPodSandbox
	Jul 22 10:37:16 addons-578168 crio[968]: time="2024-07-22 10:37:16.095124057Z" level=info msg="Stopped pod sandbox (already stopped): 94eaf8e168e0bf3145aa10bbc8972e2398f15c5d8793d5bce2ec125f401d6ec8" id=a120b61f-905d-49c7-9d53-b5caa2e5f0c6 name=/runtime.v1.RuntimeService/StopPodSandbox
	Jul 22 10:37:16 addons-578168 crio[968]: time="2024-07-22 10:37:16.095446651Z" level=info msg="Removing pod sandbox: 94eaf8e168e0bf3145aa10bbc8972e2398f15c5d8793d5bce2ec125f401d6ec8" id=2ae87da5-c815-431c-8d22-caa6634764e9 name=/runtime.v1.RuntimeService/RemovePodSandbox
	Jul 22 10:37:16 addons-578168 crio[968]: time="2024-07-22 10:37:16.104651258Z" level=info msg="Removed pod sandbox: 94eaf8e168e0bf3145aa10bbc8972e2398f15c5d8793d5bce2ec125f401d6ec8" id=2ae87da5-c815-431c-8d22-caa6634764e9 name=/runtime.v1.RuntimeService/RemovePodSandbox
	Jul 22 10:37:16 addons-578168 crio[968]: time="2024-07-22 10:37:16.105104610Z" level=info msg="Stopping pod sandbox: 71bd2845be8bce5ae8136a308bd4c902dce2608665fa3ac004cbf306ea0178e2" id=5fce714b-4247-4e78-b4de-1963b789961a name=/runtime.v1.RuntimeService/StopPodSandbox
	Jul 22 10:37:16 addons-578168 crio[968]: time="2024-07-22 10:37:16.105213812Z" level=info msg="Stopped pod sandbox (already stopped): 71bd2845be8bce5ae8136a308bd4c902dce2608665fa3ac004cbf306ea0178e2" id=5fce714b-4247-4e78-b4de-1963b789961a name=/runtime.v1.RuntimeService/StopPodSandbox
	Jul 22 10:37:16 addons-578168 crio[968]: time="2024-07-22 10:37:16.105581092Z" level=info msg="Removing pod sandbox: 71bd2845be8bce5ae8136a308bd4c902dce2608665fa3ac004cbf306ea0178e2" id=867ca36c-5f36-4f0f-a8b5-d11fe3f92d45 name=/runtime.v1.RuntimeService/RemovePodSandbox
	Jul 22 10:37:16 addons-578168 crio[968]: time="2024-07-22 10:37:16.120795304Z" level=info msg="Removed pod sandbox: 71bd2845be8bce5ae8136a308bd4c902dce2608665fa3ac004cbf306ea0178e2" id=867ca36c-5f36-4f0f-a8b5-d11fe3f92d45 name=/runtime.v1.RuntimeService/RemovePodSandbox
	Jul 22 10:37:17 addons-578168 crio[968]: time="2024-07-22 10:37:17.795355916Z" level=warning msg="Stopping container 6a874d432dcdb5eb46cd1f03811d08edb612216544a177fbfa1155872ca9a99d with stop signal timed out: timeout reached after 2 seconds waiting for container process to exit" id=0d5ab8a4-4978-488b-8096-66e381e32a7c name=/runtime.v1.RuntimeService/StopContainer
	Jul 22 10:37:17 addons-578168 conmon[5065]: conmon 6a874d432dcdb5eb46cd <ninfo>: container 5076 exited with status 137
	Jul 22 10:37:17 addons-578168 crio[968]: time="2024-07-22 10:37:17.931908426Z" level=info msg="Stopped container 6a874d432dcdb5eb46cd1f03811d08edb612216544a177fbfa1155872ca9a99d: ingress-nginx/ingress-nginx-controller-6d9bd977d4-mdtsr/controller" id=0d5ab8a4-4978-488b-8096-66e381e32a7c name=/runtime.v1.RuntimeService/StopContainer
	Jul 22 10:37:17 addons-578168 crio[968]: time="2024-07-22 10:37:17.932526464Z" level=info msg="Stopping pod sandbox: 03a3ebc997f672a134fd857baa52564dafc14e1b7d6b1ec43b3554d799e70fdf" id=ec33bdf2-1de3-4f0c-8ed9-a2ff46a423b7 name=/runtime.v1.RuntimeService/StopPodSandbox
	Jul 22 10:37:17 addons-578168 crio[968]: time="2024-07-22 10:37:17.936223942Z" level=info msg="Restoring iptables rules: *nat\n:KUBE-HP-SXPOCKRAWLUKT4UZ - [0:0]\n:KUBE-HOSTPORTS - [0:0]\n:KUBE-HP-XSEE5TR7YNDZGAZP - [0:0]\n-X KUBE-HP-XSEE5TR7YNDZGAZP\n-X KUBE-HP-SXPOCKRAWLUKT4UZ\nCOMMIT\n"
	Jul 22 10:37:17 addons-578168 crio[968]: time="2024-07-22 10:37:17.937675248Z" level=info msg="Closing host port tcp:80"
	Jul 22 10:37:17 addons-578168 crio[968]: time="2024-07-22 10:37:17.937724528Z" level=info msg="Closing host port tcp:443"
	Jul 22 10:37:17 addons-578168 crio[968]: time="2024-07-22 10:37:17.939017195Z" level=info msg="Host port tcp:80 does not have an open socket"
	Jul 22 10:37:17 addons-578168 crio[968]: time="2024-07-22 10:37:17.939042302Z" level=info msg="Host port tcp:443 does not have an open socket"
	Jul 22 10:37:17 addons-578168 crio[968]: time="2024-07-22 10:37:17.939231161Z" level=info msg="Got pod network &{Name:ingress-nginx-controller-6d9bd977d4-mdtsr Namespace:ingress-nginx ID:03a3ebc997f672a134fd857baa52564dafc14e1b7d6b1ec43b3554d799e70fdf UID:e739a650-7924-41c4-bf78-5835a8a60047 NetNS:/var/run/netns/0a4fb035-fa2b-4214-824f-7d4739612d03 Networks:[{Name:kindnet Ifname:eth0}] RuntimeConfig:map[kindnet:{IP: MAC: PortMappings:[] Bandwidth:<nil> IpRanges:[]}] Aliases:map[]}"
	Jul 22 10:37:17 addons-578168 crio[968]: time="2024-07-22 10:37:17.939371125Z" level=info msg="Deleting pod ingress-nginx_ingress-nginx-controller-6d9bd977d4-mdtsr from CNI network \"kindnet\" (type=ptp)"
	Jul 22 10:37:17 addons-578168 crio[968]: time="2024-07-22 10:37:17.958673610Z" level=info msg="Stopped pod sandbox: 03a3ebc997f672a134fd857baa52564dafc14e1b7d6b1ec43b3554d799e70fdf" id=ec33bdf2-1de3-4f0c-8ed9-a2ff46a423b7 name=/runtime.v1.RuntimeService/StopPodSandbox
	Jul 22 10:37:18 addons-578168 crio[968]: time="2024-07-22 10:37:18.108930335Z" level=info msg="Removing container: 6a874d432dcdb5eb46cd1f03811d08edb612216544a177fbfa1155872ca9a99d" id=6a796c2d-3613-491a-ba75-a89028761e48 name=/runtime.v1.RuntimeService/RemoveContainer
	Jul 22 10:37:18 addons-578168 crio[968]: time="2024-07-22 10:37:18.129970519Z" level=info msg="Removed container 6a874d432dcdb5eb46cd1f03811d08edb612216544a177fbfa1155872ca9a99d: ingress-nginx/ingress-nginx-controller-6d9bd977d4-mdtsr/controller" id=6a796c2d-3613-491a-ba75-a89028761e48 name=/runtime.v1.RuntimeService/RemoveContainer
	
	
	==> container status <==
	CONTAINER           IMAGE                                                                                                                   CREATED             STATE               NAME                      ATTEMPT             POD ID              POD
	823b5a445ba9c       docker.io/kicbase/echo-server@sha256:127ac38a2bb9537b7f252addff209ea6801edcac8a92c8b1104dacd66a583ed6                   9 seconds ago       Running             hello-world-app           0                   c7d2a9ee40936       hello-world-app-6778b5fc9f-gr6bg
	b4d01d48bb53c       docker.io/library/nginx@sha256:a45ee5d042aaa9e81e013f97ae40c3dda26fbe98f22b6251acdf28e579560d55                         2 minutes ago       Running             nginx                     0                   e3734fa997fcc       nginx
	fbbe6ee6ee826       ghcr.io/headlamp-k8s/headlamp@sha256:1c3f42aacd8eee1d3f1c63efb5a3b42da387ca1d87b77b0f486e8443201fcb37                   3 minutes ago       Running             headlamp                  0                   61ad506b05533       headlamp-7867546754-58m48
	652b75dc31e14       gcr.io/k8s-minikube/gcp-auth-webhook@sha256:a40e1a121ee367d1712ac3a54ec9c38c405a65dde923c98e5fa6368fa82c4b69            4 minutes ago       Running             gcp-auth                  0                   c6d17d7e77e43       gcp-auth-5db96cd9b4-hccst
	a74ae9ee85cfb       docker.io/marcnuri/yakd@sha256:1c961556224d57fc747de0b1874524208e5fb4f8386f23e9c1c4c18e97109f17                         4 minutes ago       Running             yakd                      0                   c6da73fd40036       yakd-dashboard-799879c74f-dvdml
	0b76add32a7ff       registry.k8s.io/metrics-server/metrics-server@sha256:7f0fc3565b6d4655d078bb8e250d0423d7c79aeb05fbc71e1ffa6ff664264d70   5 minutes ago       Running             metrics-server            0                   0a122cabab235       metrics-server-c59844bb4-qqltc
	17687e7fd50ab       ba04bb24b95753201135cbc420b233c1b0b9fa2e1fd21d28319c348c33fbcde6                                                        5 minutes ago       Running             storage-provisioner       0                   80f9728c9cf1a       storage-provisioner
	fd14ed2fa3138       2437cf762177702dec2dfe99a09c37427a15af6d9a57c456b65352667c223d93                                                        5 minutes ago       Running             coredns                   0                   0fd914b6375a3       coredns-7db6d8ff4d-dz9nf
	872f619c51c41       docker.io/kindest/kindnetd@sha256:14100a3a7aca6cad3de3f26ee342ad937ca7d2844b1983d3baa7bf5f491baa7a                      5 minutes ago       Running             kindnet-cni               0                   c60df34b0605d       kindnet-pb6q8
	b89d03fa7e9ed       2351f570ed0eac5533e538280d73c6aa5d6b6f6379f5f3fac08f51378621e6be                                                        5 minutes ago       Running             kube-proxy                0                   803105df867f3       kube-proxy-qlrkl
	be869384de7f9       d48f992a22722fc0290769b8fab1186db239bbad4cff837fbb641c55faef9355                                                        6 minutes ago       Running             kube-scheduler            0                   5c26724a9fe2a       kube-scheduler-addons-578168
	d064c7ca8b93e       8e97cdb19e7cc420af7c71de8b5c9ab536bd278758c8c0878c464b833d91b31a                                                        6 minutes ago       Running             kube-controller-manager   0                   aa5aa5b5a79db       kube-controller-manager-addons-578168
	7fd0f1e313e4e       014faa467e29798aeef733fe6d1a3b5e382688217b053ad23410e6cccd5d22fd                                                        6 minutes ago       Running             etcd                      0                   7eb8f4563a931       etcd-addons-578168
	3eaa36f65893e       61773190d42ff0792f3bab2658e80b1c07519170955bb350b153b564ef28f4ca                                                        6 minutes ago       Running             kube-apiserver            0                   4be130721d1fb       kube-apiserver-addons-578168
	
	
	==> coredns [fd14ed2fa3138ce3db1337fd1c8961db47db39d56a8f8f978e98aa5cb8f0e2a4] <==
	[INFO] 10.244.0.5:52357 - 59486 "A IN registry.kube-system.svc.cluster.local.us-east-2.compute.internal. udp 83 false 512" NXDOMAIN qr,rd,ra 83 0.001920146s
	[INFO] 10.244.0.5:53083 - 28340 "A IN registry.kube-system.svc.cluster.local. udp 56 false 512" NOERROR qr,aa,rd 110 0.000186503s
	[INFO] 10.244.0.5:53083 - 55736 "AAAA IN registry.kube-system.svc.cluster.local. udp 56 false 512" NOERROR qr,aa,rd 149 0.000344994s
	[INFO] 10.244.0.5:55224 - 16438 "AAAA IN registry.kube-system.svc.cluster.local.kube-system.svc.cluster.local. udp 86 false 512" NXDOMAIN qr,aa,rd 179 0.000043759s
	[INFO] 10.244.0.5:55224 - 54325 "A IN registry.kube-system.svc.cluster.local.kube-system.svc.cluster.local. udp 86 false 512" NXDOMAIN qr,aa,rd 179 0.000120098s
	[INFO] 10.244.0.5:50099 - 36274 "AAAA IN registry.kube-system.svc.cluster.local.svc.cluster.local. udp 74 false 512" NXDOMAIN qr,aa,rd 167 0.000159074s
	[INFO] 10.244.0.5:50099 - 51636 "A IN registry.kube-system.svc.cluster.local.svc.cluster.local. udp 74 false 512" NXDOMAIN qr,aa,rd 167 0.000146126s
	[INFO] 10.244.0.5:57649 - 55913 "AAAA IN registry.kube-system.svc.cluster.local.cluster.local. udp 70 false 512" NXDOMAIN qr,aa,rd 163 0.000107766s
	[INFO] 10.244.0.5:57649 - 10599 "A IN registry.kube-system.svc.cluster.local.cluster.local. udp 70 false 512" NXDOMAIN qr,aa,rd 163 0.000112821s
	[INFO] 10.244.0.5:44206 - 23741 "AAAA IN registry.kube-system.svc.cluster.local.us-east-2.compute.internal. udp 83 false 512" NXDOMAIN qr,rd,ra 83 0.001657581s
	[INFO] 10.244.0.5:44206 - 24499 "A IN registry.kube-system.svc.cluster.local.us-east-2.compute.internal. udp 83 false 512" NXDOMAIN qr,rd,ra 83 0.002080196s
	[INFO] 10.244.0.5:44605 - 46286 "A IN registry.kube-system.svc.cluster.local. udp 56 false 512" NOERROR qr,aa,rd 110 0.000121108s
	[INFO] 10.244.0.5:44605 - 39116 "AAAA IN registry.kube-system.svc.cluster.local. udp 56 false 512" NOERROR qr,aa,rd 149 0.000090454s
	[INFO] 10.244.0.20:38241 - 13902 "AAAA IN storage.googleapis.com.gcp-auth.svc.cluster.local. udp 78 false 1232" NXDOMAIN qr,aa,rd 160 0.003755715s
	[INFO] 10.244.0.20:51409 - 21950 "A IN storage.googleapis.com.gcp-auth.svc.cluster.local. udp 78 false 1232" NXDOMAIN qr,aa,rd 160 0.003769319s
	[INFO] 10.244.0.20:51860 - 2430 "A IN storage.googleapis.com.svc.cluster.local. udp 69 false 1232" NXDOMAIN qr,aa,rd 151 0.000155078s
	[INFO] 10.244.0.20:56941 - 4409 "AAAA IN storage.googleapis.com.svc.cluster.local. udp 69 false 1232" NXDOMAIN qr,aa,rd 151 0.000176969s
	[INFO] 10.244.0.20:57940 - 46823 "AAAA IN storage.googleapis.com.cluster.local. udp 65 false 1232" NXDOMAIN qr,aa,rd 147 0.000139907s
	[INFO] 10.244.0.20:34068 - 47022 "A IN storage.googleapis.com.cluster.local. udp 65 false 1232" NXDOMAIN qr,aa,rd 147 0.000090651s
	[INFO] 10.244.0.20:39593 - 10044 "AAAA IN storage.googleapis.com.us-east-2.compute.internal. udp 78 false 1232" NXDOMAIN qr,rd,ra 67 0.002657807s
	[INFO] 10.244.0.20:54685 - 14096 "A IN storage.googleapis.com.us-east-2.compute.internal. udp 78 false 1232" NXDOMAIN qr,rd,ra 67 0.0027292s
	[INFO] 10.244.0.20:43426 - 6335 "A IN storage.googleapis.com. udp 51 false 1232" NOERROR qr,rd,ra 610 0.0014089s
	[INFO] 10.244.0.20:41275 - 18352 "AAAA IN storage.googleapis.com. udp 51 false 1232" NOERROR qr,rd,ra 240 0.002424395s
	[INFO] 10.244.0.22:57099 - 2 "AAAA IN registry.kube-system.svc.cluster.local. udp 56 false 512" NOERROR qr,aa,rd 149 0.000157613s
	[INFO] 10.244.0.22:42480 - 3 "A IN registry.kube-system.svc.cluster.local. udp 56 false 512" NOERROR qr,aa,rd 110 0.000114856s
	
	
	==> describe nodes <==
	Name:               addons-578168
	Roles:              control-plane
	Labels:             beta.kubernetes.io/arch=arm64
	                    beta.kubernetes.io/os=linux
	                    kubernetes.io/arch=arm64
	                    kubernetes.io/hostname=addons-578168
	                    kubernetes.io/os=linux
	                    minikube.k8s.io/commit=8e5b1d22910d5d447b525af478862a848159d7b7
	                    minikube.k8s.io/name=addons-578168
	                    minikube.k8s.io/primary=true
	                    minikube.k8s.io/updated_at=2024_07_22T10_31_16_0700
	                    minikube.k8s.io/version=v1.33.1
	                    node-role.kubernetes.io/control-plane=
	                    node.kubernetes.io/exclude-from-external-load-balancers=
	                    topology.hostpath.csi/node=addons-578168
	Annotations:        kubeadm.alpha.kubernetes.io/cri-socket: unix:///var/run/crio/crio.sock
	                    node.alpha.kubernetes.io/ttl: 0
	                    volumes.kubernetes.io/controller-managed-attach-detach: true
	CreationTimestamp:  Mon, 22 Jul 2024 10:31:13 +0000
	Taints:             <none>
	Unschedulable:      false
	Lease:
	  HolderIdentity:  addons-578168
	  AcquireTime:     <unset>
	  RenewTime:       Mon, 22 Jul 2024 10:37:21 +0000
	Conditions:
	  Type             Status  LastHeartbeatTime                 LastTransitionTime                Reason                       Message
	  ----             ------  -----------------                 ------------------                ------                       -------
	  MemoryPressure   False   Mon, 22 Jul 2024 10:35:21 +0000   Mon, 22 Jul 2024 10:31:10 +0000   KubeletHasSufficientMemory   kubelet has sufficient memory available
	  DiskPressure     False   Mon, 22 Jul 2024 10:35:21 +0000   Mon, 22 Jul 2024 10:31:10 +0000   KubeletHasNoDiskPressure     kubelet has no disk pressure
	  PIDPressure      False   Mon, 22 Jul 2024 10:35:21 +0000   Mon, 22 Jul 2024 10:31:10 +0000   KubeletHasSufficientPID      kubelet has sufficient PID available
	  Ready            True    Mon, 22 Jul 2024 10:35:21 +0000   Mon, 22 Jul 2024 10:31:45 +0000   KubeletReady                 kubelet is posting ready status
	Addresses:
	  InternalIP:  192.168.49.2
	  Hostname:    addons-578168
	Capacity:
	  cpu:                2
	  ephemeral-storage:  203034800Ki
	  hugepages-1Gi:      0
	  hugepages-2Mi:      0
	  hugepages-32Mi:     0
	  hugepages-64Ki:     0
	  memory:             8022360Ki
	  pods:               110
	Allocatable:
	  cpu:                2
	  ephemeral-storage:  203034800Ki
	  hugepages-1Gi:      0
	  hugepages-2Mi:      0
	  hugepages-32Mi:     0
	  hugepages-64Ki:     0
	  memory:             8022360Ki
	  pods:               110
	System Info:
	  Machine ID:                 3877af839aef4bdd8a6fb65c49ba642e
	  System UUID:                500d4ba1-5b05-4ed9-8dda-92e646b0485d
	  Boot ID:                    0ef69867-e3da-4d6a-b5e0-eebac57ce510
	  Kernel Version:             5.15.0-1064-aws
	  OS Image:                   Ubuntu 22.04.4 LTS
	  Operating System:           linux
	  Architecture:               arm64
	  Container Runtime Version:  cri-o://1.24.6
	  Kubelet Version:            v1.30.3
	  Kube-Proxy Version:         v1.30.3
	PodCIDR:                      10.244.0.0/24
	PodCIDRs:                     10.244.0.0/24
	Non-terminated Pods:          (14 in total)
	  Namespace                   Name                                     CPU Requests  CPU Limits  Memory Requests  Memory Limits  Age
	  ---------                   ----                                     ------------  ----------  ---------------  -------------  ---
	  default                     hello-world-app-6778b5fc9f-gr6bg         0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         11s
	  default                     nginx                                    0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         2m31s
	  gcp-auth                    gcp-auth-5db96cd9b4-hccst                0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         5m43s
	  headlamp                    headlamp-7867546754-58m48                0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         3m52s
	  kube-system                 coredns-7db6d8ff4d-dz9nf                 100m (5%!)(MISSING)     0 (0%!)(MISSING)      70Mi (0%!)(MISSING)        170Mi (2%!)(MISSING)     5m54s
	  kube-system                 etcd-addons-578168                       100m (5%!)(MISSING)     0 (0%!)(MISSING)      100Mi (1%!)(MISSING)       0 (0%!)(MISSING)         6m8s
	  kube-system                 kindnet-pb6q8                            100m (5%!)(MISSING)     100m (5%!)(MISSING)   50Mi (0%!)(MISSING)        50Mi (0%!)(MISSING)      5m55s
	  kube-system                 kube-apiserver-addons-578168             250m (12%!)(MISSING)    0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         6m8s
	  kube-system                 kube-controller-manager-addons-578168    200m (10%!)(MISSING)    0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         6m8s
	  kube-system                 kube-proxy-qlrkl                         0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         5m55s
	  kube-system                 kube-scheduler-addons-578168             100m (5%!)(MISSING)     0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         6m8s
	  kube-system                 metrics-server-c59844bb4-qqltc           100m (5%!)(MISSING)     0 (0%!)(MISSING)      200Mi (2%!)(MISSING)       0 (0%!)(MISSING)         5m49s
	  kube-system                 storage-provisioner                      0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         5m48s
	  yakd-dashboard              yakd-dashboard-799879c74f-dvdml          0 (0%!)(MISSING)        0 (0%!)(MISSING)      128Mi (1%!)(MISSING)       256Mi (3%!)(MISSING)     5m48s
	Allocated resources:
	  (Total limits may be over 100 percent, i.e., overcommitted.)
	  Resource           Requests    Limits
	  --------           --------    ------
	  cpu                950m (47%!)(MISSING)  100m (5%!)(MISSING)
	  memory             548Mi (6%!)(MISSING)  476Mi (6%!)(MISSING)
	  ephemeral-storage  0 (0%!)(MISSING)      0 (0%!)(MISSING)
	  hugepages-1Gi      0 (0%!)(MISSING)      0 (0%!)(MISSING)
	  hugepages-2Mi      0 (0%!)(MISSING)      0 (0%!)(MISSING)
	  hugepages-32Mi     0 (0%!)(MISSING)      0 (0%!)(MISSING)
	  hugepages-64Ki     0 (0%!)(MISSING)      0 (0%!)(MISSING)
	Events:
	  Type    Reason                   Age                  From             Message
	  ----    ------                   ----                 ----             -------
	  Normal  Starting                 5m53s                kube-proxy       
	  Normal  Starting                 6m8s                 kubelet          Starting kubelet.
	  Normal  NodeHasSufficientMemory  6m8s (x2 over 6m8s)  kubelet          Node addons-578168 status is now: NodeHasSufficientMemory
	  Normal  NodeHasNoDiskPressure    6m8s (x2 over 6m8s)  kubelet          Node addons-578168 status is now: NodeHasNoDiskPressure
	  Normal  NodeHasSufficientPID     6m8s (x2 over 6m8s)  kubelet          Node addons-578168 status is now: NodeHasSufficientPID
	  Normal  RegisteredNode           5m55s                node-controller  Node addons-578168 event: Registered Node addons-578168 in Controller
	  Normal  NodeReady                5m38s                kubelet          Node addons-578168 status is now: NodeReady
	
	
	==> dmesg <==
	[Jul22 10:17] ACPI: SRAT not present
	[  +0.000000] ACPI: SRAT not present
	[  +0.000000] SPI driver altr_a10sr has no spi_device_id for altr,a10sr
	[  +0.015445] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.
	[  +0.490841] systemd[1]: Configuration file /run/systemd/system/netplan-ovs-cleanup.service is marked world-inaccessible. This has no effect as configuration data is accessible via APIs without restrictions. Proceeding anyway.
	[  +0.063634] systemd[1]: /lib/systemd/system/cloud-init-local.service:15: Unknown key name 'ConditionEnvironment' in section 'Unit', ignoring.
	[  +0.002944] systemd[1]: /lib/systemd/system/cloud-init.service:19: Unknown key name 'ConditionEnvironment' in section 'Unit', ignoring.
	[  +0.017750] systemd[1]: /lib/systemd/system/cloud-init.target:15: Unknown key name 'ConditionEnvironment' in section 'Unit', ignoring.
	[  +0.004783] systemd[1]: /lib/systemd/system/cloud-final.service:9: Unknown key name 'ConditionEnvironment' in section 'Unit', ignoring.
	[  +0.003823] systemd[1]: /lib/systemd/system/cloud-config.service:8: Unknown key name 'ConditionEnvironment' in section 'Unit', ignoring.
	[  +0.669480] ena 0000:00:05.0: LLQ is not supported Fallback to host mode policy.
	[  +6.423928] kauditd_printk_skb: 36 callbacks suppressed
	
	
	==> etcd [7fd0f1e313e4efe8d94ceaf40a5d5c3f6bafcee15f4d9ae8fbd6a57bb89e2d32] <==
	{"level":"info","ts":"2024-07-22T10:31:10.604989Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"aec36adc501070cc received MsgPreVoteResp from aec36adc501070cc at term 1"}
	{"level":"info","ts":"2024-07-22T10:31:10.605014Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"aec36adc501070cc became candidate at term 2"}
	{"level":"info","ts":"2024-07-22T10:31:10.605021Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"aec36adc501070cc received MsgVoteResp from aec36adc501070cc at term 2"}
	{"level":"info","ts":"2024-07-22T10:31:10.60503Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"aec36adc501070cc became leader at term 2"}
	{"level":"info","ts":"2024-07-22T10:31:10.605042Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"raft.node: aec36adc501070cc elected leader aec36adc501070cc at term 2"}
	{"level":"info","ts":"2024-07-22T10:31:10.608978Z","caller":"etcdserver/server.go:2578","msg":"setting up initial cluster version using v2 API","cluster-version":"3.5"}
	{"level":"info","ts":"2024-07-22T10:31:10.611284Z","caller":"etcdserver/server.go:2068","msg":"published local member to cluster through raft","local-member-id":"aec36adc501070cc","local-member-attributes":"{Name:addons-578168 ClientURLs:[https://192.168.49.2:2379]}","request-path":"/0/members/aec36adc501070cc/attributes","cluster-id":"fa54960ea34d58be","publish-timeout":"7s"}
	{"level":"info","ts":"2024-07-22T10:31:10.611448Z","caller":"embed/serve.go:103","msg":"ready to serve client requests"}
	{"level":"info","ts":"2024-07-22T10:31:10.611774Z","caller":"embed/serve.go:103","msg":"ready to serve client requests"}
	{"level":"info","ts":"2024-07-22T10:31:10.61191Z","caller":"etcdmain/main.go:44","msg":"notifying init daemon"}
	{"level":"info","ts":"2024-07-22T10:31:10.611953Z","caller":"etcdmain/main.go:50","msg":"successfully notified init daemon"}
	{"level":"info","ts":"2024-07-22T10:31:10.612007Z","caller":"membership/cluster.go:584","msg":"set initial cluster version","cluster-id":"fa54960ea34d58be","local-member-id":"aec36adc501070cc","cluster-version":"3.5"}
	{"level":"info","ts":"2024-07-22T10:31:10.612106Z","caller":"api/capability.go:75","msg":"enabled capabilities for version","cluster-version":"3.5"}
	{"level":"info","ts":"2024-07-22T10:31:10.612152Z","caller":"etcdserver/server.go:2602","msg":"cluster version is updated","cluster-version":"3.5"}
	{"level":"info","ts":"2024-07-22T10:31:10.613745Z","caller":"embed/serve.go:250","msg":"serving client traffic securely","traffic":"grpc+http","address":"127.0.0.1:2379"}
	{"level":"info","ts":"2024-07-22T10:31:10.628555Z","caller":"embed/serve.go:250","msg":"serving client traffic securely","traffic":"grpc+http","address":"192.168.49.2:2379"}
	{"level":"warn","ts":"2024-07-22T10:31:32.025552Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"116.5802ms","expected-duration":"100ms","prefix":"","request":"header:<ID:8128030693453236363 username:\"kube-apiserver-etcd-client\" auth_revision:1 > txn:<compare:<target:MOD key:\"/registry/serviceaccounts/kube-system/coredns\" mod_revision:237 > success:<request_put:<key:\"/registry/serviceaccounts/kube-system/coredns\" value_size:124 >> failure:<request_range:<key:\"/registry/serviceaccounts/kube-system/coredns\" > >>","response":"size:16"}
	{"level":"info","ts":"2024-07-22T10:31:32.025843Z","caller":"traceutil/trace.go:171","msg":"trace[54396959] transaction","detail":"{read_only:false; response_revision:376; number_of_response:1; }","duration":"164.621654ms","start":"2024-07-22T10:31:31.861207Z","end":"2024-07-22T10:31:32.025829Z","steps":["trace[54396959] 'process raft request'  (duration: 47.40407ms)","trace[54396959] 'compare'  (duration: 116.497574ms)"],"step_count":2}
	{"level":"info","ts":"2024-07-22T10:31:32.776706Z","caller":"traceutil/trace.go:171","msg":"trace[1067895989] transaction","detail":"{read_only:false; response_revision:381; number_of_response:1; }","duration":"146.847491ms","start":"2024-07-22T10:31:32.62984Z","end":"2024-07-22T10:31:32.776687Z","steps":["trace[1067895989] 'process raft request'  (duration: 110.400877ms)","trace[1067895989] 'compare'  (duration: 35.977559ms)"],"step_count":2}
	{"level":"info","ts":"2024-07-22T10:31:32.787079Z","caller":"traceutil/trace.go:171","msg":"trace[589939883] transaction","detail":"{read_only:false; response_revision:382; number_of_response:1; }","duration":"157.173068ms","start":"2024-07-22T10:31:32.629886Z","end":"2024-07-22T10:31:32.787059Z","steps":["trace[589939883] 'process raft request'  (duration: 146.692118ms)"],"step_count":1}
	{"level":"warn","ts":"2024-07-22T10:31:33.199093Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"116.98658ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/services/specs/default/cloud-spanner-emulator\" ","response":"range_response_count:0 size:5"}
	{"level":"info","ts":"2024-07-22T10:31:33.199437Z","caller":"traceutil/trace.go:171","msg":"trace[920519791] range","detail":"{range_begin:/registry/services/specs/default/cloud-spanner-emulator; range_end:; response_count:0; response_revision:387; }","duration":"117.354081ms","start":"2024-07-22T10:31:33.082068Z","end":"2024-07-22T10:31:33.199423Z","steps":["trace[920519791] 'agreement among raft nodes before linearized reading'  (duration: 116.809176ms)"],"step_count":1}
	{"level":"info","ts":"2024-07-22T10:31:33.652577Z","caller":"traceutil/trace.go:171","msg":"trace[280530649] transaction","detail":"{read_only:false; response_revision:389; number_of_response:1; }","duration":"185.936176ms","start":"2024-07-22T10:31:33.466428Z","end":"2024-07-22T10:31:33.652364Z","steps":["trace[280530649] 'process raft request'  (duration: 85.586774ms)"],"step_count":1}
	{"level":"info","ts":"2024-07-22T10:31:33.730687Z","caller":"traceutil/trace.go:171","msg":"trace[38972565] transaction","detail":"{read_only:false; response_revision:391; number_of_response:1; }","duration":"200.123657ms","start":"2024-07-22T10:31:33.53054Z","end":"2024-07-22T10:31:33.730664Z","steps":["trace[38972565] 'process raft request'  (duration: 195.906988ms)"],"step_count":1}
	{"level":"info","ts":"2024-07-22T10:31:33.731127Z","caller":"traceutil/trace.go:171","msg":"trace[2118585148] transaction","detail":"{read_only:false; response_revision:392; number_of_response:1; }","duration":"199.226775ms","start":"2024-07-22T10:31:33.53189Z","end":"2024-07-22T10:31:33.731117Z","steps":["trace[2118585148] 'process raft request'  (duration: 195.322025ms)"],"step_count":1}
	
	
	==> gcp-auth [652b75dc31e146978082cd8f1136ce0f655ae6689f966c62a03ab828d2f351c6] <==
	2024/07/22 10:32:53 GCP Auth Webhook started!
	2024/07/22 10:33:31 Ready to marshal response ...
	2024/07/22 10:33:31 Ready to write response ...
	2024/07/22 10:33:31 Ready to marshal response ...
	2024/07/22 10:33:31 Ready to write response ...
	2024/07/22 10:33:31 Ready to marshal response ...
	2024/07/22 10:33:31 Ready to write response ...
	2024/07/22 10:33:42 Ready to marshal response ...
	2024/07/22 10:33:42 Ready to write response ...
	2024/07/22 10:33:48 Ready to marshal response ...
	2024/07/22 10:33:48 Ready to write response ...
	2024/07/22 10:33:48 Ready to marshal response ...
	2024/07/22 10:33:48 Ready to write response ...
	2024/07/22 10:33:56 Ready to marshal response ...
	2024/07/22 10:33:56 Ready to write response ...
	2024/07/22 10:34:02 Ready to marshal response ...
	2024/07/22 10:34:02 Ready to write response ...
	2024/07/22 10:34:33 Ready to marshal response ...
	2024/07/22 10:34:33 Ready to write response ...
	2024/07/22 10:34:52 Ready to marshal response ...
	2024/07/22 10:34:52 Ready to write response ...
	2024/07/22 10:37:12 Ready to marshal response ...
	2024/07/22 10:37:12 Ready to write response ...
	
	
	==> kernel <==
	 10:37:23 up 19 min,  0 users,  load average: 0.29, 0.91, 0.58
	Linux addons-578168 5.15.0-1064-aws #70~20.04.1-Ubuntu SMP Thu Jun 27 14:52:48 UTC 2024 aarch64 aarch64 aarch64 GNU/Linux
	PRETTY_NAME="Ubuntu 22.04.4 LTS"
	
	
	==> kindnet [872f619c51c416886aba341acb0c461d4f4aa14c0eb3a9141099b7525e942d7f] <==
	E0722 10:36:05.539765       1 reflector.go:150] pkg/mod/k8s.io/client-go@v0.30.2/tools/cache/reflector.go:232: Failed to watch *v1.Pod: failed to list *v1.Pod: pods is forbidden: User "system:serviceaccount:kube-system:kindnet" cannot list resource "pods" in API group "" at the cluster scope
	I0722 10:36:15.443839       1 main.go:295] Handling node with IPs: map[192.168.49.2:{}]
	I0722 10:36:15.443878       1 main.go:299] handling current node
	W0722 10:36:22.628034       1 reflector.go:547] pkg/mod/k8s.io/client-go@v0.30.2/tools/cache/reflector.go:232: failed to list *v1.NetworkPolicy: networkpolicies.networking.k8s.io is forbidden: User "system:serviceaccount:kube-system:kindnet" cannot list resource "networkpolicies" in API group "networking.k8s.io" at the cluster scope
	E0722 10:36:22.628093       1 reflector.go:150] pkg/mod/k8s.io/client-go@v0.30.2/tools/cache/reflector.go:232: Failed to watch *v1.NetworkPolicy: failed to list *v1.NetworkPolicy: networkpolicies.networking.k8s.io is forbidden: User "system:serviceaccount:kube-system:kindnet" cannot list resource "networkpolicies" in API group "networking.k8s.io" at the cluster scope
	I0722 10:36:25.443864       1 main.go:295] Handling node with IPs: map[192.168.49.2:{}]
	I0722 10:36:25.443900       1 main.go:299] handling current node
	I0722 10:36:35.443144       1 main.go:295] Handling node with IPs: map[192.168.49.2:{}]
	I0722 10:36:35.443190       1 main.go:299] handling current node
	W0722 10:36:44.969852       1 reflector.go:547] pkg/mod/k8s.io/client-go@v0.30.2/tools/cache/reflector.go:232: failed to list *v1.Pod: pods is forbidden: User "system:serviceaccount:kube-system:kindnet" cannot list resource "pods" in API group "" at the cluster scope
	E0722 10:36:44.969887       1 reflector.go:150] pkg/mod/k8s.io/client-go@v0.30.2/tools/cache/reflector.go:232: Failed to watch *v1.Pod: failed to list *v1.Pod: pods is forbidden: User "system:serviceaccount:kube-system:kindnet" cannot list resource "pods" in API group "" at the cluster scope
	I0722 10:36:45.443342       1 main.go:295] Handling node with IPs: map[192.168.49.2:{}]
	I0722 10:36:45.443380       1 main.go:299] handling current node
	I0722 10:36:55.443453       1 main.go:295] Handling node with IPs: map[192.168.49.2:{}]
	I0722 10:36:55.443495       1 main.go:299] handling current node
	W0722 10:36:56.509995       1 reflector.go:547] pkg/mod/k8s.io/client-go@v0.30.2/tools/cache/reflector.go:232: failed to list *v1.NetworkPolicy: networkpolicies.networking.k8s.io is forbidden: User "system:serviceaccount:kube-system:kindnet" cannot list resource "networkpolicies" in API group "networking.k8s.io" at the cluster scope
	E0722 10:36:56.510031       1 reflector.go:150] pkg/mod/k8s.io/client-go@v0.30.2/tools/cache/reflector.go:232: Failed to watch *v1.NetworkPolicy: failed to list *v1.NetworkPolicy: networkpolicies.networking.k8s.io is forbidden: User "system:serviceaccount:kube-system:kindnet" cannot list resource "networkpolicies" in API group "networking.k8s.io" at the cluster scope
	W0722 10:36:58.778958       1 reflector.go:547] pkg/mod/k8s.io/client-go@v0.30.2/tools/cache/reflector.go:232: failed to list *v1.Namespace: namespaces is forbidden: User "system:serviceaccount:kube-system:kindnet" cannot list resource "namespaces" in API group "" at the cluster scope
	E0722 10:36:58.778995       1 reflector.go:150] pkg/mod/k8s.io/client-go@v0.30.2/tools/cache/reflector.go:232: Failed to watch *v1.Namespace: failed to list *v1.Namespace: namespaces is forbidden: User "system:serviceaccount:kube-system:kindnet" cannot list resource "namespaces" in API group "" at the cluster scope
	I0722 10:37:05.443719       1 main.go:295] Handling node with IPs: map[192.168.49.2:{}]
	I0722 10:37:05.443758       1 main.go:299] handling current node
	I0722 10:37:15.443962       1 main.go:295] Handling node with IPs: map[192.168.49.2:{}]
	I0722 10:37:15.444001       1 main.go:299] handling current node
	W0722 10:37:22.297394       1 reflector.go:547] pkg/mod/k8s.io/client-go@v0.30.2/tools/cache/reflector.go:232: failed to list *v1.Pod: pods is forbidden: User "system:serviceaccount:kube-system:kindnet" cannot list resource "pods" in API group "" at the cluster scope
	E0722 10:37:22.297432       1 reflector.go:150] pkg/mod/k8s.io/client-go@v0.30.2/tools/cache/reflector.go:232: Failed to watch *v1.Pod: failed to list *v1.Pod: pods is forbidden: User "system:serviceaccount:kube-system:kindnet" cannot list resource "pods" in API group "" at the cluster scope
	
	
	==> kube-apiserver [3eaa36f65893e9ea154ad290476a76999e7fce5187e40f9b7dbac9b55955d25c] <==
	E0722 10:32:56.077484       1 available_controller.go:460] v1beta1.metrics.k8s.io failed with: failing or missing response from https://10.99.238.40:443/apis/metrics.k8s.io/v1beta1: Get "https://10.99.238.40:443/apis/metrics.k8s.io/v1beta1": dial tcp 10.99.238.40:443: connect: connection refused
	E0722 10:32:56.099300       1 available_controller.go:460] v1beta1.metrics.k8s.io failed with: failing or missing response from https://10.99.238.40:443/apis/metrics.k8s.io/v1beta1: Get "https://10.99.238.40:443/apis/metrics.k8s.io/v1beta1": dial tcp 10.99.238.40:443: connect: connection refused
	E0722 10:32:56.145386       1 available_controller.go:460] v1beta1.metrics.k8s.io failed with: failing or missing response from https://10.99.238.40:443/apis/metrics.k8s.io/v1beta1: Get "https://10.99.238.40:443/apis/metrics.k8s.io/v1beta1": dial tcp 10.99.238.40:443: connect: connection refused
	I0722 10:32:56.485169       1 handler.go:286] Adding GroupVersion metrics.k8s.io v1beta1 to ResourceManager
	I0722 10:33:31.616695       1 alloc.go:330] "allocated clusterIPs" service="headlamp/headlamp" clusterIPs={"IPv4":"10.96.110.237"}
	E0722 10:34:12.753855       1 authentication.go:73] "Unable to authenticate the request" err="[invalid bearer token, serviceaccounts \"local-path-provisioner-service-account\" not found]"
	I0722 10:34:15.104655       1 controller.go:615] quota admission added evaluator for: volumesnapshots.snapshot.storage.k8s.io
	I0722 10:34:46.621106       1 handler.go:286] Adding GroupVersion gadget.kinvolk.io v1alpha1 to ResourceManager
	W0722 10:34:47.649049       1 cacher.go:168] Terminating all watchers from cacher traces.gadget.kinvolk.io
	I0722 10:34:48.307401       1 handler.go:286] Adding GroupVersion snapshot.storage.k8s.io v1 to ResourceManager
	I0722 10:34:48.307442       1 handler.go:286] Adding GroupVersion snapshot.storage.k8s.io v1beta1 to ResourceManager
	I0722 10:34:48.332753       1 handler.go:286] Adding GroupVersion snapshot.storage.k8s.io v1 to ResourceManager
	I0722 10:34:48.332803       1 handler.go:286] Adding GroupVersion snapshot.storage.k8s.io v1beta1 to ResourceManager
	I0722 10:34:48.362666       1 handler.go:286] Adding GroupVersion snapshot.storage.k8s.io v1 to ResourceManager
	I0722 10:34:48.362709       1 handler.go:286] Adding GroupVersion snapshot.storage.k8s.io v1beta1 to ResourceManager
	I0722 10:34:48.372344       1 handler.go:286] Adding GroupVersion snapshot.storage.k8s.io v1 to ResourceManager
	I0722 10:34:48.372395       1 handler.go:286] Adding GroupVersion snapshot.storage.k8s.io v1beta1 to ResourceManager
	I0722 10:34:48.387055       1 handler.go:286] Adding GroupVersion snapshot.storage.k8s.io v1 to ResourceManager
	I0722 10:34:48.387172       1 handler.go:286] Adding GroupVersion snapshot.storage.k8s.io v1beta1 to ResourceManager
	W0722 10:34:49.363092       1 cacher.go:168] Terminating all watchers from cacher volumesnapshotclasses.snapshot.storage.k8s.io
	W0722 10:34:49.387903       1 cacher.go:168] Terminating all watchers from cacher volumesnapshotcontents.snapshot.storage.k8s.io
	W0722 10:34:49.411273       1 cacher.go:168] Terminating all watchers from cacher volumesnapshots.snapshot.storage.k8s.io
	I0722 10:34:52.195799       1 controller.go:615] quota admission added evaluator for: ingresses.networking.k8s.io
	I0722 10:34:52.494640       1 alloc.go:330] "allocated clusterIPs" service="default/nginx" clusterIPs={"IPv4":"10.105.214.49"}
	I0722 10:37:12.584364       1 alloc.go:330] "allocated clusterIPs" service="default/hello-world-app" clusterIPs={"IPv4":"10.97.90.215"}
	
	
	==> kube-controller-manager [d064c7ca8b93e4b380a00ab859233190e1fc369f5e15ecf5dfd9b54dbc650897] <==
	E0722 10:35:53.866674       1 reflector.go:150] k8s.io/client-go/metadata/metadatainformer/informer.go:138: Failed to watch *v1.PartialObjectMetadata: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource
	W0722 10:35:58.135266       1 reflector.go:547] k8s.io/client-go/metadata/metadatainformer/informer.go:138: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource
	E0722 10:35:58.135299       1 reflector.go:150] k8s.io/client-go/metadata/metadatainformer/informer.go:138: Failed to watch *v1.PartialObjectMetadata: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource
	W0722 10:36:05.596718       1 reflector.go:547] k8s.io/client-go/metadata/metadatainformer/informer.go:138: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource
	E0722 10:36:05.596755       1 reflector.go:150] k8s.io/client-go/metadata/metadatainformer/informer.go:138: Failed to watch *v1.PartialObjectMetadata: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource
	W0722 10:36:10.694193       1 reflector.go:547] k8s.io/client-go/metadata/metadatainformer/informer.go:138: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource
	E0722 10:36:10.694238       1 reflector.go:150] k8s.io/client-go/metadata/metadatainformer/informer.go:138: Failed to watch *v1.PartialObjectMetadata: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource
	W0722 10:36:39.431146       1 reflector.go:547] k8s.io/client-go/metadata/metadatainformer/informer.go:138: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource
	E0722 10:36:39.431184       1 reflector.go:150] k8s.io/client-go/metadata/metadatainformer/informer.go:138: Failed to watch *v1.PartialObjectMetadata: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource
	W0722 10:36:47.911347       1 reflector.go:547] k8s.io/client-go/metadata/metadatainformer/informer.go:138: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource
	E0722 10:36:47.911389       1 reflector.go:150] k8s.io/client-go/metadata/metadatainformer/informer.go:138: Failed to watch *v1.PartialObjectMetadata: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource
	W0722 10:36:50.604522       1 reflector.go:547] k8s.io/client-go/metadata/metadatainformer/informer.go:138: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource
	E0722 10:36:50.604636       1 reflector.go:150] k8s.io/client-go/metadata/metadatainformer/informer.go:138: Failed to watch *v1.PartialObjectMetadata: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource
	W0722 10:37:06.785228       1 reflector.go:547] k8s.io/client-go/metadata/metadatainformer/informer.go:138: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource
	E0722 10:37:06.785271       1 reflector.go:150] k8s.io/client-go/metadata/metadatainformer/informer.go:138: Failed to watch *v1.PartialObjectMetadata: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource
	I0722 10:37:12.373018       1 replica_set.go:676] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="default/hello-world-app-6778b5fc9f" duration="48.159307ms"
	I0722 10:37:12.392511       1 replica_set.go:676] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="default/hello-world-app-6778b5fc9f" duration="19.349837ms"
	I0722 10:37:12.392806       1 replica_set.go:676] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="default/hello-world-app-6778b5fc9f" duration="40.221µs"
	I0722 10:37:14.125353       1 replica_set.go:676] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="default/hello-world-app-6778b5fc9f" duration="17.075595ms"
	I0722 10:37:14.125738       1 replica_set.go:676] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="default/hello-world-app-6778b5fc9f" duration="53.842µs"
	I0722 10:37:14.762179       1 job_controller.go:566] "enqueueing job" logger="job-controller" key="ingress-nginx/ingress-nginx-admission-create"
	I0722 10:37:14.765711       1 replica_set.go:676] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="ingress-nginx/ingress-nginx-controller-6d9bd977d4" duration="6.704µs"
	I0722 10:37:14.773440       1 job_controller.go:566] "enqueueing job" logger="job-controller" key="ingress-nginx/ingress-nginx-admission-patch"
	W0722 10:37:20.899422       1 reflector.go:547] k8s.io/client-go/metadata/metadatainformer/informer.go:138: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource
	E0722 10:37:20.899459       1 reflector.go:150] k8s.io/client-go/metadata/metadatainformer/informer.go:138: Failed to watch *v1.PartialObjectMetadata: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource
	
	
	==> kube-proxy [b89d03fa7e9ed0ffa3d2a61fb546963c18198c7a24c7257d93f144d4122fe61e] <==
	I0722 10:31:29.687313       1 server_linux.go:69] "Using iptables proxy"
	I0722 10:31:29.722969       1 server.go:1062] "Successfully retrieved node IP(s)" IPs=["192.168.49.2"]
	I0722 10:31:29.842622       1 server.go:659] "kube-proxy running in dual-stack mode" primary ipFamily="IPv4"
	I0722 10:31:29.842750       1 server_linux.go:165] "Using iptables Proxier"
	I0722 10:31:29.861562       1 server_linux.go:511] "Detect-local-mode set to ClusterCIDR, but no cluster CIDR for family" ipFamily="IPv6"
	I0722 10:31:29.862495       1 server_linux.go:528] "Defaulting to no-op detect-local"
	I0722 10:31:29.862578       1 proxier.go:243] "Setting route_localnet=1 to allow node-ports on localhost; to change this either disable iptables.localhostNodePorts (--iptables-localhost-nodeports) or set nodePortAddresses (--nodeport-addresses) to filter loopback addresses"
	I0722 10:31:29.862937       1 server.go:872] "Version info" version="v1.30.3"
	I0722 10:31:29.863149       1 server.go:874] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
	I0722 10:31:29.864104       1 config.go:192] "Starting service config controller"
	I0722 10:31:29.864216       1 shared_informer.go:313] Waiting for caches to sync for service config
	I0722 10:31:29.864272       1 config.go:101] "Starting endpoint slice config controller"
	I0722 10:31:29.864302       1 shared_informer.go:313] Waiting for caches to sync for endpoint slice config
	I0722 10:31:29.864772       1 config.go:319] "Starting node config controller"
	I0722 10:31:29.866604       1 shared_informer.go:313] Waiting for caches to sync for node config
	I0722 10:31:29.965239       1 shared_informer.go:320] Caches are synced for endpoint slice config
	I0722 10:31:29.965351       1 shared_informer.go:320] Caches are synced for service config
	I0722 10:31:29.966884       1 shared_informer.go:320] Caches are synced for node config
	
	
	==> kube-scheduler [be869384de7f9f26c6638b2090ca4d4ae3c4463e38549fcc1f474aa8077b8359] <==
	W0722 10:31:13.606085       1 reflector.go:547] k8s.io/client-go/informers/factory.go:160: failed to list *v1.CSIStorageCapacity: csistoragecapacities.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csistoragecapacities" in API group "storage.k8s.io" at the cluster scope
	E0722 10:31:13.607134       1 reflector.go:150] k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.CSIStorageCapacity: failed to list *v1.CSIStorageCapacity: csistoragecapacities.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csistoragecapacities" in API group "storage.k8s.io" at the cluster scope
	W0722 10:31:13.606155       1 reflector.go:547] k8s.io/client-go/informers/factory.go:160: failed to list *v1.Service: services is forbidden: User "system:kube-scheduler" cannot list resource "services" in API group "" at the cluster scope
	W0722 10:31:13.606193       1 reflector.go:547] k8s.io/client-go/informers/factory.go:160: failed to list *v1.StorageClass: storageclasses.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "storageclasses" in API group "storage.k8s.io" at the cluster scope
	W0722 10:31:13.606259       1 reflector.go:547] k8s.io/client-go/informers/factory.go:160: failed to list *v1.PodDisruptionBudget: poddisruptionbudgets.policy is forbidden: User "system:kube-scheduler" cannot list resource "poddisruptionbudgets" in API group "policy" at the cluster scope
	W0722 10:31:13.606294       1 reflector.go:547] k8s.io/client-go/informers/factory.go:160: failed to list *v1.StatefulSet: statefulsets.apps is forbidden: User "system:kube-scheduler" cannot list resource "statefulsets" in API group "apps" at the cluster scope
	W0722 10:31:13.606329       1 reflector.go:547] k8s.io/client-go/informers/factory.go:160: failed to list *v1.PersistentVolume: persistentvolumes is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumes" in API group "" at the cluster scope
	E0722 10:31:13.607253       1 reflector.go:150] k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.Service: failed to list *v1.Service: services is forbidden: User "system:kube-scheduler" cannot list resource "services" in API group "" at the cluster scope
	E0722 10:31:13.607302       1 reflector.go:150] k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.StorageClass: failed to list *v1.StorageClass: storageclasses.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "storageclasses" in API group "storage.k8s.io" at the cluster scope
	E0722 10:31:13.607348       1 reflector.go:150] k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.PodDisruptionBudget: failed to list *v1.PodDisruptionBudget: poddisruptionbudgets.policy is forbidden: User "system:kube-scheduler" cannot list resource "poddisruptionbudgets" in API group "policy" at the cluster scope
	E0722 10:31:13.607398       1 reflector.go:150] k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.StatefulSet: failed to list *v1.StatefulSet: statefulsets.apps is forbidden: User "system:kube-scheduler" cannot list resource "statefulsets" in API group "apps" at the cluster scope
	E0722 10:31:13.607451       1 reflector.go:150] k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.PersistentVolume: failed to list *v1.PersistentVolume: persistentvolumes is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumes" in API group "" at the cluster scope
	W0722 10:31:14.448425       1 reflector.go:547] k8s.io/client-go/informers/factory.go:160: failed to list *v1.StatefulSet: statefulsets.apps is forbidden: User "system:kube-scheduler" cannot list resource "statefulsets" in API group "apps" at the cluster scope
	E0722 10:31:14.448463       1 reflector.go:150] k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.StatefulSet: failed to list *v1.StatefulSet: statefulsets.apps is forbidden: User "system:kube-scheduler" cannot list resource "statefulsets" in API group "apps" at the cluster scope
	W0722 10:31:14.457284       1 reflector.go:547] k8s.io/client-go/informers/factory.go:160: failed to list *v1.PodDisruptionBudget: poddisruptionbudgets.policy is forbidden: User "system:kube-scheduler" cannot list resource "poddisruptionbudgets" in API group "policy" at the cluster scope
	E0722 10:31:14.457399       1 reflector.go:150] k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.PodDisruptionBudget: failed to list *v1.PodDisruptionBudget: poddisruptionbudgets.policy is forbidden: User "system:kube-scheduler" cannot list resource "poddisruptionbudgets" in API group "policy" at the cluster scope
	W0722 10:31:14.463567       1 reflector.go:547] k8s.io/client-go/informers/factory.go:160: failed to list *v1.CSIStorageCapacity: csistoragecapacities.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csistoragecapacities" in API group "storage.k8s.io" at the cluster scope
	E0722 10:31:14.463671       1 reflector.go:150] k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.CSIStorageCapacity: failed to list *v1.CSIStorageCapacity: csistoragecapacities.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csistoragecapacities" in API group "storage.k8s.io" at the cluster scope
	W0722 10:31:14.468132       1 reflector.go:547] k8s.io/client-go/informers/factory.go:160: failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csidrivers" in API group "storage.k8s.io" at the cluster scope
	E0722 10:31:14.468346       1 reflector.go:150] k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.CSIDriver: failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csidrivers" in API group "storage.k8s.io" at the cluster scope
	W0722 10:31:14.530591       1 reflector.go:547] k8s.io/client-go/informers/factory.go:160: failed to list *v1.ReplicaSet: replicasets.apps is forbidden: User "system:kube-scheduler" cannot list resource "replicasets" in API group "apps" at the cluster scope
	E0722 10:31:14.530712       1 reflector.go:150] k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.ReplicaSet: failed to list *v1.ReplicaSet: replicasets.apps is forbidden: User "system:kube-scheduler" cannot list resource "replicasets" in API group "apps" at the cluster scope
	W0722 10:31:14.578546       1 reflector.go:547] runtime/asm_arm64.s:1222: failed to list *v1.ConfigMap: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot list resource "configmaps" in API group "" in the namespace "kube-system"
	E0722 10:31:14.578666       1 reflector.go:150] runtime/asm_arm64.s:1222: Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot list resource "configmaps" in API group "" in the namespace "kube-system"
	I0722 10:31:17.292783       1 shared_informer.go:320] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file
	
	
	==> kubelet <==
	Jul 22 10:37:12 addons-578168 kubelet[1541]: I0722 10:37:12.451863    1541 reconciler_common.go:247] "operationExecutor.VerifyControllerAttachedVolume started for volume \"gcp-creds\" (UniqueName: \"kubernetes.io/host-path/7c0c3583-8cf1-4558-8945-0ee8835a350e-gcp-creds\") pod \"hello-world-app-6778b5fc9f-gr6bg\" (UID: \"7c0c3583-8cf1-4558-8945-0ee8835a350e\") " pod="default/hello-world-app-6778b5fc9f-gr6bg"
	Jul 22 10:37:13 addons-578168 kubelet[1541]: I0722 10:37:13.662999    1541 reconciler_common.go:161] "operationExecutor.UnmountVolume started for volume \"kube-api-access-thn68\" (UniqueName: \"kubernetes.io/projected/9ea7b2d6-84ca-4b41-b838-277a02fbac6e-kube-api-access-thn68\") pod \"9ea7b2d6-84ca-4b41-b838-277a02fbac6e\" (UID: \"9ea7b2d6-84ca-4b41-b838-277a02fbac6e\") "
	Jul 22 10:37:13 addons-578168 kubelet[1541]: I0722 10:37:13.674623    1541 operation_generator.go:887] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9ea7b2d6-84ca-4b41-b838-277a02fbac6e-kube-api-access-thn68" (OuterVolumeSpecName: "kube-api-access-thn68") pod "9ea7b2d6-84ca-4b41-b838-277a02fbac6e" (UID: "9ea7b2d6-84ca-4b41-b838-277a02fbac6e"). InnerVolumeSpecName "kube-api-access-thn68". PluginName "kubernetes.io/projected", VolumeGidValue ""
	Jul 22 10:37:13 addons-578168 kubelet[1541]: I0722 10:37:13.763794    1541 reconciler_common.go:289] "Volume detached for volume \"kube-api-access-thn68\" (UniqueName: \"kubernetes.io/projected/9ea7b2d6-84ca-4b41-b838-277a02fbac6e-kube-api-access-thn68\") on node \"addons-578168\" DevicePath \"\""
	Jul 22 10:37:14 addons-578168 kubelet[1541]: I0722 10:37:14.096484    1541 scope.go:117] "RemoveContainer" containerID="5406936ec4754416f7f8dabe6e59a74f2dfe2c7679c607b31885eeea5d24cd8a"
	Jul 22 10:37:14 addons-578168 kubelet[1541]: I0722 10:37:14.118917    1541 scope.go:117] "RemoveContainer" containerID="5406936ec4754416f7f8dabe6e59a74f2dfe2c7679c607b31885eeea5d24cd8a"
	Jul 22 10:37:14 addons-578168 kubelet[1541]: E0722 10:37:14.119413    1541 remote_runtime.go:432] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5406936ec4754416f7f8dabe6e59a74f2dfe2c7679c607b31885eeea5d24cd8a\": container with ID starting with 5406936ec4754416f7f8dabe6e59a74f2dfe2c7679c607b31885eeea5d24cd8a not found: ID does not exist" containerID="5406936ec4754416f7f8dabe6e59a74f2dfe2c7679c607b31885eeea5d24cd8a"
	Jul 22 10:37:14 addons-578168 kubelet[1541]: I0722 10:37:14.119446    1541 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5406936ec4754416f7f8dabe6e59a74f2dfe2c7679c607b31885eeea5d24cd8a"} err="failed to get container status \"5406936ec4754416f7f8dabe6e59a74f2dfe2c7679c607b31885eeea5d24cd8a\": rpc error: code = NotFound desc = could not find container \"5406936ec4754416f7f8dabe6e59a74f2dfe2c7679c607b31885eeea5d24cd8a\": container with ID starting with 5406936ec4754416f7f8dabe6e59a74f2dfe2c7679c607b31885eeea5d24cd8a not found: ID does not exist"
	Jul 22 10:37:14 addons-578168 kubelet[1541]: I0722 10:37:14.139260    1541 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="default/hello-world-app-6778b5fc9f-gr6bg" podStartSLOduration=1.145960744 podStartE2EDuration="2.139240658s" podCreationTimestamp="2024-07-22 10:37:12 +0000 UTC" firstStartedPulling="2024-07-22 10:37:12.733922011 +0000 UTC m=+357.237831626" lastFinishedPulling="2024-07-22 10:37:13.727201933 +0000 UTC m=+358.231111540" observedRunningTime="2024-07-22 10:37:14.108245134 +0000 UTC m=+358.612154741" watchObservedRunningTime="2024-07-22 10:37:14.139240658 +0000 UTC m=+358.643150264"
	Jul 22 10:37:15 addons-578168 kubelet[1541]: I0722 10:37:15.674937    1541 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3e89c57b-45f8-48ca-b163-e8d92f30e4aa" path="/var/lib/kubelet/pods/3e89c57b-45f8-48ca-b163-e8d92f30e4aa/volumes"
	Jul 22 10:37:15 addons-578168 kubelet[1541]: I0722 10:37:15.675777    1541 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="415812b3-fc03-4dd5-abce-289f98c559dc" path="/var/lib/kubelet/pods/415812b3-fc03-4dd5-abce-289f98c559dc/volumes"
	Jul 22 10:37:15 addons-578168 kubelet[1541]: I0722 10:37:15.676980    1541 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9ea7b2d6-84ca-4b41-b838-277a02fbac6e" path="/var/lib/kubelet/pods/9ea7b2d6-84ca-4b41-b838-277a02fbac6e/volumes"
	Jul 22 10:37:16 addons-578168 kubelet[1541]: I0722 10:37:16.048578    1541 scope.go:117] "RemoveContainer" containerID="134d2507c68760c489a7adfb9262d45c411b179680d8f5d4a78ab514fda59f98"
	Jul 22 10:37:16 addons-578168 kubelet[1541]: I0722 10:37:16.065072    1541 scope.go:117] "RemoveContainer" containerID="e9a6c68bccd440c3996ff62a2f009b16bc4e1a8c48e6025152a65736e39e2543"
	Jul 22 10:37:18 addons-578168 kubelet[1541]: I0722 10:37:18.092973    1541 reconciler_common.go:161] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kjnwm\" (UniqueName: \"kubernetes.io/projected/e739a650-7924-41c4-bf78-5835a8a60047-kube-api-access-kjnwm\") pod \"e739a650-7924-41c4-bf78-5835a8a60047\" (UID: \"e739a650-7924-41c4-bf78-5835a8a60047\") "
	Jul 22 10:37:18 addons-578168 kubelet[1541]: I0722 10:37:18.093037    1541 reconciler_common.go:161] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e739a650-7924-41c4-bf78-5835a8a60047-webhook-cert\") pod \"e739a650-7924-41c4-bf78-5835a8a60047\" (UID: \"e739a650-7924-41c4-bf78-5835a8a60047\") "
	Jul 22 10:37:18 addons-578168 kubelet[1541]: I0722 10:37:18.095518    1541 operation_generator.go:887] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e739a650-7924-41c4-bf78-5835a8a60047-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "e739a650-7924-41c4-bf78-5835a8a60047" (UID: "e739a650-7924-41c4-bf78-5835a8a60047"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGidValue ""
	Jul 22 10:37:18 addons-578168 kubelet[1541]: I0722 10:37:18.098863    1541 operation_generator.go:887] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e739a650-7924-41c4-bf78-5835a8a60047-kube-api-access-kjnwm" (OuterVolumeSpecName: "kube-api-access-kjnwm") pod "e739a650-7924-41c4-bf78-5835a8a60047" (UID: "e739a650-7924-41c4-bf78-5835a8a60047"). InnerVolumeSpecName "kube-api-access-kjnwm". PluginName "kubernetes.io/projected", VolumeGidValue ""
	Jul 22 10:37:18 addons-578168 kubelet[1541]: I0722 10:37:18.107657    1541 scope.go:117] "RemoveContainer" containerID="6a874d432dcdb5eb46cd1f03811d08edb612216544a177fbfa1155872ca9a99d"
	Jul 22 10:37:18 addons-578168 kubelet[1541]: I0722 10:37:18.130230    1541 scope.go:117] "RemoveContainer" containerID="6a874d432dcdb5eb46cd1f03811d08edb612216544a177fbfa1155872ca9a99d"
	Jul 22 10:37:18 addons-578168 kubelet[1541]: E0722 10:37:18.130633    1541 remote_runtime.go:432] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6a874d432dcdb5eb46cd1f03811d08edb612216544a177fbfa1155872ca9a99d\": container with ID starting with 6a874d432dcdb5eb46cd1f03811d08edb612216544a177fbfa1155872ca9a99d not found: ID does not exist" containerID="6a874d432dcdb5eb46cd1f03811d08edb612216544a177fbfa1155872ca9a99d"
	Jul 22 10:37:18 addons-578168 kubelet[1541]: I0722 10:37:18.130671    1541 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6a874d432dcdb5eb46cd1f03811d08edb612216544a177fbfa1155872ca9a99d"} err="failed to get container status \"6a874d432dcdb5eb46cd1f03811d08edb612216544a177fbfa1155872ca9a99d\": rpc error: code = NotFound desc = could not find container \"6a874d432dcdb5eb46cd1f03811d08edb612216544a177fbfa1155872ca9a99d\": container with ID starting with 6a874d432dcdb5eb46cd1f03811d08edb612216544a177fbfa1155872ca9a99d not found: ID does not exist"
	Jul 22 10:37:18 addons-578168 kubelet[1541]: I0722 10:37:18.194237    1541 reconciler_common.go:289] "Volume detached for volume \"kube-api-access-kjnwm\" (UniqueName: \"kubernetes.io/projected/e739a650-7924-41c4-bf78-5835a8a60047-kube-api-access-kjnwm\") on node \"addons-578168\" DevicePath \"\""
	Jul 22 10:37:18 addons-578168 kubelet[1541]: I0722 10:37:18.194280    1541 reconciler_common.go:289] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e739a650-7924-41c4-bf78-5835a8a60047-webhook-cert\") on node \"addons-578168\" DevicePath \"\""
	Jul 22 10:37:19 addons-578168 kubelet[1541]: I0722 10:37:19.673076    1541 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e739a650-7924-41c4-bf78-5835a8a60047" path="/var/lib/kubelet/pods/e739a650-7924-41c4-bf78-5835a8a60047/volumes"
	
	
	==> storage-provisioner [17687e7fd50ab16cf0de5fa906428a495071a12266be1c95139407674f6af363] <==
	I0722 10:31:46.365847       1 storage_provisioner.go:116] Initializing the minikube storage provisioner...
	I0722 10:31:46.456785       1 storage_provisioner.go:141] Storage provisioner initialized, now starting service!
	I0722 10:31:46.456834       1 leaderelection.go:243] attempting to acquire leader lease kube-system/k8s.io-minikube-hostpath...
	I0722 10:31:46.466736       1 leaderelection.go:253] successfully acquired lease kube-system/k8s.io-minikube-hostpath
	I0722 10:31:46.466899       1 controller.go:835] Starting provisioner controller k8s.io/minikube-hostpath_addons-578168_6763285f-b6d2-422d-9c25-1576c5f17dd6!
	I0722 10:31:46.474149       1 event.go:282] Event(v1.ObjectReference{Kind:"Endpoints", Namespace:"kube-system", Name:"k8s.io-minikube-hostpath", UID:"505e2309-8f08-4afb-a915-aa0db0373c7e", APIVersion:"v1", ResourceVersion:"894", FieldPath:""}): type: 'Normal' reason: 'LeaderElection' addons-578168_6763285f-b6d2-422d-9c25-1576c5f17dd6 became leader
	I0722 10:31:46.567584       1 controller.go:884] Started provisioner controller k8s.io/minikube-hostpath_addons-578168_6763285f-b6d2-422d-9c25-1576c5f17dd6!
	

                                                
                                                
-- /stdout --
helpers_test.go:254: (dbg) Run:  out/minikube-linux-arm64 status --format={{.APIServer}} -p addons-578168 -n addons-578168
helpers_test.go:261: (dbg) Run:  kubectl --context addons-578168 get po -o=jsonpath={.items[*].metadata.name} -A --field-selector=status.phase!=Running
helpers_test.go:285: <<< TestAddons/parallel/Ingress FAILED: end of post-mortem logs <<<
helpers_test.go:286: ---------------------/post-mortem---------------------------------
--- FAIL: TestAddons/parallel/Ingress (152.45s)

                                                
                                    
x
+
TestAddons/parallel/MetricsServer (353.93s)

                                                
                                                
=== RUN   TestAddons/parallel/MetricsServer
=== PAUSE TestAddons/parallel/MetricsServer

                                                
                                                

                                                
                                                
=== CONT  TestAddons/parallel/MetricsServer
addons_test.go:409: metrics-server stabilized in 4.184667ms
addons_test.go:411: (dbg) TestAddons/parallel/MetricsServer: waiting 6m0s for pods matching "k8s-app=metrics-server" in namespace "kube-system" ...
helpers_test.go:344: "metrics-server-c59844bb4-qqltc" [25386e93-7dbb-4ba9-948a-f1aecb63987c] Running
addons_test.go:411: (dbg) TestAddons/parallel/MetricsServer: k8s-app=metrics-server healthy within 5.005879373s
addons_test.go:417: (dbg) Run:  kubectl --context addons-578168 top pods -n kube-system
addons_test.go:417: (dbg) Non-zero exit: kubectl --context addons-578168 top pods -n kube-system: exit status 1 (168.911002ms)

                                                
                                                
** stderr ** 
	error: Metrics not available for pod kube-system/coredns-7db6d8ff4d-dz9nf, age: 3m24.729171s

                                                
                                                
** /stderr **
addons_test.go:417: (dbg) Run:  kubectl --context addons-578168 top pods -n kube-system
addons_test.go:417: (dbg) Non-zero exit: kubectl --context addons-578168 top pods -n kube-system: exit status 1 (93.326935ms)

                                                
                                                
** stderr ** 
	error: Metrics not available for pod kube-system/coredns-7db6d8ff4d-dz9nf, age: 3m26.371132392s

                                                
                                                
** /stderr **
addons_test.go:417: (dbg) Run:  kubectl --context addons-578168 top pods -n kube-system
addons_test.go:417: (dbg) Non-zero exit: kubectl --context addons-578168 top pods -n kube-system: exit status 1 (84.629764ms)

                                                
                                                
** stderr ** 
	error: Metrics not available for pod kube-system/coredns-7db6d8ff4d-dz9nf, age: 3m29.626426534s

                                                
                                                
** /stderr **
addons_test.go:417: (dbg) Run:  kubectl --context addons-578168 top pods -n kube-system
addons_test.go:417: (dbg) Non-zero exit: kubectl --context addons-578168 top pods -n kube-system: exit status 1 (83.524349ms)

                                                
                                                
** stderr ** 
	error: Metrics not available for pod kube-system/coredns-7db6d8ff4d-dz9nf, age: 3m38.571169157s

                                                
                                                
** /stderr **
addons_test.go:417: (dbg) Run:  kubectl --context addons-578168 top pods -n kube-system
addons_test.go:417: (dbg) Non-zero exit: kubectl --context addons-578168 top pods -n kube-system: exit status 1 (89.816434ms)

                                                
                                                
** stderr ** 
	error: Metrics not available for pod kube-system/coredns-7db6d8ff4d-dz9nf, age: 3m46.259684754s

                                                
                                                
** /stderr **
addons_test.go:417: (dbg) Run:  kubectl --context addons-578168 top pods -n kube-system
addons_test.go:417: (dbg) Non-zero exit: kubectl --context addons-578168 top pods -n kube-system: exit status 1 (92.958565ms)

                                                
                                                
** stderr ** 
	error: Metrics not available for pod kube-system/coredns-7db6d8ff4d-dz9nf, age: 3m56.811884224s

                                                
                                                
** /stderr **
addons_test.go:417: (dbg) Run:  kubectl --context addons-578168 top pods -n kube-system
addons_test.go:417: (dbg) Non-zero exit: kubectl --context addons-578168 top pods -n kube-system: exit status 1 (86.089704ms)

                                                
                                                
** stderr ** 
	error: Metrics not available for pod kube-system/coredns-7db6d8ff4d-dz9nf, age: 4m19.345785352s

                                                
                                                
** /stderr **
addons_test.go:417: (dbg) Run:  kubectl --context addons-578168 top pods -n kube-system
addons_test.go:417: (dbg) Non-zero exit: kubectl --context addons-578168 top pods -n kube-system: exit status 1 (83.737856ms)

                                                
                                                
** stderr ** 
	error: Metrics not available for pod kube-system/coredns-7db6d8ff4d-dz9nf, age: 5m3.759178882s

                                                
                                                
** /stderr **
addons_test.go:417: (dbg) Run:  kubectl --context addons-578168 top pods -n kube-system
addons_test.go:417: (dbg) Non-zero exit: kubectl --context addons-578168 top pods -n kube-system: exit status 1 (119.370363ms)

                                                
                                                
** stderr ** 
	error: Metrics not available for pod kube-system/coredns-7db6d8ff4d-dz9nf, age: 5m54.342647358s

                                                
                                                
** /stderr **
addons_test.go:417: (dbg) Run:  kubectl --context addons-578168 top pods -n kube-system
addons_test.go:417: (dbg) Non-zero exit: kubectl --context addons-578168 top pods -n kube-system: exit status 1 (82.657056ms)

                                                
                                                
** stderr ** 
	error: Metrics not available for pod kube-system/coredns-7db6d8ff4d-dz9nf, age: 7m16.736634529s

                                                
                                                
** /stderr **
addons_test.go:417: (dbg) Run:  kubectl --context addons-578168 top pods -n kube-system
addons_test.go:417: (dbg) Non-zero exit: kubectl --context addons-578168 top pods -n kube-system: exit status 1 (95.32118ms)

                                                
                                                
** stderr ** 
	error: Metrics not available for pod kube-system/coredns-7db6d8ff4d-dz9nf, age: 8m27.475555336s

                                                
                                                
** /stderr **
addons_test.go:417: (dbg) Run:  kubectl --context addons-578168 top pods -n kube-system
addons_test.go:417: (dbg) Non-zero exit: kubectl --context addons-578168 top pods -n kube-system: exit status 1 (92.087975ms)

                                                
                                                
** stderr ** 
	error: Metrics not available for pod kube-system/coredns-7db6d8ff4d-dz9nf, age: 9m10.286099425s

                                                
                                                
** /stderr **
addons_test.go:431: failed checking metric server: exit status 1
addons_test.go:434: (dbg) Run:  out/minikube-linux-arm64 -p addons-578168 addons disable metrics-server --alsologtostderr -v=1
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:230: ======>  post-mortem[TestAddons/parallel/MetricsServer]: docker inspect <======
helpers_test.go:231: (dbg) Run:  docker inspect addons-578168
helpers_test.go:235: (dbg) docker inspect addons-578168:

                                                
                                                
-- stdout --
	[
	    {
	        "Id": "40bf57728062d55da8ed4ca764cac539ef1f3f90f65fc96f5a1b1ff997a2ffc0",
	        "Created": "2024-07-22T10:30:51.267539624Z",
	        "Path": "/usr/local/bin/entrypoint",
	        "Args": [
	            "/sbin/init"
	        ],
	        "State": {
	            "Status": "running",
	            "Running": true,
	            "Paused": false,
	            "Restarting": false,
	            "OOMKilled": false,
	            "Dead": false,
	            "Pid": 9081,
	            "ExitCode": 0,
	            "Error": "",
	            "StartedAt": "2024-07-22T10:30:51.414530689Z",
	            "FinishedAt": "0001-01-01T00:00:00Z"
	        },
	        "Image": "sha256:e2c91a2178aa1acdb3eade350c62303b0cf135b362b91c6aa21cd060c2dbfcac",
	        "ResolvConfPath": "/var/lib/docker/containers/40bf57728062d55da8ed4ca764cac539ef1f3f90f65fc96f5a1b1ff997a2ffc0/resolv.conf",
	        "HostnamePath": "/var/lib/docker/containers/40bf57728062d55da8ed4ca764cac539ef1f3f90f65fc96f5a1b1ff997a2ffc0/hostname",
	        "HostsPath": "/var/lib/docker/containers/40bf57728062d55da8ed4ca764cac539ef1f3f90f65fc96f5a1b1ff997a2ffc0/hosts",
	        "LogPath": "/var/lib/docker/containers/40bf57728062d55da8ed4ca764cac539ef1f3f90f65fc96f5a1b1ff997a2ffc0/40bf57728062d55da8ed4ca764cac539ef1f3f90f65fc96f5a1b1ff997a2ffc0-json.log",
	        "Name": "/addons-578168",
	        "RestartCount": 0,
	        "Driver": "overlay2",
	        "Platform": "linux",
	        "MountLabel": "",
	        "ProcessLabel": "",
	        "AppArmorProfile": "unconfined",
	        "ExecIDs": null,
	        "HostConfig": {
	            "Binds": [
	                "/lib/modules:/lib/modules:ro",
	                "addons-578168:/var"
	            ],
	            "ContainerIDFile": "",
	            "LogConfig": {
	                "Type": "json-file",
	                "Config": {}
	            },
	            "NetworkMode": "addons-578168",
	            "PortBindings": {
	                "22/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": ""
	                    }
	                ],
	                "2376/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": ""
	                    }
	                ],
	                "32443/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": ""
	                    }
	                ],
	                "5000/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": ""
	                    }
	                ],
	                "8443/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": ""
	                    }
	                ]
	            },
	            "RestartPolicy": {
	                "Name": "no",
	                "MaximumRetryCount": 0
	            },
	            "AutoRemove": false,
	            "VolumeDriver": "",
	            "VolumesFrom": null,
	            "ConsoleSize": [
	                0,
	                0
	            ],
	            "CapAdd": null,
	            "CapDrop": null,
	            "CgroupnsMode": "host",
	            "Dns": [],
	            "DnsOptions": [],
	            "DnsSearch": [],
	            "ExtraHosts": null,
	            "GroupAdd": null,
	            "IpcMode": "private",
	            "Cgroup": "",
	            "Links": null,
	            "OomScoreAdj": 0,
	            "PidMode": "",
	            "Privileged": true,
	            "PublishAllPorts": false,
	            "ReadonlyRootfs": false,
	            "SecurityOpt": [
	                "seccomp=unconfined",
	                "apparmor=unconfined",
	                "label=disable"
	            ],
	            "Tmpfs": {
	                "/run": "",
	                "/tmp": ""
	            },
	            "UTSMode": "",
	            "UsernsMode": "",
	            "ShmSize": 67108864,
	            "Runtime": "runc",
	            "Isolation": "",
	            "CpuShares": 0,
	            "Memory": 4194304000,
	            "NanoCpus": 2000000000,
	            "CgroupParent": "",
	            "BlkioWeight": 0,
	            "BlkioWeightDevice": [],
	            "BlkioDeviceReadBps": [],
	            "BlkioDeviceWriteBps": [],
	            "BlkioDeviceReadIOps": [],
	            "BlkioDeviceWriteIOps": [],
	            "CpuPeriod": 0,
	            "CpuQuota": 0,
	            "CpuRealtimePeriod": 0,
	            "CpuRealtimeRuntime": 0,
	            "CpusetCpus": "",
	            "CpusetMems": "",
	            "Devices": [],
	            "DeviceCgroupRules": null,
	            "DeviceRequests": null,
	            "MemoryReservation": 0,
	            "MemorySwap": 8388608000,
	            "MemorySwappiness": null,
	            "OomKillDisable": false,
	            "PidsLimit": null,
	            "Ulimits": [],
	            "CpuCount": 0,
	            "CpuPercent": 0,
	            "IOMaximumIOps": 0,
	            "IOMaximumBandwidth": 0,
	            "MaskedPaths": null,
	            "ReadonlyPaths": null
	        },
	        "GraphDriver": {
	            "Data": {
	                "LowerDir": "/var/lib/docker/overlay2/48f10ecf198ef9cf47dbfcf8b90201828b97572ce1398e1d17f0eb69f73a9a4c-init/diff:/var/lib/docker/overlay2/375eed0e332cee71fb41f23c3bebb2cf752289490317aab56b4bc0e86204dc16/diff",
	                "MergedDir": "/var/lib/docker/overlay2/48f10ecf198ef9cf47dbfcf8b90201828b97572ce1398e1d17f0eb69f73a9a4c/merged",
	                "UpperDir": "/var/lib/docker/overlay2/48f10ecf198ef9cf47dbfcf8b90201828b97572ce1398e1d17f0eb69f73a9a4c/diff",
	                "WorkDir": "/var/lib/docker/overlay2/48f10ecf198ef9cf47dbfcf8b90201828b97572ce1398e1d17f0eb69f73a9a4c/work"
	            },
	            "Name": "overlay2"
	        },
	        "Mounts": [
	            {
	                "Type": "bind",
	                "Source": "/lib/modules",
	                "Destination": "/lib/modules",
	                "Mode": "ro",
	                "RW": false,
	                "Propagation": "rprivate"
	            },
	            {
	                "Type": "volume",
	                "Name": "addons-578168",
	                "Source": "/var/lib/docker/volumes/addons-578168/_data",
	                "Destination": "/var",
	                "Driver": "local",
	                "Mode": "z",
	                "RW": true,
	                "Propagation": ""
	            }
	        ],
	        "Config": {
	            "Hostname": "addons-578168",
	            "Domainname": "",
	            "User": "",
	            "AttachStdin": false,
	            "AttachStdout": false,
	            "AttachStderr": false,
	            "ExposedPorts": {
	                "22/tcp": {},
	                "2376/tcp": {},
	                "32443/tcp": {},
	                "5000/tcp": {},
	                "8443/tcp": {}
	            },
	            "Tty": true,
	            "OpenStdin": false,
	            "StdinOnce": false,
	            "Env": [
	                "container=docker",
	                "PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin"
	            ],
	            "Cmd": null,
	            "Image": "gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721324606-19298@sha256:1c495b056df42bd3fd9a5c30d049e1802f9ed73a342611781f1ccc3c3853953f",
	            "Volumes": null,
	            "WorkingDir": "/",
	            "Entrypoint": [
	                "/usr/local/bin/entrypoint",
	                "/sbin/init"
	            ],
	            "OnBuild": null,
	            "Labels": {
	                "created_by.minikube.sigs.k8s.io": "true",
	                "mode.minikube.sigs.k8s.io": "addons-578168",
	                "name.minikube.sigs.k8s.io": "addons-578168",
	                "role.minikube.sigs.k8s.io": ""
	            },
	            "StopSignal": "SIGRTMIN+3"
	        },
	        "NetworkSettings": {
	            "Bridge": "",
	            "SandboxID": "04f9cbaa5854c7178efd3697ce48fae970941e26075b1c5824a16b821fd67eaf",
	            "SandboxKey": "/var/run/docker/netns/04f9cbaa5854",
	            "Ports": {
	                "22/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": "32768"
	                    }
	                ],
	                "2376/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": "32769"
	                    }
	                ],
	                "32443/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": "32772"
	                    }
	                ],
	                "5000/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": "32770"
	                    }
	                ],
	                "8443/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": "32771"
	                    }
	                ]
	            },
	            "HairpinMode": false,
	            "LinkLocalIPv6Address": "",
	            "LinkLocalIPv6PrefixLen": 0,
	            "SecondaryIPAddresses": null,
	            "SecondaryIPv6Addresses": null,
	            "EndpointID": "",
	            "Gateway": "",
	            "GlobalIPv6Address": "",
	            "GlobalIPv6PrefixLen": 0,
	            "IPAddress": "",
	            "IPPrefixLen": 0,
	            "IPv6Gateway": "",
	            "MacAddress": "",
	            "Networks": {
	                "addons-578168": {
	                    "IPAMConfig": {
	                        "IPv4Address": "192.168.49.2"
	                    },
	                    "Links": null,
	                    "Aliases": null,
	                    "MacAddress": "02:42:c0:a8:31:02",
	                    "DriverOpts": null,
	                    "NetworkID": "dfa62625aa072cff84687ae2020c802c4bb4741da8a3aa9bb82e88eaf74cdd14",
	                    "EndpointID": "ba3e15c0d4daeed295006ade44694678467285844a412dbfee0f77a6696f89a4",
	                    "Gateway": "192.168.49.1",
	                    "IPAddress": "192.168.49.2",
	                    "IPPrefixLen": 24,
	                    "IPv6Gateway": "",
	                    "GlobalIPv6Address": "",
	                    "GlobalIPv6PrefixLen": 0,
	                    "DNSNames": [
	                        "addons-578168",
	                        "40bf57728062"
	                    ]
	                }
	            }
	        }
	    }
	]

                                                
                                                
-- /stdout --
helpers_test.go:239: (dbg) Run:  out/minikube-linux-arm64 status --format={{.Host}} -p addons-578168 -n addons-578168
helpers_test.go:244: <<< TestAddons/parallel/MetricsServer FAILED: start of post-mortem logs <<<
helpers_test.go:245: ======>  post-mortem[TestAddons/parallel/MetricsServer]: minikube logs <======
helpers_test.go:247: (dbg) Run:  out/minikube-linux-arm64 -p addons-578168 logs -n 25
helpers_test.go:247: (dbg) Done: out/minikube-linux-arm64 -p addons-578168 logs -n 25: (1.512620699s)
helpers_test.go:252: TestAddons/parallel/MetricsServer logs: 
-- stdout --
	
	==> Audit <==
	|---------|---------------------------------------------------------------------------------------------|------------------------|---------|---------|---------------------|---------------------|
	| Command |                                            Args                                             |        Profile         |  User   | Version |     Start Time      |      End Time       |
	|---------|---------------------------------------------------------------------------------------------|------------------------|---------|---------|---------------------|---------------------|
	| delete  | -p download-only-465809                                                                     | download-only-465809   | jenkins | v1.33.1 | 22 Jul 24 10:30 UTC | 22 Jul 24 10:30 UTC |
	| delete  | -p download-only-516107                                                                     | download-only-516107   | jenkins | v1.33.1 | 22 Jul 24 10:30 UTC | 22 Jul 24 10:30 UTC |
	| delete  | -p download-only-121393                                                                     | download-only-121393   | jenkins | v1.33.1 | 22 Jul 24 10:30 UTC | 22 Jul 24 10:30 UTC |
	| start   | --download-only -p                                                                          | download-docker-568204 | jenkins | v1.33.1 | 22 Jul 24 10:30 UTC |                     |
	|         | download-docker-568204                                                                      |                        |         |         |                     |                     |
	|         | --alsologtostderr                                                                           |                        |         |         |                     |                     |
	|         | --driver=docker                                                                             |                        |         |         |                     |                     |
	|         | --container-runtime=crio                                                                    |                        |         |         |                     |                     |
	| delete  | -p download-docker-568204                                                                   | download-docker-568204 | jenkins | v1.33.1 | 22 Jul 24 10:30 UTC | 22 Jul 24 10:30 UTC |
	| start   | --download-only -p                                                                          | binary-mirror-754911   | jenkins | v1.33.1 | 22 Jul 24 10:30 UTC |                     |
	|         | binary-mirror-754911                                                                        |                        |         |         |                     |                     |
	|         | --alsologtostderr                                                                           |                        |         |         |                     |                     |
	|         | --binary-mirror                                                                             |                        |         |         |                     |                     |
	|         | http://127.0.0.1:34829                                                                      |                        |         |         |                     |                     |
	|         | --driver=docker                                                                             |                        |         |         |                     |                     |
	|         | --container-runtime=crio                                                                    |                        |         |         |                     |                     |
	| delete  | -p binary-mirror-754911                                                                     | binary-mirror-754911   | jenkins | v1.33.1 | 22 Jul 24 10:30 UTC | 22 Jul 24 10:30 UTC |
	| addons  | enable dashboard -p                                                                         | addons-578168          | jenkins | v1.33.1 | 22 Jul 24 10:30 UTC |                     |
	|         | addons-578168                                                                               |                        |         |         |                     |                     |
	| addons  | disable dashboard -p                                                                        | addons-578168          | jenkins | v1.33.1 | 22 Jul 24 10:30 UTC |                     |
	|         | addons-578168                                                                               |                        |         |         |                     |                     |
	| start   | -p addons-578168 --wait=true                                                                | addons-578168          | jenkins | v1.33.1 | 22 Jul 24 10:30 UTC | 22 Jul 24 10:33 UTC |
	|         | --memory=4000 --alsologtostderr                                                             |                        |         |         |                     |                     |
	|         | --addons=registry                                                                           |                        |         |         |                     |                     |
	|         | --addons=metrics-server                                                                     |                        |         |         |                     |                     |
	|         | --addons=volumesnapshots                                                                    |                        |         |         |                     |                     |
	|         | --addons=csi-hostpath-driver                                                                |                        |         |         |                     |                     |
	|         | --addons=gcp-auth                                                                           |                        |         |         |                     |                     |
	|         | --addons=cloud-spanner                                                                      |                        |         |         |                     |                     |
	|         | --addons=inspektor-gadget                                                                   |                        |         |         |                     |                     |
	|         | --addons=storage-provisioner-rancher                                                        |                        |         |         |                     |                     |
	|         | --addons=nvidia-device-plugin                                                               |                        |         |         |                     |                     |
	|         | --addons=yakd --addons=volcano                                                              |                        |         |         |                     |                     |
	|         | --driver=docker                                                                             |                        |         |         |                     |                     |
	|         | --container-runtime=crio                                                                    |                        |         |         |                     |                     |
	|         | --addons=ingress                                                                            |                        |         |         |                     |                     |
	|         | --addons=ingress-dns                                                                        |                        |         |         |                     |                     |
	| addons  | enable headlamp                                                                             | addons-578168          | jenkins | v1.33.1 | 22 Jul 24 10:33 UTC | 22 Jul 24 10:33 UTC |
	|         | -p addons-578168                                                                            |                        |         |         |                     |                     |
	|         | --alsologtostderr -v=1                                                                      |                        |         |         |                     |                     |
	| ip      | addons-578168 ip                                                                            | addons-578168          | jenkins | v1.33.1 | 22 Jul 24 10:33 UTC | 22 Jul 24 10:33 UTC |
	| addons  | addons-578168 addons disable                                                                | addons-578168          | jenkins | v1.33.1 | 22 Jul 24 10:33 UTC | 22 Jul 24 10:33 UTC |
	|         | registry --alsologtostderr                                                                  |                        |         |         |                     |                     |
	|         | -v=1                                                                                        |                        |         |         |                     |                     |
	| addons  | disable nvidia-device-plugin                                                                | addons-578168          | jenkins | v1.33.1 | 22 Jul 24 10:33 UTC | 22 Jul 24 10:33 UTC |
	|         | -p addons-578168                                                                            |                        |         |         |                     |                     |
	| ssh     | addons-578168 ssh cat                                                                       | addons-578168          | jenkins | v1.33.1 | 22 Jul 24 10:33 UTC | 22 Jul 24 10:33 UTC |
	|         | /opt/local-path-provisioner/pvc-3fa9736a-2470-4225-9ba0-57fda8a0f7a4_default_test-pvc/file1 |                        |         |         |                     |                     |
	| addons  | addons-578168 addons disable                                                                | addons-578168          | jenkins | v1.33.1 | 22 Jul 24 10:33 UTC | 22 Jul 24 10:34 UTC |
	|         | storage-provisioner-rancher                                                                 |                        |         |         |                     |                     |
	|         | --alsologtostderr -v=1                                                                      |                        |         |         |                     |                     |
	| addons  | disable cloud-spanner -p                                                                    | addons-578168          | jenkins | v1.33.1 | 22 Jul 24 10:33 UTC | 22 Jul 24 10:33 UTC |
	|         | addons-578168                                                                               |                        |         |         |                     |                     |
	| addons  | addons-578168 addons                                                                        | addons-578168          | jenkins | v1.33.1 | 22 Jul 24 10:34 UTC | 22 Jul 24 10:34 UTC |
	|         | disable csi-hostpath-driver                                                                 |                        |         |         |                     |                     |
	|         | --alsologtostderr -v=1                                                                      |                        |         |         |                     |                     |
	| addons  | disable inspektor-gadget -p                                                                 | addons-578168          | jenkins | v1.33.1 | 22 Jul 24 10:34 UTC | 22 Jul 24 10:34 UTC |
	|         | addons-578168                                                                               |                        |         |         |                     |                     |
	| addons  | addons-578168 addons                                                                        | addons-578168          | jenkins | v1.33.1 | 22 Jul 24 10:34 UTC | 22 Jul 24 10:34 UTC |
	|         | disable volumesnapshots                                                                     |                        |         |         |                     |                     |
	|         | --alsologtostderr -v=1                                                                      |                        |         |         |                     |                     |
	| ssh     | addons-578168 ssh curl -s                                                                   | addons-578168          | jenkins | v1.33.1 | 22 Jul 24 10:35 UTC |                     |
	|         | http://127.0.0.1/ -H 'Host:                                                                 |                        |         |         |                     |                     |
	|         | nginx.example.com'                                                                          |                        |         |         |                     |                     |
	| ip      | addons-578168 ip                                                                            | addons-578168          | jenkins | v1.33.1 | 22 Jul 24 10:37 UTC | 22 Jul 24 10:37 UTC |
	| addons  | addons-578168 addons disable                                                                | addons-578168          | jenkins | v1.33.1 | 22 Jul 24 10:37 UTC | 22 Jul 24 10:37 UTC |
	|         | ingress-dns --alsologtostderr                                                               |                        |         |         |                     |                     |
	|         | -v=1                                                                                        |                        |         |         |                     |                     |
	| addons  | addons-578168 addons disable                                                                | addons-578168          | jenkins | v1.33.1 | 22 Jul 24 10:37 UTC | 22 Jul 24 10:37 UTC |
	|         | ingress --alsologtostderr -v=1                                                              |                        |         |         |                     |                     |
	| addons  | addons-578168 addons                                                                        | addons-578168          | jenkins | v1.33.1 | 22 Jul 24 10:40 UTC | 22 Jul 24 10:40 UTC |
	|         | disable metrics-server                                                                      |                        |         |         |                     |                     |
	|         | --alsologtostderr -v=1                                                                      |                        |         |         |                     |                     |
	|---------|---------------------------------------------------------------------------------------------|------------------------|---------|---------|---------------------|---------------------|
	
	
	==> Last Start <==
	Log file created at: 2024/07/22 10:30:26
	Running on machine: ip-172-31-21-244
	Binary: Built with gc go1.22.5 for linux/arm64
	Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg
	I0722 10:30:26.968131    8575 out.go:291] Setting OutFile to fd 1 ...
	I0722 10:30:26.968266    8575 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0722 10:30:26.968278    8575 out.go:304] Setting ErrFile to fd 2...
	I0722 10:30:26.968283    8575 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0722 10:30:26.968509    8575 root.go:338] Updating PATH: /home/jenkins/minikube-integration/19313-2237/.minikube/bin
	I0722 10:30:26.968999    8575 out.go:298] Setting JSON to false
	I0722 10:30:26.969755    8575 start.go:129] hostinfo: {"hostname":"ip-172-31-21-244","uptime":772,"bootTime":1721643455,"procs":146,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1064-aws","kernelArch":"aarch64","virtualizationSystem":"","virtualizationRole":"","hostId":"da8ac1fd-6236-412a-a346-95873c98230d"}
	I0722 10:30:26.969823    8575 start.go:139] virtualization:  
	I0722 10:30:26.972292    8575 out.go:177] * [addons-578168] minikube v1.33.1 on Ubuntu 20.04 (arm64)
	I0722 10:30:26.974264    8575 out.go:177]   - MINIKUBE_LOCATION=19313
	I0722 10:30:26.974358    8575 notify.go:220] Checking for updates...
	I0722 10:30:26.978078    8575 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I0722 10:30:26.979746    8575 out.go:177]   - KUBECONFIG=/home/jenkins/minikube-integration/19313-2237/kubeconfig
	I0722 10:30:26.981549    8575 out.go:177]   - MINIKUBE_HOME=/home/jenkins/minikube-integration/19313-2237/.minikube
	I0722 10:30:26.983405    8575 out.go:177]   - MINIKUBE_BIN=out/minikube-linux-arm64
	I0722 10:30:26.984996    8575 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=
	I0722 10:30:26.986889    8575 driver.go:392] Setting default libvirt URI to qemu:///system
	I0722 10:30:27.019330    8575 docker.go:123] docker version: linux-27.0.3:Docker Engine - Community
	I0722 10:30:27.019445    8575 cli_runner.go:164] Run: docker system info --format "{{json .}}"
	I0722 10:30:27.074839    8575 info.go:266] docker info: {ID:5FDH:SA5P:5GCT:NLAS:B73P:SGDQ:PBG5:UBVH:UZY3:RXGO:CI7S:WAIH Containers:0 ContainersRunning:0 ContainersPaused:0 ContainersStopped:0 Images:1 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:25 OomKillDisable:true NGoroutines:44 SystemTime:2024-07-22 10:30:27.065927821 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1064-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Architecture:aar
ch64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8214896640 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-21-244 Labels:[] ExperimentalBuild:false ServerVersion:27.0.3 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:2bf793ef6dc9a18e00cb12efb64355c2c9d5eb41 Expected:2bf793ef6dc9a18e00cb12efb64355c2c9d5eb41} RuncCommit:{ID:v1.1.13-0-g58aa920 Expected:v1.1.13-0-g58aa920} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:<nil> ServerErro
rs:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.15.1] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.28.1]] Warnings:<nil>}}
	I0722 10:30:27.074950    8575 docker.go:307] overlay module found
	I0722 10:30:27.077014    8575 out.go:177] * Using the docker driver based on user configuration
	I0722 10:30:27.078792    8575 start.go:297] selected driver: docker
	I0722 10:30:27.078806    8575 start.go:901] validating driver "docker" against <nil>
	I0722 10:30:27.078819    8575 start.go:912] status for docker: {Installed:true Healthy:true Running:false NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I0722 10:30:27.079484    8575 cli_runner.go:164] Run: docker system info --format "{{json .}}"
	I0722 10:30:27.131448    8575 info.go:266] docker info: {ID:5FDH:SA5P:5GCT:NLAS:B73P:SGDQ:PBG5:UBVH:UZY3:RXGO:CI7S:WAIH Containers:0 ContainersRunning:0 ContainersPaused:0 ContainersStopped:0 Images:1 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:25 OomKillDisable:true NGoroutines:44 SystemTime:2024-07-22 10:30:27.122541746 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1064-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Architecture:aar
ch64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8214896640 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-21-244 Labels:[] ExperimentalBuild:false ServerVersion:27.0.3 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:2bf793ef6dc9a18e00cb12efb64355c2c9d5eb41 Expected:2bf793ef6dc9a18e00cb12efb64355c2c9d5eb41} RuncCommit:{ID:v1.1.13-0-g58aa920 Expected:v1.1.13-0-g58aa920} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:<nil> ServerErro
rs:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.15.1] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.28.1]] Warnings:<nil>}}
	I0722 10:30:27.131619    8575 start_flags.go:310] no existing cluster config was found, will generate one from the flags 
	I0722 10:30:27.131855    8575 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
	I0722 10:30:27.134056    8575 out.go:177] * Using Docker driver with root privileges
	I0722 10:30:27.135881    8575 cni.go:84] Creating CNI manager for ""
	I0722 10:30:27.135905    8575 cni.go:143] "docker" driver + "crio" runtime found, recommending kindnet
	I0722 10:30:27.135917    8575 start_flags.go:319] Found "CNI" CNI - setting NetworkPlugin=cni
	I0722 10:30:27.136010    8575 start.go:340] cluster config:
	{Name:addons-578168 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721324606-19298@sha256:1c495b056df42bd3fd9a5c30d049e1802f9ed73a342611781f1ccc3c3853953f Memory:4000 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.30.3 ClusterName:addons-578168 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime
:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.30.3 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSH
AgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I0722 10:30:27.138879    8575 out.go:177] * Starting "addons-578168" primary control-plane node in "addons-578168" cluster
	I0722 10:30:27.140655    8575 cache.go:121] Beginning downloading kic base image for docker with crio
	I0722 10:30:27.142985    8575 out.go:177] * Pulling base image v0.0.44-1721324606-19298 ...
	I0722 10:30:27.145244    8575 preload.go:131] Checking if preload exists for k8s version v1.30.3 and runtime crio
	I0722 10:30:27.145286    8575 image.go:79] Checking for gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721324606-19298@sha256:1c495b056df42bd3fd9a5c30d049e1802f9ed73a342611781f1ccc3c3853953f in local docker daemon
	I0722 10:30:27.145304    8575 preload.go:146] Found local preload: /home/jenkins/minikube-integration/19313-2237/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.30.3-cri-o-overlay-arm64.tar.lz4
	I0722 10:30:27.145314    8575 cache.go:56] Caching tarball of preloaded images
	I0722 10:30:27.145427    8575 preload.go:172] Found /home/jenkins/minikube-integration/19313-2237/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.30.3-cri-o-overlay-arm64.tar.lz4 in cache, skipping download
	I0722 10:30:27.145466    8575 cache.go:59] Finished verifying existence of preloaded tar for v1.30.3 on crio
	I0722 10:30:27.145878    8575 profile.go:143] Saving config to /home/jenkins/minikube-integration/19313-2237/.minikube/profiles/addons-578168/config.json ...
	I0722 10:30:27.145935    8575 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19313-2237/.minikube/profiles/addons-578168/config.json: {Name:mk7e0c748764fc54142663f8bc3b61db8b4c280f Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0722 10:30:27.160585    8575 cache.go:149] Downloading gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721324606-19298@sha256:1c495b056df42bd3fd9a5c30d049e1802f9ed73a342611781f1ccc3c3853953f to local cache
	I0722 10:30:27.160691    8575 image.go:63] Checking for gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721324606-19298@sha256:1c495b056df42bd3fd9a5c30d049e1802f9ed73a342611781f1ccc3c3853953f in local cache directory
	I0722 10:30:27.160715    8575 image.go:66] Found gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721324606-19298@sha256:1c495b056df42bd3fd9a5c30d049e1802f9ed73a342611781f1ccc3c3853953f in local cache directory, skipping pull
	I0722 10:30:27.160725    8575 image.go:135] gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721324606-19298@sha256:1c495b056df42bd3fd9a5c30d049e1802f9ed73a342611781f1ccc3c3853953f exists in cache, skipping pull
	I0722 10:30:27.160733    8575 cache.go:152] successfully saved gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721324606-19298@sha256:1c495b056df42bd3fd9a5c30d049e1802f9ed73a342611781f1ccc3c3853953f as a tarball
	I0722 10:30:27.160749    8575 cache.go:162] Loading gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721324606-19298@sha256:1c495b056df42bd3fd9a5c30d049e1802f9ed73a342611781f1ccc3c3853953f from local cache
	I0722 10:30:43.810516    8575 cache.go:164] successfully loaded and using gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721324606-19298@sha256:1c495b056df42bd3fd9a5c30d049e1802f9ed73a342611781f1ccc3c3853953f from cached tarball
	I0722 10:30:43.810556    8575 cache.go:194] Successfully downloaded all kic artifacts
	I0722 10:30:43.810592    8575 start.go:360] acquireMachinesLock for addons-578168: {Name:mk413af3133258b838feab4165830c0eccf18c0a Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0722 10:30:43.810721    8575 start.go:364] duration metric: took 105.945µs to acquireMachinesLock for "addons-578168"
	I0722 10:30:43.810754    8575 start.go:93] Provisioning new machine with config: &{Name:addons-578168 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721324606-19298@sha256:1c495b056df42bd3fd9a5c30d049e1802f9ed73a342611781f1ccc3c3853953f Memory:4000 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.30.3 ClusterName:addons-578168 Namespace:default APIServerHAVIP: APIServerName:min
ikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.30.3 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQe
muFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.30.3 ContainerRuntime:crio ControlPlane:true Worker:true}
	I0722 10:30:43.810842    8575 start.go:125] createHost starting for "" (driver="docker")
	I0722 10:30:43.813170    8575 out.go:204] * Creating docker container (CPUs=2, Memory=4000MB) ...
	I0722 10:30:43.813424    8575 start.go:159] libmachine.API.Create for "addons-578168" (driver="docker")
	I0722 10:30:43.813458    8575 client.go:168] LocalClient.Create starting
	I0722 10:30:43.813568    8575 main.go:141] libmachine: Creating CA: /home/jenkins/minikube-integration/19313-2237/.minikube/certs/ca.pem
	I0722 10:30:44.290335    8575 main.go:141] libmachine: Creating client certificate: /home/jenkins/minikube-integration/19313-2237/.minikube/certs/cert.pem
	I0722 10:30:44.630878    8575 cli_runner.go:164] Run: docker network inspect addons-578168 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
	W0722 10:30:44.645884    8575 cli_runner.go:211] docker network inspect addons-578168 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}" returned with exit code 1
	I0722 10:30:44.645964    8575 network_create.go:284] running [docker network inspect addons-578168] to gather additional debugging logs...
	I0722 10:30:44.645984    8575 cli_runner.go:164] Run: docker network inspect addons-578168
	W0722 10:30:44.660190    8575 cli_runner.go:211] docker network inspect addons-578168 returned with exit code 1
	I0722 10:30:44.660220    8575 network_create.go:287] error running [docker network inspect addons-578168]: docker network inspect addons-578168: exit status 1
	stdout:
	[]
	
	stderr:
	Error response from daemon: network addons-578168 not found
	I0722 10:30:44.660233    8575 network_create.go:289] output of [docker network inspect addons-578168]: -- stdout --
	[]
	
	-- /stdout --
	** stderr ** 
	Error response from daemon: network addons-578168 not found
	
	** /stderr **
	I0722 10:30:44.660338    8575 cli_runner.go:164] Run: docker network inspect bridge --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
	I0722 10:30:44.675884    8575 network.go:206] using free private subnet 192.168.49.0/24: &{IP:192.168.49.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.49.0/24 Gateway:192.168.49.1 ClientMin:192.168.49.2 ClientMax:192.168.49.254 Broadcast:192.168.49.255 IsPrivate:true Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:} reservation:0x4001836bd0}
	I0722 10:30:44.675926    8575 network_create.go:124] attempt to create docker network addons-578168 192.168.49.0/24 with gateway 192.168.49.1 and MTU of 1500 ...
	I0722 10:30:44.675986    8575 cli_runner.go:164] Run: docker network create --driver=bridge --subnet=192.168.49.0/24 --gateway=192.168.49.1 -o --ip-masq -o --icc -o com.docker.network.driver.mtu=1500 --label=created_by.minikube.sigs.k8s.io=true --label=name.minikube.sigs.k8s.io=addons-578168 addons-578168
	I0722 10:30:44.743386    8575 network_create.go:108] docker network addons-578168 192.168.49.0/24 created
	I0722 10:30:44.743431    8575 kic.go:121] calculated static IP "192.168.49.2" for the "addons-578168" container
	I0722 10:30:44.743502    8575 cli_runner.go:164] Run: docker ps -a --format {{.Names}}
	I0722 10:30:44.757203    8575 cli_runner.go:164] Run: docker volume create addons-578168 --label name.minikube.sigs.k8s.io=addons-578168 --label created_by.minikube.sigs.k8s.io=true
	I0722 10:30:44.773794    8575 oci.go:103] Successfully created a docker volume addons-578168
	I0722 10:30:44.773884    8575 cli_runner.go:164] Run: docker run --rm --name addons-578168-preload-sidecar --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=addons-578168 --entrypoint /usr/bin/test -v addons-578168:/var gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721324606-19298@sha256:1c495b056df42bd3fd9a5c30d049e1802f9ed73a342611781f1ccc3c3853953f -d /var/lib
	I0722 10:30:46.856782    8575 cli_runner.go:217] Completed: docker run --rm --name addons-578168-preload-sidecar --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=addons-578168 --entrypoint /usr/bin/test -v addons-578168:/var gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721324606-19298@sha256:1c495b056df42bd3fd9a5c30d049e1802f9ed73a342611781f1ccc3c3853953f -d /var/lib: (2.082845057s)
	I0722 10:30:46.856811    8575 oci.go:107] Successfully prepared a docker volume addons-578168
	I0722 10:30:46.856842    8575 preload.go:131] Checking if preload exists for k8s version v1.30.3 and runtime crio
	I0722 10:30:46.856864    8575 kic.go:194] Starting extracting preloaded images to volume ...
	I0722 10:30:46.856964    8575 cli_runner.go:164] Run: docker run --rm --entrypoint /usr/bin/tar -v /home/jenkins/minikube-integration/19313-2237/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.30.3-cri-o-overlay-arm64.tar.lz4:/preloaded.tar:ro -v addons-578168:/extractDir gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721324606-19298@sha256:1c495b056df42bd3fd9a5c30d049e1802f9ed73a342611781f1ccc3c3853953f -I lz4 -xf /preloaded.tar -C /extractDir
	I0722 10:30:51.196605    8575 cli_runner.go:217] Completed: docker run --rm --entrypoint /usr/bin/tar -v /home/jenkins/minikube-integration/19313-2237/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.30.3-cri-o-overlay-arm64.tar.lz4:/preloaded.tar:ro -v addons-578168:/extractDir gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721324606-19298@sha256:1c495b056df42bd3fd9a5c30d049e1802f9ed73a342611781f1ccc3c3853953f -I lz4 -xf /preloaded.tar -C /extractDir: (4.339601108s)
	I0722 10:30:51.196648    8575 kic.go:203] duration metric: took 4.339779399s to extract preloaded images to volume ...
	W0722 10:30:51.196781    8575 cgroups_linux.go:77] Your kernel does not support swap limit capabilities or the cgroup is not mounted.
	I0722 10:30:51.196951    8575 cli_runner.go:164] Run: docker info --format "'{{json .SecurityOptions}}'"
	I0722 10:30:51.252928    8575 cli_runner.go:164] Run: docker run -d -t --privileged --security-opt seccomp=unconfined --tmpfs /tmp --tmpfs /run -v /lib/modules:/lib/modules:ro --hostname addons-578168 --name addons-578168 --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=addons-578168 --label role.minikube.sigs.k8s.io= --label mode.minikube.sigs.k8s.io=addons-578168 --network addons-578168 --ip 192.168.49.2 --volume addons-578168:/var --security-opt apparmor=unconfined --memory=4000mb --cpus=2 -e container=docker --expose 8443 --publish=127.0.0.1::8443 --publish=127.0.0.1::22 --publish=127.0.0.1::2376 --publish=127.0.0.1::5000 --publish=127.0.0.1::32443 gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721324606-19298@sha256:1c495b056df42bd3fd9a5c30d049e1802f9ed73a342611781f1ccc3c3853953f
	I0722 10:30:51.598902    8575 cli_runner.go:164] Run: docker container inspect addons-578168 --format={{.State.Running}}
	I0722 10:30:51.621097    8575 cli_runner.go:164] Run: docker container inspect addons-578168 --format={{.State.Status}}
	I0722 10:30:51.652344    8575 cli_runner.go:164] Run: docker exec addons-578168 stat /var/lib/dpkg/alternatives/iptables
	I0722 10:30:51.725077    8575 oci.go:144] the created container "addons-578168" has a running status.
	I0722 10:30:51.725102    8575 kic.go:225] Creating ssh key for kic: /home/jenkins/minikube-integration/19313-2237/.minikube/machines/addons-578168/id_rsa...
	I0722 10:30:52.021725    8575 kic_runner.go:191] docker (temp): /home/jenkins/minikube-integration/19313-2237/.minikube/machines/addons-578168/id_rsa.pub --> /home/docker/.ssh/authorized_keys (381 bytes)
	I0722 10:30:52.054924    8575 cli_runner.go:164] Run: docker container inspect addons-578168 --format={{.State.Status}}
	I0722 10:30:52.077077    8575 kic_runner.go:93] Run: chown docker:docker /home/docker/.ssh/authorized_keys
	I0722 10:30:52.077098    8575 kic_runner.go:114] Args: [docker exec --privileged addons-578168 chown docker:docker /home/docker/.ssh/authorized_keys]
	I0722 10:30:52.170870    8575 cli_runner.go:164] Run: docker container inspect addons-578168 --format={{.State.Status}}
	I0722 10:30:52.197395    8575 machine.go:94] provisionDockerMachine start ...
	I0722 10:30:52.197490    8575 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-578168
	I0722 10:30:52.223654    8575 main.go:141] libmachine: Using SSH client type: native
	I0722 10:30:52.223932    8575 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x3e2cd0] 0x3e5530 <nil>  [] 0s} 127.0.0.1 32768 <nil> <nil>}
	I0722 10:30:52.223950    8575 main.go:141] libmachine: About to run SSH command:
	hostname
	I0722 10:30:52.225061    8575 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: EOF
	I0722 10:30:55.344269    8575 main.go:141] libmachine: SSH cmd err, output: <nil>: addons-578168
	
	I0722 10:30:55.344295    8575 ubuntu.go:169] provisioning hostname "addons-578168"
	I0722 10:30:55.344379    8575 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-578168
	I0722 10:30:55.360976    8575 main.go:141] libmachine: Using SSH client type: native
	I0722 10:30:55.361225    8575 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x3e2cd0] 0x3e5530 <nil>  [] 0s} 127.0.0.1 32768 <nil> <nil>}
	I0722 10:30:55.361242    8575 main.go:141] libmachine: About to run SSH command:
	sudo hostname addons-578168 && echo "addons-578168" | sudo tee /etc/hostname
	I0722 10:30:55.494271    8575 main.go:141] libmachine: SSH cmd err, output: <nil>: addons-578168
	
	I0722 10:30:55.494384    8575 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-578168
	I0722 10:30:55.512007    8575 main.go:141] libmachine: Using SSH client type: native
	I0722 10:30:55.512256    8575 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x3e2cd0] 0x3e5530 <nil>  [] 0s} 127.0.0.1 32768 <nil> <nil>}
	I0722 10:30:55.512278    8575 main.go:141] libmachine: About to run SSH command:
	
			if ! grep -xq '.*\saddons-578168' /etc/hosts; then
				if grep -xq '127.0.1.1\s.*' /etc/hosts; then
					sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 addons-578168/g' /etc/hosts;
				else 
					echo '127.0.1.1 addons-578168' | sudo tee -a /etc/hosts; 
				fi
			fi
	I0722 10:30:55.632724    8575 main.go:141] libmachine: SSH cmd err, output: <nil>: 
	I0722 10:30:55.632750    8575 ubuntu.go:175] set auth options {CertDir:/home/jenkins/minikube-integration/19313-2237/.minikube CaCertPath:/home/jenkins/minikube-integration/19313-2237/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/19313-2237/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/19313-2237/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/19313-2237/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/19313-2237/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/19313-2237/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/19313-2237/.minikube}
	I0722 10:30:55.632775    8575 ubuntu.go:177] setting up certificates
	I0722 10:30:55.632784    8575 provision.go:84] configureAuth start
	I0722 10:30:55.632842    8575 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" addons-578168
	I0722 10:30:55.648745    8575 provision.go:143] copyHostCerts
	I0722 10:30:55.648837    8575 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19313-2237/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/19313-2237/.minikube/cert.pem (1123 bytes)
	I0722 10:30:55.648984    8575 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19313-2237/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/19313-2237/.minikube/key.pem (1679 bytes)
	I0722 10:30:55.649053    8575 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19313-2237/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/19313-2237/.minikube/ca.pem (1078 bytes)
	I0722 10:30:55.649113    8575 provision.go:117] generating server cert: /home/jenkins/minikube-integration/19313-2237/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/19313-2237/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/19313-2237/.minikube/certs/ca-key.pem org=jenkins.addons-578168 san=[127.0.0.1 192.168.49.2 addons-578168 localhost minikube]
	I0722 10:30:56.130974    8575 provision.go:177] copyRemoteCerts
	I0722 10:30:56.131042    8575 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
	I0722 10:30:56.131091    8575 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-578168
	I0722 10:30:56.147824    8575 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32768 SSHKeyPath:/home/jenkins/minikube-integration/19313-2237/.minikube/machines/addons-578168/id_rsa Username:docker}
	I0722 10:30:56.237246    8575 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19313-2237/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1078 bytes)
	I0722 10:30:56.260294    8575 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19313-2237/.minikube/machines/server.pem --> /etc/docker/server.pem (1208 bytes)
	I0722 10:30:56.282254    8575 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19313-2237/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1675 bytes)
	I0722 10:30:56.304988    8575 provision.go:87] duration metric: took 672.190907ms to configureAuth
	I0722 10:30:56.305017    8575 ubuntu.go:193] setting minikube options for container-runtime
	I0722 10:30:56.305231    8575 config.go:182] Loaded profile config "addons-578168": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.30.3
	I0722 10:30:56.305345    8575 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-578168
	I0722 10:30:56.322711    8575 main.go:141] libmachine: Using SSH client type: native
	I0722 10:30:56.322948    8575 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x3e2cd0] 0x3e5530 <nil>  [] 0s} 127.0.0.1 32768 <nil> <nil>}
	I0722 10:30:56.322967    8575 main.go:141] libmachine: About to run SSH command:
	sudo mkdir -p /etc/sysconfig && printf %!s(MISSING) "
	CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
	" | sudo tee /etc/sysconfig/crio.minikube && sudo systemctl restart crio
	I0722 10:30:56.538914    8575 main.go:141] libmachine: SSH cmd err, output: <nil>: 
	CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
	
	I0722 10:30:56.538938    8575 machine.go:97] duration metric: took 4.341519592s to provisionDockerMachine
	I0722 10:30:56.538949    8575 client.go:171] duration metric: took 12.725479965s to LocalClient.Create
	I0722 10:30:56.538961    8575 start.go:167] duration metric: took 12.725537812s to libmachine.API.Create "addons-578168"
	I0722 10:30:56.538968    8575 start.go:293] postStartSetup for "addons-578168" (driver="docker")
	I0722 10:30:56.538979    8575 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
	I0722 10:30:56.539055    8575 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
	I0722 10:30:56.539106    8575 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-578168
	I0722 10:30:56.556857    8575 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32768 SSHKeyPath:/home/jenkins/minikube-integration/19313-2237/.minikube/machines/addons-578168/id_rsa Username:docker}
	I0722 10:30:56.645612    8575 ssh_runner.go:195] Run: cat /etc/os-release
	I0722 10:30:56.648582    8575 main.go:141] libmachine: Couldn't set key VERSION_CODENAME, no corresponding struct field found
	I0722 10:30:56.648616    8575 main.go:141] libmachine: Couldn't set key PRIVACY_POLICY_URL, no corresponding struct field found
	I0722 10:30:56.648626    8575 main.go:141] libmachine: Couldn't set key UBUNTU_CODENAME, no corresponding struct field found
	I0722 10:30:56.648633    8575 info.go:137] Remote host: Ubuntu 22.04.4 LTS
	I0722 10:30:56.648643    8575 filesync.go:126] Scanning /home/jenkins/minikube-integration/19313-2237/.minikube/addons for local assets ...
	I0722 10:30:56.648708    8575 filesync.go:126] Scanning /home/jenkins/minikube-integration/19313-2237/.minikube/files for local assets ...
	I0722 10:30:56.648730    8575 start.go:296] duration metric: took 109.756739ms for postStartSetup
	I0722 10:30:56.649056    8575 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" addons-578168
	I0722 10:30:56.664714    8575 profile.go:143] Saving config to /home/jenkins/minikube-integration/19313-2237/.minikube/profiles/addons-578168/config.json ...
	I0722 10:30:56.665239    8575 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
	I0722 10:30:56.665291    8575 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-578168
	I0722 10:30:56.686019    8575 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32768 SSHKeyPath:/home/jenkins/minikube-integration/19313-2237/.minikube/machines/addons-578168/id_rsa Username:docker}
	I0722 10:30:56.769397    8575 ssh_runner.go:195] Run: sh -c "df -BG /var | awk 'NR==2{print $4}'"
	I0722 10:30:56.773617    8575 start.go:128] duration metric: took 12.962759975s to createHost
	I0722 10:30:56.773643    8575 start.go:83] releasing machines lock for "addons-578168", held for 12.962905395s
	I0722 10:30:56.773724    8575 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" addons-578168
	I0722 10:30:56.790816    8575 ssh_runner.go:195] Run: cat /version.json
	I0722 10:30:56.790871    8575 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-578168
	I0722 10:30:56.791106    8575 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/
	I0722 10:30:56.791173    8575 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-578168
	I0722 10:30:56.807492    8575 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32768 SSHKeyPath:/home/jenkins/minikube-integration/19313-2237/.minikube/machines/addons-578168/id_rsa Username:docker}
	I0722 10:30:56.818503    8575 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32768 SSHKeyPath:/home/jenkins/minikube-integration/19313-2237/.minikube/machines/addons-578168/id_rsa Username:docker}
	I0722 10:30:57.013414    8575 ssh_runner.go:195] Run: systemctl --version
	I0722 10:30:57.017929    8575 ssh_runner.go:195] Run: sudo sh -c "podman version >/dev/null"
	I0722 10:30:57.158873    8575 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"
	I0722 10:30:57.163087    8575 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f -name *loopback.conf* -not -name *.mk_disabled -exec sh -c "sudo mv {} {}.mk_disabled" ;
	I0722 10:30:57.183590    8575 cni.go:221] loopback cni configuration disabled: "/etc/cni/net.d/*loopback.conf*" found
	I0722 10:30:57.183681    8575 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%!p(MISSING), " -exec sh -c "sudo mv {} {}.mk_disabled" ;
	I0722 10:30:57.217577    8575 cni.go:262] disabled [/etc/cni/net.d/87-podman-bridge.conflist, /etc/cni/net.d/100-crio-bridge.conf] bridge cni config(s)
	I0722 10:30:57.217599    8575 start.go:495] detecting cgroup driver to use...
	I0722 10:30:57.217632    8575 detect.go:187] detected "cgroupfs" cgroup driver on host os
	I0722 10:30:57.217678    8575 ssh_runner.go:195] Run: sudo systemctl stop -f containerd
	I0722 10:30:57.233837    8575 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd
	I0722 10:30:57.245925    8575 docker.go:217] disabling cri-docker service (if available) ...
	I0722 10:30:57.245993    8575 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.socket
	I0722 10:30:57.259356    8575 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.service
	I0722 10:30:57.274201    8575 ssh_runner.go:195] Run: sudo systemctl disable cri-docker.socket
	I0722 10:30:57.371580    8575 ssh_runner.go:195] Run: sudo systemctl mask cri-docker.service
	I0722 10:30:57.479342    8575 docker.go:233] disabling docker service ...
	I0722 10:30:57.479407    8575 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket
	I0722 10:30:57.499113    8575 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service
	I0722 10:30:57.511059    8575 ssh_runner.go:195] Run: sudo systemctl disable docker.socket
	I0722 10:30:57.606923    8575 ssh_runner.go:195] Run: sudo systemctl mask docker.service
	I0722 10:30:57.707187    8575 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker
	I0722 10:30:57.717891    8575 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %!s(MISSING) "runtime-endpoint: unix:///var/run/crio/crio.sock
	" | sudo tee /etc/crictl.yaml"
	I0722 10:30:57.734028    8575 crio.go:59] configure cri-o to use "registry.k8s.io/pause:3.9" pause image...
	I0722 10:30:57.734142    8575 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*pause_image = .*$|pause_image = "registry.k8s.io/pause:3.9"|' /etc/crio/crio.conf.d/02-crio.conf"
	I0722 10:30:57.743994    8575 crio.go:70] configuring cri-o to use "cgroupfs" as cgroup driver...
	I0722 10:30:57.744090    8575 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*cgroup_manager = .*$|cgroup_manager = "cgroupfs"|' /etc/crio/crio.conf.d/02-crio.conf"
	I0722 10:30:57.754058    8575 ssh_runner.go:195] Run: sh -c "sudo sed -i '/conmon_cgroup = .*/d' /etc/crio/crio.conf.d/02-crio.conf"
	I0722 10:30:57.763602    8575 ssh_runner.go:195] Run: sh -c "sudo sed -i '/cgroup_manager = .*/a conmon_cgroup = "pod"' /etc/crio/crio.conf.d/02-crio.conf"
	I0722 10:30:57.773751    8575 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"
	I0722 10:30:57.782907    8575 ssh_runner.go:195] Run: sh -c "sudo sed -i '/^ *"net.ipv4.ip_unprivileged_port_start=.*"/d' /etc/crio/crio.conf.d/02-crio.conf"
	I0722 10:30:57.792481    8575 ssh_runner.go:195] Run: sh -c "sudo grep -q "^ *default_sysctls" /etc/crio/crio.conf.d/02-crio.conf || sudo sed -i '/conmon_cgroup = .*/a default_sysctls = \[\n\]' /etc/crio/crio.conf.d/02-crio.conf"
	I0722 10:30:57.807577    8575 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^default_sysctls *= *\[|&\n  "net.ipv4.ip_unprivileged_port_start=0",|' /etc/crio/crio.conf.d/02-crio.conf"
	I0722 10:30:57.816820    8575 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
	I0722 10:30:57.825156    8575 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
	I0722 10:30:57.834328    8575 ssh_runner.go:195] Run: sudo systemctl daemon-reload
	I0722 10:30:57.928059    8575 ssh_runner.go:195] Run: sudo systemctl restart crio
	I0722 10:30:58.026741    8575 start.go:542] Will wait 60s for socket path /var/run/crio/crio.sock
	I0722 10:30:58.026833    8575 ssh_runner.go:195] Run: stat /var/run/crio/crio.sock
	I0722 10:30:58.030974    8575 start.go:563] Will wait 60s for crictl version
	I0722 10:30:58.031038    8575 ssh_runner.go:195] Run: which crictl
	I0722 10:30:58.034850    8575 ssh_runner.go:195] Run: sudo /usr/bin/crictl version
	I0722 10:30:58.074977    8575 start.go:579] Version:  0.1.0
	RuntimeName:  cri-o
	RuntimeVersion:  1.24.6
	RuntimeApiVersion:  v1
	I0722 10:30:58.075131    8575 ssh_runner.go:195] Run: crio --version
	I0722 10:30:58.111943    8575 ssh_runner.go:195] Run: crio --version
	I0722 10:30:58.152585    8575 out.go:177] * Preparing Kubernetes v1.30.3 on CRI-O 1.24.6 ...
	I0722 10:30:58.154384    8575 cli_runner.go:164] Run: docker network inspect addons-578168 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
	I0722 10:30:58.170741    8575 ssh_runner.go:195] Run: grep 192.168.49.1	host.minikube.internal$ /etc/hosts
	I0722 10:30:58.174912    8575 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.49.1	host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
	I0722 10:30:58.186166    8575 kubeadm.go:883] updating cluster {Name:addons-578168 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721324606-19298@sha256:1c495b056df42bd3fd9a5c30d049e1802f9ed73a342611781f1ccc3c3853953f Memory:4000 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.30.3 ClusterName:addons-578168 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNa
mes:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.49.2 Port:8443 KubernetesVersion:v1.30.3 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmw
arePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} ...
	I0722 10:30:58.186284    8575 preload.go:131] Checking if preload exists for k8s version v1.30.3 and runtime crio
	I0722 10:30:58.186345    8575 ssh_runner.go:195] Run: sudo crictl images --output json
	I0722 10:30:58.262342    8575 crio.go:514] all images are preloaded for cri-o runtime.
	I0722 10:30:58.262366    8575 crio.go:433] Images already preloaded, skipping extraction
	I0722 10:30:58.262424    8575 ssh_runner.go:195] Run: sudo crictl images --output json
	I0722 10:30:58.302279    8575 crio.go:514] all images are preloaded for cri-o runtime.
	I0722 10:30:58.302302    8575 cache_images.go:84] Images are preloaded, skipping loading
	I0722 10:30:58.302311    8575 kubeadm.go:934] updating node { 192.168.49.2 8443 v1.30.3 crio true true} ...
	I0722 10:30:58.302410    8575 kubeadm.go:946] kubelet [Unit]
	Wants=crio.service
	
	[Service]
	ExecStart=
	ExecStart=/var/lib/minikube/binaries/v1.30.3/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --cgroups-per-qos=false --config=/var/lib/kubelet/config.yaml --enforce-node-allocatable= --hostname-override=addons-578168 --kubeconfig=/etc/kubernetes/kubelet.conf --node-ip=192.168.49.2
	
	[Install]
	 config:
	{KubernetesVersion:v1.30.3 ClusterName:addons-578168 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:}
	I0722 10:30:58.302493    8575 ssh_runner.go:195] Run: crio config
	I0722 10:30:58.350774    8575 cni.go:84] Creating CNI manager for ""
	I0722 10:30:58.350797    8575 cni.go:143] "docker" driver + "crio" runtime found, recommending kindnet
	I0722 10:30:58.350807    8575 kubeadm.go:84] Using pod CIDR: 10.244.0.0/16
	I0722 10:30:58.350860    8575 kubeadm.go:181] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.49.2 APIServerPort:8443 KubernetesVersion:v1.30.3 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:addons-578168 NodeName:addons-578168 DNSDomain:cluster.local CRISocket:/var/run/crio/crio.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.49.2"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.49.2 CgroupDriver:cgroupfs ClientCAFile:/var/lib/minikube/certs/ca.crt StaticPodPath:/etc/kuberne
tes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[containerRuntimeEndpoint:unix:///var/run/crio/crio.sock hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:true}
	I0722 10:30:58.351030    8575 kubeadm.go:187] kubeadm config:
	apiVersion: kubeadm.k8s.io/v1beta3
	kind: InitConfiguration
	localAPIEndpoint:
	  advertiseAddress: 192.168.49.2
	  bindPort: 8443
	bootstrapTokens:
	  - groups:
	      - system:bootstrappers:kubeadm:default-node-token
	    ttl: 24h0m0s
	    usages:
	      - signing
	      - authentication
	nodeRegistration:
	  criSocket: unix:///var/run/crio/crio.sock
	  name: "addons-578168"
	  kubeletExtraArgs:
	    node-ip: 192.168.49.2
	  taints: []
	---
	apiVersion: kubeadm.k8s.io/v1beta3
	kind: ClusterConfiguration
	apiServer:
	  certSANs: ["127.0.0.1", "localhost", "192.168.49.2"]
	  extraArgs:
	    enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"
	controllerManager:
	  extraArgs:
	    allocate-node-cidrs: "true"
	    leader-elect: "false"
	scheduler:
	  extraArgs:
	    leader-elect: "false"
	certificatesDir: /var/lib/minikube/certs
	clusterName: mk
	controlPlaneEndpoint: control-plane.minikube.internal:8443
	etcd:
	  local:
	    dataDir: /var/lib/minikube/etcd
	    extraArgs:
	      proxy-refresh-interval: "70000"
	kubernetesVersion: v1.30.3
	networking:
	  dnsDomain: cluster.local
	  podSubnet: "10.244.0.0/16"
	  serviceSubnet: 10.96.0.0/12
	---
	apiVersion: kubelet.config.k8s.io/v1beta1
	kind: KubeletConfiguration
	authentication:
	  x509:
	    clientCAFile: /var/lib/minikube/certs/ca.crt
	cgroupDriver: cgroupfs
	containerRuntimeEndpoint: unix:///var/run/crio/crio.sock
	hairpinMode: hairpin-veth
	runtimeRequestTimeout: 15m
	clusterDomain: "cluster.local"
	# disable disk resource management by default
	imageGCHighThresholdPercent: 100
	evictionHard:
	  nodefs.available: "0%!"(MISSING)
	  nodefs.inodesFree: "0%!"(MISSING)
	  imagefs.available: "0%!"(MISSING)
	failSwapOn: false
	staticPodPath: /etc/kubernetes/manifests
	---
	apiVersion: kubeproxy.config.k8s.io/v1alpha1
	kind: KubeProxyConfiguration
	clusterCIDR: "10.244.0.0/16"
	metricsBindAddress: 0.0.0.0:10249
	conntrack:
	  maxPerCore: 0
	# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"
	  tcpEstablishedTimeout: 0s
	# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"
	  tcpCloseWaitTimeout: 0s
	
	I0722 10:30:58.351106    8575 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.30.3
	I0722 10:30:58.359781    8575 binaries.go:44] Found k8s binaries, skipping transfer
	I0722 10:30:58.359847    8575 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube
	I0722 10:30:58.368434    8575 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (363 bytes)
	I0722 10:30:58.385905    8575 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)
	I0722 10:30:58.403435    8575 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2151 bytes)
	I0722 10:30:58.421061    8575 ssh_runner.go:195] Run: grep 192.168.49.2	control-plane.minikube.internal$ /etc/hosts
	I0722 10:30:58.424305    8575 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.49.2	control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
	I0722 10:30:58.434682    8575 ssh_runner.go:195] Run: sudo systemctl daemon-reload
	I0722 10:30:58.512336    8575 ssh_runner.go:195] Run: sudo systemctl start kubelet
	I0722 10:30:58.525279    8575 certs.go:68] Setting up /home/jenkins/minikube-integration/19313-2237/.minikube/profiles/addons-578168 for IP: 192.168.49.2
	I0722 10:30:58.525348    8575 certs.go:194] generating shared ca certs ...
	I0722 10:30:58.525378    8575 certs.go:226] acquiring lock for ca certs: {Name:mkc633027ec1393c6f58c3260e76c1b2d2250318 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0722 10:30:58.525541    8575 certs.go:240] generating "minikubeCA" ca cert: /home/jenkins/minikube-integration/19313-2237/.minikube/ca.key
	I0722 10:30:58.833993    8575 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19313-2237/.minikube/ca.crt ...
	I0722 10:30:58.834025    8575 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19313-2237/.minikube/ca.crt: {Name:mke6783e5d1c24da41875b3d91804f1fce7194b3 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0722 10:30:58.834240    8575 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19313-2237/.minikube/ca.key ...
	I0722 10:30:58.834254    8575 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19313-2237/.minikube/ca.key: {Name:mk1aec15eb580808707f9cef78882bcdc57202c6 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0722 10:30:58.834345    8575 certs.go:240] generating "proxyClientCA" ca cert: /home/jenkins/minikube-integration/19313-2237/.minikube/proxy-client-ca.key
	I0722 10:30:59.013482    8575 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19313-2237/.minikube/proxy-client-ca.crt ...
	I0722 10:30:59.013512    8575 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19313-2237/.minikube/proxy-client-ca.crt: {Name:mka1e8f1ca8a47f5a164bc4d361dc2d2d08e90dc Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0722 10:30:59.013693    8575 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19313-2237/.minikube/proxy-client-ca.key ...
	I0722 10:30:59.013706    8575 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19313-2237/.minikube/proxy-client-ca.key: {Name:mk059b9fa89bec6064c6aa8e2e64d880b01f053c Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0722 10:30:59.013785    8575 certs.go:256] generating profile certs ...
	I0722 10:30:59.013843    8575 certs.go:363] generating signed profile cert for "minikube-user": /home/jenkins/minikube-integration/19313-2237/.minikube/profiles/addons-578168/client.key
	I0722 10:30:59.013860    8575 crypto.go:68] Generating cert /home/jenkins/minikube-integration/19313-2237/.minikube/profiles/addons-578168/client.crt with IP's: []
	I0722 10:30:59.239607    8575 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19313-2237/.minikube/profiles/addons-578168/client.crt ...
	I0722 10:30:59.239635    8575 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19313-2237/.minikube/profiles/addons-578168/client.crt: {Name:mkcf38a53aa3753ac08897bbf4084dd587b84e3f Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0722 10:30:59.239864    8575 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19313-2237/.minikube/profiles/addons-578168/client.key ...
	I0722 10:30:59.239884    8575 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19313-2237/.minikube/profiles/addons-578168/client.key: {Name:mk3e53fc9eca4d0d666de39e2337ba1ef108a749 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0722 10:30:59.239999    8575 certs.go:363] generating signed profile cert for "minikube": /home/jenkins/minikube-integration/19313-2237/.minikube/profiles/addons-578168/apiserver.key.cc699dbf
	I0722 10:30:59.240017    8575 crypto.go:68] Generating cert /home/jenkins/minikube-integration/19313-2237/.minikube/profiles/addons-578168/apiserver.crt.cc699dbf with IP's: [10.96.0.1 127.0.0.1 10.0.0.1 192.168.49.2]
	I0722 10:30:59.460422    8575 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19313-2237/.minikube/profiles/addons-578168/apiserver.crt.cc699dbf ...
	I0722 10:30:59.460449    8575 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19313-2237/.minikube/profiles/addons-578168/apiserver.crt.cc699dbf: {Name:mkdf79dbfd472931f5680351719311354842f85c Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0722 10:30:59.460635    8575 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19313-2237/.minikube/profiles/addons-578168/apiserver.key.cc699dbf ...
	I0722 10:30:59.460648    8575 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19313-2237/.minikube/profiles/addons-578168/apiserver.key.cc699dbf: {Name:mk3d9da7c82f66b2c1e6d90af7f3348b5a93d69e Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0722 10:30:59.460735    8575 certs.go:381] copying /home/jenkins/minikube-integration/19313-2237/.minikube/profiles/addons-578168/apiserver.crt.cc699dbf -> /home/jenkins/minikube-integration/19313-2237/.minikube/profiles/addons-578168/apiserver.crt
	I0722 10:30:59.460813    8575 certs.go:385] copying /home/jenkins/minikube-integration/19313-2237/.minikube/profiles/addons-578168/apiserver.key.cc699dbf -> /home/jenkins/minikube-integration/19313-2237/.minikube/profiles/addons-578168/apiserver.key
	I0722 10:30:59.460903    8575 certs.go:363] generating signed profile cert for "aggregator": /home/jenkins/minikube-integration/19313-2237/.minikube/profiles/addons-578168/proxy-client.key
	I0722 10:30:59.460927    8575 crypto.go:68] Generating cert /home/jenkins/minikube-integration/19313-2237/.minikube/profiles/addons-578168/proxy-client.crt with IP's: []
	I0722 10:30:59.667753    8575 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19313-2237/.minikube/profiles/addons-578168/proxy-client.crt ...
	I0722 10:30:59.667783    8575 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19313-2237/.minikube/profiles/addons-578168/proxy-client.crt: {Name:mkb5e2f3ea6918a46f2571f39d6f800c1327505c Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0722 10:30:59.667967    8575 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19313-2237/.minikube/profiles/addons-578168/proxy-client.key ...
	I0722 10:30:59.668003    8575 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19313-2237/.minikube/profiles/addons-578168/proxy-client.key: {Name:mke5d7c8f3279cfb246e8bb7a6444238316eb428 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0722 10:30:59.668197    8575 certs.go:484] found cert: /home/jenkins/minikube-integration/19313-2237/.minikube/certs/ca-key.pem (1675 bytes)
	I0722 10:30:59.668242    8575 certs.go:484] found cert: /home/jenkins/minikube-integration/19313-2237/.minikube/certs/ca.pem (1078 bytes)
	I0722 10:30:59.668271    8575 certs.go:484] found cert: /home/jenkins/minikube-integration/19313-2237/.minikube/certs/cert.pem (1123 bytes)
	I0722 10:30:59.668300    8575 certs.go:484] found cert: /home/jenkins/minikube-integration/19313-2237/.minikube/certs/key.pem (1679 bytes)
	I0722 10:30:59.668940    8575 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19313-2237/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
	I0722 10:30:59.694353    8575 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19313-2237/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1675 bytes)
	I0722 10:30:59.718590    8575 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19313-2237/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
	I0722 10:30:59.742186    8575 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19313-2237/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1675 bytes)
	I0722 10:30:59.768458    8575 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19313-2237/.minikube/profiles/addons-578168/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1419 bytes)
	I0722 10:30:59.792569    8575 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19313-2237/.minikube/profiles/addons-578168/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1679 bytes)
	I0722 10:30:59.816371    8575 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19313-2237/.minikube/profiles/addons-578168/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
	I0722 10:30:59.840767    8575 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19313-2237/.minikube/profiles/addons-578168/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1679 bytes)
	I0722 10:30:59.864457    8575 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19313-2237/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
	I0722 10:30:59.888444    8575 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)
	I0722 10:30:59.906524    8575 ssh_runner.go:195] Run: openssl version
	I0722 10:30:59.911766    8575 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
	I0722 10:30:59.921092    8575 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
	I0722 10:30:59.924525    8575 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 Jul 22 10:30 /usr/share/ca-certificates/minikubeCA.pem
	I0722 10:30:59.924618    8575 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
	I0722 10:30:59.931638    8575 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
	I0722 10:30:59.940967    8575 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt
	I0722 10:30:59.945583    8575 certs.go:399] 'apiserver-kubelet-client' cert doesn't exist, likely first start: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt: Process exited with status 1
	stdout:
	
	stderr:
	stat: cannot statx '/var/lib/minikube/certs/apiserver-kubelet-client.crt': No such file or directory
	I0722 10:30:59.945632    8575 kubeadm.go:392] StartCluster: {Name:addons-578168 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721324606-19298@sha256:1c495b056df42bd3fd9a5c30d049e1802f9ed73a342611781f1ccc3c3853953f Memory:4000 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.30.3 ClusterName:addons-578168 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames
:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.49.2 Port:8443 KubernetesVersion:v1.30.3 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmware
Path: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I0722 10:30:59.945713    8575 cri.go:54] listing CRI containers in root : {State:paused Name: Namespaces:[kube-system]}
	I0722 10:30:59.945784    8575 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"
	I0722 10:31:00.010427    8575 cri.go:89] found id: ""
	I0722 10:31:00.010508    8575 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd
	I0722 10:31:00.030501    8575 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml
	I0722 10:31:00.054116    8575 kubeadm.go:214] ignoring SystemVerification for kubeadm because of docker driver
	I0722 10:31:00.054192    8575 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
	I0722 10:31:00.074802    8575 kubeadm.go:155] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
	stdout:
	
	stderr:
	ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
	ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
	ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
	ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
	I0722 10:31:00.074887    8575 kubeadm.go:157] found existing configuration files:
	
	I0722 10:31:00.074991    8575 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf
	I0722 10:31:00.093913    8575 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/admin.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf: Process exited with status 2
	stdout:
	
	stderr:
	grep: /etc/kubernetes/admin.conf: No such file or directory
	I0722 10:31:00.093979    8575 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/admin.conf
	I0722 10:31:00.139553    8575 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf
	I0722 10:31:00.166741    8575 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/kubelet.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf: Process exited with status 2
	stdout:
	
	stderr:
	grep: /etc/kubernetes/kubelet.conf: No such file or directory
	I0722 10:31:00.166877    8575 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/kubelet.conf
	I0722 10:31:00.184917    8575 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf
	I0722 10:31:00.201315    8575 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/controller-manager.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf: Process exited with status 2
	stdout:
	
	stderr:
	grep: /etc/kubernetes/controller-manager.conf: No such file or directory
	I0722 10:31:00.201397    8575 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/controller-manager.conf
	I0722 10:31:00.217306    8575 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf
	I0722 10:31:00.239367    8575 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/scheduler.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf: Process exited with status 2
	stdout:
	
	stderr:
	grep: /etc/kubernetes/scheduler.conf: No such file or directory
	I0722 10:31:00.239435    8575 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/scheduler.conf
	I0722 10:31:00.252238    8575 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.30.3:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml  --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem,SystemVerification,FileContent--proc-sys-net-bridge-bridge-nf-call-iptables"
	I0722 10:31:00.346328    8575 kubeadm.go:310] 	[WARNING SystemVerification]: failed to parse kernel config: unable to load kernel module: "configs", output: "modprobe: FATAL: Module configs not found in directory /lib/modules/5.15.0-1064-aws\n", err: exit status 1
	I0722 10:31:00.413474    8575 kubeadm.go:310] 	[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
	I0722 10:31:16.303663    8575 kubeadm.go:310] [init] Using Kubernetes version: v1.30.3
	I0722 10:31:16.303728    8575 kubeadm.go:310] [preflight] Running pre-flight checks
	I0722 10:31:16.303821    8575 kubeadm.go:310] [preflight] The system verification failed. Printing the output from the verification:
	I0722 10:31:16.303879    8575 kubeadm.go:310] KERNEL_VERSION: 5.15.0-1064-aws
	I0722 10:31:16.303916    8575 kubeadm.go:310] OS: Linux
	I0722 10:31:16.303964    8575 kubeadm.go:310] CGROUPS_CPU: enabled
	I0722 10:31:16.304014    8575 kubeadm.go:310] CGROUPS_CPUACCT: enabled
	I0722 10:31:16.304062    8575 kubeadm.go:310] CGROUPS_CPUSET: enabled
	I0722 10:31:16.304112    8575 kubeadm.go:310] CGROUPS_DEVICES: enabled
	I0722 10:31:16.304177    8575 kubeadm.go:310] CGROUPS_FREEZER: enabled
	I0722 10:31:16.304231    8575 kubeadm.go:310] CGROUPS_MEMORY: enabled
	I0722 10:31:16.304279    8575 kubeadm.go:310] CGROUPS_PIDS: enabled
	I0722 10:31:16.304328    8575 kubeadm.go:310] CGROUPS_HUGETLB: enabled
	I0722 10:31:16.304376    8575 kubeadm.go:310] CGROUPS_BLKIO: enabled
	I0722 10:31:16.304449    8575 kubeadm.go:310] [preflight] Pulling images required for setting up a Kubernetes cluster
	I0722 10:31:16.304547    8575 kubeadm.go:310] [preflight] This might take a minute or two, depending on the speed of your internet connection
	I0722 10:31:16.304640    8575 kubeadm.go:310] [preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
	I0722 10:31:16.304708    8575 kubeadm.go:310] [certs] Using certificateDir folder "/var/lib/minikube/certs"
	I0722 10:31:16.306988    8575 out.go:204]   - Generating certificates and keys ...
	I0722 10:31:16.307105    8575 kubeadm.go:310] [certs] Using existing ca certificate authority
	I0722 10:31:16.307195    8575 kubeadm.go:310] [certs] Using existing apiserver certificate and key on disk
	I0722 10:31:16.307275    8575 kubeadm.go:310] [certs] Generating "apiserver-kubelet-client" certificate and key
	I0722 10:31:16.307351    8575 kubeadm.go:310] [certs] Generating "front-proxy-ca" certificate and key
	I0722 10:31:16.307415    8575 kubeadm.go:310] [certs] Generating "front-proxy-client" certificate and key
	I0722 10:31:16.307469    8575 kubeadm.go:310] [certs] Generating "etcd/ca" certificate and key
	I0722 10:31:16.307537    8575 kubeadm.go:310] [certs] Generating "etcd/server" certificate and key
	I0722 10:31:16.307682    8575 kubeadm.go:310] [certs] etcd/server serving cert is signed for DNS names [addons-578168 localhost] and IPs [192.168.49.2 127.0.0.1 ::1]
	I0722 10:31:16.307746    8575 kubeadm.go:310] [certs] Generating "etcd/peer" certificate and key
	I0722 10:31:16.307903    8575 kubeadm.go:310] [certs] etcd/peer serving cert is signed for DNS names [addons-578168 localhost] and IPs [192.168.49.2 127.0.0.1 ::1]
	I0722 10:31:16.307994    8575 kubeadm.go:310] [certs] Generating "etcd/healthcheck-client" certificate and key
	I0722 10:31:16.308111    8575 kubeadm.go:310] [certs] Generating "apiserver-etcd-client" certificate and key
	I0722 10:31:16.308177    8575 kubeadm.go:310] [certs] Generating "sa" key and public key
	I0722 10:31:16.308248    8575 kubeadm.go:310] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"
	I0722 10:31:16.308321    8575 kubeadm.go:310] [kubeconfig] Writing "admin.conf" kubeconfig file
	I0722 10:31:16.308400    8575 kubeadm.go:310] [kubeconfig] Writing "super-admin.conf" kubeconfig file
	I0722 10:31:16.308470    8575 kubeadm.go:310] [kubeconfig] Writing "kubelet.conf" kubeconfig file
	I0722 10:31:16.308547    8575 kubeadm.go:310] [kubeconfig] Writing "controller-manager.conf" kubeconfig file
	I0722 10:31:16.308623    8575 kubeadm.go:310] [kubeconfig] Writing "scheduler.conf" kubeconfig file
	I0722 10:31:16.308716    8575 kubeadm.go:310] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
	I0722 10:31:16.308806    8575 kubeadm.go:310] [control-plane] Using manifest folder "/etc/kubernetes/manifests"
	I0722 10:31:16.310650    8575 out.go:204]   - Booting up control plane ...
	I0722 10:31:16.310751    8575 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-apiserver"
	I0722 10:31:16.310832    8575 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-controller-manager"
	I0722 10:31:16.310904    8575 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-scheduler"
	I0722 10:31:16.311007    8575 kubeadm.go:310] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
	I0722 10:31:16.311097    8575 kubeadm.go:310] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
	I0722 10:31:16.311140    8575 kubeadm.go:310] [kubelet-start] Starting the kubelet
	I0722 10:31:16.311271    8575 kubeadm.go:310] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests"
	I0722 10:31:16.311345    8575 kubeadm.go:310] [kubelet-check] Waiting for a healthy kubelet. This can take up to 4m0s
	I0722 10:31:16.311405    8575 kubeadm.go:310] [kubelet-check] The kubelet is healthy after 2.002493623s
	I0722 10:31:16.311475    8575 kubeadm.go:310] [api-check] Waiting for a healthy API server. This can take up to 4m0s
	I0722 10:31:16.311534    8575 kubeadm.go:310] [api-check] The API server is healthy after 5.501369959s
	I0722 10:31:16.311639    8575 kubeadm.go:310] [upload-config] Storing the configuration used in ConfigMap "kubeadm-config" in the "kube-system" Namespace
	I0722 10:31:16.311762    8575 kubeadm.go:310] [kubelet] Creating a ConfigMap "kubelet-config" in namespace kube-system with the configuration for the kubelets in the cluster
	I0722 10:31:16.311827    8575 kubeadm.go:310] [upload-certs] Skipping phase. Please see --upload-certs
	I0722 10:31:16.312004    8575 kubeadm.go:310] [mark-control-plane] Marking the node addons-578168 as control-plane by adding the labels: [node-role.kubernetes.io/control-plane node.kubernetes.io/exclude-from-external-load-balancers]
	I0722 10:31:16.312062    8575 kubeadm.go:310] [bootstrap-token] Using token: 1hiflh.gzphognequh4f0si
	I0722 10:31:16.315434    8575 out.go:204]   - Configuring RBAC rules ...
	I0722 10:31:16.315553    8575 kubeadm.go:310] [bootstrap-token] Configuring bootstrap tokens, cluster-info ConfigMap, RBAC Roles
	I0722 10:31:16.315643    8575 kubeadm.go:310] [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to get nodes
	I0722 10:31:16.315782    8575 kubeadm.go:310] [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to post CSRs in order for nodes to get long term certificate credentials
	I0722 10:31:16.315929    8575 kubeadm.go:310] [bootstrap-token] Configured RBAC rules to allow the csrapprover controller automatically approve CSRs from a Node Bootstrap Token
	I0722 10:31:16.316044    8575 kubeadm.go:310] [bootstrap-token] Configured RBAC rules to allow certificate rotation for all node client certificates in the cluster
	I0722 10:31:16.316129    8575 kubeadm.go:310] [bootstrap-token] Creating the "cluster-info" ConfigMap in the "kube-public" namespace
	I0722 10:31:16.316256    8575 kubeadm.go:310] [kubelet-finalize] Updating "/etc/kubernetes/kubelet.conf" to point to a rotatable kubelet client certificate and key
	I0722 10:31:16.316302    8575 kubeadm.go:310] [addons] Applied essential addon: CoreDNS
	I0722 10:31:16.316360    8575 kubeadm.go:310] [addons] Applied essential addon: kube-proxy
	I0722 10:31:16.316370    8575 kubeadm.go:310] 
	I0722 10:31:16.316428    8575 kubeadm.go:310] Your Kubernetes control-plane has initialized successfully!
	I0722 10:31:16.316437    8575 kubeadm.go:310] 
	I0722 10:31:16.316516    8575 kubeadm.go:310] To start using your cluster, you need to run the following as a regular user:
	I0722 10:31:16.316525    8575 kubeadm.go:310] 
	I0722 10:31:16.316550    8575 kubeadm.go:310]   mkdir -p $HOME/.kube
	I0722 10:31:16.316615    8575 kubeadm.go:310]   sudo cp -i /etc/kubernetes/admin.conf $HOME/.kube/config
	I0722 10:31:16.316668    8575 kubeadm.go:310]   sudo chown $(id -u):$(id -g) $HOME/.kube/config
	I0722 10:31:16.316676    8575 kubeadm.go:310] 
	I0722 10:31:16.316728    8575 kubeadm.go:310] Alternatively, if you are the root user, you can run:
	I0722 10:31:16.316736    8575 kubeadm.go:310] 
	I0722 10:31:16.316781    8575 kubeadm.go:310]   export KUBECONFIG=/etc/kubernetes/admin.conf
	I0722 10:31:16.316790    8575 kubeadm.go:310] 
	I0722 10:31:16.316840    8575 kubeadm.go:310] You should now deploy a pod network to the cluster.
	I0722 10:31:16.316934    8575 kubeadm.go:310] Run "kubectl apply -f [podnetwork].yaml" with one of the options listed at:
	I0722 10:31:16.317025    8575 kubeadm.go:310]   https://kubernetes.io/docs/concepts/cluster-administration/addons/
	I0722 10:31:16.317036    8575 kubeadm.go:310] 
	I0722 10:31:16.317118    8575 kubeadm.go:310] You can now join any number of control-plane nodes by copying certificate authorities
	I0722 10:31:16.317192    8575 kubeadm.go:310] and service account keys on each node and then running the following as root:
	I0722 10:31:16.317196    8575 kubeadm.go:310] 
	I0722 10:31:16.317276    8575 kubeadm.go:310]   kubeadm join control-plane.minikube.internal:8443 --token 1hiflh.gzphognequh4f0si \
	I0722 10:31:16.317392    8575 kubeadm.go:310] 	--discovery-token-ca-cert-hash sha256:f7bc1c869ca0058fd4273fc1112c05a52361550e75cdb524f71ef7e71fc9b86a \
	I0722 10:31:16.317412    8575 kubeadm.go:310] 	--control-plane 
	I0722 10:31:16.317416    8575 kubeadm.go:310] 
	I0722 10:31:16.317498    8575 kubeadm.go:310] Then you can join any number of worker nodes by running the following on each as root:
	I0722 10:31:16.317517    8575 kubeadm.go:310] 
	I0722 10:31:16.317633    8575 kubeadm.go:310] kubeadm join control-plane.minikube.internal:8443 --token 1hiflh.gzphognequh4f0si \
	I0722 10:31:16.317757    8575 kubeadm.go:310] 	--discovery-token-ca-cert-hash sha256:f7bc1c869ca0058fd4273fc1112c05a52361550e75cdb524f71ef7e71fc9b86a 
	I0722 10:31:16.317770    8575 cni.go:84] Creating CNI manager for ""
	I0722 10:31:16.317778    8575 cni.go:143] "docker" driver + "crio" runtime found, recommending kindnet
	I0722 10:31:16.319956    8575 out.go:177] * Configuring CNI (Container Networking Interface) ...
	I0722 10:31:16.321985    8575 ssh_runner.go:195] Run: stat /opt/cni/bin/portmap
	I0722 10:31:16.325734    8575 cni.go:182] applying CNI manifest using /var/lib/minikube/binaries/v1.30.3/kubectl ...
	I0722 10:31:16.325757    8575 ssh_runner.go:362] scp memory --> /var/tmp/minikube/cni.yaml (2438 bytes)
	I0722 10:31:16.343694    8575 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.3/kubectl apply --kubeconfig=/var/lib/minikube/kubeconfig -f /var/tmp/minikube/cni.yaml
	I0722 10:31:16.600057    8575 ssh_runner.go:195] Run: /bin/bash -c "cat /proc/$(pgrep kube-apiserver)/oom_adj"
	I0722 10:31:16.600196    8575 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.3/kubectl create clusterrolebinding minikube-rbac --clusterrole=cluster-admin --serviceaccount=kube-system:default --kubeconfig=/var/lib/minikube/kubeconfig
	I0722 10:31:16.600289    8575 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.3/kubectl --kubeconfig=/var/lib/minikube/kubeconfig label --overwrite nodes addons-578168 minikube.k8s.io/updated_at=2024_07_22T10_31_16_0700 minikube.k8s.io/version=v1.33.1 minikube.k8s.io/commit=8e5b1d22910d5d447b525af478862a848159d7b7 minikube.k8s.io/name=addons-578168 minikube.k8s.io/primary=true
	I0722 10:31:16.724089    8575 ops.go:34] apiserver oom_adj: -16
	I0722 10:31:16.724194    8575 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0722 10:31:17.225277    8575 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0722 10:31:17.724253    8575 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0722 10:31:18.224278    8575 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0722 10:31:18.724854    8575 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0722 10:31:19.224487    8575 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0722 10:31:19.724936    8575 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0722 10:31:20.224468    8575 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0722 10:31:20.724376    8575 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0722 10:31:21.224335    8575 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0722 10:31:21.724842    8575 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0722 10:31:22.224599    8575 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0722 10:31:22.724832    8575 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0722 10:31:23.225019    8575 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0722 10:31:23.724903    8575 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0722 10:31:24.225069    8575 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0722 10:31:24.724783    8575 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0722 10:31:25.224910    8575 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0722 10:31:25.724392    8575 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0722 10:31:26.225277    8575 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0722 10:31:26.724603    8575 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0722 10:31:27.224670    8575 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0722 10:31:27.724989    8575 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0722 10:31:28.224494    8575 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0722 10:31:28.724838    8575 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0722 10:31:29.224315    8575 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0722 10:31:29.724842    8575 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0722 10:31:29.865961    8575 kubeadm.go:1113] duration metric: took 13.265820413s to wait for elevateKubeSystemPrivileges
	I0722 10:31:29.866000    8575 kubeadm.go:394] duration metric: took 29.920365856s to StartCluster
	I0722 10:31:29.866017    8575 settings.go:142] acquiring lock: {Name:mk5fbd205fde0f82abe2a5378554c5e9944b6110 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0722 10:31:29.866125    8575 settings.go:150] Updating kubeconfig:  /home/jenkins/minikube-integration/19313-2237/kubeconfig
	I0722 10:31:29.866492    8575 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19313-2237/kubeconfig: {Name:mkcc86b3f46ba469151bab0be6d762245d79cdb6 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0722 10:31:29.866681    8575 start.go:235] Will wait 6m0s for node &{Name: IP:192.168.49.2 Port:8443 KubernetesVersion:v1.30.3 ContainerRuntime:crio ControlPlane:true Worker:true}
	I0722 10:31:29.866783    8575 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.30.3/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml"
	I0722 10:31:29.867024    8575 config.go:182] Loaded profile config "addons-578168": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.30.3
	I0722 10:31:29.867060    8575 addons.go:507] enable addons start: toEnable=map[ambassador:false auto-pause:false cloud-spanner:true csi-hostpath-driver:true dashboard:false default-storageclass:true efk:false freshpod:false gcp-auth:true gvisor:false headlamp:false helm-tiller:false inaccel:false ingress:true ingress-dns:true inspektor-gadget:true istio:false istio-provisioner:false kong:false kubeflow:false kubevirt:false logviewer:false metallb:false metrics-server:true nvidia-device-plugin:true nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:true registry-aliases:false registry-creds:false storage-provisioner:true storage-provisioner-gluster:false storage-provisioner-rancher:true volcano:true volumesnapshots:true yakd:true]
	I0722 10:31:29.867135    8575 addons.go:69] Setting yakd=true in profile "addons-578168"
	I0722 10:31:29.867159    8575 addons.go:234] Setting addon yakd=true in "addons-578168"
	I0722 10:31:29.867204    8575 host.go:66] Checking if "addons-578168" exists ...
	I0722 10:31:29.867637    8575 cli_runner.go:164] Run: docker container inspect addons-578168 --format={{.State.Status}}
	I0722 10:31:29.868090    8575 addons.go:69] Setting inspektor-gadget=true in profile "addons-578168"
	I0722 10:31:29.868128    8575 addons.go:234] Setting addon inspektor-gadget=true in "addons-578168"
	I0722 10:31:29.868155    8575 host.go:66] Checking if "addons-578168" exists ...
	I0722 10:31:29.868562    8575 cli_runner.go:164] Run: docker container inspect addons-578168 --format={{.State.Status}}
	I0722 10:31:29.868705    8575 addons.go:69] Setting metrics-server=true in profile "addons-578168"
	I0722 10:31:29.868737    8575 addons.go:234] Setting addon metrics-server=true in "addons-578168"
	I0722 10:31:29.868764    8575 host.go:66] Checking if "addons-578168" exists ...
	I0722 10:31:29.868957    8575 addons.go:69] Setting nvidia-device-plugin=true in profile "addons-578168"
	I0722 10:31:29.868977    8575 addons.go:234] Setting addon nvidia-device-plugin=true in "addons-578168"
	I0722 10:31:29.868995    8575 host.go:66] Checking if "addons-578168" exists ...
	I0722 10:31:29.869359    8575 cli_runner.go:164] Run: docker container inspect addons-578168 --format={{.State.Status}}
	I0722 10:31:29.871859    8575 addons.go:69] Setting cloud-spanner=true in profile "addons-578168"
	I0722 10:31:29.874450    8575 addons.go:234] Setting addon cloud-spanner=true in "addons-578168"
	I0722 10:31:29.874495    8575 host.go:66] Checking if "addons-578168" exists ...
	I0722 10:31:29.874915    8575 cli_runner.go:164] Run: docker container inspect addons-578168 --format={{.State.Status}}
	I0722 10:31:29.875158    8575 addons.go:69] Setting registry=true in profile "addons-578168"
	I0722 10:31:29.875183    8575 addons.go:234] Setting addon registry=true in "addons-578168"
	I0722 10:31:29.875206    8575 host.go:66] Checking if "addons-578168" exists ...
	I0722 10:31:29.875573    8575 cli_runner.go:164] Run: docker container inspect addons-578168 --format={{.State.Status}}
	I0722 10:31:29.876223    8575 addons.go:69] Setting storage-provisioner=true in profile "addons-578168"
	I0722 10:31:29.876349    8575 addons.go:234] Setting addon storage-provisioner=true in "addons-578168"
	I0722 10:31:29.876395    8575 host.go:66] Checking if "addons-578168" exists ...
	I0722 10:31:29.876965    8575 cli_runner.go:164] Run: docker container inspect addons-578168 --format={{.State.Status}}
	I0722 10:31:29.872077    8575 addons.go:69] Setting csi-hostpath-driver=true in profile "addons-578168"
	I0722 10:31:29.888753    8575 addons.go:234] Setting addon csi-hostpath-driver=true in "addons-578168"
	I0722 10:31:29.888804    8575 host.go:66] Checking if "addons-578168" exists ...
	I0722 10:31:29.889275    8575 cli_runner.go:164] Run: docker container inspect addons-578168 --format={{.State.Status}}
	I0722 10:31:29.872090    8575 addons.go:69] Setting default-storageclass=true in profile "addons-578168"
	I0722 10:31:29.904777    8575 addons_storage_classes.go:33] enableOrDisableStorageClasses default-storageclass=true on "addons-578168"
	I0722 10:31:29.905221    8575 cli_runner.go:164] Run: docker container inspect addons-578168 --format={{.State.Status}}
	I0722 10:31:29.906562    8575 addons.go:69] Setting storage-provisioner-rancher=true in profile "addons-578168"
	I0722 10:31:29.906628    8575 addons_storage_classes.go:33] enableOrDisableStorageClasses storage-provisioner-rancher=true on "addons-578168"
	I0722 10:31:29.907005    8575 cli_runner.go:164] Run: docker container inspect addons-578168 --format={{.State.Status}}
	I0722 10:31:29.935580    8575 addons.go:69] Setting volcano=true in profile "addons-578168"
	I0722 10:31:29.935629    8575 addons.go:234] Setting addon volcano=true in "addons-578168"
	I0722 10:31:29.935676    8575 host.go:66] Checking if "addons-578168" exists ...
	I0722 10:31:29.936125    8575 cli_runner.go:164] Run: docker container inspect addons-578168 --format={{.State.Status}}
	I0722 10:31:29.872095    8575 addons.go:69] Setting gcp-auth=true in profile "addons-578168"
	I0722 10:31:29.950111    8575 mustload.go:65] Loading cluster: addons-578168
	I0722 10:31:29.950321    8575 config.go:182] Loaded profile config "addons-578168": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.30.3
	I0722 10:31:29.950638    8575 cli_runner.go:164] Run: docker container inspect addons-578168 --format={{.State.Status}}
	I0722 10:31:29.967793    8575 addons.go:69] Setting volumesnapshots=true in profile "addons-578168"
	I0722 10:31:29.967852    8575 addons.go:234] Setting addon volumesnapshots=true in "addons-578168"
	I0722 10:31:29.967890    8575 host.go:66] Checking if "addons-578168" exists ...
	I0722 10:31:29.872099    8575 addons.go:69] Setting ingress=true in profile "addons-578168"
	I0722 10:31:29.968135    8575 addons.go:234] Setting addon ingress=true in "addons-578168"
	I0722 10:31:29.872103    8575 addons.go:69] Setting ingress-dns=true in profile "addons-578168"
	I0722 10:31:29.968172    8575 addons.go:234] Setting addon ingress-dns=true in "addons-578168"
	I0722 10:31:29.968201    8575 host.go:66] Checking if "addons-578168" exists ...
	I0722 10:31:29.872604    8575 cli_runner.go:164] Run: docker container inspect addons-578168 --format={{.State.Status}}
	I0722 10:31:29.881634    8575 out.go:177] * Verifying Kubernetes components...
	I0722 10:31:29.968535    8575 cli_runner.go:164] Run: docker container inspect addons-578168 --format={{.State.Status}}
	I0722 10:31:30.008694    8575 out.go:177]   - Using image nvcr.io/nvidia/k8s-device-plugin:v0.16.0
	I0722 10:31:30.011605    8575 addons.go:431] installing /etc/kubernetes/addons/nvidia-device-plugin.yaml
	I0722 10:31:30.012035    8575 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/nvidia-device-plugin.yaml (1966 bytes)
	I0722 10:31:30.012115    8575 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-578168
	I0722 10:31:30.025090    8575 out.go:177]   - Using image ghcr.io/inspektor-gadget/inspektor-gadget:v0.30.0
	I0722 10:31:29.976626    8575 host.go:66] Checking if "addons-578168" exists ...
	I0722 10:31:30.028256    8575 cli_runner.go:164] Run: docker container inspect addons-578168 --format={{.State.Status}}
	I0722 10:31:29.976813    8575 ssh_runner.go:195] Run: sudo systemctl daemon-reload
	I0722 10:31:29.977000    8575 cli_runner.go:164] Run: docker container inspect addons-578168 --format={{.State.Status}}
	I0722 10:31:30.075745    8575 out.go:177]   - Using image gcr.io/cloud-spanner-emulator/emulator:1.5.17
	I0722 10:31:30.077846    8575 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.30.3/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml | sed -e '/^        forward . \/etc\/resolv.conf.*/i \        hosts {\n           192.168.49.1 host.minikube.internal\n           fallthrough\n        }' -e '/^        errors *$/i \        log' | sudo /var/lib/minikube/binaries/v1.30.3/kubectl --kubeconfig=/var/lib/minikube/kubeconfig replace -f -"
	I0722 10:31:30.078174    8575 addons.go:431] installing /etc/kubernetes/addons/deployment.yaml
	I0722 10:31:30.078187    8575 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/deployment.yaml (1004 bytes)
	I0722 10:31:30.078253    8575 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-578168
	I0722 10:31:30.027537    8575 addons.go:431] installing /etc/kubernetes/addons/ig-namespace.yaml
	I0722 10:31:30.078507    8575 ssh_runner.go:362] scp inspektor-gadget/ig-namespace.yaml --> /etc/kubernetes/addons/ig-namespace.yaml (55 bytes)
	I0722 10:31:30.027550    8575 out.go:177]   - Using image docker.io/marcnuri/yakd:0.0.5
	I0722 10:31:30.080788    8575 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-578168
	I0722 10:31:30.101092    8575 addons.go:431] installing /etc/kubernetes/addons/yakd-ns.yaml
	I0722 10:31:30.101122    8575 ssh_runner.go:362] scp yakd/yakd-ns.yaml --> /etc/kubernetes/addons/yakd-ns.yaml (171 bytes)
	I0722 10:31:30.101200    8575 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-578168
	I0722 10:31:30.135733    8575 addons.go:234] Setting addon storage-provisioner-rancher=true in "addons-578168"
	I0722 10:31:30.135775    8575 host.go:66] Checking if "addons-578168" exists ...
	I0722 10:31:30.136088    8575 addons.go:234] Setting addon default-storageclass=true in "addons-578168"
	I0722 10:31:30.136117    8575 host.go:66] Checking if "addons-578168" exists ...
	I0722 10:31:30.136189    8575 cli_runner.go:164] Run: docker container inspect addons-578168 --format={{.State.Status}}
	I0722 10:31:30.136481    8575 cli_runner.go:164] Run: docker container inspect addons-578168 --format={{.State.Status}}
	I0722 10:31:30.154899    8575 out.go:177]   - Using image docker.io/registry:2.8.3
	I0722 10:31:30.159674    8575 out.go:177]   - Using image gcr.io/k8s-minikube/kube-registry-proxy:0.0.6
	I0722 10:31:30.164634    8575 addons.go:431] installing /etc/kubernetes/addons/registry-rc.yaml
	I0722 10:31:30.164657    8575 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/registry-rc.yaml (860 bytes)
	I0722 10:31:30.164726    8575 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-578168
	I0722 10:31:30.194242    8575 out.go:177]   - Using image gcr.io/k8s-minikube/storage-provisioner:v5
	I0722 10:31:30.194417    8575 out.go:177]   - Using image registry.k8s.io/sig-storage/livenessprobe:v2.8.0
	I0722 10:31:30.196790    8575 out.go:177]   - Using image registry.k8s.io/sig-storage/csi-resizer:v1.6.0
	I0722 10:31:30.197196    8575 addons.go:431] installing /etc/kubernetes/addons/storage-provisioner.yaml
	I0722 10:31:30.197214    8575 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storage-provisioner.yaml (2676 bytes)
	I0722 10:31:30.197298    8575 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-578168
	I0722 10:31:30.218090    8575 out.go:177]   - Using image registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0
	I0722 10:31:30.219958    8575 out.go:177]   - Using image registry.k8s.io/metrics-server/metrics-server:v0.7.1
	I0722 10:31:30.221875    8575 addons.go:431] installing /etc/kubernetes/addons/metrics-apiservice.yaml
	I0722 10:31:30.221906    8575 ssh_runner.go:362] scp metrics-server/metrics-apiservice.yaml --> /etc/kubernetes/addons/metrics-apiservice.yaml (424 bytes)
	I0722 10:31:30.221985    8575 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-578168
	I0722 10:31:30.235942    8575 out.go:177]   - Using image registry.k8s.io/sig-storage/csi-provisioner:v3.3.0
	I0722 10:31:30.240705    8575 out.go:177]   - Using image registry.k8s.io/sig-storage/csi-attacher:v4.0.0
	I0722 10:31:30.242346    8575 out.go:177]   - Using image registry.k8s.io/sig-storage/csi-external-health-monitor-controller:v0.7.0
	I0722 10:31:30.249065    8575 out.go:177]   - Using image registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.6.0
	I0722 10:31:30.250980    8575 out.go:177]   - Using image registry.k8s.io/sig-storage/hostpathplugin:v1.9.0
	I0722 10:31:30.257368    8575 out.go:177]   - Using image registry.k8s.io/sig-storage/snapshot-controller:v6.1.0
	W0722 10:31:30.257699    8575 out.go:239] ! Enabling 'volcano' returned an error: running callbacks: [volcano addon does not support crio]
	I0722 10:31:30.257775    8575 addons.go:431] installing /etc/kubernetes/addons/rbac-external-attacher.yaml
	I0722 10:31:30.257785    8575 ssh_runner.go:362] scp csi-hostpath-driver/rbac/rbac-external-attacher.yaml --> /etc/kubernetes/addons/rbac-external-attacher.yaml (3073 bytes)
	I0722 10:31:30.257848    8575 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-578168
	I0722 10:31:30.259095    8575 addons.go:431] installing /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml
	I0722 10:31:30.259113    8575 ssh_runner.go:362] scp volumesnapshots/csi-hostpath-snapshotclass.yaml --> /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml (934 bytes)
	I0722 10:31:30.259175    8575 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-578168
	I0722 10:31:30.286324    8575 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32768 SSHKeyPath:/home/jenkins/minikube-integration/19313-2237/.minikube/machines/addons-578168/id_rsa Username:docker}
	I0722 10:31:30.298025    8575 host.go:66] Checking if "addons-578168" exists ...
	I0722 10:31:30.298309    8575 out.go:177]   - Using image registry.k8s.io/ingress-nginx/controller:v1.11.1
	I0722 10:31:30.303061    8575 out.go:177]   - Using image registry.k8s.io/ingress-nginx/kube-webhook-certgen:v1.4.1
	I0722 10:31:30.307782    8575 out.go:177]   - Using image registry.k8s.io/ingress-nginx/kube-webhook-certgen:v1.4.1
	I0722 10:31:30.310278    8575 addons.go:431] installing /etc/kubernetes/addons/ingress-deploy.yaml
	I0722 10:31:30.310297    8575 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/ingress-deploy.yaml (16078 bytes)
	I0722 10:31:30.310363    8575 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-578168
	I0722 10:31:30.356982    8575 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32768 SSHKeyPath:/home/jenkins/minikube-integration/19313-2237/.minikube/machines/addons-578168/id_rsa Username:docker}
	I0722 10:31:30.362522    8575 out.go:177]   - Using image gcr.io/k8s-minikube/minikube-ingress-dns:0.0.3
	I0722 10:31:30.364234    8575 addons.go:431] installing /etc/kubernetes/addons/ingress-dns-pod.yaml
	I0722 10:31:30.364256    8575 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/ingress-dns-pod.yaml (2442 bytes)
	I0722 10:31:30.364324    8575 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-578168
	I0722 10:31:30.397174    8575 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32768 SSHKeyPath:/home/jenkins/minikube-integration/19313-2237/.minikube/machines/addons-578168/id_rsa Username:docker}
	I0722 10:31:30.403983    8575 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32768 SSHKeyPath:/home/jenkins/minikube-integration/19313-2237/.minikube/machines/addons-578168/id_rsa Username:docker}
	I0722 10:31:30.409215    8575 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32768 SSHKeyPath:/home/jenkins/minikube-integration/19313-2237/.minikube/machines/addons-578168/id_rsa Username:docker}
	I0722 10:31:30.418605    8575 out.go:177]   - Using image docker.io/rancher/local-path-provisioner:v0.0.22
	I0722 10:31:30.420383    8575 out.go:177]   - Using image docker.io/busybox:stable
	I0722 10:31:30.421977    8575 addons.go:431] installing /etc/kubernetes/addons/storage-provisioner-rancher.yaml
	I0722 10:31:30.422002    8575 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storage-provisioner-rancher.yaml (3113 bytes)
	I0722 10:31:30.422066    8575 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-578168
	I0722 10:31:30.432332    8575 addons.go:431] installing /etc/kubernetes/addons/storageclass.yaml
	I0722 10:31:30.432355    8575 ssh_runner.go:362] scp storageclass/storageclass.yaml --> /etc/kubernetes/addons/storageclass.yaml (271 bytes)
	I0722 10:31:30.432421    8575 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-578168
	I0722 10:31:30.444784    8575 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32768 SSHKeyPath:/home/jenkins/minikube-integration/19313-2237/.minikube/machines/addons-578168/id_rsa Username:docker}
	I0722 10:31:30.445250    8575 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32768 SSHKeyPath:/home/jenkins/minikube-integration/19313-2237/.minikube/machines/addons-578168/id_rsa Username:docker}
	I0722 10:31:30.477346    8575 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32768 SSHKeyPath:/home/jenkins/minikube-integration/19313-2237/.minikube/machines/addons-578168/id_rsa Username:docker}
	I0722 10:31:30.489995    8575 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32768 SSHKeyPath:/home/jenkins/minikube-integration/19313-2237/.minikube/machines/addons-578168/id_rsa Username:docker}
	I0722 10:31:30.503340    8575 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32768 SSHKeyPath:/home/jenkins/minikube-integration/19313-2237/.minikube/machines/addons-578168/id_rsa Username:docker}
	I0722 10:31:30.505530    8575 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32768 SSHKeyPath:/home/jenkins/minikube-integration/19313-2237/.minikube/machines/addons-578168/id_rsa Username:docker}
	I0722 10:31:30.537044    8575 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32768 SSHKeyPath:/home/jenkins/minikube-integration/19313-2237/.minikube/machines/addons-578168/id_rsa Username:docker}
	I0722 10:31:30.539837    8575 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32768 SSHKeyPath:/home/jenkins/minikube-integration/19313-2237/.minikube/machines/addons-578168/id_rsa Username:docker}
	I0722 10:31:30.729029    8575 ssh_runner.go:195] Run: sudo systemctl start kubelet
	I0722 10:31:30.752061    8575 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.3/kubectl apply -f /etc/kubernetes/addons/deployment.yaml
	I0722 10:31:30.824250    8575 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.3/kubectl apply -f /etc/kubernetes/addons/nvidia-device-plugin.yaml
	I0722 10:31:30.939418    8575 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.3/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml
	I0722 10:31:30.951299    8575 addons.go:431] installing /etc/kubernetes/addons/ig-serviceaccount.yaml
	I0722 10:31:30.951372    8575 ssh_runner.go:362] scp inspektor-gadget/ig-serviceaccount.yaml --> /etc/kubernetes/addons/ig-serviceaccount.yaml (80 bytes)
	I0722 10:31:30.954252    8575 addons.go:431] installing /etc/kubernetes/addons/yakd-sa.yaml
	I0722 10:31:30.954311    8575 ssh_runner.go:362] scp yakd/yakd-sa.yaml --> /etc/kubernetes/addons/yakd-sa.yaml (247 bytes)
	I0722 10:31:30.957841    8575 addons.go:431] installing /etc/kubernetes/addons/metrics-server-deployment.yaml
	I0722 10:31:30.957908    8575 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-server-deployment.yaml (1907 bytes)
	I0722 10:31:30.964816    8575 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.3/kubectl apply -f /etc/kubernetes/addons/ingress-deploy.yaml
	I0722 10:31:30.967237    8575 addons.go:431] installing /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml
	I0722 10:31:30.967296    8575 ssh_runner.go:362] scp volumesnapshots/snapshot.storage.k8s.io_volumesnapshotclasses.yaml --> /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml (6471 bytes)
	I0722 10:31:31.039480    8575 addons.go:431] installing /etc/kubernetes/addons/rbac-hostpath.yaml
	I0722 10:31:31.039593    8575 ssh_runner.go:362] scp csi-hostpath-driver/rbac/rbac-hostpath.yaml --> /etc/kubernetes/addons/rbac-hostpath.yaml (4266 bytes)
	I0722 10:31:31.044651    8575 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.3/kubectl apply -f /etc/kubernetes/addons/ingress-dns-pod.yaml
	I0722 10:31:31.048137    8575 addons.go:431] installing /etc/kubernetes/addons/metrics-server-rbac.yaml
	I0722 10:31:31.048208    8575 ssh_runner.go:362] scp metrics-server/metrics-server-rbac.yaml --> /etc/kubernetes/addons/metrics-server-rbac.yaml (2175 bytes)
	I0722 10:31:31.056365    8575 addons.go:431] installing /etc/kubernetes/addons/registry-svc.yaml
	I0722 10:31:31.056440    8575 ssh_runner.go:362] scp registry/registry-svc.yaml --> /etc/kubernetes/addons/registry-svc.yaml (398 bytes)
	I0722 10:31:31.062961    8575 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.3/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml
	I0722 10:31:31.063954    8575 addons.go:431] installing /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml
	I0722 10:31:31.064037    8575 ssh_runner.go:362] scp volumesnapshots/snapshot.storage.k8s.io_volumesnapshotcontents.yaml --> /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml (23126 bytes)
	I0722 10:31:31.132461    8575 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.3/kubectl apply -f /etc/kubernetes/addons/storage-provisioner-rancher.yaml
	I0722 10:31:31.163088    8575 addons.go:431] installing /etc/kubernetes/addons/yakd-crb.yaml
	I0722 10:31:31.163160    8575 ssh_runner.go:362] scp yakd/yakd-crb.yaml --> /etc/kubernetes/addons/yakd-crb.yaml (422 bytes)
	I0722 10:31:31.176226    8575 addons.go:431] installing /etc/kubernetes/addons/metrics-server-service.yaml
	I0722 10:31:31.176298    8575 ssh_runner.go:362] scp metrics-server/metrics-server-service.yaml --> /etc/kubernetes/addons/metrics-server-service.yaml (446 bytes)
	I0722 10:31:31.184989    8575 addons.go:431] installing /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml
	I0722 10:31:31.185064    8575 ssh_runner.go:362] scp volumesnapshots/snapshot.storage.k8s.io_volumesnapshots.yaml --> /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml (19582 bytes)
	I0722 10:31:31.187158    8575 addons.go:431] installing /etc/kubernetes/addons/ig-role.yaml
	I0722 10:31:31.187229    8575 ssh_runner.go:362] scp inspektor-gadget/ig-role.yaml --> /etc/kubernetes/addons/ig-role.yaml (210 bytes)
	I0722 10:31:31.236692    8575 addons.go:431] installing /etc/kubernetes/addons/rbac-external-health-monitor-controller.yaml
	I0722 10:31:31.236765    8575 ssh_runner.go:362] scp csi-hostpath-driver/rbac/rbac-external-health-monitor-controller.yaml --> /etc/kubernetes/addons/rbac-external-health-monitor-controller.yaml (3038 bytes)
	I0722 10:31:31.242480    8575 addons.go:431] installing /etc/kubernetes/addons/registry-proxy.yaml
	I0722 10:31:31.242545    8575 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/registry-proxy.yaml (947 bytes)
	I0722 10:31:31.315175    8575 addons.go:431] installing /etc/kubernetes/addons/ig-rolebinding.yaml
	I0722 10:31:31.315246    8575 ssh_runner.go:362] scp inspektor-gadget/ig-rolebinding.yaml --> /etc/kubernetes/addons/ig-rolebinding.yaml (244 bytes)
	I0722 10:31:31.318592    8575 addons.go:431] installing /etc/kubernetes/addons/yakd-svc.yaml
	I0722 10:31:31.318660    8575 ssh_runner.go:362] scp yakd/yakd-svc.yaml --> /etc/kubernetes/addons/yakd-svc.yaml (412 bytes)
	I0722 10:31:31.321980    8575 addons.go:431] installing /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml
	I0722 10:31:31.322052    8575 ssh_runner.go:362] scp volumesnapshots/rbac-volume-snapshot-controller.yaml --> /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml (3545 bytes)
	I0722 10:31:31.325325    8575 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.3/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
	I0722 10:31:31.421464    8575 addons.go:431] installing /etc/kubernetes/addons/rbac-external-provisioner.yaml
	I0722 10:31:31.421537    8575 ssh_runner.go:362] scp csi-hostpath-driver/rbac/rbac-external-provisioner.yaml --> /etc/kubernetes/addons/rbac-external-provisioner.yaml (4442 bytes)
	I0722 10:31:31.427033    8575 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.3/kubectl apply -f /etc/kubernetes/addons/registry-rc.yaml -f /etc/kubernetes/addons/registry-svc.yaml -f /etc/kubernetes/addons/registry-proxy.yaml
	I0722 10:31:31.495741    8575 addons.go:431] installing /etc/kubernetes/addons/yakd-dp.yaml
	I0722 10:31:31.495812    8575 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/yakd-dp.yaml (2017 bytes)
	I0722 10:31:31.503657    8575 addons.go:431] installing /etc/kubernetes/addons/ig-clusterrole.yaml
	I0722 10:31:31.503728    8575 ssh_runner.go:362] scp inspektor-gadget/ig-clusterrole.yaml --> /etc/kubernetes/addons/ig-clusterrole.yaml (1485 bytes)
	I0722 10:31:31.514263    8575 addons.go:431] installing /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml
	I0722 10:31:31.514335    8575 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml (1475 bytes)
	I0722 10:31:31.678813    8575 addons.go:431] installing /etc/kubernetes/addons/rbac-external-resizer.yaml
	I0722 10:31:31.678889    8575 ssh_runner.go:362] scp csi-hostpath-driver/rbac/rbac-external-resizer.yaml --> /etc/kubernetes/addons/rbac-external-resizer.yaml (2943 bytes)
	I0722 10:31:31.712667    8575 addons.go:431] installing /etc/kubernetes/addons/ig-clusterrolebinding.yaml
	I0722 10:31:31.712697    8575 ssh_runner.go:362] scp inspektor-gadget/ig-clusterrolebinding.yaml --> /etc/kubernetes/addons/ig-clusterrolebinding.yaml (274 bytes)
	I0722 10:31:31.730209    8575 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.3/kubectl apply -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml
	I0722 10:31:31.737800    8575 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.3/kubectl apply -f /etc/kubernetes/addons/yakd-ns.yaml -f /etc/kubernetes/addons/yakd-sa.yaml -f /etc/kubernetes/addons/yakd-crb.yaml -f /etc/kubernetes/addons/yakd-svc.yaml -f /etc/kubernetes/addons/yakd-dp.yaml
	I0722 10:31:31.856625    8575 addons.go:431] installing /etc/kubernetes/addons/rbac-external-snapshotter.yaml
	I0722 10:31:31.856688    8575 ssh_runner.go:362] scp csi-hostpath-driver/rbac/rbac-external-snapshotter.yaml --> /etc/kubernetes/addons/rbac-external-snapshotter.yaml (3149 bytes)
	I0722 10:31:31.911587    8575 addons.go:431] installing /etc/kubernetes/addons/ig-crd.yaml
	I0722 10:31:31.911663    8575 ssh_runner.go:362] scp inspektor-gadget/ig-crd.yaml --> /etc/kubernetes/addons/ig-crd.yaml (5216 bytes)
	I0722 10:31:32.036061    8575 addons.go:431] installing /etc/kubernetes/addons/ig-daemonset.yaml
	I0722 10:31:32.036085    8575 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/ig-daemonset.yaml (7735 bytes)
	I0722 10:31:32.061923    8575 addons.go:431] installing /etc/kubernetes/addons/csi-hostpath-attacher.yaml
	I0722 10:31:32.061990    8575 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/csi-hostpath-attacher.yaml (2143 bytes)
	I0722 10:31:32.162328    8575 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.3/kubectl apply -f /etc/kubernetes/addons/ig-namespace.yaml -f /etc/kubernetes/addons/ig-serviceaccount.yaml -f /etc/kubernetes/addons/ig-role.yaml -f /etc/kubernetes/addons/ig-rolebinding.yaml -f /etc/kubernetes/addons/ig-clusterrole.yaml -f /etc/kubernetes/addons/ig-clusterrolebinding.yaml -f /etc/kubernetes/addons/ig-crd.yaml -f /etc/kubernetes/addons/ig-daemonset.yaml
	I0722 10:31:32.193568    8575 addons.go:431] installing /etc/kubernetes/addons/csi-hostpath-driverinfo.yaml
	I0722 10:31:32.193638    8575 ssh_runner.go:362] scp csi-hostpath-driver/deploy/csi-hostpath-driverinfo.yaml --> /etc/kubernetes/addons/csi-hostpath-driverinfo.yaml (1274 bytes)
	I0722 10:31:32.332035    8575 addons.go:431] installing /etc/kubernetes/addons/csi-hostpath-plugin.yaml
	I0722 10:31:32.332108    8575 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/csi-hostpath-plugin.yaml (8201 bytes)
	I0722 10:31:32.437092    8575 ssh_runner.go:235] Completed: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.30.3/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml | sed -e '/^        forward . \/etc\/resolv.conf.*/i \        hosts {\n           192.168.49.1 host.minikube.internal\n           fallthrough\n        }' -e '/^        errors *$/i \        log' | sudo /var/lib/minikube/binaries/v1.30.3/kubectl --kubeconfig=/var/lib/minikube/kubeconfig replace -f -": (2.35921009s)
	I0722 10:31:32.437165    8575 start.go:971] {"host.minikube.internal": 192.168.49.1} host record injected into CoreDNS's ConfigMap
	I0722 10:31:32.437356    8575 ssh_runner.go:235] Completed: sudo systemctl start kubelet: (1.708263724s)
	I0722 10:31:32.438955    8575 node_ready.go:35] waiting up to 6m0s for node "addons-578168" to be "Ready" ...
	I0722 10:31:32.467042    8575 addons.go:431] installing /etc/kubernetes/addons/csi-hostpath-resizer.yaml
	I0722 10:31:32.467108    8575 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/csi-hostpath-resizer.yaml (2191 bytes)
	I0722 10:31:32.577177    8575 addons.go:431] installing /etc/kubernetes/addons/csi-hostpath-storageclass.yaml
	I0722 10:31:32.577198    8575 ssh_runner.go:362] scp csi-hostpath-driver/deploy/csi-hostpath-storageclass.yaml --> /etc/kubernetes/addons/csi-hostpath-storageclass.yaml (846 bytes)
	I0722 10:31:32.700135    8575 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.3/kubectl apply -f /etc/kubernetes/addons/rbac-external-attacher.yaml -f /etc/kubernetes/addons/rbac-hostpath.yaml -f /etc/kubernetes/addons/rbac-external-health-monitor-controller.yaml -f /etc/kubernetes/addons/rbac-external-provisioner.yaml -f /etc/kubernetes/addons/rbac-external-resizer.yaml -f /etc/kubernetes/addons/rbac-external-snapshotter.yaml -f /etc/kubernetes/addons/csi-hostpath-attacher.yaml -f /etc/kubernetes/addons/csi-hostpath-driverinfo.yaml -f /etc/kubernetes/addons/csi-hostpath-plugin.yaml -f /etc/kubernetes/addons/csi-hostpath-resizer.yaml -f /etc/kubernetes/addons/csi-hostpath-storageclass.yaml
	I0722 10:31:33.555085    8575 kapi.go:214] "coredns" deployment in "kube-system" namespace and "addons-578168" context rescaled to 1 replicas
	I0722 10:31:34.460067    8575 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.3/kubectl apply -f /etc/kubernetes/addons/deployment.yaml: (3.707926701s)
	I0722 10:31:34.460129    8575 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.3/kubectl apply -f /etc/kubernetes/addons/nvidia-device-plugin.yaml: (3.635818428s)
	I0722 10:31:34.460167    8575 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.3/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml: (3.520688097s)
	I0722 10:31:34.712444    8575 node_ready.go:53] node "addons-578168" has status "Ready":"False"
	I0722 10:31:36.487379    8575 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.3/kubectl apply -f /etc/kubernetes/addons/ingress-deploy.yaml: (5.522470514s)
	I0722 10:31:36.487421    8575 addons.go:475] Verifying addon ingress=true in "addons-578168"
	I0722 10:31:36.487715    8575 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.3/kubectl apply -f /etc/kubernetes/addons/ingress-dns-pod.yaml: (5.44293282s)
	I0722 10:31:36.487789    8575 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.3/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml: (5.424768951s)
	I0722 10:31:36.487864    8575 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.3/kubectl apply -f /etc/kubernetes/addons/storage-provisioner-rancher.yaml: (5.355336624s)
	I0722 10:31:36.488112    8575 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.3/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: (5.162725841s)
	I0722 10:31:36.488134    8575 addons.go:475] Verifying addon metrics-server=true in "addons-578168"
	I0722 10:31:36.488169    8575 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.3/kubectl apply -f /etc/kubernetes/addons/registry-rc.yaml -f /etc/kubernetes/addons/registry-svc.yaml -f /etc/kubernetes/addons/registry-proxy.yaml: (5.06107312s)
	I0722 10:31:36.488183    8575 addons.go:475] Verifying addon registry=true in "addons-578168"
	I0722 10:31:36.489572    8575 out.go:177] * Verifying ingress addon...
	I0722 10:31:36.491903    8575 out.go:177] * Verifying registry addon...
	I0722 10:31:36.492913    8575 kapi.go:75] Waiting for pod with label "app.kubernetes.io/name=ingress-nginx" in ns "ingress-nginx" ...
	I0722 10:31:36.495216    8575 kapi.go:75] Waiting for pod with label "kubernetes.io/minikube-addons=registry" in ns "kube-system" ...
	I0722 10:31:36.528300    8575 kapi.go:86] Found 1 Pods for label selector kubernetes.io/minikube-addons=registry
	I0722 10:31:36.528335    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0722 10:31:36.531933    8575 kapi.go:86] Found 3 Pods for label selector app.kubernetes.io/name=ingress-nginx
	I0722 10:31:36.531980    8575 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0722 10:31:36.718316    8575 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.3/kubectl apply -f /etc/kubernetes/addons/yakd-ns.yaml -f /etc/kubernetes/addons/yakd-sa.yaml -f /etc/kubernetes/addons/yakd-crb.yaml -f /etc/kubernetes/addons/yakd-svc.yaml -f /etc/kubernetes/addons/yakd-dp.yaml: (4.980491542s)
	I0722 10:31:36.718265    8575 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.3/kubectl apply -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml: (4.988011589s)
	W0722 10:31:36.718481    8575 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.3/kubectl apply -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml: Process exited with status 1
	stdout:
	customresourcedefinition.apiextensions.k8s.io/volumesnapshotclasses.snapshot.storage.k8s.io created
	customresourcedefinition.apiextensions.k8s.io/volumesnapshotcontents.snapshot.storage.k8s.io created
	customresourcedefinition.apiextensions.k8s.io/volumesnapshots.snapshot.storage.k8s.io created
	serviceaccount/snapshot-controller created
	clusterrole.rbac.authorization.k8s.io/snapshot-controller-runner created
	clusterrolebinding.rbac.authorization.k8s.io/snapshot-controller-role created
	role.rbac.authorization.k8s.io/snapshot-controller-leaderelection created
	rolebinding.rbac.authorization.k8s.io/snapshot-controller-leaderelection created
	deployment.apps/snapshot-controller created
	
	stderr:
	error: resource mapping not found for name: "csi-hostpath-snapclass" namespace: "" from "/etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml": no matches for kind "VolumeSnapshotClass" in version "snapshot.storage.k8s.io/v1"
	ensure CRDs are installed first
	I0722 10:31:36.718505    8575 retry.go:31] will retry after 244.670902ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.3/kubectl apply -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml: Process exited with status 1
	stdout:
	customresourcedefinition.apiextensions.k8s.io/volumesnapshotclasses.snapshot.storage.k8s.io created
	customresourcedefinition.apiextensions.k8s.io/volumesnapshotcontents.snapshot.storage.k8s.io created
	customresourcedefinition.apiextensions.k8s.io/volumesnapshots.snapshot.storage.k8s.io created
	serviceaccount/snapshot-controller created
	clusterrole.rbac.authorization.k8s.io/snapshot-controller-runner created
	clusterrolebinding.rbac.authorization.k8s.io/snapshot-controller-role created
	role.rbac.authorization.k8s.io/snapshot-controller-leaderelection created
	rolebinding.rbac.authorization.k8s.io/snapshot-controller-leaderelection created
	deployment.apps/snapshot-controller created
	
	stderr:
	error: resource mapping not found for name: "csi-hostpath-snapclass" namespace: "" from "/etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml": no matches for kind "VolumeSnapshotClass" in version "snapshot.storage.k8s.io/v1"
	ensure CRDs are installed first
	I0722 10:31:36.718626    8575 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.3/kubectl apply -f /etc/kubernetes/addons/ig-namespace.yaml -f /etc/kubernetes/addons/ig-serviceaccount.yaml -f /etc/kubernetes/addons/ig-role.yaml -f /etc/kubernetes/addons/ig-rolebinding.yaml -f /etc/kubernetes/addons/ig-clusterrole.yaml -f /etc/kubernetes/addons/ig-clusterrolebinding.yaml -f /etc/kubernetes/addons/ig-crd.yaml -f /etc/kubernetes/addons/ig-daemonset.yaml: (4.556220769s)
	I0722 10:31:36.720205    8575 out.go:177] * To access YAKD - Kubernetes Dashboard, wait for Pod to be ready and run the following command:
	
		minikube -p addons-578168 service yakd-dashboard -n yakd-dashboard
	
	I0722 10:31:36.959101    8575 node_ready.go:53] node "addons-578168" has status "Ready":"False"
	I0722 10:31:36.964360    8575 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.3/kubectl apply --force -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml
	I0722 10:31:37.040130    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0722 10:31:37.046631    8575 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0722 10:31:37.264125    8575 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.3/kubectl apply -f /etc/kubernetes/addons/rbac-external-attacher.yaml -f /etc/kubernetes/addons/rbac-hostpath.yaml -f /etc/kubernetes/addons/rbac-external-health-monitor-controller.yaml -f /etc/kubernetes/addons/rbac-external-provisioner.yaml -f /etc/kubernetes/addons/rbac-external-resizer.yaml -f /etc/kubernetes/addons/rbac-external-snapshotter.yaml -f /etc/kubernetes/addons/csi-hostpath-attacher.yaml -f /etc/kubernetes/addons/csi-hostpath-driverinfo.yaml -f /etc/kubernetes/addons/csi-hostpath-plugin.yaml -f /etc/kubernetes/addons/csi-hostpath-resizer.yaml -f /etc/kubernetes/addons/csi-hostpath-storageclass.yaml: (4.563949856s)
	I0722 10:31:37.264174    8575 addons.go:475] Verifying addon csi-hostpath-driver=true in "addons-578168"
	I0722 10:31:37.266474    8575 out.go:177] * Verifying csi-hostpath-driver addon...
	I0722 10:31:37.269057    8575 kapi.go:75] Waiting for pod with label "kubernetes.io/minikube-addons=csi-hostpath-driver" in ns "kube-system" ...
	I0722 10:31:37.304160    8575 kapi.go:86] Found 2 Pods for label selector kubernetes.io/minikube-addons=csi-hostpath-driver
	I0722 10:31:37.304191    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0722 10:31:37.498921    8575 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0722 10:31:37.530717    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0722 10:31:37.618442    8575 ssh_runner.go:362] scp memory --> /var/lib/minikube/google_application_credentials.json (162 bytes)
	I0722 10:31:37.618569    8575 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-578168
	I0722 10:31:37.661165    8575 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32768 SSHKeyPath:/home/jenkins/minikube-integration/19313-2237/.minikube/machines/addons-578168/id_rsa Username:docker}
	I0722 10:31:37.774043    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0722 10:31:37.817584    8575 ssh_runner.go:362] scp memory --> /var/lib/minikube/google_cloud_project (12 bytes)
	I0722 10:31:37.871484    8575 addons.go:234] Setting addon gcp-auth=true in "addons-578168"
	I0722 10:31:37.871534    8575 host.go:66] Checking if "addons-578168" exists ...
	I0722 10:31:37.871976    8575 cli_runner.go:164] Run: docker container inspect addons-578168 --format={{.State.Status}}
	I0722 10:31:37.894848    8575 ssh_runner.go:195] Run: cat /var/lib/minikube/google_application_credentials.json
	I0722 10:31:37.894900    8575 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-578168
	I0722 10:31:37.926062    8575 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32768 SSHKeyPath:/home/jenkins/minikube-integration/19313-2237/.minikube/machines/addons-578168/id_rsa Username:docker}
	I0722 10:31:37.997036    8575 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0722 10:31:38.000382    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0722 10:31:38.276342    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0722 10:31:38.498059    8575 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0722 10:31:38.502821    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0722 10:31:38.775210    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0722 10:31:38.998005    8575 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0722 10:31:39.002861    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0722 10:31:39.273464    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0722 10:31:39.442892    8575 node_ready.go:53] node "addons-578168" has status "Ready":"False"
	I0722 10:31:39.497949    8575 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0722 10:31:39.499673    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0722 10:31:39.776214    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0722 10:31:39.998183    8575 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0722 10:31:40.002769    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0722 10:31:40.054210    8575 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.3/kubectl apply --force -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml: (3.089785177s)
	I0722 10:31:40.054372    8575 ssh_runner.go:235] Completed: cat /var/lib/minikube/google_application_credentials.json: (2.159478743s)
	I0722 10:31:40.056555    8575 out.go:177]   - Using image registry.k8s.io/ingress-nginx/kube-webhook-certgen:v1.4.1
	I0722 10:31:40.058444    8575 out.go:177]   - Using image gcr.io/k8s-minikube/gcp-auth-webhook:v0.1.2
	I0722 10:31:40.060091    8575 addons.go:431] installing /etc/kubernetes/addons/gcp-auth-ns.yaml
	I0722 10:31:40.060153    8575 ssh_runner.go:362] scp gcp-auth/gcp-auth-ns.yaml --> /etc/kubernetes/addons/gcp-auth-ns.yaml (700 bytes)
	I0722 10:31:40.083202    8575 addons.go:431] installing /etc/kubernetes/addons/gcp-auth-service.yaml
	I0722 10:31:40.083275    8575 ssh_runner.go:362] scp gcp-auth/gcp-auth-service.yaml --> /etc/kubernetes/addons/gcp-auth-service.yaml (788 bytes)
	I0722 10:31:40.111513    8575 addons.go:431] installing /etc/kubernetes/addons/gcp-auth-webhook.yaml
	I0722 10:31:40.111585    8575 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/gcp-auth-webhook.yaml (5421 bytes)
	I0722 10:31:40.140557    8575 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.3/kubectl apply -f /etc/kubernetes/addons/gcp-auth-ns.yaml -f /etc/kubernetes/addons/gcp-auth-service.yaml -f /etc/kubernetes/addons/gcp-auth-webhook.yaml
	I0722 10:31:40.282461    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0722 10:31:40.499308    8575 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0722 10:31:40.504593    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0722 10:31:40.738506    8575 addons.go:475] Verifying addon gcp-auth=true in "addons-578168"
	I0722 10:31:40.740443    8575 out.go:177] * Verifying gcp-auth addon...
	I0722 10:31:40.743012    8575 kapi.go:75] Waiting for pod with label "kubernetes.io/minikube-addons=gcp-auth" in ns "gcp-auth" ...
	I0722 10:31:40.748858    8575 kapi.go:86] Found 1 Pods for label selector kubernetes.io/minikube-addons=gcp-auth
	I0722 10:31:40.748933    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0722 10:31:40.774064    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0722 10:31:40.997591    8575 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0722 10:31:41.001329    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0722 10:31:41.246457    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0722 10:31:41.273481    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0722 10:31:41.497388    8575 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0722 10:31:41.499454    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0722 10:31:41.752863    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0722 10:31:41.779127    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0722 10:31:41.942365    8575 node_ready.go:53] node "addons-578168" has status "Ready":"False"
	I0722 10:31:42.008200    8575 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0722 10:31:42.017072    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0722 10:31:42.247785    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0722 10:31:42.275816    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0722 10:31:42.502580    8575 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0722 10:31:42.503490    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0722 10:31:42.748850    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0722 10:31:42.774752    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0722 10:31:42.999793    8575 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0722 10:31:43.002238    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0722 10:31:43.247076    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0722 10:31:43.273939    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0722 10:31:43.497076    8575 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0722 10:31:43.499395    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0722 10:31:43.746215    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0722 10:31:43.774091    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0722 10:31:43.942628    8575 node_ready.go:53] node "addons-578168" has status "Ready":"False"
	I0722 10:31:43.999269    8575 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0722 10:31:44.004316    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0722 10:31:44.247128    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0722 10:31:44.273201    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0722 10:31:44.498214    8575 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0722 10:31:44.499599    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0722 10:31:44.747123    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0722 10:31:44.773134    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0722 10:31:45.004765    8575 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0722 10:31:45.008295    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0722 10:31:45.247174    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0722 10:31:45.274006    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0722 10:31:45.497474    8575 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0722 10:31:45.499779    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0722 10:31:45.751295    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0722 10:31:45.777056    8575 kapi.go:86] Found 3 Pods for label selector kubernetes.io/minikube-addons=csi-hostpath-driver
	I0722 10:31:45.777128    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0722 10:31:45.980997    8575 node_ready.go:49] node "addons-578168" has status "Ready":"True"
	I0722 10:31:45.981067    8575 node_ready.go:38] duration metric: took 13.541724939s for node "addons-578168" to be "Ready" ...
	I0722 10:31:45.981094    8575 pod_ready.go:35] extra waiting up to 6m0s for all system-critical pods including labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
	I0722 10:31:45.997695    8575 pod_ready.go:78] waiting up to 6m0s for pod "coredns-7db6d8ff4d-dz9nf" in "kube-system" namespace to be "Ready" ...
	I0722 10:31:46.014434    8575 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0722 10:31:46.014881    8575 kapi.go:86] Found 2 Pods for label selector kubernetes.io/minikube-addons=registry
	I0722 10:31:46.014889    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0722 10:31:46.271575    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0722 10:31:46.304388    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0722 10:31:46.501757    8575 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0722 10:31:46.502853    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0722 10:31:46.746834    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0722 10:31:46.774502    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0722 10:31:46.997451    8575 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0722 10:31:47.001600    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0722 10:31:47.007746    8575 pod_ready.go:92] pod "coredns-7db6d8ff4d-dz9nf" in "kube-system" namespace has status "Ready":"True"
	I0722 10:31:47.007771    8575 pod_ready.go:81] duration metric: took 1.009990192s for pod "coredns-7db6d8ff4d-dz9nf" in "kube-system" namespace to be "Ready" ...
	I0722 10:31:47.007794    8575 pod_ready.go:78] waiting up to 6m0s for pod "etcd-addons-578168" in "kube-system" namespace to be "Ready" ...
	I0722 10:31:47.013889    8575 pod_ready.go:92] pod "etcd-addons-578168" in "kube-system" namespace has status "Ready":"True"
	I0722 10:31:47.013913    8575 pod_ready.go:81] duration metric: took 6.110001ms for pod "etcd-addons-578168" in "kube-system" namespace to be "Ready" ...
	I0722 10:31:47.013929    8575 pod_ready.go:78] waiting up to 6m0s for pod "kube-apiserver-addons-578168" in "kube-system" namespace to be "Ready" ...
	I0722 10:31:47.019201    8575 pod_ready.go:92] pod "kube-apiserver-addons-578168" in "kube-system" namespace has status "Ready":"True"
	I0722 10:31:47.019227    8575 pod_ready.go:81] duration metric: took 5.288747ms for pod "kube-apiserver-addons-578168" in "kube-system" namespace to be "Ready" ...
	I0722 10:31:47.019238    8575 pod_ready.go:78] waiting up to 6m0s for pod "kube-controller-manager-addons-578168" in "kube-system" namespace to be "Ready" ...
	I0722 10:31:47.024623    8575 pod_ready.go:92] pod "kube-controller-manager-addons-578168" in "kube-system" namespace has status "Ready":"True"
	I0722 10:31:47.024647    8575 pod_ready.go:81] duration metric: took 5.401913ms for pod "kube-controller-manager-addons-578168" in "kube-system" namespace to be "Ready" ...
	I0722 10:31:47.024658    8575 pod_ready.go:78] waiting up to 6m0s for pod "kube-proxy-qlrkl" in "kube-system" namespace to be "Ready" ...
	I0722 10:31:47.143020    8575 pod_ready.go:92] pod "kube-proxy-qlrkl" in "kube-system" namespace has status "Ready":"True"
	I0722 10:31:47.143051    8575 pod_ready.go:81] duration metric: took 118.379348ms for pod "kube-proxy-qlrkl" in "kube-system" namespace to be "Ready" ...
	I0722 10:31:47.143063    8575 pod_ready.go:78] waiting up to 6m0s for pod "kube-scheduler-addons-578168" in "kube-system" namespace to be "Ready" ...
	I0722 10:31:47.246627    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0722 10:31:47.274177    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0722 10:31:47.500175    8575 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0722 10:31:47.503355    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0722 10:31:47.542651    8575 pod_ready.go:92] pod "kube-scheduler-addons-578168" in "kube-system" namespace has status "Ready":"True"
	I0722 10:31:47.542714    8575 pod_ready.go:81] duration metric: took 399.642045ms for pod "kube-scheduler-addons-578168" in "kube-system" namespace to be "Ready" ...
	I0722 10:31:47.542742    8575 pod_ready.go:78] waiting up to 6m0s for pod "metrics-server-c59844bb4-qqltc" in "kube-system" namespace to be "Ready" ...
	I0722 10:31:47.748352    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0722 10:31:47.775438    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0722 10:31:47.999415    8575 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0722 10:31:48.011165    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0722 10:31:48.247477    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0722 10:31:48.276051    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0722 10:31:48.499926    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0722 10:31:48.501680    8575 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0722 10:31:48.747614    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0722 10:31:48.775156    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0722 10:31:48.997454    8575 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0722 10:31:49.002108    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0722 10:31:49.248902    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0722 10:31:49.276844    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0722 10:31:49.505240    8575 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0722 10:31:49.507781    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0722 10:31:49.550203    8575 pod_ready.go:102] pod "metrics-server-c59844bb4-qqltc" in "kube-system" namespace has status "Ready":"False"
	I0722 10:31:49.747451    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0722 10:31:49.779613    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0722 10:31:49.999190    8575 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0722 10:31:50.004641    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0722 10:31:50.255351    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0722 10:31:50.276915    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0722 10:31:50.522171    8575 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0722 10:31:50.522853    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0722 10:31:50.747466    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0722 10:31:50.775525    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0722 10:31:51.000475    8575 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0722 10:31:51.006214    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0722 10:31:51.248239    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0722 10:31:51.276797    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0722 10:31:51.509761    8575 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0722 10:31:51.510748    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0722 10:31:51.746933    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0722 10:31:51.780797    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0722 10:31:51.998043    8575 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0722 10:31:52.011460    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0722 10:31:52.056117    8575 pod_ready.go:102] pod "metrics-server-c59844bb4-qqltc" in "kube-system" namespace has status "Ready":"False"
	I0722 10:31:52.246698    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0722 10:31:52.274578    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0722 10:31:52.498509    8575 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0722 10:31:52.504535    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0722 10:31:52.747210    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0722 10:31:52.779117    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0722 10:31:52.998986    8575 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0722 10:31:53.006221    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0722 10:31:53.247170    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0722 10:31:53.278835    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0722 10:31:53.500436    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0722 10:31:53.501747    8575 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0722 10:31:53.747000    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0722 10:31:53.775088    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0722 10:31:53.999071    8575 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0722 10:31:54.003020    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0722 10:31:54.063457    8575 pod_ready.go:102] pod "metrics-server-c59844bb4-qqltc" in "kube-system" namespace has status "Ready":"False"
	I0722 10:31:54.247452    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0722 10:31:54.275185    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0722 10:31:54.501107    8575 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0722 10:31:54.514759    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0722 10:31:54.746955    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0722 10:31:54.774874    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0722 10:31:55.001853    8575 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0722 10:31:55.007342    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0722 10:31:55.247622    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0722 10:31:55.275893    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0722 10:31:55.501893    8575 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0722 10:31:55.513621    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0722 10:31:55.747964    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0722 10:31:55.784470    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0722 10:31:56.000809    8575 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0722 10:31:56.005414    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0722 10:31:56.249438    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0722 10:31:56.276396    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0722 10:31:56.502992    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0722 10:31:56.504357    8575 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0722 10:31:56.550215    8575 pod_ready.go:102] pod "metrics-server-c59844bb4-qqltc" in "kube-system" namespace has status "Ready":"False"
	I0722 10:31:56.748007    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0722 10:31:56.775020    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0722 10:31:57.001206    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0722 10:31:57.002960    8575 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0722 10:31:57.247074    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0722 10:31:57.274330    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0722 10:31:57.501048    8575 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0722 10:31:57.501939    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0722 10:31:57.746548    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0722 10:31:57.774911    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0722 10:31:57.998310    8575 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0722 10:31:58.005364    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0722 10:31:58.247480    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0722 10:31:58.274242    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0722 10:31:58.501612    8575 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0722 10:31:58.502729    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0722 10:31:58.550777    8575 pod_ready.go:102] pod "metrics-server-c59844bb4-qqltc" in "kube-system" namespace has status "Ready":"False"
	I0722 10:31:58.747516    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0722 10:31:58.777684    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0722 10:31:59.002036    8575 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0722 10:31:59.010914    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0722 10:31:59.258863    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0722 10:31:59.278806    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0722 10:31:59.553929    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0722 10:31:59.560474    8575 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0722 10:31:59.747381    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0722 10:31:59.775654    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0722 10:32:00.017304    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0722 10:32:00.018240    8575 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0722 10:32:00.281783    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0722 10:32:00.303238    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0722 10:32:00.505254    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0722 10:32:00.508579    8575 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0722 10:32:00.551421    8575 pod_ready.go:102] pod "metrics-server-c59844bb4-qqltc" in "kube-system" namespace has status "Ready":"False"
	I0722 10:32:00.747304    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0722 10:32:00.776519    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0722 10:32:00.998614    8575 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0722 10:32:01.012606    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0722 10:32:01.247939    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0722 10:32:01.275668    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0722 10:32:01.501391    8575 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0722 10:32:01.505216    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0722 10:32:01.747942    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0722 10:32:01.776014    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0722 10:32:02.000942    8575 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0722 10:32:02.004105    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0722 10:32:02.248466    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0722 10:32:02.281651    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0722 10:32:02.499106    8575 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0722 10:32:02.506700    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0722 10:32:02.554479    8575 pod_ready.go:102] pod "metrics-server-c59844bb4-qqltc" in "kube-system" namespace has status "Ready":"False"
	I0722 10:32:02.747302    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0722 10:32:02.775347    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0722 10:32:02.996962    8575 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0722 10:32:03.002335    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0722 10:32:03.247938    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0722 10:32:03.276592    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0722 10:32:03.498349    8575 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0722 10:32:03.501038    8575 kapi.go:107] duration metric: took 27.005816301s to wait for kubernetes.io/minikube-addons=registry ...
	I0722 10:32:03.747187    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0722 10:32:03.774908    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0722 10:32:03.997914    8575 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0722 10:32:04.246918    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0722 10:32:04.276661    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0722 10:32:04.498801    8575 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0722 10:32:04.750685    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0722 10:32:04.775902    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0722 10:32:05.002066    8575 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0722 10:32:05.049526    8575 pod_ready.go:102] pod "metrics-server-c59844bb4-qqltc" in "kube-system" namespace has status "Ready":"False"
	I0722 10:32:05.246976    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0722 10:32:05.274265    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0722 10:32:05.497173    8575 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0722 10:32:05.747069    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0722 10:32:05.775609    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0722 10:32:06.000967    8575 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0722 10:32:06.246462    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0722 10:32:06.276203    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0722 10:32:06.497104    8575 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0722 10:32:06.746481    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0722 10:32:06.774909    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0722 10:32:06.997369    8575 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0722 10:32:07.050077    8575 pod_ready.go:102] pod "metrics-server-c59844bb4-qqltc" in "kube-system" namespace has status "Ready":"False"
	I0722 10:32:07.248858    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0722 10:32:07.276777    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0722 10:32:07.497111    8575 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0722 10:32:07.748555    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0722 10:32:07.783379    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0722 10:32:08.000601    8575 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0722 10:32:08.247745    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0722 10:32:08.275285    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0722 10:32:08.498961    8575 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0722 10:32:08.752122    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0722 10:32:08.775439    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0722 10:32:08.998675    8575 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0722 10:32:09.051428    8575 pod_ready.go:102] pod "metrics-server-c59844bb4-qqltc" in "kube-system" namespace has status "Ready":"False"
	I0722 10:32:09.247391    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0722 10:32:09.289425    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0722 10:32:09.498014    8575 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0722 10:32:09.747772    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0722 10:32:09.776732    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0722 10:32:10.009741    8575 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0722 10:32:10.248191    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0722 10:32:10.279455    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0722 10:32:10.498308    8575 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0722 10:32:10.747522    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0722 10:32:10.776265    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0722 10:32:10.998014    8575 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0722 10:32:11.246568    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0722 10:32:11.276218    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0722 10:32:11.498838    8575 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0722 10:32:11.550048    8575 pod_ready.go:102] pod "metrics-server-c59844bb4-qqltc" in "kube-system" namespace has status "Ready":"False"
	I0722 10:32:11.747152    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0722 10:32:11.776727    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0722 10:32:11.998183    8575 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0722 10:32:12.246697    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0722 10:32:12.278024    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0722 10:32:12.511860    8575 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0722 10:32:12.747216    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0722 10:32:12.775367    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0722 10:32:12.997453    8575 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0722 10:32:13.247111    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0722 10:32:13.274897    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0722 10:32:13.497263    8575 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0722 10:32:13.747069    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0722 10:32:13.775186    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0722 10:32:13.997619    8575 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0722 10:32:14.049781    8575 pod_ready.go:102] pod "metrics-server-c59844bb4-qqltc" in "kube-system" namespace has status "Ready":"False"
	I0722 10:32:14.247055    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0722 10:32:14.275478    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0722 10:32:14.498000    8575 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0722 10:32:14.747932    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0722 10:32:14.776253    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0722 10:32:14.999686    8575 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0722 10:32:15.248551    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0722 10:32:15.274094    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0722 10:32:15.500018    8575 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0722 10:32:15.747184    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0722 10:32:15.774361    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0722 10:32:15.998263    8575 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0722 10:32:16.246916    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0722 10:32:16.275320    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0722 10:32:16.498130    8575 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0722 10:32:16.552366    8575 pod_ready.go:102] pod "metrics-server-c59844bb4-qqltc" in "kube-system" namespace has status "Ready":"False"
	I0722 10:32:16.746930    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0722 10:32:16.776639    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0722 10:32:16.998582    8575 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0722 10:32:17.249840    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0722 10:32:17.276469    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0722 10:32:17.497837    8575 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0722 10:32:17.747018    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0722 10:32:17.774795    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0722 10:32:17.998208    8575 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0722 10:32:18.247411    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0722 10:32:18.274942    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0722 10:32:18.499135    8575 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0722 10:32:18.747186    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0722 10:32:18.774921    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0722 10:32:18.997389    8575 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0722 10:32:19.050016    8575 pod_ready.go:102] pod "metrics-server-c59844bb4-qqltc" in "kube-system" namespace has status "Ready":"False"
	I0722 10:32:19.246959    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0722 10:32:19.275281    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0722 10:32:19.498317    8575 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0722 10:32:19.747135    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0722 10:32:19.775676    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0722 10:32:20.009488    8575 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0722 10:32:20.246888    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0722 10:32:20.283466    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0722 10:32:20.497468    8575 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0722 10:32:20.747136    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0722 10:32:20.774184    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0722 10:32:20.997906    8575 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0722 10:32:21.051613    8575 pod_ready.go:102] pod "metrics-server-c59844bb4-qqltc" in "kube-system" namespace has status "Ready":"False"
	I0722 10:32:21.247521    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0722 10:32:21.275535    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0722 10:32:21.498539    8575 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0722 10:32:21.747151    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0722 10:32:21.774720    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0722 10:32:21.997410    8575 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0722 10:32:22.247215    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0722 10:32:22.274911    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0722 10:32:22.497215    8575 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0722 10:32:22.746447    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0722 10:32:22.774994    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0722 10:32:23.000114    8575 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0722 10:32:23.247117    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0722 10:32:23.275336    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0722 10:32:23.501980    8575 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0722 10:32:23.549320    8575 pod_ready.go:102] pod "metrics-server-c59844bb4-qqltc" in "kube-system" namespace has status "Ready":"False"
	I0722 10:32:23.746525    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0722 10:32:23.778143    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0722 10:32:24.000441    8575 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0722 10:32:24.251579    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0722 10:32:24.275502    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0722 10:32:24.497557    8575 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0722 10:32:24.746685    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0722 10:32:24.774868    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0722 10:32:24.997480    8575 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0722 10:32:25.246386    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0722 10:32:25.275090    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0722 10:32:25.498114    8575 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0722 10:32:25.747993    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0722 10:32:25.774186    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0722 10:32:25.999160    8575 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0722 10:32:26.049917    8575 pod_ready.go:102] pod "metrics-server-c59844bb4-qqltc" in "kube-system" namespace has status "Ready":"False"
	I0722 10:32:26.249087    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0722 10:32:26.276475    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0722 10:32:26.517653    8575 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0722 10:32:26.747003    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0722 10:32:26.775984    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0722 10:32:26.999769    8575 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0722 10:32:27.248815    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0722 10:32:27.277088    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0722 10:32:27.498147    8575 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0722 10:32:27.752095    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0722 10:32:27.777729    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0722 10:32:28.001110    8575 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0722 10:32:28.050947    8575 pod_ready.go:102] pod "metrics-server-c59844bb4-qqltc" in "kube-system" namespace has status "Ready":"False"
	I0722 10:32:28.246705    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0722 10:32:28.275154    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0722 10:32:28.496836    8575 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0722 10:32:28.747248    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0722 10:32:28.775296    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0722 10:32:29.002336    8575 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0722 10:32:29.247881    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0722 10:32:29.277572    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0722 10:32:29.498584    8575 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0722 10:32:29.748461    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0722 10:32:29.775380    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0722 10:32:29.998518    8575 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0722 10:32:30.051440    8575 pod_ready.go:102] pod "metrics-server-c59844bb4-qqltc" in "kube-system" namespace has status "Ready":"False"
	I0722 10:32:30.247502    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0722 10:32:30.276231    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0722 10:32:30.504307    8575 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0722 10:32:30.747285    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0722 10:32:30.775272    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0722 10:32:30.998538    8575 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0722 10:32:31.247142    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0722 10:32:31.280221    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0722 10:32:31.498490    8575 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0722 10:32:31.747651    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0722 10:32:31.775498    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0722 10:32:31.998516    8575 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0722 10:32:32.053763    8575 pod_ready.go:102] pod "metrics-server-c59844bb4-qqltc" in "kube-system" namespace has status "Ready":"False"
	I0722 10:32:32.246795    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0722 10:32:32.274882    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0722 10:32:32.497107    8575 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0722 10:32:32.749077    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0722 10:32:32.774638    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0722 10:32:32.998069    8575 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0722 10:32:33.248928    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0722 10:32:33.279221    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0722 10:32:33.498220    8575 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0722 10:32:33.751394    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0722 10:32:33.788974    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0722 10:32:33.999745    8575 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0722 10:32:34.247084    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0722 10:32:34.276118    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0722 10:32:34.505298    8575 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0722 10:32:34.552818    8575 pod_ready.go:102] pod "metrics-server-c59844bb4-qqltc" in "kube-system" namespace has status "Ready":"False"
	I0722 10:32:34.747035    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0722 10:32:34.776179    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0722 10:32:34.999562    8575 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0722 10:32:35.247030    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0722 10:32:35.274604    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0722 10:32:35.505141    8575 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0722 10:32:35.751048    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0722 10:32:35.774849    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0722 10:32:35.999075    8575 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0722 10:32:36.247267    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0722 10:32:36.274670    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0722 10:32:36.501029    8575 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0722 10:32:36.747147    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0722 10:32:36.774863    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0722 10:32:36.997531    8575 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0722 10:32:37.049683    8575 pod_ready.go:102] pod "metrics-server-c59844bb4-qqltc" in "kube-system" namespace has status "Ready":"False"
	I0722 10:32:37.247470    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0722 10:32:37.275202    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0722 10:32:37.502136    8575 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0722 10:32:37.747066    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0722 10:32:37.774891    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0722 10:32:37.997036    8575 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0722 10:32:38.248138    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0722 10:32:38.279063    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0722 10:32:38.498613    8575 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0722 10:32:38.746579    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0722 10:32:38.775412    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0722 10:32:38.999350    8575 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0722 10:32:39.057332    8575 pod_ready.go:102] pod "metrics-server-c59844bb4-qqltc" in "kube-system" namespace has status "Ready":"False"
	I0722 10:32:39.246860    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0722 10:32:39.274927    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0722 10:32:39.499028    8575 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0722 10:32:39.747073    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0722 10:32:39.777578    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0722 10:32:40.010222    8575 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0722 10:32:40.246737    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0722 10:32:40.277042    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0722 10:32:40.498505    8575 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0722 10:32:40.746871    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0722 10:32:40.774996    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0722 10:32:40.997211    8575 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0722 10:32:41.246897    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0722 10:32:41.275728    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0722 10:32:41.497809    8575 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0722 10:32:41.549269    8575 pod_ready.go:102] pod "metrics-server-c59844bb4-qqltc" in "kube-system" namespace has status "Ready":"False"
	I0722 10:32:41.747775    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0722 10:32:41.776162    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0722 10:32:41.997887    8575 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0722 10:32:42.247744    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0722 10:32:42.276383    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0722 10:32:42.498350    8575 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0722 10:32:42.752648    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0722 10:32:42.777083    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0722 10:32:42.998011    8575 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0722 10:32:43.246753    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0722 10:32:43.275416    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0722 10:32:43.497563    8575 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0722 10:32:43.746872    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0722 10:32:43.775414    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0722 10:32:43.998224    8575 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0722 10:32:44.054057    8575 pod_ready.go:102] pod "metrics-server-c59844bb4-qqltc" in "kube-system" namespace has status "Ready":"False"
	I0722 10:32:44.250967    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0722 10:32:44.275497    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0722 10:32:44.497961    8575 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0722 10:32:44.748921    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0722 10:32:44.775890    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0722 10:32:44.998555    8575 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0722 10:32:45.247380    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0722 10:32:45.275496    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0722 10:32:45.497712    8575 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0722 10:32:45.747272    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0722 10:32:45.775099    8575 kapi.go:107] duration metric: took 1m8.506039227s to wait for kubernetes.io/minikube-addons=csi-hostpath-driver ...
	I0722 10:32:46.000493    8575 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0722 10:32:46.247322    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0722 10:32:46.497356    8575 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0722 10:32:46.549606    8575 pod_ready.go:102] pod "metrics-server-c59844bb4-qqltc" in "kube-system" namespace has status "Ready":"False"
	I0722 10:32:46.746739    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0722 10:32:46.997204    8575 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0722 10:32:47.247093    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0722 10:32:47.497259    8575 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0722 10:32:47.746968    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0722 10:32:47.998248    8575 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0722 10:32:48.247288    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0722 10:32:48.497575    8575 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0722 10:32:48.549692    8575 pod_ready.go:102] pod "metrics-server-c59844bb4-qqltc" in "kube-system" namespace has status "Ready":"False"
	I0722 10:32:48.746588    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0722 10:32:48.998718    8575 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0722 10:32:49.246510    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0722 10:32:49.497914    8575 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0722 10:32:49.746718    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0722 10:32:50.019516    8575 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0722 10:32:50.246769    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0722 10:32:50.498122    8575 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0722 10:32:50.748985    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0722 10:32:50.997485    8575 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0722 10:32:51.051160    8575 pod_ready.go:102] pod "metrics-server-c59844bb4-qqltc" in "kube-system" namespace has status "Ready":"False"
	I0722 10:32:51.247261    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0722 10:32:51.497972    8575 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0722 10:32:51.747134    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0722 10:32:51.999009    8575 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0722 10:32:52.246956    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0722 10:32:52.498520    8575 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0722 10:32:52.748798    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0722 10:32:52.998978    8575 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0722 10:32:53.247503    8575 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0722 10:32:53.498294    8575 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0722 10:32:53.549534    8575 pod_ready.go:102] pod "metrics-server-c59844bb4-qqltc" in "kube-system" namespace has status "Ready":"False"
	I0722 10:32:53.747319    8575 kapi.go:107] duration metric: took 1m13.004303917s to wait for kubernetes.io/minikube-addons=gcp-auth ...
	I0722 10:32:53.749869    8575 out.go:177] * Your GCP credentials will now be mounted into every pod created in the addons-578168 cluster.
	I0722 10:32:53.751869    8575 out.go:177] * If you don't want your credentials mounted into a specific pod, add a label with the `gcp-auth-skip-secret` key to your pod configuration.
	I0722 10:32:53.753633    8575 out.go:177] * If you want existing pods to be mounted with credentials, either recreate them or rerun addons enable with --refresh.
	I0722 10:32:53.997603    8575 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0722 10:32:54.497549    8575 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0722 10:32:55.004722    8575 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0722 10:32:55.496987    8575 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0722 10:32:56.046433    8575 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0722 10:32:56.076923    8575 pod_ready.go:92] pod "metrics-server-c59844bb4-qqltc" in "kube-system" namespace has status "Ready":"True"
	I0722 10:32:56.076946    8575 pod_ready.go:81] duration metric: took 1m8.53418299s for pod "metrics-server-c59844bb4-qqltc" in "kube-system" namespace to be "Ready" ...
	I0722 10:32:56.076957    8575 pod_ready.go:78] waiting up to 6m0s for pod "nvidia-device-plugin-daemonset-l6frr" in "kube-system" namespace to be "Ready" ...
	I0722 10:32:56.100975    8575 pod_ready.go:92] pod "nvidia-device-plugin-daemonset-l6frr" in "kube-system" namespace has status "Ready":"True"
	I0722 10:32:56.101004    8575 pod_ready.go:81] duration metric: took 24.037928ms for pod "nvidia-device-plugin-daemonset-l6frr" in "kube-system" namespace to be "Ready" ...
	I0722 10:32:56.101025    8575 pod_ready.go:38] duration metric: took 1m10.119881415s for extra waiting for all system-critical and pods with labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
	I0722 10:32:56.101045    8575 api_server.go:52] waiting for apiserver process to appear ...
	I0722 10:32:56.101764    8575 cri.go:54] listing CRI containers in root : {State:all Name:kube-apiserver Namespaces:[]}
	I0722 10:32:56.101841    8575 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
	I0722 10:32:56.311159    8575 cri.go:89] found id: "3eaa36f65893e9ea154ad290476a76999e7fce5187e40f9b7dbac9b55955d25c"
	I0722 10:32:56.311182    8575 cri.go:89] found id: ""
	I0722 10:32:56.311191    8575 logs.go:276] 1 containers: [3eaa36f65893e9ea154ad290476a76999e7fce5187e40f9b7dbac9b55955d25c]
	I0722 10:32:56.311246    8575 ssh_runner.go:195] Run: which crictl
	I0722 10:32:56.327927    8575 cri.go:54] listing CRI containers in root : {State:all Name:etcd Namespaces:[]}
	I0722 10:32:56.327994    8575 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
	I0722 10:32:56.497988    8575 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0722 10:32:56.548042    8575 cri.go:89] found id: "7fd0f1e313e4efe8d94ceaf40a5d5c3f6bafcee15f4d9ae8fbd6a57bb89e2d32"
	I0722 10:32:56.548066    8575 cri.go:89] found id: ""
	I0722 10:32:56.548074    8575 logs.go:276] 1 containers: [7fd0f1e313e4efe8d94ceaf40a5d5c3f6bafcee15f4d9ae8fbd6a57bb89e2d32]
	I0722 10:32:56.548129    8575 ssh_runner.go:195] Run: which crictl
	I0722 10:32:56.551757    8575 cri.go:54] listing CRI containers in root : {State:all Name:coredns Namespaces:[]}
	I0722 10:32:56.551829    8575 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
	I0722 10:32:56.615021    8575 cri.go:89] found id: "fd14ed2fa3138ce3db1337fd1c8961db47db39d56a8f8f978e98aa5cb8f0e2a4"
	I0722 10:32:56.615044    8575 cri.go:89] found id: ""
	I0722 10:32:56.615052    8575 logs.go:276] 1 containers: [fd14ed2fa3138ce3db1337fd1c8961db47db39d56a8f8f978e98aa5cb8f0e2a4]
	I0722 10:32:56.615112    8575 ssh_runner.go:195] Run: which crictl
	I0722 10:32:56.623920    8575 cri.go:54] listing CRI containers in root : {State:all Name:kube-scheduler Namespaces:[]}
	I0722 10:32:56.623988    8575 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
	I0722 10:32:56.718854    8575 cri.go:89] found id: "be869384de7f9f26c6638b2090ca4d4ae3c4463e38549fcc1f474aa8077b8359"
	I0722 10:32:56.718876    8575 cri.go:89] found id: ""
	I0722 10:32:56.718884    8575 logs.go:276] 1 containers: [be869384de7f9f26c6638b2090ca4d4ae3c4463e38549fcc1f474aa8077b8359]
	I0722 10:32:56.718940    8575 ssh_runner.go:195] Run: which crictl
	I0722 10:32:56.724780    8575 cri.go:54] listing CRI containers in root : {State:all Name:kube-proxy Namespaces:[]}
	I0722 10:32:56.724852    8575 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
	I0722 10:32:56.797716    8575 cri.go:89] found id: "b89d03fa7e9ed0ffa3d2a61fb546963c18198c7a24c7257d93f144d4122fe61e"
	I0722 10:32:56.797739    8575 cri.go:89] found id: ""
	I0722 10:32:56.797747    8575 logs.go:276] 1 containers: [b89d03fa7e9ed0ffa3d2a61fb546963c18198c7a24c7257d93f144d4122fe61e]
	I0722 10:32:56.797806    8575 ssh_runner.go:195] Run: which crictl
	I0722 10:32:56.801828    8575 cri.go:54] listing CRI containers in root : {State:all Name:kube-controller-manager Namespaces:[]}
	I0722 10:32:56.801898    8575 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
	I0722 10:32:56.868558    8575 cri.go:89] found id: "d064c7ca8b93e4b380a00ab859233190e1fc369f5e15ecf5dfd9b54dbc650897"
	I0722 10:32:56.868582    8575 cri.go:89] found id: ""
	I0722 10:32:56.868590    8575 logs.go:276] 1 containers: [d064c7ca8b93e4b380a00ab859233190e1fc369f5e15ecf5dfd9b54dbc650897]
	I0722 10:32:56.868644    8575 ssh_runner.go:195] Run: which crictl
	I0722 10:32:56.872608    8575 cri.go:54] listing CRI containers in root : {State:all Name:kindnet Namespaces:[]}
	I0722 10:32:56.872676    8575 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet
	I0722 10:32:56.930150    8575 cri.go:89] found id: "872f619c51c416886aba341acb0c461d4f4aa14c0eb3a9141099b7525e942d7f"
	I0722 10:32:56.930220    8575 cri.go:89] found id: ""
	I0722 10:32:56.930241    8575 logs.go:276] 1 containers: [872f619c51c416886aba341acb0c461d4f4aa14c0eb3a9141099b7525e942d7f]
	I0722 10:32:56.930343    8575 ssh_runner.go:195] Run: which crictl
	I0722 10:32:56.935020    8575 logs.go:123] Gathering logs for dmesg ...
	I0722 10:32:56.935100    8575 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
	I0722 10:32:56.949341    8575 logs.go:123] Gathering logs for kube-proxy [b89d03fa7e9ed0ffa3d2a61fb546963c18198c7a24c7257d93f144d4122fe61e] ...
	I0722 10:32:56.949424    8575 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 b89d03fa7e9ed0ffa3d2a61fb546963c18198c7a24c7257d93f144d4122fe61e"
	I0722 10:32:57.002891    8575 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0722 10:32:57.072094    8575 logs.go:123] Gathering logs for kindnet [872f619c51c416886aba341acb0c461d4f4aa14c0eb3a9141099b7525e942d7f] ...
	I0722 10:32:57.072206    8575 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 872f619c51c416886aba341acb0c461d4f4aa14c0eb3a9141099b7525e942d7f"
	I0722 10:32:57.157642    8575 logs.go:123] Gathering logs for container status ...
	I0722 10:32:57.157674    8575 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
	I0722 10:32:57.251727    8575 logs.go:123] Gathering logs for coredns [fd14ed2fa3138ce3db1337fd1c8961db47db39d56a8f8f978e98aa5cb8f0e2a4] ...
	I0722 10:32:57.251761    8575 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 fd14ed2fa3138ce3db1337fd1c8961db47db39d56a8f8f978e98aa5cb8f0e2a4"
	I0722 10:32:57.313233    8575 logs.go:123] Gathering logs for kube-scheduler [be869384de7f9f26c6638b2090ca4d4ae3c4463e38549fcc1f474aa8077b8359] ...
	I0722 10:32:57.313261    8575 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 be869384de7f9f26c6638b2090ca4d4ae3c4463e38549fcc1f474aa8077b8359"
	I0722 10:32:57.388212    8575 logs.go:123] Gathering logs for kube-controller-manager [d064c7ca8b93e4b380a00ab859233190e1fc369f5e15ecf5dfd9b54dbc650897] ...
	I0722 10:32:57.388245    8575 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 d064c7ca8b93e4b380a00ab859233190e1fc369f5e15ecf5dfd9b54dbc650897"
	I0722 10:32:57.488974    8575 logs.go:123] Gathering logs for CRI-O ...
	I0722 10:32:57.489011    8575 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u crio -n 400"
	I0722 10:32:57.498751    8575 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0722 10:32:57.590704    8575 logs.go:123] Gathering logs for kubelet ...
	I0722 10:32:57.590797    8575 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
	W0722 10:32:57.699602    8575 logs.go:138] Found kubelet problem: Jul 22 10:31:45 addons-578168 kubelet[1541]: W0722 10:31:45.633933    1541 reflector.go:547] object-"default"/"kube-root-ca.crt": failed to list *v1.ConfigMap: configmaps "kube-root-ca.crt" is forbidden: User "system:node:addons-578168" cannot list resource "configmaps" in API group "" in the namespace "default": no relationship found between node 'addons-578168' and this object
	W0722 10:32:57.699799    8575 logs.go:138] Found kubelet problem: Jul 22 10:31:45 addons-578168 kubelet[1541]: W0722 10:31:45.633933    1541 reflector.go:547] object-"default"/"gcp-auth": failed to list *v1.Secret: secrets "gcp-auth" is forbidden: User "system:node:addons-578168" cannot list resource "secrets" in API group "" in the namespace "default": no relationship found between node 'addons-578168' and this object
	W0722 10:32:57.700045    8575 logs.go:138] Found kubelet problem: Jul 22 10:31:45 addons-578168 kubelet[1541]: E0722 10:31:45.634227    1541 reflector.go:150] object-"default"/"kube-root-ca.crt": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "kube-root-ca.crt" is forbidden: User "system:node:addons-578168" cannot list resource "configmaps" in API group "" in the namespace "default": no relationship found between node 'addons-578168' and this object
	W0722 10:32:57.700285    8575 logs.go:138] Found kubelet problem: Jul 22 10:31:45 addons-578168 kubelet[1541]: E0722 10:31:45.634236    1541 reflector.go:150] object-"default"/"gcp-auth": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "gcp-auth" is forbidden: User "system:node:addons-578168" cannot list resource "secrets" in API group "" in the namespace "default": no relationship found between node 'addons-578168' and this object
	W0722 10:32:57.702446    8575 logs.go:138] Found kubelet problem: Jul 22 10:31:45 addons-578168 kubelet[1541]: W0722 10:31:45.657618    1541 reflector.go:547] object-"ingress-nginx"/"ingress-nginx-admission": failed to list *v1.Secret: secrets "ingress-nginx-admission" is forbidden: User "system:node:addons-578168" cannot list resource "secrets" in API group "" in the namespace "ingress-nginx": no relationship found between node 'addons-578168' and this object
	W0722 10:32:57.702665    8575 logs.go:138] Found kubelet problem: Jul 22 10:31:45 addons-578168 kubelet[1541]: E0722 10:31:45.657656    1541 reflector.go:150] object-"ingress-nginx"/"ingress-nginx-admission": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "ingress-nginx-admission" is forbidden: User "system:node:addons-578168" cannot list resource "secrets" in API group "" in the namespace "ingress-nginx": no relationship found between node 'addons-578168' and this object
	W0722 10:32:57.703305    8575 logs.go:138] Found kubelet problem: Jul 22 10:31:45 addons-578168 kubelet[1541]: W0722 10:31:45.663542    1541 reflector.go:547] object-"yakd-dashboard"/"kube-root-ca.crt": failed to list *v1.ConfigMap: configmaps "kube-root-ca.crt" is forbidden: User "system:node:addons-578168" cannot list resource "configmaps" in API group "" in the namespace "yakd-dashboard": no relationship found between node 'addons-578168' and this object
	W0722 10:32:57.703523    8575 logs.go:138] Found kubelet problem: Jul 22 10:31:45 addons-578168 kubelet[1541]: E0722 10:31:45.663578    1541 reflector.go:150] object-"yakd-dashboard"/"kube-root-ca.crt": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "kube-root-ca.crt" is forbidden: User "system:node:addons-578168" cannot list resource "configmaps" in API group "" in the namespace "yakd-dashboard": no relationship found between node 'addons-578168' and this object
	W0722 10:32:57.703710    8575 logs.go:138] Found kubelet problem: Jul 22 10:31:45 addons-578168 kubelet[1541]: W0722 10:31:45.663834    1541 reflector.go:547] object-"ingress-nginx"/"kube-root-ca.crt": failed to list *v1.ConfigMap: configmaps "kube-root-ca.crt" is forbidden: User "system:node:addons-578168" cannot list resource "configmaps" in API group "" in the namespace "ingress-nginx": no relationship found between node 'addons-578168' and this object
	W0722 10:32:57.703919    8575 logs.go:138] Found kubelet problem: Jul 22 10:31:45 addons-578168 kubelet[1541]: E0722 10:31:45.663859    1541 reflector.go:150] object-"ingress-nginx"/"kube-root-ca.crt": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "kube-root-ca.crt" is forbidden: User "system:node:addons-578168" cannot list resource "configmaps" in API group "" in the namespace "ingress-nginx": no relationship found between node 'addons-578168' and this object
	W0722 10:32:57.704109    8575 logs.go:138] Found kubelet problem: Jul 22 10:31:45 addons-578168 kubelet[1541]: W0722 10:31:45.667585    1541 reflector.go:547] object-"local-path-storage"/"kube-root-ca.crt": failed to list *v1.ConfigMap: configmaps "kube-root-ca.crt" is forbidden: User "system:node:addons-578168" cannot list resource "configmaps" in API group "" in the namespace "local-path-storage": no relationship found between node 'addons-578168' and this object
	W0722 10:32:57.704320    8575 logs.go:138] Found kubelet problem: Jul 22 10:31:45 addons-578168 kubelet[1541]: E0722 10:31:45.667627    1541 reflector.go:150] object-"local-path-storage"/"kube-root-ca.crt": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "kube-root-ca.crt" is forbidden: User "system:node:addons-578168" cannot list resource "configmaps" in API group "" in the namespace "local-path-storage": no relationship found between node 'addons-578168' and this object
	W0722 10:32:57.704505    8575 logs.go:138] Found kubelet problem: Jul 22 10:31:45 addons-578168 kubelet[1541]: W0722 10:31:45.668640    1541 reflector.go:547] object-"gcp-auth"/"kube-root-ca.crt": failed to list *v1.ConfigMap: configmaps "kube-root-ca.crt" is forbidden: User "system:node:addons-578168" cannot list resource "configmaps" in API group "" in the namespace "gcp-auth": no relationship found between node 'addons-578168' and this object
	W0722 10:32:57.704707    8575 logs.go:138] Found kubelet problem: Jul 22 10:31:45 addons-578168 kubelet[1541]: E0722 10:31:45.668674    1541 reflector.go:150] object-"gcp-auth"/"kube-root-ca.crt": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "kube-root-ca.crt" is forbidden: User "system:node:addons-578168" cannot list resource "configmaps" in API group "" in the namespace "gcp-auth": no relationship found between node 'addons-578168' and this object
	W0722 10:32:57.704895    8575 logs.go:138] Found kubelet problem: Jul 22 10:31:45 addons-578168 kubelet[1541]: W0722 10:31:45.668822    1541 reflector.go:547] object-"gcp-auth"/"gcp-auth-certs": failed to list *v1.Secret: secrets "gcp-auth-certs" is forbidden: User "system:node:addons-578168" cannot list resource "secrets" in API group "" in the namespace "gcp-auth": no relationship found between node 'addons-578168' and this object
	W0722 10:32:57.705089    8575 logs.go:138] Found kubelet problem: Jul 22 10:31:45 addons-578168 kubelet[1541]: E0722 10:31:45.668852    1541 reflector.go:150] object-"gcp-auth"/"gcp-auth-certs": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "gcp-auth-certs" is forbidden: User "system:node:addons-578168" cannot list resource "secrets" in API group "" in the namespace "gcp-auth": no relationship found between node 'addons-578168' and this object
	I0722 10:32:57.743645    8575 logs.go:123] Gathering logs for describe nodes ...
	I0722 10:32:57.748953    8575 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.30.3/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
	I0722 10:32:57.966790    8575 logs.go:123] Gathering logs for kube-apiserver [3eaa36f65893e9ea154ad290476a76999e7fce5187e40f9b7dbac9b55955d25c] ...
	I0722 10:32:57.966898    8575 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 3eaa36f65893e9ea154ad290476a76999e7fce5187e40f9b7dbac9b55955d25c"
	I0722 10:32:57.997585    8575 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0722 10:32:58.093647    8575 logs.go:123] Gathering logs for etcd [7fd0f1e313e4efe8d94ceaf40a5d5c3f6bafcee15f4d9ae8fbd6a57bb89e2d32] ...
	I0722 10:32:58.093721    8575 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 7fd0f1e313e4efe8d94ceaf40a5d5c3f6bafcee15f4d9ae8fbd6a57bb89e2d32"
	I0722 10:32:58.162885    8575 out.go:304] Setting ErrFile to fd 2...
	I0722 10:32:58.162915    8575 out.go:338] TERM=,COLORTERM=, which probably does not support color
	W0722 10:32:58.162979    8575 out.go:239] X Problems detected in kubelet:
	W0722 10:32:58.162993    8575 out.go:239]   Jul 22 10:31:45 addons-578168 kubelet[1541]: E0722 10:31:45.667627    1541 reflector.go:150] object-"local-path-storage"/"kube-root-ca.crt": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "kube-root-ca.crt" is forbidden: User "system:node:addons-578168" cannot list resource "configmaps" in API group "" in the namespace "local-path-storage": no relationship found between node 'addons-578168' and this object
	W0722 10:32:58.163000    8575 out.go:239]   Jul 22 10:31:45 addons-578168 kubelet[1541]: W0722 10:31:45.668640    1541 reflector.go:547] object-"gcp-auth"/"kube-root-ca.crt": failed to list *v1.ConfigMap: configmaps "kube-root-ca.crt" is forbidden: User "system:node:addons-578168" cannot list resource "configmaps" in API group "" in the namespace "gcp-auth": no relationship found between node 'addons-578168' and this object
	W0722 10:32:58.163016    8575 out.go:239]   Jul 22 10:31:45 addons-578168 kubelet[1541]: E0722 10:31:45.668674    1541 reflector.go:150] object-"gcp-auth"/"kube-root-ca.crt": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "kube-root-ca.crt" is forbidden: User "system:node:addons-578168" cannot list resource "configmaps" in API group "" in the namespace "gcp-auth": no relationship found between node 'addons-578168' and this object
	W0722 10:32:58.163145    8575 out.go:239]   Jul 22 10:31:45 addons-578168 kubelet[1541]: W0722 10:31:45.668822    1541 reflector.go:547] object-"gcp-auth"/"gcp-auth-certs": failed to list *v1.Secret: secrets "gcp-auth-certs" is forbidden: User "system:node:addons-578168" cannot list resource "secrets" in API group "" in the namespace "gcp-auth": no relationship found between node 'addons-578168' and this object
	W0722 10:32:58.163160    8575 out.go:239]   Jul 22 10:31:45 addons-578168 kubelet[1541]: E0722 10:31:45.668852    1541 reflector.go:150] object-"gcp-auth"/"gcp-auth-certs": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "gcp-auth-certs" is forbidden: User "system:node:addons-578168" cannot list resource "secrets" in API group "" in the namespace "gcp-auth": no relationship found between node 'addons-578168' and this object
	I0722 10:32:58.163167    8575 out.go:304] Setting ErrFile to fd 2...
	I0722 10:32:58.163177    8575 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0722 10:32:58.497117    8575 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0722 10:32:59.000198    8575 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0722 10:32:59.498179    8575 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0722 10:33:00.009846    8575 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0722 10:33:00.498937    8575 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0722 10:33:00.998806    8575 kapi.go:107] duration metric: took 1m24.505886714s to wait for app.kubernetes.io/name=ingress-nginx ...
	I0722 10:33:01.002561    8575 out.go:177] * Enabled addons: cloud-spanner, nvidia-device-plugin, default-storageclass, ingress-dns, storage-provisioner, metrics-server, storage-provisioner-rancher, inspektor-gadget, yakd, volumesnapshots, registry, csi-hostpath-driver, gcp-auth, ingress
	I0722 10:33:01.004503    8575 addons.go:510] duration metric: took 1m31.137436164s for enable addons: enabled=[cloud-spanner nvidia-device-plugin default-storageclass ingress-dns storage-provisioner metrics-server storage-provisioner-rancher inspektor-gadget yakd volumesnapshots registry csi-hostpath-driver gcp-auth ingress]
	I0722 10:33:08.164528    8575 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0722 10:33:08.178405    8575 api_server.go:72] duration metric: took 1m38.311689002s to wait for apiserver process to appear ...
	I0722 10:33:08.178430    8575 api_server.go:88] waiting for apiserver healthz status ...
	I0722 10:33:08.178464    8575 cri.go:54] listing CRI containers in root : {State:all Name:kube-apiserver Namespaces:[]}
	I0722 10:33:08.178520    8575 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
	I0722 10:33:08.220549    8575 cri.go:89] found id: "3eaa36f65893e9ea154ad290476a76999e7fce5187e40f9b7dbac9b55955d25c"
	I0722 10:33:08.220571    8575 cri.go:89] found id: ""
	I0722 10:33:08.220579    8575 logs.go:276] 1 containers: [3eaa36f65893e9ea154ad290476a76999e7fce5187e40f9b7dbac9b55955d25c]
	I0722 10:33:08.220632    8575 ssh_runner.go:195] Run: which crictl
	I0722 10:33:08.224896    8575 cri.go:54] listing CRI containers in root : {State:all Name:etcd Namespaces:[]}
	I0722 10:33:08.224976    8575 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
	I0722 10:33:08.263502    8575 cri.go:89] found id: "7fd0f1e313e4efe8d94ceaf40a5d5c3f6bafcee15f4d9ae8fbd6a57bb89e2d32"
	I0722 10:33:08.263525    8575 cri.go:89] found id: ""
	I0722 10:33:08.263533    8575 logs.go:276] 1 containers: [7fd0f1e313e4efe8d94ceaf40a5d5c3f6bafcee15f4d9ae8fbd6a57bb89e2d32]
	I0722 10:33:08.263589    8575 ssh_runner.go:195] Run: which crictl
	I0722 10:33:08.267318    8575 cri.go:54] listing CRI containers in root : {State:all Name:coredns Namespaces:[]}
	I0722 10:33:08.267398    8575 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
	I0722 10:33:08.309611    8575 cri.go:89] found id: "fd14ed2fa3138ce3db1337fd1c8961db47db39d56a8f8f978e98aa5cb8f0e2a4"
	I0722 10:33:08.309632    8575 cri.go:89] found id: ""
	I0722 10:33:08.309647    8575 logs.go:276] 1 containers: [fd14ed2fa3138ce3db1337fd1c8961db47db39d56a8f8f978e98aa5cb8f0e2a4]
	I0722 10:33:08.309705    8575 ssh_runner.go:195] Run: which crictl
	I0722 10:33:08.313407    8575 cri.go:54] listing CRI containers in root : {State:all Name:kube-scheduler Namespaces:[]}
	I0722 10:33:08.313483    8575 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
	I0722 10:33:08.353390    8575 cri.go:89] found id: "be869384de7f9f26c6638b2090ca4d4ae3c4463e38549fcc1f474aa8077b8359"
	I0722 10:33:08.353412    8575 cri.go:89] found id: ""
	I0722 10:33:08.353419    8575 logs.go:276] 1 containers: [be869384de7f9f26c6638b2090ca4d4ae3c4463e38549fcc1f474aa8077b8359]
	I0722 10:33:08.353477    8575 ssh_runner.go:195] Run: which crictl
	I0722 10:33:08.356860    8575 cri.go:54] listing CRI containers in root : {State:all Name:kube-proxy Namespaces:[]}
	I0722 10:33:08.356973    8575 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
	I0722 10:33:08.394005    8575 cri.go:89] found id: "b89d03fa7e9ed0ffa3d2a61fb546963c18198c7a24c7257d93f144d4122fe61e"
	I0722 10:33:08.394029    8575 cri.go:89] found id: ""
	I0722 10:33:08.394037    8575 logs.go:276] 1 containers: [b89d03fa7e9ed0ffa3d2a61fb546963c18198c7a24c7257d93f144d4122fe61e]
	I0722 10:33:08.394139    8575 ssh_runner.go:195] Run: which crictl
	I0722 10:33:08.397666    8575 cri.go:54] listing CRI containers in root : {State:all Name:kube-controller-manager Namespaces:[]}
	I0722 10:33:08.397734    8575 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
	I0722 10:33:08.439326    8575 cri.go:89] found id: "d064c7ca8b93e4b380a00ab859233190e1fc369f5e15ecf5dfd9b54dbc650897"
	I0722 10:33:08.439399    8575 cri.go:89] found id: ""
	I0722 10:33:08.439411    8575 logs.go:276] 1 containers: [d064c7ca8b93e4b380a00ab859233190e1fc369f5e15ecf5dfd9b54dbc650897]
	I0722 10:33:08.439477    8575 ssh_runner.go:195] Run: which crictl
	I0722 10:33:08.442890    8575 cri.go:54] listing CRI containers in root : {State:all Name:kindnet Namespaces:[]}
	I0722 10:33:08.442958    8575 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet
	I0722 10:33:08.481522    8575 cri.go:89] found id: "872f619c51c416886aba341acb0c461d4f4aa14c0eb3a9141099b7525e942d7f"
	I0722 10:33:08.481544    8575 cri.go:89] found id: ""
	I0722 10:33:08.481552    8575 logs.go:276] 1 containers: [872f619c51c416886aba341acb0c461d4f4aa14c0eb3a9141099b7525e942d7f]
	I0722 10:33:08.481613    8575 ssh_runner.go:195] Run: which crictl
	I0722 10:33:08.485025    8575 logs.go:123] Gathering logs for kubelet ...
	I0722 10:33:08.485048    8575 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
	W0722 10:33:08.511518    8575 logs.go:138] Found kubelet problem: Jul 22 10:31:45 addons-578168 kubelet[1541]: W0722 10:31:45.633933    1541 reflector.go:547] object-"default"/"kube-root-ca.crt": failed to list *v1.ConfigMap: configmaps "kube-root-ca.crt" is forbidden: User "system:node:addons-578168" cannot list resource "configmaps" in API group "" in the namespace "default": no relationship found between node 'addons-578168' and this object
	W0722 10:33:08.511702    8575 logs.go:138] Found kubelet problem: Jul 22 10:31:45 addons-578168 kubelet[1541]: W0722 10:31:45.633933    1541 reflector.go:547] object-"default"/"gcp-auth": failed to list *v1.Secret: secrets "gcp-auth" is forbidden: User "system:node:addons-578168" cannot list resource "secrets" in API group "" in the namespace "default": no relationship found between node 'addons-578168' and this object
	W0722 10:33:08.511908    8575 logs.go:138] Found kubelet problem: Jul 22 10:31:45 addons-578168 kubelet[1541]: E0722 10:31:45.634227    1541 reflector.go:150] object-"default"/"kube-root-ca.crt": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "kube-root-ca.crt" is forbidden: User "system:node:addons-578168" cannot list resource "configmaps" in API group "" in the namespace "default": no relationship found between node 'addons-578168' and this object
	W0722 10:33:08.512095    8575 logs.go:138] Found kubelet problem: Jul 22 10:31:45 addons-578168 kubelet[1541]: E0722 10:31:45.634236    1541 reflector.go:150] object-"default"/"gcp-auth": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "gcp-auth" is forbidden: User "system:node:addons-578168" cannot list resource "secrets" in API group "" in the namespace "default": no relationship found between node 'addons-578168' and this object
	W0722 10:33:08.514182    8575 logs.go:138] Found kubelet problem: Jul 22 10:31:45 addons-578168 kubelet[1541]: W0722 10:31:45.657618    1541 reflector.go:547] object-"ingress-nginx"/"ingress-nginx-admission": failed to list *v1.Secret: secrets "ingress-nginx-admission" is forbidden: User "system:node:addons-578168" cannot list resource "secrets" in API group "" in the namespace "ingress-nginx": no relationship found between node 'addons-578168' and this object
	W0722 10:33:08.514402    8575 logs.go:138] Found kubelet problem: Jul 22 10:31:45 addons-578168 kubelet[1541]: E0722 10:31:45.657656    1541 reflector.go:150] object-"ingress-nginx"/"ingress-nginx-admission": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "ingress-nginx-admission" is forbidden: User "system:node:addons-578168" cannot list resource "secrets" in API group "" in the namespace "ingress-nginx": no relationship found between node 'addons-578168' and this object
	W0722 10:33:08.515047    8575 logs.go:138] Found kubelet problem: Jul 22 10:31:45 addons-578168 kubelet[1541]: W0722 10:31:45.663542    1541 reflector.go:547] object-"yakd-dashboard"/"kube-root-ca.crt": failed to list *v1.ConfigMap: configmaps "kube-root-ca.crt" is forbidden: User "system:node:addons-578168" cannot list resource "configmaps" in API group "" in the namespace "yakd-dashboard": no relationship found between node 'addons-578168' and this object
	W0722 10:33:08.515253    8575 logs.go:138] Found kubelet problem: Jul 22 10:31:45 addons-578168 kubelet[1541]: E0722 10:31:45.663578    1541 reflector.go:150] object-"yakd-dashboard"/"kube-root-ca.crt": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "kube-root-ca.crt" is forbidden: User "system:node:addons-578168" cannot list resource "configmaps" in API group "" in the namespace "yakd-dashboard": no relationship found between node 'addons-578168' and this object
	W0722 10:33:08.515443    8575 logs.go:138] Found kubelet problem: Jul 22 10:31:45 addons-578168 kubelet[1541]: W0722 10:31:45.663834    1541 reflector.go:547] object-"ingress-nginx"/"kube-root-ca.crt": failed to list *v1.ConfigMap: configmaps "kube-root-ca.crt" is forbidden: User "system:node:addons-578168" cannot list resource "configmaps" in API group "" in the namespace "ingress-nginx": no relationship found between node 'addons-578168' and this object
	W0722 10:33:08.515659    8575 logs.go:138] Found kubelet problem: Jul 22 10:31:45 addons-578168 kubelet[1541]: E0722 10:31:45.663859    1541 reflector.go:150] object-"ingress-nginx"/"kube-root-ca.crt": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "kube-root-ca.crt" is forbidden: User "system:node:addons-578168" cannot list resource "configmaps" in API group "" in the namespace "ingress-nginx": no relationship found between node 'addons-578168' and this object
	W0722 10:33:08.515847    8575 logs.go:138] Found kubelet problem: Jul 22 10:31:45 addons-578168 kubelet[1541]: W0722 10:31:45.667585    1541 reflector.go:547] object-"local-path-storage"/"kube-root-ca.crt": failed to list *v1.ConfigMap: configmaps "kube-root-ca.crt" is forbidden: User "system:node:addons-578168" cannot list resource "configmaps" in API group "" in the namespace "local-path-storage": no relationship found between node 'addons-578168' and this object
	W0722 10:33:08.516054    8575 logs.go:138] Found kubelet problem: Jul 22 10:31:45 addons-578168 kubelet[1541]: E0722 10:31:45.667627    1541 reflector.go:150] object-"local-path-storage"/"kube-root-ca.crt": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "kube-root-ca.crt" is forbidden: User "system:node:addons-578168" cannot list resource "configmaps" in API group "" in the namespace "local-path-storage": no relationship found between node 'addons-578168' and this object
	W0722 10:33:08.516236    8575 logs.go:138] Found kubelet problem: Jul 22 10:31:45 addons-578168 kubelet[1541]: W0722 10:31:45.668640    1541 reflector.go:547] object-"gcp-auth"/"kube-root-ca.crt": failed to list *v1.ConfigMap: configmaps "kube-root-ca.crt" is forbidden: User "system:node:addons-578168" cannot list resource "configmaps" in API group "" in the namespace "gcp-auth": no relationship found between node 'addons-578168' and this object
	W0722 10:33:08.516438    8575 logs.go:138] Found kubelet problem: Jul 22 10:31:45 addons-578168 kubelet[1541]: E0722 10:31:45.668674    1541 reflector.go:150] object-"gcp-auth"/"kube-root-ca.crt": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "kube-root-ca.crt" is forbidden: User "system:node:addons-578168" cannot list resource "configmaps" in API group "" in the namespace "gcp-auth": no relationship found between node 'addons-578168' and this object
	W0722 10:33:08.516612    8575 logs.go:138] Found kubelet problem: Jul 22 10:31:45 addons-578168 kubelet[1541]: W0722 10:31:45.668822    1541 reflector.go:547] object-"gcp-auth"/"gcp-auth-certs": failed to list *v1.Secret: secrets "gcp-auth-certs" is forbidden: User "system:node:addons-578168" cannot list resource "secrets" in API group "" in the namespace "gcp-auth": no relationship found between node 'addons-578168' and this object
	W0722 10:33:08.516805    8575 logs.go:138] Found kubelet problem: Jul 22 10:31:45 addons-578168 kubelet[1541]: E0722 10:31:45.668852    1541 reflector.go:150] object-"gcp-auth"/"gcp-auth-certs": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "gcp-auth-certs" is forbidden: User "system:node:addons-578168" cannot list resource "secrets" in API group "" in the namespace "gcp-auth": no relationship found between node 'addons-578168' and this object
	I0722 10:33:08.573317    8575 logs.go:123] Gathering logs for describe nodes ...
	I0722 10:33:08.573348    8575 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.30.3/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
	I0722 10:33:08.710352    8575 logs.go:123] Gathering logs for kube-apiserver [3eaa36f65893e9ea154ad290476a76999e7fce5187e40f9b7dbac9b55955d25c] ...
	I0722 10:33:08.710380    8575 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 3eaa36f65893e9ea154ad290476a76999e7fce5187e40f9b7dbac9b55955d25c"
	I0722 10:33:08.779316    8575 logs.go:123] Gathering logs for coredns [fd14ed2fa3138ce3db1337fd1c8961db47db39d56a8f8f978e98aa5cb8f0e2a4] ...
	I0722 10:33:08.779406    8575 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 fd14ed2fa3138ce3db1337fd1c8961db47db39d56a8f8f978e98aa5cb8f0e2a4"
	I0722 10:33:08.828235    8575 logs.go:123] Gathering logs for kube-scheduler [be869384de7f9f26c6638b2090ca4d4ae3c4463e38549fcc1f474aa8077b8359] ...
	I0722 10:33:08.828262    8575 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 be869384de7f9f26c6638b2090ca4d4ae3c4463e38549fcc1f474aa8077b8359"
	I0722 10:33:08.879699    8575 logs.go:123] Gathering logs for CRI-O ...
	I0722 10:33:08.879738    8575 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u crio -n 400"
	I0722 10:33:08.979451    8575 logs.go:123] Gathering logs for container status ...
	I0722 10:33:08.979492    8575 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
	I0722 10:33:09.039914    8575 logs.go:123] Gathering logs for dmesg ...
	I0722 10:33:09.039947    8575 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
	I0722 10:33:09.053991    8575 logs.go:123] Gathering logs for etcd [7fd0f1e313e4efe8d94ceaf40a5d5c3f6bafcee15f4d9ae8fbd6a57bb89e2d32] ...
	I0722 10:33:09.054058    8575 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 7fd0f1e313e4efe8d94ceaf40a5d5c3f6bafcee15f4d9ae8fbd6a57bb89e2d32"
	I0722 10:33:09.113984    8575 logs.go:123] Gathering logs for kube-proxy [b89d03fa7e9ed0ffa3d2a61fb546963c18198c7a24c7257d93f144d4122fe61e] ...
	I0722 10:33:09.114021    8575 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 b89d03fa7e9ed0ffa3d2a61fb546963c18198c7a24c7257d93f144d4122fe61e"
	I0722 10:33:09.161228    8575 logs.go:123] Gathering logs for kube-controller-manager [d064c7ca8b93e4b380a00ab859233190e1fc369f5e15ecf5dfd9b54dbc650897] ...
	I0722 10:33:09.161256    8575 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 d064c7ca8b93e4b380a00ab859233190e1fc369f5e15ecf5dfd9b54dbc650897"
	I0722 10:33:09.230811    8575 logs.go:123] Gathering logs for kindnet [872f619c51c416886aba341acb0c461d4f4aa14c0eb3a9141099b7525e942d7f] ...
	I0722 10:33:09.230850    8575 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 872f619c51c416886aba341acb0c461d4f4aa14c0eb3a9141099b7525e942d7f"
	I0722 10:33:09.277404    8575 out.go:304] Setting ErrFile to fd 2...
	I0722 10:33:09.277435    8575 out.go:338] TERM=,COLORTERM=, which probably does not support color
	W0722 10:33:09.277492    8575 out.go:239] X Problems detected in kubelet:
	W0722 10:33:09.277506    8575 out.go:239]   Jul 22 10:31:45 addons-578168 kubelet[1541]: E0722 10:31:45.667627    1541 reflector.go:150] object-"local-path-storage"/"kube-root-ca.crt": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "kube-root-ca.crt" is forbidden: User "system:node:addons-578168" cannot list resource "configmaps" in API group "" in the namespace "local-path-storage": no relationship found between node 'addons-578168' and this object
	W0722 10:33:09.277514    8575 out.go:239]   Jul 22 10:31:45 addons-578168 kubelet[1541]: W0722 10:31:45.668640    1541 reflector.go:547] object-"gcp-auth"/"kube-root-ca.crt": failed to list *v1.ConfigMap: configmaps "kube-root-ca.crt" is forbidden: User "system:node:addons-578168" cannot list resource "configmaps" in API group "" in the namespace "gcp-auth": no relationship found between node 'addons-578168' and this object
	W0722 10:33:09.277521    8575 out.go:239]   Jul 22 10:31:45 addons-578168 kubelet[1541]: E0722 10:31:45.668674    1541 reflector.go:150] object-"gcp-auth"/"kube-root-ca.crt": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "kube-root-ca.crt" is forbidden: User "system:node:addons-578168" cannot list resource "configmaps" in API group "" in the namespace "gcp-auth": no relationship found between node 'addons-578168' and this object
	W0722 10:33:09.277529    8575 out.go:239]   Jul 22 10:31:45 addons-578168 kubelet[1541]: W0722 10:31:45.668822    1541 reflector.go:547] object-"gcp-auth"/"gcp-auth-certs": failed to list *v1.Secret: secrets "gcp-auth-certs" is forbidden: User "system:node:addons-578168" cannot list resource "secrets" in API group "" in the namespace "gcp-auth": no relationship found between node 'addons-578168' and this object
	W0722 10:33:09.277536    8575 out.go:239]   Jul 22 10:31:45 addons-578168 kubelet[1541]: E0722 10:31:45.668852    1541 reflector.go:150] object-"gcp-auth"/"gcp-auth-certs": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "gcp-auth-certs" is forbidden: User "system:node:addons-578168" cannot list resource "secrets" in API group "" in the namespace "gcp-auth": no relationship found between node 'addons-578168' and this object
	I0722 10:33:09.277545    8575 out.go:304] Setting ErrFile to fd 2...
	I0722 10:33:09.277551    8575 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0722 10:33:19.278362    8575 api_server.go:253] Checking apiserver healthz at https://192.168.49.2:8443/healthz ...
	I0722 10:33:19.286692    8575 api_server.go:279] https://192.168.49.2:8443/healthz returned 200:
	ok
	I0722 10:33:19.288702    8575 api_server.go:141] control plane version: v1.30.3
	I0722 10:33:19.288732    8575 api_server.go:131] duration metric: took 11.110293012s to wait for apiserver health ...
	I0722 10:33:19.288740    8575 system_pods.go:43] waiting for kube-system pods to appear ...
	I0722 10:33:19.288764    8575 cri.go:54] listing CRI containers in root : {State:all Name:kube-apiserver Namespaces:[]}
	I0722 10:33:19.288827    8575 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
	I0722 10:33:19.327345    8575 cri.go:89] found id: "3eaa36f65893e9ea154ad290476a76999e7fce5187e40f9b7dbac9b55955d25c"
	I0722 10:33:19.327365    8575 cri.go:89] found id: ""
	I0722 10:33:19.327373    8575 logs.go:276] 1 containers: [3eaa36f65893e9ea154ad290476a76999e7fce5187e40f9b7dbac9b55955d25c]
	I0722 10:33:19.327456    8575 ssh_runner.go:195] Run: which crictl
	I0722 10:33:19.331113    8575 cri.go:54] listing CRI containers in root : {State:all Name:etcd Namespaces:[]}
	I0722 10:33:19.331201    8575 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
	I0722 10:33:19.368747    8575 cri.go:89] found id: "7fd0f1e313e4efe8d94ceaf40a5d5c3f6bafcee15f4d9ae8fbd6a57bb89e2d32"
	I0722 10:33:19.368768    8575 cri.go:89] found id: ""
	I0722 10:33:19.368776    8575 logs.go:276] 1 containers: [7fd0f1e313e4efe8d94ceaf40a5d5c3f6bafcee15f4d9ae8fbd6a57bb89e2d32]
	I0722 10:33:19.368831    8575 ssh_runner.go:195] Run: which crictl
	I0722 10:33:19.372261    8575 cri.go:54] listing CRI containers in root : {State:all Name:coredns Namespaces:[]}
	I0722 10:33:19.372329    8575 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
	I0722 10:33:19.410999    8575 cri.go:89] found id: "fd14ed2fa3138ce3db1337fd1c8961db47db39d56a8f8f978e98aa5cb8f0e2a4"
	I0722 10:33:19.411023    8575 cri.go:89] found id: ""
	I0722 10:33:19.411031    8575 logs.go:276] 1 containers: [fd14ed2fa3138ce3db1337fd1c8961db47db39d56a8f8f978e98aa5cb8f0e2a4]
	I0722 10:33:19.411087    8575 ssh_runner.go:195] Run: which crictl
	I0722 10:33:19.414587    8575 cri.go:54] listing CRI containers in root : {State:all Name:kube-scheduler Namespaces:[]}
	I0722 10:33:19.414660    8575 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
	I0722 10:33:19.457156    8575 cri.go:89] found id: "be869384de7f9f26c6638b2090ca4d4ae3c4463e38549fcc1f474aa8077b8359"
	I0722 10:33:19.457179    8575 cri.go:89] found id: ""
	I0722 10:33:19.457187    8575 logs.go:276] 1 containers: [be869384de7f9f26c6638b2090ca4d4ae3c4463e38549fcc1f474aa8077b8359]
	I0722 10:33:19.457242    8575 ssh_runner.go:195] Run: which crictl
	I0722 10:33:19.460720    8575 cri.go:54] listing CRI containers in root : {State:all Name:kube-proxy Namespaces:[]}
	I0722 10:33:19.460787    8575 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
	I0722 10:33:19.503298    8575 cri.go:89] found id: "b89d03fa7e9ed0ffa3d2a61fb546963c18198c7a24c7257d93f144d4122fe61e"
	I0722 10:33:19.503336    8575 cri.go:89] found id: ""
	I0722 10:33:19.503345    8575 logs.go:276] 1 containers: [b89d03fa7e9ed0ffa3d2a61fb546963c18198c7a24c7257d93f144d4122fe61e]
	I0722 10:33:19.503405    8575 ssh_runner.go:195] Run: which crictl
	I0722 10:33:19.506858    8575 cri.go:54] listing CRI containers in root : {State:all Name:kube-controller-manager Namespaces:[]}
	I0722 10:33:19.506932    8575 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
	I0722 10:33:19.543515    8575 cri.go:89] found id: "d064c7ca8b93e4b380a00ab859233190e1fc369f5e15ecf5dfd9b54dbc650897"
	I0722 10:33:19.543541    8575 cri.go:89] found id: ""
	I0722 10:33:19.543549    8575 logs.go:276] 1 containers: [d064c7ca8b93e4b380a00ab859233190e1fc369f5e15ecf5dfd9b54dbc650897]
	I0722 10:33:19.543608    8575 ssh_runner.go:195] Run: which crictl
	I0722 10:33:19.547131    8575 cri.go:54] listing CRI containers in root : {State:all Name:kindnet Namespaces:[]}
	I0722 10:33:19.547202    8575 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet
	I0722 10:33:19.585455    8575 cri.go:89] found id: "872f619c51c416886aba341acb0c461d4f4aa14c0eb3a9141099b7525e942d7f"
	I0722 10:33:19.585476    8575 cri.go:89] found id: ""
	I0722 10:33:19.585493    8575 logs.go:276] 1 containers: [872f619c51c416886aba341acb0c461d4f4aa14c0eb3a9141099b7525e942d7f]
	I0722 10:33:19.585552    8575 ssh_runner.go:195] Run: which crictl
	I0722 10:33:19.590360    8575 logs.go:123] Gathering logs for describe nodes ...
	I0722 10:33:19.590385    8575 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.30.3/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
	I0722 10:33:19.725238    8575 logs.go:123] Gathering logs for kube-apiserver [3eaa36f65893e9ea154ad290476a76999e7fce5187e40f9b7dbac9b55955d25c] ...
	I0722 10:33:19.725271    8575 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 3eaa36f65893e9ea154ad290476a76999e7fce5187e40f9b7dbac9b55955d25c"
	I0722 10:33:19.785062    8575 logs.go:123] Gathering logs for kube-proxy [b89d03fa7e9ed0ffa3d2a61fb546963c18198c7a24c7257d93f144d4122fe61e] ...
	I0722 10:33:19.785094    8575 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 b89d03fa7e9ed0ffa3d2a61fb546963c18198c7a24c7257d93f144d4122fe61e"
	I0722 10:33:19.821568    8575 logs.go:123] Gathering logs for kube-controller-manager [d064c7ca8b93e4b380a00ab859233190e1fc369f5e15ecf5dfd9b54dbc650897] ...
	I0722 10:33:19.821597    8575 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 d064c7ca8b93e4b380a00ab859233190e1fc369f5e15ecf5dfd9b54dbc650897"
	I0722 10:33:19.887290    8575 logs.go:123] Gathering logs for kindnet [872f619c51c416886aba341acb0c461d4f4aa14c0eb3a9141099b7525e942d7f] ...
	I0722 10:33:19.887327    8575 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 872f619c51c416886aba341acb0c461d4f4aa14c0eb3a9141099b7525e942d7f"
	I0722 10:33:19.935639    8575 logs.go:123] Gathering logs for dmesg ...
	I0722 10:33:19.935669    8575 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
	I0722 10:33:19.948308    8575 logs.go:123] Gathering logs for etcd [7fd0f1e313e4efe8d94ceaf40a5d5c3f6bafcee15f4d9ae8fbd6a57bb89e2d32] ...
	I0722 10:33:19.948333    8575 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 7fd0f1e313e4efe8d94ceaf40a5d5c3f6bafcee15f4d9ae8fbd6a57bb89e2d32"
	I0722 10:33:20.009491    8575 logs.go:123] Gathering logs for coredns [fd14ed2fa3138ce3db1337fd1c8961db47db39d56a8f8f978e98aa5cb8f0e2a4] ...
	I0722 10:33:20.009532    8575 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 fd14ed2fa3138ce3db1337fd1c8961db47db39d56a8f8f978e98aa5cb8f0e2a4"
	I0722 10:33:20.057417    8575 logs.go:123] Gathering logs for kube-scheduler [be869384de7f9f26c6638b2090ca4d4ae3c4463e38549fcc1f474aa8077b8359] ...
	I0722 10:33:20.057476    8575 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 be869384de7f9f26c6638b2090ca4d4ae3c4463e38549fcc1f474aa8077b8359"
	I0722 10:33:20.109956    8575 logs.go:123] Gathering logs for CRI-O ...
	I0722 10:33:20.109989    8575 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u crio -n 400"
	I0722 10:33:20.202118    8575 logs.go:123] Gathering logs for container status ...
	I0722 10:33:20.202148    8575 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
	I0722 10:33:20.252853    8575 logs.go:123] Gathering logs for kubelet ...
	I0722 10:33:20.252895    8575 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
	W0722 10:33:20.275476    8575 logs.go:138] Found kubelet problem: Jul 22 10:31:45 addons-578168 kubelet[1541]: W0722 10:31:45.633933    1541 reflector.go:547] object-"default"/"kube-root-ca.crt": failed to list *v1.ConfigMap: configmaps "kube-root-ca.crt" is forbidden: User "system:node:addons-578168" cannot list resource "configmaps" in API group "" in the namespace "default": no relationship found between node 'addons-578168' and this object
	W0722 10:33:20.275720    8575 logs.go:138] Found kubelet problem: Jul 22 10:31:45 addons-578168 kubelet[1541]: W0722 10:31:45.633933    1541 reflector.go:547] object-"default"/"gcp-auth": failed to list *v1.Secret: secrets "gcp-auth" is forbidden: User "system:node:addons-578168" cannot list resource "secrets" in API group "" in the namespace "default": no relationship found between node 'addons-578168' and this object
	W0722 10:33:20.275967    8575 logs.go:138] Found kubelet problem: Jul 22 10:31:45 addons-578168 kubelet[1541]: E0722 10:31:45.634227    1541 reflector.go:150] object-"default"/"kube-root-ca.crt": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "kube-root-ca.crt" is forbidden: User "system:node:addons-578168" cannot list resource "configmaps" in API group "" in the namespace "default": no relationship found between node 'addons-578168' and this object
	W0722 10:33:20.276215    8575 logs.go:138] Found kubelet problem: Jul 22 10:31:45 addons-578168 kubelet[1541]: E0722 10:31:45.634236    1541 reflector.go:150] object-"default"/"gcp-auth": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "gcp-auth" is forbidden: User "system:node:addons-578168" cannot list resource "secrets" in API group "" in the namespace "default": no relationship found between node 'addons-578168' and this object
	W0722 10:33:20.280026    8575 logs.go:138] Found kubelet problem: Jul 22 10:31:45 addons-578168 kubelet[1541]: W0722 10:31:45.657618    1541 reflector.go:547] object-"ingress-nginx"/"ingress-nginx-admission": failed to list *v1.Secret: secrets "ingress-nginx-admission" is forbidden: User "system:node:addons-578168" cannot list resource "secrets" in API group "" in the namespace "ingress-nginx": no relationship found between node 'addons-578168' and this object
	W0722 10:33:20.280281    8575 logs.go:138] Found kubelet problem: Jul 22 10:31:45 addons-578168 kubelet[1541]: E0722 10:31:45.657656    1541 reflector.go:150] object-"ingress-nginx"/"ingress-nginx-admission": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "ingress-nginx-admission" is forbidden: User "system:node:addons-578168" cannot list resource "secrets" in API group "" in the namespace "ingress-nginx": no relationship found between node 'addons-578168' and this object
	W0722 10:33:20.280963    8575 logs.go:138] Found kubelet problem: Jul 22 10:31:45 addons-578168 kubelet[1541]: W0722 10:31:45.663542    1541 reflector.go:547] object-"yakd-dashboard"/"kube-root-ca.crt": failed to list *v1.ConfigMap: configmaps "kube-root-ca.crt" is forbidden: User "system:node:addons-578168" cannot list resource "configmaps" in API group "" in the namespace "yakd-dashboard": no relationship found between node 'addons-578168' and this object
	W0722 10:33:20.281176    8575 logs.go:138] Found kubelet problem: Jul 22 10:31:45 addons-578168 kubelet[1541]: E0722 10:31:45.663578    1541 reflector.go:150] object-"yakd-dashboard"/"kube-root-ca.crt": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "kube-root-ca.crt" is forbidden: User "system:node:addons-578168" cannot list resource "configmaps" in API group "" in the namespace "yakd-dashboard": no relationship found between node 'addons-578168' and this object
	W0722 10:33:20.281363    8575 logs.go:138] Found kubelet problem: Jul 22 10:31:45 addons-578168 kubelet[1541]: W0722 10:31:45.663834    1541 reflector.go:547] object-"ingress-nginx"/"kube-root-ca.crt": failed to list *v1.ConfigMap: configmaps "kube-root-ca.crt" is forbidden: User "system:node:addons-578168" cannot list resource "configmaps" in API group "" in the namespace "ingress-nginx": no relationship found between node 'addons-578168' and this object
	W0722 10:33:20.281571    8575 logs.go:138] Found kubelet problem: Jul 22 10:31:45 addons-578168 kubelet[1541]: E0722 10:31:45.663859    1541 reflector.go:150] object-"ingress-nginx"/"kube-root-ca.crt": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "kube-root-ca.crt" is forbidden: User "system:node:addons-578168" cannot list resource "configmaps" in API group "" in the namespace "ingress-nginx": no relationship found between node 'addons-578168' and this object
	W0722 10:33:20.281766    8575 logs.go:138] Found kubelet problem: Jul 22 10:31:45 addons-578168 kubelet[1541]: W0722 10:31:45.667585    1541 reflector.go:547] object-"local-path-storage"/"kube-root-ca.crt": failed to list *v1.ConfigMap: configmaps "kube-root-ca.crt" is forbidden: User "system:node:addons-578168" cannot list resource "configmaps" in API group "" in the namespace "local-path-storage": no relationship found between node 'addons-578168' and this object
	W0722 10:33:20.281976    8575 logs.go:138] Found kubelet problem: Jul 22 10:31:45 addons-578168 kubelet[1541]: E0722 10:31:45.667627    1541 reflector.go:150] object-"local-path-storage"/"kube-root-ca.crt": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "kube-root-ca.crt" is forbidden: User "system:node:addons-578168" cannot list resource "configmaps" in API group "" in the namespace "local-path-storage": no relationship found between node 'addons-578168' and this object
	W0722 10:33:20.282158    8575 logs.go:138] Found kubelet problem: Jul 22 10:31:45 addons-578168 kubelet[1541]: W0722 10:31:45.668640    1541 reflector.go:547] object-"gcp-auth"/"kube-root-ca.crt": failed to list *v1.ConfigMap: configmaps "kube-root-ca.crt" is forbidden: User "system:node:addons-578168" cannot list resource "configmaps" in API group "" in the namespace "gcp-auth": no relationship found between node 'addons-578168' and this object
	W0722 10:33:20.282359    8575 logs.go:138] Found kubelet problem: Jul 22 10:31:45 addons-578168 kubelet[1541]: E0722 10:31:45.668674    1541 reflector.go:150] object-"gcp-auth"/"kube-root-ca.crt": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "kube-root-ca.crt" is forbidden: User "system:node:addons-578168" cannot list resource "configmaps" in API group "" in the namespace "gcp-auth": no relationship found between node 'addons-578168' and this object
	W0722 10:33:20.282534    8575 logs.go:138] Found kubelet problem: Jul 22 10:31:45 addons-578168 kubelet[1541]: W0722 10:31:45.668822    1541 reflector.go:547] object-"gcp-auth"/"gcp-auth-certs": failed to list *v1.Secret: secrets "gcp-auth-certs" is forbidden: User "system:node:addons-578168" cannot list resource "secrets" in API group "" in the namespace "gcp-auth": no relationship found between node 'addons-578168' and this object
	W0722 10:33:20.282729    8575 logs.go:138] Found kubelet problem: Jul 22 10:31:45 addons-578168 kubelet[1541]: E0722 10:31:45.668852    1541 reflector.go:150] object-"gcp-auth"/"gcp-auth-certs": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "gcp-auth-certs" is forbidden: User "system:node:addons-578168" cannot list resource "secrets" in API group "" in the namespace "gcp-auth": no relationship found between node 'addons-578168' and this object
	I0722 10:33:20.338879    8575 out.go:304] Setting ErrFile to fd 2...
	I0722 10:33:20.338911    8575 out.go:338] TERM=,COLORTERM=, which probably does not support color
	W0722 10:33:20.338968    8575 out.go:239] X Problems detected in kubelet:
	W0722 10:33:20.338981    8575 out.go:239]   Jul 22 10:31:45 addons-578168 kubelet[1541]: E0722 10:31:45.667627    1541 reflector.go:150] object-"local-path-storage"/"kube-root-ca.crt": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "kube-root-ca.crt" is forbidden: User "system:node:addons-578168" cannot list resource "configmaps" in API group "" in the namespace "local-path-storage": no relationship found between node 'addons-578168' and this object
	W0722 10:33:20.338995    8575 out.go:239]   Jul 22 10:31:45 addons-578168 kubelet[1541]: W0722 10:31:45.668640    1541 reflector.go:547] object-"gcp-auth"/"kube-root-ca.crt": failed to list *v1.ConfigMap: configmaps "kube-root-ca.crt" is forbidden: User "system:node:addons-578168" cannot list resource "configmaps" in API group "" in the namespace "gcp-auth": no relationship found between node 'addons-578168' and this object
	W0722 10:33:20.339005    8575 out.go:239]   Jul 22 10:31:45 addons-578168 kubelet[1541]: E0722 10:31:45.668674    1541 reflector.go:150] object-"gcp-auth"/"kube-root-ca.crt": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "kube-root-ca.crt" is forbidden: User "system:node:addons-578168" cannot list resource "configmaps" in API group "" in the namespace "gcp-auth": no relationship found between node 'addons-578168' and this object
	W0722 10:33:20.339017    8575 out.go:239]   Jul 22 10:31:45 addons-578168 kubelet[1541]: W0722 10:31:45.668822    1541 reflector.go:547] object-"gcp-auth"/"gcp-auth-certs": failed to list *v1.Secret: secrets "gcp-auth-certs" is forbidden: User "system:node:addons-578168" cannot list resource "secrets" in API group "" in the namespace "gcp-auth": no relationship found between node 'addons-578168' and this object
	W0722 10:33:20.339023    8575 out.go:239]   Jul 22 10:31:45 addons-578168 kubelet[1541]: E0722 10:31:45.668852    1541 reflector.go:150] object-"gcp-auth"/"gcp-auth-certs": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "gcp-auth-certs" is forbidden: User "system:node:addons-578168" cannot list resource "secrets" in API group "" in the namespace "gcp-auth": no relationship found between node 'addons-578168' and this object
	I0722 10:33:20.339028    8575 out.go:304] Setting ErrFile to fd 2...
	I0722 10:33:20.339035    8575 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0722 10:33:30.350545    8575 system_pods.go:59] 18 kube-system pods found
	I0722 10:33:30.350586    8575 system_pods.go:61] "coredns-7db6d8ff4d-dz9nf" [5b68c434-479c-4f3f-89ef-574ff93cad07] Running
	I0722 10:33:30.350592    8575 system_pods.go:61] "csi-hostpath-attacher-0" [efd4000b-6d36-4bf6-acc6-77dc5ee227ce] Running
	I0722 10:33:30.350598    8575 system_pods.go:61] "csi-hostpath-resizer-0" [1411c232-72bc-476b-bf59-1f7d8ebe108c] Running
	I0722 10:33:30.350603    8575 system_pods.go:61] "csi-hostpathplugin-l2bb9" [28b0890c-53ec-42e8-a34a-3cf71d7fd761] Running
	I0722 10:33:30.350607    8575 system_pods.go:61] "etcd-addons-578168" [2b70cf03-56ab-43c9-bb1f-dd424a315eb8] Running
	I0722 10:33:30.350616    8575 system_pods.go:61] "kindnet-pb6q8" [98221cf0-c8b1-41c7-802a-0bfecacc14b2] Running
	I0722 10:33:30.350621    8575 system_pods.go:61] "kube-apiserver-addons-578168" [818f1cc9-7bca-4bf2-bf1b-1f8d446bbfa6] Running
	I0722 10:33:30.350632    8575 system_pods.go:61] "kube-controller-manager-addons-578168" [a9c15e78-e8d6-4df9-a887-4d19603a0307] Running
	I0722 10:33:30.350648    8575 system_pods.go:61] "kube-ingress-dns-minikube" [9ea7b2d6-84ca-4b41-b838-277a02fbac6e] Running
	I0722 10:33:30.350653    8575 system_pods.go:61] "kube-proxy-qlrkl" [a4b76f6e-03ef-44b7-bc32-95afb9b54325] Running
	I0722 10:33:30.350660    8575 system_pods.go:61] "kube-scheduler-addons-578168" [6e6be899-0b7f-4bba-bc87-ce962e16a996] Running
	I0722 10:33:30.350664    8575 system_pods.go:61] "metrics-server-c59844bb4-qqltc" [25386e93-7dbb-4ba9-948a-f1aecb63987c] Running
	I0722 10:33:30.350671    8575 system_pods.go:61] "nvidia-device-plugin-daemonset-l6frr" [6baaf8fc-6bea-4c53-bfe3-053a25f4594d] Running
	I0722 10:33:30.350675    8575 system_pods.go:61] "registry-656c9c8d9c-c2dgx" [47d52a97-6fdc-4c57-882b-f6098503cfa3] Running
	I0722 10:33:30.350680    8575 system_pods.go:61] "registry-proxy-6fp26" [aa53a675-95b7-4a46-9478-32230bc47800] Running
	I0722 10:33:30.350684    8575 system_pods.go:61] "snapshot-controller-745499f584-pr62d" [47d3368a-136b-491b-b106-ab3bfe3c191d] Running
	I0722 10:33:30.350696    8575 system_pods.go:61] "snapshot-controller-745499f584-whpkh" [df9f9d3a-ca57-4c83-b30e-2c8b846c97cb] Running
	I0722 10:33:30.350700    8575 system_pods.go:61] "storage-provisioner" [332a1289-8294-4ea6-9292-4d1789302ab4] Running
	I0722 10:33:30.350756    8575 system_pods.go:74] duration metric: took 11.06200878s to wait for pod list to return data ...
	I0722 10:33:30.350780    8575 default_sa.go:34] waiting for default service account to be created ...
	I0722 10:33:30.353258    8575 default_sa.go:45] found service account: "default"
	I0722 10:33:30.353286    8575 default_sa.go:55] duration metric: took 2.496167ms for default service account to be created ...
	I0722 10:33:30.353308    8575 system_pods.go:116] waiting for k8s-apps to be running ...
	I0722 10:33:30.363875    8575 system_pods.go:86] 18 kube-system pods found
	I0722 10:33:30.363911    8575 system_pods.go:89] "coredns-7db6d8ff4d-dz9nf" [5b68c434-479c-4f3f-89ef-574ff93cad07] Running
	I0722 10:33:30.363920    8575 system_pods.go:89] "csi-hostpath-attacher-0" [efd4000b-6d36-4bf6-acc6-77dc5ee227ce] Running
	I0722 10:33:30.363925    8575 system_pods.go:89] "csi-hostpath-resizer-0" [1411c232-72bc-476b-bf59-1f7d8ebe108c] Running
	I0722 10:33:30.363935    8575 system_pods.go:89] "csi-hostpathplugin-l2bb9" [28b0890c-53ec-42e8-a34a-3cf71d7fd761] Running
	I0722 10:33:30.363941    8575 system_pods.go:89] "etcd-addons-578168" [2b70cf03-56ab-43c9-bb1f-dd424a315eb8] Running
	I0722 10:33:30.363945    8575 system_pods.go:89] "kindnet-pb6q8" [98221cf0-c8b1-41c7-802a-0bfecacc14b2] Running
	I0722 10:33:30.363965    8575 system_pods.go:89] "kube-apiserver-addons-578168" [818f1cc9-7bca-4bf2-bf1b-1f8d446bbfa6] Running
	I0722 10:33:30.363973    8575 system_pods.go:89] "kube-controller-manager-addons-578168" [a9c15e78-e8d6-4df9-a887-4d19603a0307] Running
	I0722 10:33:30.363978    8575 system_pods.go:89] "kube-ingress-dns-minikube" [9ea7b2d6-84ca-4b41-b838-277a02fbac6e] Running
	I0722 10:33:30.363982    8575 system_pods.go:89] "kube-proxy-qlrkl" [a4b76f6e-03ef-44b7-bc32-95afb9b54325] Running
	I0722 10:33:30.363986    8575 system_pods.go:89] "kube-scheduler-addons-578168" [6e6be899-0b7f-4bba-bc87-ce962e16a996] Running
	I0722 10:33:30.363993    8575 system_pods.go:89] "metrics-server-c59844bb4-qqltc" [25386e93-7dbb-4ba9-948a-f1aecb63987c] Running
	I0722 10:33:30.364001    8575 system_pods.go:89] "nvidia-device-plugin-daemonset-l6frr" [6baaf8fc-6bea-4c53-bfe3-053a25f4594d] Running
	I0722 10:33:30.364011    8575 system_pods.go:89] "registry-656c9c8d9c-c2dgx" [47d52a97-6fdc-4c57-882b-f6098503cfa3] Running
	I0722 10:33:30.364015    8575 system_pods.go:89] "registry-proxy-6fp26" [aa53a675-95b7-4a46-9478-32230bc47800] Running
	I0722 10:33:30.364019    8575 system_pods.go:89] "snapshot-controller-745499f584-pr62d" [47d3368a-136b-491b-b106-ab3bfe3c191d] Running
	I0722 10:33:30.364025    8575 system_pods.go:89] "snapshot-controller-745499f584-whpkh" [df9f9d3a-ca57-4c83-b30e-2c8b846c97cb] Running
	I0722 10:33:30.364029    8575 system_pods.go:89] "storage-provisioner" [332a1289-8294-4ea6-9292-4d1789302ab4] Running
	I0722 10:33:30.364035    8575 system_pods.go:126] duration metric: took 10.721948ms to wait for k8s-apps to be running ...
	I0722 10:33:30.364045    8575 system_svc.go:44] waiting for kubelet service to be running ....
	I0722 10:33:30.364104    8575 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
	I0722 10:33:30.375759    8575 system_svc.go:56] duration metric: took 11.703574ms WaitForService to wait for kubelet
	I0722 10:33:30.375834    8575 kubeadm.go:582] duration metric: took 2m0.509121746s to wait for: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
	I0722 10:33:30.375863    8575 node_conditions.go:102] verifying NodePressure condition ...
	I0722 10:33:30.379593    8575 node_conditions.go:122] node storage ephemeral capacity is 203034800Ki
	I0722 10:33:30.379628    8575 node_conditions.go:123] node cpu capacity is 2
	I0722 10:33:30.379641    8575 node_conditions.go:105] duration metric: took 3.7712ms to run NodePressure ...
	I0722 10:33:30.379653    8575 start.go:241] waiting for startup goroutines ...
	I0722 10:33:30.379661    8575 start.go:246] waiting for cluster config update ...
	I0722 10:33:30.379678    8575 start.go:255] writing updated cluster config ...
	I0722 10:33:30.380006    8575 ssh_runner.go:195] Run: rm -f paused
	I0722 10:33:30.704520    8575 start.go:600] kubectl: 1.30.3, cluster: 1.30.3 (minor skew: 0)
	I0722 10:33:30.707082    8575 out.go:177] * Done! kubectl is now configured to use "addons-578168" cluster and "default" namespace by default
	
	
	==> CRI-O <==
	Jul 22 10:37:16 addons-578168 crio[968]: time="2024-07-22 10:37:16.120795304Z" level=info msg="Removed pod sandbox: 71bd2845be8bce5ae8136a308bd4c902dce2608665fa3ac004cbf306ea0178e2" id=867ca36c-5f36-4f0f-a8b5-d11fe3f92d45 name=/runtime.v1.RuntimeService/RemovePodSandbox
	Jul 22 10:37:17 addons-578168 crio[968]: time="2024-07-22 10:37:17.795355916Z" level=warning msg="Stopping container 6a874d432dcdb5eb46cd1f03811d08edb612216544a177fbfa1155872ca9a99d with stop signal timed out: timeout reached after 2 seconds waiting for container process to exit" id=0d5ab8a4-4978-488b-8096-66e381e32a7c name=/runtime.v1.RuntimeService/StopContainer
	Jul 22 10:37:17 addons-578168 conmon[5065]: conmon 6a874d432dcdb5eb46cd <ninfo>: container 5076 exited with status 137
	Jul 22 10:37:17 addons-578168 crio[968]: time="2024-07-22 10:37:17.931908426Z" level=info msg="Stopped container 6a874d432dcdb5eb46cd1f03811d08edb612216544a177fbfa1155872ca9a99d: ingress-nginx/ingress-nginx-controller-6d9bd977d4-mdtsr/controller" id=0d5ab8a4-4978-488b-8096-66e381e32a7c name=/runtime.v1.RuntimeService/StopContainer
	Jul 22 10:37:17 addons-578168 crio[968]: time="2024-07-22 10:37:17.932526464Z" level=info msg="Stopping pod sandbox: 03a3ebc997f672a134fd857baa52564dafc14e1b7d6b1ec43b3554d799e70fdf" id=ec33bdf2-1de3-4f0c-8ed9-a2ff46a423b7 name=/runtime.v1.RuntimeService/StopPodSandbox
	Jul 22 10:37:17 addons-578168 crio[968]: time="2024-07-22 10:37:17.936223942Z" level=info msg="Restoring iptables rules: *nat\n:KUBE-HP-SXPOCKRAWLUKT4UZ - [0:0]\n:KUBE-HOSTPORTS - [0:0]\n:KUBE-HP-XSEE5TR7YNDZGAZP - [0:0]\n-X KUBE-HP-XSEE5TR7YNDZGAZP\n-X KUBE-HP-SXPOCKRAWLUKT4UZ\nCOMMIT\n"
	Jul 22 10:37:17 addons-578168 crio[968]: time="2024-07-22 10:37:17.937675248Z" level=info msg="Closing host port tcp:80"
	Jul 22 10:37:17 addons-578168 crio[968]: time="2024-07-22 10:37:17.937724528Z" level=info msg="Closing host port tcp:443"
	Jul 22 10:37:17 addons-578168 crio[968]: time="2024-07-22 10:37:17.939017195Z" level=info msg="Host port tcp:80 does not have an open socket"
	Jul 22 10:37:17 addons-578168 crio[968]: time="2024-07-22 10:37:17.939042302Z" level=info msg="Host port tcp:443 does not have an open socket"
	Jul 22 10:37:17 addons-578168 crio[968]: time="2024-07-22 10:37:17.939231161Z" level=info msg="Got pod network &{Name:ingress-nginx-controller-6d9bd977d4-mdtsr Namespace:ingress-nginx ID:03a3ebc997f672a134fd857baa52564dafc14e1b7d6b1ec43b3554d799e70fdf UID:e739a650-7924-41c4-bf78-5835a8a60047 NetNS:/var/run/netns/0a4fb035-fa2b-4214-824f-7d4739612d03 Networks:[{Name:kindnet Ifname:eth0}] RuntimeConfig:map[kindnet:{IP: MAC: PortMappings:[] Bandwidth:<nil> IpRanges:[]}] Aliases:map[]}"
	Jul 22 10:37:17 addons-578168 crio[968]: time="2024-07-22 10:37:17.939371125Z" level=info msg="Deleting pod ingress-nginx_ingress-nginx-controller-6d9bd977d4-mdtsr from CNI network \"kindnet\" (type=ptp)"
	Jul 22 10:37:17 addons-578168 crio[968]: time="2024-07-22 10:37:17.958673610Z" level=info msg="Stopped pod sandbox: 03a3ebc997f672a134fd857baa52564dafc14e1b7d6b1ec43b3554d799e70fdf" id=ec33bdf2-1de3-4f0c-8ed9-a2ff46a423b7 name=/runtime.v1.RuntimeService/StopPodSandbox
	Jul 22 10:37:18 addons-578168 crio[968]: time="2024-07-22 10:37:18.108930335Z" level=info msg="Removing container: 6a874d432dcdb5eb46cd1f03811d08edb612216544a177fbfa1155872ca9a99d" id=6a796c2d-3613-491a-ba75-a89028761e48 name=/runtime.v1.RuntimeService/RemoveContainer
	Jul 22 10:37:18 addons-578168 crio[968]: time="2024-07-22 10:37:18.129970519Z" level=info msg="Removed container 6a874d432dcdb5eb46cd1f03811d08edb612216544a177fbfa1155872ca9a99d: ingress-nginx/ingress-nginx-controller-6d9bd977d4-mdtsr/controller" id=6a796c2d-3613-491a-ba75-a89028761e48 name=/runtime.v1.RuntimeService/RemoveContainer
	Jul 22 10:38:16 addons-578168 crio[968]: time="2024-07-22 10:38:16.123710074Z" level=info msg="Stopping pod sandbox: 03a3ebc997f672a134fd857baa52564dafc14e1b7d6b1ec43b3554d799e70fdf" id=a217651c-267b-4e5b-931a-a22f331c2dc8 name=/runtime.v1.RuntimeService/StopPodSandbox
	Jul 22 10:38:16 addons-578168 crio[968]: time="2024-07-22 10:38:16.123765754Z" level=info msg="Stopped pod sandbox (already stopped): 03a3ebc997f672a134fd857baa52564dafc14e1b7d6b1ec43b3554d799e70fdf" id=a217651c-267b-4e5b-931a-a22f331c2dc8 name=/runtime.v1.RuntimeService/StopPodSandbox
	Jul 22 10:38:16 addons-578168 crio[968]: time="2024-07-22 10:38:16.124175996Z" level=info msg="Removing pod sandbox: 03a3ebc997f672a134fd857baa52564dafc14e1b7d6b1ec43b3554d799e70fdf" id=c1e7f30d-83e0-4618-86d8-96ebaf66a7d4 name=/runtime.v1.RuntimeService/RemovePodSandbox
	Jul 22 10:38:16 addons-578168 crio[968]: time="2024-07-22 10:38:16.134439021Z" level=info msg="Removed pod sandbox: 03a3ebc997f672a134fd857baa52564dafc14e1b7d6b1ec43b3554d799e70fdf" id=c1e7f30d-83e0-4618-86d8-96ebaf66a7d4 name=/runtime.v1.RuntimeService/RemovePodSandbox
	Jul 22 10:40:39 addons-578168 crio[968]: time="2024-07-22 10:40:39.798847842Z" level=info msg="Stopping container: 0b76add32a7ff626d3aa25764dcba55cdad898a45b04f093a1486242db9c9584 (timeout: 30s)" id=1d9a5878-fc68-4617-b551-2fdec29d9026 name=/runtime.v1.RuntimeService/StopContainer
	Jul 22 10:40:40 addons-578168 crio[968]: time="2024-07-22 10:40:40.958076331Z" level=info msg="Stopped container 0b76add32a7ff626d3aa25764dcba55cdad898a45b04f093a1486242db9c9584: kube-system/metrics-server-c59844bb4-qqltc/metrics-server" id=1d9a5878-fc68-4617-b551-2fdec29d9026 name=/runtime.v1.RuntimeService/StopContainer
	Jul 22 10:40:40 addons-578168 crio[968]: time="2024-07-22 10:40:40.959032454Z" level=info msg="Stopping pod sandbox: 0a122cabab235a61a724919cb3073157cd20d2d6ea1b4e3fd9f889d7de790b56" id=f9421501-92e9-4868-aec1-d4f89fc17b76 name=/runtime.v1.RuntimeService/StopPodSandbox
	Jul 22 10:40:40 addons-578168 crio[968]: time="2024-07-22 10:40:40.959292123Z" level=info msg="Got pod network &{Name:metrics-server-c59844bb4-qqltc Namespace:kube-system ID:0a122cabab235a61a724919cb3073157cd20d2d6ea1b4e3fd9f889d7de790b56 UID:25386e93-7dbb-4ba9-948a-f1aecb63987c NetNS:/var/run/netns/526d36be-6b88-4326-84a1-35b6113395be Networks:[{Name:kindnet Ifname:eth0}] RuntimeConfig:map[kindnet:{IP: MAC: PortMappings:[] Bandwidth:<nil> IpRanges:[]}] Aliases:map[]}"
	Jul 22 10:40:40 addons-578168 crio[968]: time="2024-07-22 10:40:40.959436986Z" level=info msg="Deleting pod kube-system_metrics-server-c59844bb4-qqltc from CNI network \"kindnet\" (type=ptp)"
	Jul 22 10:40:41 addons-578168 crio[968]: time="2024-07-22 10:40:41.003871841Z" level=info msg="Stopped pod sandbox: 0a122cabab235a61a724919cb3073157cd20d2d6ea1b4e3fd9f889d7de790b56" id=f9421501-92e9-4868-aec1-d4f89fc17b76 name=/runtime.v1.RuntimeService/StopPodSandbox
	
	
	==> container status <==
	CONTAINER           IMAGE                                                                                                                   CREATED             STATE               NAME                      ATTEMPT             POD ID              POD
	823b5a445ba9c       docker.io/kicbase/echo-server@sha256:127ac38a2bb9537b7f252addff209ea6801edcac8a92c8b1104dacd66a583ed6                   3 minutes ago       Running             hello-world-app           0                   c7d2a9ee40936       hello-world-app-6778b5fc9f-gr6bg
	b4d01d48bb53c       docker.io/library/nginx@sha256:a45ee5d042aaa9e81e013f97ae40c3dda26fbe98f22b6251acdf28e579560d55                         5 minutes ago       Running             nginx                     0                   e3734fa997fcc       nginx
	fbbe6ee6ee826       ghcr.io/headlamp-k8s/headlamp@sha256:1c3f42aacd8eee1d3f1c63efb5a3b42da387ca1d87b77b0f486e8443201fcb37                   7 minutes ago       Running             headlamp                  0                   61ad506b05533       headlamp-7867546754-58m48
	652b75dc31e14       gcr.io/k8s-minikube/gcp-auth-webhook@sha256:a40e1a121ee367d1712ac3a54ec9c38c405a65dde923c98e5fa6368fa82c4b69            7 minutes ago       Running             gcp-auth                  0                   c6d17d7e77e43       gcp-auth-5db96cd9b4-hccst
	a74ae9ee85cfb       docker.io/marcnuri/yakd@sha256:1c961556224d57fc747de0b1874524208e5fb4f8386f23e9c1c4c18e97109f17                         8 minutes ago       Running             yakd                      0                   c6da73fd40036       yakd-dashboard-799879c74f-dvdml
	0b76add32a7ff       registry.k8s.io/metrics-server/metrics-server@sha256:7f0fc3565b6d4655d078bb8e250d0423d7c79aeb05fbc71e1ffa6ff664264d70   8 minutes ago       Exited              metrics-server            0                   0a122cabab235       metrics-server-c59844bb4-qqltc
	17687e7fd50ab       ba04bb24b95753201135cbc420b233c1b0b9fa2e1fd21d28319c348c33fbcde6                                                        8 minutes ago       Running             storage-provisioner       0                   80f9728c9cf1a       storage-provisioner
	fd14ed2fa3138       2437cf762177702dec2dfe99a09c37427a15af6d9a57c456b65352667c223d93                                                        8 minutes ago       Running             coredns                   0                   0fd914b6375a3       coredns-7db6d8ff4d-dz9nf
	872f619c51c41       docker.io/kindest/kindnetd@sha256:14100a3a7aca6cad3de3f26ee342ad937ca7d2844b1983d3baa7bf5f491baa7a                      9 minutes ago       Running             kindnet-cni               0                   c60df34b0605d       kindnet-pb6q8
	b89d03fa7e9ed       2351f570ed0eac5533e538280d73c6aa5d6b6f6379f5f3fac08f51378621e6be                                                        9 minutes ago       Running             kube-proxy                0                   803105df867f3       kube-proxy-qlrkl
	be869384de7f9       d48f992a22722fc0290769b8fab1186db239bbad4cff837fbb641c55faef9355                                                        9 minutes ago       Running             kube-scheduler            0                   5c26724a9fe2a       kube-scheduler-addons-578168
	d064c7ca8b93e       8e97cdb19e7cc420af7c71de8b5c9ab536bd278758c8c0878c464b833d91b31a                                                        9 minutes ago       Running             kube-controller-manager   0                   aa5aa5b5a79db       kube-controller-manager-addons-578168
	7fd0f1e313e4e       014faa467e29798aeef733fe6d1a3b5e382688217b053ad23410e6cccd5d22fd                                                        9 minutes ago       Running             etcd                      0                   7eb8f4563a931       etcd-addons-578168
	3eaa36f65893e       61773190d42ff0792f3bab2658e80b1c07519170955bb350b153b564ef28f4ca                                                        9 minutes ago       Running             kube-apiserver            0                   4be130721d1fb       kube-apiserver-addons-578168
	
	
	==> coredns [fd14ed2fa3138ce3db1337fd1c8961db47db39d56a8f8f978e98aa5cb8f0e2a4] <==
	[INFO] 10.244.0.5:52357 - 59486 "A IN registry.kube-system.svc.cluster.local.us-east-2.compute.internal. udp 83 false 512" NXDOMAIN qr,rd,ra 83 0.001920146s
	[INFO] 10.244.0.5:53083 - 28340 "A IN registry.kube-system.svc.cluster.local. udp 56 false 512" NOERROR qr,aa,rd 110 0.000186503s
	[INFO] 10.244.0.5:53083 - 55736 "AAAA IN registry.kube-system.svc.cluster.local. udp 56 false 512" NOERROR qr,aa,rd 149 0.000344994s
	[INFO] 10.244.0.5:55224 - 16438 "AAAA IN registry.kube-system.svc.cluster.local.kube-system.svc.cluster.local. udp 86 false 512" NXDOMAIN qr,aa,rd 179 0.000043759s
	[INFO] 10.244.0.5:55224 - 54325 "A IN registry.kube-system.svc.cluster.local.kube-system.svc.cluster.local. udp 86 false 512" NXDOMAIN qr,aa,rd 179 0.000120098s
	[INFO] 10.244.0.5:50099 - 36274 "AAAA IN registry.kube-system.svc.cluster.local.svc.cluster.local. udp 74 false 512" NXDOMAIN qr,aa,rd 167 0.000159074s
	[INFO] 10.244.0.5:50099 - 51636 "A IN registry.kube-system.svc.cluster.local.svc.cluster.local. udp 74 false 512" NXDOMAIN qr,aa,rd 167 0.000146126s
	[INFO] 10.244.0.5:57649 - 55913 "AAAA IN registry.kube-system.svc.cluster.local.cluster.local. udp 70 false 512" NXDOMAIN qr,aa,rd 163 0.000107766s
	[INFO] 10.244.0.5:57649 - 10599 "A IN registry.kube-system.svc.cluster.local.cluster.local. udp 70 false 512" NXDOMAIN qr,aa,rd 163 0.000112821s
	[INFO] 10.244.0.5:44206 - 23741 "AAAA IN registry.kube-system.svc.cluster.local.us-east-2.compute.internal. udp 83 false 512" NXDOMAIN qr,rd,ra 83 0.001657581s
	[INFO] 10.244.0.5:44206 - 24499 "A IN registry.kube-system.svc.cluster.local.us-east-2.compute.internal. udp 83 false 512" NXDOMAIN qr,rd,ra 83 0.002080196s
	[INFO] 10.244.0.5:44605 - 46286 "A IN registry.kube-system.svc.cluster.local. udp 56 false 512" NOERROR qr,aa,rd 110 0.000121108s
	[INFO] 10.244.0.5:44605 - 39116 "AAAA IN registry.kube-system.svc.cluster.local. udp 56 false 512" NOERROR qr,aa,rd 149 0.000090454s
	[INFO] 10.244.0.20:38241 - 13902 "AAAA IN storage.googleapis.com.gcp-auth.svc.cluster.local. udp 78 false 1232" NXDOMAIN qr,aa,rd 160 0.003755715s
	[INFO] 10.244.0.20:51409 - 21950 "A IN storage.googleapis.com.gcp-auth.svc.cluster.local. udp 78 false 1232" NXDOMAIN qr,aa,rd 160 0.003769319s
	[INFO] 10.244.0.20:51860 - 2430 "A IN storage.googleapis.com.svc.cluster.local. udp 69 false 1232" NXDOMAIN qr,aa,rd 151 0.000155078s
	[INFO] 10.244.0.20:56941 - 4409 "AAAA IN storage.googleapis.com.svc.cluster.local. udp 69 false 1232" NXDOMAIN qr,aa,rd 151 0.000176969s
	[INFO] 10.244.0.20:57940 - 46823 "AAAA IN storage.googleapis.com.cluster.local. udp 65 false 1232" NXDOMAIN qr,aa,rd 147 0.000139907s
	[INFO] 10.244.0.20:34068 - 47022 "A IN storage.googleapis.com.cluster.local. udp 65 false 1232" NXDOMAIN qr,aa,rd 147 0.000090651s
	[INFO] 10.244.0.20:39593 - 10044 "AAAA IN storage.googleapis.com.us-east-2.compute.internal. udp 78 false 1232" NXDOMAIN qr,rd,ra 67 0.002657807s
	[INFO] 10.244.0.20:54685 - 14096 "A IN storage.googleapis.com.us-east-2.compute.internal. udp 78 false 1232" NXDOMAIN qr,rd,ra 67 0.0027292s
	[INFO] 10.244.0.20:43426 - 6335 "A IN storage.googleapis.com. udp 51 false 1232" NOERROR qr,rd,ra 610 0.0014089s
	[INFO] 10.244.0.20:41275 - 18352 "AAAA IN storage.googleapis.com. udp 51 false 1232" NOERROR qr,rd,ra 240 0.002424395s
	[INFO] 10.244.0.22:57099 - 2 "AAAA IN registry.kube-system.svc.cluster.local. udp 56 false 512" NOERROR qr,aa,rd 149 0.000157613s
	[INFO] 10.244.0.22:42480 - 3 "A IN registry.kube-system.svc.cluster.local. udp 56 false 512" NOERROR qr,aa,rd 110 0.000114856s
	
	
	==> describe nodes <==
	Name:               addons-578168
	Roles:              control-plane
	Labels:             beta.kubernetes.io/arch=arm64
	                    beta.kubernetes.io/os=linux
	                    kubernetes.io/arch=arm64
	                    kubernetes.io/hostname=addons-578168
	                    kubernetes.io/os=linux
	                    minikube.k8s.io/commit=8e5b1d22910d5d447b525af478862a848159d7b7
	                    minikube.k8s.io/name=addons-578168
	                    minikube.k8s.io/primary=true
	                    minikube.k8s.io/updated_at=2024_07_22T10_31_16_0700
	                    minikube.k8s.io/version=v1.33.1
	                    node-role.kubernetes.io/control-plane=
	                    node.kubernetes.io/exclude-from-external-load-balancers=
	                    topology.hostpath.csi/node=addons-578168
	Annotations:        kubeadm.alpha.kubernetes.io/cri-socket: unix:///var/run/crio/crio.sock
	                    node.alpha.kubernetes.io/ttl: 0
	                    volumes.kubernetes.io/controller-managed-attach-detach: true
	CreationTimestamp:  Mon, 22 Jul 2024 10:31:13 +0000
	Taints:             <none>
	Unschedulable:      false
	Lease:
	  HolderIdentity:  addons-578168
	  AcquireTime:     <unset>
	  RenewTime:       Mon, 22 Jul 2024 10:40:34 +0000
	Conditions:
	  Type             Status  LastHeartbeatTime                 LastTransitionTime                Reason                       Message
	  ----             ------  -----------------                 ------------------                ------                       -------
	  MemoryPressure   False   Mon, 22 Jul 2024 10:37:24 +0000   Mon, 22 Jul 2024 10:31:10 +0000   KubeletHasSufficientMemory   kubelet has sufficient memory available
	  DiskPressure     False   Mon, 22 Jul 2024 10:37:24 +0000   Mon, 22 Jul 2024 10:31:10 +0000   KubeletHasNoDiskPressure     kubelet has no disk pressure
	  PIDPressure      False   Mon, 22 Jul 2024 10:37:24 +0000   Mon, 22 Jul 2024 10:31:10 +0000   KubeletHasSufficientPID      kubelet has sufficient PID available
	  Ready            True    Mon, 22 Jul 2024 10:37:24 +0000   Mon, 22 Jul 2024 10:31:45 +0000   KubeletReady                 kubelet is posting ready status
	Addresses:
	  InternalIP:  192.168.49.2
	  Hostname:    addons-578168
	Capacity:
	  cpu:                2
	  ephemeral-storage:  203034800Ki
	  hugepages-1Gi:      0
	  hugepages-2Mi:      0
	  hugepages-32Mi:     0
	  hugepages-64Ki:     0
	  memory:             8022360Ki
	  pods:               110
	Allocatable:
	  cpu:                2
	  ephemeral-storage:  203034800Ki
	  hugepages-1Gi:      0
	  hugepages-2Mi:      0
	  hugepages-32Mi:     0
	  hugepages-64Ki:     0
	  memory:             8022360Ki
	  pods:               110
	System Info:
	  Machine ID:                 3877af839aef4bdd8a6fb65c49ba642e
	  System UUID:                500d4ba1-5b05-4ed9-8dda-92e646b0485d
	  Boot ID:                    0ef69867-e3da-4d6a-b5e0-eebac57ce510
	  Kernel Version:             5.15.0-1064-aws
	  OS Image:                   Ubuntu 22.04.4 LTS
	  Operating System:           linux
	  Architecture:               arm64
	  Container Runtime Version:  cri-o://1.24.6
	  Kubelet Version:            v1.30.3
	  Kube-Proxy Version:         v1.30.3
	PodCIDR:                      10.244.0.0/24
	PodCIDRs:                     10.244.0.0/24
	Non-terminated Pods:          (13 in total)
	  Namespace                   Name                                     CPU Requests  CPU Limits  Memory Requests  Memory Limits  Age
	  ---------                   ----                                     ------------  ----------  ---------------  -------------  ---
	  default                     hello-world-app-6778b5fc9f-gr6bg         0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         3m29s
	  default                     nginx                                    0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         5m49s
	  gcp-auth                    gcp-auth-5db96cd9b4-hccst                0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         9m1s
	  headlamp                    headlamp-7867546754-58m48                0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         7m10s
	  kube-system                 coredns-7db6d8ff4d-dz9nf                 100m (5%!)(MISSING)     0 (0%!)(MISSING)      70Mi (0%!)(MISSING)        170Mi (2%!)(MISSING)     9m12s
	  kube-system                 etcd-addons-578168                       100m (5%!)(MISSING)     0 (0%!)(MISSING)      100Mi (1%!)(MISSING)       0 (0%!)(MISSING)         9m26s
	  kube-system                 kindnet-pb6q8                            100m (5%!)(MISSING)     100m (5%!)(MISSING)   50Mi (0%!)(MISSING)        50Mi (0%!)(MISSING)      9m13s
	  kube-system                 kube-apiserver-addons-578168             250m (12%!)(MISSING)    0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         9m26s
	  kube-system                 kube-controller-manager-addons-578168    200m (10%!)(MISSING)    0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         9m26s
	  kube-system                 kube-proxy-qlrkl                         0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         9m13s
	  kube-system                 kube-scheduler-addons-578168             100m (5%!)(MISSING)     0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         9m26s
	  kube-system                 storage-provisioner                      0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         9m6s
	  yakd-dashboard              yakd-dashboard-799879c74f-dvdml          0 (0%!)(MISSING)        0 (0%!)(MISSING)      128Mi (1%!)(MISSING)       256Mi (3%!)(MISSING)     9m6s
	Allocated resources:
	  (Total limits may be over 100 percent, i.e., overcommitted.)
	  Resource           Requests    Limits
	  --------           --------    ------
	  cpu                850m (42%!)(MISSING)  100m (5%!)(MISSING)
	  memory             348Mi (4%!)(MISSING)  476Mi (6%!)(MISSING)
	  ephemeral-storage  0 (0%!)(MISSING)      0 (0%!)(MISSING)
	  hugepages-1Gi      0 (0%!)(MISSING)      0 (0%!)(MISSING)
	  hugepages-2Mi      0 (0%!)(MISSING)      0 (0%!)(MISSING)
	  hugepages-32Mi     0 (0%!)(MISSING)      0 (0%!)(MISSING)
	  hugepages-64Ki     0 (0%!)(MISSING)      0 (0%!)(MISSING)
	Events:
	  Type    Reason                   Age                    From             Message
	  ----    ------                   ----                   ----             -------
	  Normal  Starting                 9m11s                  kube-proxy       
	  Normal  Starting                 9m26s                  kubelet          Starting kubelet.
	  Normal  NodeHasSufficientMemory  9m26s (x2 over 9m26s)  kubelet          Node addons-578168 status is now: NodeHasSufficientMemory
	  Normal  NodeHasNoDiskPressure    9m26s (x2 over 9m26s)  kubelet          Node addons-578168 status is now: NodeHasNoDiskPressure
	  Normal  NodeHasSufficientPID     9m26s (x2 over 9m26s)  kubelet          Node addons-578168 status is now: NodeHasSufficientPID
	  Normal  RegisteredNode           9m13s                  node-controller  Node addons-578168 event: Registered Node addons-578168 in Controller
	  Normal  NodeReady                8m56s                  kubelet          Node addons-578168 status is now: NodeReady
	
	
	==> dmesg <==
	[Jul22 10:17] ACPI: SRAT not present
	[  +0.000000] ACPI: SRAT not present
	[  +0.000000] SPI driver altr_a10sr has no spi_device_id for altr,a10sr
	[  +0.015445] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.
	[  +0.490841] systemd[1]: Configuration file /run/systemd/system/netplan-ovs-cleanup.service is marked world-inaccessible. This has no effect as configuration data is accessible via APIs without restrictions. Proceeding anyway.
	[  +0.063634] systemd[1]: /lib/systemd/system/cloud-init-local.service:15: Unknown key name 'ConditionEnvironment' in section 'Unit', ignoring.
	[  +0.002944] systemd[1]: /lib/systemd/system/cloud-init.service:19: Unknown key name 'ConditionEnvironment' in section 'Unit', ignoring.
	[  +0.017750] systemd[1]: /lib/systemd/system/cloud-init.target:15: Unknown key name 'ConditionEnvironment' in section 'Unit', ignoring.
	[  +0.004783] systemd[1]: /lib/systemd/system/cloud-final.service:9: Unknown key name 'ConditionEnvironment' in section 'Unit', ignoring.
	[  +0.003823] systemd[1]: /lib/systemd/system/cloud-config.service:8: Unknown key name 'ConditionEnvironment' in section 'Unit', ignoring.
	[  +0.669480] ena 0000:00:05.0: LLQ is not supported Fallback to host mode policy.
	[  +6.423928] kauditd_printk_skb: 36 callbacks suppressed
	
	
	==> etcd [7fd0f1e313e4efe8d94ceaf40a5d5c3f6bafcee15f4d9ae8fbd6a57bb89e2d32] <==
	{"level":"info","ts":"2024-07-22T10:31:10.604989Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"aec36adc501070cc received MsgPreVoteResp from aec36adc501070cc at term 1"}
	{"level":"info","ts":"2024-07-22T10:31:10.605014Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"aec36adc501070cc became candidate at term 2"}
	{"level":"info","ts":"2024-07-22T10:31:10.605021Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"aec36adc501070cc received MsgVoteResp from aec36adc501070cc at term 2"}
	{"level":"info","ts":"2024-07-22T10:31:10.60503Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"aec36adc501070cc became leader at term 2"}
	{"level":"info","ts":"2024-07-22T10:31:10.605042Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"raft.node: aec36adc501070cc elected leader aec36adc501070cc at term 2"}
	{"level":"info","ts":"2024-07-22T10:31:10.608978Z","caller":"etcdserver/server.go:2578","msg":"setting up initial cluster version using v2 API","cluster-version":"3.5"}
	{"level":"info","ts":"2024-07-22T10:31:10.611284Z","caller":"etcdserver/server.go:2068","msg":"published local member to cluster through raft","local-member-id":"aec36adc501070cc","local-member-attributes":"{Name:addons-578168 ClientURLs:[https://192.168.49.2:2379]}","request-path":"/0/members/aec36adc501070cc/attributes","cluster-id":"fa54960ea34d58be","publish-timeout":"7s"}
	{"level":"info","ts":"2024-07-22T10:31:10.611448Z","caller":"embed/serve.go:103","msg":"ready to serve client requests"}
	{"level":"info","ts":"2024-07-22T10:31:10.611774Z","caller":"embed/serve.go:103","msg":"ready to serve client requests"}
	{"level":"info","ts":"2024-07-22T10:31:10.61191Z","caller":"etcdmain/main.go:44","msg":"notifying init daemon"}
	{"level":"info","ts":"2024-07-22T10:31:10.611953Z","caller":"etcdmain/main.go:50","msg":"successfully notified init daemon"}
	{"level":"info","ts":"2024-07-22T10:31:10.612007Z","caller":"membership/cluster.go:584","msg":"set initial cluster version","cluster-id":"fa54960ea34d58be","local-member-id":"aec36adc501070cc","cluster-version":"3.5"}
	{"level":"info","ts":"2024-07-22T10:31:10.612106Z","caller":"api/capability.go:75","msg":"enabled capabilities for version","cluster-version":"3.5"}
	{"level":"info","ts":"2024-07-22T10:31:10.612152Z","caller":"etcdserver/server.go:2602","msg":"cluster version is updated","cluster-version":"3.5"}
	{"level":"info","ts":"2024-07-22T10:31:10.613745Z","caller":"embed/serve.go:250","msg":"serving client traffic securely","traffic":"grpc+http","address":"127.0.0.1:2379"}
	{"level":"info","ts":"2024-07-22T10:31:10.628555Z","caller":"embed/serve.go:250","msg":"serving client traffic securely","traffic":"grpc+http","address":"192.168.49.2:2379"}
	{"level":"warn","ts":"2024-07-22T10:31:32.025552Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"116.5802ms","expected-duration":"100ms","prefix":"","request":"header:<ID:8128030693453236363 username:\"kube-apiserver-etcd-client\" auth_revision:1 > txn:<compare:<target:MOD key:\"/registry/serviceaccounts/kube-system/coredns\" mod_revision:237 > success:<request_put:<key:\"/registry/serviceaccounts/kube-system/coredns\" value_size:124 >> failure:<request_range:<key:\"/registry/serviceaccounts/kube-system/coredns\" > >>","response":"size:16"}
	{"level":"info","ts":"2024-07-22T10:31:32.025843Z","caller":"traceutil/trace.go:171","msg":"trace[54396959] transaction","detail":"{read_only:false; response_revision:376; number_of_response:1; }","duration":"164.621654ms","start":"2024-07-22T10:31:31.861207Z","end":"2024-07-22T10:31:32.025829Z","steps":["trace[54396959] 'process raft request'  (duration: 47.40407ms)","trace[54396959] 'compare'  (duration: 116.497574ms)"],"step_count":2}
	{"level":"info","ts":"2024-07-22T10:31:32.776706Z","caller":"traceutil/trace.go:171","msg":"trace[1067895989] transaction","detail":"{read_only:false; response_revision:381; number_of_response:1; }","duration":"146.847491ms","start":"2024-07-22T10:31:32.62984Z","end":"2024-07-22T10:31:32.776687Z","steps":["trace[1067895989] 'process raft request'  (duration: 110.400877ms)","trace[1067895989] 'compare'  (duration: 35.977559ms)"],"step_count":2}
	{"level":"info","ts":"2024-07-22T10:31:32.787079Z","caller":"traceutil/trace.go:171","msg":"trace[589939883] transaction","detail":"{read_only:false; response_revision:382; number_of_response:1; }","duration":"157.173068ms","start":"2024-07-22T10:31:32.629886Z","end":"2024-07-22T10:31:32.787059Z","steps":["trace[589939883] 'process raft request'  (duration: 146.692118ms)"],"step_count":1}
	{"level":"warn","ts":"2024-07-22T10:31:33.199093Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"116.98658ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/services/specs/default/cloud-spanner-emulator\" ","response":"range_response_count:0 size:5"}
	{"level":"info","ts":"2024-07-22T10:31:33.199437Z","caller":"traceutil/trace.go:171","msg":"trace[920519791] range","detail":"{range_begin:/registry/services/specs/default/cloud-spanner-emulator; range_end:; response_count:0; response_revision:387; }","duration":"117.354081ms","start":"2024-07-22T10:31:33.082068Z","end":"2024-07-22T10:31:33.199423Z","steps":["trace[920519791] 'agreement among raft nodes before linearized reading'  (duration: 116.809176ms)"],"step_count":1}
	{"level":"info","ts":"2024-07-22T10:31:33.652577Z","caller":"traceutil/trace.go:171","msg":"trace[280530649] transaction","detail":"{read_only:false; response_revision:389; number_of_response:1; }","duration":"185.936176ms","start":"2024-07-22T10:31:33.466428Z","end":"2024-07-22T10:31:33.652364Z","steps":["trace[280530649] 'process raft request'  (duration: 85.586774ms)"],"step_count":1}
	{"level":"info","ts":"2024-07-22T10:31:33.730687Z","caller":"traceutil/trace.go:171","msg":"trace[38972565] transaction","detail":"{read_only:false; response_revision:391; number_of_response:1; }","duration":"200.123657ms","start":"2024-07-22T10:31:33.53054Z","end":"2024-07-22T10:31:33.730664Z","steps":["trace[38972565] 'process raft request'  (duration: 195.906988ms)"],"step_count":1}
	{"level":"info","ts":"2024-07-22T10:31:33.731127Z","caller":"traceutil/trace.go:171","msg":"trace[2118585148] transaction","detail":"{read_only:false; response_revision:392; number_of_response:1; }","duration":"199.226775ms","start":"2024-07-22T10:31:33.53189Z","end":"2024-07-22T10:31:33.731117Z","steps":["trace[2118585148] 'process raft request'  (duration: 195.322025ms)"],"step_count":1}
	
	
	==> gcp-auth [652b75dc31e146978082cd8f1136ce0f655ae6689f966c62a03ab828d2f351c6] <==
	2024/07/22 10:32:53 GCP Auth Webhook started!
	2024/07/22 10:33:31 Ready to marshal response ...
	2024/07/22 10:33:31 Ready to write response ...
	2024/07/22 10:33:31 Ready to marshal response ...
	2024/07/22 10:33:31 Ready to write response ...
	2024/07/22 10:33:31 Ready to marshal response ...
	2024/07/22 10:33:31 Ready to write response ...
	2024/07/22 10:33:42 Ready to marshal response ...
	2024/07/22 10:33:42 Ready to write response ...
	2024/07/22 10:33:48 Ready to marshal response ...
	2024/07/22 10:33:48 Ready to write response ...
	2024/07/22 10:33:48 Ready to marshal response ...
	2024/07/22 10:33:48 Ready to write response ...
	2024/07/22 10:33:56 Ready to marshal response ...
	2024/07/22 10:33:56 Ready to write response ...
	2024/07/22 10:34:02 Ready to marshal response ...
	2024/07/22 10:34:02 Ready to write response ...
	2024/07/22 10:34:33 Ready to marshal response ...
	2024/07/22 10:34:33 Ready to write response ...
	2024/07/22 10:34:52 Ready to marshal response ...
	2024/07/22 10:34:52 Ready to write response ...
	2024/07/22 10:37:12 Ready to marshal response ...
	2024/07/22 10:37:12 Ready to write response ...
	
	
	==> kernel <==
	 10:40:41 up 23 min,  0 users,  load average: 0.09, 0.52, 0.48
	Linux addons-578168 5.15.0-1064-aws #70~20.04.1-Ubuntu SMP Thu Jun 27 14:52:48 UTC 2024 aarch64 aarch64 aarch64 GNU/Linux
	PRETTY_NAME="Ubuntu 22.04.4 LTS"
	
	
	==> kindnet [872f619c51c416886aba341acb0c461d4f4aa14c0eb3a9141099b7525e942d7f] <==
	I0722 10:39:25.443148       1 main.go:299] handling current node
	W0722 10:39:28.835145       1 reflector.go:547] pkg/mod/k8s.io/client-go@v0.30.2/tools/cache/reflector.go:232: failed to list *v1.NetworkPolicy: networkpolicies.networking.k8s.io is forbidden: User "system:serviceaccount:kube-system:kindnet" cannot list resource "networkpolicies" in API group "networking.k8s.io" at the cluster scope
	E0722 10:39:28.835184       1 reflector.go:150] pkg/mod/k8s.io/client-go@v0.30.2/tools/cache/reflector.go:232: Failed to watch *v1.NetworkPolicy: failed to list *v1.NetworkPolicy: networkpolicies.networking.k8s.io is forbidden: User "system:serviceaccount:kube-system:kindnet" cannot list resource "networkpolicies" in API group "networking.k8s.io" at the cluster scope
	I0722 10:39:35.443996       1 main.go:295] Handling node with IPs: map[192.168.49.2:{}]
	I0722 10:39:35.444033       1 main.go:299] handling current node
	W0722 10:39:41.860487       1 reflector.go:547] pkg/mod/k8s.io/client-go@v0.30.2/tools/cache/reflector.go:232: failed to list *v1.Namespace: namespaces is forbidden: User "system:serviceaccount:kube-system:kindnet" cannot list resource "namespaces" in API group "" at the cluster scope
	E0722 10:39:41.860601       1 reflector.go:150] pkg/mod/k8s.io/client-go@v0.30.2/tools/cache/reflector.go:232: Failed to watch *v1.Namespace: failed to list *v1.Namespace: namespaces is forbidden: User "system:serviceaccount:kube-system:kindnet" cannot list resource "namespaces" in API group "" at the cluster scope
	I0722 10:39:45.443735       1 main.go:295] Handling node with IPs: map[192.168.49.2:{}]
	I0722 10:39:45.443779       1 main.go:299] handling current node
	I0722 10:39:55.443416       1 main.go:295] Handling node with IPs: map[192.168.49.2:{}]
	I0722 10:39:55.443463       1 main.go:299] handling current node
	I0722 10:40:05.443757       1 main.go:295] Handling node with IPs: map[192.168.49.2:{}]
	I0722 10:40:05.443867       1 main.go:299] handling current node
	W0722 10:40:10.424846       1 reflector.go:547] pkg/mod/k8s.io/client-go@v0.30.2/tools/cache/reflector.go:232: failed to list *v1.NetworkPolicy: networkpolicies.networking.k8s.io is forbidden: User "system:serviceaccount:kube-system:kindnet" cannot list resource "networkpolicies" in API group "networking.k8s.io" at the cluster scope
	E0722 10:40:10.424954       1 reflector.go:150] pkg/mod/k8s.io/client-go@v0.30.2/tools/cache/reflector.go:232: Failed to watch *v1.NetworkPolicy: failed to list *v1.NetworkPolicy: networkpolicies.networking.k8s.io is forbidden: User "system:serviceaccount:kube-system:kindnet" cannot list resource "networkpolicies" in API group "networking.k8s.io" at the cluster scope
	W0722 10:40:13.224293       1 reflector.go:547] pkg/mod/k8s.io/client-go@v0.30.2/tools/cache/reflector.go:232: failed to list *v1.Pod: pods is forbidden: User "system:serviceaccount:kube-system:kindnet" cannot list resource "pods" in API group "" at the cluster scope
	E0722 10:40:13.224329       1 reflector.go:150] pkg/mod/k8s.io/client-go@v0.30.2/tools/cache/reflector.go:232: Failed to watch *v1.Pod: failed to list *v1.Pod: pods is forbidden: User "system:serviceaccount:kube-system:kindnet" cannot list resource "pods" in API group "" at the cluster scope
	I0722 10:40:15.443893       1 main.go:295] Handling node with IPs: map[192.168.49.2:{}]
	I0722 10:40:15.443932       1 main.go:299] handling current node
	I0722 10:40:25.443356       1 main.go:295] Handling node with IPs: map[192.168.49.2:{}]
	I0722 10:40:25.443467       1 main.go:299] handling current node
	W0722 10:40:28.556995       1 reflector.go:547] pkg/mod/k8s.io/client-go@v0.30.2/tools/cache/reflector.go:232: failed to list *v1.Namespace: namespaces is forbidden: User "system:serviceaccount:kube-system:kindnet" cannot list resource "namespaces" in API group "" at the cluster scope
	E0722 10:40:28.557028       1 reflector.go:150] pkg/mod/k8s.io/client-go@v0.30.2/tools/cache/reflector.go:232: Failed to watch *v1.Namespace: failed to list *v1.Namespace: namespaces is forbidden: User "system:serviceaccount:kube-system:kindnet" cannot list resource "namespaces" in API group "" at the cluster scope
	I0722 10:40:35.444000       1 main.go:295] Handling node with IPs: map[192.168.49.2:{}]
	I0722 10:40:35.444042       1 main.go:299] handling current node
	
	
	==> kube-apiserver [3eaa36f65893e9ea154ad290476a76999e7fce5187e40f9b7dbac9b55955d25c] <==
	E0722 10:32:56.077484       1 available_controller.go:460] v1beta1.metrics.k8s.io failed with: failing or missing response from https://10.99.238.40:443/apis/metrics.k8s.io/v1beta1: Get "https://10.99.238.40:443/apis/metrics.k8s.io/v1beta1": dial tcp 10.99.238.40:443: connect: connection refused
	E0722 10:32:56.099300       1 available_controller.go:460] v1beta1.metrics.k8s.io failed with: failing or missing response from https://10.99.238.40:443/apis/metrics.k8s.io/v1beta1: Get "https://10.99.238.40:443/apis/metrics.k8s.io/v1beta1": dial tcp 10.99.238.40:443: connect: connection refused
	E0722 10:32:56.145386       1 available_controller.go:460] v1beta1.metrics.k8s.io failed with: failing or missing response from https://10.99.238.40:443/apis/metrics.k8s.io/v1beta1: Get "https://10.99.238.40:443/apis/metrics.k8s.io/v1beta1": dial tcp 10.99.238.40:443: connect: connection refused
	I0722 10:32:56.485169       1 handler.go:286] Adding GroupVersion metrics.k8s.io v1beta1 to ResourceManager
	I0722 10:33:31.616695       1 alloc.go:330] "allocated clusterIPs" service="headlamp/headlamp" clusterIPs={"IPv4":"10.96.110.237"}
	E0722 10:34:12.753855       1 authentication.go:73] "Unable to authenticate the request" err="[invalid bearer token, serviceaccounts \"local-path-provisioner-service-account\" not found]"
	I0722 10:34:15.104655       1 controller.go:615] quota admission added evaluator for: volumesnapshots.snapshot.storage.k8s.io
	I0722 10:34:46.621106       1 handler.go:286] Adding GroupVersion gadget.kinvolk.io v1alpha1 to ResourceManager
	W0722 10:34:47.649049       1 cacher.go:168] Terminating all watchers from cacher traces.gadget.kinvolk.io
	I0722 10:34:48.307401       1 handler.go:286] Adding GroupVersion snapshot.storage.k8s.io v1 to ResourceManager
	I0722 10:34:48.307442       1 handler.go:286] Adding GroupVersion snapshot.storage.k8s.io v1beta1 to ResourceManager
	I0722 10:34:48.332753       1 handler.go:286] Adding GroupVersion snapshot.storage.k8s.io v1 to ResourceManager
	I0722 10:34:48.332803       1 handler.go:286] Adding GroupVersion snapshot.storage.k8s.io v1beta1 to ResourceManager
	I0722 10:34:48.362666       1 handler.go:286] Adding GroupVersion snapshot.storage.k8s.io v1 to ResourceManager
	I0722 10:34:48.362709       1 handler.go:286] Adding GroupVersion snapshot.storage.k8s.io v1beta1 to ResourceManager
	I0722 10:34:48.372344       1 handler.go:286] Adding GroupVersion snapshot.storage.k8s.io v1 to ResourceManager
	I0722 10:34:48.372395       1 handler.go:286] Adding GroupVersion snapshot.storage.k8s.io v1beta1 to ResourceManager
	I0722 10:34:48.387055       1 handler.go:286] Adding GroupVersion snapshot.storage.k8s.io v1 to ResourceManager
	I0722 10:34:48.387172       1 handler.go:286] Adding GroupVersion snapshot.storage.k8s.io v1beta1 to ResourceManager
	W0722 10:34:49.363092       1 cacher.go:168] Terminating all watchers from cacher volumesnapshotclasses.snapshot.storage.k8s.io
	W0722 10:34:49.387903       1 cacher.go:168] Terminating all watchers from cacher volumesnapshotcontents.snapshot.storage.k8s.io
	W0722 10:34:49.411273       1 cacher.go:168] Terminating all watchers from cacher volumesnapshots.snapshot.storage.k8s.io
	I0722 10:34:52.195799       1 controller.go:615] quota admission added evaluator for: ingresses.networking.k8s.io
	I0722 10:34:52.494640       1 alloc.go:330] "allocated clusterIPs" service="default/nginx" clusterIPs={"IPv4":"10.105.214.49"}
	I0722 10:37:12.584364       1 alloc.go:330] "allocated clusterIPs" service="default/hello-world-app" clusterIPs={"IPv4":"10.97.90.215"}
	
	
	==> kube-controller-manager [d064c7ca8b93e4b380a00ab859233190e1fc369f5e15ecf5dfd9b54dbc650897] <==
	W0722 10:38:38.605814       1 reflector.go:547] k8s.io/client-go/metadata/metadatainformer/informer.go:138: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource
	E0722 10:38:38.605853       1 reflector.go:150] k8s.io/client-go/metadata/metadatainformer/informer.go:138: Failed to watch *v1.PartialObjectMetadata: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource
	W0722 10:38:43.863913       1 reflector.go:547] k8s.io/client-go/metadata/metadatainformer/informer.go:138: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource
	E0722 10:38:43.863954       1 reflector.go:150] k8s.io/client-go/metadata/metadatainformer/informer.go:138: Failed to watch *v1.PartialObjectMetadata: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource
	W0722 10:38:54.229415       1 reflector.go:547] k8s.io/client-go/metadata/metadatainformer/informer.go:138: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource
	E0722 10:38:54.229457       1 reflector.go:150] k8s.io/client-go/metadata/metadatainformer/informer.go:138: Failed to watch *v1.PartialObjectMetadata: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource
	W0722 10:39:10.341027       1 reflector.go:547] k8s.io/client-go/metadata/metadatainformer/informer.go:138: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource
	E0722 10:39:10.341062       1 reflector.go:150] k8s.io/client-go/metadata/metadatainformer/informer.go:138: Failed to watch *v1.PartialObjectMetadata: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource
	W0722 10:39:14.815776       1 reflector.go:547] k8s.io/client-go/metadata/metadatainformer/informer.go:138: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource
	E0722 10:39:14.815814       1 reflector.go:150] k8s.io/client-go/metadata/metadatainformer/informer.go:138: Failed to watch *v1.PartialObjectMetadata: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource
	W0722 10:39:25.813071       1 reflector.go:547] k8s.io/client-go/metadata/metadatainformer/informer.go:138: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource
	E0722 10:39:25.813116       1 reflector.go:150] k8s.io/client-go/metadata/metadatainformer/informer.go:138: Failed to watch *v1.PartialObjectMetadata: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource
	W0722 10:39:31.432893       1 reflector.go:547] k8s.io/client-go/metadata/metadatainformer/informer.go:138: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource
	E0722 10:39:31.432931       1 reflector.go:150] k8s.io/client-go/metadata/metadatainformer/informer.go:138: Failed to watch *v1.PartialObjectMetadata: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource
	W0722 10:39:50.915504       1 reflector.go:547] k8s.io/client-go/metadata/metadatainformer/informer.go:138: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource
	E0722 10:39:50.915541       1 reflector.go:150] k8s.io/client-go/metadata/metadatainformer/informer.go:138: Failed to watch *v1.PartialObjectMetadata: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource
	W0722 10:40:10.210675       1 reflector.go:547] k8s.io/client-go/metadata/metadatainformer/informer.go:138: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource
	E0722 10:40:10.210710       1 reflector.go:150] k8s.io/client-go/metadata/metadatainformer/informer.go:138: Failed to watch *v1.PartialObjectMetadata: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource
	W0722 10:40:18.371835       1 reflector.go:547] k8s.io/client-go/metadata/metadatainformer/informer.go:138: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource
	E0722 10:40:18.371875       1 reflector.go:150] k8s.io/client-go/metadata/metadatainformer/informer.go:138: Failed to watch *v1.PartialObjectMetadata: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource
	W0722 10:40:19.696497       1 reflector.go:547] k8s.io/client-go/metadata/metadatainformer/informer.go:138: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource
	E0722 10:40:19.696545       1 reflector.go:150] k8s.io/client-go/metadata/metadatainformer/informer.go:138: Failed to watch *v1.PartialObjectMetadata: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource
	W0722 10:40:33.771613       1 reflector.go:547] k8s.io/client-go/metadata/metadatainformer/informer.go:138: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource
	E0722 10:40:33.771762       1 reflector.go:150] k8s.io/client-go/metadata/metadatainformer/informer.go:138: Failed to watch *v1.PartialObjectMetadata: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource
	I0722 10:40:39.760116       1 replica_set.go:676] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="kube-system/metrics-server-c59844bb4" duration="7.27µs"
	
	
	==> kube-proxy [b89d03fa7e9ed0ffa3d2a61fb546963c18198c7a24c7257d93f144d4122fe61e] <==
	I0722 10:31:29.687313       1 server_linux.go:69] "Using iptables proxy"
	I0722 10:31:29.722969       1 server.go:1062] "Successfully retrieved node IP(s)" IPs=["192.168.49.2"]
	I0722 10:31:29.842622       1 server.go:659] "kube-proxy running in dual-stack mode" primary ipFamily="IPv4"
	I0722 10:31:29.842750       1 server_linux.go:165] "Using iptables Proxier"
	I0722 10:31:29.861562       1 server_linux.go:511] "Detect-local-mode set to ClusterCIDR, but no cluster CIDR for family" ipFamily="IPv6"
	I0722 10:31:29.862495       1 server_linux.go:528] "Defaulting to no-op detect-local"
	I0722 10:31:29.862578       1 proxier.go:243] "Setting route_localnet=1 to allow node-ports on localhost; to change this either disable iptables.localhostNodePorts (--iptables-localhost-nodeports) or set nodePortAddresses (--nodeport-addresses) to filter loopback addresses"
	I0722 10:31:29.862937       1 server.go:872] "Version info" version="v1.30.3"
	I0722 10:31:29.863149       1 server.go:874] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
	I0722 10:31:29.864104       1 config.go:192] "Starting service config controller"
	I0722 10:31:29.864216       1 shared_informer.go:313] Waiting for caches to sync for service config
	I0722 10:31:29.864272       1 config.go:101] "Starting endpoint slice config controller"
	I0722 10:31:29.864302       1 shared_informer.go:313] Waiting for caches to sync for endpoint slice config
	I0722 10:31:29.864772       1 config.go:319] "Starting node config controller"
	I0722 10:31:29.866604       1 shared_informer.go:313] Waiting for caches to sync for node config
	I0722 10:31:29.965239       1 shared_informer.go:320] Caches are synced for endpoint slice config
	I0722 10:31:29.965351       1 shared_informer.go:320] Caches are synced for service config
	I0722 10:31:29.966884       1 shared_informer.go:320] Caches are synced for node config
	
	
	==> kube-scheduler [be869384de7f9f26c6638b2090ca4d4ae3c4463e38549fcc1f474aa8077b8359] <==
	W0722 10:31:13.606085       1 reflector.go:547] k8s.io/client-go/informers/factory.go:160: failed to list *v1.CSIStorageCapacity: csistoragecapacities.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csistoragecapacities" in API group "storage.k8s.io" at the cluster scope
	E0722 10:31:13.607134       1 reflector.go:150] k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.CSIStorageCapacity: failed to list *v1.CSIStorageCapacity: csistoragecapacities.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csistoragecapacities" in API group "storage.k8s.io" at the cluster scope
	W0722 10:31:13.606155       1 reflector.go:547] k8s.io/client-go/informers/factory.go:160: failed to list *v1.Service: services is forbidden: User "system:kube-scheduler" cannot list resource "services" in API group "" at the cluster scope
	W0722 10:31:13.606193       1 reflector.go:547] k8s.io/client-go/informers/factory.go:160: failed to list *v1.StorageClass: storageclasses.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "storageclasses" in API group "storage.k8s.io" at the cluster scope
	W0722 10:31:13.606259       1 reflector.go:547] k8s.io/client-go/informers/factory.go:160: failed to list *v1.PodDisruptionBudget: poddisruptionbudgets.policy is forbidden: User "system:kube-scheduler" cannot list resource "poddisruptionbudgets" in API group "policy" at the cluster scope
	W0722 10:31:13.606294       1 reflector.go:547] k8s.io/client-go/informers/factory.go:160: failed to list *v1.StatefulSet: statefulsets.apps is forbidden: User "system:kube-scheduler" cannot list resource "statefulsets" in API group "apps" at the cluster scope
	W0722 10:31:13.606329       1 reflector.go:547] k8s.io/client-go/informers/factory.go:160: failed to list *v1.PersistentVolume: persistentvolumes is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumes" in API group "" at the cluster scope
	E0722 10:31:13.607253       1 reflector.go:150] k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.Service: failed to list *v1.Service: services is forbidden: User "system:kube-scheduler" cannot list resource "services" in API group "" at the cluster scope
	E0722 10:31:13.607302       1 reflector.go:150] k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.StorageClass: failed to list *v1.StorageClass: storageclasses.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "storageclasses" in API group "storage.k8s.io" at the cluster scope
	E0722 10:31:13.607348       1 reflector.go:150] k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.PodDisruptionBudget: failed to list *v1.PodDisruptionBudget: poddisruptionbudgets.policy is forbidden: User "system:kube-scheduler" cannot list resource "poddisruptionbudgets" in API group "policy" at the cluster scope
	E0722 10:31:13.607398       1 reflector.go:150] k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.StatefulSet: failed to list *v1.StatefulSet: statefulsets.apps is forbidden: User "system:kube-scheduler" cannot list resource "statefulsets" in API group "apps" at the cluster scope
	E0722 10:31:13.607451       1 reflector.go:150] k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.PersistentVolume: failed to list *v1.PersistentVolume: persistentvolumes is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumes" in API group "" at the cluster scope
	W0722 10:31:14.448425       1 reflector.go:547] k8s.io/client-go/informers/factory.go:160: failed to list *v1.StatefulSet: statefulsets.apps is forbidden: User "system:kube-scheduler" cannot list resource "statefulsets" in API group "apps" at the cluster scope
	E0722 10:31:14.448463       1 reflector.go:150] k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.StatefulSet: failed to list *v1.StatefulSet: statefulsets.apps is forbidden: User "system:kube-scheduler" cannot list resource "statefulsets" in API group "apps" at the cluster scope
	W0722 10:31:14.457284       1 reflector.go:547] k8s.io/client-go/informers/factory.go:160: failed to list *v1.PodDisruptionBudget: poddisruptionbudgets.policy is forbidden: User "system:kube-scheduler" cannot list resource "poddisruptionbudgets" in API group "policy" at the cluster scope
	E0722 10:31:14.457399       1 reflector.go:150] k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.PodDisruptionBudget: failed to list *v1.PodDisruptionBudget: poddisruptionbudgets.policy is forbidden: User "system:kube-scheduler" cannot list resource "poddisruptionbudgets" in API group "policy" at the cluster scope
	W0722 10:31:14.463567       1 reflector.go:547] k8s.io/client-go/informers/factory.go:160: failed to list *v1.CSIStorageCapacity: csistoragecapacities.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csistoragecapacities" in API group "storage.k8s.io" at the cluster scope
	E0722 10:31:14.463671       1 reflector.go:150] k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.CSIStorageCapacity: failed to list *v1.CSIStorageCapacity: csistoragecapacities.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csistoragecapacities" in API group "storage.k8s.io" at the cluster scope
	W0722 10:31:14.468132       1 reflector.go:547] k8s.io/client-go/informers/factory.go:160: failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csidrivers" in API group "storage.k8s.io" at the cluster scope
	E0722 10:31:14.468346       1 reflector.go:150] k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.CSIDriver: failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csidrivers" in API group "storage.k8s.io" at the cluster scope
	W0722 10:31:14.530591       1 reflector.go:547] k8s.io/client-go/informers/factory.go:160: failed to list *v1.ReplicaSet: replicasets.apps is forbidden: User "system:kube-scheduler" cannot list resource "replicasets" in API group "apps" at the cluster scope
	E0722 10:31:14.530712       1 reflector.go:150] k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.ReplicaSet: failed to list *v1.ReplicaSet: replicasets.apps is forbidden: User "system:kube-scheduler" cannot list resource "replicasets" in API group "apps" at the cluster scope
	W0722 10:31:14.578546       1 reflector.go:547] runtime/asm_arm64.s:1222: failed to list *v1.ConfigMap: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot list resource "configmaps" in API group "" in the namespace "kube-system"
	E0722 10:31:14.578666       1 reflector.go:150] runtime/asm_arm64.s:1222: Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot list resource "configmaps" in API group "" in the namespace "kube-system"
	I0722 10:31:17.292783       1 shared_informer.go:320] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file
	
	
	==> kubelet <==
	Jul 22 10:37:15 addons-578168 kubelet[1541]: I0722 10:37:15.676980    1541 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9ea7b2d6-84ca-4b41-b838-277a02fbac6e" path="/var/lib/kubelet/pods/9ea7b2d6-84ca-4b41-b838-277a02fbac6e/volumes"
	Jul 22 10:37:16 addons-578168 kubelet[1541]: I0722 10:37:16.048578    1541 scope.go:117] "RemoveContainer" containerID="134d2507c68760c489a7adfb9262d45c411b179680d8f5d4a78ab514fda59f98"
	Jul 22 10:37:16 addons-578168 kubelet[1541]: I0722 10:37:16.065072    1541 scope.go:117] "RemoveContainer" containerID="e9a6c68bccd440c3996ff62a2f009b16bc4e1a8c48e6025152a65736e39e2543"
	Jul 22 10:37:18 addons-578168 kubelet[1541]: I0722 10:37:18.092973    1541 reconciler_common.go:161] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kjnwm\" (UniqueName: \"kubernetes.io/projected/e739a650-7924-41c4-bf78-5835a8a60047-kube-api-access-kjnwm\") pod \"e739a650-7924-41c4-bf78-5835a8a60047\" (UID: \"e739a650-7924-41c4-bf78-5835a8a60047\") "
	Jul 22 10:37:18 addons-578168 kubelet[1541]: I0722 10:37:18.093037    1541 reconciler_common.go:161] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e739a650-7924-41c4-bf78-5835a8a60047-webhook-cert\") pod \"e739a650-7924-41c4-bf78-5835a8a60047\" (UID: \"e739a650-7924-41c4-bf78-5835a8a60047\") "
	Jul 22 10:37:18 addons-578168 kubelet[1541]: I0722 10:37:18.095518    1541 operation_generator.go:887] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e739a650-7924-41c4-bf78-5835a8a60047-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "e739a650-7924-41c4-bf78-5835a8a60047" (UID: "e739a650-7924-41c4-bf78-5835a8a60047"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGidValue ""
	Jul 22 10:37:18 addons-578168 kubelet[1541]: I0722 10:37:18.098863    1541 operation_generator.go:887] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e739a650-7924-41c4-bf78-5835a8a60047-kube-api-access-kjnwm" (OuterVolumeSpecName: "kube-api-access-kjnwm") pod "e739a650-7924-41c4-bf78-5835a8a60047" (UID: "e739a650-7924-41c4-bf78-5835a8a60047"). InnerVolumeSpecName "kube-api-access-kjnwm". PluginName "kubernetes.io/projected", VolumeGidValue ""
	Jul 22 10:37:18 addons-578168 kubelet[1541]: I0722 10:37:18.107657    1541 scope.go:117] "RemoveContainer" containerID="6a874d432dcdb5eb46cd1f03811d08edb612216544a177fbfa1155872ca9a99d"
	Jul 22 10:37:18 addons-578168 kubelet[1541]: I0722 10:37:18.130230    1541 scope.go:117] "RemoveContainer" containerID="6a874d432dcdb5eb46cd1f03811d08edb612216544a177fbfa1155872ca9a99d"
	Jul 22 10:37:18 addons-578168 kubelet[1541]: E0722 10:37:18.130633    1541 remote_runtime.go:432] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6a874d432dcdb5eb46cd1f03811d08edb612216544a177fbfa1155872ca9a99d\": container with ID starting with 6a874d432dcdb5eb46cd1f03811d08edb612216544a177fbfa1155872ca9a99d not found: ID does not exist" containerID="6a874d432dcdb5eb46cd1f03811d08edb612216544a177fbfa1155872ca9a99d"
	Jul 22 10:37:18 addons-578168 kubelet[1541]: I0722 10:37:18.130671    1541 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6a874d432dcdb5eb46cd1f03811d08edb612216544a177fbfa1155872ca9a99d"} err="failed to get container status \"6a874d432dcdb5eb46cd1f03811d08edb612216544a177fbfa1155872ca9a99d\": rpc error: code = NotFound desc = could not find container \"6a874d432dcdb5eb46cd1f03811d08edb612216544a177fbfa1155872ca9a99d\": container with ID starting with 6a874d432dcdb5eb46cd1f03811d08edb612216544a177fbfa1155872ca9a99d not found: ID does not exist"
	Jul 22 10:37:18 addons-578168 kubelet[1541]: I0722 10:37:18.194237    1541 reconciler_common.go:289] "Volume detached for volume \"kube-api-access-kjnwm\" (UniqueName: \"kubernetes.io/projected/e739a650-7924-41c4-bf78-5835a8a60047-kube-api-access-kjnwm\") on node \"addons-578168\" DevicePath \"\""
	Jul 22 10:37:18 addons-578168 kubelet[1541]: I0722 10:37:18.194280    1541 reconciler_common.go:289] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e739a650-7924-41c4-bf78-5835a8a60047-webhook-cert\") on node \"addons-578168\" DevicePath \"\""
	Jul 22 10:37:19 addons-578168 kubelet[1541]: I0722 10:37:19.673076    1541 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e739a650-7924-41c4-bf78-5835a8a60047" path="/var/lib/kubelet/pods/e739a650-7924-41c4-bf78-5835a8a60047/volumes"
	Jul 22 10:40:41 addons-578168 kubelet[1541]: I0722 10:40:41.123877    1541 reconciler_common.go:161] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/25386e93-7dbb-4ba9-948a-f1aecb63987c-tmp-dir\") pod \"25386e93-7dbb-4ba9-948a-f1aecb63987c\" (UID: \"25386e93-7dbb-4ba9-948a-f1aecb63987c\") "
	Jul 22 10:40:41 addons-578168 kubelet[1541]: I0722 10:40:41.123964    1541 reconciler_common.go:161] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5nwkn\" (UniqueName: \"kubernetes.io/projected/25386e93-7dbb-4ba9-948a-f1aecb63987c-kube-api-access-5nwkn\") pod \"25386e93-7dbb-4ba9-948a-f1aecb63987c\" (UID: \"25386e93-7dbb-4ba9-948a-f1aecb63987c\") "
	Jul 22 10:40:41 addons-578168 kubelet[1541]: I0722 10:40:41.124361    1541 operation_generator.go:887] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/25386e93-7dbb-4ba9-948a-f1aecb63987c-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "25386e93-7dbb-4ba9-948a-f1aecb63987c" (UID: "25386e93-7dbb-4ba9-948a-f1aecb63987c"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGidValue ""
	Jul 22 10:40:41 addons-578168 kubelet[1541]: I0722 10:40:41.126804    1541 operation_generator.go:887] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/25386e93-7dbb-4ba9-948a-f1aecb63987c-kube-api-access-5nwkn" (OuterVolumeSpecName: "kube-api-access-5nwkn") pod "25386e93-7dbb-4ba9-948a-f1aecb63987c" (UID: "25386e93-7dbb-4ba9-948a-f1aecb63987c"). InnerVolumeSpecName "kube-api-access-5nwkn". PluginName "kubernetes.io/projected", VolumeGidValue ""
	Jul 22 10:40:41 addons-578168 kubelet[1541]: I0722 10:40:41.225079    1541 reconciler_common.go:289] "Volume detached for volume \"kube-api-access-5nwkn\" (UniqueName: \"kubernetes.io/projected/25386e93-7dbb-4ba9-948a-f1aecb63987c-kube-api-access-5nwkn\") on node \"addons-578168\" DevicePath \"\""
	Jul 22 10:40:41 addons-578168 kubelet[1541]: I0722 10:40:41.225132    1541 reconciler_common.go:289] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/25386e93-7dbb-4ba9-948a-f1aecb63987c-tmp-dir\") on node \"addons-578168\" DevicePath \"\""
	Jul 22 10:40:41 addons-578168 kubelet[1541]: I0722 10:40:41.487747    1541 scope.go:117] "RemoveContainer" containerID="0b76add32a7ff626d3aa25764dcba55cdad898a45b04f093a1486242db9c9584"
	Jul 22 10:40:41 addons-578168 kubelet[1541]: I0722 10:40:41.515399    1541 scope.go:117] "RemoveContainer" containerID="0b76add32a7ff626d3aa25764dcba55cdad898a45b04f093a1486242db9c9584"
	Jul 22 10:40:41 addons-578168 kubelet[1541]: E0722 10:40:41.515891    1541 remote_runtime.go:432] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0b76add32a7ff626d3aa25764dcba55cdad898a45b04f093a1486242db9c9584\": container with ID starting with 0b76add32a7ff626d3aa25764dcba55cdad898a45b04f093a1486242db9c9584 not found: ID does not exist" containerID="0b76add32a7ff626d3aa25764dcba55cdad898a45b04f093a1486242db9c9584"
	Jul 22 10:40:41 addons-578168 kubelet[1541]: I0722 10:40:41.515927    1541 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0b76add32a7ff626d3aa25764dcba55cdad898a45b04f093a1486242db9c9584"} err="failed to get container status \"0b76add32a7ff626d3aa25764dcba55cdad898a45b04f093a1486242db9c9584\": rpc error: code = NotFound desc = could not find container \"0b76add32a7ff626d3aa25764dcba55cdad898a45b04f093a1486242db9c9584\": container with ID starting with 0b76add32a7ff626d3aa25764dcba55cdad898a45b04f093a1486242db9c9584 not found: ID does not exist"
	Jul 22 10:40:41 addons-578168 kubelet[1541]: I0722 10:40:41.672760    1541 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="25386e93-7dbb-4ba9-948a-f1aecb63987c" path="/var/lib/kubelet/pods/25386e93-7dbb-4ba9-948a-f1aecb63987c/volumes"
	
	
	==> storage-provisioner [17687e7fd50ab16cf0de5fa906428a495071a12266be1c95139407674f6af363] <==
	I0722 10:31:46.365847       1 storage_provisioner.go:116] Initializing the minikube storage provisioner...
	I0722 10:31:46.456785       1 storage_provisioner.go:141] Storage provisioner initialized, now starting service!
	I0722 10:31:46.456834       1 leaderelection.go:243] attempting to acquire leader lease kube-system/k8s.io-minikube-hostpath...
	I0722 10:31:46.466736       1 leaderelection.go:253] successfully acquired lease kube-system/k8s.io-minikube-hostpath
	I0722 10:31:46.466899       1 controller.go:835] Starting provisioner controller k8s.io/minikube-hostpath_addons-578168_6763285f-b6d2-422d-9c25-1576c5f17dd6!
	I0722 10:31:46.474149       1 event.go:282] Event(v1.ObjectReference{Kind:"Endpoints", Namespace:"kube-system", Name:"k8s.io-minikube-hostpath", UID:"505e2309-8f08-4afb-a915-aa0db0373c7e", APIVersion:"v1", ResourceVersion:"894", FieldPath:""}): type: 'Normal' reason: 'LeaderElection' addons-578168_6763285f-b6d2-422d-9c25-1576c5f17dd6 became leader
	I0722 10:31:46.567584       1 controller.go:884] Started provisioner controller k8s.io/minikube-hostpath_addons-578168_6763285f-b6d2-422d-9c25-1576c5f17dd6!
	

                                                
                                                
-- /stdout --
helpers_test.go:254: (dbg) Run:  out/minikube-linux-arm64 status --format={{.APIServer}} -p addons-578168 -n addons-578168
helpers_test.go:261: (dbg) Run:  kubectl --context addons-578168 get po -o=jsonpath={.items[*].metadata.name} -A --field-selector=status.phase!=Running
helpers_test.go:285: <<< TestAddons/parallel/MetricsServer FAILED: end of post-mortem logs <<<
helpers_test.go:286: ---------------------/post-mortem---------------------------------
--- FAIL: TestAddons/parallel/MetricsServer (353.93s)

                                                
                                    
x
+
TestStartStop/group/old-k8s-version/serial/SecondStart (374.83s)

                                                
                                                
=== RUN   TestStartStop/group/old-k8s-version/serial/SecondStart
start_stop_delete_test.go:256: (dbg) Run:  out/minikube-linux-arm64 start -p old-k8s-version-584140 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=docker  --container-runtime=crio --kubernetes-version=v1.20.0
E0722 11:28:30.762214    7564 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19313-2237/.minikube/profiles/addons-578168/client.crt: no such file or directory
E0722 11:29:19.083454    7564 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19313-2237/.minikube/profiles/functional-430070/client.crt: no such file or directory
start_stop_delete_test.go:256: (dbg) Non-zero exit: out/minikube-linux-arm64 start -p old-k8s-version-584140 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=docker  --container-runtime=crio --kubernetes-version=v1.20.0: exit status 102 (6m11.014876946s)

                                                
                                                
-- stdout --
	* [old-k8s-version-584140] minikube v1.33.1 on Ubuntu 20.04 (arm64)
	  - MINIKUBE_LOCATION=19313
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - KUBECONFIG=/home/jenkins/minikube-integration/19313-2237/kubeconfig
	  - MINIKUBE_HOME=/home/jenkins/minikube-integration/19313-2237/.minikube
	  - MINIKUBE_BIN=out/minikube-linux-arm64
	  - MINIKUBE_FORCE_SYSTEMD=
	* Kubernetes 1.30.3 is now available. If you would like to upgrade, specify: --kubernetes-version=v1.30.3
	* Using the docker driver based on existing profile
	* Starting "old-k8s-version-584140" primary control-plane node in "old-k8s-version-584140" cluster
	* Pulling base image v0.0.44-1721324606-19298 ...
	* Restarting existing docker container for "old-k8s-version-584140" ...
	* Preparing Kubernetes v1.20.0 on CRI-O 1.24.6 ...
	* Verifying Kubernetes components...
	  - Using image gcr.io/k8s-minikube/storage-provisioner:v5
	  - Using image fake.domain/registry.k8s.io/echoserver:1.4
	  - Using image docker.io/kubernetesui/dashboard:v2.7.0
	  - Using image registry.k8s.io/echoserver:1.4
	* Some dashboard features require the metrics-server addon. To enable all features please run:
	
		minikube -p old-k8s-version-584140 addons enable metrics-server
	
	* Enabled addons: metrics-server, storage-provisioner, dashboard, default-storageclass
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0722 11:26:13.583198  210080 out.go:291] Setting OutFile to fd 1 ...
	I0722 11:26:13.583425  210080 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0722 11:26:13.583438  210080 out.go:304] Setting ErrFile to fd 2...
	I0722 11:26:13.583443  210080 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0722 11:26:13.583731  210080 root.go:338] Updating PATH: /home/jenkins/minikube-integration/19313-2237/.minikube/bin
	I0722 11:26:13.584184  210080 out.go:298] Setting JSON to false
	I0722 11:26:13.585347  210080 start.go:129] hostinfo: {"hostname":"ip-172-31-21-244","uptime":4118,"bootTime":1721643455,"procs":210,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1064-aws","kernelArch":"aarch64","virtualizationSystem":"","virtualizationRole":"","hostId":"da8ac1fd-6236-412a-a346-95873c98230d"}
	I0722 11:26:13.585419  210080 start.go:139] virtualization:  
	I0722 11:26:13.589343  210080 out.go:177] * [old-k8s-version-584140] minikube v1.33.1 on Ubuntu 20.04 (arm64)
	I0722 11:26:13.591205  210080 notify.go:220] Checking for updates...
	I0722 11:26:13.596939  210080 out.go:177]   - MINIKUBE_LOCATION=19313
	I0722 11:26:13.598533  210080 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I0722 11:26:13.600277  210080 out.go:177]   - KUBECONFIG=/home/jenkins/minikube-integration/19313-2237/kubeconfig
	I0722 11:26:13.602332  210080 out.go:177]   - MINIKUBE_HOME=/home/jenkins/minikube-integration/19313-2237/.minikube
	I0722 11:26:13.604070  210080 out.go:177]   - MINIKUBE_BIN=out/minikube-linux-arm64
	I0722 11:26:13.606055  210080 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=
	I0722 11:26:13.608200  210080 config.go:182] Loaded profile config "old-k8s-version-584140": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.20.0
	I0722 11:26:13.610698  210080 out.go:177] * Kubernetes 1.30.3 is now available. If you would like to upgrade, specify: --kubernetes-version=v1.30.3
	I0722 11:26:13.612496  210080 driver.go:392] Setting default libvirt URI to qemu:///system
	I0722 11:26:13.641141  210080 docker.go:123] docker version: linux-27.0.3:Docker Engine - Community
	I0722 11:26:13.641252  210080 cli_runner.go:164] Run: docker system info --format "{{json .}}"
	I0722 11:26:13.724717  210080 info.go:266] docker info: {ID:5FDH:SA5P:5GCT:NLAS:B73P:SGDQ:PBG5:UBVH:UZY3:RXGO:CI7S:WAIH Containers:2 ContainersRunning:1 ContainersPaused:0 ContainersStopped:1 Images:4 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:39 OomKillDisable:true NGoroutines:53 SystemTime:2024-07-22 11:26:13.71528019 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1064-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Architecture:aarc
h64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8214896640 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-21-244 Labels:[] ExperimentalBuild:false ServerVersion:27.0.3 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:2bf793ef6dc9a18e00cb12efb64355c2c9d5eb41 Expected:2bf793ef6dc9a18e00cb12efb64355c2c9d5eb41} RuncCommit:{ID:v1.1.13-0-g58aa920 Expected:v1.1.13-0-g58aa920} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:<nil> ServerError
s:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.15.1] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.28.1]] Warnings:<nil>}}
	I0722 11:26:13.724830  210080 docker.go:307] overlay module found
	I0722 11:26:13.727750  210080 out.go:177] * Using the docker driver based on existing profile
	I0722 11:26:13.729447  210080 start.go:297] selected driver: docker
	I0722 11:26:13.729468  210080 start.go:901] validating driver "docker" against &{Name:old-k8s-version-584140 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721324606-19298@sha256:1c495b056df42bd3fd9a5c30d049e1802f9ed73a342611781f1ccc3c3853953f Memory:2200 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-584140 Namespace:default APIServerHAVIP: AP
IServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.76.2 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[dashboard:true default-storageclass:true metrics-server:true storage-provisioner:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4 MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountStr
ing:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I0722 11:26:13.729586  210080 start.go:912] status for docker: {Installed:true Healthy:true Running:false NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I0722 11:26:13.730271  210080 cli_runner.go:164] Run: docker system info --format "{{json .}}"
	I0722 11:26:13.817237  210080 info.go:266] docker info: {ID:5FDH:SA5P:5GCT:NLAS:B73P:SGDQ:PBG5:UBVH:UZY3:RXGO:CI7S:WAIH Containers:2 ContainersRunning:1 ContainersPaused:0 ContainersStopped:1 Images:4 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:39 OomKillDisable:true NGoroutines:53 SystemTime:2024-07-22 11:26:13.808328456 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1064-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Architecture:aar
ch64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8214896640 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-21-244 Labels:[] ExperimentalBuild:false ServerVersion:27.0.3 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:2bf793ef6dc9a18e00cb12efb64355c2c9d5eb41 Expected:2bf793ef6dc9a18e00cb12efb64355c2c9d5eb41} RuncCommit:{ID:v1.1.13-0-g58aa920 Expected:v1.1.13-0-g58aa920} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:<nil> ServerErro
rs:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.15.1] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.28.1]] Warnings:<nil>}}
	I0722 11:26:13.817567  210080 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
	I0722 11:26:13.817587  210080 cni.go:84] Creating CNI manager for ""
	I0722 11:26:13.817596  210080 cni.go:143] "docker" driver + "crio" runtime found, recommending kindnet
	I0722 11:26:13.817643  210080 start.go:340] cluster config:
	{Name:old-k8s-version-584140 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721324606-19298@sha256:1c495b056df42bd3fd9a5c30d049e1802f9ed73a342611781f1ccc3c3853953f Memory:2200 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-584140 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local
ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.76.2 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[dashboard:true default-storageclass:true metrics-server:true storage-provisioner:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4 MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP
: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I0722 11:26:13.819906  210080 out.go:177] * Starting "old-k8s-version-584140" primary control-plane node in "old-k8s-version-584140" cluster
	I0722 11:26:13.821751  210080 cache.go:121] Beginning downloading kic base image for docker with crio
	I0722 11:26:13.823684  210080 out.go:177] * Pulling base image v0.0.44-1721324606-19298 ...
	I0722 11:26:13.827204  210080 preload.go:131] Checking if preload exists for k8s version v1.20.0 and runtime crio
	I0722 11:26:13.827271  210080 preload.go:146] Found local preload: /home/jenkins/minikube-integration/19313-2237/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-cri-o-overlay-arm64.tar.lz4
	I0722 11:26:13.827293  210080 cache.go:56] Caching tarball of preloaded images
	I0722 11:26:13.827379  210080 preload.go:172] Found /home/jenkins/minikube-integration/19313-2237/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-cri-o-overlay-arm64.tar.lz4 in cache, skipping download
	I0722 11:26:13.827388  210080 cache.go:59] Finished verifying existence of preloaded tar for v1.20.0 on crio
	I0722 11:26:13.827498  210080 profile.go:143] Saving config to /home/jenkins/minikube-integration/19313-2237/.minikube/profiles/old-k8s-version-584140/config.json ...
	I0722 11:26:13.827729  210080 image.go:79] Checking for gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721324606-19298@sha256:1c495b056df42bd3fd9a5c30d049e1802f9ed73a342611781f1ccc3c3853953f in local docker daemon
	W0722 11:26:13.848183  210080 image.go:95] image gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721324606-19298@sha256:1c495b056df42bd3fd9a5c30d049e1802f9ed73a342611781f1ccc3c3853953f is of wrong architecture
	I0722 11:26:13.848202  210080 cache.go:149] Downloading gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721324606-19298@sha256:1c495b056df42bd3fd9a5c30d049e1802f9ed73a342611781f1ccc3c3853953f to local cache
	I0722 11:26:13.848291  210080 image.go:63] Checking for gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721324606-19298@sha256:1c495b056df42bd3fd9a5c30d049e1802f9ed73a342611781f1ccc3c3853953f in local cache directory
	I0722 11:26:13.848309  210080 image.go:66] Found gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721324606-19298@sha256:1c495b056df42bd3fd9a5c30d049e1802f9ed73a342611781f1ccc3c3853953f in local cache directory, skipping pull
	I0722 11:26:13.848314  210080 image.go:135] gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721324606-19298@sha256:1c495b056df42bd3fd9a5c30d049e1802f9ed73a342611781f1ccc3c3853953f exists in cache, skipping pull
	I0722 11:26:13.848322  210080 cache.go:152] successfully saved gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721324606-19298@sha256:1c495b056df42bd3fd9a5c30d049e1802f9ed73a342611781f1ccc3c3853953f as a tarball
	I0722 11:26:13.848327  210080 cache.go:162] Loading gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721324606-19298@sha256:1c495b056df42bd3fd9a5c30d049e1802f9ed73a342611781f1ccc3c3853953f from local cache
	I0722 11:26:13.976175  210080 cache.go:164] successfully loaded and using gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721324606-19298@sha256:1c495b056df42bd3fd9a5c30d049e1802f9ed73a342611781f1ccc3c3853953f from cached tarball
	I0722 11:26:13.976221  210080 cache.go:194] Successfully downloaded all kic artifacts
	I0722 11:26:13.976258  210080 start.go:360] acquireMachinesLock for old-k8s-version-584140: {Name:mkb562e2b9b0fb1f72dbe73cc5483758be061e7f Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0722 11:26:13.976342  210080 start.go:364] duration metric: took 54.993µs to acquireMachinesLock for "old-k8s-version-584140"
	I0722 11:26:13.976368  210080 start.go:96] Skipping create...Using existing machine configuration
	I0722 11:26:13.976377  210080 fix.go:54] fixHost starting: 
	I0722 11:26:13.976657  210080 cli_runner.go:164] Run: docker container inspect old-k8s-version-584140 --format={{.State.Status}}
	I0722 11:26:13.994422  210080 fix.go:112] recreateIfNeeded on old-k8s-version-584140: state=Stopped err=<nil>
	W0722 11:26:13.994452  210080 fix.go:138] unexpected machine state, will restart: <nil>
	I0722 11:26:13.996999  210080 out.go:177] * Restarting existing docker container for "old-k8s-version-584140" ...
	I0722 11:26:13.998767  210080 cli_runner.go:164] Run: docker start old-k8s-version-584140
	I0722 11:26:14.335604  210080 cli_runner.go:164] Run: docker container inspect old-k8s-version-584140 --format={{.State.Status}}
	I0722 11:26:14.367790  210080 kic.go:430] container "old-k8s-version-584140" state is running.
	I0722 11:26:14.368188  210080 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" old-k8s-version-584140
	I0722 11:26:14.394947  210080 profile.go:143] Saving config to /home/jenkins/minikube-integration/19313-2237/.minikube/profiles/old-k8s-version-584140/config.json ...
	I0722 11:26:14.395176  210080 machine.go:94] provisionDockerMachine start ...
	I0722 11:26:14.395245  210080 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-584140
	I0722 11:26:14.421396  210080 main.go:141] libmachine: Using SSH client type: native
	I0722 11:26:14.421707  210080 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x3e2cd0] 0x3e5530 <nil>  [] 0s} 127.0.0.1 33063 <nil> <nil>}
	I0722 11:26:14.421724  210080 main.go:141] libmachine: About to run SSH command:
	hostname
	I0722 11:26:14.422331  210080 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: EOF
	I0722 11:26:17.569193  210080 main.go:141] libmachine: SSH cmd err, output: <nil>: old-k8s-version-584140
	
	I0722 11:26:17.569218  210080 ubuntu.go:169] provisioning hostname "old-k8s-version-584140"
	I0722 11:26:17.569288  210080 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-584140
	I0722 11:26:17.589637  210080 main.go:141] libmachine: Using SSH client type: native
	I0722 11:26:17.589976  210080 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x3e2cd0] 0x3e5530 <nil>  [] 0s} 127.0.0.1 33063 <nil> <nil>}
	I0722 11:26:17.589997  210080 main.go:141] libmachine: About to run SSH command:
	sudo hostname old-k8s-version-584140 && echo "old-k8s-version-584140" | sudo tee /etc/hostname
	I0722 11:26:17.737837  210080 main.go:141] libmachine: SSH cmd err, output: <nil>: old-k8s-version-584140
	
	I0722 11:26:17.737927  210080 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-584140
	I0722 11:26:17.762830  210080 main.go:141] libmachine: Using SSH client type: native
	I0722 11:26:17.763121  210080 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x3e2cd0] 0x3e5530 <nil>  [] 0s} 127.0.0.1 33063 <nil> <nil>}
	I0722 11:26:17.763145  210080 main.go:141] libmachine: About to run SSH command:
	
			if ! grep -xq '.*\sold-k8s-version-584140' /etc/hosts; then
				if grep -xq '127.0.1.1\s.*' /etc/hosts; then
					sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 old-k8s-version-584140/g' /etc/hosts;
				else 
					echo '127.0.1.1 old-k8s-version-584140' | sudo tee -a /etc/hosts; 
				fi
			fi
	I0722 11:26:17.908847  210080 main.go:141] libmachine: SSH cmd err, output: <nil>: 
	I0722 11:26:17.908953  210080 ubuntu.go:175] set auth options {CertDir:/home/jenkins/minikube-integration/19313-2237/.minikube CaCertPath:/home/jenkins/minikube-integration/19313-2237/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/19313-2237/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/19313-2237/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/19313-2237/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/19313-2237/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/19313-2237/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/19313-2237/.minikube}
	I0722 11:26:17.909008  210080 ubuntu.go:177] setting up certificates
	I0722 11:26:17.909036  210080 provision.go:84] configureAuth start
	I0722 11:26:17.909124  210080 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" old-k8s-version-584140
	I0722 11:26:17.938675  210080 provision.go:143] copyHostCerts
	I0722 11:26:17.938755  210080 exec_runner.go:144] found /home/jenkins/minikube-integration/19313-2237/.minikube/key.pem, removing ...
	I0722 11:26:17.938764  210080 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19313-2237/.minikube/key.pem
	I0722 11:26:17.938835  210080 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19313-2237/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/19313-2237/.minikube/key.pem (1679 bytes)
	I0722 11:26:17.938930  210080 exec_runner.go:144] found /home/jenkins/minikube-integration/19313-2237/.minikube/ca.pem, removing ...
	I0722 11:26:17.938936  210080 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19313-2237/.minikube/ca.pem
	I0722 11:26:17.938962  210080 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19313-2237/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/19313-2237/.minikube/ca.pem (1078 bytes)
	I0722 11:26:17.939018  210080 exec_runner.go:144] found /home/jenkins/minikube-integration/19313-2237/.minikube/cert.pem, removing ...
	I0722 11:26:17.939023  210080 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19313-2237/.minikube/cert.pem
	I0722 11:26:17.939047  210080 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19313-2237/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/19313-2237/.minikube/cert.pem (1123 bytes)
	I0722 11:26:17.939091  210080 provision.go:117] generating server cert: /home/jenkins/minikube-integration/19313-2237/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/19313-2237/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/19313-2237/.minikube/certs/ca-key.pem org=jenkins.old-k8s-version-584140 san=[127.0.0.1 192.168.76.2 localhost minikube old-k8s-version-584140]
	I0722 11:26:18.209155  210080 provision.go:177] copyRemoteCerts
	I0722 11:26:18.209273  210080 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
	I0722 11:26:18.209346  210080 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-584140
	I0722 11:26:18.227782  210080 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33063 SSHKeyPath:/home/jenkins/minikube-integration/19313-2237/.minikube/machines/old-k8s-version-584140/id_rsa Username:docker}
	I0722 11:26:18.322344  210080 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19313-2237/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1078 bytes)
	I0722 11:26:18.365241  210080 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19313-2237/.minikube/machines/server.pem --> /etc/docker/server.pem (1233 bytes)
	I0722 11:26:18.402267  210080 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19313-2237/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1675 bytes)
	I0722 11:26:18.429257  210080 provision.go:87] duration metric: took 520.195137ms to configureAuth
	I0722 11:26:18.429330  210080 ubuntu.go:193] setting minikube options for container-runtime
	I0722 11:26:18.429580  210080 config.go:182] Loaded profile config "old-k8s-version-584140": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.20.0
	I0722 11:26:18.429729  210080 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-584140
	I0722 11:26:18.449005  210080 main.go:141] libmachine: Using SSH client type: native
	I0722 11:26:18.449254  210080 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x3e2cd0] 0x3e5530 <nil>  [] 0s} 127.0.0.1 33063 <nil> <nil>}
	I0722 11:26:18.449275  210080 main.go:141] libmachine: About to run SSH command:
	sudo mkdir -p /etc/sysconfig && printf %s "
	CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
	" | sudo tee /etc/sysconfig/crio.minikube && sudo systemctl restart crio
	I0722 11:26:18.902432  210080 main.go:141] libmachine: SSH cmd err, output: <nil>: 
	CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
	
	I0722 11:26:18.902464  210080 machine.go:97] duration metric: took 4.507271664s to provisionDockerMachine
	I0722 11:26:18.902476  210080 start.go:293] postStartSetup for "old-k8s-version-584140" (driver="docker")
	I0722 11:26:18.902488  210080 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
	I0722 11:26:18.902561  210080 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
	I0722 11:26:18.902622  210080 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-584140
	I0722 11:26:18.927570  210080 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33063 SSHKeyPath:/home/jenkins/minikube-integration/19313-2237/.minikube/machines/old-k8s-version-584140/id_rsa Username:docker}
	I0722 11:26:19.037857  210080 ssh_runner.go:195] Run: cat /etc/os-release
	I0722 11:26:19.043285  210080 main.go:141] libmachine: Couldn't set key VERSION_CODENAME, no corresponding struct field found
	I0722 11:26:19.043323  210080 main.go:141] libmachine: Couldn't set key PRIVACY_POLICY_URL, no corresponding struct field found
	I0722 11:26:19.043334  210080 main.go:141] libmachine: Couldn't set key UBUNTU_CODENAME, no corresponding struct field found
	I0722 11:26:19.043341  210080 info.go:137] Remote host: Ubuntu 22.04.4 LTS
	I0722 11:26:19.043355  210080 filesync.go:126] Scanning /home/jenkins/minikube-integration/19313-2237/.minikube/addons for local assets ...
	I0722 11:26:19.043412  210080 filesync.go:126] Scanning /home/jenkins/minikube-integration/19313-2237/.minikube/files for local assets ...
	I0722 11:26:19.043496  210080 filesync.go:149] local asset: /home/jenkins/minikube-integration/19313-2237/.minikube/files/etc/ssl/certs/75642.pem -> 75642.pem in /etc/ssl/certs
	I0722 11:26:19.043600  210080 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs
	I0722 11:26:19.057047  210080 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19313-2237/.minikube/files/etc/ssl/certs/75642.pem --> /etc/ssl/certs/75642.pem (1708 bytes)
	I0722 11:26:19.084426  210080 start.go:296] duration metric: took 181.934557ms for postStartSetup
	I0722 11:26:19.084544  210080 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
	I0722 11:26:19.084601  210080 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-584140
	I0722 11:26:19.109323  210080 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33063 SSHKeyPath:/home/jenkins/minikube-integration/19313-2237/.minikube/machines/old-k8s-version-584140/id_rsa Username:docker}
	I0722 11:26:19.210241  210080 ssh_runner.go:195] Run: sh -c "df -BG /var | awk 'NR==2{print $4}'"
	I0722 11:26:19.215827  210080 fix.go:56] duration metric: took 5.239442574s for fixHost
	I0722 11:26:19.215854  210080 start.go:83] releasing machines lock for "old-k8s-version-584140", held for 5.239499724s
	I0722 11:26:19.215928  210080 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" old-k8s-version-584140
	I0722 11:26:19.239413  210080 ssh_runner.go:195] Run: cat /version.json
	I0722 11:26:19.239476  210080 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-584140
	I0722 11:26:19.239754  210080 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/
	I0722 11:26:19.239810  210080 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-584140
	I0722 11:26:19.264062  210080 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33063 SSHKeyPath:/home/jenkins/minikube-integration/19313-2237/.minikube/machines/old-k8s-version-584140/id_rsa Username:docker}
	I0722 11:26:19.274930  210080 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33063 SSHKeyPath:/home/jenkins/minikube-integration/19313-2237/.minikube/machines/old-k8s-version-584140/id_rsa Username:docker}
	I0722 11:26:19.360909  210080 ssh_runner.go:195] Run: systemctl --version
	I0722 11:26:19.500284  210080 ssh_runner.go:195] Run: sudo sh -c "podman version >/dev/null"
	I0722 11:26:19.661981  210080 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"
	I0722 11:26:19.666238  210080 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f -name *loopback.conf* -not -name *.mk_disabled -exec sh -c "sudo mv {} {}.mk_disabled" ;
	I0722 11:26:19.680158  210080 cni.go:221] loopback cni configuration disabled: "/etc/cni/net.d/*loopback.conf*" found
	I0722 11:26:19.680229  210080 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%p, " -exec sh -c "sudo mv {} {}.mk_disabled" ;
	I0722 11:26:19.697801  210080 cni.go:259] no active bridge cni configs found in "/etc/cni/net.d" - nothing to disable
	I0722 11:26:19.697823  210080 start.go:495] detecting cgroup driver to use...
	I0722 11:26:19.697855  210080 detect.go:187] detected "cgroupfs" cgroup driver on host os
	I0722 11:26:19.697908  210080 ssh_runner.go:195] Run: sudo systemctl stop -f containerd
	I0722 11:26:19.713967  210080 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd
	I0722 11:26:19.731454  210080 docker.go:217] disabling cri-docker service (if available) ...
	I0722 11:26:19.731515  210080 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.socket
	I0722 11:26:19.747541  210080 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.service
	I0722 11:26:19.760666  210080 ssh_runner.go:195] Run: sudo systemctl disable cri-docker.socket
	I0722 11:26:19.877354  210080 ssh_runner.go:195] Run: sudo systemctl mask cri-docker.service
	I0722 11:26:19.999195  210080 docker.go:233] disabling docker service ...
	I0722 11:26:19.999269  210080 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket
	I0722 11:26:20.015951  210080 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service
	I0722 11:26:20.043374  210080 ssh_runner.go:195] Run: sudo systemctl disable docker.socket
	I0722 11:26:20.191036  210080 ssh_runner.go:195] Run: sudo systemctl mask docker.service
	I0722 11:26:20.342247  210080 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker
	I0722 11:26:20.355556  210080 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///var/run/crio/crio.sock
	" | sudo tee /etc/crictl.yaml"
	I0722 11:26:20.374086  210080 crio.go:59] configure cri-o to use "registry.k8s.io/pause:3.2" pause image...
	I0722 11:26:20.374166  210080 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*pause_image = .*$|pause_image = "registry.k8s.io/pause:3.2"|' /etc/crio/crio.conf.d/02-crio.conf"
	I0722 11:26:20.390271  210080 crio.go:70] configuring cri-o to use "cgroupfs" as cgroup driver...
	I0722 11:26:20.390393  210080 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*cgroup_manager = .*$|cgroup_manager = "cgroupfs"|' /etc/crio/crio.conf.d/02-crio.conf"
	I0722 11:26:20.401167  210080 ssh_runner.go:195] Run: sh -c "sudo sed -i '/conmon_cgroup = .*/d' /etc/crio/crio.conf.d/02-crio.conf"
	I0722 11:26:20.412024  210080 ssh_runner.go:195] Run: sh -c "sudo sed -i '/cgroup_manager = .*/a conmon_cgroup = "pod"' /etc/crio/crio.conf.d/02-crio.conf"
	I0722 11:26:20.422553  210080 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"
	I0722 11:26:20.433429  210080 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
	I0722 11:26:20.445498  210080 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
	I0722 11:26:20.454793  210080 ssh_runner.go:195] Run: sudo systemctl daemon-reload
	I0722 11:26:20.552437  210080 ssh_runner.go:195] Run: sudo systemctl restart crio
	I0722 11:26:21.168329  210080 start.go:542] Will wait 60s for socket path /var/run/crio/crio.sock
	I0722 11:26:21.168448  210080 ssh_runner.go:195] Run: stat /var/run/crio/crio.sock
	I0722 11:26:21.180625  210080 start.go:563] Will wait 60s for crictl version
	I0722 11:26:21.180720  210080 ssh_runner.go:195] Run: which crictl
	I0722 11:26:21.184010  210080 ssh_runner.go:195] Run: sudo /usr/bin/crictl version
	I0722 11:26:21.229362  210080 start.go:579] Version:  0.1.0
	RuntimeName:  cri-o
	RuntimeVersion:  1.24.6
	RuntimeApiVersion:  v1
	I0722 11:26:21.229471  210080 ssh_runner.go:195] Run: crio --version
	I0722 11:26:21.275698  210080 ssh_runner.go:195] Run: crio --version
	I0722 11:26:21.333595  210080 out.go:177] * Preparing Kubernetes v1.20.0 on CRI-O 1.24.6 ...
	I0722 11:26:21.335545  210080 cli_runner.go:164] Run: docker network inspect old-k8s-version-584140 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
	I0722 11:26:21.358615  210080 ssh_runner.go:195] Run: grep 192.168.76.1	host.minikube.internal$ /etc/hosts
	I0722 11:26:21.363023  210080 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.76.1	host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
	I0722 11:26:21.375208  210080 kubeadm.go:883] updating cluster {Name:old-k8s-version-584140 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721324606-19298@sha256:1c495b056df42bd3fd9a5c30d049e1802f9ed73a342611781f1ccc3c3853953f Memory:2200 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-584140 Namespace:default APIServerHAVIP: APIServerName:minik
ubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.76.2 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[dashboard:true default-storageclass:true metrics-server:true storage-provisioner:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4 MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins
:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} ...
	I0722 11:26:21.375331  210080 preload.go:131] Checking if preload exists for k8s version v1.20.0 and runtime crio
	I0722 11:26:21.375398  210080 ssh_runner.go:195] Run: sudo crictl images --output json
	I0722 11:26:21.461248  210080 crio.go:514] all images are preloaded for cri-o runtime.
	I0722 11:26:21.461274  210080 crio.go:433] Images already preloaded, skipping extraction
	I0722 11:26:21.461331  210080 ssh_runner.go:195] Run: sudo crictl images --output json
	I0722 11:26:21.559489  210080 crio.go:514] all images are preloaded for cri-o runtime.
	I0722 11:26:21.559514  210080 cache_images.go:84] Images are preloaded, skipping loading
	I0722 11:26:21.559546  210080 kubeadm.go:934] updating node { 192.168.76.2 8443 v1.20.0 crio true true} ...
	I0722 11:26:21.559703  210080 kubeadm.go:946] kubelet [Unit]
	Wants=crio.service
	
	[Service]
	ExecStart=
	ExecStart=/var/lib/minikube/binaries/v1.20.0/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --cgroups-per-qos=false --config=/var/lib/kubelet/config.yaml --container-runtime=remote --container-runtime-endpoint=unix:///var/run/crio/crio.sock --enforce-node-allocatable= --hostname-override=old-k8s-version-584140 --kubeconfig=/etc/kubernetes/kubelet.conf --network-plugin=cni --node-ip=192.168.76.2
	
	[Install]
	 config:
	{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-584140 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:}
	I0722 11:26:21.559821  210080 ssh_runner.go:195] Run: crio config
	I0722 11:26:21.640691  210080 cni.go:84] Creating CNI manager for ""
	I0722 11:26:21.640726  210080 cni.go:143] "docker" driver + "crio" runtime found, recommending kindnet
	I0722 11:26:21.640738  210080 kubeadm.go:84] Using pod CIDR: 10.244.0.0/16
	I0722 11:26:21.640816  210080 kubeadm.go:181] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.76.2 APIServerPort:8443 KubernetesVersion:v1.20.0 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:old-k8s-version-584140 NodeName:old-k8s-version-584140 DNSDomain:cluster.local CRISocket:/var/run/crio/crio.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.76.2"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.76.2 CgroupDriver:cgroupfs ClientCAFile:/var/lib/minikube/certs/ca.crt StaticPo
dPath:/etc/kubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:false}
	I0722 11:26:21.641022  210080 kubeadm.go:187] kubeadm config:
	apiVersion: kubeadm.k8s.io/v1beta2
	kind: InitConfiguration
	localAPIEndpoint:
	  advertiseAddress: 192.168.76.2
	  bindPort: 8443
	bootstrapTokens:
	  - groups:
	      - system:bootstrappers:kubeadm:default-node-token
	    ttl: 24h0m0s
	    usages:
	      - signing
	      - authentication
	nodeRegistration:
	  criSocket: /var/run/crio/crio.sock
	  name: "old-k8s-version-584140"
	  kubeletExtraArgs:
	    node-ip: 192.168.76.2
	  taints: []
	---
	apiVersion: kubeadm.k8s.io/v1beta2
	kind: ClusterConfiguration
	apiServer:
	  certSANs: ["127.0.0.1", "localhost", "192.168.76.2"]
	  extraArgs:
	    enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"
	controllerManager:
	  extraArgs:
	    allocate-node-cidrs: "true"
	    leader-elect: "false"
	scheduler:
	  extraArgs:
	    leader-elect: "false"
	certificatesDir: /var/lib/minikube/certs
	clusterName: mk
	controlPlaneEndpoint: control-plane.minikube.internal:8443
	dns:
	  type: CoreDNS
	etcd:
	  local:
	    dataDir: /var/lib/minikube/etcd
	    extraArgs:
	      proxy-refresh-interval: "70000"
	kubernetesVersion: v1.20.0
	networking:
	  dnsDomain: cluster.local
	  podSubnet: "10.244.0.0/16"
	  serviceSubnet: 10.96.0.0/12
	---
	apiVersion: kubelet.config.k8s.io/v1beta1
	kind: KubeletConfiguration
	authentication:
	  x509:
	    clientCAFile: /var/lib/minikube/certs/ca.crt
	cgroupDriver: cgroupfs
	hairpinMode: hairpin-veth
	runtimeRequestTimeout: 15m
	clusterDomain: "cluster.local"
	# disable disk resource management by default
	imageGCHighThresholdPercent: 100
	evictionHard:
	  nodefs.available: "0%"
	  nodefs.inodesFree: "0%"
	  imagefs.available: "0%"
	failSwapOn: false
	staticPodPath: /etc/kubernetes/manifests
	---
	apiVersion: kubeproxy.config.k8s.io/v1alpha1
	kind: KubeProxyConfiguration
	clusterCIDR: "10.244.0.0/16"
	metricsBindAddress: 0.0.0.0:10249
	conntrack:
	  maxPerCore: 0
	# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"
	  tcpEstablishedTimeout: 0s
	# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"
	  tcpCloseWaitTimeout: 0s
	
	I0722 11:26:21.641137  210080 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.20.0
	I0722 11:26:21.651925  210080 binaries.go:44] Found k8s binaries, skipping transfer
	I0722 11:26:21.652050  210080 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube
	I0722 11:26:21.662802  210080 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (480 bytes)
	I0722 11:26:21.684553  210080 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)
	I0722 11:26:21.715792  210080 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2117 bytes)
	I0722 11:26:21.750745  210080 ssh_runner.go:195] Run: grep 192.168.76.2	control-plane.minikube.internal$ /etc/hosts
	I0722 11:26:21.754656  210080 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.76.2	control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
	I0722 11:26:21.774576  210080 ssh_runner.go:195] Run: sudo systemctl daemon-reload
	I0722 11:26:21.932688  210080 ssh_runner.go:195] Run: sudo systemctl start kubelet
	I0722 11:26:21.958384  210080 certs.go:68] Setting up /home/jenkins/minikube-integration/19313-2237/.minikube/profiles/old-k8s-version-584140 for IP: 192.168.76.2
	I0722 11:26:21.958420  210080 certs.go:194] generating shared ca certs ...
	I0722 11:26:21.958454  210080 certs.go:226] acquiring lock for ca certs: {Name:mkc633027ec1393c6f58c3260e76c1b2d2250318 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0722 11:26:21.958624  210080 certs.go:235] skipping valid "minikubeCA" ca cert: /home/jenkins/minikube-integration/19313-2237/.minikube/ca.key
	I0722 11:26:21.958691  210080 certs.go:235] skipping valid "proxyClientCA" ca cert: /home/jenkins/minikube-integration/19313-2237/.minikube/proxy-client-ca.key
	I0722 11:26:21.958706  210080 certs.go:256] generating profile certs ...
	I0722 11:26:21.958823  210080 certs.go:359] skipping valid signed profile cert regeneration for "minikube-user": /home/jenkins/minikube-integration/19313-2237/.minikube/profiles/old-k8s-version-584140/client.key
	I0722 11:26:21.958914  210080 certs.go:359] skipping valid signed profile cert regeneration for "minikube": /home/jenkins/minikube-integration/19313-2237/.minikube/profiles/old-k8s-version-584140/apiserver.key.e5ed41e6
	I0722 11:26:21.958987  210080 certs.go:359] skipping valid signed profile cert regeneration for "aggregator": /home/jenkins/minikube-integration/19313-2237/.minikube/profiles/old-k8s-version-584140/proxy-client.key
	I0722 11:26:21.959133  210080 certs.go:484] found cert: /home/jenkins/minikube-integration/19313-2237/.minikube/certs/7564.pem (1338 bytes)
	W0722 11:26:21.959191  210080 certs.go:480] ignoring /home/jenkins/minikube-integration/19313-2237/.minikube/certs/7564_empty.pem, impossibly tiny 0 bytes
	I0722 11:26:21.959206  210080 certs.go:484] found cert: /home/jenkins/minikube-integration/19313-2237/.minikube/certs/ca-key.pem (1675 bytes)
	I0722 11:26:21.959234  210080 certs.go:484] found cert: /home/jenkins/minikube-integration/19313-2237/.minikube/certs/ca.pem (1078 bytes)
	I0722 11:26:21.959285  210080 certs.go:484] found cert: /home/jenkins/minikube-integration/19313-2237/.minikube/certs/cert.pem (1123 bytes)
	I0722 11:26:21.959336  210080 certs.go:484] found cert: /home/jenkins/minikube-integration/19313-2237/.minikube/certs/key.pem (1679 bytes)
	I0722 11:26:21.959418  210080 certs.go:484] found cert: /home/jenkins/minikube-integration/19313-2237/.minikube/files/etc/ssl/certs/75642.pem (1708 bytes)
	I0722 11:26:21.960184  210080 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19313-2237/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
	I0722 11:26:22.054659  210080 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19313-2237/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1675 bytes)
	I0722 11:26:22.143845  210080 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19313-2237/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
	I0722 11:26:22.222073  210080 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19313-2237/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1675 bytes)
	I0722 11:26:22.274535  210080 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19313-2237/.minikube/profiles/old-k8s-version-584140/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1432 bytes)
	I0722 11:26:22.316503  210080 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19313-2237/.minikube/profiles/old-k8s-version-584140/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1675 bytes)
	I0722 11:26:22.357456  210080 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19313-2237/.minikube/profiles/old-k8s-version-584140/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
	I0722 11:26:22.384942  210080 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19313-2237/.minikube/profiles/old-k8s-version-584140/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1675 bytes)
	I0722 11:26:22.412377  210080 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19313-2237/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
	I0722 11:26:22.439953  210080 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19313-2237/.minikube/certs/7564.pem --> /usr/share/ca-certificates/7564.pem (1338 bytes)
	I0722 11:26:22.467640  210080 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19313-2237/.minikube/files/etc/ssl/certs/75642.pem --> /usr/share/ca-certificates/75642.pem (1708 bytes)
	I0722 11:26:22.495311  210080 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)
	I0722 11:26:22.515650  210080 ssh_runner.go:195] Run: openssl version
	I0722 11:26:22.529198  210080 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
	I0722 11:26:22.541058  210080 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
	I0722 11:26:22.545193  210080 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 Jul 22 10:30 /usr/share/ca-certificates/minikubeCA.pem
	I0722 11:26:22.545296  210080 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
	I0722 11:26:22.553748  210080 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
	I0722 11:26:22.573418  210080 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/7564.pem && ln -fs /usr/share/ca-certificates/7564.pem /etc/ssl/certs/7564.pem"
	I0722 11:26:22.586682  210080 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/7564.pem
	I0722 11:26:22.590738  210080 certs.go:528] hashing: -rw-r--r-- 1 root root 1338 Jul 22 10:41 /usr/share/ca-certificates/7564.pem
	I0722 11:26:22.590845  210080 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/7564.pem
	I0722 11:26:22.601172  210080 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/7564.pem /etc/ssl/certs/51391683.0"
	I0722 11:26:22.613811  210080 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/75642.pem && ln -fs /usr/share/ca-certificates/75642.pem /etc/ssl/certs/75642.pem"
	I0722 11:26:22.623971  210080 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/75642.pem
	I0722 11:26:22.628585  210080 certs.go:528] hashing: -rw-r--r-- 1 root root 1708 Jul 22 10:41 /usr/share/ca-certificates/75642.pem
	I0722 11:26:22.628700  210080 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/75642.pem
	I0722 11:26:22.636296  210080 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/75642.pem /etc/ssl/certs/3ec20f2e.0"
	I0722 11:26:22.654565  210080 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt
	I0722 11:26:22.658724  210080 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/apiserver-etcd-client.crt -checkend 86400
	I0722 11:26:22.670719  210080 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/apiserver-kubelet-client.crt -checkend 86400
	I0722 11:26:22.681812  210080 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/server.crt -checkend 86400
	I0722 11:26:22.689402  210080 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/healthcheck-client.crt -checkend 86400
	I0722 11:26:22.701167  210080 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/peer.crt -checkend 86400
	I0722 11:26:22.708483  210080 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/front-proxy-client.crt -checkend 86400
	I0722 11:26:22.717153  210080 kubeadm.go:392] StartCluster: {Name:old-k8s-version-584140 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721324606-19298@sha256:1c495b056df42bd3fd9a5c30d049e1802f9ed73a342611781f1ccc3c3853953f Memory:2200 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-584140 Namespace:default APIServerHAVIP: APIServerName:minikube
CA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.76.2 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[dashboard:true default-storageclass:true metrics-server:true storage-provisioner:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4 MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/m
inikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I0722 11:26:22.717266  210080 cri.go:54] listing CRI containers in root : {State:paused Name: Namespaces:[kube-system]}
	I0722 11:26:22.717387  210080 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"
	I0722 11:26:22.790317  210080 cri.go:89] found id: ""
	I0722 11:26:22.790434  210080 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd
	I0722 11:26:22.799869  210080 kubeadm.go:408] found existing configuration files, will attempt cluster restart
	I0722 11:26:22.799915  210080 kubeadm.go:593] restartPrimaryControlPlane start ...
	I0722 11:26:22.799998  210080 ssh_runner.go:195] Run: sudo test -d /data/minikube
	I0722 11:26:22.809348  210080 kubeadm.go:130] /data/minikube skipping compat symlinks: sudo test -d /data/minikube: Process exited with status 1
	stdout:
	
	stderr:
	I0722 11:26:22.810313  210080 kubeconfig.go:47] verify endpoint returned: get endpoint: "old-k8s-version-584140" does not appear in /home/jenkins/minikube-integration/19313-2237/kubeconfig
	I0722 11:26:22.810925  210080 kubeconfig.go:62] /home/jenkins/minikube-integration/19313-2237/kubeconfig needs updating (will repair): [kubeconfig missing "old-k8s-version-584140" cluster setting kubeconfig missing "old-k8s-version-584140" context setting]
	I0722 11:26:22.811937  210080 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19313-2237/kubeconfig: {Name:mkcc86b3f46ba469151bab0be6d762245d79cdb6 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0722 11:26:22.813879  210080 ssh_runner.go:195] Run: sudo diff -u /var/tmp/minikube/kubeadm.yaml /var/tmp/minikube/kubeadm.yaml.new
	I0722 11:26:22.824865  210080 kubeadm.go:630] The running cluster does not require reconfiguration: 192.168.76.2
	I0722 11:26:22.824913  210080 kubeadm.go:597] duration metric: took 24.990967ms to restartPrimaryControlPlane
	I0722 11:26:22.824923  210080 kubeadm.go:394] duration metric: took 107.783105ms to StartCluster
	I0722 11:26:22.824939  210080 settings.go:142] acquiring lock: {Name:mk5fbd205fde0f82abe2a5378554c5e9944b6110 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0722 11:26:22.825020  210080 settings.go:150] Updating kubeconfig:  /home/jenkins/minikube-integration/19313-2237/kubeconfig
	I0722 11:26:22.826671  210080 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19313-2237/kubeconfig: {Name:mkcc86b3f46ba469151bab0be6d762245d79cdb6 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0722 11:26:22.827073  210080 start.go:235] Will wait 6m0s for node &{Name: IP:192.168.76.2 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}
	I0722 11:26:22.827499  210080 addons.go:507] enable addons start: toEnable=map[ambassador:false auto-pause:false cloud-spanner:false csi-hostpath-driver:false dashboard:true default-storageclass:true efk:false freshpod:false gcp-auth:false gvisor:false headlamp:false helm-tiller:false inaccel:false ingress:false ingress-dns:false inspektor-gadget:false istio:false istio-provisioner:false kong:false kubeflow:false kubevirt:false logviewer:false metallb:false metrics-server:true nvidia-device-plugin:false nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:false registry-aliases:false registry-creds:false storage-provisioner:true storage-provisioner-gluster:false storage-provisioner-rancher:false volcano:false volumesnapshots:false yakd:false]
	I0722 11:26:22.827588  210080 addons.go:69] Setting storage-provisioner=true in profile "old-k8s-version-584140"
	I0722 11:26:22.827609  210080 addons.go:234] Setting addon storage-provisioner=true in "old-k8s-version-584140"
	W0722 11:26:22.827620  210080 addons.go:243] addon storage-provisioner should already be in state true
	I0722 11:26:22.827644  210080 host.go:66] Checking if "old-k8s-version-584140" exists ...
	I0722 11:26:22.828095  210080 cli_runner.go:164] Run: docker container inspect old-k8s-version-584140 --format={{.State.Status}}
	I0722 11:26:22.828488  210080 config.go:182] Loaded profile config "old-k8s-version-584140": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.20.0
	I0722 11:26:22.828591  210080 addons.go:69] Setting metrics-server=true in profile "old-k8s-version-584140"
	I0722 11:26:22.828635  210080 addons.go:234] Setting addon metrics-server=true in "old-k8s-version-584140"
	W0722 11:26:22.828647  210080 addons.go:243] addon metrics-server should already be in state true
	I0722 11:26:22.828681  210080 host.go:66] Checking if "old-k8s-version-584140" exists ...
	I0722 11:26:22.829277  210080 cli_runner.go:164] Run: docker container inspect old-k8s-version-584140 --format={{.State.Status}}
	I0722 11:26:22.829546  210080 addons.go:69] Setting dashboard=true in profile "old-k8s-version-584140"
	I0722 11:26:22.829592  210080 addons.go:234] Setting addon dashboard=true in "old-k8s-version-584140"
	W0722 11:26:22.829605  210080 addons.go:243] addon dashboard should already be in state true
	I0722 11:26:22.829628  210080 host.go:66] Checking if "old-k8s-version-584140" exists ...
	I0722 11:26:22.829961  210080 addons.go:69] Setting default-storageclass=true in profile "old-k8s-version-584140"
	I0722 11:26:22.829988  210080 addons_storage_classes.go:33] enableOrDisableStorageClasses default-storageclass=true on "old-k8s-version-584140"
	I0722 11:26:22.830204  210080 cli_runner.go:164] Run: docker container inspect old-k8s-version-584140 --format={{.State.Status}}
	I0722 11:26:22.830697  210080 out.go:177] * Verifying Kubernetes components...
	I0722 11:26:22.831119  210080 cli_runner.go:164] Run: docker container inspect old-k8s-version-584140 --format={{.State.Status}}
	I0722 11:26:22.841546  210080 ssh_runner.go:195] Run: sudo systemctl daemon-reload
	I0722 11:26:22.887478  210080 out.go:177]   - Using image gcr.io/k8s-minikube/storage-provisioner:v5
	I0722 11:26:22.890326  210080 addons.go:431] installing /etc/kubernetes/addons/storage-provisioner.yaml
	I0722 11:26:22.892942  210080 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storage-provisioner.yaml (2676 bytes)
	I0722 11:26:22.893033  210080 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-584140
	I0722 11:26:22.908443  210080 addons.go:234] Setting addon default-storageclass=true in "old-k8s-version-584140"
	W0722 11:26:22.908474  210080 addons.go:243] addon default-storageclass should already be in state true
	I0722 11:26:22.908500  210080 host.go:66] Checking if "old-k8s-version-584140" exists ...
	I0722 11:26:22.908970  210080 cli_runner.go:164] Run: docker container inspect old-k8s-version-584140 --format={{.State.Status}}
	I0722 11:26:22.909018  210080 out.go:177]   - Using image fake.domain/registry.k8s.io/echoserver:1.4
	I0722 11:26:22.912765  210080 addons.go:431] installing /etc/kubernetes/addons/metrics-apiservice.yaml
	I0722 11:26:22.912797  210080 ssh_runner.go:362] scp metrics-server/metrics-apiservice.yaml --> /etc/kubernetes/addons/metrics-apiservice.yaml (424 bytes)
	I0722 11:26:22.912936  210080 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-584140
	I0722 11:26:22.916184  210080 out.go:177]   - Using image docker.io/kubernetesui/dashboard:v2.7.0
	I0722 11:26:22.919121  210080 out.go:177]   - Using image registry.k8s.io/echoserver:1.4
	I0722 11:26:22.920970  210080 addons.go:431] installing /etc/kubernetes/addons/dashboard-ns.yaml
	I0722 11:26:22.920999  210080 ssh_runner.go:362] scp dashboard/dashboard-ns.yaml --> /etc/kubernetes/addons/dashboard-ns.yaml (759 bytes)
	I0722 11:26:22.921069  210080 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-584140
	I0722 11:26:22.958668  210080 addons.go:431] installing /etc/kubernetes/addons/storageclass.yaml
	I0722 11:26:22.958691  210080 ssh_runner.go:362] scp storageclass/storageclass.yaml --> /etc/kubernetes/addons/storageclass.yaml (271 bytes)
	I0722 11:26:22.958752  210080 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-584140
	I0722 11:26:22.981534  210080 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33063 SSHKeyPath:/home/jenkins/minikube-integration/19313-2237/.minikube/machines/old-k8s-version-584140/id_rsa Username:docker}
	I0722 11:26:22.982493  210080 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33063 SSHKeyPath:/home/jenkins/minikube-integration/19313-2237/.minikube/machines/old-k8s-version-584140/id_rsa Username:docker}
	I0722 11:26:23.001654  210080 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33063 SSHKeyPath:/home/jenkins/minikube-integration/19313-2237/.minikube/machines/old-k8s-version-584140/id_rsa Username:docker}
	I0722 11:26:23.017230  210080 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33063 SSHKeyPath:/home/jenkins/minikube-integration/19313-2237/.minikube/machines/old-k8s-version-584140/id_rsa Username:docker}
	I0722 11:26:23.169361  210080 ssh_runner.go:195] Run: sudo systemctl start kubelet
	I0722 11:26:23.195478  210080 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml
	I0722 11:26:23.202279  210080 addons.go:431] installing /etc/kubernetes/addons/metrics-server-deployment.yaml
	I0722 11:26:23.202350  210080 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-server-deployment.yaml (1825 bytes)
	I0722 11:26:23.247980  210080 node_ready.go:35] waiting up to 6m0s for node "old-k8s-version-584140" to be "Ready" ...
	I0722 11:26:23.250541  210080 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml
	I0722 11:26:23.254939  210080 addons.go:431] installing /etc/kubernetes/addons/dashboard-clusterrole.yaml
	I0722 11:26:23.255012  210080 ssh_runner.go:362] scp dashboard/dashboard-clusterrole.yaml --> /etc/kubernetes/addons/dashboard-clusterrole.yaml (1001 bytes)
	I0722 11:26:23.325071  210080 addons.go:431] installing /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml
	I0722 11:26:23.325147  210080 ssh_runner.go:362] scp dashboard/dashboard-clusterrolebinding.yaml --> /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml (1018 bytes)
	I0722 11:26:23.326875  210080 addons.go:431] installing /etc/kubernetes/addons/metrics-server-rbac.yaml
	I0722 11:26:23.326946  210080 ssh_runner.go:362] scp metrics-server/metrics-server-rbac.yaml --> /etc/kubernetes/addons/metrics-server-rbac.yaml (2175 bytes)
	I0722 11:26:23.427495  210080 addons.go:431] installing /etc/kubernetes/addons/dashboard-configmap.yaml
	I0722 11:26:23.427572  210080 ssh_runner.go:362] scp dashboard/dashboard-configmap.yaml --> /etc/kubernetes/addons/dashboard-configmap.yaml (837 bytes)
	I0722 11:26:23.446954  210080 addons.go:431] installing /etc/kubernetes/addons/metrics-server-service.yaml
	I0722 11:26:23.447034  210080 ssh_runner.go:362] scp metrics-server/metrics-server-service.yaml --> /etc/kubernetes/addons/metrics-server-service.yaml (446 bytes)
	I0722 11:26:23.494561  210080 addons.go:431] installing /etc/kubernetes/addons/dashboard-dp.yaml
	I0722 11:26:23.494633  210080 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-dp.yaml (4201 bytes)
	I0722 11:26:23.550596  210080 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
	W0722 11:26:23.574199  210080 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
	stdout:
	
	stderr:
	The connection to the server localhost:8443 was refused - did you specify the right host or port?
	I0722 11:26:23.574291  210080 retry.go:31] will retry after 216.974056ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
	stdout:
	
	stderr:
	The connection to the server localhost:8443 was refused - did you specify the right host or port?
	W0722 11:26:23.594026  210080 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
	stdout:
	
	stderr:
	The connection to the server localhost:8443 was refused - did you specify the right host or port?
	I0722 11:26:23.594153  210080 retry.go:31] will retry after 129.282105ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
	stdout:
	
	stderr:
	The connection to the server localhost:8443 was refused - did you specify the right host or port?
	I0722 11:26:23.605941  210080 addons.go:431] installing /etc/kubernetes/addons/dashboard-role.yaml
	I0722 11:26:23.606020  210080 ssh_runner.go:362] scp dashboard/dashboard-role.yaml --> /etc/kubernetes/addons/dashboard-role.yaml (1724 bytes)
	I0722 11:26:23.689300  210080 addons.go:431] installing /etc/kubernetes/addons/dashboard-rolebinding.yaml
	I0722 11:26:23.689380  210080 ssh_runner.go:362] scp dashboard/dashboard-rolebinding.yaml --> /etc/kubernetes/addons/dashboard-rolebinding.yaml (1046 bytes)
	I0722 11:26:23.723718  210080 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml
	W0722 11:26:23.745973  210080 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
	stdout:
	
	stderr:
	The connection to the server localhost:8443 was refused - did you specify the right host or port?
	I0722 11:26:23.746053  210080 retry.go:31] will retry after 125.475262ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
	stdout:
	
	stderr:
	The connection to the server localhost:8443 was refused - did you specify the right host or port?
	I0722 11:26:23.751041  210080 addons.go:431] installing /etc/kubernetes/addons/dashboard-sa.yaml
	I0722 11:26:23.751113  210080 ssh_runner.go:362] scp dashboard/dashboard-sa.yaml --> /etc/kubernetes/addons/dashboard-sa.yaml (837 bytes)
	I0722 11:26:23.792347  210080 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml
	I0722 11:26:23.816896  210080 addons.go:431] installing /etc/kubernetes/addons/dashboard-secret.yaml
	I0722 11:26:23.816969  210080 ssh_runner.go:362] scp dashboard/dashboard-secret.yaml --> /etc/kubernetes/addons/dashboard-secret.yaml (1389 bytes)
	I0722 11:26:23.872275  210080 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
	I0722 11:26:23.914879  210080 addons.go:431] installing /etc/kubernetes/addons/dashboard-svc.yaml
	I0722 11:26:23.914953  210080 ssh_runner.go:362] scp dashboard/dashboard-svc.yaml --> /etc/kubernetes/addons/dashboard-svc.yaml (1294 bytes)
	W0722 11:26:24.061372  210080 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
	stdout:
	
	stderr:
	The connection to the server localhost:8443 was refused - did you specify the right host or port?
	I0722 11:26:24.061469  210080 retry.go:31] will retry after 552.016201ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
	stdout:
	
	stderr:
	The connection to the server localhost:8443 was refused - did you specify the right host or port?
	I0722 11:26:24.079071  210080 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
	W0722 11:26:24.157151  210080 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
	stdout:
	
	stderr:
	The connection to the server localhost:8443 was refused - did you specify the right host or port?
	I0722 11:26:24.157251  210080 retry.go:31] will retry after 410.691769ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
	stdout:
	
	stderr:
	The connection to the server localhost:8443 was refused - did you specify the right host or port?
	W0722 11:26:24.260460  210080 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
	stdout:
	
	stderr:
	The connection to the server localhost:8443 was refused - did you specify the right host or port?
	I0722 11:26:24.260495  210080 retry.go:31] will retry after 355.743811ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
	stdout:
	
	stderr:
	The connection to the server localhost:8443 was refused - did you specify the right host or port?
	W0722 11:26:24.260518  210080 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
	stdout:
	
	stderr:
	The connection to the server localhost:8443 was refused - did you specify the right host or port?
	I0722 11:26:24.260530  210080 retry.go:31] will retry after 504.336946ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
	stdout:
	
	stderr:
	The connection to the server localhost:8443 was refused - did you specify the right host or port?
	I0722 11:26:24.569070  210080 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml
	I0722 11:26:24.614416  210080 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml
	I0722 11:26:24.616827  210080 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
	W0722 11:26:24.741513  210080 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
	stdout:
	
	stderr:
	The connection to the server localhost:8443 was refused - did you specify the right host or port?
	I0722 11:26:24.741572  210080 retry.go:31] will retry after 464.879223ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
	stdout:
	
	stderr:
	The connection to the server localhost:8443 was refused - did you specify the right host or port?
	I0722 11:26:24.765251  210080 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
	W0722 11:26:24.914492  210080 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
	stdout:
	
	stderr:
	The connection to the server localhost:8443 was refused - did you specify the right host or port?
	I0722 11:26:24.914560  210080 retry.go:31] will retry after 422.635115ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
	stdout:
	
	stderr:
	The connection to the server localhost:8443 was refused - did you specify the right host or port?
	W0722 11:26:24.914610  210080 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
	stdout:
	
	stderr:
	The connection to the server localhost:8443 was refused - did you specify the right host or port?
	I0722 11:26:24.914623  210080 retry.go:31] will retry after 214.87889ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
	stdout:
	
	stderr:
	The connection to the server localhost:8443 was refused - did you specify the right host or port?
	W0722 11:26:25.020044  210080 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
	stdout:
	
	stderr:
	The connection to the server localhost:8443 was refused - did you specify the right host or port?
	I0722 11:26:25.020083  210080 retry.go:31] will retry after 293.452781ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
	stdout:
	
	stderr:
	The connection to the server localhost:8443 was refused - did you specify the right host or port?
	I0722 11:26:25.130188  210080 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
	I0722 11:26:25.207600  210080 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml
	I0722 11:26:25.249288  210080 node_ready.go:53] error getting node "old-k8s-version-584140": Get "https://192.168.76.2:8443/api/v1/nodes/old-k8s-version-584140": dial tcp 192.168.76.2:8443: connect: connection refused
	W0722 11:26:25.265135  210080 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
	stdout:
	
	stderr:
	The connection to the server localhost:8443 was refused - did you specify the right host or port?
	I0722 11:26:25.265180  210080 retry.go:31] will retry after 334.91173ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
	stdout:
	
	stderr:
	The connection to the server localhost:8443 was refused - did you specify the right host or port?
	I0722 11:26:25.314454  210080 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
	I0722 11:26:25.338364  210080 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml
	W0722 11:26:25.362855  210080 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
	stdout:
	
	stderr:
	The connection to the server localhost:8443 was refused - did you specify the right host or port?
	I0722 11:26:25.362888  210080 retry.go:31] will retry after 894.559471ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
	stdout:
	
	stderr:
	The connection to the server localhost:8443 was refused - did you specify the right host or port?
	W0722 11:26:25.535786  210080 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
	stdout:
	
	stderr:
	The connection to the server localhost:8443 was refused - did you specify the right host or port?
	I0722 11:26:25.535823  210080 retry.go:31] will retry after 1.073827156s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
	stdout:
	
	stderr:
	The connection to the server localhost:8443 was refused - did you specify the right host or port?
	W0722 11:26:25.535873  210080 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
	stdout:
	
	stderr:
	The connection to the server localhost:8443 was refused - did you specify the right host or port?
	I0722 11:26:25.535896  210080 retry.go:31] will retry after 872.541815ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
	stdout:
	
	stderr:
	The connection to the server localhost:8443 was refused - did you specify the right host or port?
	I0722 11:26:25.601042  210080 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
	W0722 11:26:25.704962  210080 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
	stdout:
	
	stderr:
	The connection to the server localhost:8443 was refused - did you specify the right host or port?
	I0722 11:26:25.705005  210080 retry.go:31] will retry after 511.889941ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
	stdout:
	
	stderr:
	The connection to the server localhost:8443 was refused - did you specify the right host or port?
	I0722 11:26:26.217124  210080 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
	I0722 11:26:26.258182  210080 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml
	W0722 11:26:26.313953  210080 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
	stdout:
	
	stderr:
	The connection to the server localhost:8443 was refused - did you specify the right host or port?
	I0722 11:26:26.314053  210080 retry.go:31] will retry after 730.942457ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
	stdout:
	
	stderr:
	The connection to the server localhost:8443 was refused - did you specify the right host or port?
	W0722 11:26:26.356623  210080 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
	stdout:
	
	stderr:
	The connection to the server localhost:8443 was refused - did you specify the right host or port?
	I0722 11:26:26.356698  210080 retry.go:31] will retry after 1.434334313s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
	stdout:
	
	stderr:
	The connection to the server localhost:8443 was refused - did you specify the right host or port?
	I0722 11:26:26.408982  210080 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
	W0722 11:26:26.478164  210080 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
	stdout:
	
	stderr:
	The connection to the server localhost:8443 was refused - did you specify the right host or port?
	I0722 11:26:26.478197  210080 retry.go:31] will retry after 1.521308895s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
	stdout:
	
	stderr:
	The connection to the server localhost:8443 was refused - did you specify the right host or port?
	I0722 11:26:26.610634  210080 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml
	W0722 11:26:26.692537  210080 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
	stdout:
	
	stderr:
	The connection to the server localhost:8443 was refused - did you specify the right host or port?
	I0722 11:26:26.692583  210080 retry.go:31] will retry after 1.592780676s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
	stdout:
	
	stderr:
	The connection to the server localhost:8443 was refused - did you specify the right host or port?
	I0722 11:26:27.045569  210080 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
	W0722 11:26:27.125001  210080 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
	stdout:
	
	stderr:
	The connection to the server localhost:8443 was refused - did you specify the right host or port?
	I0722 11:26:27.125047  210080 retry.go:31] will retry after 1.234745247s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
	stdout:
	
	stderr:
	The connection to the server localhost:8443 was refused - did you specify the right host or port?
	I0722 11:26:27.749515  210080 node_ready.go:53] error getting node "old-k8s-version-584140": Get "https://192.168.76.2:8443/api/v1/nodes/old-k8s-version-584140": dial tcp 192.168.76.2:8443: connect: connection refused
	I0722 11:26:27.791654  210080 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml
	W0722 11:26:27.866342  210080 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
	stdout:
	
	stderr:
	The connection to the server localhost:8443 was refused - did you specify the right host or port?
	I0722 11:26:27.866372  210080 retry.go:31] will retry after 1.849660889s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
	stdout:
	
	stderr:
	The connection to the server localhost:8443 was refused - did you specify the right host or port?
	I0722 11:26:27.999672  210080 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
	W0722 11:26:28.069399  210080 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
	stdout:
	
	stderr:
	The connection to the server localhost:8443 was refused - did you specify the right host or port?
	I0722 11:26:28.069433  210080 retry.go:31] will retry after 1.347098407s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
	stdout:
	
	stderr:
	The connection to the server localhost:8443 was refused - did you specify the right host or port?
	I0722 11:26:28.286336  210080 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml
	I0722 11:26:28.360736  210080 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
	W0722 11:26:28.366486  210080 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
	stdout:
	
	stderr:
	The connection to the server localhost:8443 was refused - did you specify the right host or port?
	I0722 11:26:28.366515  210080 retry.go:31] will retry after 1.325777049s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
	stdout:
	
	stderr:
	The connection to the server localhost:8443 was refused - did you specify the right host or port?
	W0722 11:26:28.435995  210080 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
	stdout:
	
	stderr:
	The connection to the server localhost:8443 was refused - did you specify the right host or port?
	I0722 11:26:28.436029  210080 retry.go:31] will retry after 1.780416162s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
	stdout:
	
	stderr:
	The connection to the server localhost:8443 was refused - did you specify the right host or port?
	I0722 11:26:29.417234  210080 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
	W0722 11:26:29.496185  210080 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
	stdout:
	
	stderr:
	The connection to the server localhost:8443 was refused - did you specify the right host or port?
	I0722 11:26:29.496219  210080 retry.go:31] will retry after 2.571047357s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
	stdout:
	
	stderr:
	The connection to the server localhost:8443 was refused - did you specify the right host or port?
	I0722 11:26:29.692518  210080 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml
	I0722 11:26:29.717038  210080 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml
	W0722 11:26:29.797274  210080 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
	stdout:
	
	stderr:
	The connection to the server localhost:8443 was refused - did you specify the right host or port?
	I0722 11:26:29.797303  210080 retry.go:31] will retry after 1.479993802s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
	stdout:
	
	stderr:
	The connection to the server localhost:8443 was refused - did you specify the right host or port?
	W0722 11:26:29.821022  210080 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
	stdout:
	
	stderr:
	The connection to the server localhost:8443 was refused - did you specify the right host or port?
	I0722 11:26:29.821057  210080 retry.go:31] will retry after 3.493279527s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
	stdout:
	
	stderr:
	The connection to the server localhost:8443 was refused - did you specify the right host or port?
	I0722 11:26:30.217568  210080 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
	I0722 11:26:30.250838  210080 node_ready.go:53] error getting node "old-k8s-version-584140": Get "https://192.168.76.2:8443/api/v1/nodes/old-k8s-version-584140": dial tcp 192.168.76.2:8443: connect: connection refused
	W0722 11:26:30.294719  210080 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
	stdout:
	
	stderr:
	The connection to the server localhost:8443 was refused - did you specify the right host or port?
	I0722 11:26:30.294755  210080 retry.go:31] will retry after 3.971221443s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
	stdout:
	
	stderr:
	The connection to the server localhost:8443 was refused - did you specify the right host or port?
	I0722 11:26:31.277646  210080 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml
	W0722 11:26:31.433438  210080 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
	stdout:
	
	stderr:
	The connection to the server localhost:8443 was refused - did you specify the right host or port?
	I0722 11:26:31.433467  210080 retry.go:31] will retry after 5.9779828s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
	stdout:
	
	stderr:
	The connection to the server localhost:8443 was refused - did you specify the right host or port?
	I0722 11:26:32.068064  210080 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
	I0722 11:26:33.315377  210080 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml
	I0722 11:26:34.266973  210080 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
	I0722 11:26:37.411665  210080 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml
	I0722 11:26:39.183850  210080 node_ready.go:49] node "old-k8s-version-584140" has status "Ready":"True"
	I0722 11:26:39.183880  210080 node_ready.go:38] duration metric: took 15.935822129s for node "old-k8s-version-584140" to be "Ready" ...
	I0722 11:26:39.183890  210080 pod_ready.go:35] extra waiting up to 6m0s for all system-critical pods including labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
	I0722 11:26:39.334341  210080 pod_ready.go:78] waiting up to 6m0s for pod "coredns-74ff55c5b-t7kln" in "kube-system" namespace to be "Ready" ...
	I0722 11:26:39.652054  210080 pod_ready.go:92] pod "coredns-74ff55c5b-t7kln" in "kube-system" namespace has status "Ready":"True"
	I0722 11:26:39.652099  210080 pod_ready.go:81] duration metric: took 317.722452ms for pod "coredns-74ff55c5b-t7kln" in "kube-system" namespace to be "Ready" ...
	I0722 11:26:39.652112  210080 pod_ready.go:78] waiting up to 6m0s for pod "etcd-old-k8s-version-584140" in "kube-system" namespace to be "Ready" ...
	I0722 11:26:39.804676  210080 pod_ready.go:92] pod "etcd-old-k8s-version-584140" in "kube-system" namespace has status "Ready":"True"
	I0722 11:26:39.804702  210080 pod_ready.go:81] duration metric: took 152.572833ms for pod "etcd-old-k8s-version-584140" in "kube-system" namespace to be "Ready" ...
	I0722 11:26:39.804716  210080 pod_ready.go:78] waiting up to 6m0s for pod "kube-apiserver-old-k8s-version-584140" in "kube-system" namespace to be "Ready" ...
	I0722 11:26:40.028137  210080 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: (7.960025211s)
	I0722 11:26:40.028179  210080 addons.go:475] Verifying addon metrics-server=true in "old-k8s-version-584140"
	I0722 11:26:40.028252  210080 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: (6.712846144s)
	I0722 11:26:40.199485  210080 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: (5.932470206s)
	I0722 11:26:40.199745  210080 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: (2.788052122s)
	I0722 11:26:40.201519  210080 out.go:177] * Some dashboard features require the metrics-server addon. To enable all features please run:
	
		minikube -p old-k8s-version-584140 addons enable metrics-server
	
	I0722 11:26:40.242465  210080 out.go:177] * Enabled addons: metrics-server, storage-provisioner, dashboard, default-storageclass
	I0722 11:26:40.244334  210080 addons.go:510] duration metric: took 17.416826577s for enable addons: enabled=[metrics-server storage-provisioner dashboard default-storageclass]
	I0722 11:26:41.811170  210080 pod_ready.go:102] pod "kube-apiserver-old-k8s-version-584140" in "kube-system" namespace has status "Ready":"False"
	I0722 11:26:43.813708  210080 pod_ready.go:102] pod "kube-apiserver-old-k8s-version-584140" in "kube-system" namespace has status "Ready":"False"
	I0722 11:26:46.311063  210080 pod_ready.go:102] pod "kube-apiserver-old-k8s-version-584140" in "kube-system" namespace has status "Ready":"False"
	I0722 11:26:48.311961  210080 pod_ready.go:102] pod "kube-apiserver-old-k8s-version-584140" in "kube-system" namespace has status "Ready":"False"
	I0722 11:26:49.311687  210080 pod_ready.go:92] pod "kube-apiserver-old-k8s-version-584140" in "kube-system" namespace has status "Ready":"True"
	I0722 11:26:49.311714  210080 pod_ready.go:81] duration metric: took 9.506989512s for pod "kube-apiserver-old-k8s-version-584140" in "kube-system" namespace to be "Ready" ...
	I0722 11:26:49.311725  210080 pod_ready.go:78] waiting up to 6m0s for pod "kube-controller-manager-old-k8s-version-584140" in "kube-system" namespace to be "Ready" ...
	I0722 11:26:51.319290  210080 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-584140" in "kube-system" namespace has status "Ready":"False"
	I0722 11:26:53.817661  210080 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-584140" in "kube-system" namespace has status "Ready":"False"
	I0722 11:26:55.818214  210080 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-584140" in "kube-system" namespace has status "Ready":"False"
	I0722 11:26:57.823039  210080 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-584140" in "kube-system" namespace has status "Ready":"False"
	I0722 11:26:59.825738  210080 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-584140" in "kube-system" namespace has status "Ready":"False"
	I0722 11:27:01.845166  210080 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-584140" in "kube-system" namespace has status "Ready":"False"
	I0722 11:27:04.320128  210080 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-584140" in "kube-system" namespace has status "Ready":"False"
	I0722 11:27:06.823358  210080 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-584140" in "kube-system" namespace has status "Ready":"False"
	I0722 11:27:09.318476  210080 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-584140" in "kube-system" namespace has status "Ready":"False"
	I0722 11:27:11.819545  210080 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-584140" in "kube-system" namespace has status "Ready":"False"
	I0722 11:27:14.318323  210080 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-584140" in "kube-system" namespace has status "Ready":"False"
	I0722 11:27:16.319386  210080 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-584140" in "kube-system" namespace has status "Ready":"False"
	I0722 11:27:18.821118  210080 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-584140" in "kube-system" namespace has status "Ready":"False"
	I0722 11:27:21.318228  210080 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-584140" in "kube-system" namespace has status "Ready":"False"
	I0722 11:27:23.817953  210080 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-584140" in "kube-system" namespace has status "Ready":"False"
	I0722 11:27:26.317951  210080 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-584140" in "kube-system" namespace has status "Ready":"False"
	I0722 11:27:28.324255  210080 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-584140" in "kube-system" namespace has status "Ready":"False"
	I0722 11:27:30.817333  210080 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-584140" in "kube-system" namespace has status "Ready":"False"
	I0722 11:27:32.818440  210080 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-584140" in "kube-system" namespace has status "Ready":"False"
	I0722 11:27:34.822199  210080 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-584140" in "kube-system" namespace has status "Ready":"False"
	I0722 11:27:37.318055  210080 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-584140" in "kube-system" namespace has status "Ready":"False"
	I0722 11:27:39.318483  210080 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-584140" in "kube-system" namespace has status "Ready":"False"
	I0722 11:27:41.319323  210080 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-584140" in "kube-system" namespace has status "Ready":"False"
	I0722 11:27:43.819274  210080 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-584140" in "kube-system" namespace has status "Ready":"False"
	I0722 11:27:46.318488  210080 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-584140" in "kube-system" namespace has status "Ready":"False"
	I0722 11:27:48.818841  210080 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-584140" in "kube-system" namespace has status "Ready":"False"
	I0722 11:27:51.318878  210080 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-584140" in "kube-system" namespace has status "Ready":"False"
	I0722 11:27:53.818196  210080 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-584140" in "kube-system" namespace has status "Ready":"False"
	I0722 11:27:55.819450  210080 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-584140" in "kube-system" namespace has status "Ready":"False"
	I0722 11:27:58.319051  210080 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-584140" in "kube-system" namespace has status "Ready":"False"
	I0722 11:27:59.818283  210080 pod_ready.go:92] pod "kube-controller-manager-old-k8s-version-584140" in "kube-system" namespace has status "Ready":"True"
	I0722 11:27:59.818306  210080 pod_ready.go:81] duration metric: took 1m10.506573165s for pod "kube-controller-manager-old-k8s-version-584140" in "kube-system" namespace to be "Ready" ...
	I0722 11:27:59.818318  210080 pod_ready.go:78] waiting up to 6m0s for pod "kube-proxy-xfm5t" in "kube-system" namespace to be "Ready" ...
	I0722 11:27:59.823211  210080 pod_ready.go:92] pod "kube-proxy-xfm5t" in "kube-system" namespace has status "Ready":"True"
	I0722 11:27:59.823233  210080 pod_ready.go:81] duration metric: took 4.90751ms for pod "kube-proxy-xfm5t" in "kube-system" namespace to be "Ready" ...
	I0722 11:27:59.823244  210080 pod_ready.go:78] waiting up to 6m0s for pod "kube-scheduler-old-k8s-version-584140" in "kube-system" namespace to be "Ready" ...
	I0722 11:27:59.833008  210080 pod_ready.go:92] pod "kube-scheduler-old-k8s-version-584140" in "kube-system" namespace has status "Ready":"True"
	I0722 11:27:59.833035  210080 pod_ready.go:81] duration metric: took 9.782659ms for pod "kube-scheduler-old-k8s-version-584140" in "kube-system" namespace to be "Ready" ...
	I0722 11:27:59.833047  210080 pod_ready.go:78] waiting up to 6m0s for pod "metrics-server-9975d5f86-4jcvm" in "kube-system" namespace to be "Ready" ...
	I0722 11:28:01.851100  210080 pod_ready.go:102] pod "metrics-server-9975d5f86-4jcvm" in "kube-system" namespace has status "Ready":"False"
	I0722 11:28:04.343376  210080 pod_ready.go:102] pod "metrics-server-9975d5f86-4jcvm" in "kube-system" namespace has status "Ready":"False"
	I0722 11:28:06.842663  210080 pod_ready.go:102] pod "metrics-server-9975d5f86-4jcvm" in "kube-system" namespace has status "Ready":"False"
	I0722 11:28:08.844596  210080 pod_ready.go:102] pod "metrics-server-9975d5f86-4jcvm" in "kube-system" namespace has status "Ready":"False"
	I0722 11:28:10.859536  210080 pod_ready.go:102] pod "metrics-server-9975d5f86-4jcvm" in "kube-system" namespace has status "Ready":"False"
	I0722 11:28:13.339582  210080 pod_ready.go:102] pod "metrics-server-9975d5f86-4jcvm" in "kube-system" namespace has status "Ready":"False"
	I0722 11:28:15.340713  210080 pod_ready.go:102] pod "metrics-server-9975d5f86-4jcvm" in "kube-system" namespace has status "Ready":"False"
	I0722 11:28:17.842659  210080 pod_ready.go:102] pod "metrics-server-9975d5f86-4jcvm" in "kube-system" namespace has status "Ready":"False"
	I0722 11:28:19.845825  210080 pod_ready.go:102] pod "metrics-server-9975d5f86-4jcvm" in "kube-system" namespace has status "Ready":"False"
	I0722 11:28:22.344369  210080 pod_ready.go:102] pod "metrics-server-9975d5f86-4jcvm" in "kube-system" namespace has status "Ready":"False"
	I0722 11:28:24.840644  210080 pod_ready.go:102] pod "metrics-server-9975d5f86-4jcvm" in "kube-system" namespace has status "Ready":"False"
	I0722 11:28:26.851632  210080 pod_ready.go:102] pod "metrics-server-9975d5f86-4jcvm" in "kube-system" namespace has status "Ready":"False"
	I0722 11:28:29.340133  210080 pod_ready.go:102] pod "metrics-server-9975d5f86-4jcvm" in "kube-system" namespace has status "Ready":"False"
	I0722 11:28:31.345096  210080 pod_ready.go:102] pod "metrics-server-9975d5f86-4jcvm" in "kube-system" namespace has status "Ready":"False"
	I0722 11:28:33.853318  210080 pod_ready.go:102] pod "metrics-server-9975d5f86-4jcvm" in "kube-system" namespace has status "Ready":"False"
	I0722 11:28:36.340963  210080 pod_ready.go:102] pod "metrics-server-9975d5f86-4jcvm" in "kube-system" namespace has status "Ready":"False"
	I0722 11:28:38.341543  210080 pod_ready.go:102] pod "metrics-server-9975d5f86-4jcvm" in "kube-system" namespace has status "Ready":"False"
	I0722 11:28:40.846170  210080 pod_ready.go:102] pod "metrics-server-9975d5f86-4jcvm" in "kube-system" namespace has status "Ready":"False"
	I0722 11:28:43.341346  210080 pod_ready.go:102] pod "metrics-server-9975d5f86-4jcvm" in "kube-system" namespace has status "Ready":"False"
	I0722 11:28:45.342439  210080 pod_ready.go:102] pod "metrics-server-9975d5f86-4jcvm" in "kube-system" namespace has status "Ready":"False"
	I0722 11:28:47.845840  210080 pod_ready.go:102] pod "metrics-server-9975d5f86-4jcvm" in "kube-system" namespace has status "Ready":"False"
	I0722 11:28:49.927380  210080 pod_ready.go:102] pod "metrics-server-9975d5f86-4jcvm" in "kube-system" namespace has status "Ready":"False"
	I0722 11:28:52.342262  210080 pod_ready.go:102] pod "metrics-server-9975d5f86-4jcvm" in "kube-system" namespace has status "Ready":"False"
	I0722 11:28:54.343206  210080 pod_ready.go:102] pod "metrics-server-9975d5f86-4jcvm" in "kube-system" namespace has status "Ready":"False"
	I0722 11:28:56.343483  210080 pod_ready.go:102] pod "metrics-server-9975d5f86-4jcvm" in "kube-system" namespace has status "Ready":"False"
	I0722 11:28:58.849142  210080 pod_ready.go:102] pod "metrics-server-9975d5f86-4jcvm" in "kube-system" namespace has status "Ready":"False"
	I0722 11:29:00.851630  210080 pod_ready.go:102] pod "metrics-server-9975d5f86-4jcvm" in "kube-system" namespace has status "Ready":"False"
	I0722 11:29:03.339643  210080 pod_ready.go:102] pod "metrics-server-9975d5f86-4jcvm" in "kube-system" namespace has status "Ready":"False"
	I0722 11:29:05.341047  210080 pod_ready.go:102] pod "metrics-server-9975d5f86-4jcvm" in "kube-system" namespace has status "Ready":"False"
	I0722 11:29:07.841414  210080 pod_ready.go:102] pod "metrics-server-9975d5f86-4jcvm" in "kube-system" namespace has status "Ready":"False"
	I0722 11:29:10.342265  210080 pod_ready.go:102] pod "metrics-server-9975d5f86-4jcvm" in "kube-system" namespace has status "Ready":"False"
	I0722 11:29:12.344293  210080 pod_ready.go:102] pod "metrics-server-9975d5f86-4jcvm" in "kube-system" namespace has status "Ready":"False"
	I0722 11:29:14.842021  210080 pod_ready.go:102] pod "metrics-server-9975d5f86-4jcvm" in "kube-system" namespace has status "Ready":"False"
	I0722 11:29:16.846485  210080 pod_ready.go:102] pod "metrics-server-9975d5f86-4jcvm" in "kube-system" namespace has status "Ready":"False"
	I0722 11:29:18.857924  210080 pod_ready.go:102] pod "metrics-server-9975d5f86-4jcvm" in "kube-system" namespace has status "Ready":"False"
	I0722 11:29:21.341689  210080 pod_ready.go:102] pod "metrics-server-9975d5f86-4jcvm" in "kube-system" namespace has status "Ready":"False"
	I0722 11:29:23.851410  210080 pod_ready.go:102] pod "metrics-server-9975d5f86-4jcvm" in "kube-system" namespace has status "Ready":"False"
	I0722 11:29:25.852505  210080 pod_ready.go:102] pod "metrics-server-9975d5f86-4jcvm" in "kube-system" namespace has status "Ready":"False"
	I0722 11:29:28.340931  210080 pod_ready.go:102] pod "metrics-server-9975d5f86-4jcvm" in "kube-system" namespace has status "Ready":"False"
	I0722 11:29:30.342845  210080 pod_ready.go:102] pod "metrics-server-9975d5f86-4jcvm" in "kube-system" namespace has status "Ready":"False"
	I0722 11:29:32.845252  210080 pod_ready.go:102] pod "metrics-server-9975d5f86-4jcvm" in "kube-system" namespace has status "Ready":"False"
	I0722 11:29:35.340507  210080 pod_ready.go:102] pod "metrics-server-9975d5f86-4jcvm" in "kube-system" namespace has status "Ready":"False"
	I0722 11:29:37.353042  210080 pod_ready.go:102] pod "metrics-server-9975d5f86-4jcvm" in "kube-system" namespace has status "Ready":"False"
	I0722 11:29:39.356521  210080 pod_ready.go:102] pod "metrics-server-9975d5f86-4jcvm" in "kube-system" namespace has status "Ready":"False"
	I0722 11:29:41.850218  210080 pod_ready.go:102] pod "metrics-server-9975d5f86-4jcvm" in "kube-system" namespace has status "Ready":"False"
	I0722 11:29:43.853399  210080 pod_ready.go:102] pod "metrics-server-9975d5f86-4jcvm" in "kube-system" namespace has status "Ready":"False"
	I0722 11:29:46.341023  210080 pod_ready.go:102] pod "metrics-server-9975d5f86-4jcvm" in "kube-system" namespace has status "Ready":"False"
	I0722 11:29:48.846198  210080 pod_ready.go:102] pod "metrics-server-9975d5f86-4jcvm" in "kube-system" namespace has status "Ready":"False"
	I0722 11:29:51.340346  210080 pod_ready.go:102] pod "metrics-server-9975d5f86-4jcvm" in "kube-system" namespace has status "Ready":"False"
	I0722 11:29:53.340731  210080 pod_ready.go:102] pod "metrics-server-9975d5f86-4jcvm" in "kube-system" namespace has status "Ready":"False"
	I0722 11:29:55.341344  210080 pod_ready.go:102] pod "metrics-server-9975d5f86-4jcvm" in "kube-system" namespace has status "Ready":"False"
	I0722 11:29:57.342794  210080 pod_ready.go:102] pod "metrics-server-9975d5f86-4jcvm" in "kube-system" namespace has status "Ready":"False"
	I0722 11:29:59.843530  210080 pod_ready.go:102] pod "metrics-server-9975d5f86-4jcvm" in "kube-system" namespace has status "Ready":"False"
	I0722 11:30:01.847469  210080 pod_ready.go:102] pod "metrics-server-9975d5f86-4jcvm" in "kube-system" namespace has status "Ready":"False"
	I0722 11:30:04.342535  210080 pod_ready.go:102] pod "metrics-server-9975d5f86-4jcvm" in "kube-system" namespace has status "Ready":"False"
	I0722 11:30:06.342738  210080 pod_ready.go:102] pod "metrics-server-9975d5f86-4jcvm" in "kube-system" namespace has status "Ready":"False"
	I0722 11:30:08.849016  210080 pod_ready.go:102] pod "metrics-server-9975d5f86-4jcvm" in "kube-system" namespace has status "Ready":"False"
	I0722 11:30:11.340051  210080 pod_ready.go:102] pod "metrics-server-9975d5f86-4jcvm" in "kube-system" namespace has status "Ready":"False"
	I0722 11:30:13.840316  210080 pod_ready.go:102] pod "metrics-server-9975d5f86-4jcvm" in "kube-system" namespace has status "Ready":"False"
	I0722 11:30:15.843443  210080 pod_ready.go:102] pod "metrics-server-9975d5f86-4jcvm" in "kube-system" namespace has status "Ready":"False"
	I0722 11:30:18.340155  210080 pod_ready.go:102] pod "metrics-server-9975d5f86-4jcvm" in "kube-system" namespace has status "Ready":"False"
	I0722 11:30:20.845290  210080 pod_ready.go:102] pod "metrics-server-9975d5f86-4jcvm" in "kube-system" namespace has status "Ready":"False"
	I0722 11:30:23.340036  210080 pod_ready.go:102] pod "metrics-server-9975d5f86-4jcvm" in "kube-system" namespace has status "Ready":"False"
	I0722 11:30:25.846244  210080 pod_ready.go:102] pod "metrics-server-9975d5f86-4jcvm" in "kube-system" namespace has status "Ready":"False"
	I0722 11:30:27.846998  210080 pod_ready.go:102] pod "metrics-server-9975d5f86-4jcvm" in "kube-system" namespace has status "Ready":"False"
	I0722 11:30:30.340185  210080 pod_ready.go:102] pod "metrics-server-9975d5f86-4jcvm" in "kube-system" namespace has status "Ready":"False"
	I0722 11:30:32.849212  210080 pod_ready.go:102] pod "metrics-server-9975d5f86-4jcvm" in "kube-system" namespace has status "Ready":"False"
	I0722 11:30:35.340221  210080 pod_ready.go:102] pod "metrics-server-9975d5f86-4jcvm" in "kube-system" namespace has status "Ready":"False"
	I0722 11:30:37.341246  210080 pod_ready.go:102] pod "metrics-server-9975d5f86-4jcvm" in "kube-system" namespace has status "Ready":"False"
	I0722 11:30:39.343176  210080 pod_ready.go:102] pod "metrics-server-9975d5f86-4jcvm" in "kube-system" namespace has status "Ready":"False"
	I0722 11:30:41.344030  210080 pod_ready.go:102] pod "metrics-server-9975d5f86-4jcvm" in "kube-system" namespace has status "Ready":"False"
	I0722 11:30:43.842816  210080 pod_ready.go:102] pod "metrics-server-9975d5f86-4jcvm" in "kube-system" namespace has status "Ready":"False"
	I0722 11:30:45.847417  210080 pod_ready.go:102] pod "metrics-server-9975d5f86-4jcvm" in "kube-system" namespace has status "Ready":"False"
	I0722 11:30:48.342459  210080 pod_ready.go:102] pod "metrics-server-9975d5f86-4jcvm" in "kube-system" namespace has status "Ready":"False"
	I0722 11:30:50.847956  210080 pod_ready.go:102] pod "metrics-server-9975d5f86-4jcvm" in "kube-system" namespace has status "Ready":"False"
	I0722 11:30:52.855771  210080 pod_ready.go:102] pod "metrics-server-9975d5f86-4jcvm" in "kube-system" namespace has status "Ready":"False"
	I0722 11:30:55.340307  210080 pod_ready.go:102] pod "metrics-server-9975d5f86-4jcvm" in "kube-system" namespace has status "Ready":"False"
	I0722 11:30:57.345989  210080 pod_ready.go:102] pod "metrics-server-9975d5f86-4jcvm" in "kube-system" namespace has status "Ready":"False"
	I0722 11:30:59.850453  210080 pod_ready.go:102] pod "metrics-server-9975d5f86-4jcvm" in "kube-system" namespace has status "Ready":"False"
	I0722 11:31:02.341215  210080 pod_ready.go:102] pod "metrics-server-9975d5f86-4jcvm" in "kube-system" namespace has status "Ready":"False"
	I0722 11:31:04.341496  210080 pod_ready.go:102] pod "metrics-server-9975d5f86-4jcvm" in "kube-system" namespace has status "Ready":"False"
	I0722 11:31:06.847997  210080 pod_ready.go:102] pod "metrics-server-9975d5f86-4jcvm" in "kube-system" namespace has status "Ready":"False"
	I0722 11:31:08.850639  210080 pod_ready.go:102] pod "metrics-server-9975d5f86-4jcvm" in "kube-system" namespace has status "Ready":"False"
	I0722 11:31:11.388361  210080 pod_ready.go:102] pod "metrics-server-9975d5f86-4jcvm" in "kube-system" namespace has status "Ready":"False"
	I0722 11:31:13.842183  210080 pod_ready.go:102] pod "metrics-server-9975d5f86-4jcvm" in "kube-system" namespace has status "Ready":"False"
	I0722 11:31:15.853421  210080 pod_ready.go:102] pod "metrics-server-9975d5f86-4jcvm" in "kube-system" namespace has status "Ready":"False"
	I0722 11:31:18.339864  210080 pod_ready.go:102] pod "metrics-server-9975d5f86-4jcvm" in "kube-system" namespace has status "Ready":"False"
	I0722 11:31:20.340050  210080 pod_ready.go:102] pod "metrics-server-9975d5f86-4jcvm" in "kube-system" namespace has status "Ready":"False"
	I0722 11:31:22.344482  210080 pod_ready.go:102] pod "metrics-server-9975d5f86-4jcvm" in "kube-system" namespace has status "Ready":"False"
	I0722 11:31:24.853179  210080 pod_ready.go:102] pod "metrics-server-9975d5f86-4jcvm" in "kube-system" namespace has status "Ready":"False"
	I0722 11:31:27.339795  210080 pod_ready.go:102] pod "metrics-server-9975d5f86-4jcvm" in "kube-system" namespace has status "Ready":"False"
	I0722 11:31:29.340179  210080 pod_ready.go:102] pod "metrics-server-9975d5f86-4jcvm" in "kube-system" namespace has status "Ready":"False"
	I0722 11:31:31.840513  210080 pod_ready.go:102] pod "metrics-server-9975d5f86-4jcvm" in "kube-system" namespace has status "Ready":"False"
	I0722 11:31:33.841987  210080 pod_ready.go:102] pod "metrics-server-9975d5f86-4jcvm" in "kube-system" namespace has status "Ready":"False"
	I0722 11:31:36.340593  210080 pod_ready.go:102] pod "metrics-server-9975d5f86-4jcvm" in "kube-system" namespace has status "Ready":"False"
	I0722 11:31:38.346722  210080 pod_ready.go:102] pod "metrics-server-9975d5f86-4jcvm" in "kube-system" namespace has status "Ready":"False"
	I0722 11:31:40.845171  210080 pod_ready.go:102] pod "metrics-server-9975d5f86-4jcvm" in "kube-system" namespace has status "Ready":"False"
	I0722 11:31:43.339987  210080 pod_ready.go:102] pod "metrics-server-9975d5f86-4jcvm" in "kube-system" namespace has status "Ready":"False"
	I0722 11:31:45.340367  210080 pod_ready.go:102] pod "metrics-server-9975d5f86-4jcvm" in "kube-system" namespace has status "Ready":"False"
	I0722 11:31:47.849494  210080 pod_ready.go:102] pod "metrics-server-9975d5f86-4jcvm" in "kube-system" namespace has status "Ready":"False"
	I0722 11:31:50.339967  210080 pod_ready.go:102] pod "metrics-server-9975d5f86-4jcvm" in "kube-system" namespace has status "Ready":"False"
	I0722 11:31:52.840216  210080 pod_ready.go:102] pod "metrics-server-9975d5f86-4jcvm" in "kube-system" namespace has status "Ready":"False"
	I0722 11:31:54.840912  210080 pod_ready.go:102] pod "metrics-server-9975d5f86-4jcvm" in "kube-system" namespace has status "Ready":"False"
	I0722 11:31:56.849216  210080 pod_ready.go:102] pod "metrics-server-9975d5f86-4jcvm" in "kube-system" namespace has status "Ready":"False"
	I0722 11:31:59.342888  210080 pod_ready.go:102] pod "metrics-server-9975d5f86-4jcvm" in "kube-system" namespace has status "Ready":"False"
	I0722 11:31:59.845379  210080 pod_ready.go:81] duration metric: took 4m0.012318488s for pod "metrics-server-9975d5f86-4jcvm" in "kube-system" namespace to be "Ready" ...
	E0722 11:31:59.845399  210080 pod_ready.go:66] WaitExtra: waitPodCondition: context deadline exceeded
	I0722 11:31:59.845409  210080 pod_ready.go:38] duration metric: took 5m20.661509404s for extra waiting for all system-critical and pods with labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
	I0722 11:31:59.845424  210080 api_server.go:52] waiting for apiserver process to appear ...
	I0722 11:31:59.845451  210080 cri.go:54] listing CRI containers in root : {State:all Name:kube-apiserver Namespaces:[]}
	I0722 11:31:59.845574  210080 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
	I0722 11:31:59.920139  210080 cri.go:89] found id: "7b17da0e203acb0f33605e81ab92029743299c8b53e99bedad6247fb2e22336d"
	I0722 11:31:59.920178  210080 cri.go:89] found id: ""
	I0722 11:31:59.920186  210080 logs.go:276] 1 containers: [7b17da0e203acb0f33605e81ab92029743299c8b53e99bedad6247fb2e22336d]
	I0722 11:31:59.920236  210080 ssh_runner.go:195] Run: which crictl
	I0722 11:31:59.924556  210080 cri.go:54] listing CRI containers in root : {State:all Name:etcd Namespaces:[]}
	I0722 11:31:59.924629  210080 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
	I0722 11:31:59.977812  210080 cri.go:89] found id: "b8f395f6e10fffc01d9db2971c2690affd63e1173ebe081a173b1df5e29b3eae"
	I0722 11:31:59.977831  210080 cri.go:89] found id: ""
	I0722 11:31:59.977840  210080 logs.go:276] 1 containers: [b8f395f6e10fffc01d9db2971c2690affd63e1173ebe081a173b1df5e29b3eae]
	I0722 11:31:59.977895  210080 ssh_runner.go:195] Run: which crictl
	I0722 11:31:59.982113  210080 cri.go:54] listing CRI containers in root : {State:all Name:coredns Namespaces:[]}
	I0722 11:31:59.982181  210080 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
	I0722 11:32:00.089770  210080 cri.go:89] found id: "25b426692cff4a0ddaac80382d5fd8be373235953b017a1f2591adbc04fe5208"
	I0722 11:32:00.089791  210080 cri.go:89] found id: ""
	I0722 11:32:00.089799  210080 logs.go:276] 1 containers: [25b426692cff4a0ddaac80382d5fd8be373235953b017a1f2591adbc04fe5208]
	I0722 11:32:00.089863  210080 ssh_runner.go:195] Run: which crictl
	I0722 11:32:00.106635  210080 cri.go:54] listing CRI containers in root : {State:all Name:kube-scheduler Namespaces:[]}
	I0722 11:32:00.106733  210080 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
	I0722 11:32:00.253185  210080 cri.go:89] found id: "a38f1a7f716723ae1738fc6d121fd5959ee9c40c5b1c46b537955d760c9f4290"
	I0722 11:32:00.253208  210080 cri.go:89] found id: ""
	I0722 11:32:00.253221  210080 logs.go:276] 1 containers: [a38f1a7f716723ae1738fc6d121fd5959ee9c40c5b1c46b537955d760c9f4290]
	I0722 11:32:00.253285  210080 ssh_runner.go:195] Run: which crictl
	I0722 11:32:00.269148  210080 cri.go:54] listing CRI containers in root : {State:all Name:kube-proxy Namespaces:[]}
	I0722 11:32:00.269317  210080 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
	I0722 11:32:00.378714  210080 cri.go:89] found id: "5191e613fc2d72706f1d776fe8a845ca8f4b3cec7ff3b0f9d18aee199e8d79c6"
	I0722 11:32:00.378743  210080 cri.go:89] found id: ""
	I0722 11:32:00.378751  210080 logs.go:276] 1 containers: [5191e613fc2d72706f1d776fe8a845ca8f4b3cec7ff3b0f9d18aee199e8d79c6]
	I0722 11:32:00.378814  210080 ssh_runner.go:195] Run: which crictl
	I0722 11:32:00.385279  210080 cri.go:54] listing CRI containers in root : {State:all Name:kube-controller-manager Namespaces:[]}
	I0722 11:32:00.385366  210080 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
	I0722 11:32:00.464157  210080 cri.go:89] found id: "460bdeec3bdfccab7101c9d13045f9bcf87734da1fb0f6f8b6a5c0111906ac43"
	I0722 11:32:00.464207  210080 cri.go:89] found id: ""
	I0722 11:32:00.464216  210080 logs.go:276] 1 containers: [460bdeec3bdfccab7101c9d13045f9bcf87734da1fb0f6f8b6a5c0111906ac43]
	I0722 11:32:00.464285  210080 ssh_runner.go:195] Run: which crictl
	I0722 11:32:00.468544  210080 cri.go:54] listing CRI containers in root : {State:all Name:kindnet Namespaces:[]}
	I0722 11:32:00.468644  210080 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet
	I0722 11:32:00.528057  210080 cri.go:89] found id: "451ceb51fb176f2ab58c30c602fe7a8d8dcdde723f94ec75d058fd599561cfde"
	I0722 11:32:00.528078  210080 cri.go:89] found id: ""
	I0722 11:32:00.528086  210080 logs.go:276] 1 containers: [451ceb51fb176f2ab58c30c602fe7a8d8dcdde723f94ec75d058fd599561cfde]
	I0722 11:32:00.528144  210080 ssh_runner.go:195] Run: which crictl
	I0722 11:32:00.533504  210080 cri.go:54] listing CRI containers in root : {State:all Name:storage-provisioner Namespaces:[]}
	I0722 11:32:00.533634  210080 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=storage-provisioner
	I0722 11:32:00.595614  210080 cri.go:89] found id: "b64b9e0461292d72b7fc112215c86b2db789ed69b01b10063e3b4f24a2155a8a"
	I0722 11:32:00.595635  210080 cri.go:89] found id: "48a74507ee5da0b4b62d92cb8fe64853426c4fcd088c4d455c7d827c4c514ab2"
	I0722 11:32:00.595641  210080 cri.go:89] found id: ""
	I0722 11:32:00.595649  210080 logs.go:276] 2 containers: [b64b9e0461292d72b7fc112215c86b2db789ed69b01b10063e3b4f24a2155a8a 48a74507ee5da0b4b62d92cb8fe64853426c4fcd088c4d455c7d827c4c514ab2]
	I0722 11:32:00.595739  210080 ssh_runner.go:195] Run: which crictl
	I0722 11:32:00.601448  210080 ssh_runner.go:195] Run: which crictl
	I0722 11:32:00.605652  210080 cri.go:54] listing CRI containers in root : {State:all Name:kubernetes-dashboard Namespaces:[]}
	I0722 11:32:00.605721  210080 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kubernetes-dashboard
	I0722 11:32:00.651274  210080 cri.go:89] found id: "0da5dde31a386001ac351514fcd5b733872eb5d92ec8b3579e32b0f14de7b1fc"
	I0722 11:32:00.651297  210080 cri.go:89] found id: ""
	I0722 11:32:00.651306  210080 logs.go:276] 1 containers: [0da5dde31a386001ac351514fcd5b733872eb5d92ec8b3579e32b0f14de7b1fc]
	I0722 11:32:00.651361  210080 ssh_runner.go:195] Run: which crictl
	I0722 11:32:00.654976  210080 logs.go:123] Gathering logs for dmesg ...
	I0722 11:32:00.655002  210080 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
	I0722 11:32:00.673970  210080 logs.go:123] Gathering logs for describe nodes ...
	I0722 11:32:00.673997  210080 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
	I0722 11:32:00.904292  210080 logs.go:123] Gathering logs for kube-scheduler [a38f1a7f716723ae1738fc6d121fd5959ee9c40c5b1c46b537955d760c9f4290] ...
	I0722 11:32:00.904323  210080 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 a38f1a7f716723ae1738fc6d121fd5959ee9c40c5b1c46b537955d760c9f4290"
	I0722 11:32:00.986854  210080 logs.go:123] Gathering logs for kube-proxy [5191e613fc2d72706f1d776fe8a845ca8f4b3cec7ff3b0f9d18aee199e8d79c6] ...
	I0722 11:32:00.986888  210080 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 5191e613fc2d72706f1d776fe8a845ca8f4b3cec7ff3b0f9d18aee199e8d79c6"
	I0722 11:32:01.042704  210080 logs.go:123] Gathering logs for storage-provisioner [b64b9e0461292d72b7fc112215c86b2db789ed69b01b10063e3b4f24a2155a8a] ...
	I0722 11:32:01.042744  210080 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 b64b9e0461292d72b7fc112215c86b2db789ed69b01b10063e3b4f24a2155a8a"
	I0722 11:32:01.152534  210080 logs.go:123] Gathering logs for CRI-O ...
	I0722 11:32:01.152568  210080 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u crio -n 400"
	I0722 11:32:01.294215  210080 logs.go:123] Gathering logs for kubelet ...
	I0722 11:32:01.294250  210080 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
	W0722 11:32:01.368159  210080 logs.go:138] Found kubelet problem: Jul 22 11:26:39 old-k8s-version-584140 kubelet[730]: E0722 11:26:39.204682     730 reflector.go:138] object-"kube-system"/"kube-proxy": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "kube-proxy" is forbidden: User "system:node:old-k8s-version-584140" cannot list resource "configmaps" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-584140' and this object
	W0722 11:32:01.368517  210080 logs.go:138] Found kubelet problem: Jul 22 11:26:39 old-k8s-version-584140 kubelet[730]: E0722 11:26:39.205097     730 reflector.go:138] object-"kube-system"/"storage-provisioner-token-th5sl": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "storage-provisioner-token-th5sl" is forbidden: User "system:node:old-k8s-version-584140" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-584140' and this object
	W0722 11:32:01.369028  210080 logs.go:138] Found kubelet problem: Jul 22 11:26:39 old-k8s-version-584140 kubelet[730]: E0722 11:26:39.205388     730 reflector.go:138] object-"default"/"default-token-gkskl": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "default-token-gkskl" is forbidden: User "system:node:old-k8s-version-584140" cannot list resource "secrets" in API group "" in the namespace "default": no relationship found between node 'old-k8s-version-584140' and this object
	W0722 11:32:01.369328  210080 logs.go:138] Found kubelet problem: Jul 22 11:26:39 old-k8s-version-584140 kubelet[730]: E0722 11:26:39.206223     730 reflector.go:138] object-"kube-system"/"coredns": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "coredns" is forbidden: User "system:node:old-k8s-version-584140" cannot list resource "configmaps" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-584140' and this object
	W0722 11:32:01.369617  210080 logs.go:138] Found kubelet problem: Jul 22 11:26:39 old-k8s-version-584140 kubelet[730]: E0722 11:26:39.206544     730 reflector.go:138] object-"kube-system"/"kube-proxy-token-g9gsb": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "kube-proxy-token-g9gsb" is forbidden: User "system:node:old-k8s-version-584140" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-584140' and this object
	W0722 11:32:01.369927  210080 logs.go:138] Found kubelet problem: Jul 22 11:26:39 old-k8s-version-584140 kubelet[730]: E0722 11:26:39.206876     730 reflector.go:138] object-"kube-system"/"kindnet-token-tjmsp": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "kindnet-token-tjmsp" is forbidden: User "system:node:old-k8s-version-584140" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-584140' and this object
	W0722 11:32:01.370487  210080 logs.go:138] Found kubelet problem: Jul 22 11:26:39 old-k8s-version-584140 kubelet[730]: E0722 11:26:39.207130     730 reflector.go:138] object-"kube-system"/"metrics-server-token-btvqb": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "metrics-server-token-btvqb" is forbidden: User "system:node:old-k8s-version-584140" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-584140' and this object
	W0722 11:32:01.370748  210080 logs.go:138] Found kubelet problem: Jul 22 11:26:39 old-k8s-version-584140 kubelet[730]: E0722 11:26:39.207456     730 reflector.go:138] object-"kube-system"/"coredns-token-7tqrc": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "coredns-token-7tqrc" is forbidden: User "system:node:old-k8s-version-584140" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-584140' and this object
	W0722 11:32:01.387088  210080 logs.go:138] Found kubelet problem: Jul 22 11:26:43 old-k8s-version-584140 kubelet[730]: E0722 11:26:43.160558     730 pod_workers.go:191] Error syncing pod 5a4606c4-b596-44df-a930-60179facf4e9 ("metrics-server-9975d5f86-4jcvm_kube-system(5a4606c4-b596-44df-a930-60179facf4e9)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = pinging container registry fake.domain: Get \"https://fake.domain/v2/\": dial tcp: lookup fake.domain: no such host"
	W0722 11:32:01.387435  210080 logs.go:138] Found kubelet problem: Jul 22 11:26:43 old-k8s-version-584140 kubelet[730]: E0722 11:26:43.632278     730 pod_workers.go:191] Error syncing pod 5a4606c4-b596-44df-a930-60179facf4e9 ("metrics-server-9975d5f86-4jcvm_kube-system(5a4606c4-b596-44df-a930-60179facf4e9)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W0722 11:32:01.389517  210080 logs.go:138] Found kubelet problem: Jul 22 11:26:54 old-k8s-version-584140 kubelet[730]: E0722 11:26:54.611909     730 pod_workers.go:191] Error syncing pod 5a4606c4-b596-44df-a930-60179facf4e9 ("metrics-server-9975d5f86-4jcvm_kube-system(5a4606c4-b596-44df-a930-60179facf4e9)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = pinging container registry fake.domain: Get \"https://fake.domain/v2/\": dial tcp: lookup fake.domain: no such host"
	W0722 11:32:01.392146  210080 logs.go:138] Found kubelet problem: Jul 22 11:27:02 old-k8s-version-584140 kubelet[730]: E0722 11:27:02.738618     730 pod_workers.go:191] Error syncing pod b728f80c-1116-4ef9-b36b-6d05d11b72a1 ("dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 10s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"
	W0722 11:32:01.392634  210080 logs.go:138] Found kubelet problem: Jul 22 11:27:03 old-k8s-version-584140 kubelet[730]: E0722 11:27:03.741827     730 pod_workers.go:191] Error syncing pod b728f80c-1116-4ef9-b36b-6d05d11b72a1 ("dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 10s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"
	W0722 11:32:01.393033  210080 logs.go:138] Found kubelet problem: Jul 22 11:27:04 old-k8s-version-584140 kubelet[730]: E0722 11:27:04.838076     730 pod_workers.go:191] Error syncing pod b728f80c-1116-4ef9-b36b-6d05d11b72a1 ("dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 10s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"
	W0722 11:32:01.393237  210080 logs.go:138] Found kubelet problem: Jul 22 11:27:09 old-k8s-version-584140 kubelet[730]: E0722 11:27:09.598856     730 pod_workers.go:191] Error syncing pod 5a4606c4-b596-44df-a930-60179facf4e9 ("metrics-server-9975d5f86-4jcvm_kube-system(5a4606c4-b596-44df-a930-60179facf4e9)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W0722 11:32:01.394001  210080 logs.go:138] Found kubelet problem: Jul 22 11:27:18 old-k8s-version-584140 kubelet[730]: E0722 11:27:18.778810     730 pod_workers.go:191] Error syncing pod b728f80c-1116-4ef9-b36b-6d05d11b72a1 ("dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"
	W0722 11:32:01.396691  210080 logs.go:138] Found kubelet problem: Jul 22 11:27:23 old-k8s-version-584140 kubelet[730]: E0722 11:27:23.614499     730 pod_workers.go:191] Error syncing pod 5a4606c4-b596-44df-a930-60179facf4e9 ("metrics-server-9975d5f86-4jcvm_kube-system(5a4606c4-b596-44df-a930-60179facf4e9)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = pinging container registry fake.domain: Get \"https://fake.domain/v2/\": dial tcp: lookup fake.domain: no such host"
	W0722 11:32:01.397145  210080 logs.go:138] Found kubelet problem: Jul 22 11:27:24 old-k8s-version-584140 kubelet[730]: E0722 11:27:24.838228     730 pod_workers.go:191] Error syncing pod b728f80c-1116-4ef9-b36b-6d05d11b72a1 ("dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"
	W0722 11:32:01.397548  210080 logs.go:138] Found kubelet problem: Jul 22 11:27:36 old-k8s-version-584140 kubelet[730]: E0722 11:27:36.599081     730 pod_workers.go:191] Error syncing pod b728f80c-1116-4ef9-b36b-6d05d11b72a1 ("dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"
	W0722 11:32:01.397788  210080 logs.go:138] Found kubelet problem: Jul 22 11:27:38 old-k8s-version-584140 kubelet[730]: E0722 11:27:38.598819     730 pod_workers.go:191] Error syncing pod 5a4606c4-b596-44df-a930-60179facf4e9 ("metrics-server-9975d5f86-4jcvm_kube-system(5a4606c4-b596-44df-a930-60179facf4e9)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W0722 11:32:01.398743  210080 logs.go:138] Found kubelet problem: Jul 22 11:27:50 old-k8s-version-584140 kubelet[730]: E0722 11:27:50.837672     730 pod_workers.go:191] Error syncing pod b728f80c-1116-4ef9-b36b-6d05d11b72a1 ("dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"
	W0722 11:32:01.398983  210080 logs.go:138] Found kubelet problem: Jul 22 11:27:53 old-k8s-version-584140 kubelet[730]: E0722 11:27:53.599749     730 pod_workers.go:191] Error syncing pod 5a4606c4-b596-44df-a930-60179facf4e9 ("metrics-server-9975d5f86-4jcvm_kube-system(5a4606c4-b596-44df-a930-60179facf4e9)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W0722 11:32:01.399344  210080 logs.go:138] Found kubelet problem: Jul 22 11:27:54 old-k8s-version-584140 kubelet[730]: E0722 11:27:54.838469     730 pod_workers.go:191] Error syncing pod b728f80c-1116-4ef9-b36b-6d05d11b72a1 ("dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"
	W0722 11:32:01.399885  210080 logs.go:138] Found kubelet problem: Jul 22 11:28:06 old-k8s-version-584140 kubelet[730]: E0722 11:28:06.598312     730 pod_workers.go:191] Error syncing pod b728f80c-1116-4ef9-b36b-6d05d11b72a1 ("dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"
	W0722 11:32:01.404193  210080 logs.go:138] Found kubelet problem: Jul 22 11:28:07 old-k8s-version-584140 kubelet[730]: E0722 11:28:07.619353     730 pod_workers.go:191] Error syncing pod 5a4606c4-b596-44df-a930-60179facf4e9 ("metrics-server-9975d5f86-4jcvm_kube-system(5a4606c4-b596-44df-a930-60179facf4e9)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = pinging container registry fake.domain: Get \"https://fake.domain/v2/\": dial tcp: lookup fake.domain: no such host"
	W0722 11:32:01.404622  210080 logs.go:138] Found kubelet problem: Jul 22 11:28:20 old-k8s-version-584140 kubelet[730]: E0722 11:28:20.599140     730 pod_workers.go:191] Error syncing pod b728f80c-1116-4ef9-b36b-6d05d11b72a1 ("dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"
	W0722 11:32:01.404836  210080 logs.go:138] Found kubelet problem: Jul 22 11:28:20 old-k8s-version-584140 kubelet[730]: E0722 11:28:20.600438     730 pod_workers.go:191] Error syncing pod 5a4606c4-b596-44df-a930-60179facf4e9 ("metrics-server-9975d5f86-4jcvm_kube-system(5a4606c4-b596-44df-a930-60179facf4e9)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W0722 11:32:01.405520  210080 logs.go:138] Found kubelet problem: Jul 22 11:28:33 old-k8s-version-584140 kubelet[730]: E0722 11:28:33.909665     730 pod_workers.go:191] Error syncing pod b728f80c-1116-4ef9-b36b-6d05d11b72a1 ("dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"
	W0722 11:32:01.405900  210080 logs.go:138] Found kubelet problem: Jul 22 11:28:34 old-k8s-version-584140 kubelet[730]: E0722 11:28:34.912079     730 pod_workers.go:191] Error syncing pod b728f80c-1116-4ef9-b36b-6d05d11b72a1 ("dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"
	W0722 11:32:01.406112  210080 logs.go:138] Found kubelet problem: Jul 22 11:28:35 old-k8s-version-584140 kubelet[730]: E0722 11:28:35.599081     730 pod_workers.go:191] Error syncing pod 5a4606c4-b596-44df-a930-60179facf4e9 ("metrics-server-9975d5f86-4jcvm_kube-system(5a4606c4-b596-44df-a930-60179facf4e9)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W0722 11:32:01.406477  210080 logs.go:138] Found kubelet problem: Jul 22 11:28:46 old-k8s-version-584140 kubelet[730]: E0722 11:28:46.598307     730 pod_workers.go:191] Error syncing pod b728f80c-1116-4ef9-b36b-6d05d11b72a1 ("dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"
	W0722 11:32:01.406689  210080 logs.go:138] Found kubelet problem: Jul 22 11:28:50 old-k8s-version-584140 kubelet[730]: E0722 11:28:50.599499     730 pod_workers.go:191] Error syncing pod 5a4606c4-b596-44df-a930-60179facf4e9 ("metrics-server-9975d5f86-4jcvm_kube-system(5a4606c4-b596-44df-a930-60179facf4e9)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W0722 11:32:01.407045  210080 logs.go:138] Found kubelet problem: Jul 22 11:29:01 old-k8s-version-584140 kubelet[730]: E0722 11:29:01.598946     730 pod_workers.go:191] Error syncing pod b728f80c-1116-4ef9-b36b-6d05d11b72a1 ("dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"
	W0722 11:32:01.407255  210080 logs.go:138] Found kubelet problem: Jul 22 11:29:04 old-k8s-version-584140 kubelet[730]: E0722 11:29:04.598688     730 pod_workers.go:191] Error syncing pod 5a4606c4-b596-44df-a930-60179facf4e9 ("metrics-server-9975d5f86-4jcvm_kube-system(5a4606c4-b596-44df-a930-60179facf4e9)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W0722 11:32:01.407606  210080 logs.go:138] Found kubelet problem: Jul 22 11:29:12 old-k8s-version-584140 kubelet[730]: E0722 11:29:12.598338     730 pod_workers.go:191] Error syncing pod b728f80c-1116-4ef9-b36b-6d05d11b72a1 ("dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"
	W0722 11:32:01.407820  210080 logs.go:138] Found kubelet problem: Jul 22 11:29:19 old-k8s-version-584140 kubelet[730]: E0722 11:29:19.598946     730 pod_workers.go:191] Error syncing pod 5a4606c4-b596-44df-a930-60179facf4e9 ("metrics-server-9975d5f86-4jcvm_kube-system(5a4606c4-b596-44df-a930-60179facf4e9)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W0722 11:32:01.408172  210080 logs.go:138] Found kubelet problem: Jul 22 11:29:26 old-k8s-version-584140 kubelet[730]: E0722 11:29:26.598882     730 pod_workers.go:191] Error syncing pod b728f80c-1116-4ef9-b36b-6d05d11b72a1 ("dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"
	W0722 11:32:01.412144  210080 logs.go:138] Found kubelet problem: Jul 22 11:29:33 old-k8s-version-584140 kubelet[730]: E0722 11:29:33.611073     730 pod_workers.go:191] Error syncing pod 5a4606c4-b596-44df-a930-60179facf4e9 ("metrics-server-9975d5f86-4jcvm_kube-system(5a4606c4-b596-44df-a930-60179facf4e9)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = pinging container registry fake.domain: Get \"https://fake.domain/v2/\": dial tcp: lookup fake.domain: no such host"
	W0722 11:32:01.412531  210080 logs.go:138] Found kubelet problem: Jul 22 11:29:37 old-k8s-version-584140 kubelet[730]: E0722 11:29:37.598186     730 pod_workers.go:191] Error syncing pod b728f80c-1116-4ef9-b36b-6d05d11b72a1 ("dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"
	W0722 11:32:01.412752  210080 logs.go:138] Found kubelet problem: Jul 22 11:29:46 old-k8s-version-584140 kubelet[730]: E0722 11:29:46.599495     730 pod_workers.go:191] Error syncing pod 5a4606c4-b596-44df-a930-60179facf4e9 ("metrics-server-9975d5f86-4jcvm_kube-system(5a4606c4-b596-44df-a930-60179facf4e9)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W0722 11:32:01.413134  210080 logs.go:138] Found kubelet problem: Jul 22 11:29:48 old-k8s-version-584140 kubelet[730]: E0722 11:29:48.598602     730 pod_workers.go:191] Error syncing pod b728f80c-1116-4ef9-b36b-6d05d11b72a1 ("dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"
	W0722 11:32:01.413352  210080 logs.go:138] Found kubelet problem: Jul 22 11:30:00 old-k8s-version-584140 kubelet[730]: E0722 11:30:00.599866     730 pod_workers.go:191] Error syncing pod 5a4606c4-b596-44df-a930-60179facf4e9 ("metrics-server-9975d5f86-4jcvm_kube-system(5a4606c4-b596-44df-a930-60179facf4e9)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W0722 11:32:01.413969  210080 logs.go:138] Found kubelet problem: Jul 22 11:30:03 old-k8s-version-584140 kubelet[730]: E0722 11:30:03.060169     730 pod_workers.go:191] Error syncing pod b728f80c-1116-4ef9-b36b-6d05d11b72a1 ("dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"
	W0722 11:32:01.414322  210080 logs.go:138] Found kubelet problem: Jul 22 11:30:04 old-k8s-version-584140 kubelet[730]: E0722 11:30:04.837656     730 pod_workers.go:191] Error syncing pod b728f80c-1116-4ef9-b36b-6d05d11b72a1 ("dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"
	W0722 11:32:01.414534  210080 logs.go:138] Found kubelet problem: Jul 22 11:30:13 old-k8s-version-584140 kubelet[730]: E0722 11:30:13.598674     730 pod_workers.go:191] Error syncing pod 5a4606c4-b596-44df-a930-60179facf4e9 ("metrics-server-9975d5f86-4jcvm_kube-system(5a4606c4-b596-44df-a930-60179facf4e9)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W0722 11:32:01.414890  210080 logs.go:138] Found kubelet problem: Jul 22 11:30:17 old-k8s-version-584140 kubelet[730]: E0722 11:30:17.598240     730 pod_workers.go:191] Error syncing pod b728f80c-1116-4ef9-b36b-6d05d11b72a1 ("dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"
	W0722 11:32:01.415098  210080 logs.go:138] Found kubelet problem: Jul 22 11:30:28 old-k8s-version-584140 kubelet[730]: E0722 11:30:28.598615     730 pod_workers.go:191] Error syncing pod 5a4606c4-b596-44df-a930-60179facf4e9 ("metrics-server-9975d5f86-4jcvm_kube-system(5a4606c4-b596-44df-a930-60179facf4e9)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W0722 11:32:01.416026  210080 logs.go:138] Found kubelet problem: Jul 22 11:30:31 old-k8s-version-584140 kubelet[730]: E0722 11:30:31.598312     730 pod_workers.go:191] Error syncing pod b728f80c-1116-4ef9-b36b-6d05d11b72a1 ("dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"
	W0722 11:32:01.416265  210080 logs.go:138] Found kubelet problem: Jul 22 11:30:43 old-k8s-version-584140 kubelet[730]: E0722 11:30:43.599168     730 pod_workers.go:191] Error syncing pod 5a4606c4-b596-44df-a930-60179facf4e9 ("metrics-server-9975d5f86-4jcvm_kube-system(5a4606c4-b596-44df-a930-60179facf4e9)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W0722 11:32:01.416704  210080 logs.go:138] Found kubelet problem: Jul 22 11:30:44 old-k8s-version-584140 kubelet[730]: E0722 11:30:44.598289     730 pod_workers.go:191] Error syncing pod b728f80c-1116-4ef9-b36b-6d05d11b72a1 ("dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"
	W0722 11:32:01.416965  210080 logs.go:138] Found kubelet problem: Jul 22 11:30:55 old-k8s-version-584140 kubelet[730]: E0722 11:30:55.599111     730 pod_workers.go:191] Error syncing pod 5a4606c4-b596-44df-a930-60179facf4e9 ("metrics-server-9975d5f86-4jcvm_kube-system(5a4606c4-b596-44df-a930-60179facf4e9)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W0722 11:32:01.417337  210080 logs.go:138] Found kubelet problem: Jul 22 11:30:58 old-k8s-version-584140 kubelet[730]: E0722 11:30:58.598266     730 pod_workers.go:191] Error syncing pod b728f80c-1116-4ef9-b36b-6d05d11b72a1 ("dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"
	W0722 11:32:01.417583  210080 logs.go:138] Found kubelet problem: Jul 22 11:31:08 old-k8s-version-584140 kubelet[730]: E0722 11:31:08.598772     730 pod_workers.go:191] Error syncing pod 5a4606c4-b596-44df-a930-60179facf4e9 ("metrics-server-9975d5f86-4jcvm_kube-system(5a4606c4-b596-44df-a930-60179facf4e9)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W0722 11:32:01.417938  210080 logs.go:138] Found kubelet problem: Jul 22 11:31:12 old-k8s-version-584140 kubelet[730]: E0722 11:31:12.598216     730 pod_workers.go:191] Error syncing pod b728f80c-1116-4ef9-b36b-6d05d11b72a1 ("dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"
	W0722 11:32:01.418299  210080 logs.go:138] Found kubelet problem: Jul 22 11:31:23 old-k8s-version-584140 kubelet[730]: E0722 11:31:23.598165     730 pod_workers.go:191] Error syncing pod b728f80c-1116-4ef9-b36b-6d05d11b72a1 ("dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"
	W0722 11:32:01.418509  210080 logs.go:138] Found kubelet problem: Jul 22 11:31:23 old-k8s-version-584140 kubelet[730]: E0722 11:31:23.599281     730 pod_workers.go:191] Error syncing pod 5a4606c4-b596-44df-a930-60179facf4e9 ("metrics-server-9975d5f86-4jcvm_kube-system(5a4606c4-b596-44df-a930-60179facf4e9)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W0722 11:32:01.419110  210080 logs.go:138] Found kubelet problem: Jul 22 11:31:36 old-k8s-version-584140 kubelet[730]: E0722 11:31:36.598285     730 pod_workers.go:191] Error syncing pod b728f80c-1116-4ef9-b36b-6d05d11b72a1 ("dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"
	W0722 11:32:01.419315  210080 logs.go:138] Found kubelet problem: Jul 22 11:31:37 old-k8s-version-584140 kubelet[730]: E0722 11:31:37.598777     730 pod_workers.go:191] Error syncing pod 5a4606c4-b596-44df-a930-60179facf4e9 ("metrics-server-9975d5f86-4jcvm_kube-system(5a4606c4-b596-44df-a930-60179facf4e9)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W0722 11:32:01.419668  210080 logs.go:138] Found kubelet problem: Jul 22 11:31:50 old-k8s-version-584140 kubelet[730]: E0722 11:31:50.598548     730 pod_workers.go:191] Error syncing pod b728f80c-1116-4ef9-b36b-6d05d11b72a1 ("dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"
	W0722 11:32:01.419879  210080 logs.go:138] Found kubelet problem: Jul 22 11:31:52 old-k8s-version-584140 kubelet[730]: E0722 11:31:52.598992     730 pod_workers.go:191] Error syncing pod 5a4606c4-b596-44df-a930-60179facf4e9 ("metrics-server-9975d5f86-4jcvm_kube-system(5a4606c4-b596-44df-a930-60179facf4e9)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	I0722 11:32:01.419894  210080 logs.go:123] Gathering logs for etcd [b8f395f6e10fffc01d9db2971c2690affd63e1173ebe081a173b1df5e29b3eae] ...
	I0722 11:32:01.419919  210080 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 b8f395f6e10fffc01d9db2971c2690affd63e1173ebe081a173b1df5e29b3eae"
	I0722 11:32:01.511015  210080 logs.go:123] Gathering logs for storage-provisioner [48a74507ee5da0b4b62d92cb8fe64853426c4fcd088c4d455c7d827c4c514ab2] ...
	I0722 11:32:01.511087  210080 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 48a74507ee5da0b4b62d92cb8fe64853426c4fcd088c4d455c7d827c4c514ab2"
	I0722 11:32:01.574240  210080 logs.go:123] Gathering logs for kubernetes-dashboard [0da5dde31a386001ac351514fcd5b733872eb5d92ec8b3579e32b0f14de7b1fc] ...
	I0722 11:32:01.574317  210080 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 0da5dde31a386001ac351514fcd5b733872eb5d92ec8b3579e32b0f14de7b1fc"
	I0722 11:32:01.651394  210080 logs.go:123] Gathering logs for kindnet [451ceb51fb176f2ab58c30c602fe7a8d8dcdde723f94ec75d058fd599561cfde] ...
	I0722 11:32:01.651472  210080 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 451ceb51fb176f2ab58c30c602fe7a8d8dcdde723f94ec75d058fd599561cfde"
	I0722 11:32:01.753651  210080 logs.go:123] Gathering logs for container status ...
	I0722 11:32:01.753699  210080 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
	I0722 11:32:01.909399  210080 logs.go:123] Gathering logs for kube-apiserver [7b17da0e203acb0f33605e81ab92029743299c8b53e99bedad6247fb2e22336d] ...
	I0722 11:32:01.909484  210080 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 7b17da0e203acb0f33605e81ab92029743299c8b53e99bedad6247fb2e22336d"
	I0722 11:32:02.053113  210080 logs.go:123] Gathering logs for coredns [25b426692cff4a0ddaac80382d5fd8be373235953b017a1f2591adbc04fe5208] ...
	I0722 11:32:02.053146  210080 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 25b426692cff4a0ddaac80382d5fd8be373235953b017a1f2591adbc04fe5208"
	I0722 11:32:02.111073  210080 logs.go:123] Gathering logs for kube-controller-manager [460bdeec3bdfccab7101c9d13045f9bcf87734da1fb0f6f8b6a5c0111906ac43] ...
	I0722 11:32:02.111101  210080 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 460bdeec3bdfccab7101c9d13045f9bcf87734da1fb0f6f8b6a5c0111906ac43"
	I0722 11:32:02.182025  210080 out.go:304] Setting ErrFile to fd 2...
	I0722 11:32:02.182054  210080 out.go:338] TERM=,COLORTERM=, which probably does not support color
	W0722 11:32:02.182109  210080 out.go:239] X Problems detected in kubelet:
	X Problems detected in kubelet:
	W0722 11:32:02.182119  210080 out.go:239]   Jul 22 11:31:23 old-k8s-version-584140 kubelet[730]: E0722 11:31:23.599281     730 pod_workers.go:191] Error syncing pod 5a4606c4-b596-44df-a930-60179facf4e9 ("metrics-server-9975d5f86-4jcvm_kube-system(5a4606c4-b596-44df-a930-60179facf4e9)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	  Jul 22 11:31:23 old-k8s-version-584140 kubelet[730]: E0722 11:31:23.599281     730 pod_workers.go:191] Error syncing pod 5a4606c4-b596-44df-a930-60179facf4e9 ("metrics-server-9975d5f86-4jcvm_kube-system(5a4606c4-b596-44df-a930-60179facf4e9)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W0722 11:32:02.182126  210080 out.go:239]   Jul 22 11:31:36 old-k8s-version-584140 kubelet[730]: E0722 11:31:36.598285     730 pod_workers.go:191] Error syncing pod b728f80c-1116-4ef9-b36b-6d05d11b72a1 ("dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"
	  Jul 22 11:31:36 old-k8s-version-584140 kubelet[730]: E0722 11:31:36.598285     730 pod_workers.go:191] Error syncing pod b728f80c-1116-4ef9-b36b-6d05d11b72a1 ("dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"
	W0722 11:32:02.182134  210080 out.go:239]   Jul 22 11:31:37 old-k8s-version-584140 kubelet[730]: E0722 11:31:37.598777     730 pod_workers.go:191] Error syncing pod 5a4606c4-b596-44df-a930-60179facf4e9 ("metrics-server-9975d5f86-4jcvm_kube-system(5a4606c4-b596-44df-a930-60179facf4e9)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	  Jul 22 11:31:37 old-k8s-version-584140 kubelet[730]: E0722 11:31:37.598777     730 pod_workers.go:191] Error syncing pod 5a4606c4-b596-44df-a930-60179facf4e9 ("metrics-server-9975d5f86-4jcvm_kube-system(5a4606c4-b596-44df-a930-60179facf4e9)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W0722 11:32:02.182142  210080 out.go:239]   Jul 22 11:31:50 old-k8s-version-584140 kubelet[730]: E0722 11:31:50.598548     730 pod_workers.go:191] Error syncing pod b728f80c-1116-4ef9-b36b-6d05d11b72a1 ("dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"
	  Jul 22 11:31:50 old-k8s-version-584140 kubelet[730]: E0722 11:31:50.598548     730 pod_workers.go:191] Error syncing pod b728f80c-1116-4ef9-b36b-6d05d11b72a1 ("dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"
	W0722 11:32:02.182165  210080 out.go:239]   Jul 22 11:31:52 old-k8s-version-584140 kubelet[730]: E0722 11:31:52.598992     730 pod_workers.go:191] Error syncing pod 5a4606c4-b596-44df-a930-60179facf4e9 ("metrics-server-9975d5f86-4jcvm_kube-system(5a4606c4-b596-44df-a930-60179facf4e9)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	  Jul 22 11:31:52 old-k8s-version-584140 kubelet[730]: E0722 11:31:52.598992     730 pod_workers.go:191] Error syncing pod 5a4606c4-b596-44df-a930-60179facf4e9 ("metrics-server-9975d5f86-4jcvm_kube-system(5a4606c4-b596-44df-a930-60179facf4e9)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	I0722 11:32:02.182171  210080 out.go:304] Setting ErrFile to fd 2...
	I0722 11:32:02.182177  210080 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0722 11:32:12.183203  210080 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0722 11:32:12.202803  210080 api_server.go:72] duration metric: took 5m49.375690109s to wait for apiserver process to appear ...
	I0722 11:32:12.202845  210080 api_server.go:88] waiting for apiserver healthz status ...
	I0722 11:32:12.202883  210080 cri.go:54] listing CRI containers in root : {State:all Name:kube-apiserver Namespaces:[]}
	I0722 11:32:12.202977  210080 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
	I0722 11:32:12.281497  210080 cri.go:89] found id: "7b17da0e203acb0f33605e81ab92029743299c8b53e99bedad6247fb2e22336d"
	I0722 11:32:12.281517  210080 cri.go:89] found id: ""
	I0722 11:32:12.281525  210080 logs.go:276] 1 containers: [7b17da0e203acb0f33605e81ab92029743299c8b53e99bedad6247fb2e22336d]
	I0722 11:32:12.281584  210080 ssh_runner.go:195] Run: which crictl
	I0722 11:32:12.285928  210080 cri.go:54] listing CRI containers in root : {State:all Name:etcd Namespaces:[]}
	I0722 11:32:12.285996  210080 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
	I0722 11:32:12.366847  210080 cri.go:89] found id: "b8f395f6e10fffc01d9db2971c2690affd63e1173ebe081a173b1df5e29b3eae"
	I0722 11:32:12.366866  210080 cri.go:89] found id: ""
	I0722 11:32:12.366873  210080 logs.go:276] 1 containers: [b8f395f6e10fffc01d9db2971c2690affd63e1173ebe081a173b1df5e29b3eae]
	I0722 11:32:12.366925  210080 ssh_runner.go:195] Run: which crictl
	I0722 11:32:12.377727  210080 cri.go:54] listing CRI containers in root : {State:all Name:coredns Namespaces:[]}
	I0722 11:32:12.377844  210080 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
	I0722 11:32:12.489949  210080 cri.go:89] found id: "25b426692cff4a0ddaac80382d5fd8be373235953b017a1f2591adbc04fe5208"
	I0722 11:32:12.489969  210080 cri.go:89] found id: ""
	I0722 11:32:12.489976  210080 logs.go:276] 1 containers: [25b426692cff4a0ddaac80382d5fd8be373235953b017a1f2591adbc04fe5208]
	I0722 11:32:12.490035  210080 ssh_runner.go:195] Run: which crictl
	I0722 11:32:12.494239  210080 cri.go:54] listing CRI containers in root : {State:all Name:kube-scheduler Namespaces:[]}
	I0722 11:32:12.494312  210080 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
	I0722 11:32:12.570563  210080 cri.go:89] found id: "a38f1a7f716723ae1738fc6d121fd5959ee9c40c5b1c46b537955d760c9f4290"
	I0722 11:32:12.570583  210080 cri.go:89] found id: ""
	I0722 11:32:12.570591  210080 logs.go:276] 1 containers: [a38f1a7f716723ae1738fc6d121fd5959ee9c40c5b1c46b537955d760c9f4290]
	I0722 11:32:12.570644  210080 ssh_runner.go:195] Run: which crictl
	I0722 11:32:12.577492  210080 cri.go:54] listing CRI containers in root : {State:all Name:kube-proxy Namespaces:[]}
	I0722 11:32:12.577562  210080 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
	I0722 11:32:12.639244  210080 cri.go:89] found id: "5191e613fc2d72706f1d776fe8a845ca8f4b3cec7ff3b0f9d18aee199e8d79c6"
	I0722 11:32:12.639265  210080 cri.go:89] found id: ""
	I0722 11:32:12.639272  210080 logs.go:276] 1 containers: [5191e613fc2d72706f1d776fe8a845ca8f4b3cec7ff3b0f9d18aee199e8d79c6]
	I0722 11:32:12.639326  210080 ssh_runner.go:195] Run: which crictl
	I0722 11:32:12.645464  210080 cri.go:54] listing CRI containers in root : {State:all Name:kube-controller-manager Namespaces:[]}
	I0722 11:32:12.645532  210080 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
	I0722 11:32:12.711129  210080 cri.go:89] found id: "460bdeec3bdfccab7101c9d13045f9bcf87734da1fb0f6f8b6a5c0111906ac43"
	I0722 11:32:12.711207  210080 cri.go:89] found id: ""
	I0722 11:32:12.711230  210080 logs.go:276] 1 containers: [460bdeec3bdfccab7101c9d13045f9bcf87734da1fb0f6f8b6a5c0111906ac43]
	I0722 11:32:12.711316  210080 ssh_runner.go:195] Run: which crictl
	I0722 11:32:12.719704  210080 cri.go:54] listing CRI containers in root : {State:all Name:kindnet Namespaces:[]}
	I0722 11:32:12.719776  210080 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet
	I0722 11:32:12.806984  210080 cri.go:89] found id: "451ceb51fb176f2ab58c30c602fe7a8d8dcdde723f94ec75d058fd599561cfde"
	I0722 11:32:12.807002  210080 cri.go:89] found id: ""
	I0722 11:32:12.807009  210080 logs.go:276] 1 containers: [451ceb51fb176f2ab58c30c602fe7a8d8dcdde723f94ec75d058fd599561cfde]
	I0722 11:32:12.807062  210080 ssh_runner.go:195] Run: which crictl
	I0722 11:32:12.810945  210080 cri.go:54] listing CRI containers in root : {State:all Name:storage-provisioner Namespaces:[]}
	I0722 11:32:12.811013  210080 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=storage-provisioner
	I0722 11:32:12.904775  210080 cri.go:89] found id: "b64b9e0461292d72b7fc112215c86b2db789ed69b01b10063e3b4f24a2155a8a"
	I0722 11:32:12.904794  210080 cri.go:89] found id: "48a74507ee5da0b4b62d92cb8fe64853426c4fcd088c4d455c7d827c4c514ab2"
	I0722 11:32:12.904799  210080 cri.go:89] found id: ""
	I0722 11:32:12.904805  210080 logs.go:276] 2 containers: [b64b9e0461292d72b7fc112215c86b2db789ed69b01b10063e3b4f24a2155a8a 48a74507ee5da0b4b62d92cb8fe64853426c4fcd088c4d455c7d827c4c514ab2]
	I0722 11:32:12.904865  210080 ssh_runner.go:195] Run: which crictl
	I0722 11:32:12.913119  210080 ssh_runner.go:195] Run: which crictl
	I0722 11:32:12.916790  210080 cri.go:54] listing CRI containers in root : {State:all Name:kubernetes-dashboard Namespaces:[]}
	I0722 11:32:12.916854  210080 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kubernetes-dashboard
	I0722 11:32:12.991388  210080 cri.go:89] found id: "0da5dde31a386001ac351514fcd5b733872eb5d92ec8b3579e32b0f14de7b1fc"
	I0722 11:32:12.991462  210080 cri.go:89] found id: ""
	I0722 11:32:12.991484  210080 logs.go:276] 1 containers: [0da5dde31a386001ac351514fcd5b733872eb5d92ec8b3579e32b0f14de7b1fc]
	I0722 11:32:12.991583  210080 ssh_runner.go:195] Run: which crictl
	I0722 11:32:12.997559  210080 logs.go:123] Gathering logs for kubelet ...
	I0722 11:32:12.997645  210080 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
	W0722 11:32:13.066644  210080 logs.go:138] Found kubelet problem: Jul 22 11:26:39 old-k8s-version-584140 kubelet[730]: E0722 11:26:39.204682     730 reflector.go:138] object-"kube-system"/"kube-proxy": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "kube-proxy" is forbidden: User "system:node:old-k8s-version-584140" cannot list resource "configmaps" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-584140' and this object
	W0722 11:32:13.066947  210080 logs.go:138] Found kubelet problem: Jul 22 11:26:39 old-k8s-version-584140 kubelet[730]: E0722 11:26:39.205097     730 reflector.go:138] object-"kube-system"/"storage-provisioner-token-th5sl": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "storage-provisioner-token-th5sl" is forbidden: User "system:node:old-k8s-version-584140" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-584140' and this object
	W0722 11:32:13.067193  210080 logs.go:138] Found kubelet problem: Jul 22 11:26:39 old-k8s-version-584140 kubelet[730]: E0722 11:26:39.205388     730 reflector.go:138] object-"default"/"default-token-gkskl": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "default-token-gkskl" is forbidden: User "system:node:old-k8s-version-584140" cannot list resource "secrets" in API group "" in the namespace "default": no relationship found between node 'old-k8s-version-584140' and this object
	W0722 11:32:13.067423  210080 logs.go:138] Found kubelet problem: Jul 22 11:26:39 old-k8s-version-584140 kubelet[730]: E0722 11:26:39.206223     730 reflector.go:138] object-"kube-system"/"coredns": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "coredns" is forbidden: User "system:node:old-k8s-version-584140" cannot list resource "configmaps" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-584140' and this object
	W0722 11:32:13.067664  210080 logs.go:138] Found kubelet problem: Jul 22 11:26:39 old-k8s-version-584140 kubelet[730]: E0722 11:26:39.206544     730 reflector.go:138] object-"kube-system"/"kube-proxy-token-g9gsb": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "kube-proxy-token-g9gsb" is forbidden: User "system:node:old-k8s-version-584140" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-584140' and this object
	W0722 11:32:13.067913  210080 logs.go:138] Found kubelet problem: Jul 22 11:26:39 old-k8s-version-584140 kubelet[730]: E0722 11:26:39.206876     730 reflector.go:138] object-"kube-system"/"kindnet-token-tjmsp": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "kindnet-token-tjmsp" is forbidden: User "system:node:old-k8s-version-584140" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-584140' and this object
	W0722 11:32:13.068162  210080 logs.go:138] Found kubelet problem: Jul 22 11:26:39 old-k8s-version-584140 kubelet[730]: E0722 11:26:39.207130     730 reflector.go:138] object-"kube-system"/"metrics-server-token-btvqb": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "metrics-server-token-btvqb" is forbidden: User "system:node:old-k8s-version-584140" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-584140' and this object
	W0722 11:32:13.068406  210080 logs.go:138] Found kubelet problem: Jul 22 11:26:39 old-k8s-version-584140 kubelet[730]: E0722 11:26:39.207456     730 reflector.go:138] object-"kube-system"/"coredns-token-7tqrc": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "coredns-token-7tqrc" is forbidden: User "system:node:old-k8s-version-584140" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-584140' and this object
	W0722 11:32:13.091614  210080 logs.go:138] Found kubelet problem: Jul 22 11:26:43 old-k8s-version-584140 kubelet[730]: E0722 11:26:43.160558     730 pod_workers.go:191] Error syncing pod 5a4606c4-b596-44df-a930-60179facf4e9 ("metrics-server-9975d5f86-4jcvm_kube-system(5a4606c4-b596-44df-a930-60179facf4e9)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = pinging container registry fake.domain: Get \"https://fake.domain/v2/\": dial tcp: lookup fake.domain: no such host"
	W0722 11:32:13.091891  210080 logs.go:138] Found kubelet problem: Jul 22 11:26:43 old-k8s-version-584140 kubelet[730]: E0722 11:26:43.632278     730 pod_workers.go:191] Error syncing pod 5a4606c4-b596-44df-a930-60179facf4e9 ("metrics-server-9975d5f86-4jcvm_kube-system(5a4606c4-b596-44df-a930-60179facf4e9)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W0722 11:32:13.096193  210080 logs.go:138] Found kubelet problem: Jul 22 11:26:54 old-k8s-version-584140 kubelet[730]: E0722 11:26:54.611909     730 pod_workers.go:191] Error syncing pod 5a4606c4-b596-44df-a930-60179facf4e9 ("metrics-server-9975d5f86-4jcvm_kube-system(5a4606c4-b596-44df-a930-60179facf4e9)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = pinging container registry fake.domain: Get \"https://fake.domain/v2/\": dial tcp: lookup fake.domain: no such host"
	W0722 11:32:13.098728  210080 logs.go:138] Found kubelet problem: Jul 22 11:27:02 old-k8s-version-584140 kubelet[730]: E0722 11:27:02.738618     730 pod_workers.go:191] Error syncing pod b728f80c-1116-4ef9-b36b-6d05d11b72a1 ("dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 10s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"
	W0722 11:32:13.099226  210080 logs.go:138] Found kubelet problem: Jul 22 11:27:03 old-k8s-version-584140 kubelet[730]: E0722 11:27:03.741827     730 pod_workers.go:191] Error syncing pod b728f80c-1116-4ef9-b36b-6d05d11b72a1 ("dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 10s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"
	W0722 11:32:13.099583  210080 logs.go:138] Found kubelet problem: Jul 22 11:27:04 old-k8s-version-584140 kubelet[730]: E0722 11:27:04.838076     730 pod_workers.go:191] Error syncing pod b728f80c-1116-4ef9-b36b-6d05d11b72a1 ("dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 10s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"
	W0722 11:32:13.103114  210080 logs.go:138] Found kubelet problem: Jul 22 11:27:09 old-k8s-version-584140 kubelet[730]: E0722 11:27:09.598856     730 pod_workers.go:191] Error syncing pod 5a4606c4-b596-44df-a930-60179facf4e9 ("metrics-server-9975d5f86-4jcvm_kube-system(5a4606c4-b596-44df-a930-60179facf4e9)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W0722 11:32:13.103933  210080 logs.go:138] Found kubelet problem: Jul 22 11:27:18 old-k8s-version-584140 kubelet[730]: E0722 11:27:18.778810     730 pod_workers.go:191] Error syncing pod b728f80c-1116-4ef9-b36b-6d05d11b72a1 ("dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"
	W0722 11:32:13.106139  210080 logs.go:138] Found kubelet problem: Jul 22 11:27:23 old-k8s-version-584140 kubelet[730]: E0722 11:27:23.614499     730 pod_workers.go:191] Error syncing pod 5a4606c4-b596-44df-a930-60179facf4e9 ("metrics-server-9975d5f86-4jcvm_kube-system(5a4606c4-b596-44df-a930-60179facf4e9)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = pinging container registry fake.domain: Get \"https://fake.domain/v2/\": dial tcp: lookup fake.domain: no such host"
	W0722 11:32:13.106475  210080 logs.go:138] Found kubelet problem: Jul 22 11:27:24 old-k8s-version-584140 kubelet[730]: E0722 11:27:24.838228     730 pod_workers.go:191] Error syncing pod b728f80c-1116-4ef9-b36b-6d05d11b72a1 ("dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"
	W0722 11:32:13.106803  210080 logs.go:138] Found kubelet problem: Jul 22 11:27:36 old-k8s-version-584140 kubelet[730]: E0722 11:27:36.599081     730 pod_workers.go:191] Error syncing pod b728f80c-1116-4ef9-b36b-6d05d11b72a1 ("dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"
	W0722 11:32:13.106986  210080 logs.go:138] Found kubelet problem: Jul 22 11:27:38 old-k8s-version-584140 kubelet[730]: E0722 11:27:38.598819     730 pod_workers.go:191] Error syncing pod 5a4606c4-b596-44df-a930-60179facf4e9 ("metrics-server-9975d5f86-4jcvm_kube-system(5a4606c4-b596-44df-a930-60179facf4e9)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W0722 11:32:13.107575  210080 logs.go:138] Found kubelet problem: Jul 22 11:27:50 old-k8s-version-584140 kubelet[730]: E0722 11:27:50.837672     730 pod_workers.go:191] Error syncing pod b728f80c-1116-4ef9-b36b-6d05d11b72a1 ("dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"
	W0722 11:32:13.107756  210080 logs.go:138] Found kubelet problem: Jul 22 11:27:53 old-k8s-version-584140 kubelet[730]: E0722 11:27:53.599749     730 pod_workers.go:191] Error syncing pod 5a4606c4-b596-44df-a930-60179facf4e9 ("metrics-server-9975d5f86-4jcvm_kube-system(5a4606c4-b596-44df-a930-60179facf4e9)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W0722 11:32:13.108087  210080 logs.go:138] Found kubelet problem: Jul 22 11:27:54 old-k8s-version-584140 kubelet[730]: E0722 11:27:54.838469     730 pod_workers.go:191] Error syncing pod b728f80c-1116-4ef9-b36b-6d05d11b72a1 ("dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"
	W0722 11:32:13.108413  210080 logs.go:138] Found kubelet problem: Jul 22 11:28:06 old-k8s-version-584140 kubelet[730]: E0722 11:28:06.598312     730 pod_workers.go:191] Error syncing pod b728f80c-1116-4ef9-b36b-6d05d11b72a1 ("dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"
	W0722 11:32:13.112031  210080 logs.go:138] Found kubelet problem: Jul 22 11:28:07 old-k8s-version-584140 kubelet[730]: E0722 11:28:07.619353     730 pod_workers.go:191] Error syncing pod 5a4606c4-b596-44df-a930-60179facf4e9 ("metrics-server-9975d5f86-4jcvm_kube-system(5a4606c4-b596-44df-a930-60179facf4e9)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = pinging container registry fake.domain: Get \"https://fake.domain/v2/\": dial tcp: lookup fake.domain: no such host"
	W0722 11:32:13.112416  210080 logs.go:138] Found kubelet problem: Jul 22 11:28:20 old-k8s-version-584140 kubelet[730]: E0722 11:28:20.599140     730 pod_workers.go:191] Error syncing pod b728f80c-1116-4ef9-b36b-6d05d11b72a1 ("dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"
	W0722 11:32:13.112656  210080 logs.go:138] Found kubelet problem: Jul 22 11:28:20 old-k8s-version-584140 kubelet[730]: E0722 11:28:20.600438     730 pod_workers.go:191] Error syncing pod 5a4606c4-b596-44df-a930-60179facf4e9 ("metrics-server-9975d5f86-4jcvm_kube-system(5a4606c4-b596-44df-a930-60179facf4e9)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W0722 11:32:13.113300  210080 logs.go:138] Found kubelet problem: Jul 22 11:28:33 old-k8s-version-584140 kubelet[730]: E0722 11:28:33.909665     730 pod_workers.go:191] Error syncing pod b728f80c-1116-4ef9-b36b-6d05d11b72a1 ("dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"
	W0722 11:32:13.113656  210080 logs.go:138] Found kubelet problem: Jul 22 11:28:34 old-k8s-version-584140 kubelet[730]: E0722 11:28:34.912079     730 pod_workers.go:191] Error syncing pod b728f80c-1116-4ef9-b36b-6d05d11b72a1 ("dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"
	W0722 11:32:13.113873  210080 logs.go:138] Found kubelet problem: Jul 22 11:28:35 old-k8s-version-584140 kubelet[730]: E0722 11:28:35.599081     730 pod_workers.go:191] Error syncing pod 5a4606c4-b596-44df-a930-60179facf4e9 ("metrics-server-9975d5f86-4jcvm_kube-system(5a4606c4-b596-44df-a930-60179facf4e9)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W0722 11:32:13.114232  210080 logs.go:138] Found kubelet problem: Jul 22 11:28:46 old-k8s-version-584140 kubelet[730]: E0722 11:28:46.598307     730 pod_workers.go:191] Error syncing pod b728f80c-1116-4ef9-b36b-6d05d11b72a1 ("dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"
	W0722 11:32:13.114449  210080 logs.go:138] Found kubelet problem: Jul 22 11:28:50 old-k8s-version-584140 kubelet[730]: E0722 11:28:50.599499     730 pod_workers.go:191] Error syncing pod 5a4606c4-b596-44df-a930-60179facf4e9 ("metrics-server-9975d5f86-4jcvm_kube-system(5a4606c4-b596-44df-a930-60179facf4e9)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W0722 11:32:13.114814  210080 logs.go:138] Found kubelet problem: Jul 22 11:29:01 old-k8s-version-584140 kubelet[730]: E0722 11:29:01.598946     730 pod_workers.go:191] Error syncing pod b728f80c-1116-4ef9-b36b-6d05d11b72a1 ("dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"
	W0722 11:32:13.115037  210080 logs.go:138] Found kubelet problem: Jul 22 11:29:04 old-k8s-version-584140 kubelet[730]: E0722 11:29:04.598688     730 pod_workers.go:191] Error syncing pod 5a4606c4-b596-44df-a930-60179facf4e9 ("metrics-server-9975d5f86-4jcvm_kube-system(5a4606c4-b596-44df-a930-60179facf4e9)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W0722 11:32:13.115407  210080 logs.go:138] Found kubelet problem: Jul 22 11:29:12 old-k8s-version-584140 kubelet[730]: E0722 11:29:12.598338     730 pod_workers.go:191] Error syncing pod b728f80c-1116-4ef9-b36b-6d05d11b72a1 ("dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"
	W0722 11:32:13.115623  210080 logs.go:138] Found kubelet problem: Jul 22 11:29:19 old-k8s-version-584140 kubelet[730]: E0722 11:29:19.598946     730 pod_workers.go:191] Error syncing pod 5a4606c4-b596-44df-a930-60179facf4e9 ("metrics-server-9975d5f86-4jcvm_kube-system(5a4606c4-b596-44df-a930-60179facf4e9)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W0722 11:32:13.115987  210080 logs.go:138] Found kubelet problem: Jul 22 11:29:26 old-k8s-version-584140 kubelet[730]: E0722 11:29:26.598882     730 pod_workers.go:191] Error syncing pod b728f80c-1116-4ef9-b36b-6d05d11b72a1 ("dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"
	W0722 11:32:13.118742  210080 logs.go:138] Found kubelet problem: Jul 22 11:29:33 old-k8s-version-584140 kubelet[730]: E0722 11:29:33.611073     730 pod_workers.go:191] Error syncing pod 5a4606c4-b596-44df-a930-60179facf4e9 ("metrics-server-9975d5f86-4jcvm_kube-system(5a4606c4-b596-44df-a930-60179facf4e9)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = pinging container registry fake.domain: Get \"https://fake.domain/v2/\": dial tcp: lookup fake.domain: no such host"
	W0722 11:32:13.119112  210080 logs.go:138] Found kubelet problem: Jul 22 11:29:37 old-k8s-version-584140 kubelet[730]: E0722 11:29:37.598186     730 pod_workers.go:191] Error syncing pod b728f80c-1116-4ef9-b36b-6d05d11b72a1 ("dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"
	W0722 11:32:13.119323  210080 logs.go:138] Found kubelet problem: Jul 22 11:29:46 old-k8s-version-584140 kubelet[730]: E0722 11:29:46.599495     730 pod_workers.go:191] Error syncing pod 5a4606c4-b596-44df-a930-60179facf4e9 ("metrics-server-9975d5f86-4jcvm_kube-system(5a4606c4-b596-44df-a930-60179facf4e9)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W0722 11:32:13.119677  210080 logs.go:138] Found kubelet problem: Jul 22 11:29:48 old-k8s-version-584140 kubelet[730]: E0722 11:29:48.598602     730 pod_workers.go:191] Error syncing pod b728f80c-1116-4ef9-b36b-6d05d11b72a1 ("dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"
	W0722 11:32:13.119896  210080 logs.go:138] Found kubelet problem: Jul 22 11:30:00 old-k8s-version-584140 kubelet[730]: E0722 11:30:00.599866     730 pod_workers.go:191] Error syncing pod 5a4606c4-b596-44df-a930-60179facf4e9 ("metrics-server-9975d5f86-4jcvm_kube-system(5a4606c4-b596-44df-a930-60179facf4e9)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W0722 11:32:13.120518  210080 logs.go:138] Found kubelet problem: Jul 22 11:30:03 old-k8s-version-584140 kubelet[730]: E0722 11:30:03.060169     730 pod_workers.go:191] Error syncing pod b728f80c-1116-4ef9-b36b-6d05d11b72a1 ("dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"
	W0722 11:32:13.120882  210080 logs.go:138] Found kubelet problem: Jul 22 11:30:04 old-k8s-version-584140 kubelet[730]: E0722 11:30:04.837656     730 pod_workers.go:191] Error syncing pod b728f80c-1116-4ef9-b36b-6d05d11b72a1 ("dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"
	W0722 11:32:13.121095  210080 logs.go:138] Found kubelet problem: Jul 22 11:30:13 old-k8s-version-584140 kubelet[730]: E0722 11:30:13.598674     730 pod_workers.go:191] Error syncing pod 5a4606c4-b596-44df-a930-60179facf4e9 ("metrics-server-9975d5f86-4jcvm_kube-system(5a4606c4-b596-44df-a930-60179facf4e9)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W0722 11:32:13.121455  210080 logs.go:138] Found kubelet problem: Jul 22 11:30:17 old-k8s-version-584140 kubelet[730]: E0722 11:30:17.598240     730 pod_workers.go:191] Error syncing pod b728f80c-1116-4ef9-b36b-6d05d11b72a1 ("dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"
	W0722 11:32:13.121671  210080 logs.go:138] Found kubelet problem: Jul 22 11:30:28 old-k8s-version-584140 kubelet[730]: E0722 11:30:28.598615     730 pod_workers.go:191] Error syncing pod 5a4606c4-b596-44df-a930-60179facf4e9 ("metrics-server-9975d5f86-4jcvm_kube-system(5a4606c4-b596-44df-a930-60179facf4e9)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W0722 11:32:13.122558  210080 logs.go:138] Found kubelet problem: Jul 22 11:30:31 old-k8s-version-584140 kubelet[730]: E0722 11:30:31.598312     730 pod_workers.go:191] Error syncing pod b728f80c-1116-4ef9-b36b-6d05d11b72a1 ("dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"
	W0722 11:32:13.122777  210080 logs.go:138] Found kubelet problem: Jul 22 11:30:43 old-k8s-version-584140 kubelet[730]: E0722 11:30:43.599168     730 pod_workers.go:191] Error syncing pod 5a4606c4-b596-44df-a930-60179facf4e9 ("metrics-server-9975d5f86-4jcvm_kube-system(5a4606c4-b596-44df-a930-60179facf4e9)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W0722 11:32:13.123140  210080 logs.go:138] Found kubelet problem: Jul 22 11:30:44 old-k8s-version-584140 kubelet[730]: E0722 11:30:44.598289     730 pod_workers.go:191] Error syncing pod b728f80c-1116-4ef9-b36b-6d05d11b72a1 ("dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"
	W0722 11:32:13.123361  210080 logs.go:138] Found kubelet problem: Jul 22 11:30:55 old-k8s-version-584140 kubelet[730]: E0722 11:30:55.599111     730 pod_workers.go:191] Error syncing pod 5a4606c4-b596-44df-a930-60179facf4e9 ("metrics-server-9975d5f86-4jcvm_kube-system(5a4606c4-b596-44df-a930-60179facf4e9)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W0722 11:32:13.123761  210080 logs.go:138] Found kubelet problem: Jul 22 11:30:58 old-k8s-version-584140 kubelet[730]: E0722 11:30:58.598266     730 pod_workers.go:191] Error syncing pod b728f80c-1116-4ef9-b36b-6d05d11b72a1 ("dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"
	W0722 11:32:13.123983  210080 logs.go:138] Found kubelet problem: Jul 22 11:31:08 old-k8s-version-584140 kubelet[730]: E0722 11:31:08.598772     730 pod_workers.go:191] Error syncing pod 5a4606c4-b596-44df-a930-60179facf4e9 ("metrics-server-9975d5f86-4jcvm_kube-system(5a4606c4-b596-44df-a930-60179facf4e9)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W0722 11:32:13.124338  210080 logs.go:138] Found kubelet problem: Jul 22 11:31:12 old-k8s-version-584140 kubelet[730]: E0722 11:31:12.598216     730 pod_workers.go:191] Error syncing pod b728f80c-1116-4ef9-b36b-6d05d11b72a1 ("dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"
	W0722 11:32:13.124695  210080 logs.go:138] Found kubelet problem: Jul 22 11:31:23 old-k8s-version-584140 kubelet[730]: E0722 11:31:23.598165     730 pod_workers.go:191] Error syncing pod b728f80c-1116-4ef9-b36b-6d05d11b72a1 ("dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"
	W0722 11:32:13.124915  210080 logs.go:138] Found kubelet problem: Jul 22 11:31:23 old-k8s-version-584140 kubelet[730]: E0722 11:31:23.599281     730 pod_workers.go:191] Error syncing pod 5a4606c4-b596-44df-a930-60179facf4e9 ("metrics-server-9975d5f86-4jcvm_kube-system(5a4606c4-b596-44df-a930-60179facf4e9)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W0722 11:32:13.125573  210080 logs.go:138] Found kubelet problem: Jul 22 11:31:36 old-k8s-version-584140 kubelet[730]: E0722 11:31:36.598285     730 pod_workers.go:191] Error syncing pod b728f80c-1116-4ef9-b36b-6d05d11b72a1 ("dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"
	W0722 11:32:13.125763  210080 logs.go:138] Found kubelet problem: Jul 22 11:31:37 old-k8s-version-584140 kubelet[730]: E0722 11:31:37.598777     730 pod_workers.go:191] Error syncing pod 5a4606c4-b596-44df-a930-60179facf4e9 ("metrics-server-9975d5f86-4jcvm_kube-system(5a4606c4-b596-44df-a930-60179facf4e9)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W0722 11:32:13.126093  210080 logs.go:138] Found kubelet problem: Jul 22 11:31:50 old-k8s-version-584140 kubelet[730]: E0722 11:31:50.598548     730 pod_workers.go:191] Error syncing pod b728f80c-1116-4ef9-b36b-6d05d11b72a1 ("dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"
	W0722 11:32:13.126277  210080 logs.go:138] Found kubelet problem: Jul 22 11:31:52 old-k8s-version-584140 kubelet[730]: E0722 11:31:52.598992     730 pod_workers.go:191] Error syncing pod 5a4606c4-b596-44df-a930-60179facf4e9 ("metrics-server-9975d5f86-4jcvm_kube-system(5a4606c4-b596-44df-a930-60179facf4e9)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W0722 11:32:13.126606  210080 logs.go:138] Found kubelet problem: Jul 22 11:32:04 old-k8s-version-584140 kubelet[730]: E0722 11:32:04.598313     730 pod_workers.go:191] Error syncing pod b728f80c-1116-4ef9-b36b-6d05d11b72a1 ("dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"
	W0722 11:32:13.126802  210080 logs.go:138] Found kubelet problem: Jul 22 11:32:07 old-k8s-version-584140 kubelet[730]: E0722 11:32:07.598569     730 pod_workers.go:191] Error syncing pod 5a4606c4-b596-44df-a930-60179facf4e9 ("metrics-server-9975d5f86-4jcvm_kube-system(5a4606c4-b596-44df-a930-60179facf4e9)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	I0722 11:32:13.126810  210080 logs.go:123] Gathering logs for describe nodes ...
	I0722 11:32:13.126824  210080 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
	I0722 11:32:13.399039  210080 logs.go:123] Gathering logs for kindnet [451ceb51fb176f2ab58c30c602fe7a8d8dcdde723f94ec75d058fd599561cfde] ...
	I0722 11:32:13.399119  210080 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 451ceb51fb176f2ab58c30c602fe7a8d8dcdde723f94ec75d058fd599561cfde"
	I0722 11:32:13.526326  210080 logs.go:123] Gathering logs for storage-provisioner [b64b9e0461292d72b7fc112215c86b2db789ed69b01b10063e3b4f24a2155a8a] ...
	I0722 11:32:13.526402  210080 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 b64b9e0461292d72b7fc112215c86b2db789ed69b01b10063e3b4f24a2155a8a"
	I0722 11:32:13.598245  210080 logs.go:123] Gathering logs for storage-provisioner [48a74507ee5da0b4b62d92cb8fe64853426c4fcd088c4d455c7d827c4c514ab2] ...
	I0722 11:32:13.598325  210080 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 48a74507ee5da0b4b62d92cb8fe64853426c4fcd088c4d455c7d827c4c514ab2"
	I0722 11:32:13.663983  210080 logs.go:123] Gathering logs for CRI-O ...
	I0722 11:32:13.664010  210080 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u crio -n 400"
	I0722 11:32:13.774294  210080 logs.go:123] Gathering logs for kube-apiserver [7b17da0e203acb0f33605e81ab92029743299c8b53e99bedad6247fb2e22336d] ...
	I0722 11:32:13.774368  210080 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 7b17da0e203acb0f33605e81ab92029743299c8b53e99bedad6247fb2e22336d"
	I0722 11:32:13.916684  210080 logs.go:123] Gathering logs for etcd [b8f395f6e10fffc01d9db2971c2690affd63e1173ebe081a173b1df5e29b3eae] ...
	I0722 11:32:13.916766  210080 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 b8f395f6e10fffc01d9db2971c2690affd63e1173ebe081a173b1df5e29b3eae"
	I0722 11:32:13.987707  210080 logs.go:123] Gathering logs for coredns [25b426692cff4a0ddaac80382d5fd8be373235953b017a1f2591adbc04fe5208] ...
	I0722 11:32:13.987784  210080 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 25b426692cff4a0ddaac80382d5fd8be373235953b017a1f2591adbc04fe5208"
	I0722 11:32:14.058506  210080 logs.go:123] Gathering logs for kube-controller-manager [460bdeec3bdfccab7101c9d13045f9bcf87734da1fb0f6f8b6a5c0111906ac43] ...
	I0722 11:32:14.058580  210080 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 460bdeec3bdfccab7101c9d13045f9bcf87734da1fb0f6f8b6a5c0111906ac43"
	I0722 11:32:14.180422  210080 logs.go:123] Gathering logs for dmesg ...
	I0722 11:32:14.180504  210080 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
	I0722 11:32:14.206776  210080 logs.go:123] Gathering logs for kube-scheduler [a38f1a7f716723ae1738fc6d121fd5959ee9c40c5b1c46b537955d760c9f4290] ...
	I0722 11:32:14.206809  210080 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 a38f1a7f716723ae1738fc6d121fd5959ee9c40c5b1c46b537955d760c9f4290"
	I0722 11:32:14.284863  210080 logs.go:123] Gathering logs for kube-proxy [5191e613fc2d72706f1d776fe8a845ca8f4b3cec7ff3b0f9d18aee199e8d79c6] ...
	I0722 11:32:14.284912  210080 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 5191e613fc2d72706f1d776fe8a845ca8f4b3cec7ff3b0f9d18aee199e8d79c6"
	I0722 11:32:14.362593  210080 logs.go:123] Gathering logs for kubernetes-dashboard [0da5dde31a386001ac351514fcd5b733872eb5d92ec8b3579e32b0f14de7b1fc] ...
	I0722 11:32:14.362628  210080 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 0da5dde31a386001ac351514fcd5b733872eb5d92ec8b3579e32b0f14de7b1fc"
	I0722 11:32:14.443975  210080 logs.go:123] Gathering logs for container status ...
	I0722 11:32:14.444089  210080 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
	I0722 11:32:14.520662  210080 out.go:304] Setting ErrFile to fd 2...
	I0722 11:32:14.520689  210080 out.go:338] TERM=,COLORTERM=, which probably does not support color
	W0722 11:32:14.520820  210080 out.go:239] X Problems detected in kubelet:
	X Problems detected in kubelet:
	W0722 11:32:14.520838  210080 out.go:239]   Jul 22 11:31:37 old-k8s-version-584140 kubelet[730]: E0722 11:31:37.598777     730 pod_workers.go:191] Error syncing pod 5a4606c4-b596-44df-a930-60179facf4e9 ("metrics-server-9975d5f86-4jcvm_kube-system(5a4606c4-b596-44df-a930-60179facf4e9)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	  Jul 22 11:31:37 old-k8s-version-584140 kubelet[730]: E0722 11:31:37.598777     730 pod_workers.go:191] Error syncing pod 5a4606c4-b596-44df-a930-60179facf4e9 ("metrics-server-9975d5f86-4jcvm_kube-system(5a4606c4-b596-44df-a930-60179facf4e9)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W0722 11:32:14.520846  210080 out.go:239]   Jul 22 11:31:50 old-k8s-version-584140 kubelet[730]: E0722 11:31:50.598548     730 pod_workers.go:191] Error syncing pod b728f80c-1116-4ef9-b36b-6d05d11b72a1 ("dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"
	  Jul 22 11:31:50 old-k8s-version-584140 kubelet[730]: E0722 11:31:50.598548     730 pod_workers.go:191] Error syncing pod b728f80c-1116-4ef9-b36b-6d05d11b72a1 ("dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"
	W0722 11:32:14.520996  210080 out.go:239]   Jul 22 11:31:52 old-k8s-version-584140 kubelet[730]: E0722 11:31:52.598992     730 pod_workers.go:191] Error syncing pod 5a4606c4-b596-44df-a930-60179facf4e9 ("metrics-server-9975d5f86-4jcvm_kube-system(5a4606c4-b596-44df-a930-60179facf4e9)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	  Jul 22 11:31:52 old-k8s-version-584140 kubelet[730]: E0722 11:31:52.598992     730 pod_workers.go:191] Error syncing pod 5a4606c4-b596-44df-a930-60179facf4e9 ("metrics-server-9975d5f86-4jcvm_kube-system(5a4606c4-b596-44df-a930-60179facf4e9)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W0722 11:32:14.521011  210080 out.go:239]   Jul 22 11:32:04 old-k8s-version-584140 kubelet[730]: E0722 11:32:04.598313     730 pod_workers.go:191] Error syncing pod b728f80c-1116-4ef9-b36b-6d05d11b72a1 ("dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"
	  Jul 22 11:32:04 old-k8s-version-584140 kubelet[730]: E0722 11:32:04.598313     730 pod_workers.go:191] Error syncing pod b728f80c-1116-4ef9-b36b-6d05d11b72a1 ("dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"
	W0722 11:32:14.521018  210080 out.go:239]   Jul 22 11:32:07 old-k8s-version-584140 kubelet[730]: E0722 11:32:07.598569     730 pod_workers.go:191] Error syncing pod 5a4606c4-b596-44df-a930-60179facf4e9 ("metrics-server-9975d5f86-4jcvm_kube-system(5a4606c4-b596-44df-a930-60179facf4e9)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	  Jul 22 11:32:07 old-k8s-version-584140 kubelet[730]: E0722 11:32:07.598569     730 pod_workers.go:191] Error syncing pod 5a4606c4-b596-44df-a930-60179facf4e9 ("metrics-server-9975d5f86-4jcvm_kube-system(5a4606c4-b596-44df-a930-60179facf4e9)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	I0722 11:32:14.521025  210080 out.go:304] Setting ErrFile to fd 2...
	I0722 11:32:14.521035  210080 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0722 11:32:24.521380  210080 api_server.go:253] Checking apiserver healthz at https://192.168.76.2:8443/healthz ...
	I0722 11:32:24.532152  210080 api_server.go:279] https://192.168.76.2:8443/healthz returned 200:
	ok
	I0722 11:32:24.534362  210080 out.go:177] 
	W0722 11:32:24.536402  210080 out.go:239] X Exiting due to K8S_UNHEALTHY_CONTROL_PLANE: wait 6m0s for node: wait for healthy API server: controlPlane never updated to v1.20.0
	X Exiting due to K8S_UNHEALTHY_CONTROL_PLANE: wait 6m0s for node: wait for healthy API server: controlPlane never updated to v1.20.0
	W0722 11:32:24.536544  210080 out.go:239] * Suggestion: Control Plane could not update, try minikube delete --all --purge
	* Suggestion: Control Plane could not update, try minikube delete --all --purge
	W0722 11:32:24.536574  210080 out.go:239] * Related issue: https://github.com/kubernetes/minikube/issues/11417
	* Related issue: https://github.com/kubernetes/minikube/issues/11417
	W0722 11:32:24.536587  210080 out.go:239] * 
	* 
	W0722 11:32:24.537591  210080 out.go:239] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                             │
	│    * If the above advice does not help, please let us know:                                 │
	│      https://github.com/kubernetes/minikube/issues/new/choose                               │
	│                                                                                             │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │
	│                                                                                             │
	╰─────────────────────────────────────────────────────────────────────────────────────────────╯
	╭─────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                             │
	│    * If the above advice does not help, please let us know:                                 │
	│      https://github.com/kubernetes/minikube/issues/new/choose                               │
	│                                                                                             │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │
	│                                                                                             │
	╰─────────────────────────────────────────────────────────────────────────────────────────────╯
	I0722 11:32:24.538987  210080 out.go:177] 

                                                
                                                
** /stderr **
start_stop_delete_test.go:259: failed to start minikube post-stop. args "out/minikube-linux-arm64 start -p old-k8s-version-584140 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=docker  --container-runtime=crio --kubernetes-version=v1.20.0": exit status 102
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:230: ======>  post-mortem[TestStartStop/group/old-k8s-version/serial/SecondStart]: docker inspect <======
helpers_test.go:231: (dbg) Run:  docker inspect old-k8s-version-584140
helpers_test.go:235: (dbg) docker inspect old-k8s-version-584140:

                                                
                                                
-- stdout --
	[
	    {
	        "Id": "9a47d5204824dea9de7e428feb7e5cba07dfecea49620ebac54e1ddc8586aed6",
	        "Created": "2024-07-22T11:23:13.644495933Z",
	        "Path": "/usr/local/bin/entrypoint",
	        "Args": [
	            "/sbin/init"
	        ],
	        "State": {
	            "Status": "running",
	            "Running": true,
	            "Paused": false,
	            "Restarting": false,
	            "OOMKilled": false,
	            "Dead": false,
	            "Pid": 210290,
	            "ExitCode": 0,
	            "Error": "",
	            "StartedAt": "2024-07-22T11:26:14.128020685Z",
	            "FinishedAt": "2024-07-22T11:26:13.098347533Z"
	        },
	        "Image": "sha256:e2c91a2178aa1acdb3eade350c62303b0cf135b362b91c6aa21cd060c2dbfcac",
	        "ResolvConfPath": "/var/lib/docker/containers/9a47d5204824dea9de7e428feb7e5cba07dfecea49620ebac54e1ddc8586aed6/resolv.conf",
	        "HostnamePath": "/var/lib/docker/containers/9a47d5204824dea9de7e428feb7e5cba07dfecea49620ebac54e1ddc8586aed6/hostname",
	        "HostsPath": "/var/lib/docker/containers/9a47d5204824dea9de7e428feb7e5cba07dfecea49620ebac54e1ddc8586aed6/hosts",
	        "LogPath": "/var/lib/docker/containers/9a47d5204824dea9de7e428feb7e5cba07dfecea49620ebac54e1ddc8586aed6/9a47d5204824dea9de7e428feb7e5cba07dfecea49620ebac54e1ddc8586aed6-json.log",
	        "Name": "/old-k8s-version-584140",
	        "RestartCount": 0,
	        "Driver": "overlay2",
	        "Platform": "linux",
	        "MountLabel": "",
	        "ProcessLabel": "",
	        "AppArmorProfile": "unconfined",
	        "ExecIDs": null,
	        "HostConfig": {
	            "Binds": [
	                "/lib/modules:/lib/modules:ro",
	                "old-k8s-version-584140:/var"
	            ],
	            "ContainerIDFile": "",
	            "LogConfig": {
	                "Type": "json-file",
	                "Config": {}
	            },
	            "NetworkMode": "old-k8s-version-584140",
	            "PortBindings": {
	                "22/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": ""
	                    }
	                ],
	                "2376/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": ""
	                    }
	                ],
	                "32443/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": ""
	                    }
	                ],
	                "5000/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": ""
	                    }
	                ],
	                "8443/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": ""
	                    }
	                ]
	            },
	            "RestartPolicy": {
	                "Name": "no",
	                "MaximumRetryCount": 0
	            },
	            "AutoRemove": false,
	            "VolumeDriver": "",
	            "VolumesFrom": null,
	            "ConsoleSize": [
	                0,
	                0
	            ],
	            "CapAdd": null,
	            "CapDrop": null,
	            "CgroupnsMode": "host",
	            "Dns": [],
	            "DnsOptions": [],
	            "DnsSearch": [],
	            "ExtraHosts": null,
	            "GroupAdd": null,
	            "IpcMode": "private",
	            "Cgroup": "",
	            "Links": null,
	            "OomScoreAdj": 0,
	            "PidMode": "",
	            "Privileged": true,
	            "PublishAllPorts": false,
	            "ReadonlyRootfs": false,
	            "SecurityOpt": [
	                "seccomp=unconfined",
	                "apparmor=unconfined",
	                "label=disable"
	            ],
	            "Tmpfs": {
	                "/run": "",
	                "/tmp": ""
	            },
	            "UTSMode": "",
	            "UsernsMode": "",
	            "ShmSize": 67108864,
	            "Runtime": "runc",
	            "Isolation": "",
	            "CpuShares": 0,
	            "Memory": 2306867200,
	            "NanoCpus": 2000000000,
	            "CgroupParent": "",
	            "BlkioWeight": 0,
	            "BlkioWeightDevice": [],
	            "BlkioDeviceReadBps": [],
	            "BlkioDeviceWriteBps": [],
	            "BlkioDeviceReadIOps": [],
	            "BlkioDeviceWriteIOps": [],
	            "CpuPeriod": 0,
	            "CpuQuota": 0,
	            "CpuRealtimePeriod": 0,
	            "CpuRealtimeRuntime": 0,
	            "CpusetCpus": "",
	            "CpusetMems": "",
	            "Devices": [],
	            "DeviceCgroupRules": null,
	            "DeviceRequests": null,
	            "MemoryReservation": 0,
	            "MemorySwap": 4613734400,
	            "MemorySwappiness": null,
	            "OomKillDisable": false,
	            "PidsLimit": null,
	            "Ulimits": [],
	            "CpuCount": 0,
	            "CpuPercent": 0,
	            "IOMaximumIOps": 0,
	            "IOMaximumBandwidth": 0,
	            "MaskedPaths": null,
	            "ReadonlyPaths": null
	        },
	        "GraphDriver": {
	            "Data": {
	                "LowerDir": "/var/lib/docker/overlay2/d6ed63b09ddf4e12631dda12d1b165645c0ba730a9444261c62990f07d84a024-init/diff:/var/lib/docker/overlay2/375eed0e332cee71fb41f23c3bebb2cf752289490317aab56b4bc0e86204dc16/diff",
	                "MergedDir": "/var/lib/docker/overlay2/d6ed63b09ddf4e12631dda12d1b165645c0ba730a9444261c62990f07d84a024/merged",
	                "UpperDir": "/var/lib/docker/overlay2/d6ed63b09ddf4e12631dda12d1b165645c0ba730a9444261c62990f07d84a024/diff",
	                "WorkDir": "/var/lib/docker/overlay2/d6ed63b09ddf4e12631dda12d1b165645c0ba730a9444261c62990f07d84a024/work"
	            },
	            "Name": "overlay2"
	        },
	        "Mounts": [
	            {
	                "Type": "bind",
	                "Source": "/lib/modules",
	                "Destination": "/lib/modules",
	                "Mode": "ro",
	                "RW": false,
	                "Propagation": "rprivate"
	            },
	            {
	                "Type": "volume",
	                "Name": "old-k8s-version-584140",
	                "Source": "/var/lib/docker/volumes/old-k8s-version-584140/_data",
	                "Destination": "/var",
	                "Driver": "local",
	                "Mode": "z",
	                "RW": true,
	                "Propagation": ""
	            }
	        ],
	        "Config": {
	            "Hostname": "old-k8s-version-584140",
	            "Domainname": "",
	            "User": "",
	            "AttachStdin": false,
	            "AttachStdout": false,
	            "AttachStderr": false,
	            "ExposedPorts": {
	                "22/tcp": {},
	                "2376/tcp": {},
	                "32443/tcp": {},
	                "5000/tcp": {},
	                "8443/tcp": {}
	            },
	            "Tty": true,
	            "OpenStdin": false,
	            "StdinOnce": false,
	            "Env": [
	                "container=docker",
	                "PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin"
	            ],
	            "Cmd": null,
	            "Image": "gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721324606-19298@sha256:1c495b056df42bd3fd9a5c30d049e1802f9ed73a342611781f1ccc3c3853953f",
	            "Volumes": null,
	            "WorkingDir": "/",
	            "Entrypoint": [
	                "/usr/local/bin/entrypoint",
	                "/sbin/init"
	            ],
	            "OnBuild": null,
	            "Labels": {
	                "created_by.minikube.sigs.k8s.io": "true",
	                "mode.minikube.sigs.k8s.io": "old-k8s-version-584140",
	                "name.minikube.sigs.k8s.io": "old-k8s-version-584140",
	                "role.minikube.sigs.k8s.io": ""
	            },
	            "StopSignal": "SIGRTMIN+3"
	        },
	        "NetworkSettings": {
	            "Bridge": "",
	            "SandboxID": "27d22519c61a6a832e6256fb15588bcc8315baa5bc7057397360403e6b3514af",
	            "SandboxKey": "/var/run/docker/netns/27d22519c61a",
	            "Ports": {
	                "22/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": "33063"
	                    }
	                ],
	                "2376/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": "33064"
	                    }
	                ],
	                "32443/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": "33067"
	                    }
	                ],
	                "5000/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": "33065"
	                    }
	                ],
	                "8443/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": "33066"
	                    }
	                ]
	            },
	            "HairpinMode": false,
	            "LinkLocalIPv6Address": "",
	            "LinkLocalIPv6PrefixLen": 0,
	            "SecondaryIPAddresses": null,
	            "SecondaryIPv6Addresses": null,
	            "EndpointID": "",
	            "Gateway": "",
	            "GlobalIPv6Address": "",
	            "GlobalIPv6PrefixLen": 0,
	            "IPAddress": "",
	            "IPPrefixLen": 0,
	            "IPv6Gateway": "",
	            "MacAddress": "",
	            "Networks": {
	                "old-k8s-version-584140": {
	                    "IPAMConfig": {
	                        "IPv4Address": "192.168.76.2"
	                    },
	                    "Links": null,
	                    "Aliases": null,
	                    "MacAddress": "02:42:c0:a8:4c:02",
	                    "DriverOpts": null,
	                    "NetworkID": "c3157009d922a10c8485390dc93c92f21af4d3fe17cf7b28a690ca73f749587f",
	                    "EndpointID": "1e5f94a796870e9e9e892ddd201ad10ad013be3b533a9d9b6e97382cb239bfd7",
	                    "Gateway": "192.168.76.1",
	                    "IPAddress": "192.168.76.2",
	                    "IPPrefixLen": 24,
	                    "IPv6Gateway": "",
	                    "GlobalIPv6Address": "",
	                    "GlobalIPv6PrefixLen": 0,
	                    "DNSNames": [
	                        "old-k8s-version-584140",
	                        "9a47d5204824"
	                    ]
	                }
	            }
	        }
	    }
	]

                                                
                                                
-- /stdout --
helpers_test.go:239: (dbg) Run:  out/minikube-linux-arm64 status --format={{.Host}} -p old-k8s-version-584140 -n old-k8s-version-584140
helpers_test.go:244: <<< TestStartStop/group/old-k8s-version/serial/SecondStart FAILED: start of post-mortem logs <<<
helpers_test.go:245: ======>  post-mortem[TestStartStop/group/old-k8s-version/serial/SecondStart]: minikube logs <======
helpers_test.go:247: (dbg) Run:  out/minikube-linux-arm64 -p old-k8s-version-584140 logs -n 25
helpers_test.go:247: (dbg) Done: out/minikube-linux-arm64 -p old-k8s-version-584140 logs -n 25: (2.244629518s)
helpers_test.go:252: TestStartStop/group/old-k8s-version/serial/SecondStart logs: 
-- stdout --
	
	==> Audit <==
	|---------|--------------------------------------------------------|------------------------------|---------|---------|---------------------|---------------------|
	| Command |                          Args                          |           Profile            |  User   | Version |     Start Time      |      End Time       |
	|---------|--------------------------------------------------------|------------------------------|---------|---------|---------------------|---------------------|
	| ssh     | -p cert-options-708356 -- sudo                         | cert-options-708356          | jenkins | v1.33.1 | 22 Jul 24 11:23 UTC | 22 Jul 24 11:23 UTC |
	|         | cat /etc/kubernetes/admin.conf                         |                              |         |         |                     |                     |
	| delete  | -p cert-options-708356                                 | cert-options-708356          | jenkins | v1.33.1 | 22 Jul 24 11:23 UTC | 22 Jul 24 11:23 UTC |
	| start   | -p old-k8s-version-584140                              | old-k8s-version-584140       | jenkins | v1.33.1 | 22 Jul 24 11:23 UTC | 22 Jul 24 11:25 UTC |
	|         | --memory=2200                                          |                              |         |         |                     |                     |
	|         | --alsologtostderr --wait=true                          |                              |         |         |                     |                     |
	|         | --kvm-network=default                                  |                              |         |         |                     |                     |
	|         | --kvm-qemu-uri=qemu:///system                          |                              |         |         |                     |                     |
	|         | --disable-driver-mounts                                |                              |         |         |                     |                     |
	|         | --keep-context=false                                   |                              |         |         |                     |                     |
	|         | --driver=docker                                        |                              |         |         |                     |                     |
	|         | --container-runtime=crio                               |                              |         |         |                     |                     |
	|         | --kubernetes-version=v1.20.0                           |                              |         |         |                     |                     |
	| start   | -p cert-expiration-208632                              | cert-expiration-208632       | jenkins | v1.33.1 | 22 Jul 24 11:23 UTC | 22 Jul 24 11:24 UTC |
	|         | --memory=2048                                          |                              |         |         |                     |                     |
	|         | --cert-expiration=8760h                                |                              |         |         |                     |                     |
	|         | --driver=docker                                        |                              |         |         |                     |                     |
	|         | --container-runtime=crio                               |                              |         |         |                     |                     |
	| delete  | -p cert-expiration-208632                              | cert-expiration-208632       | jenkins | v1.33.1 | 22 Jul 24 11:24 UTC | 22 Jul 24 11:24 UTC |
	| start   | -p embed-certs-981687                                  | embed-certs-981687           | jenkins | v1.33.1 | 22 Jul 24 11:24 UTC | 22 Jul 24 11:25 UTC |
	|         | --memory=2200                                          |                              |         |         |                     |                     |
	|         | --alsologtostderr --wait=true                          |                              |         |         |                     |                     |
	|         | --embed-certs --driver=docker                          |                              |         |         |                     |                     |
	|         |  --container-runtime=crio                              |                              |         |         |                     |                     |
	|         | --kubernetes-version=v1.30.3                           |                              |         |         |                     |                     |
	| addons  | enable metrics-server -p embed-certs-981687            | embed-certs-981687           | jenkins | v1.33.1 | 22 Jul 24 11:25 UTC | 22 Jul 24 11:25 UTC |
	|         | --images=MetricsServer=registry.k8s.io/echoserver:1.4  |                              |         |         |                     |                     |
	|         | --registries=MetricsServer=fake.domain                 |                              |         |         |                     |                     |
	| stop    | -p embed-certs-981687                                  | embed-certs-981687           | jenkins | v1.33.1 | 22 Jul 24 11:25 UTC | 22 Jul 24 11:25 UTC |
	|         | --alsologtostderr -v=3                                 |                              |         |         |                     |                     |
	| addons  | enable dashboard -p embed-certs-981687                 | embed-certs-981687           | jenkins | v1.33.1 | 22 Jul 24 11:25 UTC | 22 Jul 24 11:25 UTC |
	|         | --images=MetricsScraper=registry.k8s.io/echoserver:1.4 |                              |         |         |                     |                     |
	| start   | -p embed-certs-981687                                  | embed-certs-981687           | jenkins | v1.33.1 | 22 Jul 24 11:25 UTC | 22 Jul 24 11:30 UTC |
	|         | --memory=2200                                          |                              |         |         |                     |                     |
	|         | --alsologtostderr --wait=true                          |                              |         |         |                     |                     |
	|         | --embed-certs --driver=docker                          |                              |         |         |                     |                     |
	|         |  --container-runtime=crio                              |                              |         |         |                     |                     |
	|         | --kubernetes-version=v1.30.3                           |                              |         |         |                     |                     |
	| addons  | enable metrics-server -p old-k8s-version-584140        | old-k8s-version-584140       | jenkins | v1.33.1 | 22 Jul 24 11:25 UTC | 22 Jul 24 11:26 UTC |
	|         | --images=MetricsServer=registry.k8s.io/echoserver:1.4  |                              |         |         |                     |                     |
	|         | --registries=MetricsServer=fake.domain                 |                              |         |         |                     |                     |
	| stop    | -p old-k8s-version-584140                              | old-k8s-version-584140       | jenkins | v1.33.1 | 22 Jul 24 11:26 UTC | 22 Jul 24 11:26 UTC |
	|         | --alsologtostderr -v=3                                 |                              |         |         |                     |                     |
	| addons  | enable dashboard -p old-k8s-version-584140             | old-k8s-version-584140       | jenkins | v1.33.1 | 22 Jul 24 11:26 UTC | 22 Jul 24 11:26 UTC |
	|         | --images=MetricsScraper=registry.k8s.io/echoserver:1.4 |                              |         |         |                     |                     |
	| start   | -p old-k8s-version-584140                              | old-k8s-version-584140       | jenkins | v1.33.1 | 22 Jul 24 11:26 UTC |                     |
	|         | --memory=2200                                          |                              |         |         |                     |                     |
	|         | --alsologtostderr --wait=true                          |                              |         |         |                     |                     |
	|         | --kvm-network=default                                  |                              |         |         |                     |                     |
	|         | --kvm-qemu-uri=qemu:///system                          |                              |         |         |                     |                     |
	|         | --disable-driver-mounts                                |                              |         |         |                     |                     |
	|         | --keep-context=false                                   |                              |         |         |                     |                     |
	|         | --driver=docker                                        |                              |         |         |                     |                     |
	|         | --container-runtime=crio                               |                              |         |         |                     |                     |
	|         | --kubernetes-version=v1.20.0                           |                              |         |         |                     |                     |
	| image   | embed-certs-981687 image list                          | embed-certs-981687           | jenkins | v1.33.1 | 22 Jul 24 11:30 UTC | 22 Jul 24 11:30 UTC |
	|         | --format=json                                          |                              |         |         |                     |                     |
	| pause   | -p embed-certs-981687                                  | embed-certs-981687           | jenkins | v1.33.1 | 22 Jul 24 11:30 UTC | 22 Jul 24 11:30 UTC |
	|         | --alsologtostderr -v=1                                 |                              |         |         |                     |                     |
	| unpause | -p embed-certs-981687                                  | embed-certs-981687           | jenkins | v1.33.1 | 22 Jul 24 11:30 UTC | 22 Jul 24 11:30 UTC |
	|         | --alsologtostderr -v=1                                 |                              |         |         |                     |                     |
	| delete  | -p embed-certs-981687                                  | embed-certs-981687           | jenkins | v1.33.1 | 22 Jul 24 11:30 UTC | 22 Jul 24 11:30 UTC |
	| delete  | -p embed-certs-981687                                  | embed-certs-981687           | jenkins | v1.33.1 | 22 Jul 24 11:30 UTC | 22 Jul 24 11:30 UTC |
	| delete  | -p                                                     | disable-driver-mounts-498326 | jenkins | v1.33.1 | 22 Jul 24 11:30 UTC | 22 Jul 24 11:30 UTC |
	|         | disable-driver-mounts-498326                           |                              |         |         |                     |                     |
	| start   | -p no-preload-076896 --memory=2200                     | no-preload-076896            | jenkins | v1.33.1 | 22 Jul 24 11:30 UTC | 22 Jul 24 11:31 UTC |
	|         | --alsologtostderr --wait=true                          |                              |         |         |                     |                     |
	|         | --preload=false --driver=docker                        |                              |         |         |                     |                     |
	|         |  --container-runtime=crio                              |                              |         |         |                     |                     |
	|         | --kubernetes-version=v1.31.0-beta.0                    |                              |         |         |                     |                     |
	| addons  | enable metrics-server -p no-preload-076896             | no-preload-076896            | jenkins | v1.33.1 | 22 Jul 24 11:31 UTC | 22 Jul 24 11:31 UTC |
	|         | --images=MetricsServer=registry.k8s.io/echoserver:1.4  |                              |         |         |                     |                     |
	|         | --registries=MetricsServer=fake.domain                 |                              |         |         |                     |                     |
	| stop    | -p no-preload-076896                                   | no-preload-076896            | jenkins | v1.33.1 | 22 Jul 24 11:31 UTC | 22 Jul 24 11:31 UTC |
	|         | --alsologtostderr -v=3                                 |                              |         |         |                     |                     |
	| addons  | enable dashboard -p no-preload-076896                  | no-preload-076896            | jenkins | v1.33.1 | 22 Jul 24 11:31 UTC | 22 Jul 24 11:32 UTC |
	|         | --images=MetricsScraper=registry.k8s.io/echoserver:1.4 |                              |         |         |                     |                     |
	| start   | -p no-preload-076896 --memory=2200                     | no-preload-076896            | jenkins | v1.33.1 | 22 Jul 24 11:32 UTC |                     |
	|         | --alsologtostderr --wait=true                          |                              |         |         |                     |                     |
	|         | --preload=false --driver=docker                        |                              |         |         |                     |                     |
	|         |  --container-runtime=crio                              |                              |         |         |                     |                     |
	|         | --kubernetes-version=v1.31.0-beta.0                    |                              |         |         |                     |                     |
	|---------|--------------------------------------------------------|------------------------------|---------|---------|---------------------|---------------------|
	
	
	==> Last Start <==
	Log file created at: 2024/07/22 11:32:00
	Running on machine: ip-172-31-21-244
	Binary: Built with gc go1.22.5 for linux/arm64
	Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg
	I0722 11:32:00.206013  218924 out.go:291] Setting OutFile to fd 1 ...
	I0722 11:32:00.206253  218924 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0722 11:32:00.206281  218924 out.go:304] Setting ErrFile to fd 2...
	I0722 11:32:00.206301  218924 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0722 11:32:00.206652  218924 root.go:338] Updating PATH: /home/jenkins/minikube-integration/19313-2237/.minikube/bin
	I0722 11:32:00.207133  218924 out.go:298] Setting JSON to false
	I0722 11:32:00.208314  218924 start.go:129] hostinfo: {"hostname":"ip-172-31-21-244","uptime":4465,"bootTime":1721643455,"procs":207,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1064-aws","kernelArch":"aarch64","virtualizationSystem":"","virtualizationRole":"","hostId":"da8ac1fd-6236-412a-a346-95873c98230d"}
	I0722 11:32:00.208452  218924 start.go:139] virtualization:  
	I0722 11:32:00.231988  218924 out.go:177] * [no-preload-076896] minikube v1.33.1 on Ubuntu 20.04 (arm64)
	I0722 11:32:00.234764  218924 notify.go:220] Checking for updates...
	I0722 11:32:00.237596  218924 out.go:177]   - MINIKUBE_LOCATION=19313
	I0722 11:32:00.239823  218924 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I0722 11:32:00.243194  218924 out.go:177]   - KUBECONFIG=/home/jenkins/minikube-integration/19313-2237/kubeconfig
	I0722 11:32:00.245824  218924 out.go:177]   - MINIKUBE_HOME=/home/jenkins/minikube-integration/19313-2237/.minikube
	I0722 11:32:00.249984  218924 out.go:177]   - MINIKUBE_BIN=out/minikube-linux-arm64
	I0722 11:32:00.253479  218924 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=
	I0722 11:32:00.256254  218924 config.go:182] Loaded profile config "no-preload-076896": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.31.0-beta.0
	I0722 11:32:00.257009  218924 driver.go:392] Setting default libvirt URI to qemu:///system
	I0722 11:32:00.321171  218924 docker.go:123] docker version: linux-27.0.3:Docker Engine - Community
	I0722 11:32:00.321315  218924 cli_runner.go:164] Run: docker system info --format "{{json .}}"
	I0722 11:32:00.419213  218924 info.go:266] docker info: {ID:5FDH:SA5P:5GCT:NLAS:B73P:SGDQ:PBG5:UBVH:UZY3:RXGO:CI7S:WAIH Containers:2 ContainersRunning:1 ContainersPaused:0 ContainersStopped:1 Images:4 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:39 OomKillDisable:true NGoroutines:53 SystemTime:2024-07-22 11:32:00.407664694 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1064-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Architecture:aar
ch64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8214896640 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-21-244 Labels:[] ExperimentalBuild:false ServerVersion:27.0.3 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:2bf793ef6dc9a18e00cb12efb64355c2c9d5eb41 Expected:2bf793ef6dc9a18e00cb12efb64355c2c9d5eb41} RuncCommit:{ID:v1.1.13-0-g58aa920 Expected:v1.1.13-0-g58aa920} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:<nil> ServerErro
rs:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.15.1] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.28.1]] Warnings:<nil>}}
	I0722 11:32:00.419342  218924 docker.go:307] overlay module found
	I0722 11:32:00.421911  218924 out.go:177] * Using the docker driver based on existing profile
	I0722 11:32:00.423460  218924 start.go:297] selected driver: docker
	I0722 11:32:00.423489  218924 start.go:901] validating driver "docker" against &{Name:no-preload-076896 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721324606-19298@sha256:1c495b056df42bd3fd9a5c30d049e1802f9ed73a342611781f1ccc3c3853953f Memory:2200 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.31.0-beta.0 ClusterName:no-preload-076896 Namespace:default APIServerHAVIP: APIS
erverName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.94.2 Port:8443 KubernetesVersion:v1.31.0-beta.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[dashboard:true default-storageclass:true metrics-server:true storage-provisioner:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4 MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false Mou
ntString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I0722 11:32:00.423631  218924 start.go:912] status for docker: {Installed:true Healthy:true Running:false NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I0722 11:32:00.424371  218924 cli_runner.go:164] Run: docker system info --format "{{json .}}"
	I0722 11:32:00.529869  218924 info.go:266] docker info: {ID:5FDH:SA5P:5GCT:NLAS:B73P:SGDQ:PBG5:UBVH:UZY3:RXGO:CI7S:WAIH Containers:2 ContainersRunning:1 ContainersPaused:0 ContainersStopped:1 Images:4 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:39 OomKillDisable:true NGoroutines:53 SystemTime:2024-07-22 11:32:00.517324747 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1064-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Architecture:aar
ch64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8214896640 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-21-244 Labels:[] ExperimentalBuild:false ServerVersion:27.0.3 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:2bf793ef6dc9a18e00cb12efb64355c2c9d5eb41 Expected:2bf793ef6dc9a18e00cb12efb64355c2c9d5eb41} RuncCommit:{ID:v1.1.13-0-g58aa920 Expected:v1.1.13-0-g58aa920} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:<nil> ServerErro
rs:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.15.1] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.28.1]] Warnings:<nil>}}
	I0722 11:32:00.530235  218924 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
	I0722 11:32:00.530267  218924 cni.go:84] Creating CNI manager for ""
	I0722 11:32:00.530277  218924 cni.go:143] "docker" driver + "crio" runtime found, recommending kindnet
	I0722 11:32:00.530329  218924 start.go:340] cluster config:
	{Name:no-preload-076896 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721324606-19298@sha256:1c495b056df42bd3fd9a5c30d049e1802f9ed73a342611781f1ccc3c3853953f Memory:2200 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.31.0-beta.0 ClusterName:no-preload-076896 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local C
ontainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.94.2 Port:8443 KubernetesVersion:v1.31.0-beta.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[dashboard:true default-storageclass:true metrics-server:true storage-provisioner:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4 MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker Mo
untIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I0722 11:32:00.533722  218924 out.go:177] * Starting "no-preload-076896" primary control-plane node in "no-preload-076896" cluster
	I0722 11:32:00.536404  218924 cache.go:121] Beginning downloading kic base image for docker with crio
	I0722 11:32:00.538702  218924 out.go:177] * Pulling base image v0.0.44-1721324606-19298 ...
	I0722 11:32:00.540976  218924 preload.go:131] Checking if preload exists for k8s version v1.31.0-beta.0 and runtime crio
	I0722 11:32:00.541141  218924 profile.go:143] Saving config to /home/jenkins/minikube-integration/19313-2237/.minikube/profiles/no-preload-076896/config.json ...
	I0722 11:32:00.541499  218924 cache.go:107] acquiring lock: {Name:mk52d9a54b742f20dfa0755d303aba7c73694651 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0722 11:32:00.541591  218924 cache.go:115] /home/jenkins/minikube-integration/19313-2237/.minikube/cache/images/arm64/gcr.io/k8s-minikube/storage-provisioner_v5 exists
	I0722 11:32:00.541605  218924 cache.go:96] cache image "gcr.io/k8s-minikube/storage-provisioner:v5" -> "/home/jenkins/minikube-integration/19313-2237/.minikube/cache/images/arm64/gcr.io/k8s-minikube/storage-provisioner_v5" took 112.142µs
	I0722 11:32:00.541622  218924 cache.go:80] save to tar file gcr.io/k8s-minikube/storage-provisioner:v5 -> /home/jenkins/minikube-integration/19313-2237/.minikube/cache/images/arm64/gcr.io/k8s-minikube/storage-provisioner_v5 succeeded
	I0722 11:32:00.541634  218924 image.go:79] Checking for gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721324606-19298@sha256:1c495b056df42bd3fd9a5c30d049e1802f9ed73a342611781f1ccc3c3853953f in local docker daemon
	I0722 11:32:00.542325  218924 cache.go:107] acquiring lock: {Name:mk6caa5d95978357841b98c0564993a3e6a35b2e Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0722 11:32:00.542429  218924 cache.go:115] /home/jenkins/minikube-integration/19313-2237/.minikube/cache/images/arm64/registry.k8s.io/kube-proxy_v1.31.0-beta.0 exists
	I0722 11:32:00.542442  218924 cache.go:96] cache image "registry.k8s.io/kube-proxy:v1.31.0-beta.0" -> "/home/jenkins/minikube-integration/19313-2237/.minikube/cache/images/arm64/registry.k8s.io/kube-proxy_v1.31.0-beta.0" took 128.125µs
	I0722 11:32:00.542451  218924 cache.go:80] save to tar file registry.k8s.io/kube-proxy:v1.31.0-beta.0 -> /home/jenkins/minikube-integration/19313-2237/.minikube/cache/images/arm64/registry.k8s.io/kube-proxy_v1.31.0-beta.0 succeeded
	I0722 11:32:00.542469  218924 cache.go:107] acquiring lock: {Name:mkea964633adff168867fc8a371bf206fb5fa896 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0722 11:32:00.542503  218924 cache.go:115] /home/jenkins/minikube-integration/19313-2237/.minikube/cache/images/arm64/registry.k8s.io/kube-apiserver_v1.31.0-beta.0 exists
	I0722 11:32:00.542514  218924 cache.go:96] cache image "registry.k8s.io/kube-apiserver:v1.31.0-beta.0" -> "/home/jenkins/minikube-integration/19313-2237/.minikube/cache/images/arm64/registry.k8s.io/kube-apiserver_v1.31.0-beta.0" took 47.566µs
	I0722 11:32:00.542522  218924 cache.go:80] save to tar file registry.k8s.io/kube-apiserver:v1.31.0-beta.0 -> /home/jenkins/minikube-integration/19313-2237/.minikube/cache/images/arm64/registry.k8s.io/kube-apiserver_v1.31.0-beta.0 succeeded
	I0722 11:32:00.542545  218924 cache.go:107] acquiring lock: {Name:mkdc6b938e43d6043dfb6754045d63e0959c9e2c Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0722 11:32:00.542577  218924 cache.go:115] /home/jenkins/minikube-integration/19313-2237/.minikube/cache/images/arm64/registry.k8s.io/kube-controller-manager_v1.31.0-beta.0 exists
	I0722 11:32:00.542583  218924 cache.go:96] cache image "registry.k8s.io/kube-controller-manager:v1.31.0-beta.0" -> "/home/jenkins/minikube-integration/19313-2237/.minikube/cache/images/arm64/registry.k8s.io/kube-controller-manager_v1.31.0-beta.0" took 51.923µs
	I0722 11:32:00.542593  218924 cache.go:80] save to tar file registry.k8s.io/kube-controller-manager:v1.31.0-beta.0 -> /home/jenkins/minikube-integration/19313-2237/.minikube/cache/images/arm64/registry.k8s.io/kube-controller-manager_v1.31.0-beta.0 succeeded
	I0722 11:32:00.542606  218924 cache.go:107] acquiring lock: {Name:mka23aced99d41fc7736a08289b8d03b46f2a9fa Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0722 11:32:00.542642  218924 cache.go:115] /home/jenkins/minikube-integration/19313-2237/.minikube/cache/images/arm64/registry.k8s.io/kube-scheduler_v1.31.0-beta.0 exists
	I0722 11:32:00.542653  218924 cache.go:96] cache image "registry.k8s.io/kube-scheduler:v1.31.0-beta.0" -> "/home/jenkins/minikube-integration/19313-2237/.minikube/cache/images/arm64/registry.k8s.io/kube-scheduler_v1.31.0-beta.0" took 48.403µs
	I0722 11:32:00.542660  218924 cache.go:80] save to tar file registry.k8s.io/kube-scheduler:v1.31.0-beta.0 -> /home/jenkins/minikube-integration/19313-2237/.minikube/cache/images/arm64/registry.k8s.io/kube-scheduler_v1.31.0-beta.0 succeeded
	I0722 11:32:00.542674  218924 cache.go:107] acquiring lock: {Name:mkae044ec7f059c6ba3b5067e8d317c2ca46ccd3 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0722 11:32:00.542714  218924 cache.go:115] /home/jenkins/minikube-integration/19313-2237/.minikube/cache/images/arm64/registry.k8s.io/etcd_3.5.14-0 exists
	I0722 11:32:00.542725  218924 cache.go:96] cache image "registry.k8s.io/etcd:3.5.14-0" -> "/home/jenkins/minikube-integration/19313-2237/.minikube/cache/images/arm64/registry.k8s.io/etcd_3.5.14-0" took 52.481µs
	I0722 11:32:00.542731  218924 cache.go:80] save to tar file registry.k8s.io/etcd:3.5.14-0 -> /home/jenkins/minikube-integration/19313-2237/.minikube/cache/images/arm64/registry.k8s.io/etcd_3.5.14-0 succeeded
	I0722 11:32:00.542740  218924 cache.go:107] acquiring lock: {Name:mk5704b6c0aa84c87ead7fb21e5f65da27c2b6f9 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0722 11:32:00.542772  218924 cache.go:115] /home/jenkins/minikube-integration/19313-2237/.minikube/cache/images/arm64/registry.k8s.io/pause_3.10 exists
	I0722 11:32:00.542790  218924 cache.go:96] cache image "registry.k8s.io/pause:3.10" -> "/home/jenkins/minikube-integration/19313-2237/.minikube/cache/images/arm64/registry.k8s.io/pause_3.10" took 50.282µs
	I0722 11:32:00.542796  218924 cache.go:80] save to tar file registry.k8s.io/pause:3.10 -> /home/jenkins/minikube-integration/19313-2237/.minikube/cache/images/arm64/registry.k8s.io/pause_3.10 succeeded
	I0722 11:32:00.542807  218924 cache.go:107] acquiring lock: {Name:mk47cae931dbe63403363e76622c92355553c9a1 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0722 11:32:00.542847  218924 cache.go:115] /home/jenkins/minikube-integration/19313-2237/.minikube/cache/images/arm64/registry.k8s.io/coredns/coredns_v1.11.1 exists
	I0722 11:32:00.542857  218924 cache.go:96] cache image "registry.k8s.io/coredns/coredns:v1.11.1" -> "/home/jenkins/minikube-integration/19313-2237/.minikube/cache/images/arm64/registry.k8s.io/coredns/coredns_v1.11.1" took 51.349µs
	I0722 11:32:00.542863  218924 cache.go:80] save to tar file registry.k8s.io/coredns/coredns:v1.11.1 -> /home/jenkins/minikube-integration/19313-2237/.minikube/cache/images/arm64/registry.k8s.io/coredns/coredns_v1.11.1 succeeded
	I0722 11:32:00.542871  218924 cache.go:87] Successfully saved all images to host disk.
	W0722 11:32:00.561347  218924 image.go:95] image gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721324606-19298@sha256:1c495b056df42bd3fd9a5c30d049e1802f9ed73a342611781f1ccc3c3853953f is of wrong architecture
	I0722 11:32:00.561366  218924 cache.go:149] Downloading gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721324606-19298@sha256:1c495b056df42bd3fd9a5c30d049e1802f9ed73a342611781f1ccc3c3853953f to local cache
	I0722 11:32:00.561438  218924 image.go:63] Checking for gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721324606-19298@sha256:1c495b056df42bd3fd9a5c30d049e1802f9ed73a342611781f1ccc3c3853953f in local cache directory
	I0722 11:32:00.561457  218924 image.go:66] Found gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721324606-19298@sha256:1c495b056df42bd3fd9a5c30d049e1802f9ed73a342611781f1ccc3c3853953f in local cache directory, skipping pull
	I0722 11:32:00.561461  218924 image.go:135] gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721324606-19298@sha256:1c495b056df42bd3fd9a5c30d049e1802f9ed73a342611781f1ccc3c3853953f exists in cache, skipping pull
	I0722 11:32:00.561470  218924 cache.go:152] successfully saved gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721324606-19298@sha256:1c495b056df42bd3fd9a5c30d049e1802f9ed73a342611781f1ccc3c3853953f as a tarball
	I0722 11:32:00.561475  218924 cache.go:162] Loading gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721324606-19298@sha256:1c495b056df42bd3fd9a5c30d049e1802f9ed73a342611781f1ccc3c3853953f from local cache
	I0722 11:32:00.702238  218924 cache.go:164] successfully loaded and using gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721324606-19298@sha256:1c495b056df42bd3fd9a5c30d049e1802f9ed73a342611781f1ccc3c3853953f from cached tarball
	I0722 11:32:00.702283  218924 cache.go:194] Successfully downloaded all kic artifacts
	I0722 11:32:00.702319  218924 start.go:360] acquireMachinesLock for no-preload-076896: {Name:mked0c4aea1bde2c94a9c1b5fe3fd3b31787769d Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0722 11:32:00.702378  218924 start.go:364] duration metric: took 42.06µs to acquireMachinesLock for "no-preload-076896"
	I0722 11:32:00.702398  218924 start.go:96] Skipping create...Using existing machine configuration
	I0722 11:32:00.702403  218924 fix.go:54] fixHost starting: 
	I0722 11:32:00.702668  218924 cli_runner.go:164] Run: docker container inspect no-preload-076896 --format={{.State.Status}}
	I0722 11:32:00.728331  218924 fix.go:112] recreateIfNeeded on no-preload-076896: state=Stopped err=<nil>
	W0722 11:32:00.728368  218924 fix.go:138] unexpected machine state, will restart: <nil>
	I0722 11:32:00.732969  218924 out.go:177] * Restarting existing docker container for "no-preload-076896" ...
	I0722 11:31:59.342888  210080 pod_ready.go:102] pod "metrics-server-9975d5f86-4jcvm" in "kube-system" namespace has status "Ready":"False"
	I0722 11:31:59.845379  210080 pod_ready.go:81] duration metric: took 4m0.012318488s for pod "metrics-server-9975d5f86-4jcvm" in "kube-system" namespace to be "Ready" ...
	E0722 11:31:59.845399  210080 pod_ready.go:66] WaitExtra: waitPodCondition: context deadline exceeded
	I0722 11:31:59.845409  210080 pod_ready.go:38] duration metric: took 5m20.661509404s for extra waiting for all system-critical and pods with labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
	I0722 11:31:59.845424  210080 api_server.go:52] waiting for apiserver process to appear ...
	I0722 11:31:59.845451  210080 cri.go:54] listing CRI containers in root : {State:all Name:kube-apiserver Namespaces:[]}
	I0722 11:31:59.845574  210080 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
	I0722 11:31:59.920139  210080 cri.go:89] found id: "7b17da0e203acb0f33605e81ab92029743299c8b53e99bedad6247fb2e22336d"
	I0722 11:31:59.920178  210080 cri.go:89] found id: ""
	I0722 11:31:59.920186  210080 logs.go:276] 1 containers: [7b17da0e203acb0f33605e81ab92029743299c8b53e99bedad6247fb2e22336d]
	I0722 11:31:59.920236  210080 ssh_runner.go:195] Run: which crictl
	I0722 11:31:59.924556  210080 cri.go:54] listing CRI containers in root : {State:all Name:etcd Namespaces:[]}
	I0722 11:31:59.924629  210080 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
	I0722 11:31:59.977812  210080 cri.go:89] found id: "b8f395f6e10fffc01d9db2971c2690affd63e1173ebe081a173b1df5e29b3eae"
	I0722 11:31:59.977831  210080 cri.go:89] found id: ""
	I0722 11:31:59.977840  210080 logs.go:276] 1 containers: [b8f395f6e10fffc01d9db2971c2690affd63e1173ebe081a173b1df5e29b3eae]
	I0722 11:31:59.977895  210080 ssh_runner.go:195] Run: which crictl
	I0722 11:31:59.982113  210080 cri.go:54] listing CRI containers in root : {State:all Name:coredns Namespaces:[]}
	I0722 11:31:59.982181  210080 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
	I0722 11:32:00.089770  210080 cri.go:89] found id: "25b426692cff4a0ddaac80382d5fd8be373235953b017a1f2591adbc04fe5208"
	I0722 11:32:00.089791  210080 cri.go:89] found id: ""
	I0722 11:32:00.089799  210080 logs.go:276] 1 containers: [25b426692cff4a0ddaac80382d5fd8be373235953b017a1f2591adbc04fe5208]
	I0722 11:32:00.089863  210080 ssh_runner.go:195] Run: which crictl
	I0722 11:32:00.106635  210080 cri.go:54] listing CRI containers in root : {State:all Name:kube-scheduler Namespaces:[]}
	I0722 11:32:00.106733  210080 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
	I0722 11:32:00.253185  210080 cri.go:89] found id: "a38f1a7f716723ae1738fc6d121fd5959ee9c40c5b1c46b537955d760c9f4290"
	I0722 11:32:00.253208  210080 cri.go:89] found id: ""
	I0722 11:32:00.253221  210080 logs.go:276] 1 containers: [a38f1a7f716723ae1738fc6d121fd5959ee9c40c5b1c46b537955d760c9f4290]
	I0722 11:32:00.253285  210080 ssh_runner.go:195] Run: which crictl
	I0722 11:32:00.269148  210080 cri.go:54] listing CRI containers in root : {State:all Name:kube-proxy Namespaces:[]}
	I0722 11:32:00.269317  210080 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
	I0722 11:32:00.378714  210080 cri.go:89] found id: "5191e613fc2d72706f1d776fe8a845ca8f4b3cec7ff3b0f9d18aee199e8d79c6"
	I0722 11:32:00.378743  210080 cri.go:89] found id: ""
	I0722 11:32:00.378751  210080 logs.go:276] 1 containers: [5191e613fc2d72706f1d776fe8a845ca8f4b3cec7ff3b0f9d18aee199e8d79c6]
	I0722 11:32:00.378814  210080 ssh_runner.go:195] Run: which crictl
	I0722 11:32:00.385279  210080 cri.go:54] listing CRI containers in root : {State:all Name:kube-controller-manager Namespaces:[]}
	I0722 11:32:00.385366  210080 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
	I0722 11:32:00.464157  210080 cri.go:89] found id: "460bdeec3bdfccab7101c9d13045f9bcf87734da1fb0f6f8b6a5c0111906ac43"
	I0722 11:32:00.464207  210080 cri.go:89] found id: ""
	I0722 11:32:00.464216  210080 logs.go:276] 1 containers: [460bdeec3bdfccab7101c9d13045f9bcf87734da1fb0f6f8b6a5c0111906ac43]
	I0722 11:32:00.464285  210080 ssh_runner.go:195] Run: which crictl
	I0722 11:32:00.468544  210080 cri.go:54] listing CRI containers in root : {State:all Name:kindnet Namespaces:[]}
	I0722 11:32:00.468644  210080 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet
	I0722 11:32:00.528057  210080 cri.go:89] found id: "451ceb51fb176f2ab58c30c602fe7a8d8dcdde723f94ec75d058fd599561cfde"
	I0722 11:32:00.528078  210080 cri.go:89] found id: ""
	I0722 11:32:00.528086  210080 logs.go:276] 1 containers: [451ceb51fb176f2ab58c30c602fe7a8d8dcdde723f94ec75d058fd599561cfde]
	I0722 11:32:00.528144  210080 ssh_runner.go:195] Run: which crictl
	I0722 11:32:00.533504  210080 cri.go:54] listing CRI containers in root : {State:all Name:storage-provisioner Namespaces:[]}
	I0722 11:32:00.533634  210080 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=storage-provisioner
	I0722 11:32:00.595614  210080 cri.go:89] found id: "b64b9e0461292d72b7fc112215c86b2db789ed69b01b10063e3b4f24a2155a8a"
	I0722 11:32:00.595635  210080 cri.go:89] found id: "48a74507ee5da0b4b62d92cb8fe64853426c4fcd088c4d455c7d827c4c514ab2"
	I0722 11:32:00.595641  210080 cri.go:89] found id: ""
	I0722 11:32:00.595649  210080 logs.go:276] 2 containers: [b64b9e0461292d72b7fc112215c86b2db789ed69b01b10063e3b4f24a2155a8a 48a74507ee5da0b4b62d92cb8fe64853426c4fcd088c4d455c7d827c4c514ab2]
	I0722 11:32:00.595739  210080 ssh_runner.go:195] Run: which crictl
	I0722 11:32:00.601448  210080 ssh_runner.go:195] Run: which crictl
	I0722 11:32:00.605652  210080 cri.go:54] listing CRI containers in root : {State:all Name:kubernetes-dashboard Namespaces:[]}
	I0722 11:32:00.605721  210080 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kubernetes-dashboard
	I0722 11:32:00.651274  210080 cri.go:89] found id: "0da5dde31a386001ac351514fcd5b733872eb5d92ec8b3579e32b0f14de7b1fc"
	I0722 11:32:00.651297  210080 cri.go:89] found id: ""
	I0722 11:32:00.651306  210080 logs.go:276] 1 containers: [0da5dde31a386001ac351514fcd5b733872eb5d92ec8b3579e32b0f14de7b1fc]
	I0722 11:32:00.651361  210080 ssh_runner.go:195] Run: which crictl
	I0722 11:32:00.654976  210080 logs.go:123] Gathering logs for dmesg ...
	I0722 11:32:00.655002  210080 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
	I0722 11:32:00.673970  210080 logs.go:123] Gathering logs for describe nodes ...
	I0722 11:32:00.673997  210080 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
	I0722 11:32:00.904292  210080 logs.go:123] Gathering logs for kube-scheduler [a38f1a7f716723ae1738fc6d121fd5959ee9c40c5b1c46b537955d760c9f4290] ...
	I0722 11:32:00.904323  210080 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 a38f1a7f716723ae1738fc6d121fd5959ee9c40c5b1c46b537955d760c9f4290"
	I0722 11:32:00.986854  210080 logs.go:123] Gathering logs for kube-proxy [5191e613fc2d72706f1d776fe8a845ca8f4b3cec7ff3b0f9d18aee199e8d79c6] ...
	I0722 11:32:00.986888  210080 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 5191e613fc2d72706f1d776fe8a845ca8f4b3cec7ff3b0f9d18aee199e8d79c6"
	I0722 11:32:01.042704  210080 logs.go:123] Gathering logs for storage-provisioner [b64b9e0461292d72b7fc112215c86b2db789ed69b01b10063e3b4f24a2155a8a] ...
	I0722 11:32:01.042744  210080 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 b64b9e0461292d72b7fc112215c86b2db789ed69b01b10063e3b4f24a2155a8a"
	I0722 11:32:01.152534  210080 logs.go:123] Gathering logs for CRI-O ...
	I0722 11:32:01.152568  210080 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u crio -n 400"
	I0722 11:32:01.294215  210080 logs.go:123] Gathering logs for kubelet ...
	I0722 11:32:01.294250  210080 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
	W0722 11:32:01.368159  210080 logs.go:138] Found kubelet problem: Jul 22 11:26:39 old-k8s-version-584140 kubelet[730]: E0722 11:26:39.204682     730 reflector.go:138] object-"kube-system"/"kube-proxy": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "kube-proxy" is forbidden: User "system:node:old-k8s-version-584140" cannot list resource "configmaps" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-584140' and this object
	W0722 11:32:01.368517  210080 logs.go:138] Found kubelet problem: Jul 22 11:26:39 old-k8s-version-584140 kubelet[730]: E0722 11:26:39.205097     730 reflector.go:138] object-"kube-system"/"storage-provisioner-token-th5sl": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "storage-provisioner-token-th5sl" is forbidden: User "system:node:old-k8s-version-584140" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-584140' and this object
	W0722 11:32:01.369028  210080 logs.go:138] Found kubelet problem: Jul 22 11:26:39 old-k8s-version-584140 kubelet[730]: E0722 11:26:39.205388     730 reflector.go:138] object-"default"/"default-token-gkskl": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "default-token-gkskl" is forbidden: User "system:node:old-k8s-version-584140" cannot list resource "secrets" in API group "" in the namespace "default": no relationship found between node 'old-k8s-version-584140' and this object
	W0722 11:32:01.369328  210080 logs.go:138] Found kubelet problem: Jul 22 11:26:39 old-k8s-version-584140 kubelet[730]: E0722 11:26:39.206223     730 reflector.go:138] object-"kube-system"/"coredns": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "coredns" is forbidden: User "system:node:old-k8s-version-584140" cannot list resource "configmaps" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-584140' and this object
	W0722 11:32:01.369617  210080 logs.go:138] Found kubelet problem: Jul 22 11:26:39 old-k8s-version-584140 kubelet[730]: E0722 11:26:39.206544     730 reflector.go:138] object-"kube-system"/"kube-proxy-token-g9gsb": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "kube-proxy-token-g9gsb" is forbidden: User "system:node:old-k8s-version-584140" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-584140' and this object
	W0722 11:32:01.369927  210080 logs.go:138] Found kubelet problem: Jul 22 11:26:39 old-k8s-version-584140 kubelet[730]: E0722 11:26:39.206876     730 reflector.go:138] object-"kube-system"/"kindnet-token-tjmsp": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "kindnet-token-tjmsp" is forbidden: User "system:node:old-k8s-version-584140" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-584140' and this object
	W0722 11:32:01.370487  210080 logs.go:138] Found kubelet problem: Jul 22 11:26:39 old-k8s-version-584140 kubelet[730]: E0722 11:26:39.207130     730 reflector.go:138] object-"kube-system"/"metrics-server-token-btvqb": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "metrics-server-token-btvqb" is forbidden: User "system:node:old-k8s-version-584140" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-584140' and this object
	W0722 11:32:01.370748  210080 logs.go:138] Found kubelet problem: Jul 22 11:26:39 old-k8s-version-584140 kubelet[730]: E0722 11:26:39.207456     730 reflector.go:138] object-"kube-system"/"coredns-token-7tqrc": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "coredns-token-7tqrc" is forbidden: User "system:node:old-k8s-version-584140" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-584140' and this object
	W0722 11:32:01.387088  210080 logs.go:138] Found kubelet problem: Jul 22 11:26:43 old-k8s-version-584140 kubelet[730]: E0722 11:26:43.160558     730 pod_workers.go:191] Error syncing pod 5a4606c4-b596-44df-a930-60179facf4e9 ("metrics-server-9975d5f86-4jcvm_kube-system(5a4606c4-b596-44df-a930-60179facf4e9)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = pinging container registry fake.domain: Get \"https://fake.domain/v2/\": dial tcp: lookup fake.domain: no such host"
	W0722 11:32:01.387435  210080 logs.go:138] Found kubelet problem: Jul 22 11:26:43 old-k8s-version-584140 kubelet[730]: E0722 11:26:43.632278     730 pod_workers.go:191] Error syncing pod 5a4606c4-b596-44df-a930-60179facf4e9 ("metrics-server-9975d5f86-4jcvm_kube-system(5a4606c4-b596-44df-a930-60179facf4e9)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W0722 11:32:01.389517  210080 logs.go:138] Found kubelet problem: Jul 22 11:26:54 old-k8s-version-584140 kubelet[730]: E0722 11:26:54.611909     730 pod_workers.go:191] Error syncing pod 5a4606c4-b596-44df-a930-60179facf4e9 ("metrics-server-9975d5f86-4jcvm_kube-system(5a4606c4-b596-44df-a930-60179facf4e9)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = pinging container registry fake.domain: Get \"https://fake.domain/v2/\": dial tcp: lookup fake.domain: no such host"
	W0722 11:32:01.392146  210080 logs.go:138] Found kubelet problem: Jul 22 11:27:02 old-k8s-version-584140 kubelet[730]: E0722 11:27:02.738618     730 pod_workers.go:191] Error syncing pod b728f80c-1116-4ef9-b36b-6d05d11b72a1 ("dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 10s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"
	W0722 11:32:01.392634  210080 logs.go:138] Found kubelet problem: Jul 22 11:27:03 old-k8s-version-584140 kubelet[730]: E0722 11:27:03.741827     730 pod_workers.go:191] Error syncing pod b728f80c-1116-4ef9-b36b-6d05d11b72a1 ("dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 10s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"
	W0722 11:32:01.393033  210080 logs.go:138] Found kubelet problem: Jul 22 11:27:04 old-k8s-version-584140 kubelet[730]: E0722 11:27:04.838076     730 pod_workers.go:191] Error syncing pod b728f80c-1116-4ef9-b36b-6d05d11b72a1 ("dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 10s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"
	W0722 11:32:01.393237  210080 logs.go:138] Found kubelet problem: Jul 22 11:27:09 old-k8s-version-584140 kubelet[730]: E0722 11:27:09.598856     730 pod_workers.go:191] Error syncing pod 5a4606c4-b596-44df-a930-60179facf4e9 ("metrics-server-9975d5f86-4jcvm_kube-system(5a4606c4-b596-44df-a930-60179facf4e9)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W0722 11:32:01.394001  210080 logs.go:138] Found kubelet problem: Jul 22 11:27:18 old-k8s-version-584140 kubelet[730]: E0722 11:27:18.778810     730 pod_workers.go:191] Error syncing pod b728f80c-1116-4ef9-b36b-6d05d11b72a1 ("dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"
	W0722 11:32:01.396691  210080 logs.go:138] Found kubelet problem: Jul 22 11:27:23 old-k8s-version-584140 kubelet[730]: E0722 11:27:23.614499     730 pod_workers.go:191] Error syncing pod 5a4606c4-b596-44df-a930-60179facf4e9 ("metrics-server-9975d5f86-4jcvm_kube-system(5a4606c4-b596-44df-a930-60179facf4e9)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = pinging container registry fake.domain: Get \"https://fake.domain/v2/\": dial tcp: lookup fake.domain: no such host"
	W0722 11:32:01.397145  210080 logs.go:138] Found kubelet problem: Jul 22 11:27:24 old-k8s-version-584140 kubelet[730]: E0722 11:27:24.838228     730 pod_workers.go:191] Error syncing pod b728f80c-1116-4ef9-b36b-6d05d11b72a1 ("dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"
	W0722 11:32:01.397548  210080 logs.go:138] Found kubelet problem: Jul 22 11:27:36 old-k8s-version-584140 kubelet[730]: E0722 11:27:36.599081     730 pod_workers.go:191] Error syncing pod b728f80c-1116-4ef9-b36b-6d05d11b72a1 ("dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"
	W0722 11:32:01.397788  210080 logs.go:138] Found kubelet problem: Jul 22 11:27:38 old-k8s-version-584140 kubelet[730]: E0722 11:27:38.598819     730 pod_workers.go:191] Error syncing pod 5a4606c4-b596-44df-a930-60179facf4e9 ("metrics-server-9975d5f86-4jcvm_kube-system(5a4606c4-b596-44df-a930-60179facf4e9)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W0722 11:32:01.398743  210080 logs.go:138] Found kubelet problem: Jul 22 11:27:50 old-k8s-version-584140 kubelet[730]: E0722 11:27:50.837672     730 pod_workers.go:191] Error syncing pod b728f80c-1116-4ef9-b36b-6d05d11b72a1 ("dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"
	W0722 11:32:01.398983  210080 logs.go:138] Found kubelet problem: Jul 22 11:27:53 old-k8s-version-584140 kubelet[730]: E0722 11:27:53.599749     730 pod_workers.go:191] Error syncing pod 5a4606c4-b596-44df-a930-60179facf4e9 ("metrics-server-9975d5f86-4jcvm_kube-system(5a4606c4-b596-44df-a930-60179facf4e9)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W0722 11:32:01.399344  210080 logs.go:138] Found kubelet problem: Jul 22 11:27:54 old-k8s-version-584140 kubelet[730]: E0722 11:27:54.838469     730 pod_workers.go:191] Error syncing pod b728f80c-1116-4ef9-b36b-6d05d11b72a1 ("dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"
	W0722 11:32:01.399885  210080 logs.go:138] Found kubelet problem: Jul 22 11:28:06 old-k8s-version-584140 kubelet[730]: E0722 11:28:06.598312     730 pod_workers.go:191] Error syncing pod b728f80c-1116-4ef9-b36b-6d05d11b72a1 ("dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"
	W0722 11:32:01.404193  210080 logs.go:138] Found kubelet problem: Jul 22 11:28:07 old-k8s-version-584140 kubelet[730]: E0722 11:28:07.619353     730 pod_workers.go:191] Error syncing pod 5a4606c4-b596-44df-a930-60179facf4e9 ("metrics-server-9975d5f86-4jcvm_kube-system(5a4606c4-b596-44df-a930-60179facf4e9)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = pinging container registry fake.domain: Get \"https://fake.domain/v2/\": dial tcp: lookup fake.domain: no such host"
	W0722 11:32:01.404622  210080 logs.go:138] Found kubelet problem: Jul 22 11:28:20 old-k8s-version-584140 kubelet[730]: E0722 11:28:20.599140     730 pod_workers.go:191] Error syncing pod b728f80c-1116-4ef9-b36b-6d05d11b72a1 ("dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"
	W0722 11:32:01.404836  210080 logs.go:138] Found kubelet problem: Jul 22 11:28:20 old-k8s-version-584140 kubelet[730]: E0722 11:28:20.600438     730 pod_workers.go:191] Error syncing pod 5a4606c4-b596-44df-a930-60179facf4e9 ("metrics-server-9975d5f86-4jcvm_kube-system(5a4606c4-b596-44df-a930-60179facf4e9)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W0722 11:32:01.405520  210080 logs.go:138] Found kubelet problem: Jul 22 11:28:33 old-k8s-version-584140 kubelet[730]: E0722 11:28:33.909665     730 pod_workers.go:191] Error syncing pod b728f80c-1116-4ef9-b36b-6d05d11b72a1 ("dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"
	W0722 11:32:01.405900  210080 logs.go:138] Found kubelet problem: Jul 22 11:28:34 old-k8s-version-584140 kubelet[730]: E0722 11:28:34.912079     730 pod_workers.go:191] Error syncing pod b728f80c-1116-4ef9-b36b-6d05d11b72a1 ("dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"
	W0722 11:32:01.406112  210080 logs.go:138] Found kubelet problem: Jul 22 11:28:35 old-k8s-version-584140 kubelet[730]: E0722 11:28:35.599081     730 pod_workers.go:191] Error syncing pod 5a4606c4-b596-44df-a930-60179facf4e9 ("metrics-server-9975d5f86-4jcvm_kube-system(5a4606c4-b596-44df-a930-60179facf4e9)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W0722 11:32:01.406477  210080 logs.go:138] Found kubelet problem: Jul 22 11:28:46 old-k8s-version-584140 kubelet[730]: E0722 11:28:46.598307     730 pod_workers.go:191] Error syncing pod b728f80c-1116-4ef9-b36b-6d05d11b72a1 ("dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"
	W0722 11:32:01.406689  210080 logs.go:138] Found kubelet problem: Jul 22 11:28:50 old-k8s-version-584140 kubelet[730]: E0722 11:28:50.599499     730 pod_workers.go:191] Error syncing pod 5a4606c4-b596-44df-a930-60179facf4e9 ("metrics-server-9975d5f86-4jcvm_kube-system(5a4606c4-b596-44df-a930-60179facf4e9)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W0722 11:32:01.407045  210080 logs.go:138] Found kubelet problem: Jul 22 11:29:01 old-k8s-version-584140 kubelet[730]: E0722 11:29:01.598946     730 pod_workers.go:191] Error syncing pod b728f80c-1116-4ef9-b36b-6d05d11b72a1 ("dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"
	W0722 11:32:01.407255  210080 logs.go:138] Found kubelet problem: Jul 22 11:29:04 old-k8s-version-584140 kubelet[730]: E0722 11:29:04.598688     730 pod_workers.go:191] Error syncing pod 5a4606c4-b596-44df-a930-60179facf4e9 ("metrics-server-9975d5f86-4jcvm_kube-system(5a4606c4-b596-44df-a930-60179facf4e9)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W0722 11:32:01.407606  210080 logs.go:138] Found kubelet problem: Jul 22 11:29:12 old-k8s-version-584140 kubelet[730]: E0722 11:29:12.598338     730 pod_workers.go:191] Error syncing pod b728f80c-1116-4ef9-b36b-6d05d11b72a1 ("dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"
	W0722 11:32:01.407820  210080 logs.go:138] Found kubelet problem: Jul 22 11:29:19 old-k8s-version-584140 kubelet[730]: E0722 11:29:19.598946     730 pod_workers.go:191] Error syncing pod 5a4606c4-b596-44df-a930-60179facf4e9 ("metrics-server-9975d5f86-4jcvm_kube-system(5a4606c4-b596-44df-a930-60179facf4e9)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W0722 11:32:01.408172  210080 logs.go:138] Found kubelet problem: Jul 22 11:29:26 old-k8s-version-584140 kubelet[730]: E0722 11:29:26.598882     730 pod_workers.go:191] Error syncing pod b728f80c-1116-4ef9-b36b-6d05d11b72a1 ("dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"
	W0722 11:32:01.412144  210080 logs.go:138] Found kubelet problem: Jul 22 11:29:33 old-k8s-version-584140 kubelet[730]: E0722 11:29:33.611073     730 pod_workers.go:191] Error syncing pod 5a4606c4-b596-44df-a930-60179facf4e9 ("metrics-server-9975d5f86-4jcvm_kube-system(5a4606c4-b596-44df-a930-60179facf4e9)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = pinging container registry fake.domain: Get \"https://fake.domain/v2/\": dial tcp: lookup fake.domain: no such host"
	W0722 11:32:01.412531  210080 logs.go:138] Found kubelet problem: Jul 22 11:29:37 old-k8s-version-584140 kubelet[730]: E0722 11:29:37.598186     730 pod_workers.go:191] Error syncing pod b728f80c-1116-4ef9-b36b-6d05d11b72a1 ("dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"
	W0722 11:32:01.412752  210080 logs.go:138] Found kubelet problem: Jul 22 11:29:46 old-k8s-version-584140 kubelet[730]: E0722 11:29:46.599495     730 pod_workers.go:191] Error syncing pod 5a4606c4-b596-44df-a930-60179facf4e9 ("metrics-server-9975d5f86-4jcvm_kube-system(5a4606c4-b596-44df-a930-60179facf4e9)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W0722 11:32:01.413134  210080 logs.go:138] Found kubelet problem: Jul 22 11:29:48 old-k8s-version-584140 kubelet[730]: E0722 11:29:48.598602     730 pod_workers.go:191] Error syncing pod b728f80c-1116-4ef9-b36b-6d05d11b72a1 ("dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"
	W0722 11:32:01.413352  210080 logs.go:138] Found kubelet problem: Jul 22 11:30:00 old-k8s-version-584140 kubelet[730]: E0722 11:30:00.599866     730 pod_workers.go:191] Error syncing pod 5a4606c4-b596-44df-a930-60179facf4e9 ("metrics-server-9975d5f86-4jcvm_kube-system(5a4606c4-b596-44df-a930-60179facf4e9)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W0722 11:32:01.413969  210080 logs.go:138] Found kubelet problem: Jul 22 11:30:03 old-k8s-version-584140 kubelet[730]: E0722 11:30:03.060169     730 pod_workers.go:191] Error syncing pod b728f80c-1116-4ef9-b36b-6d05d11b72a1 ("dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"
	W0722 11:32:01.414322  210080 logs.go:138] Found kubelet problem: Jul 22 11:30:04 old-k8s-version-584140 kubelet[730]: E0722 11:30:04.837656     730 pod_workers.go:191] Error syncing pod b728f80c-1116-4ef9-b36b-6d05d11b72a1 ("dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"
	W0722 11:32:01.414534  210080 logs.go:138] Found kubelet problem: Jul 22 11:30:13 old-k8s-version-584140 kubelet[730]: E0722 11:30:13.598674     730 pod_workers.go:191] Error syncing pod 5a4606c4-b596-44df-a930-60179facf4e9 ("metrics-server-9975d5f86-4jcvm_kube-system(5a4606c4-b596-44df-a930-60179facf4e9)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W0722 11:32:01.414890  210080 logs.go:138] Found kubelet problem: Jul 22 11:30:17 old-k8s-version-584140 kubelet[730]: E0722 11:30:17.598240     730 pod_workers.go:191] Error syncing pod b728f80c-1116-4ef9-b36b-6d05d11b72a1 ("dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"
	W0722 11:32:01.415098  210080 logs.go:138] Found kubelet problem: Jul 22 11:30:28 old-k8s-version-584140 kubelet[730]: E0722 11:30:28.598615     730 pod_workers.go:191] Error syncing pod 5a4606c4-b596-44df-a930-60179facf4e9 ("metrics-server-9975d5f86-4jcvm_kube-system(5a4606c4-b596-44df-a930-60179facf4e9)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W0722 11:32:01.416026  210080 logs.go:138] Found kubelet problem: Jul 22 11:30:31 old-k8s-version-584140 kubelet[730]: E0722 11:30:31.598312     730 pod_workers.go:191] Error syncing pod b728f80c-1116-4ef9-b36b-6d05d11b72a1 ("dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"
	W0722 11:32:01.416265  210080 logs.go:138] Found kubelet problem: Jul 22 11:30:43 old-k8s-version-584140 kubelet[730]: E0722 11:30:43.599168     730 pod_workers.go:191] Error syncing pod 5a4606c4-b596-44df-a930-60179facf4e9 ("metrics-server-9975d5f86-4jcvm_kube-system(5a4606c4-b596-44df-a930-60179facf4e9)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W0722 11:32:01.416704  210080 logs.go:138] Found kubelet problem: Jul 22 11:30:44 old-k8s-version-584140 kubelet[730]: E0722 11:30:44.598289     730 pod_workers.go:191] Error syncing pod b728f80c-1116-4ef9-b36b-6d05d11b72a1 ("dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"
	W0722 11:32:01.416965  210080 logs.go:138] Found kubelet problem: Jul 22 11:30:55 old-k8s-version-584140 kubelet[730]: E0722 11:30:55.599111     730 pod_workers.go:191] Error syncing pod 5a4606c4-b596-44df-a930-60179facf4e9 ("metrics-server-9975d5f86-4jcvm_kube-system(5a4606c4-b596-44df-a930-60179facf4e9)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W0722 11:32:01.417337  210080 logs.go:138] Found kubelet problem: Jul 22 11:30:58 old-k8s-version-584140 kubelet[730]: E0722 11:30:58.598266     730 pod_workers.go:191] Error syncing pod b728f80c-1116-4ef9-b36b-6d05d11b72a1 ("dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"
	W0722 11:32:01.417583  210080 logs.go:138] Found kubelet problem: Jul 22 11:31:08 old-k8s-version-584140 kubelet[730]: E0722 11:31:08.598772     730 pod_workers.go:191] Error syncing pod 5a4606c4-b596-44df-a930-60179facf4e9 ("metrics-server-9975d5f86-4jcvm_kube-system(5a4606c4-b596-44df-a930-60179facf4e9)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W0722 11:32:01.417938  210080 logs.go:138] Found kubelet problem: Jul 22 11:31:12 old-k8s-version-584140 kubelet[730]: E0722 11:31:12.598216     730 pod_workers.go:191] Error syncing pod b728f80c-1116-4ef9-b36b-6d05d11b72a1 ("dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"
	W0722 11:32:01.418299  210080 logs.go:138] Found kubelet problem: Jul 22 11:31:23 old-k8s-version-584140 kubelet[730]: E0722 11:31:23.598165     730 pod_workers.go:191] Error syncing pod b728f80c-1116-4ef9-b36b-6d05d11b72a1 ("dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"
	W0722 11:32:01.418509  210080 logs.go:138] Found kubelet problem: Jul 22 11:31:23 old-k8s-version-584140 kubelet[730]: E0722 11:31:23.599281     730 pod_workers.go:191] Error syncing pod 5a4606c4-b596-44df-a930-60179facf4e9 ("metrics-server-9975d5f86-4jcvm_kube-system(5a4606c4-b596-44df-a930-60179facf4e9)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W0722 11:32:01.419110  210080 logs.go:138] Found kubelet problem: Jul 22 11:31:36 old-k8s-version-584140 kubelet[730]: E0722 11:31:36.598285     730 pod_workers.go:191] Error syncing pod b728f80c-1116-4ef9-b36b-6d05d11b72a1 ("dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"
	W0722 11:32:01.419315  210080 logs.go:138] Found kubelet problem: Jul 22 11:31:37 old-k8s-version-584140 kubelet[730]: E0722 11:31:37.598777     730 pod_workers.go:191] Error syncing pod 5a4606c4-b596-44df-a930-60179facf4e9 ("metrics-server-9975d5f86-4jcvm_kube-system(5a4606c4-b596-44df-a930-60179facf4e9)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W0722 11:32:01.419668  210080 logs.go:138] Found kubelet problem: Jul 22 11:31:50 old-k8s-version-584140 kubelet[730]: E0722 11:31:50.598548     730 pod_workers.go:191] Error syncing pod b728f80c-1116-4ef9-b36b-6d05d11b72a1 ("dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"
	W0722 11:32:01.419879  210080 logs.go:138] Found kubelet problem: Jul 22 11:31:52 old-k8s-version-584140 kubelet[730]: E0722 11:31:52.598992     730 pod_workers.go:191] Error syncing pod 5a4606c4-b596-44df-a930-60179facf4e9 ("metrics-server-9975d5f86-4jcvm_kube-system(5a4606c4-b596-44df-a930-60179facf4e9)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	I0722 11:32:01.419894  210080 logs.go:123] Gathering logs for etcd [b8f395f6e10fffc01d9db2971c2690affd63e1173ebe081a173b1df5e29b3eae] ...
	I0722 11:32:01.419919  210080 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 b8f395f6e10fffc01d9db2971c2690affd63e1173ebe081a173b1df5e29b3eae"
	I0722 11:32:01.511015  210080 logs.go:123] Gathering logs for storage-provisioner [48a74507ee5da0b4b62d92cb8fe64853426c4fcd088c4d455c7d827c4c514ab2] ...
	I0722 11:32:01.511087  210080 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 48a74507ee5da0b4b62d92cb8fe64853426c4fcd088c4d455c7d827c4c514ab2"
	I0722 11:32:01.574240  210080 logs.go:123] Gathering logs for kubernetes-dashboard [0da5dde31a386001ac351514fcd5b733872eb5d92ec8b3579e32b0f14de7b1fc] ...
	I0722 11:32:01.574317  210080 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 0da5dde31a386001ac351514fcd5b733872eb5d92ec8b3579e32b0f14de7b1fc"
	I0722 11:32:01.651394  210080 logs.go:123] Gathering logs for kindnet [451ceb51fb176f2ab58c30c602fe7a8d8dcdde723f94ec75d058fd599561cfde] ...
	I0722 11:32:01.651472  210080 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 451ceb51fb176f2ab58c30c602fe7a8d8dcdde723f94ec75d058fd599561cfde"
	I0722 11:32:01.753651  210080 logs.go:123] Gathering logs for container status ...
	I0722 11:32:01.753699  210080 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
	I0722 11:32:01.909399  210080 logs.go:123] Gathering logs for kube-apiserver [7b17da0e203acb0f33605e81ab92029743299c8b53e99bedad6247fb2e22336d] ...
	I0722 11:32:01.909484  210080 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 7b17da0e203acb0f33605e81ab92029743299c8b53e99bedad6247fb2e22336d"
	I0722 11:32:02.053113  210080 logs.go:123] Gathering logs for coredns [25b426692cff4a0ddaac80382d5fd8be373235953b017a1f2591adbc04fe5208] ...
	I0722 11:32:02.053146  210080 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 25b426692cff4a0ddaac80382d5fd8be373235953b017a1f2591adbc04fe5208"
	I0722 11:32:02.111073  210080 logs.go:123] Gathering logs for kube-controller-manager [460bdeec3bdfccab7101c9d13045f9bcf87734da1fb0f6f8b6a5c0111906ac43] ...
	I0722 11:32:02.111101  210080 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 460bdeec3bdfccab7101c9d13045f9bcf87734da1fb0f6f8b6a5c0111906ac43"
	I0722 11:32:02.182025  210080 out.go:304] Setting ErrFile to fd 2...
	I0722 11:32:02.182054  210080 out.go:338] TERM=,COLORTERM=, which probably does not support color
	W0722 11:32:02.182109  210080 out.go:239] X Problems detected in kubelet:
	W0722 11:32:02.182119  210080 out.go:239]   Jul 22 11:31:23 old-k8s-version-584140 kubelet[730]: E0722 11:31:23.599281     730 pod_workers.go:191] Error syncing pod 5a4606c4-b596-44df-a930-60179facf4e9 ("metrics-server-9975d5f86-4jcvm_kube-system(5a4606c4-b596-44df-a930-60179facf4e9)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W0722 11:32:02.182126  210080 out.go:239]   Jul 22 11:31:36 old-k8s-version-584140 kubelet[730]: E0722 11:31:36.598285     730 pod_workers.go:191] Error syncing pod b728f80c-1116-4ef9-b36b-6d05d11b72a1 ("dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"
	W0722 11:32:02.182134  210080 out.go:239]   Jul 22 11:31:37 old-k8s-version-584140 kubelet[730]: E0722 11:31:37.598777     730 pod_workers.go:191] Error syncing pod 5a4606c4-b596-44df-a930-60179facf4e9 ("metrics-server-9975d5f86-4jcvm_kube-system(5a4606c4-b596-44df-a930-60179facf4e9)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W0722 11:32:02.182142  210080 out.go:239]   Jul 22 11:31:50 old-k8s-version-584140 kubelet[730]: E0722 11:31:50.598548     730 pod_workers.go:191] Error syncing pod b728f80c-1116-4ef9-b36b-6d05d11b72a1 ("dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"
	W0722 11:32:02.182165  210080 out.go:239]   Jul 22 11:31:52 old-k8s-version-584140 kubelet[730]: E0722 11:31:52.598992     730 pod_workers.go:191] Error syncing pod 5a4606c4-b596-44df-a930-60179facf4e9 ("metrics-server-9975d5f86-4jcvm_kube-system(5a4606c4-b596-44df-a930-60179facf4e9)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	I0722 11:32:02.182171  210080 out.go:304] Setting ErrFile to fd 2...
	I0722 11:32:02.182177  210080 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0722 11:32:00.734677  218924 cli_runner.go:164] Run: docker start no-preload-076896
	I0722 11:32:01.119685  218924 cli_runner.go:164] Run: docker container inspect no-preload-076896 --format={{.State.Status}}
	I0722 11:32:01.154050  218924 kic.go:430] container "no-preload-076896" state is running.
	I0722 11:32:01.154659  218924 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" no-preload-076896
	I0722 11:32:01.193483  218924 profile.go:143] Saving config to /home/jenkins/minikube-integration/19313-2237/.minikube/profiles/no-preload-076896/config.json ...
	I0722 11:32:01.194423  218924 machine.go:94] provisionDockerMachine start ...
	I0722 11:32:01.194502  218924 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" no-preload-076896
	I0722 11:32:01.258261  218924 main.go:141] libmachine: Using SSH client type: native
	I0722 11:32:01.258540  218924 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x3e2cd0] 0x3e5530 <nil>  [] 0s} 127.0.0.1 33073 <nil> <nil>}
	I0722 11:32:01.258551  218924 main.go:141] libmachine: About to run SSH command:
	hostname
	I0722 11:32:01.259286  218924 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: read tcp 127.0.0.1:55036->127.0.0.1:33073: read: connection reset by peer
	I0722 11:32:04.384655  218924 main.go:141] libmachine: SSH cmd err, output: <nil>: no-preload-076896
	
	I0722 11:32:04.384681  218924 ubuntu.go:169] provisioning hostname "no-preload-076896"
	I0722 11:32:04.384746  218924 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" no-preload-076896
	I0722 11:32:04.402673  218924 main.go:141] libmachine: Using SSH client type: native
	I0722 11:32:04.402924  218924 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x3e2cd0] 0x3e5530 <nil>  [] 0s} 127.0.0.1 33073 <nil> <nil>}
	I0722 11:32:04.402941  218924 main.go:141] libmachine: About to run SSH command:
	sudo hostname no-preload-076896 && echo "no-preload-076896" | sudo tee /etc/hostname
	I0722 11:32:04.538198  218924 main.go:141] libmachine: SSH cmd err, output: <nil>: no-preload-076896
	
	I0722 11:32:04.538321  218924 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" no-preload-076896
	I0722 11:32:04.557165  218924 main.go:141] libmachine: Using SSH client type: native
	I0722 11:32:04.557409  218924 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x3e2cd0] 0x3e5530 <nil>  [] 0s} 127.0.0.1 33073 <nil> <nil>}
	I0722 11:32:04.557437  218924 main.go:141] libmachine: About to run SSH command:
	
			if ! grep -xq '.*\sno-preload-076896' /etc/hosts; then
				if grep -xq '127.0.1.1\s.*' /etc/hosts; then
					sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 no-preload-076896/g' /etc/hosts;
				else 
					echo '127.0.1.1 no-preload-076896' | sudo tee -a /etc/hosts; 
				fi
			fi
	I0722 11:32:04.689240  218924 main.go:141] libmachine: SSH cmd err, output: <nil>: 
	I0722 11:32:04.689333  218924 ubuntu.go:175] set auth options {CertDir:/home/jenkins/minikube-integration/19313-2237/.minikube CaCertPath:/home/jenkins/minikube-integration/19313-2237/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/19313-2237/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/19313-2237/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/19313-2237/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/19313-2237/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/19313-2237/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/19313-2237/.minikube}
	I0722 11:32:04.689385  218924 ubuntu.go:177] setting up certificates
	I0722 11:32:04.689417  218924 provision.go:84] configureAuth start
	I0722 11:32:04.689540  218924 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" no-preload-076896
	I0722 11:32:04.712238  218924 provision.go:143] copyHostCerts
	I0722 11:32:04.712304  218924 exec_runner.go:144] found /home/jenkins/minikube-integration/19313-2237/.minikube/ca.pem, removing ...
	I0722 11:32:04.712313  218924 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19313-2237/.minikube/ca.pem
	I0722 11:32:04.712391  218924 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19313-2237/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/19313-2237/.minikube/ca.pem (1078 bytes)
	I0722 11:32:04.712499  218924 exec_runner.go:144] found /home/jenkins/minikube-integration/19313-2237/.minikube/cert.pem, removing ...
	I0722 11:32:04.712504  218924 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19313-2237/.minikube/cert.pem
	I0722 11:32:04.712533  218924 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19313-2237/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/19313-2237/.minikube/cert.pem (1123 bytes)
	I0722 11:32:04.712594  218924 exec_runner.go:144] found /home/jenkins/minikube-integration/19313-2237/.minikube/key.pem, removing ...
	I0722 11:32:04.712599  218924 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19313-2237/.minikube/key.pem
	I0722 11:32:04.712622  218924 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19313-2237/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/19313-2237/.minikube/key.pem (1679 bytes)
	I0722 11:32:04.712679  218924 provision.go:117] generating server cert: /home/jenkins/minikube-integration/19313-2237/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/19313-2237/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/19313-2237/.minikube/certs/ca-key.pem org=jenkins.no-preload-076896 san=[127.0.0.1 192.168.94.2 localhost minikube no-preload-076896]
	I0722 11:32:05.209681  218924 provision.go:177] copyRemoteCerts
	I0722 11:32:05.209750  218924 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
	I0722 11:32:05.209803  218924 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" no-preload-076896
	I0722 11:32:05.228407  218924 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33073 SSHKeyPath:/home/jenkins/minikube-integration/19313-2237/.minikube/machines/no-preload-076896/id_rsa Username:docker}
	I0722 11:32:05.322382  218924 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19313-2237/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1078 bytes)
	I0722 11:32:05.350072  218924 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19313-2237/.minikube/machines/server.pem --> /etc/docker/server.pem (1220 bytes)
	I0722 11:32:05.375478  218924 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19313-2237/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1675 bytes)
	I0722 11:32:05.400853  218924 provision.go:87] duration metric: took 711.408117ms to configureAuth
	I0722 11:32:05.401012  218924 ubuntu.go:193] setting minikube options for container-runtime
	I0722 11:32:05.401247  218924 config.go:182] Loaded profile config "no-preload-076896": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.31.0-beta.0
	I0722 11:32:05.401373  218924 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" no-preload-076896
	I0722 11:32:05.419733  218924 main.go:141] libmachine: Using SSH client type: native
	I0722 11:32:05.419990  218924 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x3e2cd0] 0x3e5530 <nil>  [] 0s} 127.0.0.1 33073 <nil> <nil>}
	I0722 11:32:05.420011  218924 main.go:141] libmachine: About to run SSH command:
	sudo mkdir -p /etc/sysconfig && printf %!s(MISSING) "
	CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
	" | sudo tee /etc/sysconfig/crio.minikube && sudo systemctl restart crio
	I0722 11:32:05.782905  218924 main.go:141] libmachine: SSH cmd err, output: <nil>: 
	CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
	
	I0722 11:32:05.782933  218924 machine.go:97] duration metric: took 4.588495467s to provisionDockerMachine
	I0722 11:32:05.782945  218924 start.go:293] postStartSetup for "no-preload-076896" (driver="docker")
	I0722 11:32:05.782967  218924 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
	I0722 11:32:05.783038  218924 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
	I0722 11:32:05.783091  218924 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" no-preload-076896
	I0722 11:32:05.807739  218924 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33073 SSHKeyPath:/home/jenkins/minikube-integration/19313-2237/.minikube/machines/no-preload-076896/id_rsa Username:docker}
	I0722 11:32:05.906886  218924 ssh_runner.go:195] Run: cat /etc/os-release
	I0722 11:32:05.910456  218924 main.go:141] libmachine: Couldn't set key VERSION_CODENAME, no corresponding struct field found
	I0722 11:32:05.910491  218924 main.go:141] libmachine: Couldn't set key PRIVACY_POLICY_URL, no corresponding struct field found
	I0722 11:32:05.910503  218924 main.go:141] libmachine: Couldn't set key UBUNTU_CODENAME, no corresponding struct field found
	I0722 11:32:05.910517  218924 info.go:137] Remote host: Ubuntu 22.04.4 LTS
	I0722 11:32:05.910528  218924 filesync.go:126] Scanning /home/jenkins/minikube-integration/19313-2237/.minikube/addons for local assets ...
	I0722 11:32:05.910583  218924 filesync.go:126] Scanning /home/jenkins/minikube-integration/19313-2237/.minikube/files for local assets ...
	I0722 11:32:05.910680  218924 filesync.go:149] local asset: /home/jenkins/minikube-integration/19313-2237/.minikube/files/etc/ssl/certs/75642.pem -> 75642.pem in /etc/ssl/certs
	I0722 11:32:05.910834  218924 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs
	I0722 11:32:05.921002  218924 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19313-2237/.minikube/files/etc/ssl/certs/75642.pem --> /etc/ssl/certs/75642.pem (1708 bytes)
	I0722 11:32:05.946811  218924 start.go:296] duration metric: took 163.84998ms for postStartSetup
	I0722 11:32:05.946960  218924 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
	I0722 11:32:05.947038  218924 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" no-preload-076896
	I0722 11:32:05.963482  218924 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33073 SSHKeyPath:/home/jenkins/minikube-integration/19313-2237/.minikube/machines/no-preload-076896/id_rsa Username:docker}
	I0722 11:32:06.065654  218924 ssh_runner.go:195] Run: sh -c "df -BG /var | awk 'NR==2{print $4}'"
	I0722 11:32:06.073579  218924 fix.go:56] duration metric: took 5.371167083s for fixHost
	I0722 11:32:06.073604  218924 start.go:83] releasing machines lock for "no-preload-076896", held for 5.371215962s
	I0722 11:32:06.073686  218924 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" no-preload-076896
	I0722 11:32:06.092199  218924 ssh_runner.go:195] Run: cat /version.json
	I0722 11:32:06.092254  218924 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" no-preload-076896
	I0722 11:32:06.092257  218924 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/
	I0722 11:32:06.092449  218924 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" no-preload-076896
	I0722 11:32:06.114846  218924 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33073 SSHKeyPath:/home/jenkins/minikube-integration/19313-2237/.minikube/machines/no-preload-076896/id_rsa Username:docker}
	I0722 11:32:06.134898  218924 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33073 SSHKeyPath:/home/jenkins/minikube-integration/19313-2237/.minikube/machines/no-preload-076896/id_rsa Username:docker}
	I0722 11:32:06.212393  218924 ssh_runner.go:195] Run: systemctl --version
	I0722 11:32:06.359698  218924 ssh_runner.go:195] Run: sudo sh -c "podman version >/dev/null"
	I0722 11:32:06.501414  218924 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"
	I0722 11:32:06.505855  218924 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f -name *loopback.conf* -not -name *.mk_disabled -exec sh -c "sudo mv {} {}.mk_disabled" ;
	I0722 11:32:06.515394  218924 cni.go:221] loopback cni configuration disabled: "/etc/cni/net.d/*loopback.conf*" found
	I0722 11:32:06.515515  218924 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%!p(MISSING), " -exec sh -c "sudo mv {} {}.mk_disabled" ;
	I0722 11:32:06.524830  218924 cni.go:259] no active bridge cni configs found in "/etc/cni/net.d" - nothing to disable
	I0722 11:32:06.524854  218924 start.go:495] detecting cgroup driver to use...
	I0722 11:32:06.524919  218924 detect.go:187] detected "cgroupfs" cgroup driver on host os
	I0722 11:32:06.524969  218924 ssh_runner.go:195] Run: sudo systemctl stop -f containerd
	I0722 11:32:06.537199  218924 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd
	I0722 11:32:06.551209  218924 docker.go:217] disabling cri-docker service (if available) ...
	I0722 11:32:06.551273  218924 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.socket
	I0722 11:32:06.564829  218924 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.service
	I0722 11:32:06.579366  218924 ssh_runner.go:195] Run: sudo systemctl disable cri-docker.socket
	I0722 11:32:06.670142  218924 ssh_runner.go:195] Run: sudo systemctl mask cri-docker.service
	I0722 11:32:06.765705  218924 docker.go:233] disabling docker service ...
	I0722 11:32:06.765770  218924 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket
	I0722 11:32:06.779530  218924 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service
	I0722 11:32:06.791823  218924 ssh_runner.go:195] Run: sudo systemctl disable docker.socket
	I0722 11:32:06.896159  218924 ssh_runner.go:195] Run: sudo systemctl mask docker.service
	I0722 11:32:06.997472  218924 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker
	I0722 11:32:07.010141  218924 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %!s(MISSING) "runtime-endpoint: unix:///var/run/crio/crio.sock
	" | sudo tee /etc/crictl.yaml"
	I0722 11:32:07.027109  218924 crio.go:59] configure cri-o to use "registry.k8s.io/pause:3.10" pause image...
	I0722 11:32:07.027218  218924 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*pause_image = .*$|pause_image = "registry.k8s.io/pause:3.10"|' /etc/crio/crio.conf.d/02-crio.conf"
	I0722 11:32:07.038312  218924 crio.go:70] configuring cri-o to use "cgroupfs" as cgroup driver...
	I0722 11:32:07.038459  218924 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*cgroup_manager = .*$|cgroup_manager = "cgroupfs"|' /etc/crio/crio.conf.d/02-crio.conf"
	I0722 11:32:07.048311  218924 ssh_runner.go:195] Run: sh -c "sudo sed -i '/conmon_cgroup = .*/d' /etc/crio/crio.conf.d/02-crio.conf"
	I0722 11:32:07.058808  218924 ssh_runner.go:195] Run: sh -c "sudo sed -i '/cgroup_manager = .*/a conmon_cgroup = "pod"' /etc/crio/crio.conf.d/02-crio.conf"
	I0722 11:32:07.068731  218924 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"
	I0722 11:32:07.078011  218924 ssh_runner.go:195] Run: sh -c "sudo sed -i '/^ *"net.ipv4.ip_unprivileged_port_start=.*"/d' /etc/crio/crio.conf.d/02-crio.conf"
	I0722 11:32:07.087863  218924 ssh_runner.go:195] Run: sh -c "sudo grep -q "^ *default_sysctls" /etc/crio/crio.conf.d/02-crio.conf || sudo sed -i '/conmon_cgroup = .*/a default_sysctls = \[\n\]' /etc/crio/crio.conf.d/02-crio.conf"
	I0722 11:32:07.097494  218924 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^default_sysctls *= *\[|&\n  "net.ipv4.ip_unprivileged_port_start=0",|' /etc/crio/crio.conf.d/02-crio.conf"
	I0722 11:32:07.107627  218924 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
	I0722 11:32:07.116544  218924 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
	I0722 11:32:07.125321  218924 ssh_runner.go:195] Run: sudo systemctl daemon-reload
	I0722 11:32:07.213215  218924 ssh_runner.go:195] Run: sudo systemctl restart crio
	I0722 11:32:07.336441  218924 start.go:542] Will wait 60s for socket path /var/run/crio/crio.sock
	I0722 11:32:07.336600  218924 ssh_runner.go:195] Run: stat /var/run/crio/crio.sock
	I0722 11:32:07.340554  218924 start.go:563] Will wait 60s for crictl version
	I0722 11:32:07.340646  218924 ssh_runner.go:195] Run: which crictl
	I0722 11:32:07.344472  218924 ssh_runner.go:195] Run: sudo /usr/bin/crictl version
	I0722 11:32:07.393404  218924 start.go:579] Version:  0.1.0
	RuntimeName:  cri-o
	RuntimeVersion:  1.24.6
	RuntimeApiVersion:  v1
	I0722 11:32:07.393535  218924 ssh_runner.go:195] Run: crio --version
	I0722 11:32:07.431797  218924 ssh_runner.go:195] Run: crio --version
	I0722 11:32:07.474425  218924 out.go:177] * Preparing Kubernetes v1.31.0-beta.0 on CRI-O 1.24.6 ...
	I0722 11:32:07.476587  218924 cli_runner.go:164] Run: docker network inspect no-preload-076896 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
	I0722 11:32:07.492544  218924 ssh_runner.go:195] Run: grep 192.168.94.1	host.minikube.internal$ /etc/hosts
	I0722 11:32:07.496407  218924 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.94.1	host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
	I0722 11:32:07.507234  218924 kubeadm.go:883] updating cluster {Name:no-preload-076896 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721324606-19298@sha256:1c495b056df42bd3fd9a5c30d049e1802f9ed73a342611781f1ccc3c3853953f Memory:2200 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.31.0-beta.0 ClusterName:no-preload-076896 Namespace:default APIServerHAVIP: APIServerName:minikub
eCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.94.2 Port:8443 KubernetesVersion:v1.31.0-beta.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[dashboard:true default-storageclass:true metrics-server:true storage-provisioner:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4 MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/je
nkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} ...
	I0722 11:32:07.507355  218924 preload.go:131] Checking if preload exists for k8s version v1.31.0-beta.0 and runtime crio
	I0722 11:32:07.507399  218924 ssh_runner.go:195] Run: sudo crictl images --output json
	I0722 11:32:07.558302  218924 crio.go:514] all images are preloaded for cri-o runtime.
	I0722 11:32:07.558324  218924 cache_images.go:84] Images are preloaded, skipping loading
	I0722 11:32:07.558333  218924 kubeadm.go:934] updating node { 192.168.94.2 8443 v1.31.0-beta.0 crio true true} ...
	I0722 11:32:07.558436  218924 kubeadm.go:946] kubelet [Unit]
	Wants=crio.service
	
	[Service]
	ExecStart=
	ExecStart=/var/lib/minikube/binaries/v1.31.0-beta.0/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --cgroups-per-qos=false --config=/var/lib/kubelet/config.yaml --enforce-node-allocatable= --hostname-override=no-preload-076896 --kubeconfig=/etc/kubernetes/kubelet.conf --node-ip=192.168.94.2
	
	[Install]
	 config:
	{KubernetesVersion:v1.31.0-beta.0 ClusterName:no-preload-076896 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:}
	I0722 11:32:07.558526  218924 ssh_runner.go:195] Run: crio config
	I0722 11:32:07.610998  218924 cni.go:84] Creating CNI manager for ""
	I0722 11:32:07.611023  218924 cni.go:143] "docker" driver + "crio" runtime found, recommending kindnet
	I0722 11:32:07.611037  218924 kubeadm.go:84] Using pod CIDR: 10.244.0.0/16
	I0722 11:32:07.611061  218924 kubeadm.go:181] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.94.2 APIServerPort:8443 KubernetesVersion:v1.31.0-beta.0 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:no-preload-076896 NodeName:no-preload-076896 DNSDomain:cluster.local CRISocket:/var/run/crio/crio.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.94.2"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.94.2 CgroupDriver:cgroupfs ClientCAFile:/var/lib/minikube/certs/ca.crt StaticPodPa
th:/etc/kubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[containerRuntimeEndpoint:unix:///var/run/crio/crio.sock hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:true}
	I0722 11:32:07.611212  218924 kubeadm.go:187] kubeadm config:
	apiVersion: kubeadm.k8s.io/v1beta3
	kind: InitConfiguration
	localAPIEndpoint:
	  advertiseAddress: 192.168.94.2
	  bindPort: 8443
	bootstrapTokens:
	  - groups:
	      - system:bootstrappers:kubeadm:default-node-token
	    ttl: 24h0m0s
	    usages:
	      - signing
	      - authentication
	nodeRegistration:
	  criSocket: unix:///var/run/crio/crio.sock
	  name: "no-preload-076896"
	  kubeletExtraArgs:
	    node-ip: 192.168.94.2
	  taints: []
	---
	apiVersion: kubeadm.k8s.io/v1beta3
	kind: ClusterConfiguration
	apiServer:
	  certSANs: ["127.0.0.1", "localhost", "192.168.94.2"]
	  extraArgs:
	    enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"
	controllerManager:
	  extraArgs:
	    allocate-node-cidrs: "true"
	    leader-elect: "false"
	scheduler:
	  extraArgs:
	    leader-elect: "false"
	certificatesDir: /var/lib/minikube/certs
	clusterName: mk
	controlPlaneEndpoint: control-plane.minikube.internal:8443
	etcd:
	  local:
	    dataDir: /var/lib/minikube/etcd
	    extraArgs:
	      proxy-refresh-interval: "70000"
	kubernetesVersion: v1.31.0-beta.0
	networking:
	  dnsDomain: cluster.local
	  podSubnet: "10.244.0.0/16"
	  serviceSubnet: 10.96.0.0/12
	---
	apiVersion: kubelet.config.k8s.io/v1beta1
	kind: KubeletConfiguration
	authentication:
	  x509:
	    clientCAFile: /var/lib/minikube/certs/ca.crt
	cgroupDriver: cgroupfs
	containerRuntimeEndpoint: unix:///var/run/crio/crio.sock
	hairpinMode: hairpin-veth
	runtimeRequestTimeout: 15m
	clusterDomain: "cluster.local"
	# disable disk resource management by default
	imageGCHighThresholdPercent: 100
	evictionHard:
	  nodefs.available: "0%!"(MISSING)
	  nodefs.inodesFree: "0%!"(MISSING)
	  imagefs.available: "0%!"(MISSING)
	failSwapOn: false
	staticPodPath: /etc/kubernetes/manifests
	---
	apiVersion: kubeproxy.config.k8s.io/v1alpha1
	kind: KubeProxyConfiguration
	clusterCIDR: "10.244.0.0/16"
	metricsBindAddress: 0.0.0.0:10249
	conntrack:
	  maxPerCore: 0
	# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"
	  tcpEstablishedTimeout: 0s
	# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"
	  tcpCloseWaitTimeout: 0s
	
	I0722 11:32:07.611283  218924 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.31.0-beta.0
	I0722 11:32:07.620272  218924 binaries.go:44] Found k8s binaries, skipping transfer
	I0722 11:32:07.620394  218924 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube
	I0722 11:32:07.629570  218924 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (374 bytes)
	I0722 11:32:07.647878  218924 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (359 bytes)
	I0722 11:32:07.666701  218924 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2162 bytes)
	I0722 11:32:07.684842  218924 ssh_runner.go:195] Run: grep 192.168.94.2	control-plane.minikube.internal$ /etc/hosts
	I0722 11:32:07.688256  218924 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.94.2	control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
	I0722 11:32:07.699344  218924 ssh_runner.go:195] Run: sudo systemctl daemon-reload
	I0722 11:32:07.778511  218924 ssh_runner.go:195] Run: sudo systemctl start kubelet
	I0722 11:32:07.791806  218924 certs.go:68] Setting up /home/jenkins/minikube-integration/19313-2237/.minikube/profiles/no-preload-076896 for IP: 192.168.94.2
	I0722 11:32:07.791828  218924 certs.go:194] generating shared ca certs ...
	I0722 11:32:07.791844  218924 certs.go:226] acquiring lock for ca certs: {Name:mkc633027ec1393c6f58c3260e76c1b2d2250318 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0722 11:32:07.792006  218924 certs.go:235] skipping valid "minikubeCA" ca cert: /home/jenkins/minikube-integration/19313-2237/.minikube/ca.key
	I0722 11:32:07.792065  218924 certs.go:235] skipping valid "proxyClientCA" ca cert: /home/jenkins/minikube-integration/19313-2237/.minikube/proxy-client-ca.key
	I0722 11:32:07.792077  218924 certs.go:256] generating profile certs ...
	I0722 11:32:07.792177  218924 certs.go:359] skipping valid signed profile cert regeneration for "minikube-user": /home/jenkins/minikube-integration/19313-2237/.minikube/profiles/no-preload-076896/client.key
	I0722 11:32:07.792255  218924 certs.go:359] skipping valid signed profile cert regeneration for "minikube": /home/jenkins/minikube-integration/19313-2237/.minikube/profiles/no-preload-076896/apiserver.key.f9e177d4
	I0722 11:32:07.792310  218924 certs.go:359] skipping valid signed profile cert regeneration for "aggregator": /home/jenkins/minikube-integration/19313-2237/.minikube/profiles/no-preload-076896/proxy-client.key
	I0722 11:32:07.792450  218924 certs.go:484] found cert: /home/jenkins/minikube-integration/19313-2237/.minikube/certs/7564.pem (1338 bytes)
	W0722 11:32:07.792485  218924 certs.go:480] ignoring /home/jenkins/minikube-integration/19313-2237/.minikube/certs/7564_empty.pem, impossibly tiny 0 bytes
	I0722 11:32:07.792504  218924 certs.go:484] found cert: /home/jenkins/minikube-integration/19313-2237/.minikube/certs/ca-key.pem (1675 bytes)
	I0722 11:32:07.792534  218924 certs.go:484] found cert: /home/jenkins/minikube-integration/19313-2237/.minikube/certs/ca.pem (1078 bytes)
	I0722 11:32:07.792561  218924 certs.go:484] found cert: /home/jenkins/minikube-integration/19313-2237/.minikube/certs/cert.pem (1123 bytes)
	I0722 11:32:07.792593  218924 certs.go:484] found cert: /home/jenkins/minikube-integration/19313-2237/.minikube/certs/key.pem (1679 bytes)
	I0722 11:32:07.792640  218924 certs.go:484] found cert: /home/jenkins/minikube-integration/19313-2237/.minikube/files/etc/ssl/certs/75642.pem (1708 bytes)
	I0722 11:32:07.793384  218924 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19313-2237/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
	I0722 11:32:07.832068  218924 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19313-2237/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1675 bytes)
	I0722 11:32:07.881247  218924 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19313-2237/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
	I0722 11:32:07.907144  218924 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19313-2237/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1675 bytes)
	I0722 11:32:07.969322  218924 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19313-2237/.minikube/profiles/no-preload-076896/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1424 bytes)
	I0722 11:32:07.998596  218924 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19313-2237/.minikube/profiles/no-preload-076896/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1675 bytes)
	I0722 11:32:08.025696  218924 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19313-2237/.minikube/profiles/no-preload-076896/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
	I0722 11:32:08.050229  218924 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19313-2237/.minikube/profiles/no-preload-076896/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1675 bytes)
	I0722 11:32:08.074821  218924 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19313-2237/.minikube/certs/7564.pem --> /usr/share/ca-certificates/7564.pem (1338 bytes)
	I0722 11:32:08.107709  218924 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19313-2237/.minikube/files/etc/ssl/certs/75642.pem --> /usr/share/ca-certificates/75642.pem (1708 bytes)
	I0722 11:32:08.136262  218924 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19313-2237/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
	I0722 11:32:08.160311  218924 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)
	I0722 11:32:08.177904  218924 ssh_runner.go:195] Run: openssl version
	I0722 11:32:08.183309  218924 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/7564.pem && ln -fs /usr/share/ca-certificates/7564.pem /etc/ssl/certs/7564.pem"
	I0722 11:32:08.192635  218924 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/7564.pem
	I0722 11:32:08.196235  218924 certs.go:528] hashing: -rw-r--r-- 1 root root 1338 Jul 22 10:41 /usr/share/ca-certificates/7564.pem
	I0722 11:32:08.196338  218924 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/7564.pem
	I0722 11:32:08.203179  218924 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/7564.pem /etc/ssl/certs/51391683.0"
	I0722 11:32:08.212743  218924 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/75642.pem && ln -fs /usr/share/ca-certificates/75642.pem /etc/ssl/certs/75642.pem"
	I0722 11:32:08.222381  218924 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/75642.pem
	I0722 11:32:08.226251  218924 certs.go:528] hashing: -rw-r--r-- 1 root root 1708 Jul 22 10:41 /usr/share/ca-certificates/75642.pem
	I0722 11:32:08.226312  218924 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/75642.pem
	I0722 11:32:08.234160  218924 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/75642.pem /etc/ssl/certs/3ec20f2e.0"
	I0722 11:32:08.243933  218924 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
	I0722 11:32:08.254101  218924 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
	I0722 11:32:08.258043  218924 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 Jul 22 10:30 /usr/share/ca-certificates/minikubeCA.pem
	I0722 11:32:08.258141  218924 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
	I0722 11:32:08.265424  218924 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
	I0722 11:32:08.274966  218924 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt
	I0722 11:32:08.278690  218924 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/apiserver-etcd-client.crt -checkend 86400
	I0722 11:32:08.285788  218924 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/apiserver-kubelet-client.crt -checkend 86400
	I0722 11:32:08.292708  218924 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/server.crt -checkend 86400
	I0722 11:32:08.299820  218924 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/healthcheck-client.crt -checkend 86400
	I0722 11:32:08.306727  218924 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/peer.crt -checkend 86400
	I0722 11:32:08.313977  218924 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/front-proxy-client.crt -checkend 86400
	I0722 11:32:08.322240  218924 kubeadm.go:392] StartCluster: {Name:no-preload-076896 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721324606-19298@sha256:1c495b056df42bd3fd9a5c30d049e1802f9ed73a342611781f1ccc3c3853953f Memory:2200 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.31.0-beta.0 ClusterName:no-preload-076896 Namespace:default APIServerHAVIP: APIServerName:minikubeCA
APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.94.2 Port:8443 KubernetesVersion:v1.31.0-beta.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[dashboard:true default-storageclass:true metrics-server:true storage-provisioner:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4 MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenki
ns:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I0722 11:32:08.322400  218924 cri.go:54] listing CRI containers in root : {State:paused Name: Namespaces:[kube-system]}
	I0722 11:32:08.322591  218924 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"
	I0722 11:32:08.363920  218924 cri.go:89] found id: ""
	I0722 11:32:08.364024  218924 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd
	I0722 11:32:08.373206  218924 kubeadm.go:408] found existing configuration files, will attempt cluster restart
	I0722 11:32:08.373276  218924 kubeadm.go:593] restartPrimaryControlPlane start ...
	I0722 11:32:08.373343  218924 ssh_runner.go:195] Run: sudo test -d /data/minikube
	I0722 11:32:08.383930  218924 kubeadm.go:130] /data/minikube skipping compat symlinks: sudo test -d /data/minikube: Process exited with status 1
	stdout:
	
	stderr:
	I0722 11:32:08.384566  218924 kubeconfig.go:47] verify endpoint returned: get endpoint: "no-preload-076896" does not appear in /home/jenkins/minikube-integration/19313-2237/kubeconfig
	I0722 11:32:08.384831  218924 kubeconfig.go:62] /home/jenkins/minikube-integration/19313-2237/kubeconfig needs updating (will repair): [kubeconfig missing "no-preload-076896" cluster setting kubeconfig missing "no-preload-076896" context setting]
	I0722 11:32:08.385319  218924 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19313-2237/kubeconfig: {Name:mkcc86b3f46ba469151bab0be6d762245d79cdb6 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0722 11:32:08.386723  218924 ssh_runner.go:195] Run: sudo diff -u /var/tmp/minikube/kubeadm.yaml /var/tmp/minikube/kubeadm.yaml.new
	I0722 11:32:08.398255  218924 kubeadm.go:630] The running cluster does not require reconfiguration: 192.168.94.2
	I0722 11:32:08.398326  218924 kubeadm.go:597] duration metric: took 25.029015ms to restartPrimaryControlPlane
	I0722 11:32:08.398358  218924 kubeadm.go:394] duration metric: took 76.126805ms to StartCluster
	I0722 11:32:08.398377  218924 settings.go:142] acquiring lock: {Name:mk5fbd205fde0f82abe2a5378554c5e9944b6110 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0722 11:32:08.398434  218924 settings.go:150] Updating kubeconfig:  /home/jenkins/minikube-integration/19313-2237/kubeconfig
	I0722 11:32:08.399356  218924 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19313-2237/kubeconfig: {Name:mkcc86b3f46ba469151bab0be6d762245d79cdb6 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0722 11:32:08.399545  218924 start.go:235] Will wait 6m0s for node &{Name: IP:192.168.94.2 Port:8443 KubernetesVersion:v1.31.0-beta.0 ContainerRuntime:crio ControlPlane:true Worker:true}
	I0722 11:32:08.399899  218924 config.go:182] Loaded profile config "no-preload-076896": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.31.0-beta.0
	I0722 11:32:08.399946  218924 addons.go:507] enable addons start: toEnable=map[ambassador:false auto-pause:false cloud-spanner:false csi-hostpath-driver:false dashboard:true default-storageclass:true efk:false freshpod:false gcp-auth:false gvisor:false headlamp:false helm-tiller:false inaccel:false ingress:false ingress-dns:false inspektor-gadget:false istio:false istio-provisioner:false kong:false kubeflow:false kubevirt:false logviewer:false metallb:false metrics-server:true nvidia-device-plugin:false nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:false registry-aliases:false registry-creds:false storage-provisioner:true storage-provisioner-gluster:false storage-provisioner-rancher:false volcano:false volumesnapshots:false yakd:false]
	I0722 11:32:08.400044  218924 addons.go:69] Setting storage-provisioner=true in profile "no-preload-076896"
	I0722 11:32:08.400077  218924 addons.go:234] Setting addon storage-provisioner=true in "no-preload-076896"
	I0722 11:32:08.400096  218924 addons.go:69] Setting default-storageclass=true in profile "no-preload-076896"
	I0722 11:32:08.400117  218924 addons_storage_classes.go:33] enableOrDisableStorageClasses default-storageclass=true on "no-preload-076896"
	I0722 11:32:08.400420  218924 cli_runner.go:164] Run: docker container inspect no-preload-076896 --format={{.State.Status}}
	W0722 11:32:08.400544  218924 addons.go:243] addon storage-provisioner should already be in state true
	I0722 11:32:08.400574  218924 host.go:66] Checking if "no-preload-076896" exists ...
	I0722 11:32:08.401315  218924 cli_runner.go:164] Run: docker container inspect no-preload-076896 --format={{.State.Status}}
	I0722 11:32:08.401656  218924 addons.go:69] Setting dashboard=true in profile "no-preload-076896"
	I0722 11:32:08.401687  218924 addons.go:234] Setting addon dashboard=true in "no-preload-076896"
	W0722 11:32:08.401697  218924 addons.go:243] addon dashboard should already be in state true
	I0722 11:32:08.401722  218924 host.go:66] Checking if "no-preload-076896" exists ...
	I0722 11:32:08.402125  218924 cli_runner.go:164] Run: docker container inspect no-preload-076896 --format={{.State.Status}}
	I0722 11:32:08.403385  218924 addons.go:69] Setting metrics-server=true in profile "no-preload-076896"
	I0722 11:32:08.403422  218924 addons.go:234] Setting addon metrics-server=true in "no-preload-076896"
	W0722 11:32:08.403430  218924 addons.go:243] addon metrics-server should already be in state true
	I0722 11:32:08.403456  218924 host.go:66] Checking if "no-preload-076896" exists ...
	I0722 11:32:08.403841  218924 cli_runner.go:164] Run: docker container inspect no-preload-076896 --format={{.State.Status}}
	I0722 11:32:08.404590  218924 out.go:177] * Verifying Kubernetes components...
	I0722 11:32:08.408300  218924 ssh_runner.go:195] Run: sudo systemctl daemon-reload
	I0722 11:32:08.455326  218924 addons.go:234] Setting addon default-storageclass=true in "no-preload-076896"
	W0722 11:32:08.455346  218924 addons.go:243] addon default-storageclass should already be in state true
	I0722 11:32:08.455372  218924 host.go:66] Checking if "no-preload-076896" exists ...
	I0722 11:32:08.455765  218924 cli_runner.go:164] Run: docker container inspect no-preload-076896 --format={{.State.Status}}
	I0722 11:32:08.467986  218924 out.go:177]   - Using image docker.io/kubernetesui/dashboard:v2.7.0
	I0722 11:32:08.467989  218924 out.go:177]   - Using image gcr.io/k8s-minikube/storage-provisioner:v5
	I0722 11:32:08.470249  218924 addons.go:431] installing /etc/kubernetes/addons/storage-provisioner.yaml
	I0722 11:32:08.470267  218924 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storage-provisioner.yaml (2676 bytes)
	I0722 11:32:08.470332  218924 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" no-preload-076896
	I0722 11:32:08.477813  218924 out.go:177]   - Using image registry.k8s.io/echoserver:1.4
	I0722 11:32:08.483270  218924 addons.go:431] installing /etc/kubernetes/addons/dashboard-ns.yaml
	I0722 11:32:08.483303  218924 ssh_runner.go:362] scp dashboard/dashboard-ns.yaml --> /etc/kubernetes/addons/dashboard-ns.yaml (759 bytes)
	I0722 11:32:08.483386  218924 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" no-preload-076896
	I0722 11:32:08.504983  218924 out.go:177]   - Using image fake.domain/registry.k8s.io/echoserver:1.4
	I0722 11:32:08.507287  218924 addons.go:431] installing /etc/kubernetes/addons/metrics-apiservice.yaml
	I0722 11:32:08.507312  218924 ssh_runner.go:362] scp metrics-server/metrics-apiservice.yaml --> /etc/kubernetes/addons/metrics-apiservice.yaml (424 bytes)
	I0722 11:32:08.507380  218924 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" no-preload-076896
	I0722 11:32:08.530407  218924 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33073 SSHKeyPath:/home/jenkins/minikube-integration/19313-2237/.minikube/machines/no-preload-076896/id_rsa Username:docker}
	I0722 11:32:08.559438  218924 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33073 SSHKeyPath:/home/jenkins/minikube-integration/19313-2237/.minikube/machines/no-preload-076896/id_rsa Username:docker}
	I0722 11:32:08.560252  218924 addons.go:431] installing /etc/kubernetes/addons/storageclass.yaml
	I0722 11:32:08.560267  218924 ssh_runner.go:362] scp storageclass/storageclass.yaml --> /etc/kubernetes/addons/storageclass.yaml (271 bytes)
	I0722 11:32:08.560321  218924 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" no-preload-076896
	I0722 11:32:08.572235  218924 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33073 SSHKeyPath:/home/jenkins/minikube-integration/19313-2237/.minikube/machines/no-preload-076896/id_rsa Username:docker}
	I0722 11:32:08.598200  218924 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33073 SSHKeyPath:/home/jenkins/minikube-integration/19313-2237/.minikube/machines/no-preload-076896/id_rsa Username:docker}
	I0722 11:32:08.785542  218924 addons.go:431] installing /etc/kubernetes/addons/dashboard-clusterrole.yaml
	I0722 11:32:08.785615  218924 ssh_runner.go:362] scp dashboard/dashboard-clusterrole.yaml --> /etc/kubernetes/addons/dashboard-clusterrole.yaml (1001 bytes)
	I0722 11:32:08.795384  218924 ssh_runner.go:195] Run: sudo systemctl start kubelet
	I0722 11:32:08.864517  218924 addons.go:431] installing /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml
	I0722 11:32:08.864546  218924 ssh_runner.go:362] scp dashboard/dashboard-clusterrolebinding.yaml --> /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml (1018 bytes)
	I0722 11:32:08.867647  218924 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0-beta.0/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml
	I0722 11:32:08.869541  218924 node_ready.go:35] waiting up to 6m0s for node "no-preload-076896" to be "Ready" ...
	I0722 11:32:08.875434  218924 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0-beta.0/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml
	I0722 11:32:08.932050  218924 addons.go:431] installing /etc/kubernetes/addons/metrics-server-deployment.yaml
	I0722 11:32:08.932079  218924 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-server-deployment.yaml (1825 bytes)
	I0722 11:32:08.965079  218924 addons.go:431] installing /etc/kubernetes/addons/dashboard-configmap.yaml
	I0722 11:32:08.965156  218924 ssh_runner.go:362] scp dashboard/dashboard-configmap.yaml --> /etc/kubernetes/addons/dashboard-configmap.yaml (837 bytes)
	I0722 11:32:09.021152  218924 addons.go:431] installing /etc/kubernetes/addons/dashboard-dp.yaml
	I0722 11:32:09.021216  218924 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-dp.yaml (4201 bytes)
	I0722 11:32:09.026475  218924 addons.go:431] installing /etc/kubernetes/addons/metrics-server-rbac.yaml
	I0722 11:32:09.026548  218924 ssh_runner.go:362] scp metrics-server/metrics-server-rbac.yaml --> /etc/kubernetes/addons/metrics-server-rbac.yaml (2175 bytes)
	I0722 11:32:09.080298  218924 addons.go:431] installing /etc/kubernetes/addons/dashboard-role.yaml
	I0722 11:32:09.080370  218924 ssh_runner.go:362] scp dashboard/dashboard-role.yaml --> /etc/kubernetes/addons/dashboard-role.yaml (1724 bytes)
	I0722 11:32:09.086740  218924 addons.go:431] installing /etc/kubernetes/addons/metrics-server-service.yaml
	I0722 11:32:09.086820  218924 ssh_runner.go:362] scp metrics-server/metrics-server-service.yaml --> /etc/kubernetes/addons/metrics-server-service.yaml (446 bytes)
	I0722 11:32:09.117964  218924 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0-beta.0/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
	I0722 11:32:09.147254  218924 addons.go:431] installing /etc/kubernetes/addons/dashboard-rolebinding.yaml
	I0722 11:32:09.147329  218924 ssh_runner.go:362] scp dashboard/dashboard-rolebinding.yaml --> /etc/kubernetes/addons/dashboard-rolebinding.yaml (1046 bytes)
	W0722 11:32:09.226448  218924 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0-beta.0/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
	stdout:
	
	stderr:
	error: error validating "/etc/kubernetes/addons/storageclass.yaml": error validating data: failed to download openapi: Get "https://localhost:8443/openapi/v2?timeout=32s": dial tcp [::1]:8443: connect: connection refused; if you choose to ignore these errors, turn validation off with --validate=false
	I0722 11:32:09.226546  218924 retry.go:31] will retry after 298.569055ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0-beta.0/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
	stdout:
	
	stderr:
	error: error validating "/etc/kubernetes/addons/storageclass.yaml": error validating data: failed to download openapi: Get "https://localhost:8443/openapi/v2?timeout=32s": dial tcp [::1]:8443: connect: connection refused; if you choose to ignore these errors, turn validation off with --validate=false
	W0722 11:32:09.228282  218924 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0-beta.0/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
	stdout:
	
	stderr:
	error: error validating "/etc/kubernetes/addons/storage-provisioner.yaml": error validating data: failed to download openapi: Get "https://localhost:8443/openapi/v2?timeout=32s": dial tcp [::1]:8443: connect: connection refused; if you choose to ignore these errors, turn validation off with --validate=false
	I0722 11:32:09.228337  218924 retry.go:31] will retry after 322.955864ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0-beta.0/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
	stdout:
	
	stderr:
	error: error validating "/etc/kubernetes/addons/storage-provisioner.yaml": error validating data: failed to download openapi: Get "https://localhost:8443/openapi/v2?timeout=32s": dial tcp [::1]:8443: connect: connection refused; if you choose to ignore these errors, turn validation off with --validate=false
	I0722 11:32:09.257018  218924 addons.go:431] installing /etc/kubernetes/addons/dashboard-sa.yaml
	I0722 11:32:09.257095  218924 ssh_runner.go:362] scp dashboard/dashboard-sa.yaml --> /etc/kubernetes/addons/dashboard-sa.yaml (837 bytes)
	W0722 11:32:09.306075  218924 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0-beta.0/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
	stdout:
	
	stderr:
	error validating "/etc/kubernetes/addons/metrics-apiservice.yaml": error validating data: failed to download openapi: Get "https://localhost:8443/openapi/v2?timeout=32s": dial tcp [::1]:8443: connect: connection refused; if you choose to ignore these errors, turn validation off with --validate=false
	error validating "/etc/kubernetes/addons/metrics-server-deployment.yaml": error validating data: failed to download openapi: Get "https://localhost:8443/openapi/v2?timeout=32s": dial tcp [::1]:8443: connect: connection refused; if you choose to ignore these errors, turn validation off with --validate=false
	error validating "/etc/kubernetes/addons/metrics-server-rbac.yaml": error validating data: failed to download openapi: Get "https://localhost:8443/openapi/v2?timeout=32s": dial tcp [::1]:8443: connect: connection refused; if you choose to ignore these errors, turn validation off with --validate=false
	error validating "/etc/kubernetes/addons/metrics-server-service.yaml": error validating data: failed to download openapi: Get "https://localhost:8443/openapi/v2?timeout=32s": dial tcp [::1]:8443: connect: connection refused; if you choose to ignore these errors, turn validation off with --validate=false
	I0722 11:32:09.306158  218924 retry.go:31] will retry after 152.889845ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0-beta.0/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
	stdout:
	
	stderr:
	error validating "/etc/kubernetes/addons/metrics-apiservice.yaml": error validating data: failed to download openapi: Get "https://localhost:8443/openapi/v2?timeout=32s": dial tcp [::1]:8443: connect: connection refused; if you choose to ignore these errors, turn validation off with --validate=false
	error validating "/etc/kubernetes/addons/metrics-server-deployment.yaml": error validating data: failed to download openapi: Get "https://localhost:8443/openapi/v2?timeout=32s": dial tcp [::1]:8443: connect: connection refused; if you choose to ignore these errors, turn validation off with --validate=false
	error validating "/etc/kubernetes/addons/metrics-server-rbac.yaml": error validating data: failed to download openapi: Get "https://localhost:8443/openapi/v2?timeout=32s": dial tcp [::1]:8443: connect: connection refused; if you choose to ignore these errors, turn validation off with --validate=false
	error validating "/etc/kubernetes/addons/metrics-server-service.yaml": error validating data: failed to download openapi: Get "https://localhost:8443/openapi/v2?timeout=32s": dial tcp [::1]:8443: connect: connection refused; if you choose to ignore these errors, turn validation off with --validate=false
	I0722 11:32:09.312391  218924 addons.go:431] installing /etc/kubernetes/addons/dashboard-secret.yaml
	I0722 11:32:09.312466  218924 ssh_runner.go:362] scp dashboard/dashboard-secret.yaml --> /etc/kubernetes/addons/dashboard-secret.yaml (1389 bytes)
	I0722 11:32:09.335095  218924 addons.go:431] installing /etc/kubernetes/addons/dashboard-svc.yaml
	I0722 11:32:09.335202  218924 ssh_runner.go:362] scp dashboard/dashboard-svc.yaml --> /etc/kubernetes/addons/dashboard-svc.yaml (1294 bytes)
	I0722 11:32:09.374333  218924 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0-beta.0/kubectl apply -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
	I0722 11:32:09.459639  218924 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0-beta.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
	I0722 11:32:09.526108  218924 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0-beta.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml
	I0722 11:32:09.552422  218924 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0-beta.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml
	I0722 11:32:12.183203  210080 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0722 11:32:12.202803  210080 api_server.go:72] duration metric: took 5m49.375690109s to wait for apiserver process to appear ...
	I0722 11:32:12.202845  210080 api_server.go:88] waiting for apiserver healthz status ...
	I0722 11:32:12.202883  210080 cri.go:54] listing CRI containers in root : {State:all Name:kube-apiserver Namespaces:[]}
	I0722 11:32:12.202977  210080 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
	I0722 11:32:12.281497  210080 cri.go:89] found id: "7b17da0e203acb0f33605e81ab92029743299c8b53e99bedad6247fb2e22336d"
	I0722 11:32:12.281517  210080 cri.go:89] found id: ""
	I0722 11:32:12.281525  210080 logs.go:276] 1 containers: [7b17da0e203acb0f33605e81ab92029743299c8b53e99bedad6247fb2e22336d]
	I0722 11:32:12.281584  210080 ssh_runner.go:195] Run: which crictl
	I0722 11:32:12.285928  210080 cri.go:54] listing CRI containers in root : {State:all Name:etcd Namespaces:[]}
	I0722 11:32:12.285996  210080 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
	I0722 11:32:12.366847  210080 cri.go:89] found id: "b8f395f6e10fffc01d9db2971c2690affd63e1173ebe081a173b1df5e29b3eae"
	I0722 11:32:12.366866  210080 cri.go:89] found id: ""
	I0722 11:32:12.366873  210080 logs.go:276] 1 containers: [b8f395f6e10fffc01d9db2971c2690affd63e1173ebe081a173b1df5e29b3eae]
	I0722 11:32:12.366925  210080 ssh_runner.go:195] Run: which crictl
	I0722 11:32:12.377727  210080 cri.go:54] listing CRI containers in root : {State:all Name:coredns Namespaces:[]}
	I0722 11:32:12.377844  210080 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
	I0722 11:32:12.489949  210080 cri.go:89] found id: "25b426692cff4a0ddaac80382d5fd8be373235953b017a1f2591adbc04fe5208"
	I0722 11:32:12.489969  210080 cri.go:89] found id: ""
	I0722 11:32:12.489976  210080 logs.go:276] 1 containers: [25b426692cff4a0ddaac80382d5fd8be373235953b017a1f2591adbc04fe5208]
	I0722 11:32:12.490035  210080 ssh_runner.go:195] Run: which crictl
	I0722 11:32:12.494239  210080 cri.go:54] listing CRI containers in root : {State:all Name:kube-scheduler Namespaces:[]}
	I0722 11:32:12.494312  210080 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
	I0722 11:32:12.570563  210080 cri.go:89] found id: "a38f1a7f716723ae1738fc6d121fd5959ee9c40c5b1c46b537955d760c9f4290"
	I0722 11:32:12.570583  210080 cri.go:89] found id: ""
	I0722 11:32:12.570591  210080 logs.go:276] 1 containers: [a38f1a7f716723ae1738fc6d121fd5959ee9c40c5b1c46b537955d760c9f4290]
	I0722 11:32:12.570644  210080 ssh_runner.go:195] Run: which crictl
	I0722 11:32:12.577492  210080 cri.go:54] listing CRI containers in root : {State:all Name:kube-proxy Namespaces:[]}
	I0722 11:32:12.577562  210080 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
	I0722 11:32:12.639244  210080 cri.go:89] found id: "5191e613fc2d72706f1d776fe8a845ca8f4b3cec7ff3b0f9d18aee199e8d79c6"
	I0722 11:32:12.639265  210080 cri.go:89] found id: ""
	I0722 11:32:12.639272  210080 logs.go:276] 1 containers: [5191e613fc2d72706f1d776fe8a845ca8f4b3cec7ff3b0f9d18aee199e8d79c6]
	I0722 11:32:12.639326  210080 ssh_runner.go:195] Run: which crictl
	I0722 11:32:12.645464  210080 cri.go:54] listing CRI containers in root : {State:all Name:kube-controller-manager Namespaces:[]}
	I0722 11:32:12.645532  210080 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
	I0722 11:32:12.711129  210080 cri.go:89] found id: "460bdeec3bdfccab7101c9d13045f9bcf87734da1fb0f6f8b6a5c0111906ac43"
	I0722 11:32:12.711207  210080 cri.go:89] found id: ""
	I0722 11:32:12.711230  210080 logs.go:276] 1 containers: [460bdeec3bdfccab7101c9d13045f9bcf87734da1fb0f6f8b6a5c0111906ac43]
	I0722 11:32:12.711316  210080 ssh_runner.go:195] Run: which crictl
	I0722 11:32:12.719704  210080 cri.go:54] listing CRI containers in root : {State:all Name:kindnet Namespaces:[]}
	I0722 11:32:12.719776  210080 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet
	I0722 11:32:12.806984  210080 cri.go:89] found id: "451ceb51fb176f2ab58c30c602fe7a8d8dcdde723f94ec75d058fd599561cfde"
	I0722 11:32:12.807002  210080 cri.go:89] found id: ""
	I0722 11:32:12.807009  210080 logs.go:276] 1 containers: [451ceb51fb176f2ab58c30c602fe7a8d8dcdde723f94ec75d058fd599561cfde]
	I0722 11:32:12.807062  210080 ssh_runner.go:195] Run: which crictl
	I0722 11:32:12.810945  210080 cri.go:54] listing CRI containers in root : {State:all Name:storage-provisioner Namespaces:[]}
	I0722 11:32:12.811013  210080 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=storage-provisioner
	I0722 11:32:12.904775  210080 cri.go:89] found id: "b64b9e0461292d72b7fc112215c86b2db789ed69b01b10063e3b4f24a2155a8a"
	I0722 11:32:12.904794  210080 cri.go:89] found id: "48a74507ee5da0b4b62d92cb8fe64853426c4fcd088c4d455c7d827c4c514ab2"
	I0722 11:32:12.904799  210080 cri.go:89] found id: ""
	I0722 11:32:12.904805  210080 logs.go:276] 2 containers: [b64b9e0461292d72b7fc112215c86b2db789ed69b01b10063e3b4f24a2155a8a 48a74507ee5da0b4b62d92cb8fe64853426c4fcd088c4d455c7d827c4c514ab2]
	I0722 11:32:12.904865  210080 ssh_runner.go:195] Run: which crictl
	I0722 11:32:12.913119  210080 ssh_runner.go:195] Run: which crictl
	I0722 11:32:12.916790  210080 cri.go:54] listing CRI containers in root : {State:all Name:kubernetes-dashboard Namespaces:[]}
	I0722 11:32:12.916854  210080 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kubernetes-dashboard
	I0722 11:32:12.991388  210080 cri.go:89] found id: "0da5dde31a386001ac351514fcd5b733872eb5d92ec8b3579e32b0f14de7b1fc"
	I0722 11:32:12.991462  210080 cri.go:89] found id: ""
	I0722 11:32:12.991484  210080 logs.go:276] 1 containers: [0da5dde31a386001ac351514fcd5b733872eb5d92ec8b3579e32b0f14de7b1fc]
	I0722 11:32:12.991583  210080 ssh_runner.go:195] Run: which crictl
	I0722 11:32:12.997559  210080 logs.go:123] Gathering logs for kubelet ...
	I0722 11:32:12.997645  210080 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
	W0722 11:32:13.066644  210080 logs.go:138] Found kubelet problem: Jul 22 11:26:39 old-k8s-version-584140 kubelet[730]: E0722 11:26:39.204682     730 reflector.go:138] object-"kube-system"/"kube-proxy": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "kube-proxy" is forbidden: User "system:node:old-k8s-version-584140" cannot list resource "configmaps" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-584140' and this object
	W0722 11:32:13.066947  210080 logs.go:138] Found kubelet problem: Jul 22 11:26:39 old-k8s-version-584140 kubelet[730]: E0722 11:26:39.205097     730 reflector.go:138] object-"kube-system"/"storage-provisioner-token-th5sl": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "storage-provisioner-token-th5sl" is forbidden: User "system:node:old-k8s-version-584140" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-584140' and this object
	W0722 11:32:13.067193  210080 logs.go:138] Found kubelet problem: Jul 22 11:26:39 old-k8s-version-584140 kubelet[730]: E0722 11:26:39.205388     730 reflector.go:138] object-"default"/"default-token-gkskl": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "default-token-gkskl" is forbidden: User "system:node:old-k8s-version-584140" cannot list resource "secrets" in API group "" in the namespace "default": no relationship found between node 'old-k8s-version-584140' and this object
	W0722 11:32:13.067423  210080 logs.go:138] Found kubelet problem: Jul 22 11:26:39 old-k8s-version-584140 kubelet[730]: E0722 11:26:39.206223     730 reflector.go:138] object-"kube-system"/"coredns": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "coredns" is forbidden: User "system:node:old-k8s-version-584140" cannot list resource "configmaps" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-584140' and this object
	W0722 11:32:13.067664  210080 logs.go:138] Found kubelet problem: Jul 22 11:26:39 old-k8s-version-584140 kubelet[730]: E0722 11:26:39.206544     730 reflector.go:138] object-"kube-system"/"kube-proxy-token-g9gsb": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "kube-proxy-token-g9gsb" is forbidden: User "system:node:old-k8s-version-584140" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-584140' and this object
	W0722 11:32:13.067913  210080 logs.go:138] Found kubelet problem: Jul 22 11:26:39 old-k8s-version-584140 kubelet[730]: E0722 11:26:39.206876     730 reflector.go:138] object-"kube-system"/"kindnet-token-tjmsp": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "kindnet-token-tjmsp" is forbidden: User "system:node:old-k8s-version-584140" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-584140' and this object
	W0722 11:32:13.068162  210080 logs.go:138] Found kubelet problem: Jul 22 11:26:39 old-k8s-version-584140 kubelet[730]: E0722 11:26:39.207130     730 reflector.go:138] object-"kube-system"/"metrics-server-token-btvqb": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "metrics-server-token-btvqb" is forbidden: User "system:node:old-k8s-version-584140" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-584140' and this object
	W0722 11:32:13.068406  210080 logs.go:138] Found kubelet problem: Jul 22 11:26:39 old-k8s-version-584140 kubelet[730]: E0722 11:26:39.207456     730 reflector.go:138] object-"kube-system"/"coredns-token-7tqrc": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "coredns-token-7tqrc" is forbidden: User "system:node:old-k8s-version-584140" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-584140' and this object
	W0722 11:32:13.091614  210080 logs.go:138] Found kubelet problem: Jul 22 11:26:43 old-k8s-version-584140 kubelet[730]: E0722 11:26:43.160558     730 pod_workers.go:191] Error syncing pod 5a4606c4-b596-44df-a930-60179facf4e9 ("metrics-server-9975d5f86-4jcvm_kube-system(5a4606c4-b596-44df-a930-60179facf4e9)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = pinging container registry fake.domain: Get \"https://fake.domain/v2/\": dial tcp: lookup fake.domain: no such host"
	W0722 11:32:13.091891  210080 logs.go:138] Found kubelet problem: Jul 22 11:26:43 old-k8s-version-584140 kubelet[730]: E0722 11:26:43.632278     730 pod_workers.go:191] Error syncing pod 5a4606c4-b596-44df-a930-60179facf4e9 ("metrics-server-9975d5f86-4jcvm_kube-system(5a4606c4-b596-44df-a930-60179facf4e9)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W0722 11:32:13.096193  210080 logs.go:138] Found kubelet problem: Jul 22 11:26:54 old-k8s-version-584140 kubelet[730]: E0722 11:26:54.611909     730 pod_workers.go:191] Error syncing pod 5a4606c4-b596-44df-a930-60179facf4e9 ("metrics-server-9975d5f86-4jcvm_kube-system(5a4606c4-b596-44df-a930-60179facf4e9)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = pinging container registry fake.domain: Get \"https://fake.domain/v2/\": dial tcp: lookup fake.domain: no such host"
	W0722 11:32:13.098728  210080 logs.go:138] Found kubelet problem: Jul 22 11:27:02 old-k8s-version-584140 kubelet[730]: E0722 11:27:02.738618     730 pod_workers.go:191] Error syncing pod b728f80c-1116-4ef9-b36b-6d05d11b72a1 ("dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 10s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"
	W0722 11:32:13.099226  210080 logs.go:138] Found kubelet problem: Jul 22 11:27:03 old-k8s-version-584140 kubelet[730]: E0722 11:27:03.741827     730 pod_workers.go:191] Error syncing pod b728f80c-1116-4ef9-b36b-6d05d11b72a1 ("dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 10s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"
	W0722 11:32:13.099583  210080 logs.go:138] Found kubelet problem: Jul 22 11:27:04 old-k8s-version-584140 kubelet[730]: E0722 11:27:04.838076     730 pod_workers.go:191] Error syncing pod b728f80c-1116-4ef9-b36b-6d05d11b72a1 ("dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 10s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"
	W0722 11:32:13.103114  210080 logs.go:138] Found kubelet problem: Jul 22 11:27:09 old-k8s-version-584140 kubelet[730]: E0722 11:27:09.598856     730 pod_workers.go:191] Error syncing pod 5a4606c4-b596-44df-a930-60179facf4e9 ("metrics-server-9975d5f86-4jcvm_kube-system(5a4606c4-b596-44df-a930-60179facf4e9)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W0722 11:32:13.103933  210080 logs.go:138] Found kubelet problem: Jul 22 11:27:18 old-k8s-version-584140 kubelet[730]: E0722 11:27:18.778810     730 pod_workers.go:191] Error syncing pod b728f80c-1116-4ef9-b36b-6d05d11b72a1 ("dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"
	W0722 11:32:13.106139  210080 logs.go:138] Found kubelet problem: Jul 22 11:27:23 old-k8s-version-584140 kubelet[730]: E0722 11:27:23.614499     730 pod_workers.go:191] Error syncing pod 5a4606c4-b596-44df-a930-60179facf4e9 ("metrics-server-9975d5f86-4jcvm_kube-system(5a4606c4-b596-44df-a930-60179facf4e9)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = pinging container registry fake.domain: Get \"https://fake.domain/v2/\": dial tcp: lookup fake.domain: no such host"
	W0722 11:32:13.106475  210080 logs.go:138] Found kubelet problem: Jul 22 11:27:24 old-k8s-version-584140 kubelet[730]: E0722 11:27:24.838228     730 pod_workers.go:191] Error syncing pod b728f80c-1116-4ef9-b36b-6d05d11b72a1 ("dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"
	W0722 11:32:13.106803  210080 logs.go:138] Found kubelet problem: Jul 22 11:27:36 old-k8s-version-584140 kubelet[730]: E0722 11:27:36.599081     730 pod_workers.go:191] Error syncing pod b728f80c-1116-4ef9-b36b-6d05d11b72a1 ("dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"
	W0722 11:32:13.106986  210080 logs.go:138] Found kubelet problem: Jul 22 11:27:38 old-k8s-version-584140 kubelet[730]: E0722 11:27:38.598819     730 pod_workers.go:191] Error syncing pod 5a4606c4-b596-44df-a930-60179facf4e9 ("metrics-server-9975d5f86-4jcvm_kube-system(5a4606c4-b596-44df-a930-60179facf4e9)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W0722 11:32:13.107575  210080 logs.go:138] Found kubelet problem: Jul 22 11:27:50 old-k8s-version-584140 kubelet[730]: E0722 11:27:50.837672     730 pod_workers.go:191] Error syncing pod b728f80c-1116-4ef9-b36b-6d05d11b72a1 ("dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"
	W0722 11:32:13.107756  210080 logs.go:138] Found kubelet problem: Jul 22 11:27:53 old-k8s-version-584140 kubelet[730]: E0722 11:27:53.599749     730 pod_workers.go:191] Error syncing pod 5a4606c4-b596-44df-a930-60179facf4e9 ("metrics-server-9975d5f86-4jcvm_kube-system(5a4606c4-b596-44df-a930-60179facf4e9)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W0722 11:32:13.108087  210080 logs.go:138] Found kubelet problem: Jul 22 11:27:54 old-k8s-version-584140 kubelet[730]: E0722 11:27:54.838469     730 pod_workers.go:191] Error syncing pod b728f80c-1116-4ef9-b36b-6d05d11b72a1 ("dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"
	W0722 11:32:13.108413  210080 logs.go:138] Found kubelet problem: Jul 22 11:28:06 old-k8s-version-584140 kubelet[730]: E0722 11:28:06.598312     730 pod_workers.go:191] Error syncing pod b728f80c-1116-4ef9-b36b-6d05d11b72a1 ("dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"
	W0722 11:32:13.112031  210080 logs.go:138] Found kubelet problem: Jul 22 11:28:07 old-k8s-version-584140 kubelet[730]: E0722 11:28:07.619353     730 pod_workers.go:191] Error syncing pod 5a4606c4-b596-44df-a930-60179facf4e9 ("metrics-server-9975d5f86-4jcvm_kube-system(5a4606c4-b596-44df-a930-60179facf4e9)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = pinging container registry fake.domain: Get \"https://fake.domain/v2/\": dial tcp: lookup fake.domain: no such host"
	W0722 11:32:13.112416  210080 logs.go:138] Found kubelet problem: Jul 22 11:28:20 old-k8s-version-584140 kubelet[730]: E0722 11:28:20.599140     730 pod_workers.go:191] Error syncing pod b728f80c-1116-4ef9-b36b-6d05d11b72a1 ("dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"
	W0722 11:32:13.112656  210080 logs.go:138] Found kubelet problem: Jul 22 11:28:20 old-k8s-version-584140 kubelet[730]: E0722 11:28:20.600438     730 pod_workers.go:191] Error syncing pod 5a4606c4-b596-44df-a930-60179facf4e9 ("metrics-server-9975d5f86-4jcvm_kube-system(5a4606c4-b596-44df-a930-60179facf4e9)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W0722 11:32:13.113300  210080 logs.go:138] Found kubelet problem: Jul 22 11:28:33 old-k8s-version-584140 kubelet[730]: E0722 11:28:33.909665     730 pod_workers.go:191] Error syncing pod b728f80c-1116-4ef9-b36b-6d05d11b72a1 ("dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"
	W0722 11:32:13.113656  210080 logs.go:138] Found kubelet problem: Jul 22 11:28:34 old-k8s-version-584140 kubelet[730]: E0722 11:28:34.912079     730 pod_workers.go:191] Error syncing pod b728f80c-1116-4ef9-b36b-6d05d11b72a1 ("dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"
	W0722 11:32:13.113873  210080 logs.go:138] Found kubelet problem: Jul 22 11:28:35 old-k8s-version-584140 kubelet[730]: E0722 11:28:35.599081     730 pod_workers.go:191] Error syncing pod 5a4606c4-b596-44df-a930-60179facf4e9 ("metrics-server-9975d5f86-4jcvm_kube-system(5a4606c4-b596-44df-a930-60179facf4e9)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W0722 11:32:13.114232  210080 logs.go:138] Found kubelet problem: Jul 22 11:28:46 old-k8s-version-584140 kubelet[730]: E0722 11:28:46.598307     730 pod_workers.go:191] Error syncing pod b728f80c-1116-4ef9-b36b-6d05d11b72a1 ("dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"
	W0722 11:32:13.114449  210080 logs.go:138] Found kubelet problem: Jul 22 11:28:50 old-k8s-version-584140 kubelet[730]: E0722 11:28:50.599499     730 pod_workers.go:191] Error syncing pod 5a4606c4-b596-44df-a930-60179facf4e9 ("metrics-server-9975d5f86-4jcvm_kube-system(5a4606c4-b596-44df-a930-60179facf4e9)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W0722 11:32:13.114814  210080 logs.go:138] Found kubelet problem: Jul 22 11:29:01 old-k8s-version-584140 kubelet[730]: E0722 11:29:01.598946     730 pod_workers.go:191] Error syncing pod b728f80c-1116-4ef9-b36b-6d05d11b72a1 ("dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"
	W0722 11:32:13.115037  210080 logs.go:138] Found kubelet problem: Jul 22 11:29:04 old-k8s-version-584140 kubelet[730]: E0722 11:29:04.598688     730 pod_workers.go:191] Error syncing pod 5a4606c4-b596-44df-a930-60179facf4e9 ("metrics-server-9975d5f86-4jcvm_kube-system(5a4606c4-b596-44df-a930-60179facf4e9)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W0722 11:32:13.115407  210080 logs.go:138] Found kubelet problem: Jul 22 11:29:12 old-k8s-version-584140 kubelet[730]: E0722 11:29:12.598338     730 pod_workers.go:191] Error syncing pod b728f80c-1116-4ef9-b36b-6d05d11b72a1 ("dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"
	W0722 11:32:13.115623  210080 logs.go:138] Found kubelet problem: Jul 22 11:29:19 old-k8s-version-584140 kubelet[730]: E0722 11:29:19.598946     730 pod_workers.go:191] Error syncing pod 5a4606c4-b596-44df-a930-60179facf4e9 ("metrics-server-9975d5f86-4jcvm_kube-system(5a4606c4-b596-44df-a930-60179facf4e9)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W0722 11:32:13.115987  210080 logs.go:138] Found kubelet problem: Jul 22 11:29:26 old-k8s-version-584140 kubelet[730]: E0722 11:29:26.598882     730 pod_workers.go:191] Error syncing pod b728f80c-1116-4ef9-b36b-6d05d11b72a1 ("dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"
	W0722 11:32:13.118742  210080 logs.go:138] Found kubelet problem: Jul 22 11:29:33 old-k8s-version-584140 kubelet[730]: E0722 11:29:33.611073     730 pod_workers.go:191] Error syncing pod 5a4606c4-b596-44df-a930-60179facf4e9 ("metrics-server-9975d5f86-4jcvm_kube-system(5a4606c4-b596-44df-a930-60179facf4e9)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = pinging container registry fake.domain: Get \"https://fake.domain/v2/\": dial tcp: lookup fake.domain: no such host"
	W0722 11:32:13.119112  210080 logs.go:138] Found kubelet problem: Jul 22 11:29:37 old-k8s-version-584140 kubelet[730]: E0722 11:29:37.598186     730 pod_workers.go:191] Error syncing pod b728f80c-1116-4ef9-b36b-6d05d11b72a1 ("dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"
	W0722 11:32:13.119323  210080 logs.go:138] Found kubelet problem: Jul 22 11:29:46 old-k8s-version-584140 kubelet[730]: E0722 11:29:46.599495     730 pod_workers.go:191] Error syncing pod 5a4606c4-b596-44df-a930-60179facf4e9 ("metrics-server-9975d5f86-4jcvm_kube-system(5a4606c4-b596-44df-a930-60179facf4e9)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W0722 11:32:13.119677  210080 logs.go:138] Found kubelet problem: Jul 22 11:29:48 old-k8s-version-584140 kubelet[730]: E0722 11:29:48.598602     730 pod_workers.go:191] Error syncing pod b728f80c-1116-4ef9-b36b-6d05d11b72a1 ("dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"
	W0722 11:32:13.119896  210080 logs.go:138] Found kubelet problem: Jul 22 11:30:00 old-k8s-version-584140 kubelet[730]: E0722 11:30:00.599866     730 pod_workers.go:191] Error syncing pod 5a4606c4-b596-44df-a930-60179facf4e9 ("metrics-server-9975d5f86-4jcvm_kube-system(5a4606c4-b596-44df-a930-60179facf4e9)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W0722 11:32:13.120518  210080 logs.go:138] Found kubelet problem: Jul 22 11:30:03 old-k8s-version-584140 kubelet[730]: E0722 11:30:03.060169     730 pod_workers.go:191] Error syncing pod b728f80c-1116-4ef9-b36b-6d05d11b72a1 ("dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"
	W0722 11:32:13.120882  210080 logs.go:138] Found kubelet problem: Jul 22 11:30:04 old-k8s-version-584140 kubelet[730]: E0722 11:30:04.837656     730 pod_workers.go:191] Error syncing pod b728f80c-1116-4ef9-b36b-6d05d11b72a1 ("dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"
	W0722 11:32:13.121095  210080 logs.go:138] Found kubelet problem: Jul 22 11:30:13 old-k8s-version-584140 kubelet[730]: E0722 11:30:13.598674     730 pod_workers.go:191] Error syncing pod 5a4606c4-b596-44df-a930-60179facf4e9 ("metrics-server-9975d5f86-4jcvm_kube-system(5a4606c4-b596-44df-a930-60179facf4e9)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W0722 11:32:13.121455  210080 logs.go:138] Found kubelet problem: Jul 22 11:30:17 old-k8s-version-584140 kubelet[730]: E0722 11:30:17.598240     730 pod_workers.go:191] Error syncing pod b728f80c-1116-4ef9-b36b-6d05d11b72a1 ("dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"
	W0722 11:32:13.121671  210080 logs.go:138] Found kubelet problem: Jul 22 11:30:28 old-k8s-version-584140 kubelet[730]: E0722 11:30:28.598615     730 pod_workers.go:191] Error syncing pod 5a4606c4-b596-44df-a930-60179facf4e9 ("metrics-server-9975d5f86-4jcvm_kube-system(5a4606c4-b596-44df-a930-60179facf4e9)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W0722 11:32:13.122558  210080 logs.go:138] Found kubelet problem: Jul 22 11:30:31 old-k8s-version-584140 kubelet[730]: E0722 11:30:31.598312     730 pod_workers.go:191] Error syncing pod b728f80c-1116-4ef9-b36b-6d05d11b72a1 ("dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"
	W0722 11:32:13.122777  210080 logs.go:138] Found kubelet problem: Jul 22 11:30:43 old-k8s-version-584140 kubelet[730]: E0722 11:30:43.599168     730 pod_workers.go:191] Error syncing pod 5a4606c4-b596-44df-a930-60179facf4e9 ("metrics-server-9975d5f86-4jcvm_kube-system(5a4606c4-b596-44df-a930-60179facf4e9)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W0722 11:32:13.123140  210080 logs.go:138] Found kubelet problem: Jul 22 11:30:44 old-k8s-version-584140 kubelet[730]: E0722 11:30:44.598289     730 pod_workers.go:191] Error syncing pod b728f80c-1116-4ef9-b36b-6d05d11b72a1 ("dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"
	W0722 11:32:13.123361  210080 logs.go:138] Found kubelet problem: Jul 22 11:30:55 old-k8s-version-584140 kubelet[730]: E0722 11:30:55.599111     730 pod_workers.go:191] Error syncing pod 5a4606c4-b596-44df-a930-60179facf4e9 ("metrics-server-9975d5f86-4jcvm_kube-system(5a4606c4-b596-44df-a930-60179facf4e9)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W0722 11:32:13.123761  210080 logs.go:138] Found kubelet problem: Jul 22 11:30:58 old-k8s-version-584140 kubelet[730]: E0722 11:30:58.598266     730 pod_workers.go:191] Error syncing pod b728f80c-1116-4ef9-b36b-6d05d11b72a1 ("dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"
	W0722 11:32:13.123983  210080 logs.go:138] Found kubelet problem: Jul 22 11:31:08 old-k8s-version-584140 kubelet[730]: E0722 11:31:08.598772     730 pod_workers.go:191] Error syncing pod 5a4606c4-b596-44df-a930-60179facf4e9 ("metrics-server-9975d5f86-4jcvm_kube-system(5a4606c4-b596-44df-a930-60179facf4e9)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W0722 11:32:13.124338  210080 logs.go:138] Found kubelet problem: Jul 22 11:31:12 old-k8s-version-584140 kubelet[730]: E0722 11:31:12.598216     730 pod_workers.go:191] Error syncing pod b728f80c-1116-4ef9-b36b-6d05d11b72a1 ("dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"
	W0722 11:32:13.124695  210080 logs.go:138] Found kubelet problem: Jul 22 11:31:23 old-k8s-version-584140 kubelet[730]: E0722 11:31:23.598165     730 pod_workers.go:191] Error syncing pod b728f80c-1116-4ef9-b36b-6d05d11b72a1 ("dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"
	W0722 11:32:13.124915  210080 logs.go:138] Found kubelet problem: Jul 22 11:31:23 old-k8s-version-584140 kubelet[730]: E0722 11:31:23.599281     730 pod_workers.go:191] Error syncing pod 5a4606c4-b596-44df-a930-60179facf4e9 ("metrics-server-9975d5f86-4jcvm_kube-system(5a4606c4-b596-44df-a930-60179facf4e9)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W0722 11:32:13.125573  210080 logs.go:138] Found kubelet problem: Jul 22 11:31:36 old-k8s-version-584140 kubelet[730]: E0722 11:31:36.598285     730 pod_workers.go:191] Error syncing pod b728f80c-1116-4ef9-b36b-6d05d11b72a1 ("dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"
	W0722 11:32:13.125763  210080 logs.go:138] Found kubelet problem: Jul 22 11:31:37 old-k8s-version-584140 kubelet[730]: E0722 11:31:37.598777     730 pod_workers.go:191] Error syncing pod 5a4606c4-b596-44df-a930-60179facf4e9 ("metrics-server-9975d5f86-4jcvm_kube-system(5a4606c4-b596-44df-a930-60179facf4e9)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W0722 11:32:13.126093  210080 logs.go:138] Found kubelet problem: Jul 22 11:31:50 old-k8s-version-584140 kubelet[730]: E0722 11:31:50.598548     730 pod_workers.go:191] Error syncing pod b728f80c-1116-4ef9-b36b-6d05d11b72a1 ("dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"
	W0722 11:32:13.126277  210080 logs.go:138] Found kubelet problem: Jul 22 11:31:52 old-k8s-version-584140 kubelet[730]: E0722 11:31:52.598992     730 pod_workers.go:191] Error syncing pod 5a4606c4-b596-44df-a930-60179facf4e9 ("metrics-server-9975d5f86-4jcvm_kube-system(5a4606c4-b596-44df-a930-60179facf4e9)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W0722 11:32:13.126606  210080 logs.go:138] Found kubelet problem: Jul 22 11:32:04 old-k8s-version-584140 kubelet[730]: E0722 11:32:04.598313     730 pod_workers.go:191] Error syncing pod b728f80c-1116-4ef9-b36b-6d05d11b72a1 ("dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"
	W0722 11:32:13.126802  210080 logs.go:138] Found kubelet problem: Jul 22 11:32:07 old-k8s-version-584140 kubelet[730]: E0722 11:32:07.598569     730 pod_workers.go:191] Error syncing pod 5a4606c4-b596-44df-a930-60179facf4e9 ("metrics-server-9975d5f86-4jcvm_kube-system(5a4606c4-b596-44df-a930-60179facf4e9)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	I0722 11:32:13.126810  210080 logs.go:123] Gathering logs for describe nodes ...
	I0722 11:32:13.126824  210080 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
	I0722 11:32:13.399039  210080 logs.go:123] Gathering logs for kindnet [451ceb51fb176f2ab58c30c602fe7a8d8dcdde723f94ec75d058fd599561cfde] ...
	I0722 11:32:13.399119  210080 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 451ceb51fb176f2ab58c30c602fe7a8d8dcdde723f94ec75d058fd599561cfde"
	I0722 11:32:13.526326  210080 logs.go:123] Gathering logs for storage-provisioner [b64b9e0461292d72b7fc112215c86b2db789ed69b01b10063e3b4f24a2155a8a] ...
	I0722 11:32:13.526402  210080 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 b64b9e0461292d72b7fc112215c86b2db789ed69b01b10063e3b4f24a2155a8a"
	I0722 11:32:15.156649  218924 node_ready.go:49] node "no-preload-076896" has status "Ready":"True"
	I0722 11:32:15.156672  218924 node_ready.go:38] duration metric: took 6.287102501s for node "no-preload-076896" to be "Ready" ...
	I0722 11:32:15.156682  218924 pod_ready.go:35] extra waiting up to 6m0s for all system-critical pods including labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
	I0722 11:32:15.312694  218924 pod_ready.go:78] waiting up to 6m0s for pod "coredns-5cfdc65f69-qj9x7" in "kube-system" namespace to be "Ready" ...
	I0722 11:32:15.575807  218924 pod_ready.go:92] pod "coredns-5cfdc65f69-qj9x7" in "kube-system" namespace has status "Ready":"True"
	I0722 11:32:15.575879  218924 pod_ready.go:81] duration metric: took 263.110944ms for pod "coredns-5cfdc65f69-qj9x7" in "kube-system" namespace to be "Ready" ...
	I0722 11:32:15.575904  218924 pod_ready.go:78] waiting up to 6m0s for pod "etcd-no-preload-076896" in "kube-system" namespace to be "Ready" ...
	I0722 11:32:15.656032  218924 pod_ready.go:92] pod "etcd-no-preload-076896" in "kube-system" namespace has status "Ready":"True"
	I0722 11:32:15.656106  218924 pod_ready.go:81] duration metric: took 80.155596ms for pod "etcd-no-preload-076896" in "kube-system" namespace to be "Ready" ...
	I0722 11:32:15.656148  218924 pod_ready.go:78] waiting up to 6m0s for pod "kube-apiserver-no-preload-076896" in "kube-system" namespace to be "Ready" ...
	I0722 11:32:15.702712  218924 pod_ready.go:92] pod "kube-apiserver-no-preload-076896" in "kube-system" namespace has status "Ready":"True"
	I0722 11:32:15.702785  218924 pod_ready.go:81] duration metric: took 46.611265ms for pod "kube-apiserver-no-preload-076896" in "kube-system" namespace to be "Ready" ...
	I0722 11:32:15.702812  218924 pod_ready.go:78] waiting up to 6m0s for pod "kube-controller-manager-no-preload-076896" in "kube-system" namespace to be "Ready" ...
	I0722 11:32:16.849556  218924 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0-beta.0/kubectl apply -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: (7.475131434s)
	I0722 11:32:16.850020  218924 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0-beta.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: (7.390288488s)
	I0722 11:32:16.850086  218924 addons.go:475] Verifying addon metrics-server=true in "no-preload-076896"
	I0722 11:32:16.850160  218924 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0-beta.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: (7.323967145s)
	I0722 11:32:16.850439  218924 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0-beta.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: (7.297943108s)
	I0722 11:32:16.853157  218924 out.go:177] * Some dashboard features require the metrics-server addon. To enable all features please run:
	
		minikube -p no-preload-076896 addons enable metrics-server
	
	I0722 11:32:16.873013  218924 out.go:177] * Enabled addons: metrics-server, storage-provisioner, dashboard, default-storageclass
	I0722 11:32:13.598245  210080 logs.go:123] Gathering logs for storage-provisioner [48a74507ee5da0b4b62d92cb8fe64853426c4fcd088c4d455c7d827c4c514ab2] ...
	I0722 11:32:13.598325  210080 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 48a74507ee5da0b4b62d92cb8fe64853426c4fcd088c4d455c7d827c4c514ab2"
	I0722 11:32:13.663983  210080 logs.go:123] Gathering logs for CRI-O ...
	I0722 11:32:13.664010  210080 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u crio -n 400"
	I0722 11:32:13.774294  210080 logs.go:123] Gathering logs for kube-apiserver [7b17da0e203acb0f33605e81ab92029743299c8b53e99bedad6247fb2e22336d] ...
	I0722 11:32:13.774368  210080 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 7b17da0e203acb0f33605e81ab92029743299c8b53e99bedad6247fb2e22336d"
	I0722 11:32:13.916684  210080 logs.go:123] Gathering logs for etcd [b8f395f6e10fffc01d9db2971c2690affd63e1173ebe081a173b1df5e29b3eae] ...
	I0722 11:32:13.916766  210080 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 b8f395f6e10fffc01d9db2971c2690affd63e1173ebe081a173b1df5e29b3eae"
	I0722 11:32:13.987707  210080 logs.go:123] Gathering logs for coredns [25b426692cff4a0ddaac80382d5fd8be373235953b017a1f2591adbc04fe5208] ...
	I0722 11:32:13.987784  210080 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 25b426692cff4a0ddaac80382d5fd8be373235953b017a1f2591adbc04fe5208"
	I0722 11:32:14.058506  210080 logs.go:123] Gathering logs for kube-controller-manager [460bdeec3bdfccab7101c9d13045f9bcf87734da1fb0f6f8b6a5c0111906ac43] ...
	I0722 11:32:14.058580  210080 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 460bdeec3bdfccab7101c9d13045f9bcf87734da1fb0f6f8b6a5c0111906ac43"
	I0722 11:32:14.180422  210080 logs.go:123] Gathering logs for dmesg ...
	I0722 11:32:14.180504  210080 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
	I0722 11:32:14.206776  210080 logs.go:123] Gathering logs for kube-scheduler [a38f1a7f716723ae1738fc6d121fd5959ee9c40c5b1c46b537955d760c9f4290] ...
	I0722 11:32:14.206809  210080 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 a38f1a7f716723ae1738fc6d121fd5959ee9c40c5b1c46b537955d760c9f4290"
	I0722 11:32:14.284863  210080 logs.go:123] Gathering logs for kube-proxy [5191e613fc2d72706f1d776fe8a845ca8f4b3cec7ff3b0f9d18aee199e8d79c6] ...
	I0722 11:32:14.284912  210080 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 5191e613fc2d72706f1d776fe8a845ca8f4b3cec7ff3b0f9d18aee199e8d79c6"
	I0722 11:32:14.362593  210080 logs.go:123] Gathering logs for kubernetes-dashboard [0da5dde31a386001ac351514fcd5b733872eb5d92ec8b3579e32b0f14de7b1fc] ...
	I0722 11:32:14.362628  210080 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 0da5dde31a386001ac351514fcd5b733872eb5d92ec8b3579e32b0f14de7b1fc"
	I0722 11:32:14.443975  210080 logs.go:123] Gathering logs for container status ...
	I0722 11:32:14.444089  210080 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
	I0722 11:32:14.520662  210080 out.go:304] Setting ErrFile to fd 2...
	I0722 11:32:14.520689  210080 out.go:338] TERM=,COLORTERM=, which probably does not support color
	W0722 11:32:14.520820  210080 out.go:239] X Problems detected in kubelet:
	W0722 11:32:14.520838  210080 out.go:239]   Jul 22 11:31:37 old-k8s-version-584140 kubelet[730]: E0722 11:31:37.598777     730 pod_workers.go:191] Error syncing pod 5a4606c4-b596-44df-a930-60179facf4e9 ("metrics-server-9975d5f86-4jcvm_kube-system(5a4606c4-b596-44df-a930-60179facf4e9)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W0722 11:32:14.520846  210080 out.go:239]   Jul 22 11:31:50 old-k8s-version-584140 kubelet[730]: E0722 11:31:50.598548     730 pod_workers.go:191] Error syncing pod b728f80c-1116-4ef9-b36b-6d05d11b72a1 ("dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"
	W0722 11:32:14.520996  210080 out.go:239]   Jul 22 11:31:52 old-k8s-version-584140 kubelet[730]: E0722 11:31:52.598992     730 pod_workers.go:191] Error syncing pod 5a4606c4-b596-44df-a930-60179facf4e9 ("metrics-server-9975d5f86-4jcvm_kube-system(5a4606c4-b596-44df-a930-60179facf4e9)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W0722 11:32:14.521011  210080 out.go:239]   Jul 22 11:32:04 old-k8s-version-584140 kubelet[730]: E0722 11:32:04.598313     730 pod_workers.go:191] Error syncing pod b728f80c-1116-4ef9-b36b-6d05d11b72a1 ("dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"
	W0722 11:32:14.521018  210080 out.go:239]   Jul 22 11:32:07 old-k8s-version-584140 kubelet[730]: E0722 11:32:07.598569     730 pod_workers.go:191] Error syncing pod 5a4606c4-b596-44df-a930-60179facf4e9 ("metrics-server-9975d5f86-4jcvm_kube-system(5a4606c4-b596-44df-a930-60179facf4e9)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	I0722 11:32:14.521025  210080 out.go:304] Setting ErrFile to fd 2...
	I0722 11:32:14.521035  210080 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0722 11:32:16.876234  218924 addons.go:510] duration metric: took 8.47627919s for enable addons: enabled=[metrics-server storage-provisioner dashboard default-storageclass]
	I0722 11:32:17.714217  218924 pod_ready.go:102] pod "kube-controller-manager-no-preload-076896" in "kube-system" namespace has status "Ready":"False"
	I0722 11:32:19.720521  218924 pod_ready.go:102] pod "kube-controller-manager-no-preload-076896" in "kube-system" namespace has status "Ready":"False"
	I0722 11:32:24.521380  210080 api_server.go:253] Checking apiserver healthz at https://192.168.76.2:8443/healthz ...
	I0722 11:32:24.532152  210080 api_server.go:279] https://192.168.76.2:8443/healthz returned 200:
	ok
	I0722 11:32:24.534362  210080 out.go:177] 
	W0722 11:32:24.536402  210080 out.go:239] X Exiting due to K8S_UNHEALTHY_CONTROL_PLANE: wait 6m0s for node: wait for healthy API server: controlPlane never updated to v1.20.0
	W0722 11:32:24.536544  210080 out.go:239] * Suggestion: Control Plane could not update, try minikube delete --all --purge
	W0722 11:32:24.536574  210080 out.go:239] * Related issue: https://github.com/kubernetes/minikube/issues/11417
	W0722 11:32:24.536587  210080 out.go:239] * 
	W0722 11:32:24.537591  210080 out.go:239] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                             │
	│    * If the above advice does not help, please let us know:                                 │
	│      https://github.com/kubernetes/minikube/issues/new/choose                               │
	│                                                                                             │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │
	│                                                                                             │
	╰─────────────────────────────────────────────────────────────────────────────────────────────╯
	I0722 11:32:24.538987  210080 out.go:177] 
	I0722 11:32:21.712058  218924 pod_ready.go:92] pod "kube-controller-manager-no-preload-076896" in "kube-system" namespace has status "Ready":"True"
	I0722 11:32:21.712129  218924 pod_ready.go:81] duration metric: took 6.009293891s for pod "kube-controller-manager-no-preload-076896" in "kube-system" namespace to be "Ready" ...
	I0722 11:32:21.712155  218924 pod_ready.go:78] waiting up to 6m0s for pod "kube-proxy-z6tdn" in "kube-system" namespace to be "Ready" ...
	I0722 11:32:21.729751  218924 pod_ready.go:92] pod "kube-proxy-z6tdn" in "kube-system" namespace has status "Ready":"True"
	I0722 11:32:21.729823  218924 pod_ready.go:81] duration metric: took 17.647803ms for pod "kube-proxy-z6tdn" in "kube-system" namespace to be "Ready" ...
	I0722 11:32:21.729849  218924 pod_ready.go:78] waiting up to 6m0s for pod "kube-scheduler-no-preload-076896" in "kube-system" namespace to be "Ready" ...
	I0722 11:32:23.737178  218924 pod_ready.go:102] pod "kube-scheduler-no-preload-076896" in "kube-system" namespace has status "Ready":"False"
	I0722 11:32:24.237206  218924 pod_ready.go:92] pod "kube-scheduler-no-preload-076896" in "kube-system" namespace has status "Ready":"True"
	I0722 11:32:24.237276  218924 pod_ready.go:81] duration metric: took 2.507405374s for pod "kube-scheduler-no-preload-076896" in "kube-system" namespace to be "Ready" ...
	I0722 11:32:24.237302  218924 pod_ready.go:78] waiting up to 6m0s for pod "metrics-server-78fcd8795b-spn8p" in "kube-system" namespace to be "Ready" ...
	
	
	==> CRI-O <==
	Jul 22 11:30:03 old-k8s-version-584140 crio[621]: time="2024-07-22 11:30:03.088414113Z" level=info msg="Removed container 8e03b1490598f83b5b1472f498efb487a90d9724b033d75af25d55b449dd11c3: kubernetes-dashboard/dashboard-metrics-scraper-8d5bb5db8-4ttjq/dashboard-metrics-scraper" id=f911e3e8-9549-49cd-8ee3-b5c81b446b8e name=/runtime.v1alpha2.RuntimeService/RemoveContainer
	Jul 22 11:30:13 old-k8s-version-584140 crio[621]: time="2024-07-22 11:30:13.598209308Z" level=info msg="Checking image status: fake.domain/registry.k8s.io/echoserver:1.4" id=16e20e9d-d26b-4f2c-8a89-dfaa0657d2c5 name=/runtime.v1alpha2.ImageService/ImageStatus
	Jul 22 11:30:13 old-k8s-version-584140 crio[621]: time="2024-07-22 11:30:13.598442314Z" level=info msg="Image fake.domain/registry.k8s.io/echoserver:1.4 not found" id=16e20e9d-d26b-4f2c-8a89-dfaa0657d2c5 name=/runtime.v1alpha2.ImageService/ImageStatus
	Jul 22 11:30:28 old-k8s-version-584140 crio[621]: time="2024-07-22 11:30:28.598123898Z" level=info msg="Checking image status: fake.domain/registry.k8s.io/echoserver:1.4" id=9d9bb423-e57b-48f7-808f-1b85aa2e10ef name=/runtime.v1alpha2.ImageService/ImageStatus
	Jul 22 11:30:28 old-k8s-version-584140 crio[621]: time="2024-07-22 11:30:28.598353942Z" level=info msg="Image fake.domain/registry.k8s.io/echoserver:1.4 not found" id=9d9bb423-e57b-48f7-808f-1b85aa2e10ef name=/runtime.v1alpha2.ImageService/ImageStatus
	Jul 22 11:30:43 old-k8s-version-584140 crio[621]: time="2024-07-22 11:30:43.598674249Z" level=info msg="Checking image status: fake.domain/registry.k8s.io/echoserver:1.4" id=3e011f3e-9449-419c-b8db-0f4882a2c328 name=/runtime.v1alpha2.ImageService/ImageStatus
	Jul 22 11:30:43 old-k8s-version-584140 crio[621]: time="2024-07-22 11:30:43.598913696Z" level=info msg="Image fake.domain/registry.k8s.io/echoserver:1.4 not found" id=3e011f3e-9449-419c-b8db-0f4882a2c328 name=/runtime.v1alpha2.ImageService/ImageStatus
	Jul 22 11:30:55 old-k8s-version-584140 crio[621]: time="2024-07-22 11:30:55.598191432Z" level=info msg="Checking image status: fake.domain/registry.k8s.io/echoserver:1.4" id=625e3bfb-5788-4057-b93e-90b5b658f55f name=/runtime.v1alpha2.ImageService/ImageStatus
	Jul 22 11:30:55 old-k8s-version-584140 crio[621]: time="2024-07-22 11:30:55.598420146Z" level=info msg="Image fake.domain/registry.k8s.io/echoserver:1.4 not found" id=625e3bfb-5788-4057-b93e-90b5b658f55f name=/runtime.v1alpha2.ImageService/ImageStatus
	Jul 22 11:31:08 old-k8s-version-584140 crio[621]: time="2024-07-22 11:31:08.598334176Z" level=info msg="Checking image status: fake.domain/registry.k8s.io/echoserver:1.4" id=447e3e65-299d-4963-80a6-e2bca0b01f10 name=/runtime.v1alpha2.ImageService/ImageStatus
	Jul 22 11:31:08 old-k8s-version-584140 crio[621]: time="2024-07-22 11:31:08.598563637Z" level=info msg="Image fake.domain/registry.k8s.io/echoserver:1.4 not found" id=447e3e65-299d-4963-80a6-e2bca0b01f10 name=/runtime.v1alpha2.ImageService/ImageStatus
	Jul 22 11:31:23 old-k8s-version-584140 crio[621]: time="2024-07-22 11:31:23.598792727Z" level=info msg="Checking image status: fake.domain/registry.k8s.io/echoserver:1.4" id=3db05b77-6625-41e4-bdbc-b48fc516310c name=/runtime.v1alpha2.ImageService/ImageStatus
	Jul 22 11:31:23 old-k8s-version-584140 crio[621]: time="2024-07-22 11:31:23.599029499Z" level=info msg="Image fake.domain/registry.k8s.io/echoserver:1.4 not found" id=3db05b77-6625-41e4-bdbc-b48fc516310c name=/runtime.v1alpha2.ImageService/ImageStatus
	Jul 22 11:31:30 old-k8s-version-584140 crio[621]: time="2024-07-22 11:31:30.564260665Z" level=info msg="Checking image status: k8s.gcr.io/pause:3.2" id=8026ae4e-d7e7-4ec8-ab4a-083b09784ea5 name=/runtime.v1alpha2.ImageService/ImageStatus
	Jul 22 11:31:30 old-k8s-version-584140 crio[621]: time="2024-07-22 11:31:30.564496018Z" level=info msg="Image status: &ImageStatusResponse{Image:&Image{Id:2a060e2e7101d419352bf82c613158587400be743482d9a537ec4a9d1b4eb93c,RepoTags:[k8s.gcr.io/pause:3.2 registry.k8s.io/pause:3.2],RepoDigests:[k8s.gcr.io/pause@sha256:31d3efd12022ffeffb3146bc10ae8beb890c80ed2f07363515580add7ed47636 k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f registry.k8s.io/pause@sha256:31d3efd12022ffeffb3146bc10ae8beb890c80ed2f07363515580add7ed47636 registry.k8s.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f],Size_:489397,Uid:nil,Username:,Spec:nil,},Info:map[string]string{},}" id=8026ae4e-d7e7-4ec8-ab4a-083b09784ea5 name=/runtime.v1alpha2.ImageService/ImageStatus
	Jul 22 11:31:37 old-k8s-version-584140 crio[621]: time="2024-07-22 11:31:37.598326677Z" level=info msg="Checking image status: fake.domain/registry.k8s.io/echoserver:1.4" id=3bbce1c2-2865-453a-94f2-b8545790e8ec name=/runtime.v1alpha2.ImageService/ImageStatus
	Jul 22 11:31:37 old-k8s-version-584140 crio[621]: time="2024-07-22 11:31:37.598563318Z" level=info msg="Image fake.domain/registry.k8s.io/echoserver:1.4 not found" id=3bbce1c2-2865-453a-94f2-b8545790e8ec name=/runtime.v1alpha2.ImageService/ImageStatus
	Jul 22 11:31:52 old-k8s-version-584140 crio[621]: time="2024-07-22 11:31:52.598241090Z" level=info msg="Checking image status: fake.domain/registry.k8s.io/echoserver:1.4" id=a5c3ea2c-70d0-4e27-bb06-933ed5485443 name=/runtime.v1alpha2.ImageService/ImageStatus
	Jul 22 11:31:52 old-k8s-version-584140 crio[621]: time="2024-07-22 11:31:52.598473455Z" level=info msg="Image fake.domain/registry.k8s.io/echoserver:1.4 not found" id=a5c3ea2c-70d0-4e27-bb06-933ed5485443 name=/runtime.v1alpha2.ImageService/ImageStatus
	Jul 22 11:32:07 old-k8s-version-584140 crio[621]: time="2024-07-22 11:32:07.598127506Z" level=info msg="Checking image status: fake.domain/registry.k8s.io/echoserver:1.4" id=47fdcaef-657e-49d1-b46a-059bc236865b name=/runtime.v1alpha2.ImageService/ImageStatus
	Jul 22 11:32:07 old-k8s-version-584140 crio[621]: time="2024-07-22 11:32:07.598359912Z" level=info msg="Image fake.domain/registry.k8s.io/echoserver:1.4 not found" id=47fdcaef-657e-49d1-b46a-059bc236865b name=/runtime.v1alpha2.ImageService/ImageStatus
	Jul 22 11:32:19 old-k8s-version-584140 crio[621]: time="2024-07-22 11:32:19.598229483Z" level=info msg="Checking image status: fake.domain/registry.k8s.io/echoserver:1.4" id=5d0df1f5-ef18-47a4-8513-dbe991cea400 name=/runtime.v1alpha2.ImageService/ImageStatus
	Jul 22 11:32:19 old-k8s-version-584140 crio[621]: time="2024-07-22 11:32:19.598472966Z" level=info msg="Image fake.domain/registry.k8s.io/echoserver:1.4 not found" id=5d0df1f5-ef18-47a4-8513-dbe991cea400 name=/runtime.v1alpha2.ImageService/ImageStatus
	Jul 22 11:32:19 old-k8s-version-584140 crio[621]: time="2024-07-22 11:32:19.599204959Z" level=info msg="Pulling image: fake.domain/registry.k8s.io/echoserver:1.4" id=b9af2326-f093-4591-b5f7-348ddb72a1dd name=/runtime.v1alpha2.ImageService/PullImage
	Jul 22 11:32:19 old-k8s-version-584140 crio[621]: time="2024-07-22 11:32:19.602368407Z" level=info msg="Trying to access \"fake.domain/registry.k8s.io/echoserver:1.4\""
	
	
	==> container status <==
	CONTAINER           IMAGE                                                                                                      CREATED             STATE               NAME                        ATTEMPT             POD ID              POD
	295412dcfe2d0       a90209bb39e3d7b5fc9daf60c17044ea969aaca0333d672d8c7a34c7446e7ff7                                           2 minutes ago       Exited              dashboard-metrics-scraper   5                   ba28f9a9e226b       dashboard-metrics-scraper-8d5bb5db8-4ttjq
	b64b9e0461292       ba04bb24b95753201135cbc420b233c1b0b9fa2e1fd21d28319c348c33fbcde6                                           5 minutes ago       Running             storage-provisioner         1                   d492c2839ec7c       storage-provisioner
	0da5dde31a386       docker.io/kubernetesui/dashboard@sha256:2e500d29e9d5f4a086b908eb8dfe7ecac57d2ab09d65b24f588b1d449841ef93   5 minutes ago       Running             kubernetes-dashboard        0                   da4e69e9d4772       kubernetes-dashboard-cd95d586-pmxh6
	498f3af1ac323       1611cd07b61d57dbbfebe6db242513fd51e1c02d20ba08af17a45837d86a8a8c                                           5 minutes ago       Running             busybox                     0                   4140fdf29c882       busybox
	5191e613fc2d7       25a5233254979d0678a2db1d15b76b73dc380d81bc5eed93916ba5638b3cd894                                           5 minutes ago       Running             kube-proxy                  0                   e0cb503ad3e7d       kube-proxy-xfm5t
	25b426692cff4       db91994f4ee8f894a1e8a6c1a76f615da8fc3c019300a3686291ce6fcbc57895                                           5 minutes ago       Running             coredns                     0                   306a1c03a73f9       coredns-74ff55c5b-t7kln
	48a74507ee5da       ba04bb24b95753201135cbc420b233c1b0b9fa2e1fd21d28319c348c33fbcde6                                           5 minutes ago       Exited              storage-provisioner         0                   d492c2839ec7c       storage-provisioner
	451ceb51fb176       f42786f8afd2214fc59fbf9a26531806f562488d4a7d7a31e8b5e9ff6289b800                                           5 minutes ago       Running             kindnet-cni                 0                   22979cdf3749a       kindnet-bj725
	460bdeec3bdfc       1df8a2b116bd16f7070fd383a6769c8d644b365575e8ffa3e492b84e4f05fc74                                           5 minutes ago       Running             kube-controller-manager     0                   1d81e2979e2dd       kube-controller-manager-old-k8s-version-584140
	7b17da0e203ac       2c08bbbc02d3aa5dfbf4e79f15c0a61424049288917aa10364464ca1f7de7157                                           5 minutes ago       Running             kube-apiserver              0                   f068fc18bd3fd       kube-apiserver-old-k8s-version-584140
	a38f1a7f71672       e7605f88f17d6a4c3f083ef9c6f5f19b39f87e4d4406a05a8612b54a6ea57051                                           5 minutes ago       Running             kube-scheduler              0                   cad7c49ea9136       kube-scheduler-old-k8s-version-584140
	b8f395f6e10ff       05b738aa1bc6355db8a2ee8639f3631b908286e43f584a3d2ee0c472de033c28                                           5 minutes ago       Running             etcd                        0                   be93636e3a2f7       etcd-old-k8s-version-584140
	
	
	==> coredns [25b426692cff4a0ddaac80382d5fd8be373235953b017a1f2591adbc04fe5208] <==
	I0722 11:27:12.036817       1 trace.go:116] Trace[2019727887]: "Reflector ListAndWatch" name:pkg/mod/k8s.io/client-go@v0.18.3/tools/cache/reflector.go:125 (started: 2024-07-22 11:26:42.035688352 +0000 UTC m=+0.037827147) (total time: 30.001014863s):
	Trace[2019727887]: [30.001014863s] [30.001014863s] END
	E0722 11:27:12.036856       1 reflector.go:178] pkg/mod/k8s.io/client-go@v0.18.3/tools/cache/reflector.go:125: Failed to list *v1.Namespace: Get "https://10.96.0.1:443/api/v1/namespaces?limit=500&resourceVersion=0": dial tcp 10.96.0.1:443: i/o timeout
	I0722 11:27:12.036978       1 trace.go:116] Trace[939984059]: "Reflector ListAndWatch" name:pkg/mod/k8s.io/client-go@v0.18.3/tools/cache/reflector.go:125 (started: 2024-07-22 11:26:42.036130744 +0000 UTC m=+0.038269539) (total time: 30.000835362s):
	Trace[939984059]: [30.000835362s] [30.000835362s] END
	E0722 11:27:12.036992       1 reflector.go:178] pkg/mod/k8s.io/client-go@v0.18.3/tools/cache/reflector.go:125: Failed to list *v1.Service: Get "https://10.96.0.1:443/api/v1/services?limit=500&resourceVersion=0": dial tcp 10.96.0.1:443: i/o timeout
	I0722 11:27:12.037054       1 trace.go:116] Trace[911902081]: "Reflector ListAndWatch" name:pkg/mod/k8s.io/client-go@v0.18.3/tools/cache/reflector.go:125 (started: 2024-07-22 11:26:42.036330454 +0000 UTC m=+0.038469240) (total time: 30.000714252s):
	Trace[911902081]: [30.000714252s] [30.000714252s] END
	E0722 11:27:12.037064       1 reflector.go:178] pkg/mod/k8s.io/client-go@v0.18.3/tools/cache/reflector.go:125: Failed to list *v1.Endpoints: Get "https://10.96.0.1:443/api/v1/endpoints?limit=500&resourceVersion=0": dial tcp 10.96.0.1:443: i/o timeout
	.:53
	[INFO] plugin/reload: Running configuration MD5 = b494d968e357ba1b925cee838fbd78ed
	CoreDNS-1.7.0
	linux/arm64, go1.14.4, f59c03d
	[INFO] 127.0.0.1:56865 - 61839 "HINFO IN 3909309752743002820.4240139172506480183. udp 57 false 512" NXDOMAIN qr,rd,ra 57 0.012449009s
	[INFO] SIGTERM: Shutting down servers then terminating
	[INFO] plugin/health: Going into lameduck mode for 5s
	[INFO] plugin/ready: Still waiting on: "kubernetes"
	.:53
	[INFO] plugin/reload: Running configuration MD5 = b494d968e357ba1b925cee838fbd78ed
	CoreDNS-1.7.0
	linux/arm64, go1.14.4, f59c03d
	[INFO] 127.0.0.1:43574 - 516 "HINFO IN 4717583635586907074.1732186825014459720. udp 57 false 512" NXDOMAIN qr,rd,ra 57 0.032421611s
	[INFO] plugin/ready: Still waiting on: "kubernetes"
	[INFO] plugin/ready: Still waiting on: "kubernetes"
	[INFO] plugin/ready: Still waiting on: "kubernetes"
	
	
	==> describe nodes <==
	Name:               old-k8s-version-584140
	Roles:              control-plane,master
	Labels:             beta.kubernetes.io/arch=arm64
	                    beta.kubernetes.io/os=linux
	                    kubernetes.io/arch=arm64
	                    kubernetes.io/hostname=old-k8s-version-584140
	                    kubernetes.io/os=linux
	                    minikube.k8s.io/commit=8e5b1d22910d5d447b525af478862a848159d7b7
	                    minikube.k8s.io/name=old-k8s-version-584140
	                    minikube.k8s.io/primary=true
	                    minikube.k8s.io/updated_at=2024_07_22T11_24_01_0700
	                    minikube.k8s.io/version=v1.33.1
	                    node-role.kubernetes.io/control-plane=
	                    node-role.kubernetes.io/master=
	Annotations:        kubeadm.alpha.kubernetes.io/cri-socket: /var/run/crio/crio.sock
	                    node.alpha.kubernetes.io/ttl: 0
	                    volumes.kubernetes.io/controller-managed-attach-detach: true
	CreationTimestamp:  Mon, 22 Jul 2024 11:23:57 +0000
	Taints:             <none>
	Unschedulable:      false
	Lease:
	  HolderIdentity:  old-k8s-version-584140
	  AcquireTime:     <unset>
	  RenewTime:       Mon, 22 Jul 2024 11:32:22 +0000
	Conditions:
	  Type             Status  LastHeartbeatTime                 LastTransitionTime                Reason                       Message
	  ----             ------  -----------------                 ------------------                ------                       -------
	  MemoryPressure   False   Mon, 22 Jul 2024 11:27:39 +0000   Mon, 22 Jul 2024 11:23:51 +0000   KubeletHasSufficientMemory   kubelet has sufficient memory available
	  DiskPressure     False   Mon, 22 Jul 2024 11:27:39 +0000   Mon, 22 Jul 2024 11:23:51 +0000   KubeletHasNoDiskPressure     kubelet has no disk pressure
	  PIDPressure      False   Mon, 22 Jul 2024 11:27:39 +0000   Mon, 22 Jul 2024 11:23:51 +0000   KubeletHasSufficientPID      kubelet has sufficient PID available
	  Ready            True    Mon, 22 Jul 2024 11:27:39 +0000   Mon, 22 Jul 2024 11:24:39 +0000   KubeletReady                 kubelet is posting ready status
	Addresses:
	  InternalIP:  192.168.76.2
	  Hostname:    old-k8s-version-584140
	Capacity:
	  cpu:                2
	  ephemeral-storage:  203034800Ki
	  hugepages-1Gi:      0
	  hugepages-2Mi:      0
	  hugepages-32Mi:     0
	  hugepages-64Ki:     0
	  memory:             8022360Ki
	  pods:               110
	Allocatable:
	  cpu:                2
	  ephemeral-storage:  203034800Ki
	  hugepages-1Gi:      0
	  hugepages-2Mi:      0
	  hugepages-32Mi:     0
	  hugepages-64Ki:     0
	  memory:             8022360Ki
	  pods:               110
	System Info:
	  Machine ID:                 ff918d69c24a4f2e96124dfffb1c1bf2
	  System UUID:                0db99f0b-924e-49ea-8ac8-9987f942b727
	  Boot ID:                    0ef69867-e3da-4d6a-b5e0-eebac57ce510
	  Kernel Version:             5.15.0-1064-aws
	  OS Image:                   Ubuntu 22.04.4 LTS
	  Operating System:           linux
	  Architecture:               arm64
	  Container Runtime Version:  cri-o://1.24.6
	  Kubelet Version:            v1.20.0
	  Kube-Proxy Version:         v1.20.0
	PodCIDR:                      10.244.0.0/24
	PodCIDRs:                     10.244.0.0/24
	Non-terminated Pods:          (12 in total)
	  Namespace                   Name                                              CPU Requests  CPU Limits  Memory Requests  Memory Limits  AGE
	  ---------                   ----                                              ------------  ----------  ---------------  -------------  ---
	  default                     busybox                                           0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         6m36s
	  kube-system                 coredns-74ff55c5b-t7kln                           100m (5%!)(MISSING)     0 (0%!)(MISSING)      70Mi (0%!)(MISSING)        170Mi (2%!)(MISSING)     8m10s
	  kube-system                 etcd-old-k8s-version-584140                       100m (5%!)(MISSING)     0 (0%!)(MISSING)      100Mi (1%!)(MISSING)       0 (0%!)(MISSING)         8m17s
	  kube-system                 kindnet-bj725                                     100m (5%!)(MISSING)     100m (5%!)(MISSING)   50Mi (0%!)(MISSING)        50Mi (0%!)(MISSING)      8m10s
	  kube-system                 kube-apiserver-old-k8s-version-584140             250m (12%!)(MISSING)    0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         8m17s
	  kube-system                 kube-controller-manager-old-k8s-version-584140    200m (10%!)(MISSING)    0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         8m17s
	  kube-system                 kube-proxy-xfm5t                                  0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         8m10s
	  kube-system                 kube-scheduler-old-k8s-version-584140             100m (5%!)(MISSING)     0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         8m17s
	  kube-system                 metrics-server-9975d5f86-4jcvm                    100m (5%!)(MISSING)     0 (0%!)(MISSING)      200Mi (2%!)(MISSING)       0 (0%!)(MISSING)         6m25s
	  kube-system                 storage-provisioner                               0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         8m8s
	  kubernetes-dashboard        dashboard-metrics-scraper-8d5bb5db8-4ttjq         0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         5m30s
	  kubernetes-dashboard        kubernetes-dashboard-cd95d586-pmxh6               0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         5m30s
	Allocated resources:
	  (Total limits may be over 100 percent, i.e., overcommitted.)
	  Resource           Requests    Limits
	  --------           --------    ------
	  cpu                950m (47%!)(MISSING)  100m (5%!)(MISSING)
	  memory             420Mi (5%!)(MISSING)  220Mi (2%!)(MISSING)
	  ephemeral-storage  100Mi (0%!)(MISSING)  0 (0%!)(MISSING)
	  hugepages-1Gi      0 (0%!)(MISSING)      0 (0%!)(MISSING)
	  hugepages-2Mi      0 (0%!)(MISSING)      0 (0%!)(MISSING)
	  hugepages-32Mi     0 (0%!)(MISSING)      0 (0%!)(MISSING)
	  hugepages-64Ki     0 (0%!)(MISSING)      0 (0%!)(MISSING)
	Events:
	  Type    Reason                   Age                    From        Message
	  ----    ------                   ----                   ----        -------
	  Normal  NodeHasSufficientMemory  8m36s (x5 over 8m36s)  kubelet     Node old-k8s-version-584140 status is now: NodeHasSufficientMemory
	  Normal  NodeHasNoDiskPressure    8m36s (x5 over 8m36s)  kubelet     Node old-k8s-version-584140 status is now: NodeHasNoDiskPressure
	  Normal  NodeHasSufficientPID     8m36s (x4 over 8m36s)  kubelet     Node old-k8s-version-584140 status is now: NodeHasSufficientPID
	  Normal  Starting                 8m17s                  kubelet     Starting kubelet.
	  Normal  NodeHasSufficientMemory  8m17s                  kubelet     Node old-k8s-version-584140 status is now: NodeHasSufficientMemory
	  Normal  NodeHasNoDiskPressure    8m17s                  kubelet     Node old-k8s-version-584140 status is now: NodeHasNoDiskPressure
	  Normal  NodeHasSufficientPID     8m17s                  kubelet     Node old-k8s-version-584140 status is now: NodeHasSufficientPID
	  Normal  Starting                 8m8s                   kube-proxy  Starting kube-proxy.
	  Normal  NodeReady                7m47s                  kubelet     Node old-k8s-version-584140 status is now: NodeReady
	  Normal  Starting                 5m56s                  kubelet     Starting kubelet.
	  Normal  NodeHasSufficientMemory  5m56s (x8 over 5m56s)  kubelet     Node old-k8s-version-584140 status is now: NodeHasSufficientMemory
	  Normal  NodeHasNoDiskPressure    5m56s (x8 over 5m56s)  kubelet     Node old-k8s-version-584140 status is now: NodeHasNoDiskPressure
	  Normal  NodeHasSufficientPID     5m56s (x8 over 5m56s)  kubelet     Node old-k8s-version-584140 status is now: NodeHasSufficientPID
	  Normal  Starting                 5m44s                  kube-proxy  Starting kube-proxy.
	
	
	==> dmesg <==
	[  +0.000708] FS-Cache: O-cookie c=00000006 [p=00000003 fl=226 nc=0 na=1]
	[  +0.000991] FS-Cache: O-cookie d=0000000062e998fb{9p.inode} n=0000000024046ae0
	[  +0.001097] FS-Cache: O-key=[8] '9c5b3b0000000000'
	[  +0.000733] FS-Cache: N-cookie c=0000000d [p=00000003 fl=2 nc=0 na=1]
	[  +0.001003] FS-Cache: N-cookie d=0000000062e998fb{9p.inode} n=0000000009fa42d1
	[  +0.001089] FS-Cache: N-key=[8] '9c5b3b0000000000'
	[  +2.390529] FS-Cache: Duplicate cookie detected
	[  +0.000712] FS-Cache: O-cookie c=00000004 [p=00000003 fl=226 nc=0 na=1]
	[  +0.000976] FS-Cache: O-cookie d=0000000062e998fb{9p.inode} n=00000000f0862bba
	[  +0.001062] FS-Cache: O-key=[8] '9b5b3b0000000000'
	[  +0.000716] FS-Cache: N-cookie c=0000000f [p=00000003 fl=2 nc=0 na=1]
	[  +0.000969] FS-Cache: N-cookie d=0000000062e998fb{9p.inode} n=00000000cce8ae65
	[  +0.001060] FS-Cache: N-key=[8] '9b5b3b0000000000'
	[  +0.246555] FS-Cache: Duplicate cookie detected
	[  +0.000727] FS-Cache: O-cookie c=00000009 [p=00000003 fl=226 nc=0 na=1]
	[  +0.000987] FS-Cache: O-cookie d=0000000062e998fb{9p.inode} n=000000005f76430b
	[  +0.001068] FS-Cache: O-key=[8] 'a35b3b0000000000'
	[  +0.000722] FS-Cache: N-cookie c=00000010 [p=00000003 fl=2 nc=0 na=1]
	[  +0.000979] FS-Cache: N-cookie d=0000000062e998fb{9p.inode} n=000000002c67b7f0
	[  +0.001062] FS-Cache: N-key=[8] 'a35b3b0000000000'
	[Jul22 10:45] kmem.limit_in_bytes is deprecated and will be removed. Please report your usecase to linux-mm@kvack.org if you depend on this functionality.
	[  +3.236788] systemd-journald[222]: Failed to send WATCHDOG=1 notification message: Connection refused
	[Jul22 11:18] overlayfs: '/var/lib/containers/storage/overlay/l/7FOWQIVXOWACA56BLQVF4JJOLY' not a directory
	[  +0.706503] overlayfs: '/var/lib/containers/storage/overlay/l/7FOWQIVXOWACA56BLQVF4JJOLY' not a directory
	[  +0.109197] overlayfs: '/var/lib/containers/storage/overlay/l/7FOWQIVXOWACA56BLQVF4JJOLY' not a directory
	
	
	==> etcd [b8f395f6e10fffc01d9db2971c2690affd63e1173ebe081a173b1df5e29b3eae] <==
	2024-07-22 11:28:25.872228 I | etcdserver/api/etcdhttp: /health OK (status code 200)
	2024-07-22 11:28:35.872192 I | etcdserver/api/etcdhttp: /health OK (status code 200)
	2024-07-22 11:28:45.872314 I | etcdserver/api/etcdhttp: /health OK (status code 200)
	2024-07-22 11:28:55.872303 I | etcdserver/api/etcdhttp: /health OK (status code 200)
	2024-07-22 11:29:05.872310 I | etcdserver/api/etcdhttp: /health OK (status code 200)
	2024-07-22 11:29:15.872283 I | etcdserver/api/etcdhttp: /health OK (status code 200)
	2024-07-22 11:29:25.872331 I | etcdserver/api/etcdhttp: /health OK (status code 200)
	2024-07-22 11:29:35.872291 I | etcdserver/api/etcdhttp: /health OK (status code 200)
	2024-07-22 11:29:45.872307 I | etcdserver/api/etcdhttp: /health OK (status code 200)
	2024-07-22 11:29:55.872199 I | etcdserver/api/etcdhttp: /health OK (status code 200)
	2024-07-22 11:30:05.872306 I | etcdserver/api/etcdhttp: /health OK (status code 200)
	2024-07-22 11:30:15.877526 I | etcdserver/api/etcdhttp: /health OK (status code 200)
	2024-07-22 11:30:25.872229 I | etcdserver/api/etcdhttp: /health OK (status code 200)
	2024-07-22 11:30:35.872495 I | etcdserver/api/etcdhttp: /health OK (status code 200)
	2024-07-22 11:30:45.873009 I | etcdserver/api/etcdhttp: /health OK (status code 200)
	2024-07-22 11:30:55.872301 I | etcdserver/api/etcdhttp: /health OK (status code 200)
	2024-07-22 11:31:05.872503 I | etcdserver/api/etcdhttp: /health OK (status code 200)
	2024-07-22 11:31:15.872316 I | etcdserver/api/etcdhttp: /health OK (status code 200)
	2024-07-22 11:31:25.872290 I | etcdserver/api/etcdhttp: /health OK (status code 200)
	2024-07-22 11:31:35.872279 I | etcdserver/api/etcdhttp: /health OK (status code 200)
	2024-07-22 11:31:45.872418 I | etcdserver/api/etcdhttp: /health OK (status code 200)
	2024-07-22 11:31:55.872317 I | etcdserver/api/etcdhttp: /health OK (status code 200)
	2024-07-22 11:32:05.872215 I | etcdserver/api/etcdhttp: /health OK (status code 200)
	2024-07-22 11:32:15.872211 I | etcdserver/api/etcdhttp: /health OK (status code 200)
	2024-07-22 11:32:25.872941 I | etcdserver/api/etcdhttp: /health OK (status code 200)
	
	
	==> kernel <==
	 11:32:26 up  1:14,  0 users,  load average: 2.57, 2.01, 2.21
	Linux old-k8s-version-584140 5.15.0-1064-aws #70~20.04.1-Ubuntu SMP Thu Jun 27 14:52:48 UTC 2024 aarch64 aarch64 aarch64 GNU/Linux
	PRETTY_NAME="Ubuntu 22.04.4 LTS"
	
	
	==> kindnet [451ceb51fb176f2ab58c30c602fe7a8d8dcdde723f94ec75d058fd599561cfde] <==
	I0722 11:31:21.822935       1 main.go:299] handling current node
	W0722 11:31:26.374547       1 reflector.go:547] pkg/mod/k8s.io/client-go@v0.30.2/tools/cache/reflector.go:232: failed to list *v1.NetworkPolicy: networkpolicies.networking.k8s.io is forbidden: User "system:serviceaccount:kube-system:kindnet" cannot list resource "networkpolicies" in API group "networking.k8s.io" at the cluster scope
	E0722 11:31:26.374602       1 reflector.go:150] pkg/mod/k8s.io/client-go@v0.30.2/tools/cache/reflector.go:232: Failed to watch *v1.NetworkPolicy: failed to list *v1.NetworkPolicy: networkpolicies.networking.k8s.io is forbidden: User "system:serviceaccount:kube-system:kindnet" cannot list resource "networkpolicies" in API group "networking.k8s.io" at the cluster scope
	I0722 11:31:31.822629       1 main.go:295] Handling node with IPs: map[192.168.76.2:{}]
	I0722 11:31:31.822665       1 main.go:299] handling current node
	I0722 11:31:41.822810       1 main.go:295] Handling node with IPs: map[192.168.76.2:{}]
	I0722 11:31:41.822849       1 main.go:299] handling current node
	W0722 11:31:44.005810       1 reflector.go:547] pkg/mod/k8s.io/client-go@v0.30.2/tools/cache/reflector.go:232: failed to list *v1.Pod: pods is forbidden: User "system:serviceaccount:kube-system:kindnet" cannot list resource "pods" in API group "" at the cluster scope
	E0722 11:31:44.005934       1 reflector.go:150] pkg/mod/k8s.io/client-go@v0.30.2/tools/cache/reflector.go:232: Failed to watch *v1.Pod: failed to list *v1.Pod: pods is forbidden: User "system:serviceaccount:kube-system:kindnet" cannot list resource "pods" in API group "" at the cluster scope
	W0722 11:31:49.779981       1 reflector.go:547] pkg/mod/k8s.io/client-go@v0.30.2/tools/cache/reflector.go:232: failed to list *v1.Namespace: namespaces is forbidden: User "system:serviceaccount:kube-system:kindnet" cannot list resource "namespaces" in API group "" at the cluster scope
	E0722 11:31:49.780017       1 reflector.go:150] pkg/mod/k8s.io/client-go@v0.30.2/tools/cache/reflector.go:232: Failed to watch *v1.Namespace: failed to list *v1.Namespace: namespaces is forbidden: User "system:serviceaccount:kube-system:kindnet" cannot list resource "namespaces" in API group "" at the cluster scope
	I0722 11:31:51.822226       1 main.go:295] Handling node with IPs: map[192.168.76.2:{}]
	I0722 11:31:51.822754       1 main.go:299] handling current node
	I0722 11:32:01.824708       1 main.go:295] Handling node with IPs: map[192.168.76.2:{}]
	I0722 11:32:01.824751       1 main.go:299] handling current node
	W0722 11:32:09.369763       1 reflector.go:547] pkg/mod/k8s.io/client-go@v0.30.2/tools/cache/reflector.go:232: failed to list *v1.NetworkPolicy: networkpolicies.networking.k8s.io is forbidden: User "system:serviceaccount:kube-system:kindnet" cannot list resource "networkpolicies" in API group "networking.k8s.io" at the cluster scope
	E0722 11:32:09.369814       1 reflector.go:150] pkg/mod/k8s.io/client-go@v0.30.2/tools/cache/reflector.go:232: Failed to watch *v1.NetworkPolicy: failed to list *v1.NetworkPolicy: networkpolicies.networking.k8s.io is forbidden: User "system:serviceaccount:kube-system:kindnet" cannot list resource "networkpolicies" in API group "networking.k8s.io" at the cluster scope
	I0722 11:32:11.822616       1 main.go:295] Handling node with IPs: map[192.168.76.2:{}]
	I0722 11:32:11.822660       1 main.go:299] handling current node
	W0722 11:32:15.596629       1 reflector.go:547] pkg/mod/k8s.io/client-go@v0.30.2/tools/cache/reflector.go:232: failed to list *v1.Pod: pods is forbidden: User "system:serviceaccount:kube-system:kindnet" cannot list resource "pods" in API group "" at the cluster scope
	E0722 11:32:15.596671       1 reflector.go:150] pkg/mod/k8s.io/client-go@v0.30.2/tools/cache/reflector.go:232: Failed to watch *v1.Pod: failed to list *v1.Pod: pods is forbidden: User "system:serviceaccount:kube-system:kindnet" cannot list resource "pods" in API group "" at the cluster scope
	I0722 11:32:21.821812       1 main.go:295] Handling node with IPs: map[192.168.76.2:{}]
	I0722 11:32:21.821914       1 main.go:299] handling current node
	W0722 11:32:25.478340       1 reflector.go:547] pkg/mod/k8s.io/client-go@v0.30.2/tools/cache/reflector.go:232: failed to list *v1.Namespace: namespaces is forbidden: User "system:serviceaccount:kube-system:kindnet" cannot list resource "namespaces" in API group "" at the cluster scope
	E0722 11:32:25.478375       1 reflector.go:150] pkg/mod/k8s.io/client-go@v0.30.2/tools/cache/reflector.go:232: Failed to watch *v1.Namespace: failed to list *v1.Namespace: namespaces is forbidden: User "system:serviceaccount:kube-system:kindnet" cannot list resource "namespaces" in API group "" at the cluster scope
	
	
	==> kube-apiserver [7b17da0e203acb0f33605e81ab92029743299c8b53e99bedad6247fb2e22336d] <==
	I0722 11:29:10.069803       1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379  <nil> 0 <nil>}] <nil> <nil>}
	I0722 11:29:10.069812       1 clientconn.go:948] ClientConn switching balancer to "pick_first"
	I0722 11:29:40.894072       1 client.go:360] parsed scheme: "passthrough"
	I0722 11:29:40.894225       1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379  <nil> 0 <nil>}] <nil> <nil>}
	I0722 11:29:40.894264       1 clientconn.go:948] ClientConn switching balancer to "pick_first"
	W0722 11:29:41.849740       1 handler_proxy.go:102] no RequestInfo found in the context
	E0722 11:29:41.849908       1 controller.go:116] loading OpenAPI spec for "v1beta1.metrics.k8s.io" failed with: failed to retrieve openAPI spec, http error: ResponseCode: 503, Body: service unavailable
	, Header: map[Content-Type:[text/plain; charset=utf-8] X-Content-Type-Options:[nosniff]]
	I0722 11:29:41.849943       1 controller.go:129] OpenAPI AggregationController: action for item v1beta1.metrics.k8s.io: Rate Limited Requeue.
	I0722 11:30:21.641845       1 client.go:360] parsed scheme: "passthrough"
	I0722 11:30:21.641888       1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379  <nil> 0 <nil>}] <nil> <nil>}
	I0722 11:30:21.641897       1 clientconn.go:948] ClientConn switching balancer to "pick_first"
	I0722 11:31:02.006758       1 client.go:360] parsed scheme: "passthrough"
	I0722 11:31:02.007001       1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379  <nil> 0 <nil>}] <nil> <nil>}
	I0722 11:31:02.007069       1 clientconn.go:948] ClientConn switching balancer to "pick_first"
	I0722 11:31:40.197515       1 client.go:360] parsed scheme: "passthrough"
	I0722 11:31:40.197576       1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379  <nil> 0 <nil>}] <nil> <nil>}
	I0722 11:31:40.197587       1 clientconn.go:948] ClientConn switching balancer to "pick_first"
	W0722 11:31:40.255389       1 handler_proxy.go:102] no RequestInfo found in the context
	E0722 11:31:40.255465       1 controller.go:116] loading OpenAPI spec for "v1beta1.metrics.k8s.io" failed with: failed to retrieve openAPI spec, http error: ResponseCode: 503, Body: service unavailable
	, Header: map[Content-Type:[text/plain; charset=utf-8] X-Content-Type-Options:[nosniff]]
	I0722 11:31:40.255473       1 controller.go:129] OpenAPI AggregationController: action for item v1beta1.metrics.k8s.io: Rate Limited Requeue.
	I0722 11:32:16.991550       1 client.go:360] parsed scheme: "passthrough"
	I0722 11:32:16.991684       1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379  <nil> 0 <nil>}] <nil> <nil>}
	I0722 11:32:16.991735       1 clientconn.go:948] ClientConn switching balancer to "pick_first"
	
	
	==> kube-controller-manager [460bdeec3bdfccab7101c9d13045f9bcf87734da1fb0f6f8b6a5c0111906ac43] <==
	W0722 11:28:02.325421       1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
	E0722 11:28:28.273298       1 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
	I0722 11:28:33.975821       1 request.go:655] Throttling request took 1.048431646s, request: GET:https://192.168.76.2:8443/apis/autoscaling/v1?timeout=32s
	W0722 11:28:34.827358       1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
	E0722 11:28:58.775222       1 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
	I0722 11:29:06.477800       1 request.go:655] Throttling request took 1.048497351s, request: GET:https://192.168.76.2:8443/apis/extensions/v1beta1?timeout=32s
	W0722 11:29:07.329465       1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
	E0722 11:29:29.277258       1 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
	I0722 11:29:38.979870       1 request.go:655] Throttling request took 1.048519224s, request: GET:https://192.168.76.2:8443/apis/scheduling.k8s.io/v1?timeout=32s
	W0722 11:29:39.831297       1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
	E0722 11:29:59.779139       1 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
	I0722 11:30:11.481691       1 request.go:655] Throttling request took 1.048328281s, request: GET:https://192.168.76.2:8443/apis/extensions/v1beta1?timeout=32s
	W0722 11:30:12.333476       1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
	E0722 11:30:30.281136       1 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
	I0722 11:30:43.983890       1 request.go:655] Throttling request took 1.048196851s, request: GET:https://192.168.76.2:8443/apis/extensions/v1beta1?timeout=32s
	W0722 11:30:44.837265       1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
	E0722 11:31:00.793317       1 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
	I0722 11:31:16.487632       1 request.go:655] Throttling request took 1.048367744s, request: GET:https://192.168.76.2:8443/apis/extensions/v1beta1?timeout=32s
	W0722 11:31:17.339497       1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
	E0722 11:31:31.295232       1 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
	I0722 11:31:48.989894       1 request.go:655] Throttling request took 1.048218142s, request: GET:https://192.168.76.2:8443/apis/extensions/v1beta1?timeout=32s
	W0722 11:31:49.843547       1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
	E0722 11:32:01.802411       1 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
	I0722 11:32:21.495116       1 request.go:655] Throttling request took 1.048595557s, request: GET:https://192.168.76.2:8443/apis/admissionregistration.k8s.io/v1beta1?timeout=32s
	W0722 11:32:22.346704       1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
	
	
	==> kube-proxy [5191e613fc2d72706f1d776fe8a845ca8f4b3cec7ff3b0f9d18aee199e8d79c6] <==
	I0722 11:24:18.285617       1 node.go:172] Successfully retrieved node IP: 192.168.76.2
	I0722 11:24:18.285956       1 server_others.go:142] kube-proxy node IP is an IPv4 address (192.168.76.2), assume IPv4 operation
	W0722 11:24:18.343605       1 server_others.go:578] Unknown proxy mode "", assuming iptables proxy
	I0722 11:24:18.343818       1 server_others.go:185] Using iptables Proxier.
	I0722 11:24:18.344287       1 server.go:650] Version: v1.20.0
	I0722 11:24:18.346216       1 config.go:315] Starting service config controller
	I0722 11:24:18.346417       1 shared_informer.go:240] Waiting for caches to sync for service config
	I0722 11:24:18.348997       1 config.go:224] Starting endpoint slice config controller
	I0722 11:24:18.350852       1 shared_informer.go:240] Waiting for caches to sync for endpoint slice config
	I0722 11:24:18.540330       1 shared_informer.go:247] Caches are synced for endpoint slice config 
	I0722 11:24:18.540523       1 shared_informer.go:247] Caches are synced for service config 
	I0722 11:26:42.107881       1 node.go:172] Successfully retrieved node IP: 192.168.76.2
	I0722 11:26:42.107968       1 server_others.go:142] kube-proxy node IP is an IPv4 address (192.168.76.2), assume IPv4 operation
	W0722 11:26:42.120546       1 server_others.go:578] Unknown proxy mode "", assuming iptables proxy
	I0722 11:26:42.120661       1 server_others.go:185] Using iptables Proxier.
	I0722 11:26:42.120964       1 server.go:650] Version: v1.20.0
	I0722 11:26:42.121632       1 config.go:315] Starting service config controller
	I0722 11:26:42.121650       1 shared_informer.go:240] Waiting for caches to sync for service config
	I0722 11:26:42.121671       1 config.go:224] Starting endpoint slice config controller
	I0722 11:26:42.121675       1 shared_informer.go:240] Waiting for caches to sync for endpoint slice config
	I0722 11:26:42.221789       1 shared_informer.go:247] Caches are synced for endpoint slice config 
	I0722 11:26:42.221790       1 shared_informer.go:247] Caches are synced for service config 
	
	
	==> kube-scheduler [a38f1a7f716723ae1738fc6d121fd5959ee9c40c5b1c46b537955d760c9f4290] <==
	I0722 11:23:57.848563       1 tlsconfig.go:240] Starting DynamicServingCertificateController
	E0722 11:23:57.849879       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.PersistentVolumeClaim: failed to list *v1.PersistentVolumeClaim: persistentvolumeclaims is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumeclaims" in API group "" at the cluster scope
	E0722 11:23:57.854085       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.CSINode: failed to list *v1.CSINode: csinodes.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csinodes" in API group "storage.k8s.io" at the cluster scope
	E0722 11:23:57.854280       1 reflector.go:138] k8s.io/apiserver/pkg/server/dynamiccertificates/configmap_cafile_content.go:206: Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot list resource "configmaps" in API group "" in the namespace "kube-system"
	E0722 11:23:57.854371       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.PersistentVolume: failed to list *v1.PersistentVolume: persistentvolumes is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumes" in API group "" at the cluster scope
	E0722 11:23:57.856556       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.StatefulSet: failed to list *v1.StatefulSet: statefulsets.apps is forbidden: User "system:kube-scheduler" cannot list resource "statefulsets" in API group "apps" at the cluster scope
	E0722 11:23:57.856857       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.StorageClass: failed to list *v1.StorageClass: storageclasses.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "storageclasses" in API group "storage.k8s.io" at the cluster scope
	E0722 11:23:57.857005       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1beta1.PodDisruptionBudget: failed to list *v1beta1.PodDisruptionBudget: poddisruptionbudgets.policy is forbidden: User "system:kube-scheduler" cannot list resource "poddisruptionbudgets" in API group "policy" at the cluster scope
	E0722 11:23:57.857074       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.ReplicationController: failed to list *v1.ReplicationController: replicationcontrollers is forbidden: User "system:kube-scheduler" cannot list resource "replicationcontrollers" in API group "" at the cluster scope
	E0722 11:23:57.857143       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.ReplicaSet: failed to list *v1.ReplicaSet: replicasets.apps is forbidden: User "system:kube-scheduler" cannot list resource "replicasets" in API group "apps" at the cluster scope
	E0722 11:23:57.857203       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Pod: failed to list *v1.Pod: pods is forbidden: User "system:kube-scheduler" cannot list resource "pods" in API group "" at the cluster scope
	E0722 11:23:57.857258       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Service: failed to list *v1.Service: services is forbidden: User "system:kube-scheduler" cannot list resource "services" in API group "" at the cluster scope
	E0722 11:23:57.860089       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Node: failed to list *v1.Node: nodes is forbidden: User "system:kube-scheduler" cannot list resource "nodes" in API group "" at the cluster scope
	E0722 11:23:58.684148       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.PersistentVolume: failed to list *v1.PersistentVolume: persistentvolumes is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumes" in API group "" at the cluster scope
	I0722 11:23:59.349144       1 shared_informer.go:247] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file 
	I0722 11:26:33.596096       1 serving.go:331] Generated self-signed cert in-memory
	W0722 11:26:39.008349       1 requestheader_controller.go:193] Unable to get configmap/extension-apiserver-authentication in kube-system.  Usually fixed by 'kubectl create rolebinding -n kube-system ROLEBINDING_NAME --role=extension-apiserver-authentication-reader --serviceaccount=YOUR_NS:YOUR_SA'
	W0722 11:26:39.008583       1 authentication.go:332] Error looking up in-cluster authentication configuration: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot get resource "configmaps" in API group "" in the namespace "kube-system"
	W0722 11:26:39.008600       1 authentication.go:333] Continuing without authentication configuration. This may treat all requests as anonymous.
	W0722 11:26:39.008608       1 authentication.go:334] To require authentication configuration lookup to succeed, set --authentication-tolerate-lookup-failure=false
	I0722 11:26:39.257007       1 secure_serving.go:197] Serving securely on 127.0.0.1:10259
	I0722 11:26:39.258098       1 configmap_cafile_content.go:202] Starting client-ca::kube-system::extension-apiserver-authentication::client-ca-file
	I0722 11:26:39.258173       1 shared_informer.go:240] Waiting for caches to sync for client-ca::kube-system::extension-apiserver-authentication::client-ca-file
	I0722 11:26:39.261394       1 tlsconfig.go:240] Starting DynamicServingCertificateController
	I0722 11:26:39.562404       1 shared_informer.go:247] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file 
	
	
	==> kubelet <==
	Jul 22 11:30:55 old-k8s-version-584140 kubelet[730]: E0722 11:30:55.599111     730 pod_workers.go:191] Error syncing pod 5a4606c4-b596-44df-a930-60179facf4e9 ("metrics-server-9975d5f86-4jcvm_kube-system(5a4606c4-b596-44df-a930-60179facf4e9)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	Jul 22 11:30:58 old-k8s-version-584140 kubelet[730]: I0722 11:30:58.597918     730 scope.go:95] [topologymanager] RemoveContainer - Container ID: 295412dcfe2d0314a43f65a22d5205a0c0415f89404e85fe2dafdbe709fd4d41
	Jul 22 11:30:58 old-k8s-version-584140 kubelet[730]: E0722 11:30:58.598266     730 pod_workers.go:191] Error syncing pod b728f80c-1116-4ef9-b36b-6d05d11b72a1 ("dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"
	Jul 22 11:31:08 old-k8s-version-584140 kubelet[730]: E0722 11:31:08.598772     730 pod_workers.go:191] Error syncing pod 5a4606c4-b596-44df-a930-60179facf4e9 ("metrics-server-9975d5f86-4jcvm_kube-system(5a4606c4-b596-44df-a930-60179facf4e9)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	Jul 22 11:31:12 old-k8s-version-584140 kubelet[730]: I0722 11:31:12.597891     730 scope.go:95] [topologymanager] RemoveContainer - Container ID: 295412dcfe2d0314a43f65a22d5205a0c0415f89404e85fe2dafdbe709fd4d41
	Jul 22 11:31:12 old-k8s-version-584140 kubelet[730]: E0722 11:31:12.598216     730 pod_workers.go:191] Error syncing pod b728f80c-1116-4ef9-b36b-6d05d11b72a1 ("dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"
	Jul 22 11:31:23 old-k8s-version-584140 kubelet[730]: I0722 11:31:23.597826     730 scope.go:95] [topologymanager] RemoveContainer - Container ID: 295412dcfe2d0314a43f65a22d5205a0c0415f89404e85fe2dafdbe709fd4d41
	Jul 22 11:31:23 old-k8s-version-584140 kubelet[730]: E0722 11:31:23.598165     730 pod_workers.go:191] Error syncing pod b728f80c-1116-4ef9-b36b-6d05d11b72a1 ("dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"
	Jul 22 11:31:23 old-k8s-version-584140 kubelet[730]: E0722 11:31:23.599281     730 pod_workers.go:191] Error syncing pod 5a4606c4-b596-44df-a930-60179facf4e9 ("metrics-server-9975d5f86-4jcvm_kube-system(5a4606c4-b596-44df-a930-60179facf4e9)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	Jul 22 11:31:30 old-k8s-version-584140 kubelet[730]: E0722 11:31:30.568933     730 container_manager_linux.go:533] failed to find cgroups of kubelet - cpu and memory cgroup hierarchy not unified.  cpu: /docker/9a47d5204824dea9de7e428feb7e5cba07dfecea49620ebac54e1ddc8586aed6, memory: /docker/9a47d5204824dea9de7e428feb7e5cba07dfecea49620ebac54e1ddc8586aed6/system.slice/kubelet.service
	Jul 22 11:31:36 old-k8s-version-584140 kubelet[730]: I0722 11:31:36.597896     730 scope.go:95] [topologymanager] RemoveContainer - Container ID: 295412dcfe2d0314a43f65a22d5205a0c0415f89404e85fe2dafdbe709fd4d41
	Jul 22 11:31:36 old-k8s-version-584140 kubelet[730]: E0722 11:31:36.598285     730 pod_workers.go:191] Error syncing pod b728f80c-1116-4ef9-b36b-6d05d11b72a1 ("dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"
	Jul 22 11:31:37 old-k8s-version-584140 kubelet[730]: E0722 11:31:37.598777     730 pod_workers.go:191] Error syncing pod 5a4606c4-b596-44df-a930-60179facf4e9 ("metrics-server-9975d5f86-4jcvm_kube-system(5a4606c4-b596-44df-a930-60179facf4e9)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	Jul 22 11:31:50 old-k8s-version-584140 kubelet[730]: I0722 11:31:50.598228     730 scope.go:95] [topologymanager] RemoveContainer - Container ID: 295412dcfe2d0314a43f65a22d5205a0c0415f89404e85fe2dafdbe709fd4d41
	Jul 22 11:31:50 old-k8s-version-584140 kubelet[730]: E0722 11:31:50.598548     730 pod_workers.go:191] Error syncing pod b728f80c-1116-4ef9-b36b-6d05d11b72a1 ("dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"
	Jul 22 11:31:52 old-k8s-version-584140 kubelet[730]: E0722 11:31:52.598992     730 pod_workers.go:191] Error syncing pod 5a4606c4-b596-44df-a930-60179facf4e9 ("metrics-server-9975d5f86-4jcvm_kube-system(5a4606c4-b596-44df-a930-60179facf4e9)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	Jul 22 11:32:04 old-k8s-version-584140 kubelet[730]: I0722 11:32:04.597985     730 scope.go:95] [topologymanager] RemoveContainer - Container ID: 295412dcfe2d0314a43f65a22d5205a0c0415f89404e85fe2dafdbe709fd4d41
	Jul 22 11:32:04 old-k8s-version-584140 kubelet[730]: E0722 11:32:04.598313     730 pod_workers.go:191] Error syncing pod b728f80c-1116-4ef9-b36b-6d05d11b72a1 ("dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"
	Jul 22 11:32:07 old-k8s-version-584140 kubelet[730]: E0722 11:32:07.598569     730 pod_workers.go:191] Error syncing pod 5a4606c4-b596-44df-a930-60179facf4e9 ("metrics-server-9975d5f86-4jcvm_kube-system(5a4606c4-b596-44df-a930-60179facf4e9)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	Jul 22 11:32:18 old-k8s-version-584140 kubelet[730]: I0722 11:32:18.597895     730 scope.go:95] [topologymanager] RemoveContainer - Container ID: 295412dcfe2d0314a43f65a22d5205a0c0415f89404e85fe2dafdbe709fd4d41
	Jul 22 11:32:18 old-k8s-version-584140 kubelet[730]: E0722 11:32:18.598235     730 pod_workers.go:191] Error syncing pod b728f80c-1116-4ef9-b36b-6d05d11b72a1 ("dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"
	Jul 22 11:32:19 old-k8s-version-584140 kubelet[730]: E0722 11:32:19.609262     730 remote_image.go:113] PullImage "fake.domain/registry.k8s.io/echoserver:1.4" from image service failed: rpc error: code = Unknown desc = pinging container registry fake.domain: Get "https://fake.domain/v2/": dial tcp: lookup fake.domain: no such host
	Jul 22 11:32:19 old-k8s-version-584140 kubelet[730]: E0722 11:32:19.609321     730 kuberuntime_image.go:51] Pull image "fake.domain/registry.k8s.io/echoserver:1.4" failed: rpc error: code = Unknown desc = pinging container registry fake.domain: Get "https://fake.domain/v2/": dial tcp: lookup fake.domain: no such host
	Jul 22 11:32:19 old-k8s-version-584140 kubelet[730]: E0722 11:32:19.609475     730 kuberuntime_manager.go:829] container &Container{Name:metrics-server,Image:fake.domain/registry.k8s.io/echoserver:1.4,Command:[],Args:[--cert-dir=/tmp --secure-port=4443 --kubelet-preferred-address-types=InternalIP,ExternalIP,Hostname --kubelet-use-node-status-port --metric-resolution=60s --kubelet-insecure-tls],WorkingDir:,Ports:[]ContainerPort{ContainerPort{Name:https,HostPort:0,ContainerPort:4443,Protocol:TCP,HostIP:,},},Env:[]EnvVar{},Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{cpu: {{100 -3} {<nil>} 100m DecimalSI},memory: {{209715200 0} {<nil>}  BinarySI},},},VolumeMounts:[]VolumeMount{VolumeMount{Name:tmp-dir,ReadOnly:false,MountPath:/tmp,SubPath:,MountPropagation:nil,SubPathExpr:,},VolumeMount{Name:metrics-server-token-btvqb,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,},},LivenessProbe:&Probe{Handler:Handler{Exec
:nil,HTTPGet:&HTTPGetAction{Path:/livez,Port:{1 0 https},Host:,Scheme:HTTPS,HTTPHeaders:[]HTTPHeader{},},TCPSocket:nil,},InitialDelaySeconds:0,TimeoutSeconds:1,PeriodSeconds:10,SuccessThreshold:1,FailureThreshold:3,},ReadinessProbe:&Probe{Handler:Handler{Exec:nil,HTTPGet:&HTTPGetAction{Path:/readyz,Port:{1 0 https},Host:,Scheme:HTTPS,HTTPHeaders:[]HTTPHeader{},},TCPSocket:nil,},InitialDelaySeconds:0,TimeoutSeconds:1,PeriodSeconds:10,SuccessThreshold:1,FailureThreshold:3,},Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:IfNotPresent,SecurityContext:&SecurityContext{Capabilities:nil,Privileged:nil,SELinuxOptions:nil,RunAsUser:*1000,RunAsNonRoot:*true,ReadOnlyRootFilesystem:*true,AllowPrivilegeEscalation:nil,RunAsGroup:nil,ProcMount:nil,WindowsOptions:nil,SeccompProfile:nil,},Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:File,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,} start failed in pod metrics-server-9975d5f86-4jcvm_kube-system(5a4606c
4-b596-44df-a930-60179facf4e9): ErrImagePull: rpc error: code = Unknown desc = pinging container registry fake.domain: Get "https://fake.domain/v2/": dial tcp: lookup fake.domain: no such host
	Jul 22 11:32:19 old-k8s-version-584140 kubelet[730]: E0722 11:32:19.609505     730 pod_workers.go:191] Error syncing pod 5a4606c4-b596-44df-a930-60179facf4e9 ("metrics-server-9975d5f86-4jcvm_kube-system(5a4606c4-b596-44df-a930-60179facf4e9)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = pinging container registry fake.domain: Get \"https://fake.domain/v2/\": dial tcp: lookup fake.domain: no such host"
	
	
	==> kubernetes-dashboard [0da5dde31a386001ac351514fcd5b733872eb5d92ec8b3579e32b0f14de7b1fc] <==
	2024/07/22 11:27:06 Using namespace: kubernetes-dashboard
	2024/07/22 11:27:06 Using in-cluster config to connect to apiserver
	2024/07/22 11:27:06 Using secret token for csrf signing
	2024/07/22 11:27:06 Initializing csrf token from kubernetes-dashboard-csrf secret
	2024/07/22 11:27:06 Empty token. Generating and storing in a secret kubernetes-dashboard-csrf
	2024/07/22 11:27:06 Successful initial request to the apiserver, version: v1.20.0
	2024/07/22 11:27:06 Generating JWE encryption key
	2024/07/22 11:27:06 New synchronizer has been registered: kubernetes-dashboard-key-holder-kubernetes-dashboard. Starting
	2024/07/22 11:27:06 Starting secret synchronizer for kubernetes-dashboard-key-holder in namespace kubernetes-dashboard
	2024/07/22 11:27:07 Initializing JWE encryption key from synchronized object
	2024/07/22 11:27:07 Creating in-cluster Sidecar client
	2024/07/22 11:27:07 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
	2024/07/22 11:27:07 Serving insecurely on HTTP port: 9090
	2024/07/22 11:27:37 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
	2024/07/22 11:28:07 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
	2024/07/22 11:28:37 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
	2024/07/22 11:29:07 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
	2024/07/22 11:29:37 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
	2024/07/22 11:30:07 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
	2024/07/22 11:30:37 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
	2024/07/22 11:31:07 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
	2024/07/22 11:31:37 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
	2024/07/22 11:32:07 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
	2024/07/22 11:27:06 Starting overwatch
	
	
	==> storage-provisioner [48a74507ee5da0b4b62d92cb8fe64853426c4fcd088c4d455c7d827c4c514ab2] <==
	I0722 11:24:44.697836       1 storage_provisioner.go:116] Initializing the minikube storage provisioner...
	I0722 11:24:44.827232       1 storage_provisioner.go:141] Storage provisioner initialized, now starting service!
	I0722 11:24:44.827351       1 leaderelection.go:243] attempting to acquire leader lease kube-system/k8s.io-minikube-hostpath...
	I0722 11:24:44.889504       1 leaderelection.go:253] successfully acquired lease kube-system/k8s.io-minikube-hostpath
	I0722 11:24:44.889964       1 event.go:282] Event(v1.ObjectReference{Kind:"Endpoints", Namespace:"kube-system", Name:"k8s.io-minikube-hostpath", UID:"8378c591-9d5a-428f-8e2c-0723ef4a23b8", APIVersion:"v1", ResourceVersion:"487", FieldPath:""}): type: 'Normal' reason: 'LeaderElection' old-k8s-version-584140_51c7adf2-2a98-4bc0-a750-3dc81dfa034e became leader
	I0722 11:24:44.890073       1 controller.go:835] Starting provisioner controller k8s.io/minikube-hostpath_old-k8s-version-584140_51c7adf2-2a98-4bc0-a750-3dc81dfa034e!
	I0722 11:24:44.990213       1 controller.go:884] Started provisioner controller k8s.io/minikube-hostpath_old-k8s-version-584140_51c7adf2-2a98-4bc0-a750-3dc81dfa034e!
	I0722 11:26:41.413927       1 storage_provisioner.go:116] Initializing the minikube storage provisioner...
	F0722 11:27:11.416249       1 main.go:39] error getting server version: Get "https://10.96.0.1:443/version?timeout=32s": dial tcp 10.96.0.1:443: i/o timeout
	
	
	==> storage-provisioner [b64b9e0461292d72b7fc112215c86b2db789ed69b01b10063e3b4f24a2155a8a] <==
	I0722 11:27:11.877737       1 storage_provisioner.go:116] Initializing the minikube storage provisioner...
	I0722 11:27:11.899766       1 storage_provisioner.go:141] Storage provisioner initialized, now starting service!
	I0722 11:27:11.899903       1 leaderelection.go:243] attempting to acquire leader lease kube-system/k8s.io-minikube-hostpath...
	I0722 11:27:29.328780       1 leaderelection.go:253] successfully acquired lease kube-system/k8s.io-minikube-hostpath
	I0722 11:27:29.329039       1 controller.go:835] Starting provisioner controller k8s.io/minikube-hostpath_old-k8s-version-584140_3d7a0f6b-1d10-4604-858e-065de689c7bb!
	I0722 11:27:29.329658       1 event.go:282] Event(v1.ObjectReference{Kind:"Endpoints", Namespace:"kube-system", Name:"k8s.io-minikube-hostpath", UID:"8378c591-9d5a-428f-8e2c-0723ef4a23b8", APIVersion:"v1", ResourceVersion:"814", FieldPath:""}): type: 'Normal' reason: 'LeaderElection' old-k8s-version-584140_3d7a0f6b-1d10-4604-858e-065de689c7bb became leader
	I0722 11:27:29.430096       1 controller.go:884] Started provisioner controller k8s.io/minikube-hostpath_old-k8s-version-584140_3d7a0f6b-1d10-4604-858e-065de689c7bb!
	

                                                
                                                
-- /stdout --
helpers_test.go:254: (dbg) Run:  out/minikube-linux-arm64 status --format={{.APIServer}} -p old-k8s-version-584140 -n old-k8s-version-584140
helpers_test.go:261: (dbg) Run:  kubectl --context old-k8s-version-584140 get po -o=jsonpath={.items[*].metadata.name} -A --field-selector=status.phase!=Running
helpers_test.go:272: non-running pods: metrics-server-9975d5f86-4jcvm
helpers_test.go:274: ======> post-mortem[TestStartStop/group/old-k8s-version/serial/SecondStart]: describe non-running pods <======
helpers_test.go:277: (dbg) Run:  kubectl --context old-k8s-version-584140 describe pod metrics-server-9975d5f86-4jcvm
helpers_test.go:277: (dbg) Non-zero exit: kubectl --context old-k8s-version-584140 describe pod metrics-server-9975d5f86-4jcvm: exit status 1 (114.611441ms)

                                                
                                                
** stderr ** 
	Error from server (NotFound): pods "metrics-server-9975d5f86-4jcvm" not found

                                                
                                                
** /stderr **
helpers_test.go:279: kubectl --context old-k8s-version-584140 describe pod metrics-server-9975d5f86-4jcvm: exit status 1
--- FAIL: TestStartStop/group/old-k8s-version/serial/SecondStart (374.83s)

                                                
                                    

Test pass (300/336)

Order passed test Duration
3 TestDownloadOnly/v1.20.0/json-events 12.65
4 TestDownloadOnly/v1.20.0/preload-exists 0
8 TestDownloadOnly/v1.20.0/LogsDuration 0.38
9 TestDownloadOnly/v1.20.0/DeleteAll 0.26
10 TestDownloadOnly/v1.20.0/DeleteAlwaysSucceeds 0.18
12 TestDownloadOnly/v1.30.3/json-events 6.13
13 TestDownloadOnly/v1.30.3/preload-exists 0
17 TestDownloadOnly/v1.30.3/LogsDuration 0.07
18 TestDownloadOnly/v1.30.3/DeleteAll 0.2
19 TestDownloadOnly/v1.30.3/DeleteAlwaysSucceeds 0.12
21 TestDownloadOnly/v1.31.0-beta.0/json-events 13.47
22 TestDownloadOnly/v1.31.0-beta.0/preload-exists 0
26 TestDownloadOnly/v1.31.0-beta.0/LogsDuration 0.07
27 TestDownloadOnly/v1.31.0-beta.0/DeleteAll 0.2
28 TestDownloadOnly/v1.31.0-beta.0/DeleteAlwaysSucceeds 0.13
30 TestBinaryMirror 0.54
34 TestAddons/PreSetup/EnablingAddonOnNonExistingCluster 0.07
35 TestAddons/PreSetup/DisablingAddonOnNonExistingCluster 0.08
36 TestAddons/Setup 183.8
38 TestAddons/parallel/Registry 15.69
40 TestAddons/parallel/InspektorGadget 11.76
44 TestAddons/parallel/CSI 48.93
45 TestAddons/parallel/Headlamp 11.97
46 TestAddons/parallel/CloudSpanner 6.56
47 TestAddons/parallel/LocalPath 52.42
48 TestAddons/parallel/NvidiaDevicePlugin 6.64
49 TestAddons/parallel/Yakd 5.01
53 TestAddons/serial/GCPAuth/Namespaces 0.18
54 TestAddons/StoppedEnableDisable 12.14
55 TestCertOptions 37.54
56 TestCertExpiration 240.64
58 TestForceSystemdFlag 33.83
59 TestForceSystemdEnv 39.33
65 TestErrorSpam/setup 31.89
66 TestErrorSpam/start 0.66
67 TestErrorSpam/status 0.98
68 TestErrorSpam/pause 1.66
69 TestErrorSpam/unpause 1.69
70 TestErrorSpam/stop 1.42
73 TestFunctional/serial/CopySyncFile 0
74 TestFunctional/serial/StartWithProxy 58.89
75 TestFunctional/serial/AuditLog 0
76 TestFunctional/serial/SoftStart 30.22
77 TestFunctional/serial/KubeContext 0.07
78 TestFunctional/serial/KubectlGetPods 0.11
81 TestFunctional/serial/CacheCmd/cache/add_remote 3.79
82 TestFunctional/serial/CacheCmd/cache/add_local 0.94
83 TestFunctional/serial/CacheCmd/cache/CacheDelete 0.05
84 TestFunctional/serial/CacheCmd/cache/list 0.06
85 TestFunctional/serial/CacheCmd/cache/verify_cache_inside_node 0.3
86 TestFunctional/serial/CacheCmd/cache/cache_reload 1.79
87 TestFunctional/serial/CacheCmd/cache/delete 0.11
88 TestFunctional/serial/MinikubeKubectlCmd 0.14
89 TestFunctional/serial/MinikubeKubectlCmdDirectly 0.14
90 TestFunctional/serial/ExtraConfig 29.89
91 TestFunctional/serial/ComponentHealth 0.1
92 TestFunctional/serial/LogsCmd 1.79
93 TestFunctional/serial/LogsFileCmd 1.7
94 TestFunctional/serial/InvalidService 4.82
96 TestFunctional/parallel/ConfigCmd 0.46
97 TestFunctional/parallel/DashboardCmd 9.62
98 TestFunctional/parallel/DryRun 0.41
99 TestFunctional/parallel/InternationalLanguage 0.17
100 TestFunctional/parallel/StatusCmd 0.99
104 TestFunctional/parallel/ServiceCmdConnect 7.66
105 TestFunctional/parallel/AddonsCmd 0.15
106 TestFunctional/parallel/PersistentVolumeClaim 24.74
108 TestFunctional/parallel/SSHCmd 0.53
109 TestFunctional/parallel/CpCmd 1.93
111 TestFunctional/parallel/FileSync 0.31
112 TestFunctional/parallel/CertSync 2.08
116 TestFunctional/parallel/NodeLabels 0.08
118 TestFunctional/parallel/NonActiveRuntimeDisabled 0.67
120 TestFunctional/parallel/License 0.34
121 TestFunctional/parallel/Version/short 0.09
122 TestFunctional/parallel/Version/components 1.13
123 TestFunctional/parallel/ImageCommands/ImageListShort 0.24
124 TestFunctional/parallel/ImageCommands/ImageListTable 0.22
125 TestFunctional/parallel/ImageCommands/ImageListJson 0.24
126 TestFunctional/parallel/ImageCommands/ImageListYaml 0.23
127 TestFunctional/parallel/ImageCommands/ImageBuild 4.83
128 TestFunctional/parallel/ImageCommands/Setup 0.74
129 TestFunctional/parallel/UpdateContextCmd/no_changes 0.23
130 TestFunctional/parallel/UpdateContextCmd/no_minikube_cluster 0.19
131 TestFunctional/parallel/UpdateContextCmd/no_clusters 0.23
132 TestFunctional/parallel/ImageCommands/ImageLoadDaemon 1.45
133 TestFunctional/parallel/ImageCommands/ImageReloadDaemon 1.13
134 TestFunctional/parallel/ServiceCmd/DeployApp 11.27
135 TestFunctional/parallel/ImageCommands/ImageTagAndLoadDaemon 1.34
136 TestFunctional/parallel/ImageCommands/ImageSaveToFile 2.3
137 TestFunctional/parallel/ImageCommands/ImageRemove 0.45
138 TestFunctional/parallel/ImageCommands/ImageLoadFromFile 0.79
139 TestFunctional/parallel/ImageCommands/ImageSaveDaemon 0.56
141 TestFunctional/parallel/TunnelCmd/serial/RunSecondTunnel 0.49
142 TestFunctional/parallel/TunnelCmd/serial/StartTunnel 0
144 TestFunctional/parallel/TunnelCmd/serial/WaitService/Setup 8.32
145 TestFunctional/parallel/ServiceCmd/List 0.37
146 TestFunctional/parallel/ServiceCmd/JSONOutput 0.33
147 TestFunctional/parallel/ServiceCmd/HTTPS 0.39
148 TestFunctional/parallel/ServiceCmd/Format 0.35
149 TestFunctional/parallel/ServiceCmd/URL 0.35
150 TestFunctional/parallel/TunnelCmd/serial/WaitService/IngressIP 0.08
151 TestFunctional/parallel/TunnelCmd/serial/AccessDirect 0
155 TestFunctional/parallel/TunnelCmd/serial/DeleteTunnel 0.11
156 TestFunctional/parallel/ProfileCmd/profile_not_create 0.38
157 TestFunctional/parallel/ProfileCmd/profile_list 0.39
158 TestFunctional/parallel/ProfileCmd/profile_json_output 0.38
159 TestFunctional/parallel/MountCmd/any-port 6.81
160 TestFunctional/parallel/MountCmd/specific-port 1.67
161 TestFunctional/parallel/MountCmd/VerifyCleanup 1.71
162 TestFunctional/delete_echo-server_images 0.04
163 TestFunctional/delete_my-image_image 0.02
164 TestFunctional/delete_minikube_cached_images 0.02
168 TestMultiControlPlane/serial/StartCluster 185.63
169 TestMultiControlPlane/serial/DeployApp 6.45
170 TestMultiControlPlane/serial/PingHostFromPods 1.57
171 TestMultiControlPlane/serial/AddWorkerNode 35.5
172 TestMultiControlPlane/serial/NodeLabels 0.12
173 TestMultiControlPlane/serial/HAppyAfterClusterStart 0.73
174 TestMultiControlPlane/serial/CopyFile 18.48
175 TestMultiControlPlane/serial/StopSecondaryNode 12.66
176 TestMultiControlPlane/serial/DegradedAfterControlPlaneNodeStop 0.52
177 TestMultiControlPlane/serial/RestartSecondaryNode 23.07
178 TestMultiControlPlane/serial/HAppyAfterSecondaryNodeRestart 5.25
179 TestMultiControlPlane/serial/RestartClusterKeepsNodes 211.01
180 TestMultiControlPlane/serial/DeleteSecondaryNode 12.88
181 TestMultiControlPlane/serial/DegradedAfterSecondaryNodeDelete 0.52
182 TestMultiControlPlane/serial/StopCluster 35.68
183 TestMultiControlPlane/serial/RestartCluster 115.65
184 TestMultiControlPlane/serial/DegradedAfterClusterRestart 0.55
185 TestMultiControlPlane/serial/AddSecondaryNode 75.36
186 TestMultiControlPlane/serial/HAppyAfterSecondaryNodeAdd 0.72
190 TestJSONOutput/start/Command 58.97
191 TestJSONOutput/start/Audit 0
193 TestJSONOutput/start/parallel/DistinctCurrentSteps 0
194 TestJSONOutput/start/parallel/IncreasingCurrentSteps 0
196 TestJSONOutput/pause/Command 0.71
197 TestJSONOutput/pause/Audit 0
199 TestJSONOutput/pause/parallel/DistinctCurrentSteps 0
200 TestJSONOutput/pause/parallel/IncreasingCurrentSteps 0
202 TestJSONOutput/unpause/Command 0.65
203 TestJSONOutput/unpause/Audit 0
205 TestJSONOutput/unpause/parallel/DistinctCurrentSteps 0
206 TestJSONOutput/unpause/parallel/IncreasingCurrentSteps 0
208 TestJSONOutput/stop/Command 5.9
209 TestJSONOutput/stop/Audit 0
211 TestJSONOutput/stop/parallel/DistinctCurrentSteps 0
212 TestJSONOutput/stop/parallel/IncreasingCurrentSteps 0
213 TestErrorJSONOutput 0.22
215 TestKicCustomNetwork/create_custom_network 38.38
216 TestKicCustomNetwork/use_default_bridge_network 34.05
217 TestKicExistingNetwork 33.17
218 TestKicCustomSubnet 32.67
219 TestKicStaticIP 34.46
220 TestMainNoArgs 0.05
221 TestMinikubeProfile 69.27
224 TestMountStart/serial/StartWithMountFirst 6.7
225 TestMountStart/serial/VerifyMountFirst 0.26
226 TestMountStart/serial/StartWithMountSecond 6.78
227 TestMountStart/serial/VerifyMountSecond 0.27
228 TestMountStart/serial/DeleteFirst 1.61
229 TestMountStart/serial/VerifyMountPostDelete 0.24
230 TestMountStart/serial/Stop 1.2
231 TestMountStart/serial/RestartStopped 7.9
232 TestMountStart/serial/VerifyMountPostStop 0.25
235 TestMultiNode/serial/FreshStart2Nodes 86.92
236 TestMultiNode/serial/DeployApp2Nodes 4.38
237 TestMultiNode/serial/PingHostFrom2Pods 0.96
238 TestMultiNode/serial/AddNode 32.96
239 TestMultiNode/serial/MultiNodeLabels 0.09
240 TestMultiNode/serial/ProfileList 0.33
241 TestMultiNode/serial/CopyFile 9.5
242 TestMultiNode/serial/StopNode 2.2
243 TestMultiNode/serial/StartAfterStop 9.91
244 TestMultiNode/serial/RestartKeepsNodes 88.36
245 TestMultiNode/serial/DeleteNode 5.28
246 TestMultiNode/serial/StopMultiNode 23.82
247 TestMultiNode/serial/RestartMultiNode 55.07
248 TestMultiNode/serial/ValidateNameConflict 34.91
253 TestPreload 129.24
255 TestScheduledStopUnix 106.43
258 TestInsufficientStorage 11.81
259 TestRunningBinaryUpgrade 71.06
261 TestKubernetesUpgrade 397.28
262 TestMissingContainerUpgrade 139.91
264 TestPause/serial/Start 68.44
265 TestPause/serial/SecondStartNoReconfiguration 37.08
266 TestPause/serial/Pause 0.92
267 TestPause/serial/VerifyStatus 0.35
268 TestPause/serial/Unpause 0.86
269 TestPause/serial/PauseAgain 1.11
270 TestPause/serial/DeletePaused 3.43
271 TestPause/serial/VerifyDeletedResources 0.43
272 TestStoppedBinaryUpgrade/Setup 0.74
273 TestStoppedBinaryUpgrade/Upgrade 91.03
274 TestStoppedBinaryUpgrade/MinikubeLogs 1.52
283 TestNoKubernetes/serial/StartNoK8sWithVersion 0.08
284 TestNoKubernetes/serial/StartWithK8s 32.42
285 TestNoKubernetes/serial/StartWithStopK8s 6.48
286 TestNoKubernetes/serial/Start 5.88
287 TestNoKubernetes/serial/VerifyK8sNotRunning 0.26
288 TestNoKubernetes/serial/ProfileList 1.06
289 TestNoKubernetes/serial/Stop 1.21
290 TestNoKubernetes/serial/StartNoArgs 7.07
291 TestNoKubernetes/serial/VerifyK8sNotRunningSecond 0.25
299 TestNetworkPlugins/group/false 3.64
304 TestStartStop/group/old-k8s-version/serial/FirstStart 163.66
306 TestStartStop/group/embed-certs/serial/FirstStart 63.89
307 TestStartStop/group/embed-certs/serial/DeployApp 9.4
308 TestStartStop/group/embed-certs/serial/EnableAddonWhileActive 1.07
309 TestStartStop/group/embed-certs/serial/Stop 11.92
310 TestStartStop/group/embed-certs/serial/EnableAddonAfterStop 0.18
311 TestStartStop/group/embed-certs/serial/SecondStart 273.58
312 TestStartStop/group/old-k8s-version/serial/DeployApp 8.7
313 TestStartStop/group/old-k8s-version/serial/EnableAddonWhileActive 1.85
314 TestStartStop/group/old-k8s-version/serial/Stop 12.25
315 TestStartStop/group/old-k8s-version/serial/EnableAddonAfterStop 0.18
317 TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop 6
318 TestStartStop/group/embed-certs/serial/AddonExistsAfterStop 5.1
319 TestStartStop/group/embed-certs/serial/VerifyKubernetesImages 0.26
320 TestStartStop/group/embed-certs/serial/Pause 3.09
322 TestStartStop/group/no-preload/serial/FirstStart 60.87
323 TestStartStop/group/no-preload/serial/DeployApp 8.37
324 TestStartStop/group/no-preload/serial/EnableAddonWhileActive 1.15
325 TestStartStop/group/no-preload/serial/Stop 11.94
326 TestStartStop/group/no-preload/serial/EnableAddonAfterStop 0.28
327 TestStartStop/group/no-preload/serial/SecondStart 276.26
328 TestStartStop/group/old-k8s-version/serial/UserAppExistsAfterStop 6.01
329 TestStartStop/group/old-k8s-version/serial/AddonExistsAfterStop 6.11
330 TestStartStop/group/old-k8s-version/serial/VerifyKubernetesImages 0.23
331 TestStartStop/group/old-k8s-version/serial/Pause 2.95
333 TestStartStop/group/default-k8s-diff-port/serial/FirstStart 61.19
334 TestStartStop/group/default-k8s-diff-port/serial/DeployApp 9.36
335 TestStartStop/group/default-k8s-diff-port/serial/EnableAddonWhileActive 1.04
336 TestStartStop/group/default-k8s-diff-port/serial/Stop 12.18
337 TestStartStop/group/default-k8s-diff-port/serial/EnableAddonAfterStop 0.18
338 TestStartStop/group/default-k8s-diff-port/serial/SecondStart 301.79
339 TestStartStop/group/no-preload/serial/UserAppExistsAfterStop 6.01
340 TestStartStop/group/no-preload/serial/AddonExistsAfterStop 5.11
341 TestStartStop/group/no-preload/serial/VerifyKubernetesImages 0.25
342 TestStartStop/group/no-preload/serial/Pause 3.06
344 TestStartStop/group/newest-cni/serial/FirstStart 35.28
345 TestStartStop/group/newest-cni/serial/DeployApp 0
346 TestStartStop/group/newest-cni/serial/EnableAddonWhileActive 1.11
347 TestStartStop/group/newest-cni/serial/Stop 1.26
348 TestStartStop/group/newest-cni/serial/EnableAddonAfterStop 0.17
349 TestStartStop/group/newest-cni/serial/SecondStart 15.95
350 TestStartStop/group/newest-cni/serial/UserAppExistsAfterStop 0
351 TestStartStop/group/newest-cni/serial/AddonExistsAfterStop 0
352 TestStartStop/group/newest-cni/serial/VerifyKubernetesImages 0.43
353 TestStartStop/group/newest-cni/serial/Pause 3.41
354 TestNetworkPlugins/group/auto/Start 60.04
355 TestNetworkPlugins/group/auto/KubeletFlags 0.29
356 TestNetworkPlugins/group/auto/NetCatPod 10.28
357 TestNetworkPlugins/group/auto/DNS 0.18
358 TestNetworkPlugins/group/auto/Localhost 0.16
359 TestNetworkPlugins/group/auto/HairPin 0.15
360 TestStartStop/group/default-k8s-diff-port/serial/UserAppExistsAfterStop 6.01
361 TestStartStop/group/default-k8s-diff-port/serial/AddonExistsAfterStop 6.14
362 TestStartStop/group/default-k8s-diff-port/serial/VerifyKubernetesImages 0.31
363 TestNetworkPlugins/group/kindnet/Start 70.04
364 TestStartStop/group/default-k8s-diff-port/serial/Pause 3.86
365 TestNetworkPlugins/group/calico/Start 77.63
366 TestNetworkPlugins/group/kindnet/ControllerPod 6.01
367 TestNetworkPlugins/group/kindnet/KubeletFlags 0.31
368 TestNetworkPlugins/group/kindnet/NetCatPod 11.29
369 TestNetworkPlugins/group/calico/ControllerPod 6.01
370 TestNetworkPlugins/group/kindnet/DNS 0.22
371 TestNetworkPlugins/group/kindnet/Localhost 0.15
372 TestNetworkPlugins/group/kindnet/HairPin 0.16
373 TestNetworkPlugins/group/calico/KubeletFlags 0.29
374 TestNetworkPlugins/group/calico/NetCatPod 12.26
375 TestNetworkPlugins/group/calico/DNS 0.34
376 TestNetworkPlugins/group/calico/Localhost 0.2
377 TestNetworkPlugins/group/calico/HairPin 0.2
378 TestNetworkPlugins/group/custom-flannel/Start 75.74
379 TestNetworkPlugins/group/enable-default-cni/Start 90.45
380 TestNetworkPlugins/group/custom-flannel/KubeletFlags 0.28
381 TestNetworkPlugins/group/custom-flannel/NetCatPod 12.29
382 TestNetworkPlugins/group/custom-flannel/DNS 0.17
383 TestNetworkPlugins/group/custom-flannel/Localhost 0.15
384 TestNetworkPlugins/group/custom-flannel/HairPin 0.15
385 TestNetworkPlugins/group/flannel/Start 78.23
386 TestNetworkPlugins/group/enable-default-cni/KubeletFlags 0.34
387 TestNetworkPlugins/group/enable-default-cni/NetCatPod 12.31
388 TestNetworkPlugins/group/enable-default-cni/DNS 0.25
389 TestNetworkPlugins/group/enable-default-cni/Localhost 0.19
390 TestNetworkPlugins/group/enable-default-cni/HairPin 0.21
391 TestNetworkPlugins/group/bridge/Start 91.29
392 TestNetworkPlugins/group/flannel/ControllerPod 6.01
393 TestNetworkPlugins/group/flannel/KubeletFlags 0.28
394 TestNetworkPlugins/group/flannel/NetCatPod 12.35
395 TestNetworkPlugins/group/flannel/DNS 0.18
396 TestNetworkPlugins/group/flannel/Localhost 0.16
397 TestNetworkPlugins/group/flannel/HairPin 0.16
398 TestNetworkPlugins/group/bridge/KubeletFlags 0.28
399 TestNetworkPlugins/group/bridge/NetCatPod 12.26
400 TestNetworkPlugins/group/bridge/DNS 0.17
401 TestNetworkPlugins/group/bridge/Localhost 0.15
402 TestNetworkPlugins/group/bridge/HairPin 0.15
x
+
TestDownloadOnly/v1.20.0/json-events (12.65s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.20.0/json-events
aaa_download_only_test.go:81: (dbg) Run:  out/minikube-linux-arm64 start -o=json --download-only -p download-only-465809 --force --alsologtostderr --kubernetes-version=v1.20.0 --container-runtime=crio --driver=docker  --container-runtime=crio
aaa_download_only_test.go:81: (dbg) Done: out/minikube-linux-arm64 start -o=json --download-only -p download-only-465809 --force --alsologtostderr --kubernetes-version=v1.20.0 --container-runtime=crio --driver=docker  --container-runtime=crio: (12.649312508s)
--- PASS: TestDownloadOnly/v1.20.0/json-events (12.65s)

                                                
                                    
x
+
TestDownloadOnly/v1.20.0/preload-exists (0s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.20.0/preload-exists
--- PASS: TestDownloadOnly/v1.20.0/preload-exists (0.00s)

                                                
                                    
x
+
TestDownloadOnly/v1.20.0/LogsDuration (0.38s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.20.0/LogsDuration
aaa_download_only_test.go:184: (dbg) Run:  out/minikube-linux-arm64 logs -p download-only-465809
aaa_download_only_test.go:184: (dbg) Non-zero exit: out/minikube-linux-arm64 logs -p download-only-465809: exit status 85 (374.877105ms)

                                                
                                                
-- stdout --
	
	==> Audit <==
	|---------|--------------------------------|----------------------|---------|---------|---------------------|----------|
	| Command |              Args              |       Profile        |  User   | Version |     Start Time      | End Time |
	|---------|--------------------------------|----------------------|---------|---------|---------------------|----------|
	| start   | -o=json --download-only        | download-only-465809 | jenkins | v1.33.1 | 22 Jul 24 10:29 UTC |          |
	|         | -p download-only-465809        |                      |         |         |                     |          |
	|         | --force --alsologtostderr      |                      |         |         |                     |          |
	|         | --kubernetes-version=v1.20.0   |                      |         |         |                     |          |
	|         | --container-runtime=crio       |                      |         |         |                     |          |
	|         | --driver=docker                |                      |         |         |                     |          |
	|         | --container-runtime=crio       |                      |         |         |                     |          |
	|---------|--------------------------------|----------------------|---------|---------|---------------------|----------|
	
	
	==> Last Start <==
	Log file created at: 2024/07/22 10:29:51
	Running on machine: ip-172-31-21-244
	Binary: Built with gc go1.22.5 for linux/arm64
	Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg
	I0722 10:29:51.583672    7569 out.go:291] Setting OutFile to fd 1 ...
	I0722 10:29:51.583839    7569 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0722 10:29:51.583879    7569 out.go:304] Setting ErrFile to fd 2...
	I0722 10:29:51.583901    7569 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0722 10:29:51.584168    7569 root.go:338] Updating PATH: /home/jenkins/minikube-integration/19313-2237/.minikube/bin
	W0722 10:29:51.584326    7569 root.go:314] Error reading config file at /home/jenkins/minikube-integration/19313-2237/.minikube/config/config.json: open /home/jenkins/minikube-integration/19313-2237/.minikube/config/config.json: no such file or directory
	I0722 10:29:51.584771    7569 out.go:298] Setting JSON to true
	I0722 10:29:51.585624    7569 start.go:129] hostinfo: {"hostname":"ip-172-31-21-244","uptime":736,"bootTime":1721643455,"procs":148,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1064-aws","kernelArch":"aarch64","virtualizationSystem":"","virtualizationRole":"","hostId":"da8ac1fd-6236-412a-a346-95873c98230d"}
	I0722 10:29:51.585720    7569 start.go:139] virtualization:  
	I0722 10:29:51.588808    7569 out.go:97] [download-only-465809] minikube v1.33.1 on Ubuntu 20.04 (arm64)
	W0722 10:29:51.588957    7569 preload.go:293] Failed to list preload files: open /home/jenkins/minikube-integration/19313-2237/.minikube/cache/preloaded-tarball: no such file or directory
	I0722 10:29:51.589057    7569 notify.go:220] Checking for updates...
	I0722 10:29:51.591883    7569 out.go:169] MINIKUBE_LOCATION=19313
	I0722 10:29:51.593776    7569 out.go:169] MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I0722 10:29:51.595590    7569 out.go:169] KUBECONFIG=/home/jenkins/minikube-integration/19313-2237/kubeconfig
	I0722 10:29:51.597212    7569 out.go:169] MINIKUBE_HOME=/home/jenkins/minikube-integration/19313-2237/.minikube
	I0722 10:29:51.598927    7569 out.go:169] MINIKUBE_BIN=out/minikube-linux-arm64
	W0722 10:29:51.602064    7569 out.go:267] minikube skips various validations when --force is supplied; this may lead to unexpected behavior
	I0722 10:29:51.602356    7569 driver.go:392] Setting default libvirt URI to qemu:///system
	I0722 10:29:51.630432    7569 docker.go:123] docker version: linux-27.0.3:Docker Engine - Community
	I0722 10:29:51.630530    7569 cli_runner.go:164] Run: docker system info --format "{{json .}}"
	I0722 10:29:51.961092    7569 info.go:266] docker info: {ID:5FDH:SA5P:5GCT:NLAS:B73P:SGDQ:PBG5:UBVH:UZY3:RXGO:CI7S:WAIH Containers:0 ContainersRunning:0 ContainersPaused:0 ContainersStopped:0 Images:1 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:29 OomKillDisable:true NGoroutines:50 SystemTime:2024-07-22 10:29:51.946450521 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1064-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Architecture:aar
ch64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8214896640 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-21-244 Labels:[] ExperimentalBuild:false ServerVersion:27.0.3 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:2bf793ef6dc9a18e00cb12efb64355c2c9d5eb41 Expected:2bf793ef6dc9a18e00cb12efb64355c2c9d5eb41} RuncCommit:{ID:v1.1.13-0-g58aa920 Expected:v1.1.13-0-g58aa920} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:<nil> ServerErro
rs:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.15.1] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.28.1]] Warnings:<nil>}}
	I0722 10:29:51.961199    7569 docker.go:307] overlay module found
	I0722 10:29:51.963262    7569 out.go:97] Using the docker driver based on user configuration
	I0722 10:29:51.963287    7569 start.go:297] selected driver: docker
	I0722 10:29:51.963294    7569 start.go:901] validating driver "docker" against <nil>
	I0722 10:29:51.963403    7569 cli_runner.go:164] Run: docker system info --format "{{json .}}"
	I0722 10:29:52.026531    7569 info.go:266] docker info: {ID:5FDH:SA5P:5GCT:NLAS:B73P:SGDQ:PBG5:UBVH:UZY3:RXGO:CI7S:WAIH Containers:0 ContainersRunning:0 ContainersPaused:0 ContainersStopped:0 Images:1 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:25 OomKillDisable:true NGoroutines:50 SystemTime:2024-07-22 10:29:52.018008841 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1064-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Architecture:aar
ch64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8214896640 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-21-244 Labels:[] ExperimentalBuild:false ServerVersion:27.0.3 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:2bf793ef6dc9a18e00cb12efb64355c2c9d5eb41 Expected:2bf793ef6dc9a18e00cb12efb64355c2c9d5eb41} RuncCommit:{ID:v1.1.13-0-g58aa920 Expected:v1.1.13-0-g58aa920} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:<nil> ServerErro
rs:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.15.1] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.28.1]] Warnings:<nil>}}
	I0722 10:29:52.026696    7569 start_flags.go:310] no existing cluster config was found, will generate one from the flags 
	I0722 10:29:52.026992    7569 start_flags.go:393] Using suggested 2200MB memory alloc based on sys=7834MB, container=7834MB
	I0722 10:29:52.027160    7569 start_flags.go:929] Wait components to verify : map[apiserver:true system_pods:true]
	I0722 10:29:52.029287    7569 out.go:169] Using Docker driver with root privileges
	I0722 10:29:52.031500    7569 cni.go:84] Creating CNI manager for ""
	I0722 10:29:52.031519    7569 cni.go:143] "docker" driver + "crio" runtime found, recommending kindnet
	I0722 10:29:52.031528    7569 start_flags.go:319] Found "CNI" CNI - setting NetworkPlugin=cni
	I0722 10:29:52.031615    7569 start.go:340] cluster config:
	{Name:download-only-465809 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721324606-19298@sha256:1c495b056df42bd3fd9a5c30d049e1802f9ed73a342611781f1ccc3c3853953f Memory:2200 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:download-only-465809 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local Co
ntainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I0722 10:29:52.034105    7569 out.go:97] Starting "download-only-465809" primary control-plane node in "download-only-465809" cluster
	I0722 10:29:52.034129    7569 cache.go:121] Beginning downloading kic base image for docker with crio
	I0722 10:29:52.036781    7569 out.go:97] Pulling base image v0.0.44-1721324606-19298 ...
	I0722 10:29:52.036807    7569 preload.go:131] Checking if preload exists for k8s version v1.20.0 and runtime crio
	I0722 10:29:52.036966    7569 image.go:79] Checking for gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721324606-19298@sha256:1c495b056df42bd3fd9a5c30d049e1802f9ed73a342611781f1ccc3c3853953f in local docker daemon
	I0722 10:29:52.051554    7569 cache.go:149] Downloading gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721324606-19298@sha256:1c495b056df42bd3fd9a5c30d049e1802f9ed73a342611781f1ccc3c3853953f to local cache
	I0722 10:29:52.051739    7569 image.go:63] Checking for gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721324606-19298@sha256:1c495b056df42bd3fd9a5c30d049e1802f9ed73a342611781f1ccc3c3853953f in local cache directory
	I0722 10:29:52.051842    7569 image.go:148] Writing gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721324606-19298@sha256:1c495b056df42bd3fd9a5c30d049e1802f9ed73a342611781f1ccc3c3853953f to local cache
	I0722 10:29:52.099145    7569 preload.go:118] Found remote preload: https://storage.googleapis.com/minikube-preloaded-volume-tarballs/v18/v1.20.0/preloaded-images-k8s-v18-v1.20.0-cri-o-overlay-arm64.tar.lz4
	I0722 10:29:52.099173    7569 cache.go:56] Caching tarball of preloaded images
	I0722 10:29:52.099315    7569 preload.go:131] Checking if preload exists for k8s version v1.20.0 and runtime crio
	I0722 10:29:52.102087    7569 out.go:97] Downloading Kubernetes v1.20.0 preload ...
	I0722 10:29:52.102114    7569 preload.go:236] getting checksum for preloaded-images-k8s-v18-v1.20.0-cri-o-overlay-arm64.tar.lz4 ...
	I0722 10:29:52.180838    7569 download.go:107] Downloading: https://storage.googleapis.com/minikube-preloaded-volume-tarballs/v18/v1.20.0/preloaded-images-k8s-v18-v1.20.0-cri-o-overlay-arm64.tar.lz4?checksum=md5:59cd2ef07b53f039bfd1761b921f2a02 -> /home/jenkins/minikube-integration/19313-2237/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-cri-o-overlay-arm64.tar.lz4
	I0722 10:29:55.038511    7569 cache.go:152] successfully saved gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721324606-19298@sha256:1c495b056df42bd3fd9a5c30d049e1802f9ed73a342611781f1ccc3c3853953f as a tarball
	I0722 10:29:57.830093    7569 preload.go:247] saving checksum for preloaded-images-k8s-v18-v1.20.0-cri-o-overlay-arm64.tar.lz4 ...
	I0722 10:29:57.830221    7569 preload.go:254] verifying checksum of /home/jenkins/minikube-integration/19313-2237/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-cri-o-overlay-arm64.tar.lz4 ...
	I0722 10:29:59.033875    7569 cache.go:59] Finished verifying existence of preloaded tar for v1.20.0 on crio
	I0722 10:29:59.034315    7569 profile.go:143] Saving config to /home/jenkins/minikube-integration/19313-2237/.minikube/profiles/download-only-465809/config.json ...
	I0722 10:29:59.034351    7569 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19313-2237/.minikube/profiles/download-only-465809/config.json: {Name:mkb1231bd4c5a2811e66a9b9b1e320bf5d13e563 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0722 10:29:59.034565    7569 preload.go:131] Checking if preload exists for k8s version v1.20.0 and runtime crio
	I0722 10:29:59.034796    7569 download.go:107] Downloading: https://dl.k8s.io/release/v1.20.0/bin/linux/arm64/kubectl?checksum=file:https://dl.k8s.io/release/v1.20.0/bin/linux/arm64/kubectl.sha256 -> /home/jenkins/minikube-integration/19313-2237/.minikube/cache/linux/arm64/v1.20.0/kubectl
	
	
	* The control-plane node download-only-465809 host does not exist
	  To start a cluster, run: "minikube start -p download-only-465809"

                                                
                                                
-- /stdout --
aaa_download_only_test.go:185: minikube logs failed with error: exit status 85
--- PASS: TestDownloadOnly/v1.20.0/LogsDuration (0.38s)

                                                
                                    
x
+
TestDownloadOnly/v1.20.0/DeleteAll (0.26s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.20.0/DeleteAll
aaa_download_only_test.go:197: (dbg) Run:  out/minikube-linux-arm64 delete --all
--- PASS: TestDownloadOnly/v1.20.0/DeleteAll (0.26s)

                                                
                                    
x
+
TestDownloadOnly/v1.20.0/DeleteAlwaysSucceeds (0.18s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.20.0/DeleteAlwaysSucceeds
aaa_download_only_test.go:208: (dbg) Run:  out/minikube-linux-arm64 delete -p download-only-465809
--- PASS: TestDownloadOnly/v1.20.0/DeleteAlwaysSucceeds (0.18s)

                                                
                                    
x
+
TestDownloadOnly/v1.30.3/json-events (6.13s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.30.3/json-events
aaa_download_only_test.go:81: (dbg) Run:  out/minikube-linux-arm64 start -o=json --download-only -p download-only-516107 --force --alsologtostderr --kubernetes-version=v1.30.3 --container-runtime=crio --driver=docker  --container-runtime=crio
aaa_download_only_test.go:81: (dbg) Done: out/minikube-linux-arm64 start -o=json --download-only -p download-only-516107 --force --alsologtostderr --kubernetes-version=v1.30.3 --container-runtime=crio --driver=docker  --container-runtime=crio: (6.1286758s)
--- PASS: TestDownloadOnly/v1.30.3/json-events (6.13s)

                                                
                                    
x
+
TestDownloadOnly/v1.30.3/preload-exists (0s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.30.3/preload-exists
--- PASS: TestDownloadOnly/v1.30.3/preload-exists (0.00s)

                                                
                                    
x
+
TestDownloadOnly/v1.30.3/LogsDuration (0.07s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.30.3/LogsDuration
aaa_download_only_test.go:184: (dbg) Run:  out/minikube-linux-arm64 logs -p download-only-516107
aaa_download_only_test.go:184: (dbg) Non-zero exit: out/minikube-linux-arm64 logs -p download-only-516107: exit status 85 (69.313597ms)

                                                
                                                
-- stdout --
	
	==> Audit <==
	|---------|--------------------------------|----------------------|---------|---------|---------------------|---------------------|
	| Command |              Args              |       Profile        |  User   | Version |     Start Time      |      End Time       |
	|---------|--------------------------------|----------------------|---------|---------|---------------------|---------------------|
	| start   | -o=json --download-only        | download-only-465809 | jenkins | v1.33.1 | 22 Jul 24 10:29 UTC |                     |
	|         | -p download-only-465809        |                      |         |         |                     |                     |
	|         | --force --alsologtostderr      |                      |         |         |                     |                     |
	|         | --kubernetes-version=v1.20.0   |                      |         |         |                     |                     |
	|         | --container-runtime=crio       |                      |         |         |                     |                     |
	|         | --driver=docker                |                      |         |         |                     |                     |
	|         | --container-runtime=crio       |                      |         |         |                     |                     |
	| delete  | --all                          | minikube             | jenkins | v1.33.1 | 22 Jul 24 10:30 UTC | 22 Jul 24 10:30 UTC |
	| delete  | -p download-only-465809        | download-only-465809 | jenkins | v1.33.1 | 22 Jul 24 10:30 UTC | 22 Jul 24 10:30 UTC |
	| start   | -o=json --download-only        | download-only-516107 | jenkins | v1.33.1 | 22 Jul 24 10:30 UTC |                     |
	|         | -p download-only-516107        |                      |         |         |                     |                     |
	|         | --force --alsologtostderr      |                      |         |         |                     |                     |
	|         | --kubernetes-version=v1.30.3   |                      |         |         |                     |                     |
	|         | --container-runtime=crio       |                      |         |         |                     |                     |
	|         | --driver=docker                |                      |         |         |                     |                     |
	|         | --container-runtime=crio       |                      |         |         |                     |                     |
	|---------|--------------------------------|----------------------|---------|---------|---------------------|---------------------|
	
	
	==> Last Start <==
	Log file created at: 2024/07/22 10:30:05
	Running on machine: ip-172-31-21-244
	Binary: Built with gc go1.22.5 for linux/arm64
	Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg
	I0722 10:30:05.055170    7770 out.go:291] Setting OutFile to fd 1 ...
	I0722 10:30:05.055298    7770 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0722 10:30:05.055309    7770 out.go:304] Setting ErrFile to fd 2...
	I0722 10:30:05.055315    7770 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0722 10:30:05.055558    7770 root.go:338] Updating PATH: /home/jenkins/minikube-integration/19313-2237/.minikube/bin
	I0722 10:30:05.055954    7770 out.go:298] Setting JSON to true
	I0722 10:30:05.056683    7770 start.go:129] hostinfo: {"hostname":"ip-172-31-21-244","uptime":750,"bootTime":1721643455,"procs":146,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1064-aws","kernelArch":"aarch64","virtualizationSystem":"","virtualizationRole":"","hostId":"da8ac1fd-6236-412a-a346-95873c98230d"}
	I0722 10:30:05.056752    7770 start.go:139] virtualization:  
	I0722 10:30:05.059470    7770 out.go:97] [download-only-516107] minikube v1.33.1 on Ubuntu 20.04 (arm64)
	I0722 10:30:05.059752    7770 notify.go:220] Checking for updates...
	I0722 10:30:05.061428    7770 out.go:169] MINIKUBE_LOCATION=19313
	I0722 10:30:05.063343    7770 out.go:169] MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I0722 10:30:05.065222    7770 out.go:169] KUBECONFIG=/home/jenkins/minikube-integration/19313-2237/kubeconfig
	I0722 10:30:05.067152    7770 out.go:169] MINIKUBE_HOME=/home/jenkins/minikube-integration/19313-2237/.minikube
	I0722 10:30:05.069149    7770 out.go:169] MINIKUBE_BIN=out/minikube-linux-arm64
	W0722 10:30:05.073661    7770 out.go:267] minikube skips various validations when --force is supplied; this may lead to unexpected behavior
	I0722 10:30:05.073911    7770 driver.go:392] Setting default libvirt URI to qemu:///system
	I0722 10:30:05.098510    7770 docker.go:123] docker version: linux-27.0.3:Docker Engine - Community
	I0722 10:30:05.098608    7770 cli_runner.go:164] Run: docker system info --format "{{json .}}"
	I0722 10:30:05.161885    7770 info.go:266] docker info: {ID:5FDH:SA5P:5GCT:NLAS:B73P:SGDQ:PBG5:UBVH:UZY3:RXGO:CI7S:WAIH Containers:0 ContainersRunning:0 ContainersPaused:0 ContainersStopped:0 Images:1 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:25 OomKillDisable:true NGoroutines:44 SystemTime:2024-07-22 10:30:05.152981546 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1064-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Architecture:aar
ch64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8214896640 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-21-244 Labels:[] ExperimentalBuild:false ServerVersion:27.0.3 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:2bf793ef6dc9a18e00cb12efb64355c2c9d5eb41 Expected:2bf793ef6dc9a18e00cb12efb64355c2c9d5eb41} RuncCommit:{ID:v1.1.13-0-g58aa920 Expected:v1.1.13-0-g58aa920} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:<nil> ServerErro
rs:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.15.1] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.28.1]] Warnings:<nil>}}
	I0722 10:30:05.162014    7770 docker.go:307] overlay module found
	I0722 10:30:05.164014    7770 out.go:97] Using the docker driver based on user configuration
	I0722 10:30:05.164042    7770 start.go:297] selected driver: docker
	I0722 10:30:05.164050    7770 start.go:901] validating driver "docker" against <nil>
	I0722 10:30:05.164170    7770 cli_runner.go:164] Run: docker system info --format "{{json .}}"
	I0722 10:30:05.217866    7770 info.go:266] docker info: {ID:5FDH:SA5P:5GCT:NLAS:B73P:SGDQ:PBG5:UBVH:UZY3:RXGO:CI7S:WAIH Containers:0 ContainersRunning:0 ContainersPaused:0 ContainersStopped:0 Images:1 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:25 OomKillDisable:true NGoroutines:44 SystemTime:2024-07-22 10:30:05.208440274 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1064-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Architecture:aar
ch64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8214896640 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-21-244 Labels:[] ExperimentalBuild:false ServerVersion:27.0.3 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:2bf793ef6dc9a18e00cb12efb64355c2c9d5eb41 Expected:2bf793ef6dc9a18e00cb12efb64355c2c9d5eb41} RuncCommit:{ID:v1.1.13-0-g58aa920 Expected:v1.1.13-0-g58aa920} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:<nil> ServerErro
rs:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.15.1] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.28.1]] Warnings:<nil>}}
	I0722 10:30:05.218024    7770 start_flags.go:310] no existing cluster config was found, will generate one from the flags 
	I0722 10:30:05.218312    7770 start_flags.go:393] Using suggested 2200MB memory alloc based on sys=7834MB, container=7834MB
	I0722 10:30:05.218486    7770 start_flags.go:929] Wait components to verify : map[apiserver:true system_pods:true]
	I0722 10:30:05.220959    7770 out.go:169] Using Docker driver with root privileges
	I0722 10:30:05.222899    7770 cni.go:84] Creating CNI manager for ""
	I0722 10:30:05.222918    7770 cni.go:143] "docker" driver + "crio" runtime found, recommending kindnet
	I0722 10:30:05.222928    7770 start_flags.go:319] Found "CNI" CNI - setting NetworkPlugin=cni
	I0722 10:30:05.223026    7770 start.go:340] cluster config:
	{Name:download-only-516107 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721324606-19298@sha256:1c495b056df42bd3fd9a5c30d049e1802f9ed73a342611781f1ccc3c3853953f Memory:2200 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.30.3 ClusterName:download-only-516107 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local Co
ntainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.30.3 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I0722 10:30:05.224812    7770 out.go:97] Starting "download-only-516107" primary control-plane node in "download-only-516107" cluster
	I0722 10:30:05.224834    7770 cache.go:121] Beginning downloading kic base image for docker with crio
	I0722 10:30:05.226582    7770 out.go:97] Pulling base image v0.0.44-1721324606-19298 ...
	I0722 10:30:05.226611    7770 preload.go:131] Checking if preload exists for k8s version v1.30.3 and runtime crio
	I0722 10:30:05.226773    7770 image.go:79] Checking for gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721324606-19298@sha256:1c495b056df42bd3fd9a5c30d049e1802f9ed73a342611781f1ccc3c3853953f in local docker daemon
	I0722 10:30:05.241761    7770 cache.go:149] Downloading gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721324606-19298@sha256:1c495b056df42bd3fd9a5c30d049e1802f9ed73a342611781f1ccc3c3853953f to local cache
	I0722 10:30:05.241889    7770 image.go:63] Checking for gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721324606-19298@sha256:1c495b056df42bd3fd9a5c30d049e1802f9ed73a342611781f1ccc3c3853953f in local cache directory
	I0722 10:30:05.241912    7770 image.go:66] Found gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721324606-19298@sha256:1c495b056df42bd3fd9a5c30d049e1802f9ed73a342611781f1ccc3c3853953f in local cache directory, skipping pull
	I0722 10:30:05.241921    7770 image.go:135] gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721324606-19298@sha256:1c495b056df42bd3fd9a5c30d049e1802f9ed73a342611781f1ccc3c3853953f exists in cache, skipping pull
	I0722 10:30:05.241929    7770 cache.go:152] successfully saved gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721324606-19298@sha256:1c495b056df42bd3fd9a5c30d049e1802f9ed73a342611781f1ccc3c3853953f as a tarball
	I0722 10:30:05.281746    7770 preload.go:118] Found remote preload: https://storage.googleapis.com/minikube-preloaded-volume-tarballs/v18/v1.30.3/preloaded-images-k8s-v18-v1.30.3-cri-o-overlay-arm64.tar.lz4
	I0722 10:30:05.281776    7770 cache.go:56] Caching tarball of preloaded images
	I0722 10:30:05.281941    7770 preload.go:131] Checking if preload exists for k8s version v1.30.3 and runtime crio
	I0722 10:30:05.284403    7770 out.go:97] Downloading Kubernetes v1.30.3 preload ...
	I0722 10:30:05.284427    7770 preload.go:236] getting checksum for preloaded-images-k8s-v18-v1.30.3-cri-o-overlay-arm64.tar.lz4 ...
	I0722 10:30:05.364776    7770 download.go:107] Downloading: https://storage.googleapis.com/minikube-preloaded-volume-tarballs/v18/v1.30.3/preloaded-images-k8s-v18-v1.30.3-cri-o-overlay-arm64.tar.lz4?checksum=md5:bace9a3612be7d31e4d3c3d446951ced -> /home/jenkins/minikube-integration/19313-2237/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.30.3-cri-o-overlay-arm64.tar.lz4
	I0722 10:30:09.601842    7770 preload.go:247] saving checksum for preloaded-images-k8s-v18-v1.30.3-cri-o-overlay-arm64.tar.lz4 ...
	I0722 10:30:09.601946    7770 preload.go:254] verifying checksum of /home/jenkins/minikube-integration/19313-2237/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.30.3-cri-o-overlay-arm64.tar.lz4 ...
	
	
	* The control-plane node download-only-516107 host does not exist
	  To start a cluster, run: "minikube start -p download-only-516107"

                                                
                                                
-- /stdout --
aaa_download_only_test.go:185: minikube logs failed with error: exit status 85
--- PASS: TestDownloadOnly/v1.30.3/LogsDuration (0.07s)

                                                
                                    
x
+
TestDownloadOnly/v1.30.3/DeleteAll (0.2s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.30.3/DeleteAll
aaa_download_only_test.go:197: (dbg) Run:  out/minikube-linux-arm64 delete --all
--- PASS: TestDownloadOnly/v1.30.3/DeleteAll (0.20s)

                                                
                                    
x
+
TestDownloadOnly/v1.30.3/DeleteAlwaysSucceeds (0.12s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.30.3/DeleteAlwaysSucceeds
aaa_download_only_test.go:208: (dbg) Run:  out/minikube-linux-arm64 delete -p download-only-516107
--- PASS: TestDownloadOnly/v1.30.3/DeleteAlwaysSucceeds (0.12s)

                                                
                                    
x
+
TestDownloadOnly/v1.31.0-beta.0/json-events (13.47s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.31.0-beta.0/json-events
aaa_download_only_test.go:81: (dbg) Run:  out/minikube-linux-arm64 start -o=json --download-only -p download-only-121393 --force --alsologtostderr --kubernetes-version=v1.31.0-beta.0 --container-runtime=crio --driver=docker  --container-runtime=crio
aaa_download_only_test.go:81: (dbg) Done: out/minikube-linux-arm64 start -o=json --download-only -p download-only-121393 --force --alsologtostderr --kubernetes-version=v1.31.0-beta.0 --container-runtime=crio --driver=docker  --container-runtime=crio: (13.466786402s)
--- PASS: TestDownloadOnly/v1.31.0-beta.0/json-events (13.47s)

                                                
                                    
x
+
TestDownloadOnly/v1.31.0-beta.0/preload-exists (0s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.31.0-beta.0/preload-exists
--- PASS: TestDownloadOnly/v1.31.0-beta.0/preload-exists (0.00s)

                                                
                                    
x
+
TestDownloadOnly/v1.31.0-beta.0/LogsDuration (0.07s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.31.0-beta.0/LogsDuration
aaa_download_only_test.go:184: (dbg) Run:  out/minikube-linux-arm64 logs -p download-only-121393
aaa_download_only_test.go:184: (dbg) Non-zero exit: out/minikube-linux-arm64 logs -p download-only-121393: exit status 85 (72.105293ms)

                                                
                                                
-- stdout --
	
	==> Audit <==
	|---------|-------------------------------------|----------------------|---------|---------|---------------------|---------------------|
	| Command |                Args                 |       Profile        |  User   | Version |     Start Time      |      End Time       |
	|---------|-------------------------------------|----------------------|---------|---------|---------------------|---------------------|
	| start   | -o=json --download-only             | download-only-465809 | jenkins | v1.33.1 | 22 Jul 24 10:29 UTC |                     |
	|         | -p download-only-465809             |                      |         |         |                     |                     |
	|         | --force --alsologtostderr           |                      |         |         |                     |                     |
	|         | --kubernetes-version=v1.20.0        |                      |         |         |                     |                     |
	|         | --container-runtime=crio            |                      |         |         |                     |                     |
	|         | --driver=docker                     |                      |         |         |                     |                     |
	|         | --container-runtime=crio            |                      |         |         |                     |                     |
	| delete  | --all                               | minikube             | jenkins | v1.33.1 | 22 Jul 24 10:30 UTC | 22 Jul 24 10:30 UTC |
	| delete  | -p download-only-465809             | download-only-465809 | jenkins | v1.33.1 | 22 Jul 24 10:30 UTC | 22 Jul 24 10:30 UTC |
	| start   | -o=json --download-only             | download-only-516107 | jenkins | v1.33.1 | 22 Jul 24 10:30 UTC |                     |
	|         | -p download-only-516107             |                      |         |         |                     |                     |
	|         | --force --alsologtostderr           |                      |         |         |                     |                     |
	|         | --kubernetes-version=v1.30.3        |                      |         |         |                     |                     |
	|         | --container-runtime=crio            |                      |         |         |                     |                     |
	|         | --driver=docker                     |                      |         |         |                     |                     |
	|         | --container-runtime=crio            |                      |         |         |                     |                     |
	| delete  | --all                               | minikube             | jenkins | v1.33.1 | 22 Jul 24 10:30 UTC | 22 Jul 24 10:30 UTC |
	| delete  | -p download-only-516107             | download-only-516107 | jenkins | v1.33.1 | 22 Jul 24 10:30 UTC | 22 Jul 24 10:30 UTC |
	| start   | -o=json --download-only             | download-only-121393 | jenkins | v1.33.1 | 22 Jul 24 10:30 UTC |                     |
	|         | -p download-only-121393             |                      |         |         |                     |                     |
	|         | --force --alsologtostderr           |                      |         |         |                     |                     |
	|         | --kubernetes-version=v1.31.0-beta.0 |                      |         |         |                     |                     |
	|         | --container-runtime=crio            |                      |         |         |                     |                     |
	|         | --driver=docker                     |                      |         |         |                     |                     |
	|         | --container-runtime=crio            |                      |         |         |                     |                     |
	|---------|-------------------------------------|----------------------|---------|---------|---------------------|---------------------|
	
	
	==> Last Start <==
	Log file created at: 2024/07/22 10:30:11
	Running on machine: ip-172-31-21-244
	Binary: Built with gc go1.22.5 for linux/arm64
	Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg
	I0722 10:30:11.571072    7973 out.go:291] Setting OutFile to fd 1 ...
	I0722 10:30:11.571250    7973 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0722 10:30:11.571278    7973 out.go:304] Setting ErrFile to fd 2...
	I0722 10:30:11.571298    7973 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0722 10:30:11.571647    7973 root.go:338] Updating PATH: /home/jenkins/minikube-integration/19313-2237/.minikube/bin
	I0722 10:30:11.572147    7973 out.go:298] Setting JSON to true
	I0722 10:30:11.573010    7973 start.go:129] hostinfo: {"hostname":"ip-172-31-21-244","uptime":756,"bootTime":1721643455,"procs":148,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1064-aws","kernelArch":"aarch64","virtualizationSystem":"","virtualizationRole":"","hostId":"da8ac1fd-6236-412a-a346-95873c98230d"}
	I0722 10:30:11.573135    7973 start.go:139] virtualization:  
	I0722 10:30:11.576119    7973 out.go:97] [download-only-121393] minikube v1.33.1 on Ubuntu 20.04 (arm64)
	I0722 10:30:11.576333    7973 notify.go:220] Checking for updates...
	I0722 10:30:11.578076    7973 out.go:169] MINIKUBE_LOCATION=19313
	I0722 10:30:11.580036    7973 out.go:169] MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I0722 10:30:11.581866    7973 out.go:169] KUBECONFIG=/home/jenkins/minikube-integration/19313-2237/kubeconfig
	I0722 10:30:11.584037    7973 out.go:169] MINIKUBE_HOME=/home/jenkins/minikube-integration/19313-2237/.minikube
	I0722 10:30:11.586312    7973 out.go:169] MINIKUBE_BIN=out/minikube-linux-arm64
	W0722 10:30:11.590264    7973 out.go:267] minikube skips various validations when --force is supplied; this may lead to unexpected behavior
	I0722 10:30:11.590525    7973 driver.go:392] Setting default libvirt URI to qemu:///system
	I0722 10:30:11.619089    7973 docker.go:123] docker version: linux-27.0.3:Docker Engine - Community
	I0722 10:30:11.619182    7973 cli_runner.go:164] Run: docker system info --format "{{json .}}"
	I0722 10:30:11.675760    7973 info.go:266] docker info: {ID:5FDH:SA5P:5GCT:NLAS:B73P:SGDQ:PBG5:UBVH:UZY3:RXGO:CI7S:WAIH Containers:0 ContainersRunning:0 ContainersPaused:0 ContainersStopped:0 Images:1 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:25 OomKillDisable:true NGoroutines:44 SystemTime:2024-07-22 10:30:11.66673987 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1064-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Architecture:aarc
h64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8214896640 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-21-244 Labels:[] ExperimentalBuild:false ServerVersion:27.0.3 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:2bf793ef6dc9a18e00cb12efb64355c2c9d5eb41 Expected:2bf793ef6dc9a18e00cb12efb64355c2c9d5eb41} RuncCommit:{ID:v1.1.13-0-g58aa920 Expected:v1.1.13-0-g58aa920} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:<nil> ServerError
s:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.15.1] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.28.1]] Warnings:<nil>}}
	I0722 10:30:11.675872    7973 docker.go:307] overlay module found
	I0722 10:30:11.677848    7973 out.go:97] Using the docker driver based on user configuration
	I0722 10:30:11.677878    7973 start.go:297] selected driver: docker
	I0722 10:30:11.677886    7973 start.go:901] validating driver "docker" against <nil>
	I0722 10:30:11.678002    7973 cli_runner.go:164] Run: docker system info --format "{{json .}}"
	I0722 10:30:11.732422    7973 info.go:266] docker info: {ID:5FDH:SA5P:5GCT:NLAS:B73P:SGDQ:PBG5:UBVH:UZY3:RXGO:CI7S:WAIH Containers:0 ContainersRunning:0 ContainersPaused:0 ContainersStopped:0 Images:1 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:25 OomKillDisable:true NGoroutines:44 SystemTime:2024-07-22 10:30:11.723419869 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1064-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Architecture:aar
ch64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8214896640 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-21-244 Labels:[] ExperimentalBuild:false ServerVersion:27.0.3 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:2bf793ef6dc9a18e00cb12efb64355c2c9d5eb41 Expected:2bf793ef6dc9a18e00cb12efb64355c2c9d5eb41} RuncCommit:{ID:v1.1.13-0-g58aa920 Expected:v1.1.13-0-g58aa920} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:<nil> ServerErro
rs:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.15.1] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.28.1]] Warnings:<nil>}}
	I0722 10:30:11.732574    7973 start_flags.go:310] no existing cluster config was found, will generate one from the flags 
	I0722 10:30:11.732894    7973 start_flags.go:393] Using suggested 2200MB memory alloc based on sys=7834MB, container=7834MB
	I0722 10:30:11.733074    7973 start_flags.go:929] Wait components to verify : map[apiserver:true system_pods:true]
	I0722 10:30:11.735347    7973 out.go:169] Using Docker driver with root privileges
	I0722 10:30:11.737200    7973 cni.go:84] Creating CNI manager for ""
	I0722 10:30:11.737221    7973 cni.go:143] "docker" driver + "crio" runtime found, recommending kindnet
	I0722 10:30:11.737232    7973 start_flags.go:319] Found "CNI" CNI - setting NetworkPlugin=cni
	I0722 10:30:11.737314    7973 start.go:340] cluster config:
	{Name:download-only-121393 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721324606-19298@sha256:1c495b056df42bd3fd9a5c30d049e1802f9ed73a342611781f1ccc3c3853953f Memory:2200 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.31.0-beta.0 ClusterName:download-only-121393 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.l
ocal ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.31.0-beta.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I0722 10:30:11.739667    7973 out.go:97] Starting "download-only-121393" primary control-plane node in "download-only-121393" cluster
	I0722 10:30:11.739683    7973 cache.go:121] Beginning downloading kic base image for docker with crio
	I0722 10:30:11.741457    7973 out.go:97] Pulling base image v0.0.44-1721324606-19298 ...
	I0722 10:30:11.741481    7973 preload.go:131] Checking if preload exists for k8s version v1.31.0-beta.0 and runtime crio
	I0722 10:30:11.741578    7973 image.go:79] Checking for gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721324606-19298@sha256:1c495b056df42bd3fd9a5c30d049e1802f9ed73a342611781f1ccc3c3853953f in local docker daemon
	I0722 10:30:11.755436    7973 cache.go:149] Downloading gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721324606-19298@sha256:1c495b056df42bd3fd9a5c30d049e1802f9ed73a342611781f1ccc3c3853953f to local cache
	I0722 10:30:11.755566    7973 image.go:63] Checking for gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721324606-19298@sha256:1c495b056df42bd3fd9a5c30d049e1802f9ed73a342611781f1ccc3c3853953f in local cache directory
	I0722 10:30:11.755589    7973 image.go:66] Found gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721324606-19298@sha256:1c495b056df42bd3fd9a5c30d049e1802f9ed73a342611781f1ccc3c3853953f in local cache directory, skipping pull
	I0722 10:30:11.755595    7973 image.go:135] gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721324606-19298@sha256:1c495b056df42bd3fd9a5c30d049e1802f9ed73a342611781f1ccc3c3853953f exists in cache, skipping pull
	I0722 10:30:11.755605    7973 cache.go:152] successfully saved gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721324606-19298@sha256:1c495b056df42bd3fd9a5c30d049e1802f9ed73a342611781f1ccc3c3853953f as a tarball
	I0722 10:30:11.806179    7973 preload.go:118] Found remote preload: https://storage.googleapis.com/minikube-preloaded-volume-tarballs/v18/v1.31.0-beta.0/preloaded-images-k8s-v18-v1.31.0-beta.0-cri-o-overlay-arm64.tar.lz4
	I0722 10:30:11.806203    7973 cache.go:56] Caching tarball of preloaded images
	I0722 10:30:11.806367    7973 preload.go:131] Checking if preload exists for k8s version v1.31.0-beta.0 and runtime crio
	I0722 10:30:11.808592    7973 out.go:97] Downloading Kubernetes v1.31.0-beta.0 preload ...
	I0722 10:30:11.808615    7973 preload.go:236] getting checksum for preloaded-images-k8s-v18-v1.31.0-beta.0-cri-o-overlay-arm64.tar.lz4 ...
	I0722 10:30:11.886218    7973 download.go:107] Downloading: https://storage.googleapis.com/minikube-preloaded-volume-tarballs/v18/v1.31.0-beta.0/preloaded-images-k8s-v18-v1.31.0-beta.0-cri-o-overlay-arm64.tar.lz4?checksum=md5:70b5971c257ae4defe1f5d041a04e29c -> /home/jenkins/minikube-integration/19313-2237/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.0-beta.0-cri-o-overlay-arm64.tar.lz4
	I0722 10:30:17.398341    7973 preload.go:247] saving checksum for preloaded-images-k8s-v18-v1.31.0-beta.0-cri-o-overlay-arm64.tar.lz4 ...
	I0722 10:30:17.398442    7973 preload.go:254] verifying checksum of /home/jenkins/minikube-integration/19313-2237/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.0-beta.0-cri-o-overlay-arm64.tar.lz4 ...
	I0722 10:30:18.234712    7973 cache.go:59] Finished verifying existence of preloaded tar for v1.31.0-beta.0 on crio
	I0722 10:30:18.235065    7973 profile.go:143] Saving config to /home/jenkins/minikube-integration/19313-2237/.minikube/profiles/download-only-121393/config.json ...
	I0722 10:30:18.235100    7973 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19313-2237/.minikube/profiles/download-only-121393/config.json: {Name:mk066a97a2cddd283d592ba8ae778d4e3a34fd50 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0722 10:30:18.235278    7973 preload.go:131] Checking if preload exists for k8s version v1.31.0-beta.0 and runtime crio
	I0722 10:30:18.235423    7973 download.go:107] Downloading: https://dl.k8s.io/release/v1.31.0-beta.0/bin/linux/arm64/kubectl?checksum=file:https://dl.k8s.io/release/v1.31.0-beta.0/bin/linux/arm64/kubectl.sha256 -> /home/jenkins/minikube-integration/19313-2237/.minikube/cache/linux/arm64/v1.31.0-beta.0/kubectl
	
	
	* The control-plane node download-only-121393 host does not exist
	  To start a cluster, run: "minikube start -p download-only-121393"

                                                
                                                
-- /stdout --
aaa_download_only_test.go:185: minikube logs failed with error: exit status 85
--- PASS: TestDownloadOnly/v1.31.0-beta.0/LogsDuration (0.07s)

                                                
                                    
x
+
TestDownloadOnly/v1.31.0-beta.0/DeleteAll (0.2s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.31.0-beta.0/DeleteAll
aaa_download_only_test.go:197: (dbg) Run:  out/minikube-linux-arm64 delete --all
--- PASS: TestDownloadOnly/v1.31.0-beta.0/DeleteAll (0.20s)

                                                
                                    
x
+
TestDownloadOnly/v1.31.0-beta.0/DeleteAlwaysSucceeds (0.13s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.31.0-beta.0/DeleteAlwaysSucceeds
aaa_download_only_test.go:208: (dbg) Run:  out/minikube-linux-arm64 delete -p download-only-121393
--- PASS: TestDownloadOnly/v1.31.0-beta.0/DeleteAlwaysSucceeds (0.13s)

                                                
                                    
x
+
TestBinaryMirror (0.54s)

                                                
                                                
=== RUN   TestBinaryMirror
aaa_download_only_test.go:314: (dbg) Run:  out/minikube-linux-arm64 start --download-only -p binary-mirror-754911 --alsologtostderr --binary-mirror http://127.0.0.1:34829 --driver=docker  --container-runtime=crio
helpers_test.go:175: Cleaning up "binary-mirror-754911" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-arm64 delete -p binary-mirror-754911
--- PASS: TestBinaryMirror (0.54s)

                                                
                                    
x
+
TestAddons/PreSetup/EnablingAddonOnNonExistingCluster (0.07s)

                                                
                                                
=== RUN   TestAddons/PreSetup/EnablingAddonOnNonExistingCluster
=== PAUSE TestAddons/PreSetup/EnablingAddonOnNonExistingCluster

                                                
                                                

                                                
                                                
=== CONT  TestAddons/PreSetup/EnablingAddonOnNonExistingCluster
addons_test.go:1029: (dbg) Run:  out/minikube-linux-arm64 addons enable dashboard -p addons-578168
addons_test.go:1029: (dbg) Non-zero exit: out/minikube-linux-arm64 addons enable dashboard -p addons-578168: exit status 85 (66.646891ms)

                                                
                                                
-- stdout --
	* Profile "addons-578168" not found. Run "minikube profile list" to view all profiles.
	  To start a cluster, run: "minikube start -p addons-578168"

                                                
                                                
-- /stdout --
--- PASS: TestAddons/PreSetup/EnablingAddonOnNonExistingCluster (0.07s)

                                                
                                    
x
+
TestAddons/PreSetup/DisablingAddonOnNonExistingCluster (0.08s)

                                                
                                                
=== RUN   TestAddons/PreSetup/DisablingAddonOnNonExistingCluster
=== PAUSE TestAddons/PreSetup/DisablingAddonOnNonExistingCluster

                                                
                                                

                                                
                                                
=== CONT  TestAddons/PreSetup/DisablingAddonOnNonExistingCluster
addons_test.go:1040: (dbg) Run:  out/minikube-linux-arm64 addons disable dashboard -p addons-578168
addons_test.go:1040: (dbg) Non-zero exit: out/minikube-linux-arm64 addons disable dashboard -p addons-578168: exit status 85 (84.067241ms)

                                                
                                                
-- stdout --
	* Profile "addons-578168" not found. Run "minikube profile list" to view all profiles.
	  To start a cluster, run: "minikube start -p addons-578168"

                                                
                                                
-- /stdout --
--- PASS: TestAddons/PreSetup/DisablingAddonOnNonExistingCluster (0.08s)

                                                
                                    
x
+
TestAddons/Setup (183.8s)

                                                
                                                
=== RUN   TestAddons/Setup
addons_test.go:110: (dbg) Run:  out/minikube-linux-arm64 start -p addons-578168 --wait=true --memory=4000 --alsologtostderr --addons=registry --addons=metrics-server --addons=volumesnapshots --addons=csi-hostpath-driver --addons=gcp-auth --addons=cloud-spanner --addons=inspektor-gadget --addons=storage-provisioner-rancher --addons=nvidia-device-plugin --addons=yakd --addons=volcano --driver=docker  --container-runtime=crio --addons=ingress --addons=ingress-dns
addons_test.go:110: (dbg) Done: out/minikube-linux-arm64 start -p addons-578168 --wait=true --memory=4000 --alsologtostderr --addons=registry --addons=metrics-server --addons=volumesnapshots --addons=csi-hostpath-driver --addons=gcp-auth --addons=cloud-spanner --addons=inspektor-gadget --addons=storage-provisioner-rancher --addons=nvidia-device-plugin --addons=yakd --addons=volcano --driver=docker  --container-runtime=crio --addons=ingress --addons=ingress-dns: (3m3.793976594s)
--- PASS: TestAddons/Setup (183.80s)

                                                
                                    
x
+
TestAddons/parallel/Registry (15.69s)

                                                
                                                
=== RUN   TestAddons/parallel/Registry
=== PAUSE TestAddons/parallel/Registry

                                                
                                                

                                                
                                                
=== CONT  TestAddons/parallel/Registry
addons_test.go:332: registry stabilized in 48.204133ms
addons_test.go:334: (dbg) TestAddons/parallel/Registry: waiting 6m0s for pods matching "actual-registry=true" in namespace "kube-system" ...
helpers_test.go:344: "registry-656c9c8d9c-c2dgx" [47d52a97-6fdc-4c57-882b-f6098503cfa3] Running
addons_test.go:334: (dbg) TestAddons/parallel/Registry: actual-registry=true healthy within 6.004944746s
addons_test.go:337: (dbg) TestAddons/parallel/Registry: waiting 10m0s for pods matching "registry-proxy=true" in namespace "kube-system" ...
helpers_test.go:344: "registry-proxy-6fp26" [aa53a675-95b7-4a46-9478-32230bc47800] Running
addons_test.go:337: (dbg) TestAddons/parallel/Registry: registry-proxy=true healthy within 5.004414038s
addons_test.go:342: (dbg) Run:  kubectl --context addons-578168 delete po -l run=registry-test --now
addons_test.go:347: (dbg) Run:  kubectl --context addons-578168 run --rm registry-test --restart=Never --image=gcr.io/k8s-minikube/busybox -it -- sh -c "wget --spider -S http://registry.kube-system.svc.cluster.local"
addons_test.go:347: (dbg) Done: kubectl --context addons-578168 run --rm registry-test --restart=Never --image=gcr.io/k8s-minikube/busybox -it -- sh -c "wget --spider -S http://registry.kube-system.svc.cluster.local": (3.603318729s)
addons_test.go:361: (dbg) Run:  out/minikube-linux-arm64 -p addons-578168 ip
2024/07/22 10:33:45 [DEBUG] GET http://192.168.49.2:5000
addons_test.go:390: (dbg) Run:  out/minikube-linux-arm64 -p addons-578168 addons disable registry --alsologtostderr -v=1
--- PASS: TestAddons/parallel/Registry (15.69s)

                                                
                                    
x
+
TestAddons/parallel/InspektorGadget (11.76s)

                                                
                                                
=== RUN   TestAddons/parallel/InspektorGadget
=== PAUSE TestAddons/parallel/InspektorGadget

                                                
                                                

                                                
                                                
=== CONT  TestAddons/parallel/InspektorGadget
addons_test.go:840: (dbg) TestAddons/parallel/InspektorGadget: waiting 8m0s for pods matching "k8s-app=gadget" in namespace "gadget" ...
helpers_test.go:344: "gadget-mdgzm" [d5a21cf3-33f3-4191-9057-115b009594d3] Running / Ready:ContainersNotReady (containers with unready status: [gadget]) / ContainersReady:ContainersNotReady (containers with unready status: [gadget])
addons_test.go:840: (dbg) TestAddons/parallel/InspektorGadget: k8s-app=gadget healthy within 6.007344215s
addons_test.go:843: (dbg) Run:  out/minikube-linux-arm64 addons disable inspektor-gadget -p addons-578168
addons_test.go:843: (dbg) Done: out/minikube-linux-arm64 addons disable inspektor-gadget -p addons-578168: (5.748598286s)
--- PASS: TestAddons/parallel/InspektorGadget (11.76s)

                                                
                                    
x
+
TestAddons/parallel/CSI (48.93s)

                                                
                                                
=== RUN   TestAddons/parallel/CSI
=== PAUSE TestAddons/parallel/CSI

                                                
                                                

                                                
                                                
=== CONT  TestAddons/parallel/CSI
addons_test.go:563: csi-hostpath-driver pods stabilized in 7.64535ms
addons_test.go:566: (dbg) Run:  kubectl --context addons-578168 create -f testdata/csi-hostpath-driver/pvc.yaml
addons_test.go:571: (dbg) TestAddons/parallel/CSI: waiting 6m0s for pvc "hpvc" in namespace "default" ...
helpers_test.go:394: (dbg) Run:  kubectl --context addons-578168 get pvc hpvc -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-578168 get pvc hpvc -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-578168 get pvc hpvc -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-578168 get pvc hpvc -o jsonpath={.status.phase} -n default
addons_test.go:576: (dbg) Run:  kubectl --context addons-578168 create -f testdata/csi-hostpath-driver/pv-pod.yaml
addons_test.go:581: (dbg) TestAddons/parallel/CSI: waiting 6m0s for pods matching "app=task-pv-pod" in namespace "default" ...
helpers_test.go:344: "task-pv-pod" [80ff48f6-83e6-4a74-babe-90873afb8c24] Pending
helpers_test.go:344: "task-pv-pod" [80ff48f6-83e6-4a74-babe-90873afb8c24] Pending / Ready:ContainersNotReady (containers with unready status: [task-pv-container]) / ContainersReady:ContainersNotReady (containers with unready status: [task-pv-container])
helpers_test.go:344: "task-pv-pod" [80ff48f6-83e6-4a74-babe-90873afb8c24] Running
addons_test.go:581: (dbg) TestAddons/parallel/CSI: app=task-pv-pod healthy within 12.011475822s
addons_test.go:586: (dbg) Run:  kubectl --context addons-578168 create -f testdata/csi-hostpath-driver/snapshot.yaml
addons_test.go:591: (dbg) TestAddons/parallel/CSI: waiting 6m0s for volume snapshot "new-snapshot-demo" in namespace "default" ...
helpers_test.go:419: (dbg) Run:  kubectl --context addons-578168 get volumesnapshot new-snapshot-demo -o jsonpath={.status.readyToUse} -n default
helpers_test.go:419: (dbg) Run:  kubectl --context addons-578168 get volumesnapshot new-snapshot-demo -o jsonpath={.status.readyToUse} -n default
addons_test.go:596: (dbg) Run:  kubectl --context addons-578168 delete pod task-pv-pod
addons_test.go:602: (dbg) Run:  kubectl --context addons-578168 delete pvc hpvc
addons_test.go:608: (dbg) Run:  kubectl --context addons-578168 create -f testdata/csi-hostpath-driver/pvc-restore.yaml
addons_test.go:613: (dbg) TestAddons/parallel/CSI: waiting 6m0s for pvc "hpvc-restore" in namespace "default" ...
helpers_test.go:394: (dbg) Run:  kubectl --context addons-578168 get pvc hpvc-restore -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-578168 get pvc hpvc-restore -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-578168 get pvc hpvc-restore -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-578168 get pvc hpvc-restore -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-578168 get pvc hpvc-restore -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-578168 get pvc hpvc-restore -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-578168 get pvc hpvc-restore -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-578168 get pvc hpvc-restore -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-578168 get pvc hpvc-restore -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-578168 get pvc hpvc-restore -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-578168 get pvc hpvc-restore -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-578168 get pvc hpvc-restore -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-578168 get pvc hpvc-restore -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-578168 get pvc hpvc-restore -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-578168 get pvc hpvc-restore -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-578168 get pvc hpvc-restore -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-578168 get pvc hpvc-restore -o jsonpath={.status.phase} -n default
addons_test.go:618: (dbg) Run:  kubectl --context addons-578168 create -f testdata/csi-hostpath-driver/pv-pod-restore.yaml
addons_test.go:623: (dbg) TestAddons/parallel/CSI: waiting 6m0s for pods matching "app=task-pv-pod-restore" in namespace "default" ...
helpers_test.go:344: "task-pv-pod-restore" [b1b318a6-959c-443e-945c-be042e6eba72] Pending
helpers_test.go:344: "task-pv-pod-restore" [b1b318a6-959c-443e-945c-be042e6eba72] Pending / Ready:ContainersNotReady (containers with unready status: [task-pv-container]) / ContainersReady:ContainersNotReady (containers with unready status: [task-pv-container])
helpers_test.go:344: "task-pv-pod-restore" [b1b318a6-959c-443e-945c-be042e6eba72] Running
addons_test.go:623: (dbg) TestAddons/parallel/CSI: app=task-pv-pod-restore healthy within 7.00390647s
addons_test.go:628: (dbg) Run:  kubectl --context addons-578168 delete pod task-pv-pod-restore
addons_test.go:632: (dbg) Run:  kubectl --context addons-578168 delete pvc hpvc-restore
addons_test.go:636: (dbg) Run:  kubectl --context addons-578168 delete volumesnapshot new-snapshot-demo
addons_test.go:640: (dbg) Run:  out/minikube-linux-arm64 -p addons-578168 addons disable csi-hostpath-driver --alsologtostderr -v=1
addons_test.go:640: (dbg) Done: out/minikube-linux-arm64 -p addons-578168 addons disable csi-hostpath-driver --alsologtostderr -v=1: (6.707845118s)
addons_test.go:644: (dbg) Run:  out/minikube-linux-arm64 -p addons-578168 addons disable volumesnapshots --alsologtostderr -v=1
--- PASS: TestAddons/parallel/CSI (48.93s)

                                                
                                    
x
+
TestAddons/parallel/Headlamp (11.97s)

                                                
                                                
=== RUN   TestAddons/parallel/Headlamp
=== PAUSE TestAddons/parallel/Headlamp

                                                
                                                

                                                
                                                
=== CONT  TestAddons/parallel/Headlamp
addons_test.go:826: (dbg) Run:  out/minikube-linux-arm64 addons enable headlamp -p addons-578168 --alsologtostderr -v=1
addons_test.go:831: (dbg) TestAddons/parallel/Headlamp: waiting 8m0s for pods matching "app.kubernetes.io/name=headlamp" in namespace "headlamp" ...
helpers_test.go:344: "headlamp-7867546754-58m48" [1e1dc2fb-41dc-493d-88f8-1076b401ee33] Pending
helpers_test.go:344: "headlamp-7867546754-58m48" [1e1dc2fb-41dc-493d-88f8-1076b401ee33] Pending / Ready:ContainersNotReady (containers with unready status: [headlamp]) / ContainersReady:ContainersNotReady (containers with unready status: [headlamp])
helpers_test.go:344: "headlamp-7867546754-58m48" [1e1dc2fb-41dc-493d-88f8-1076b401ee33] Running
addons_test.go:831: (dbg) TestAddons/parallel/Headlamp: app.kubernetes.io/name=headlamp healthy within 11.003735293s
--- PASS: TestAddons/parallel/Headlamp (11.97s)

                                                
                                    
x
+
TestAddons/parallel/CloudSpanner (6.56s)

                                                
                                                
=== RUN   TestAddons/parallel/CloudSpanner
=== PAUSE TestAddons/parallel/CloudSpanner

                                                
                                                

                                                
                                                
=== CONT  TestAddons/parallel/CloudSpanner
addons_test.go:859: (dbg) TestAddons/parallel/CloudSpanner: waiting 6m0s for pods matching "app=cloud-spanner-emulator" in namespace "default" ...
helpers_test.go:344: "cloud-spanner-emulator-6fcd4f6f98-pxxcj" [655ca789-19b5-4993-a444-13f0bc2e778c] Running
addons_test.go:859: (dbg) TestAddons/parallel/CloudSpanner: app=cloud-spanner-emulator healthy within 6.003776779s
addons_test.go:862: (dbg) Run:  out/minikube-linux-arm64 addons disable cloud-spanner -p addons-578168
--- PASS: TestAddons/parallel/CloudSpanner (6.56s)

                                                
                                    
x
+
TestAddons/parallel/LocalPath (52.42s)

                                                
                                                
=== RUN   TestAddons/parallel/LocalPath
=== PAUSE TestAddons/parallel/LocalPath

                                                
                                                

                                                
                                                
=== CONT  TestAddons/parallel/LocalPath
addons_test.go:974: (dbg) Run:  kubectl --context addons-578168 apply -f testdata/storage-provisioner-rancher/pvc.yaml
addons_test.go:980: (dbg) Run:  kubectl --context addons-578168 apply -f testdata/storage-provisioner-rancher/pod.yaml
addons_test.go:984: (dbg) TestAddons/parallel/LocalPath: waiting 5m0s for pvc "test-pvc" in namespace "default" ...
helpers_test.go:394: (dbg) Run:  kubectl --context addons-578168 get pvc test-pvc -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-578168 get pvc test-pvc -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-578168 get pvc test-pvc -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-578168 get pvc test-pvc -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-578168 get pvc test-pvc -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-578168 get pvc test-pvc -o jsonpath={.status.phase} -n default
addons_test.go:987: (dbg) TestAddons/parallel/LocalPath: waiting 3m0s for pods matching "run=test-local-path" in namespace "default" ...
helpers_test.go:344: "test-local-path" [9154e22e-2f55-4ac2-bf31-4ee6981b155a] Pending / Ready:ContainersNotReady (containers with unready status: [busybox]) / ContainersReady:ContainersNotReady (containers with unready status: [busybox])
helpers_test.go:344: "test-local-path" [9154e22e-2f55-4ac2-bf31-4ee6981b155a] Pending / Initialized:PodCompleted / Ready:PodCompleted / ContainersReady:PodCompleted
helpers_test.go:344: "test-local-path" [9154e22e-2f55-4ac2-bf31-4ee6981b155a] Succeeded / Initialized:PodCompleted / Ready:PodCompleted / ContainersReady:PodCompleted
addons_test.go:987: (dbg) TestAddons/parallel/LocalPath: run=test-local-path healthy within 3.004258286s
addons_test.go:992: (dbg) Run:  kubectl --context addons-578168 get pvc test-pvc -o=json
addons_test.go:1001: (dbg) Run:  out/minikube-linux-arm64 -p addons-578168 ssh "cat /opt/local-path-provisioner/pvc-3fa9736a-2470-4225-9ba0-57fda8a0f7a4_default_test-pvc/file1"
addons_test.go:1013: (dbg) Run:  kubectl --context addons-578168 delete pod test-local-path
addons_test.go:1017: (dbg) Run:  kubectl --context addons-578168 delete pvc test-pvc
addons_test.go:1021: (dbg) Run:  out/minikube-linux-arm64 -p addons-578168 addons disable storage-provisioner-rancher --alsologtostderr -v=1
addons_test.go:1021: (dbg) Done: out/minikube-linux-arm64 -p addons-578168 addons disable storage-provisioner-rancher --alsologtostderr -v=1: (43.309562734s)
--- PASS: TestAddons/parallel/LocalPath (52.42s)

                                                
                                    
x
+
TestAddons/parallel/NvidiaDevicePlugin (6.64s)

                                                
                                                
=== RUN   TestAddons/parallel/NvidiaDevicePlugin
=== PAUSE TestAddons/parallel/NvidiaDevicePlugin

                                                
                                                

                                                
                                                
=== CONT  TestAddons/parallel/NvidiaDevicePlugin
addons_test.go:1053: (dbg) TestAddons/parallel/NvidiaDevicePlugin: waiting 6m0s for pods matching "name=nvidia-device-plugin-ds" in namespace "kube-system" ...
helpers_test.go:344: "nvidia-device-plugin-daemonset-l6frr" [6baaf8fc-6bea-4c53-bfe3-053a25f4594d] Running
addons_test.go:1053: (dbg) TestAddons/parallel/NvidiaDevicePlugin: name=nvidia-device-plugin-ds healthy within 6.006655076s
addons_test.go:1056: (dbg) Run:  out/minikube-linux-arm64 addons disable nvidia-device-plugin -p addons-578168
--- PASS: TestAddons/parallel/NvidiaDevicePlugin (6.64s)

                                                
                                    
x
+
TestAddons/parallel/Yakd (5.01s)

                                                
                                                
=== RUN   TestAddons/parallel/Yakd
=== PAUSE TestAddons/parallel/Yakd

                                                
                                                

                                                
                                                
=== CONT  TestAddons/parallel/Yakd
addons_test.go:1064: (dbg) TestAddons/parallel/Yakd: waiting 2m0s for pods matching "app.kubernetes.io/name=yakd-dashboard" in namespace "yakd-dashboard" ...
helpers_test.go:344: "yakd-dashboard-799879c74f-dvdml" [2b51020d-6f48-40f4-8043-ad669a219fc8] Running
addons_test.go:1064: (dbg) TestAddons/parallel/Yakd: app.kubernetes.io/name=yakd-dashboard healthy within 5.0045006s
--- PASS: TestAddons/parallel/Yakd (5.01s)

                                                
                                    
x
+
TestAddons/serial/GCPAuth/Namespaces (0.18s)

                                                
                                                
=== RUN   TestAddons/serial/GCPAuth/Namespaces
addons_test.go:652: (dbg) Run:  kubectl --context addons-578168 create ns new-namespace
addons_test.go:666: (dbg) Run:  kubectl --context addons-578168 get secret gcp-auth -n new-namespace
--- PASS: TestAddons/serial/GCPAuth/Namespaces (0.18s)

                                                
                                    
x
+
TestAddons/StoppedEnableDisable (12.14s)

                                                
                                                
=== RUN   TestAddons/StoppedEnableDisable
addons_test.go:174: (dbg) Run:  out/minikube-linux-arm64 stop -p addons-578168
addons_test.go:174: (dbg) Done: out/minikube-linux-arm64 stop -p addons-578168: (11.894985726s)
addons_test.go:178: (dbg) Run:  out/minikube-linux-arm64 addons enable dashboard -p addons-578168
addons_test.go:182: (dbg) Run:  out/minikube-linux-arm64 addons disable dashboard -p addons-578168
addons_test.go:187: (dbg) Run:  out/minikube-linux-arm64 addons disable gvisor -p addons-578168
--- PASS: TestAddons/StoppedEnableDisable (12.14s)

                                                
                                    
x
+
TestCertOptions (37.54s)

                                                
                                                
=== RUN   TestCertOptions
=== PAUSE TestCertOptions

                                                
                                                

                                                
                                                
=== CONT  TestCertOptions
cert_options_test.go:49: (dbg) Run:  out/minikube-linux-arm64 start -p cert-options-708356 --memory=2048 --apiserver-ips=127.0.0.1 --apiserver-ips=192.168.15.15 --apiserver-names=localhost --apiserver-names=www.google.com --apiserver-port=8555 --driver=docker  --container-runtime=crio
cert_options_test.go:49: (dbg) Done: out/minikube-linux-arm64 start -p cert-options-708356 --memory=2048 --apiserver-ips=127.0.0.1 --apiserver-ips=192.168.15.15 --apiserver-names=localhost --apiserver-names=www.google.com --apiserver-port=8555 --driver=docker  --container-runtime=crio: (34.943804341s)
cert_options_test.go:60: (dbg) Run:  out/minikube-linux-arm64 -p cert-options-708356 ssh "openssl x509 -text -noout -in /var/lib/minikube/certs/apiserver.crt"
cert_options_test.go:88: (dbg) Run:  kubectl --context cert-options-708356 config view
cert_options_test.go:100: (dbg) Run:  out/minikube-linux-arm64 ssh -p cert-options-708356 -- "sudo cat /etc/kubernetes/admin.conf"
helpers_test.go:175: Cleaning up "cert-options-708356" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-arm64 delete -p cert-options-708356
helpers_test.go:178: (dbg) Done: out/minikube-linux-arm64 delete -p cert-options-708356: (1.965550966s)
--- PASS: TestCertOptions (37.54s)

                                                
                                    
x
+
TestCertExpiration (240.64s)

                                                
                                                
=== RUN   TestCertExpiration
=== PAUSE TestCertExpiration

                                                
                                                

                                                
                                                
=== CONT  TestCertExpiration
cert_options_test.go:123: (dbg) Run:  out/minikube-linux-arm64 start -p cert-expiration-208632 --memory=2048 --cert-expiration=3m --driver=docker  --container-runtime=crio
cert_options_test.go:123: (dbg) Done: out/minikube-linux-arm64 start -p cert-expiration-208632 --memory=2048 --cert-expiration=3m --driver=docker  --container-runtime=crio: (38.647621143s)
cert_options_test.go:131: (dbg) Run:  out/minikube-linux-arm64 start -p cert-expiration-208632 --memory=2048 --cert-expiration=8760h --driver=docker  --container-runtime=crio
cert_options_test.go:131: (dbg) Done: out/minikube-linux-arm64 start -p cert-expiration-208632 --memory=2048 --cert-expiration=8760h --driver=docker  --container-runtime=crio: (19.135934152s)
helpers_test.go:175: Cleaning up "cert-expiration-208632" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-arm64 delete -p cert-expiration-208632
E0722 11:24:19.083390    7564 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19313-2237/.minikube/profiles/functional-430070/client.crt: no such file or directory
helpers_test.go:178: (dbg) Done: out/minikube-linux-arm64 delete -p cert-expiration-208632: (2.852460553s)
--- PASS: TestCertExpiration (240.64s)

                                                
                                    
x
+
TestForceSystemdFlag (33.83s)

                                                
                                                
=== RUN   TestForceSystemdFlag
=== PAUSE TestForceSystemdFlag

                                                
                                                

                                                
                                                
=== CONT  TestForceSystemdFlag
docker_test.go:91: (dbg) Run:  out/minikube-linux-arm64 start -p force-systemd-flag-918505 --memory=2048 --force-systemd --alsologtostderr -v=5 --driver=docker  --container-runtime=crio
E0722 11:22:22.130246    7564 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19313-2237/.minikube/profiles/functional-430070/client.crt: no such file or directory
docker_test.go:91: (dbg) Done: out/minikube-linux-arm64 start -p force-systemd-flag-918505 --memory=2048 --force-systemd --alsologtostderr -v=5 --driver=docker  --container-runtime=crio: (31.253950762s)
docker_test.go:132: (dbg) Run:  out/minikube-linux-arm64 -p force-systemd-flag-918505 ssh "cat /etc/crio/crio.conf.d/02-crio.conf"
helpers_test.go:175: Cleaning up "force-systemd-flag-918505" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-arm64 delete -p force-systemd-flag-918505
helpers_test.go:178: (dbg) Done: out/minikube-linux-arm64 delete -p force-systemd-flag-918505: (2.294872913s)
--- PASS: TestForceSystemdFlag (33.83s)

                                                
                                    
x
+
TestForceSystemdEnv (39.33s)

                                                
                                                
=== RUN   TestForceSystemdEnv
=== PAUSE TestForceSystemdEnv

                                                
                                                

                                                
                                                
=== CONT  TestForceSystemdEnv
docker_test.go:155: (dbg) Run:  out/minikube-linux-arm64 start -p force-systemd-env-755259 --memory=2048 --alsologtostderr -v=5 --driver=docker  --container-runtime=crio
docker_test.go:155: (dbg) Done: out/minikube-linux-arm64 start -p force-systemd-env-755259 --memory=2048 --alsologtostderr -v=5 --driver=docker  --container-runtime=crio: (36.992342861s)
helpers_test.go:175: Cleaning up "force-systemd-env-755259" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-arm64 delete -p force-systemd-env-755259
helpers_test.go:178: (dbg) Done: out/minikube-linux-arm64 delete -p force-systemd-env-755259: (2.338823632s)
--- PASS: TestForceSystemdEnv (39.33s)

                                                
                                    
x
+
TestErrorSpam/setup (31.89s)

                                                
                                                
=== RUN   TestErrorSpam/setup
error_spam_test.go:81: (dbg) Run:  out/minikube-linux-arm64 start -p nospam-623628 -n=1 --memory=2250 --wait=false --log_dir=/tmp/nospam-623628 --driver=docker  --container-runtime=crio
error_spam_test.go:81: (dbg) Done: out/minikube-linux-arm64 start -p nospam-623628 -n=1 --memory=2250 --wait=false --log_dir=/tmp/nospam-623628 --driver=docker  --container-runtime=crio: (31.882010619s)
--- PASS: TestErrorSpam/setup (31.89s)

                                                
                                    
x
+
TestErrorSpam/start (0.66s)

                                                
                                                
=== RUN   TestErrorSpam/start
error_spam_test.go:216: Cleaning up 1 logfile(s) ...
error_spam_test.go:159: (dbg) Run:  out/minikube-linux-arm64 -p nospam-623628 --log_dir /tmp/nospam-623628 start --dry-run
error_spam_test.go:159: (dbg) Run:  out/minikube-linux-arm64 -p nospam-623628 --log_dir /tmp/nospam-623628 start --dry-run
error_spam_test.go:182: (dbg) Run:  out/minikube-linux-arm64 -p nospam-623628 --log_dir /tmp/nospam-623628 start --dry-run
--- PASS: TestErrorSpam/start (0.66s)

                                                
                                    
x
+
TestErrorSpam/status (0.98s)

                                                
                                                
=== RUN   TestErrorSpam/status
error_spam_test.go:216: Cleaning up 0 logfile(s) ...
error_spam_test.go:159: (dbg) Run:  out/minikube-linux-arm64 -p nospam-623628 --log_dir /tmp/nospam-623628 status
error_spam_test.go:159: (dbg) Run:  out/minikube-linux-arm64 -p nospam-623628 --log_dir /tmp/nospam-623628 status
error_spam_test.go:182: (dbg) Run:  out/minikube-linux-arm64 -p nospam-623628 --log_dir /tmp/nospam-623628 status
--- PASS: TestErrorSpam/status (0.98s)

                                                
                                    
x
+
TestErrorSpam/pause (1.66s)

                                                
                                                
=== RUN   TestErrorSpam/pause
error_spam_test.go:216: Cleaning up 0 logfile(s) ...
error_spam_test.go:159: (dbg) Run:  out/minikube-linux-arm64 -p nospam-623628 --log_dir /tmp/nospam-623628 pause
error_spam_test.go:159: (dbg) Run:  out/minikube-linux-arm64 -p nospam-623628 --log_dir /tmp/nospam-623628 pause
error_spam_test.go:182: (dbg) Run:  out/minikube-linux-arm64 -p nospam-623628 --log_dir /tmp/nospam-623628 pause
--- PASS: TestErrorSpam/pause (1.66s)

                                                
                                    
x
+
TestErrorSpam/unpause (1.69s)

                                                
                                                
=== RUN   TestErrorSpam/unpause
error_spam_test.go:216: Cleaning up 0 logfile(s) ...
error_spam_test.go:159: (dbg) Run:  out/minikube-linux-arm64 -p nospam-623628 --log_dir /tmp/nospam-623628 unpause
error_spam_test.go:159: (dbg) Run:  out/minikube-linux-arm64 -p nospam-623628 --log_dir /tmp/nospam-623628 unpause
error_spam_test.go:182: (dbg) Run:  out/minikube-linux-arm64 -p nospam-623628 --log_dir /tmp/nospam-623628 unpause
--- PASS: TestErrorSpam/unpause (1.69s)

                                                
                                    
x
+
TestErrorSpam/stop (1.42s)

                                                
                                                
=== RUN   TestErrorSpam/stop
error_spam_test.go:216: Cleaning up 0 logfile(s) ...
error_spam_test.go:159: (dbg) Run:  out/minikube-linux-arm64 -p nospam-623628 --log_dir /tmp/nospam-623628 stop
error_spam_test.go:159: (dbg) Done: out/minikube-linux-arm64 -p nospam-623628 --log_dir /tmp/nospam-623628 stop: (1.238162747s)
error_spam_test.go:159: (dbg) Run:  out/minikube-linux-arm64 -p nospam-623628 --log_dir /tmp/nospam-623628 stop
error_spam_test.go:182: (dbg) Run:  out/minikube-linux-arm64 -p nospam-623628 --log_dir /tmp/nospam-623628 stop
--- PASS: TestErrorSpam/stop (1.42s)

                                                
                                    
x
+
TestFunctional/serial/CopySyncFile (0s)

                                                
                                                
=== RUN   TestFunctional/serial/CopySyncFile
functional_test.go:1851: local sync path: /home/jenkins/minikube-integration/19313-2237/.minikube/files/etc/test/nested/copy/7564/hosts
--- PASS: TestFunctional/serial/CopySyncFile (0.00s)

                                                
                                    
x
+
TestFunctional/serial/StartWithProxy (58.89s)

                                                
                                                
=== RUN   TestFunctional/serial/StartWithProxy
functional_test.go:2230: (dbg) Run:  out/minikube-linux-arm64 start -p functional-430070 --memory=4000 --apiserver-port=8441 --wait=all --driver=docker  --container-runtime=crio
functional_test.go:2230: (dbg) Done: out/minikube-linux-arm64 start -p functional-430070 --memory=4000 --apiserver-port=8441 --wait=all --driver=docker  --container-runtime=crio: (58.890927002s)
--- PASS: TestFunctional/serial/StartWithProxy (58.89s)

                                                
                                    
x
+
TestFunctional/serial/AuditLog (0s)

                                                
                                                
=== RUN   TestFunctional/serial/AuditLog
--- PASS: TestFunctional/serial/AuditLog (0.00s)

                                                
                                    
x
+
TestFunctional/serial/SoftStart (30.22s)

                                                
                                                
=== RUN   TestFunctional/serial/SoftStart
functional_test.go:655: (dbg) Run:  out/minikube-linux-arm64 start -p functional-430070 --alsologtostderr -v=8
functional_test.go:655: (dbg) Done: out/minikube-linux-arm64 start -p functional-430070 --alsologtostderr -v=8: (30.214005165s)
functional_test.go:659: soft start took 30.218890834s for "functional-430070" cluster.
--- PASS: TestFunctional/serial/SoftStart (30.22s)

                                                
                                    
x
+
TestFunctional/serial/KubeContext (0.07s)

                                                
                                                
=== RUN   TestFunctional/serial/KubeContext
functional_test.go:677: (dbg) Run:  kubectl config current-context
--- PASS: TestFunctional/serial/KubeContext (0.07s)

                                                
                                    
x
+
TestFunctional/serial/KubectlGetPods (0.11s)

                                                
                                                
=== RUN   TestFunctional/serial/KubectlGetPods
functional_test.go:692: (dbg) Run:  kubectl --context functional-430070 get po -A
--- PASS: TestFunctional/serial/KubectlGetPods (0.11s)

                                                
                                    
x
+
TestFunctional/serial/CacheCmd/cache/add_remote (3.79s)

                                                
                                                
=== RUN   TestFunctional/serial/CacheCmd/cache/add_remote
functional_test.go:1045: (dbg) Run:  out/minikube-linux-arm64 -p functional-430070 cache add registry.k8s.io/pause:3.1
functional_test.go:1045: (dbg) Done: out/minikube-linux-arm64 -p functional-430070 cache add registry.k8s.io/pause:3.1: (1.405308792s)
functional_test.go:1045: (dbg) Run:  out/minikube-linux-arm64 -p functional-430070 cache add registry.k8s.io/pause:3.3
E0722 10:43:30.762255    7564 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19313-2237/.minikube/profiles/addons-578168/client.crt: no such file or directory
E0722 10:43:30.769537    7564 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19313-2237/.minikube/profiles/addons-578168/client.crt: no such file or directory
E0722 10:43:30.779791    7564 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19313-2237/.minikube/profiles/addons-578168/client.crt: no such file or directory
E0722 10:43:30.800024    7564 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19313-2237/.minikube/profiles/addons-578168/client.crt: no such file or directory
E0722 10:43:30.840328    7564 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19313-2237/.minikube/profiles/addons-578168/client.crt: no such file or directory
E0722 10:43:30.920563    7564 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19313-2237/.minikube/profiles/addons-578168/client.crt: no such file or directory
E0722 10:43:31.080993    7564 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19313-2237/.minikube/profiles/addons-578168/client.crt: no such file or directory
E0722 10:43:31.401594    7564 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19313-2237/.minikube/profiles/addons-578168/client.crt: no such file or directory
functional_test.go:1045: (dbg) Done: out/minikube-linux-arm64 -p functional-430070 cache add registry.k8s.io/pause:3.3: (1.270776574s)
functional_test.go:1045: (dbg) Run:  out/minikube-linux-arm64 -p functional-430070 cache add registry.k8s.io/pause:latest
E0722 10:43:32.042052    7564 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19313-2237/.minikube/profiles/addons-578168/client.crt: no such file or directory
functional_test.go:1045: (dbg) Done: out/minikube-linux-arm64 -p functional-430070 cache add registry.k8s.io/pause:latest: (1.112990817s)
--- PASS: TestFunctional/serial/CacheCmd/cache/add_remote (3.79s)

                                                
                                    
x
+
TestFunctional/serial/CacheCmd/cache/add_local (0.94s)

                                                
                                                
=== RUN   TestFunctional/serial/CacheCmd/cache/add_local
functional_test.go:1073: (dbg) Run:  docker build -t minikube-local-cache-test:functional-430070 /tmp/TestFunctionalserialCacheCmdcacheadd_local2486072772/001
functional_test.go:1085: (dbg) Run:  out/minikube-linux-arm64 -p functional-430070 cache add minikube-local-cache-test:functional-430070
E0722 10:43:33.322301    7564 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19313-2237/.minikube/profiles/addons-578168/client.crt: no such file or directory
functional_test.go:1090: (dbg) Run:  out/minikube-linux-arm64 -p functional-430070 cache delete minikube-local-cache-test:functional-430070
functional_test.go:1079: (dbg) Run:  docker rmi minikube-local-cache-test:functional-430070
--- PASS: TestFunctional/serial/CacheCmd/cache/add_local (0.94s)

                                                
                                    
x
+
TestFunctional/serial/CacheCmd/cache/CacheDelete (0.05s)

                                                
                                                
=== RUN   TestFunctional/serial/CacheCmd/cache/CacheDelete
functional_test.go:1098: (dbg) Run:  out/minikube-linux-arm64 cache delete registry.k8s.io/pause:3.3
--- PASS: TestFunctional/serial/CacheCmd/cache/CacheDelete (0.05s)

                                                
                                    
x
+
TestFunctional/serial/CacheCmd/cache/list (0.06s)

                                                
                                                
=== RUN   TestFunctional/serial/CacheCmd/cache/list
functional_test.go:1106: (dbg) Run:  out/minikube-linux-arm64 cache list
--- PASS: TestFunctional/serial/CacheCmd/cache/list (0.06s)

                                                
                                    
x
+
TestFunctional/serial/CacheCmd/cache/verify_cache_inside_node (0.3s)

                                                
                                                
=== RUN   TestFunctional/serial/CacheCmd/cache/verify_cache_inside_node
functional_test.go:1120: (dbg) Run:  out/minikube-linux-arm64 -p functional-430070 ssh sudo crictl images
--- PASS: TestFunctional/serial/CacheCmd/cache/verify_cache_inside_node (0.30s)

                                                
                                    
x
+
TestFunctional/serial/CacheCmd/cache/cache_reload (1.79s)

                                                
                                                
=== RUN   TestFunctional/serial/CacheCmd/cache/cache_reload
functional_test.go:1143: (dbg) Run:  out/minikube-linux-arm64 -p functional-430070 ssh sudo crictl rmi registry.k8s.io/pause:latest
functional_test.go:1149: (dbg) Run:  out/minikube-linux-arm64 -p functional-430070 ssh sudo crictl inspecti registry.k8s.io/pause:latest
functional_test.go:1149: (dbg) Non-zero exit: out/minikube-linux-arm64 -p functional-430070 ssh sudo crictl inspecti registry.k8s.io/pause:latest: exit status 1 (295.336838ms)

                                                
                                                
-- stdout --
	FATA[0000] no such image "registry.k8s.io/pause:latest" present 

                                                
                                                
-- /stdout --
** stderr ** 
	ssh: Process exited with status 1

                                                
                                                
** /stderr **
functional_test.go:1154: (dbg) Run:  out/minikube-linux-arm64 -p functional-430070 cache reload
functional_test.go:1159: (dbg) Run:  out/minikube-linux-arm64 -p functional-430070 ssh sudo crictl inspecti registry.k8s.io/pause:latest
--- PASS: TestFunctional/serial/CacheCmd/cache/cache_reload (1.79s)

                                                
                                    
x
+
TestFunctional/serial/CacheCmd/cache/delete (0.11s)

                                                
                                                
=== RUN   TestFunctional/serial/CacheCmd/cache/delete
functional_test.go:1168: (dbg) Run:  out/minikube-linux-arm64 cache delete registry.k8s.io/pause:3.1
functional_test.go:1168: (dbg) Run:  out/minikube-linux-arm64 cache delete registry.k8s.io/pause:latest
--- PASS: TestFunctional/serial/CacheCmd/cache/delete (0.11s)

                                                
                                    
x
+
TestFunctional/serial/MinikubeKubectlCmd (0.14s)

                                                
                                                
=== RUN   TestFunctional/serial/MinikubeKubectlCmd
functional_test.go:712: (dbg) Run:  out/minikube-linux-arm64 -p functional-430070 kubectl -- --context functional-430070 get pods
E0722 10:43:35.882644    7564 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19313-2237/.minikube/profiles/addons-578168/client.crt: no such file or directory
--- PASS: TestFunctional/serial/MinikubeKubectlCmd (0.14s)

                                                
                                    
x
+
TestFunctional/serial/MinikubeKubectlCmdDirectly (0.14s)

                                                
                                                
=== RUN   TestFunctional/serial/MinikubeKubectlCmdDirectly
functional_test.go:737: (dbg) Run:  out/kubectl --context functional-430070 get pods
--- PASS: TestFunctional/serial/MinikubeKubectlCmdDirectly (0.14s)

                                                
                                    
x
+
TestFunctional/serial/ExtraConfig (29.89s)

                                                
                                                
=== RUN   TestFunctional/serial/ExtraConfig
functional_test.go:753: (dbg) Run:  out/minikube-linux-arm64 start -p functional-430070 --extra-config=apiserver.enable-admission-plugins=NamespaceAutoProvision --wait=all
E0722 10:43:41.003506    7564 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19313-2237/.minikube/profiles/addons-578168/client.crt: no such file or directory
E0722 10:43:51.244593    7564 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19313-2237/.minikube/profiles/addons-578168/client.crt: no such file or directory
functional_test.go:753: (dbg) Done: out/minikube-linux-arm64 start -p functional-430070 --extra-config=apiserver.enable-admission-plugins=NamespaceAutoProvision --wait=all: (29.893655302s)
functional_test.go:757: restart took 29.893782876s for "functional-430070" cluster.
--- PASS: TestFunctional/serial/ExtraConfig (29.89s)

                                                
                                    
x
+
TestFunctional/serial/ComponentHealth (0.1s)

                                                
                                                
=== RUN   TestFunctional/serial/ComponentHealth
functional_test.go:806: (dbg) Run:  kubectl --context functional-430070 get po -l tier=control-plane -n kube-system -o=json
functional_test.go:821: etcd phase: Running
functional_test.go:831: etcd status: Ready
functional_test.go:821: kube-apiserver phase: Running
functional_test.go:831: kube-apiserver status: Ready
functional_test.go:821: kube-controller-manager phase: Running
functional_test.go:831: kube-controller-manager status: Ready
functional_test.go:821: kube-scheduler phase: Running
functional_test.go:831: kube-scheduler status: Ready
--- PASS: TestFunctional/serial/ComponentHealth (0.10s)

                                                
                                    
x
+
TestFunctional/serial/LogsCmd (1.79s)

                                                
                                                
=== RUN   TestFunctional/serial/LogsCmd
functional_test.go:1232: (dbg) Run:  out/minikube-linux-arm64 -p functional-430070 logs
functional_test.go:1232: (dbg) Done: out/minikube-linux-arm64 -p functional-430070 logs: (1.785667933s)
--- PASS: TestFunctional/serial/LogsCmd (1.79s)

                                                
                                    
x
+
TestFunctional/serial/LogsFileCmd (1.7s)

                                                
                                                
=== RUN   TestFunctional/serial/LogsFileCmd
functional_test.go:1246: (dbg) Run:  out/minikube-linux-arm64 -p functional-430070 logs --file /tmp/TestFunctionalserialLogsFileCmd1531118121/001/logs.txt
functional_test.go:1246: (dbg) Done: out/minikube-linux-arm64 -p functional-430070 logs --file /tmp/TestFunctionalserialLogsFileCmd1531118121/001/logs.txt: (1.703276678s)
--- PASS: TestFunctional/serial/LogsFileCmd (1.70s)

                                                
                                    
x
+
TestFunctional/serial/InvalidService (4.82s)

                                                
                                                
=== RUN   TestFunctional/serial/InvalidService
functional_test.go:2317: (dbg) Run:  kubectl --context functional-430070 apply -f testdata/invalidsvc.yaml
E0722 10:44:11.724860    7564 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19313-2237/.minikube/profiles/addons-578168/client.crt: no such file or directory
functional_test.go:2331: (dbg) Run:  out/minikube-linux-arm64 service invalid-svc -p functional-430070
functional_test.go:2331: (dbg) Non-zero exit: out/minikube-linux-arm64 service invalid-svc -p functional-430070: exit status 115 (732.451026ms)

                                                
                                                
-- stdout --
	|-----------|-------------|-------------|---------------------------|
	| NAMESPACE |    NAME     | TARGET PORT |            URL            |
	|-----------|-------------|-------------|---------------------------|
	| default   | invalid-svc |          80 | http://192.168.49.2:32514 |
	|-----------|-------------|-------------|---------------------------|
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	X Exiting due to SVC_UNREACHABLE: service not available: no running pod for service invalid-svc found
	* 
	╭─────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                             │
	│    * If the above advice does not help, please let us know:                                 │
	│      https://github.com/kubernetes/minikube/issues/new/choose                               │
	│                                                                                             │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │
	│    * Please also attach the following file to the GitHub issue:                             │
	│    * - /tmp/minikube_service_96b204199e3191fa1740d4430b018a3c8028d52d_0.log                 │
	│                                                                                             │
	╰─────────────────────────────────────────────────────────────────────────────────────────────╯

                                                
                                                
** /stderr **
functional_test.go:2323: (dbg) Run:  kubectl --context functional-430070 delete -f testdata/invalidsvc.yaml
--- PASS: TestFunctional/serial/InvalidService (4.82s)

                                                
                                    
x
+
TestFunctional/parallel/ConfigCmd (0.46s)

                                                
                                                
=== RUN   TestFunctional/parallel/ConfigCmd
=== PAUSE TestFunctional/parallel/ConfigCmd

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/ConfigCmd
functional_test.go:1195: (dbg) Run:  out/minikube-linux-arm64 -p functional-430070 config unset cpus
functional_test.go:1195: (dbg) Run:  out/minikube-linux-arm64 -p functional-430070 config get cpus
functional_test.go:1195: (dbg) Non-zero exit: out/minikube-linux-arm64 -p functional-430070 config get cpus: exit status 14 (82.020529ms)

                                                
                                                
** stderr ** 
	Error: specified key could not be found in config

                                                
                                                
** /stderr **
functional_test.go:1195: (dbg) Run:  out/minikube-linux-arm64 -p functional-430070 config set cpus 2
functional_test.go:1195: (dbg) Run:  out/minikube-linux-arm64 -p functional-430070 config get cpus
functional_test.go:1195: (dbg) Run:  out/minikube-linux-arm64 -p functional-430070 config unset cpus
functional_test.go:1195: (dbg) Run:  out/minikube-linux-arm64 -p functional-430070 config get cpus
functional_test.go:1195: (dbg) Non-zero exit: out/minikube-linux-arm64 -p functional-430070 config get cpus: exit status 14 (58.372714ms)

                                                
                                                
** stderr ** 
	Error: specified key could not be found in config

                                                
                                                
** /stderr **
--- PASS: TestFunctional/parallel/ConfigCmd (0.46s)

                                                
                                    
x
+
TestFunctional/parallel/DashboardCmd (9.62s)

                                                
                                                
=== RUN   TestFunctional/parallel/DashboardCmd
=== PAUSE TestFunctional/parallel/DashboardCmd

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/DashboardCmd
functional_test.go:901: (dbg) daemon: [out/minikube-linux-arm64 dashboard --url --port 36195 -p functional-430070 --alsologtostderr -v=1]
functional_test.go:906: (dbg) stopping [out/minikube-linux-arm64 dashboard --url --port 36195 -p functional-430070 --alsologtostderr -v=1] ...
helpers_test.go:508: unable to kill pid 36762: os: process already finished
--- PASS: TestFunctional/parallel/DashboardCmd (9.62s)

                                                
                                    
x
+
TestFunctional/parallel/DryRun (0.41s)

                                                
                                                
=== RUN   TestFunctional/parallel/DryRun
=== PAUSE TestFunctional/parallel/DryRun

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/DryRun
functional_test.go:970: (dbg) Run:  out/minikube-linux-arm64 start -p functional-430070 --dry-run --memory 250MB --alsologtostderr --driver=docker  --container-runtime=crio
functional_test.go:970: (dbg) Non-zero exit: out/minikube-linux-arm64 start -p functional-430070 --dry-run --memory 250MB --alsologtostderr --driver=docker  --container-runtime=crio: exit status 23 (181.795159ms)

                                                
                                                
-- stdout --
	* [functional-430070] minikube v1.33.1 on Ubuntu 20.04 (arm64)
	  - MINIKUBE_LOCATION=19313
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - KUBECONFIG=/home/jenkins/minikube-integration/19313-2237/kubeconfig
	  - MINIKUBE_HOME=/home/jenkins/minikube-integration/19313-2237/.minikube
	  - MINIKUBE_BIN=out/minikube-linux-arm64
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the docker driver based on existing profile
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0722 10:44:54.356332   36469 out.go:291] Setting OutFile to fd 1 ...
	I0722 10:44:54.356578   36469 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0722 10:44:54.356605   36469 out.go:304] Setting ErrFile to fd 2...
	I0722 10:44:54.356625   36469 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0722 10:44:54.356940   36469 root.go:338] Updating PATH: /home/jenkins/minikube-integration/19313-2237/.minikube/bin
	I0722 10:44:54.357398   36469 out.go:298] Setting JSON to false
	I0722 10:44:54.358375   36469 start.go:129] hostinfo: {"hostname":"ip-172-31-21-244","uptime":1639,"bootTime":1721643455,"procs":195,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1064-aws","kernelArch":"aarch64","virtualizationSystem":"","virtualizationRole":"","hostId":"da8ac1fd-6236-412a-a346-95873c98230d"}
	I0722 10:44:54.358466   36469 start.go:139] virtualization:  
	I0722 10:44:54.360701   36469 out.go:177] * [functional-430070] minikube v1.33.1 on Ubuntu 20.04 (arm64)
	I0722 10:44:54.362678   36469 out.go:177]   - MINIKUBE_LOCATION=19313
	I0722 10:44:54.362747   36469 notify.go:220] Checking for updates...
	I0722 10:44:54.366113   36469 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I0722 10:44:54.367829   36469 out.go:177]   - KUBECONFIG=/home/jenkins/minikube-integration/19313-2237/kubeconfig
	I0722 10:44:54.369512   36469 out.go:177]   - MINIKUBE_HOME=/home/jenkins/minikube-integration/19313-2237/.minikube
	I0722 10:44:54.371183   36469 out.go:177]   - MINIKUBE_BIN=out/minikube-linux-arm64
	I0722 10:44:54.373142   36469 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=
	I0722 10:44:54.375582   36469 config.go:182] Loaded profile config "functional-430070": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.30.3
	I0722 10:44:54.376212   36469 driver.go:392] Setting default libvirt URI to qemu:///system
	I0722 10:44:54.396187   36469 docker.go:123] docker version: linux-27.0.3:Docker Engine - Community
	I0722 10:44:54.396305   36469 cli_runner.go:164] Run: docker system info --format "{{json .}}"
	I0722 10:44:54.464952   36469 info.go:266] docker info: {ID:5FDH:SA5P:5GCT:NLAS:B73P:SGDQ:PBG5:UBVH:UZY3:RXGO:CI7S:WAIH Containers:1 ContainersRunning:1 ContainersPaused:0 ContainersStopped:0 Images:3 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:32 OomKillDisable:true NGoroutines:52 SystemTime:2024-07-22 10:44:54.448891628 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1064-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Architecture:aar
ch64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8214896640 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-21-244 Labels:[] ExperimentalBuild:false ServerVersion:27.0.3 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:2bf793ef6dc9a18e00cb12efb64355c2c9d5eb41 Expected:2bf793ef6dc9a18e00cb12efb64355c2c9d5eb41} RuncCommit:{ID:v1.1.13-0-g58aa920 Expected:v1.1.13-0-g58aa920} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:<nil> ServerErro
rs:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.15.1] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.28.1]] Warnings:<nil>}}
	I0722 10:44:54.465075   36469 docker.go:307] overlay module found
	I0722 10:44:54.467943   36469 out.go:177] * Using the docker driver based on existing profile
	I0722 10:44:54.469672   36469 start.go:297] selected driver: docker
	I0722 10:44:54.469693   36469 start.go:901] validating driver "docker" against &{Name:functional-430070 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721324606-19298@sha256:1c495b056df42bd3fd9a5c30d049e1802f9ed73a342611781f1ccc3c3853953f Memory:4000 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8441 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.30.3 ClusterName:functional-430070 Namespace:default APIServerHAVIP: APIServerNa
me:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[{Component:apiserver Key:enable-admission-plugins Value:NamespaceAutoProvision}] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.49.2 Port:8441 KubernetesVersion:v1.30.3 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[default-storageclass:true storage-provisioner:true] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP
: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I0722 10:44:54.469803   36469 start.go:912] status for docker: {Installed:true Healthy:true Running:false NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I0722 10:44:54.471740   36469 out.go:177] 
	W0722 10:44:54.473216   36469 out.go:239] X Exiting due to RSRC_INSUFFICIENT_REQ_MEMORY: Requested memory allocation 250MiB is less than the usable minimum of 1800MB
	X Exiting due to RSRC_INSUFFICIENT_REQ_MEMORY: Requested memory allocation 250MiB is less than the usable minimum of 1800MB
	I0722 10:44:54.475038   36469 out.go:177] 

                                                
                                                
** /stderr **
functional_test.go:987: (dbg) Run:  out/minikube-linux-arm64 start -p functional-430070 --dry-run --alsologtostderr -v=1 --driver=docker  --container-runtime=crio
--- PASS: TestFunctional/parallel/DryRun (0.41s)

                                                
                                    
x
+
TestFunctional/parallel/InternationalLanguage (0.17s)

                                                
                                                
=== RUN   TestFunctional/parallel/InternationalLanguage
=== PAUSE TestFunctional/parallel/InternationalLanguage

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/InternationalLanguage
functional_test.go:1016: (dbg) Run:  out/minikube-linux-arm64 start -p functional-430070 --dry-run --memory 250MB --alsologtostderr --driver=docker  --container-runtime=crio
functional_test.go:1016: (dbg) Non-zero exit: out/minikube-linux-arm64 start -p functional-430070 --dry-run --memory 250MB --alsologtostderr --driver=docker  --container-runtime=crio: exit status 23 (170.584937ms)

                                                
                                                
-- stdout --
	* [functional-430070] minikube v1.33.1 sur Ubuntu 20.04 (arm64)
	  - MINIKUBE_LOCATION=19313
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - KUBECONFIG=/home/jenkins/minikube-integration/19313-2237/kubeconfig
	  - MINIKUBE_HOME=/home/jenkins/minikube-integration/19313-2237/.minikube
	  - MINIKUBE_BIN=out/minikube-linux-arm64
	  - MINIKUBE_FORCE_SYSTEMD=
	* Utilisation du pilote docker basé sur le profil existant
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0722 10:44:54.752416   36583 out.go:291] Setting OutFile to fd 1 ...
	I0722 10:44:54.752548   36583 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0722 10:44:54.752607   36583 out.go:304] Setting ErrFile to fd 2...
	I0722 10:44:54.752615   36583 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0722 10:44:54.752977   36583 root.go:338] Updating PATH: /home/jenkins/minikube-integration/19313-2237/.minikube/bin
	I0722 10:44:54.753347   36583 out.go:298] Setting JSON to false
	I0722 10:44:54.754210   36583 start.go:129] hostinfo: {"hostname":"ip-172-31-21-244","uptime":1640,"bootTime":1721643455,"procs":195,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1064-aws","kernelArch":"aarch64","virtualizationSystem":"","virtualizationRole":"","hostId":"da8ac1fd-6236-412a-a346-95873c98230d"}
	I0722 10:44:54.754280   36583 start.go:139] virtualization:  
	I0722 10:44:54.757762   36583 out.go:177] * [functional-430070] minikube v1.33.1 sur Ubuntu 20.04 (arm64)
	I0722 10:44:54.759582   36583 out.go:177]   - MINIKUBE_LOCATION=19313
	I0722 10:44:54.759655   36583 notify.go:220] Checking for updates...
	I0722 10:44:54.763742   36583 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I0722 10:44:54.765900   36583 out.go:177]   - KUBECONFIG=/home/jenkins/minikube-integration/19313-2237/kubeconfig
	I0722 10:44:54.767840   36583 out.go:177]   - MINIKUBE_HOME=/home/jenkins/minikube-integration/19313-2237/.minikube
	I0722 10:44:54.769868   36583 out.go:177]   - MINIKUBE_BIN=out/minikube-linux-arm64
	I0722 10:44:54.773109   36583 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=
	I0722 10:44:54.775688   36583 config.go:182] Loaded profile config "functional-430070": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.30.3
	I0722 10:44:54.776214   36583 driver.go:392] Setting default libvirt URI to qemu:///system
	I0722 10:44:54.802852   36583 docker.go:123] docker version: linux-27.0.3:Docker Engine - Community
	I0722 10:44:54.802965   36583 cli_runner.go:164] Run: docker system info --format "{{json .}}"
	I0722 10:44:54.857016   36583 info.go:266] docker info: {ID:5FDH:SA5P:5GCT:NLAS:B73P:SGDQ:PBG5:UBVH:UZY3:RXGO:CI7S:WAIH Containers:1 ContainersRunning:1 ContainersPaused:0 ContainersStopped:0 Images:3 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:32 OomKillDisable:true NGoroutines:52 SystemTime:2024-07-22 10:44:54.847736021 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1064-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Architecture:aar
ch64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8214896640 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-21-244 Labels:[] ExperimentalBuild:false ServerVersion:27.0.3 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:2bf793ef6dc9a18e00cb12efb64355c2c9d5eb41 Expected:2bf793ef6dc9a18e00cb12efb64355c2c9d5eb41} RuncCommit:{ID:v1.1.13-0-g58aa920 Expected:v1.1.13-0-g58aa920} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:<nil> ServerErro
rs:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.15.1] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.28.1]] Warnings:<nil>}}
	I0722 10:44:54.857123   36583 docker.go:307] overlay module found
	I0722 10:44:54.859668   36583 out.go:177] * Utilisation du pilote docker basé sur le profil existant
	I0722 10:44:54.861778   36583 start.go:297] selected driver: docker
	I0722 10:44:54.861791   36583 start.go:901] validating driver "docker" against &{Name:functional-430070 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721324606-19298@sha256:1c495b056df42bd3fd9a5c30d049e1802f9ed73a342611781f1ccc3c3853953f Memory:4000 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8441 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.30.3 ClusterName:functional-430070 Namespace:default APIServerHAVIP: APIServerNa
me:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[{Component:apiserver Key:enable-admission-plugins Value:NamespaceAutoProvision}] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.49.2 Port:8441 KubernetesVersion:v1.30.3 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[default-storageclass:true storage-provisioner:true] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP
: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I0722 10:44:54.861895   36583 start.go:912] status for docker: {Installed:true Healthy:true Running:false NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I0722 10:44:54.864771   36583 out.go:177] 
	W0722 10:44:54.867300   36583 out.go:239] X Fermeture en raison de RSRC_INSUFFICIENT_REQ_MEMORY : L'allocation de mémoire demandée 250 Mio est inférieure au minimum utilisable de 1800 Mo
	X Fermeture en raison de RSRC_INSUFFICIENT_REQ_MEMORY : L'allocation de mémoire demandée 250 Mio est inférieure au minimum utilisable de 1800 Mo
	I0722 10:44:54.869667   36583 out.go:177] 

                                                
                                                
** /stderr **
--- PASS: TestFunctional/parallel/InternationalLanguage (0.17s)

                                                
                                    
x
+
TestFunctional/parallel/StatusCmd (0.99s)

                                                
                                                
=== RUN   TestFunctional/parallel/StatusCmd
=== PAUSE TestFunctional/parallel/StatusCmd

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/StatusCmd
functional_test.go:850: (dbg) Run:  out/minikube-linux-arm64 -p functional-430070 status
functional_test.go:856: (dbg) Run:  out/minikube-linux-arm64 -p functional-430070 status -f host:{{.Host}},kublet:{{.Kubelet}},apiserver:{{.APIServer}},kubeconfig:{{.Kubeconfig}}
functional_test.go:868: (dbg) Run:  out/minikube-linux-arm64 -p functional-430070 status -o json
--- PASS: TestFunctional/parallel/StatusCmd (0.99s)

                                                
                                    
x
+
TestFunctional/parallel/ServiceCmdConnect (7.66s)

                                                
                                                
=== RUN   TestFunctional/parallel/ServiceCmdConnect
=== PAUSE TestFunctional/parallel/ServiceCmdConnect

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/ServiceCmdConnect
functional_test.go:1623: (dbg) Run:  kubectl --context functional-430070 create deployment hello-node-connect --image=registry.k8s.io/echoserver-arm:1.8
functional_test.go:1631: (dbg) Run:  kubectl --context functional-430070 expose deployment hello-node-connect --type=NodePort --port=8080
functional_test.go:1636: (dbg) TestFunctional/parallel/ServiceCmdConnect: waiting 10m0s for pods matching "app=hello-node-connect" in namespace "default" ...
helpers_test.go:344: "hello-node-connect-6f49f58cd5-pxgxp" [54276904-4c51-4260-b8ca-ae25973fb6df] Pending / Ready:ContainersNotReady (containers with unready status: [echoserver-arm]) / ContainersReady:ContainersNotReady (containers with unready status: [echoserver-arm])
helpers_test.go:344: "hello-node-connect-6f49f58cd5-pxgxp" [54276904-4c51-4260-b8ca-ae25973fb6df] Running
functional_test.go:1636: (dbg) TestFunctional/parallel/ServiceCmdConnect: app=hello-node-connect healthy within 7.003949971s
functional_test.go:1645: (dbg) Run:  out/minikube-linux-arm64 -p functional-430070 service hello-node-connect --url
functional_test.go:1651: found endpoint for hello-node-connect: http://192.168.49.2:30740
functional_test.go:1671: http://192.168.49.2:30740: success! body:

                                                
                                                

                                                
                                                
Hostname: hello-node-connect-6f49f58cd5-pxgxp

                                                
                                                
Pod Information:
	-no pod information available-

                                                
                                                
Server values:
	server_version=nginx: 1.13.3 - lua: 10008

                                                
                                                
Request Information:
	client_address=10.244.0.1
	method=GET
	real path=/
	query=
	request_version=1.1
	request_uri=http://192.168.49.2:8080/

                                                
                                                
Request Headers:
	accept-encoding=gzip
	host=192.168.49.2:30740
	user-agent=Go-http-client/1.1

                                                
                                                
Request Body:
	-no body in request-

                                                
                                                
--- PASS: TestFunctional/parallel/ServiceCmdConnect (7.66s)

                                                
                                    
x
+
TestFunctional/parallel/AddonsCmd (0.15s)

                                                
                                                
=== RUN   TestFunctional/parallel/AddonsCmd
=== PAUSE TestFunctional/parallel/AddonsCmd

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/AddonsCmd
functional_test.go:1686: (dbg) Run:  out/minikube-linux-arm64 -p functional-430070 addons list
functional_test.go:1698: (dbg) Run:  out/minikube-linux-arm64 -p functional-430070 addons list -o json
--- PASS: TestFunctional/parallel/AddonsCmd (0.15s)

                                                
                                    
x
+
TestFunctional/parallel/PersistentVolumeClaim (24.74s)

                                                
                                                
=== RUN   TestFunctional/parallel/PersistentVolumeClaim
=== PAUSE TestFunctional/parallel/PersistentVolumeClaim

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/PersistentVolumeClaim
functional_test_pvc_test.go:44: (dbg) TestFunctional/parallel/PersistentVolumeClaim: waiting 4m0s for pods matching "integration-test=storage-provisioner" in namespace "kube-system" ...
helpers_test.go:344: "storage-provisioner" [91b9af69-a2b4-47be-abd2-261183f3e91e] Running
functional_test_pvc_test.go:44: (dbg) TestFunctional/parallel/PersistentVolumeClaim: integration-test=storage-provisioner healthy within 5.004845201s
functional_test_pvc_test.go:49: (dbg) Run:  kubectl --context functional-430070 get storageclass -o=json
functional_test_pvc_test.go:69: (dbg) Run:  kubectl --context functional-430070 apply -f testdata/storage-provisioner/pvc.yaml
functional_test_pvc_test.go:76: (dbg) Run:  kubectl --context functional-430070 get pvc myclaim -o=json
functional_test_pvc_test.go:125: (dbg) Run:  kubectl --context functional-430070 apply -f testdata/storage-provisioner/pod.yaml
functional_test_pvc_test.go:130: (dbg) TestFunctional/parallel/PersistentVolumeClaim: waiting 3m0s for pods matching "test=storage-provisioner" in namespace "default" ...
helpers_test.go:344: "sp-pod" [e4db9458-682f-414b-98bc-1760be7f057b] Pending
helpers_test.go:344: "sp-pod" [e4db9458-682f-414b-98bc-1760be7f057b] Pending / Ready:ContainersNotReady (containers with unready status: [myfrontend]) / ContainersReady:ContainersNotReady (containers with unready status: [myfrontend])
helpers_test.go:344: "sp-pod" [e4db9458-682f-414b-98bc-1760be7f057b] Running
functional_test_pvc_test.go:130: (dbg) TestFunctional/parallel/PersistentVolumeClaim: test=storage-provisioner healthy within 11.003815571s
functional_test_pvc_test.go:100: (dbg) Run:  kubectl --context functional-430070 exec sp-pod -- touch /tmp/mount/foo
functional_test_pvc_test.go:106: (dbg) Run:  kubectl --context functional-430070 delete -f testdata/storage-provisioner/pod.yaml
functional_test_pvc_test.go:125: (dbg) Run:  kubectl --context functional-430070 apply -f testdata/storage-provisioner/pod.yaml
functional_test_pvc_test.go:130: (dbg) TestFunctional/parallel/PersistentVolumeClaim: waiting 3m0s for pods matching "test=storage-provisioner" in namespace "default" ...
helpers_test.go:344: "sp-pod" [e0e45242-cac1-44a2-a593-17c9ee67e95e] Pending
helpers_test.go:344: "sp-pod" [e0e45242-cac1-44a2-a593-17c9ee67e95e] Pending / Ready:ContainersNotReady (containers with unready status: [myfrontend]) / ContainersReady:ContainersNotReady (containers with unready status: [myfrontend])
helpers_test.go:344: "sp-pod" [e0e45242-cac1-44a2-a593-17c9ee67e95e] Running
functional_test_pvc_test.go:130: (dbg) TestFunctional/parallel/PersistentVolumeClaim: test=storage-provisioner healthy within 7.012667565s
functional_test_pvc_test.go:114: (dbg) Run:  kubectl --context functional-430070 exec sp-pod -- ls /tmp/mount
--- PASS: TestFunctional/parallel/PersistentVolumeClaim (24.74s)

                                                
                                    
x
+
TestFunctional/parallel/SSHCmd (0.53s)

                                                
                                                
=== RUN   TestFunctional/parallel/SSHCmd
=== PAUSE TestFunctional/parallel/SSHCmd

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/SSHCmd
functional_test.go:1721: (dbg) Run:  out/minikube-linux-arm64 -p functional-430070 ssh "echo hello"
functional_test.go:1738: (dbg) Run:  out/minikube-linux-arm64 -p functional-430070 ssh "cat /etc/hostname"
--- PASS: TestFunctional/parallel/SSHCmd (0.53s)

                                                
                                    
x
+
TestFunctional/parallel/CpCmd (1.93s)

                                                
                                                
=== RUN   TestFunctional/parallel/CpCmd
=== PAUSE TestFunctional/parallel/CpCmd

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/CpCmd
helpers_test.go:556: (dbg) Run:  out/minikube-linux-arm64 -p functional-430070 cp testdata/cp-test.txt /home/docker/cp-test.txt
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p functional-430070 ssh -n functional-430070 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:556: (dbg) Run:  out/minikube-linux-arm64 -p functional-430070 cp functional-430070:/home/docker/cp-test.txt /tmp/TestFunctionalparallelCpCmd389588321/001/cp-test.txt
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p functional-430070 ssh -n functional-430070 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:556: (dbg) Run:  out/minikube-linux-arm64 -p functional-430070 cp testdata/cp-test.txt /tmp/does/not/exist/cp-test.txt
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p functional-430070 ssh -n functional-430070 "sudo cat /tmp/does/not/exist/cp-test.txt"
--- PASS: TestFunctional/parallel/CpCmd (1.93s)

                                                
                                    
x
+
TestFunctional/parallel/FileSync (0.31s)

                                                
                                                
=== RUN   TestFunctional/parallel/FileSync
=== PAUSE TestFunctional/parallel/FileSync

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/FileSync
functional_test.go:1925: Checking for existence of /etc/test/nested/copy/7564/hosts within VM
functional_test.go:1927: (dbg) Run:  out/minikube-linux-arm64 -p functional-430070 ssh "sudo cat /etc/test/nested/copy/7564/hosts"
functional_test.go:1932: file sync test content: Test file for checking file sync process
--- PASS: TestFunctional/parallel/FileSync (0.31s)

                                                
                                    
x
+
TestFunctional/parallel/CertSync (2.08s)

                                                
                                                
=== RUN   TestFunctional/parallel/CertSync
=== PAUSE TestFunctional/parallel/CertSync

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/CertSync
functional_test.go:1968: Checking for existence of /etc/ssl/certs/7564.pem within VM
functional_test.go:1969: (dbg) Run:  out/minikube-linux-arm64 -p functional-430070 ssh "sudo cat /etc/ssl/certs/7564.pem"
functional_test.go:1968: Checking for existence of /usr/share/ca-certificates/7564.pem within VM
functional_test.go:1969: (dbg) Run:  out/minikube-linux-arm64 -p functional-430070 ssh "sudo cat /usr/share/ca-certificates/7564.pem"
functional_test.go:1968: Checking for existence of /etc/ssl/certs/51391683.0 within VM
functional_test.go:1969: (dbg) Run:  out/minikube-linux-arm64 -p functional-430070 ssh "sudo cat /etc/ssl/certs/51391683.0"
functional_test.go:1995: Checking for existence of /etc/ssl/certs/75642.pem within VM
functional_test.go:1996: (dbg) Run:  out/minikube-linux-arm64 -p functional-430070 ssh "sudo cat /etc/ssl/certs/75642.pem"
functional_test.go:1995: Checking for existence of /usr/share/ca-certificates/75642.pem within VM
functional_test.go:1996: (dbg) Run:  out/minikube-linux-arm64 -p functional-430070 ssh "sudo cat /usr/share/ca-certificates/75642.pem"
functional_test.go:1995: Checking for existence of /etc/ssl/certs/3ec20f2e.0 within VM
functional_test.go:1996: (dbg) Run:  out/minikube-linux-arm64 -p functional-430070 ssh "sudo cat /etc/ssl/certs/3ec20f2e.0"
--- PASS: TestFunctional/parallel/CertSync (2.08s)

                                                
                                    
x
+
TestFunctional/parallel/NodeLabels (0.08s)

                                                
                                                
=== RUN   TestFunctional/parallel/NodeLabels
=== PAUSE TestFunctional/parallel/NodeLabels

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/NodeLabels
functional_test.go:218: (dbg) Run:  kubectl --context functional-430070 get nodes --output=go-template "--template='{{range $k, $v := (index .items 0).metadata.labels}}{{$k}} {{end}}'"
--- PASS: TestFunctional/parallel/NodeLabels (0.08s)

                                                
                                    
x
+
TestFunctional/parallel/NonActiveRuntimeDisabled (0.67s)

                                                
                                                
=== RUN   TestFunctional/parallel/NonActiveRuntimeDisabled
=== PAUSE TestFunctional/parallel/NonActiveRuntimeDisabled

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/NonActiveRuntimeDisabled
functional_test.go:2023: (dbg) Run:  out/minikube-linux-arm64 -p functional-430070 ssh "sudo systemctl is-active docker"
functional_test.go:2023: (dbg) Non-zero exit: out/minikube-linux-arm64 -p functional-430070 ssh "sudo systemctl is-active docker": exit status 1 (348.436945ms)

                                                
                                                
-- stdout --
	inactive

                                                
                                                
-- /stdout --
** stderr ** 
	ssh: Process exited with status 3

                                                
                                                
** /stderr **
functional_test.go:2023: (dbg) Run:  out/minikube-linux-arm64 -p functional-430070 ssh "sudo systemctl is-active containerd"
functional_test.go:2023: (dbg) Non-zero exit: out/minikube-linux-arm64 -p functional-430070 ssh "sudo systemctl is-active containerd": exit status 1 (319.28214ms)

                                                
                                                
-- stdout --
	inactive

                                                
                                                
-- /stdout --
** stderr ** 
	ssh: Process exited with status 3

                                                
                                                
** /stderr **
--- PASS: TestFunctional/parallel/NonActiveRuntimeDisabled (0.67s)

                                                
                                    
x
+
TestFunctional/parallel/License (0.34s)

                                                
                                                
=== RUN   TestFunctional/parallel/License
=== PAUSE TestFunctional/parallel/License

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/License
functional_test.go:2284: (dbg) Run:  out/minikube-linux-arm64 license
--- PASS: TestFunctional/parallel/License (0.34s)

                                                
                                    
x
+
TestFunctional/parallel/Version/short (0.09s)

                                                
                                                
=== RUN   TestFunctional/parallel/Version/short
=== PAUSE TestFunctional/parallel/Version/short

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/Version/short
functional_test.go:2252: (dbg) Run:  out/minikube-linux-arm64 -p functional-430070 version --short
--- PASS: TestFunctional/parallel/Version/short (0.09s)

                                                
                                    
x
+
TestFunctional/parallel/Version/components (1.13s)

                                                
                                                
=== RUN   TestFunctional/parallel/Version/components
=== PAUSE TestFunctional/parallel/Version/components

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/Version/components
functional_test.go:2266: (dbg) Run:  out/minikube-linux-arm64 -p functional-430070 version -o=json --components
functional_test.go:2266: (dbg) Done: out/minikube-linux-arm64 -p functional-430070 version -o=json --components: (1.129768488s)
--- PASS: TestFunctional/parallel/Version/components (1.13s)

                                                
                                    
x
+
TestFunctional/parallel/ImageCommands/ImageListShort (0.24s)

                                                
                                                
=== RUN   TestFunctional/parallel/ImageCommands/ImageListShort
=== PAUSE TestFunctional/parallel/ImageCommands/ImageListShort

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/ImageCommands/ImageListShort
functional_test.go:260: (dbg) Run:  out/minikube-linux-arm64 -p functional-430070 image ls --format short --alsologtostderr
functional_test.go:265: (dbg) Stdout: out/minikube-linux-arm64 -p functional-430070 image ls --format short --alsologtostderr:
registry.k8s.io/pause:latest
registry.k8s.io/pause:3.9
registry.k8s.io/pause:3.3
registry.k8s.io/pause:3.1
registry.k8s.io/kube-scheduler:v1.30.3
registry.k8s.io/kube-proxy:v1.30.3
registry.k8s.io/kube-controller-manager:v1.30.3
registry.k8s.io/kube-apiserver:v1.30.3
registry.k8s.io/etcd:3.5.12-0
registry.k8s.io/echoserver-arm:1.8
registry.k8s.io/coredns/coredns:v1.11.1
gcr.io/k8s-minikube/storage-provisioner:v5
gcr.io/k8s-minikube/busybox:1.28.4-glibc
docker.io/library/nginx:latest
docker.io/library/nginx:alpine
docker.io/kindest/kindnetd:v20240719-e7903573
docker.io/kindest/kindnetd:v20240715-585640e9
docker.io/kicbase/echo-server:functional-430070
functional_test.go:268: (dbg) Stderr: out/minikube-linux-arm64 -p functional-430070 image ls --format short --alsologtostderr:
I0722 10:44:58.559861   37096 out.go:291] Setting OutFile to fd 1 ...
I0722 10:44:58.560171   37096 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0722 10:44:58.560187   37096 out.go:304] Setting ErrFile to fd 2...
I0722 10:44:58.560193   37096 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0722 10:44:58.560419   37096 root.go:338] Updating PATH: /home/jenkins/minikube-integration/19313-2237/.minikube/bin
I0722 10:44:58.561060   37096 config.go:182] Loaded profile config "functional-430070": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.30.3
I0722 10:44:58.561178   37096 config.go:182] Loaded profile config "functional-430070": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.30.3
I0722 10:44:58.561628   37096 cli_runner.go:164] Run: docker container inspect functional-430070 --format={{.State.Status}}
I0722 10:44:58.579556   37096 ssh_runner.go:195] Run: systemctl --version
I0722 10:44:58.579613   37096 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" functional-430070
I0722 10:44:58.596465   37096 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32778 SSHKeyPath:/home/jenkins/minikube-integration/19313-2237/.minikube/machines/functional-430070/id_rsa Username:docker}
I0722 10:44:58.685897   37096 ssh_runner.go:195] Run: sudo crictl images --output json
--- PASS: TestFunctional/parallel/ImageCommands/ImageListShort (0.24s)

                                                
                                    
x
+
TestFunctional/parallel/ImageCommands/ImageListTable (0.22s)

                                                
                                                
=== RUN   TestFunctional/parallel/ImageCommands/ImageListTable
=== PAUSE TestFunctional/parallel/ImageCommands/ImageListTable

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/ImageCommands/ImageListTable
functional_test.go:260: (dbg) Run:  out/minikube-linux-arm64 -p functional-430070 image ls --format table --alsologtostderr
functional_test.go:265: (dbg) Stdout: out/minikube-linux-arm64 -p functional-430070 image ls --format table --alsologtostderr:
|-----------------------------------------|--------------------|---------------|--------|
|                  Image                  |        Tag         |   Image ID    |  Size  |
|-----------------------------------------|--------------------|---------------|--------|
| docker.io/library/nginx                 | latest             | 443d199e8bfcc | 197MB  |
| gcr.io/k8s-minikube/busybox             | latest             | 71a676dd070f4 | 1.63MB |
| registry.k8s.io/pause                   | 3.3                | 3d18732f8686c | 487kB  |
| docker.io/kicbase/echo-server           | functional-430070  | ce2d2cda2d858 | 4.79MB |
| docker.io/kindest/kindnetd              | v20240715-585640e9 | 5e32961ddcea3 | 90.3MB |
| localhost/my-image                      | functional-430070  | 0f57cfebbd5d3 | 1.64MB |
| registry.k8s.io/coredns/coredns         | v1.11.1            | 2437cf7621777 | 58.8MB |
| registry.k8s.io/kube-scheduler          | v1.30.3            | d48f992a22722 | 61.6MB |
| registry.k8s.io/echoserver-arm          | 1.8                | 72565bf5bbedf | 87.5MB |
| registry.k8s.io/etcd                    | 3.5.12-0           | 014faa467e297 | 140MB  |
| registry.k8s.io/kube-controller-manager | v1.30.3            | 8e97cdb19e7cc | 108MB  |
| docker.io/kindest/kindnetd              | v20240719-e7903573 | f42786f8afd22 | 90.3MB |
| docker.io/library/nginx                 | alpine             | 5461b18aaccf3 | 46.7MB |
| gcr.io/k8s-minikube/busybox             | 1.28.4-glibc       | 1611cd07b61d5 | 3.77MB |
| registry.k8s.io/kube-proxy              | v1.30.3            | 2351f570ed0ea | 89.2MB |
| registry.k8s.io/pause                   | 3.1                | 8057e0500773a | 529kB  |
| registry.k8s.io/pause                   | 3.9                | 829e9de338bd5 | 520kB  |
| registry.k8s.io/pause                   | latest             | 8cb2091f603e7 | 246kB  |
| gcr.io/k8s-minikube/storage-provisioner | v5                 | ba04bb24b9575 | 29MB   |
| registry.k8s.io/kube-apiserver          | v1.30.3            | 61773190d42ff | 114MB  |
|-----------------------------------------|--------------------|---------------|--------|
functional_test.go:268: (dbg) Stderr: out/minikube-linux-arm64 -p functional-430070 image ls --format table --alsologtostderr:
I0722 10:45:04.082606   37512 out.go:291] Setting OutFile to fd 1 ...
I0722 10:45:04.082742   37512 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0722 10:45:04.082753   37512 out.go:304] Setting ErrFile to fd 2...
I0722 10:45:04.082759   37512 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0722 10:45:04.083030   37512 root.go:338] Updating PATH: /home/jenkins/minikube-integration/19313-2237/.minikube/bin
I0722 10:45:04.083682   37512 config.go:182] Loaded profile config "functional-430070": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.30.3
I0722 10:45:04.083797   37512 config.go:182] Loaded profile config "functional-430070": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.30.3
I0722 10:45:04.084324   37512 cli_runner.go:164] Run: docker container inspect functional-430070 --format={{.State.Status}}
I0722 10:45:04.101450   37512 ssh_runner.go:195] Run: systemctl --version
I0722 10:45:04.101513   37512 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" functional-430070
I0722 10:45:04.118648   37512 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32778 SSHKeyPath:/home/jenkins/minikube-integration/19313-2237/.minikube/machines/functional-430070/id_rsa Username:docker}
I0722 10:45:04.205296   37512 ssh_runner.go:195] Run: sudo crictl images --output json
2024/07/22 10:45:04 [DEBUG] GET http://127.0.0.1:36195/api/v1/namespaces/kubernetes-dashboard/services/http:kubernetes-dashboard:/proxy/
--- PASS: TestFunctional/parallel/ImageCommands/ImageListTable (0.22s)

                                                
                                    
x
+
TestFunctional/parallel/ImageCommands/ImageListJson (0.24s)

                                                
                                                
=== RUN   TestFunctional/parallel/ImageCommands/ImageListJson
=== PAUSE TestFunctional/parallel/ImageCommands/ImageListJson

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/ImageCommands/ImageListJson
functional_test.go:260: (dbg) Run:  out/minikube-linux-arm64 -p functional-430070 image ls --format json --alsologtostderr
functional_test.go:265: (dbg) Stdout: out/minikube-linux-arm64 -p functional-430070 image ls --format json --alsologtostderr:
[{"id":"829e9de338bd5fdd3f16f68f83a9fb288fbc8453e881e5d5cfd0f6f2ff72b43e","repoDigests":["registry.k8s.io/pause@sha256:3ec98b8452dc8ae265a6917dfb81587ac78849e520d5dbba6de524851d20eca6","registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097"],"repoTags":["registry.k8s.io/pause:3.9"],"size":"520014"},{"id":"8cb2091f603e75187e2f6226c5901d12e00b1d1f778c6471ae4578e8a1c4724a","repoDigests":["registry.k8s.io/pause@sha256:f5e31d44aa14d5669e030380b656463a7e45934c03994e72e3dbf83d4a645cca"],"repoTags":["registry.k8s.io/pause:latest"],"size":"246070"},{"id":"ce2d2cda2d858fdaea84129deb86d18e5dbf1c548f230b79fdca74cc91729d17","repoDigests":["docker.io/kicbase/echo-server@sha256:49260110d6ce1914d3de292ed370ee11a2e34ab577b97e6011d795cb13534d4a"],"repoTags":["docker.io/kicbase/echo-server:functional-430070"],"size":"4788229"},{"id":"5e32961ddcea3ade65511b2e27f675bbda25305639279f8b708014019e8cebb2","repoDigests":["docker.io/kindest/kindnetd@sha256:88ed2adbc140254762f98fad7f4b16d27
9117356ebaf95aebf191713c828a493","docker.io/kindest/kindnetd@sha256:ca8545687e833593ef3047fdbb04957ab9a32153bc36738760b6975879ada987"],"repoTags":["docker.io/kindest/kindnetd:v20240715-585640e9"],"size":"90278450"},{"id":"aca1ded3c8f906a34a25f5d671a25d37d21eaa5bf08b1f435251372a65f8bd7e","repoDigests":["docker.io/library/3ed1aed9910b99375485bb4ac68a79720f0376c1d5907b0ac684515fc53dedaf-tmp@sha256:1fce4df2d78f86b1b230c0aeb60a2c19020b14d5d67277143280882d51dfb62a"],"repoTags":[],"size":"1637643"},{"id":"71a676dd070f4b701c3272e566d84951362f1326ea07d5bbad119d1c4f6b3d02","repoDigests":["gcr.io/k8s-minikube/busybox@sha256:a77fe109c026308f149d36484d795b42efe0fd29b332be9071f63e1634c36ac9","gcr.io/k8s-minikube/busybox@sha256:ca5ae90100d50772da31f3b5016209e25ad61972404e2ccd83d44f10dee7e79b"],"repoTags":["gcr.io/k8s-minikube/busybox:latest"],"size":"1634527"},{"id":"8e97cdb19e7cc420af7c71de8b5c9ab536bd278758c8c0878c464b833d91b31a","repoDigests":["registry.k8s.io/kube-controller-manager@sha256:078d7873222b53b4530e619e8dc5bc
cf8420557f3be2b4996a65e59ba4a09499","registry.k8s.io/kube-controller-manager@sha256:eff43da55a29a5e66ec9480f28233d733a6a8433b7a46f6e8c07086fa4ef69b7"],"repoTags":["registry.k8s.io/kube-controller-manager:v1.30.3"],"size":"108229958"},{"id":"d48f992a22722fc0290769b8fab1186db239bbad4cff837fbb641c55faef9355","repoDigests":["registry.k8s.io/kube-scheduler@sha256:2147ab5d2c73dd84e28332fcbee6826d1648eed30a531a52a96501b37d7ee4e4","registry.k8s.io/kube-scheduler@sha256:f194dea192a672732bc45ef2e7a0bcf28080ae6bd0626bd2c444edda987d7b95"],"repoTags":["registry.k8s.io/kube-scheduler:v1.30.3"],"size":"61568326"},{"id":"f42786f8afd2214fc59fbf9a26531806f562488d4a7d7a31e8b5e9ff6289b800","repoDigests":["docker.io/kindest/kindnetd@sha256:14100a3a7aca6cad3de3f26ee342ad937ca7d2844b1983d3baa7bf5f491baa7a","docker.io/kindest/kindnetd@sha256:da8ad203ec15a72c313015e5609db44bfad7c95d8ce63e87ff97c66363b5680a"],"repoTags":["docker.io/kindest/kindnetd:v20240719-e7903573"],"size":"90281007"},{"id":"a422e0e982356f6c1cf0e5bb7b733363caae3992
a07c99951fbcc73e58ed656a","repoDigests":["docker.io/kubernetesui/metrics-scraper@sha256:76049887f07a0476dc93efc2d3569b9529bf982b22d29f356092ce206e98765c","docker.io/kubernetesui/metrics-scraper@sha256:853c43f3cced687cb211708aa0024304a5adb33ec45ebf5915d318358822e09a"],"repoTags":[],"size":"42263767"},{"id":"5461b18aaccf366faf9fba071a5f1ac333cd13435366b32c5e9b8ec903fa18a1","repoDigests":["docker.io/library/nginx@sha256:a45ee5d042aaa9e81e013f97ae40c3dda26fbe98f22b6251acdf28e579560d55","docker.io/library/nginx@sha256:a7164ab2224553c2da2303d490474d4d546d2141eef1c6367a38d37d46992c62"],"repoTags":["docker.io/library/nginx:alpine"],"size":"46671377"},{"id":"1611cd07b61d57dbbfebe6db242513fd51e1c02d20ba08af17a45837d86a8a8c","repoDigests":["gcr.io/k8s-minikube/busybox@sha256:2d03e6ceeb99250061dd110530b0ece7998cd84121f952adef120ea7c5a6f00e","gcr.io/k8s-minikube/busybox@sha256:580b0aa58b210f512f818b7b7ef4f63c803f7a8cd6baf571b1462b79f7b7719e"],"repoTags":["gcr.io/k8s-minikube/busybox:1.28.4-glibc"],"size":"3774172"},{"id":
"2437cf762177702dec2dfe99a09c37427a15af6d9a57c456b65352667c223d93","repoDigests":["registry.k8s.io/coredns/coredns@sha256:1eeb4c7316bacb1d4c8ead65571cd92dd21e27359f0d4917f1a5822a73b75db1","registry.k8s.io/coredns/coredns@sha256:ba9e70dbdf0ff8a77ea63451bb1241d08819471730fe7a35a218a8db2ef7890c"],"repoTags":["registry.k8s.io/coredns/coredns:v1.11.1"],"size":"58812704"},{"id":"72565bf5bbedfb62e9d21afa2b1221b2c7a5e05b746dae33430bc550d3f87beb","repoDigests":["registry.k8s.io/echoserver-arm@sha256:b33d4cdf6ed097f4e9b77b135d83a596ab73c6268b0342648818eb85f5edfdb5"],"repoTags":["registry.k8s.io/echoserver-arm:1.8"],"size":"87536549"},{"id":"20b332c9a70d8516d849d1ac23eff5800cbb2f263d379f0ec11ee908db6b25a8","repoDigests":["docker.io/kubernetesui/dashboard@sha256:2e500d29e9d5f4a086b908eb8dfe7ecac57d2ab09d65b24f588b1d449841ef93","docker.io/kubernetesui/dashboard@sha256:5c52c60663b473628bd98e4ffee7a747ef1f88d8c7bcee957b089fb3f61bdedf"],"repoTags":[],"size":"247562353"},{"id":"443d199e8bfcce69c2aa494b36b5f8b04c3b183277cd1919
0e9589fd8552d618","repoDigests":["docker.io/library/nginx@sha256:67682bda769fae1ccf5183192b8daf37b64cae99c6c3302650f6f8bf5f0f95df","docker.io/library/nginx@sha256:9a3f8e8b2777851f98c569c91f8ebd6f21b0af188c245c38a0179086bb27782e"],"repoTags":["docker.io/library/nginx:latest"],"size":"197104786"},{"id":"0f57cfebbd5d3b1fff75971f5b545229ad8a1e0436e760c9afc6f50d9d6633c1","repoDigests":["localhost/my-image@sha256:ebf1b1ab07aa85af7b8a4b981509a576a48388e6d6114f42a7aefc5a45d800d7"],"repoTags":["localhost/my-image:functional-430070"],"size":"1640225"},{"id":"014faa467e29798aeef733fe6d1a3b5e382688217b053ad23410e6cccd5d22fd","repoDigests":["registry.k8s.io/etcd@sha256:44a8e24dcbba3470ee1fee21d5e88d128c936e9b55d4bc51fbef8086f8ed123b","registry.k8s.io/etcd@sha256:675d0e055ad04d9d6227bbb1aa88626bb1903a8b9b177c0353c6e1b3112952ad"],"repoTags":["registry.k8s.io/etcd:3.5.12-0"],"size":"140414767"},{"id":"2351f570ed0eac5533e538280d73c6aa5d6b6f6379f5f3fac08f51378621e6be","repoDigests":["registry.k8s.io/kube-proxy@sha256:22d1f9b07
34b7dbb2266b889edf456303746e750129e4d7f20699f23e9a31acc","registry.k8s.io/kube-proxy@sha256:b26e535e8ee1cbd7dc5642fb61bd36e9d23f32e9242ae0010b2905656e664f65"],"repoTags":["registry.k8s.io/kube-proxy:v1.30.3"],"size":"89199511"},{"id":"3d18732f8686cc3c878055d99a05fa80289502fa496b36b6a0fe0f77206a7300","repoDigests":["registry.k8s.io/pause@sha256:e59730b14890252c14f85976e22ab1c47ec28b111ffed407f34bca1b44447476"],"repoTags":["registry.k8s.io/pause:3.3"],"size":"487479"},{"id":"ba04bb24b95753201135cbc420b233c1b0b9fa2e1fd21d28319c348c33fbcde6","repoDigests":["gcr.io/k8s-minikube/storage-provisioner@sha256:0ba370588274b88531ab311a5d2e645d240a853555c1e58fd1dd428fc333c9d2","gcr.io/k8s-minikube/storage-provisioner@sha256:18eb69d1418e854ad5a19e399310e52808a8321e4c441c1dddad8977a0d7a944"],"repoTags":["gcr.io/k8s-minikube/storage-provisioner:v5"],"size":"29037500"},{"id":"61773190d42ff0792f3bab2658e80b1c07519170955bb350b153b564ef28f4ca","repoDigests":["registry.k8s.io/kube-apiserver@sha256:30d6b23df5ccf427536840a904047f3c
d946c9c78bf9750f0d82b18409d6089e","registry.k8s.io/kube-apiserver@sha256:a36d558835e48950f6d13b1edbe20605b8dfbc81e088f58221796631e107966c"],"repoTags":["registry.k8s.io/kube-apiserver:v1.30.3"],"size":"113538528"},{"id":"8057e0500773a37cde2cff041eb13ebd68c748419a2fbfd1dfb5bf38696cc8e5","repoDigests":["registry.k8s.io/pause@sha256:b0602c9f938379133ff8017007894b48c1112681c9468f82a1e4cbf8a4498b67"],"repoTags":["registry.k8s.io/pause:3.1"],"size":"528622"}]
functional_test.go:268: (dbg) Stderr: out/minikube-linux-arm64 -p functional-430070 image ls --format json --alsologtostderr:
I0722 10:45:03.848443   37480 out.go:291] Setting OutFile to fd 1 ...
I0722 10:45:03.848572   37480 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0722 10:45:03.848582   37480 out.go:304] Setting ErrFile to fd 2...
I0722 10:45:03.848588   37480 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0722 10:45:03.848809   37480 root.go:338] Updating PATH: /home/jenkins/minikube-integration/19313-2237/.minikube/bin
I0722 10:45:03.849441   37480 config.go:182] Loaded profile config "functional-430070": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.30.3
I0722 10:45:03.849557   37480 config.go:182] Loaded profile config "functional-430070": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.30.3
I0722 10:45:03.850006   37480 cli_runner.go:164] Run: docker container inspect functional-430070 --format={{.State.Status}}
I0722 10:45:03.866939   37480 ssh_runner.go:195] Run: systemctl --version
I0722 10:45:03.867004   37480 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" functional-430070
I0722 10:45:03.888223   37480 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32778 SSHKeyPath:/home/jenkins/minikube-integration/19313-2237/.minikube/machines/functional-430070/id_rsa Username:docker}
I0722 10:45:03.990221   37480 ssh_runner.go:195] Run: sudo crictl images --output json
--- PASS: TestFunctional/parallel/ImageCommands/ImageListJson (0.24s)

                                                
                                    
x
+
TestFunctional/parallel/ImageCommands/ImageListYaml (0.23s)

                                                
                                                
=== RUN   TestFunctional/parallel/ImageCommands/ImageListYaml
=== PAUSE TestFunctional/parallel/ImageCommands/ImageListYaml

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/ImageCommands/ImageListYaml
functional_test.go:260: (dbg) Run:  out/minikube-linux-arm64 -p functional-430070 image ls --format yaml --alsologtostderr
functional_test.go:265: (dbg) Stdout: out/minikube-linux-arm64 -p functional-430070 image ls --format yaml --alsologtostderr:
- id: 1611cd07b61d57dbbfebe6db242513fd51e1c02d20ba08af17a45837d86a8a8c
repoDigests:
- gcr.io/k8s-minikube/busybox@sha256:2d03e6ceeb99250061dd110530b0ece7998cd84121f952adef120ea7c5a6f00e
- gcr.io/k8s-minikube/busybox@sha256:580b0aa58b210f512f818b7b7ef4f63c803f7a8cd6baf571b1462b79f7b7719e
repoTags:
- gcr.io/k8s-minikube/busybox:1.28.4-glibc
size: "3774172"
- id: 2351f570ed0eac5533e538280d73c6aa5d6b6f6379f5f3fac08f51378621e6be
repoDigests:
- registry.k8s.io/kube-proxy@sha256:22d1f9b0734b7dbb2266b889edf456303746e750129e4d7f20699f23e9a31acc
- registry.k8s.io/kube-proxy@sha256:b26e535e8ee1cbd7dc5642fb61bd36e9d23f32e9242ae0010b2905656e664f65
repoTags:
- registry.k8s.io/kube-proxy:v1.30.3
size: "89199511"
- id: d48f992a22722fc0290769b8fab1186db239bbad4cff837fbb641c55faef9355
repoDigests:
- registry.k8s.io/kube-scheduler@sha256:2147ab5d2c73dd84e28332fcbee6826d1648eed30a531a52a96501b37d7ee4e4
- registry.k8s.io/kube-scheduler@sha256:f194dea192a672732bc45ef2e7a0bcf28080ae6bd0626bd2c444edda987d7b95
repoTags:
- registry.k8s.io/kube-scheduler:v1.30.3
size: "61568326"
- id: 8057e0500773a37cde2cff041eb13ebd68c748419a2fbfd1dfb5bf38696cc8e5
repoDigests:
- registry.k8s.io/pause@sha256:b0602c9f938379133ff8017007894b48c1112681c9468f82a1e4cbf8a4498b67
repoTags:
- registry.k8s.io/pause:3.1
size: "528622"
- id: ce2d2cda2d858fdaea84129deb86d18e5dbf1c548f230b79fdca74cc91729d17
repoDigests:
- docker.io/kicbase/echo-server@sha256:49260110d6ce1914d3de292ed370ee11a2e34ab577b97e6011d795cb13534d4a
repoTags:
- docker.io/kicbase/echo-server:functional-430070
size: "4788229"
- id: f42786f8afd2214fc59fbf9a26531806f562488d4a7d7a31e8b5e9ff6289b800
repoDigests:
- docker.io/kindest/kindnetd@sha256:14100a3a7aca6cad3de3f26ee342ad937ca7d2844b1983d3baa7bf5f491baa7a
- docker.io/kindest/kindnetd@sha256:da8ad203ec15a72c313015e5609db44bfad7c95d8ce63e87ff97c66363b5680a
repoTags:
- docker.io/kindest/kindnetd:v20240719-e7903573
size: "90281007"
- id: 61773190d42ff0792f3bab2658e80b1c07519170955bb350b153b564ef28f4ca
repoDigests:
- registry.k8s.io/kube-apiserver@sha256:30d6b23df5ccf427536840a904047f3cd946c9c78bf9750f0d82b18409d6089e
- registry.k8s.io/kube-apiserver@sha256:a36d558835e48950f6d13b1edbe20605b8dfbc81e088f58221796631e107966c
repoTags:
- registry.k8s.io/kube-apiserver:v1.30.3
size: "113538528"
- id: 5e32961ddcea3ade65511b2e27f675bbda25305639279f8b708014019e8cebb2
repoDigests:
- docker.io/kindest/kindnetd@sha256:88ed2adbc140254762f98fad7f4b16d279117356ebaf95aebf191713c828a493
- docker.io/kindest/kindnetd@sha256:ca8545687e833593ef3047fdbb04957ab9a32153bc36738760b6975879ada987
repoTags:
- docker.io/kindest/kindnetd:v20240715-585640e9
size: "90278450"
- id: a422e0e982356f6c1cf0e5bb7b733363caae3992a07c99951fbcc73e58ed656a
repoDigests:
- docker.io/kubernetesui/metrics-scraper@sha256:76049887f07a0476dc93efc2d3569b9529bf982b22d29f356092ce206e98765c
- docker.io/kubernetesui/metrics-scraper@sha256:853c43f3cced687cb211708aa0024304a5adb33ec45ebf5915d318358822e09a
repoTags: []
size: "42263767"
- id: 443d199e8bfcce69c2aa494b36b5f8b04c3b183277cd19190e9589fd8552d618
repoDigests:
- docker.io/library/nginx@sha256:67682bda769fae1ccf5183192b8daf37b64cae99c6c3302650f6f8bf5f0f95df
- docker.io/library/nginx@sha256:9a3f8e8b2777851f98c569c91f8ebd6f21b0af188c245c38a0179086bb27782e
repoTags:
- docker.io/library/nginx:latest
size: "197104786"
- id: ba04bb24b95753201135cbc420b233c1b0b9fa2e1fd21d28319c348c33fbcde6
repoDigests:
- gcr.io/k8s-minikube/storage-provisioner@sha256:0ba370588274b88531ab311a5d2e645d240a853555c1e58fd1dd428fc333c9d2
- gcr.io/k8s-minikube/storage-provisioner@sha256:18eb69d1418e854ad5a19e399310e52808a8321e4c441c1dddad8977a0d7a944
repoTags:
- gcr.io/k8s-minikube/storage-provisioner:v5
size: "29037500"
- id: 2437cf762177702dec2dfe99a09c37427a15af6d9a57c456b65352667c223d93
repoDigests:
- registry.k8s.io/coredns/coredns@sha256:1eeb4c7316bacb1d4c8ead65571cd92dd21e27359f0d4917f1a5822a73b75db1
- registry.k8s.io/coredns/coredns@sha256:ba9e70dbdf0ff8a77ea63451bb1241d08819471730fe7a35a218a8db2ef7890c
repoTags:
- registry.k8s.io/coredns/coredns:v1.11.1
size: "58812704"
- id: 014faa467e29798aeef733fe6d1a3b5e382688217b053ad23410e6cccd5d22fd
repoDigests:
- registry.k8s.io/etcd@sha256:44a8e24dcbba3470ee1fee21d5e88d128c936e9b55d4bc51fbef8086f8ed123b
- registry.k8s.io/etcd@sha256:675d0e055ad04d9d6227bbb1aa88626bb1903a8b9b177c0353c6e1b3112952ad
repoTags:
- registry.k8s.io/etcd:3.5.12-0
size: "140414767"
- id: 8e97cdb19e7cc420af7c71de8b5c9ab536bd278758c8c0878c464b833d91b31a
repoDigests:
- registry.k8s.io/kube-controller-manager@sha256:078d7873222b53b4530e619e8dc5bccf8420557f3be2b4996a65e59ba4a09499
- registry.k8s.io/kube-controller-manager@sha256:eff43da55a29a5e66ec9480f28233d733a6a8433b7a46f6e8c07086fa4ef69b7
repoTags:
- registry.k8s.io/kube-controller-manager:v1.30.3
size: "108229958"
- id: 829e9de338bd5fdd3f16f68f83a9fb288fbc8453e881e5d5cfd0f6f2ff72b43e
repoDigests:
- registry.k8s.io/pause@sha256:3ec98b8452dc8ae265a6917dfb81587ac78849e520d5dbba6de524851d20eca6
- registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097
repoTags:
- registry.k8s.io/pause:3.9
size: "520014"
- id: 8cb2091f603e75187e2f6226c5901d12e00b1d1f778c6471ae4578e8a1c4724a
repoDigests:
- registry.k8s.io/pause@sha256:f5e31d44aa14d5669e030380b656463a7e45934c03994e72e3dbf83d4a645cca
repoTags:
- registry.k8s.io/pause:latest
size: "246070"
- id: 5461b18aaccf366faf9fba071a5f1ac333cd13435366b32c5e9b8ec903fa18a1
repoDigests:
- docker.io/library/nginx@sha256:a45ee5d042aaa9e81e013f97ae40c3dda26fbe98f22b6251acdf28e579560d55
- docker.io/library/nginx@sha256:a7164ab2224553c2da2303d490474d4d546d2141eef1c6367a38d37d46992c62
repoTags:
- docker.io/library/nginx:alpine
size: "46671377"
- id: 72565bf5bbedfb62e9d21afa2b1221b2c7a5e05b746dae33430bc550d3f87beb
repoDigests:
- registry.k8s.io/echoserver-arm@sha256:b33d4cdf6ed097f4e9b77b135d83a596ab73c6268b0342648818eb85f5edfdb5
repoTags:
- registry.k8s.io/echoserver-arm:1.8
size: "87536549"
- id: 3d18732f8686cc3c878055d99a05fa80289502fa496b36b6a0fe0f77206a7300
repoDigests:
- registry.k8s.io/pause@sha256:e59730b14890252c14f85976e22ab1c47ec28b111ffed407f34bca1b44447476
repoTags:
- registry.k8s.io/pause:3.3
size: "487479"

                                                
                                                
functional_test.go:268: (dbg) Stderr: out/minikube-linux-arm64 -p functional-430070 image ls --format yaml --alsologtostderr:
I0722 10:44:58.784543   37144 out.go:291] Setting OutFile to fd 1 ...
I0722 10:44:58.784738   37144 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0722 10:44:58.784752   37144 out.go:304] Setting ErrFile to fd 2...
I0722 10:44:58.784759   37144 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0722 10:44:58.785056   37144 root.go:338] Updating PATH: /home/jenkins/minikube-integration/19313-2237/.minikube/bin
I0722 10:44:58.785702   37144 config.go:182] Loaded profile config "functional-430070": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.30.3
I0722 10:44:58.785816   37144 config.go:182] Loaded profile config "functional-430070": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.30.3
I0722 10:44:58.786274   37144 cli_runner.go:164] Run: docker container inspect functional-430070 --format={{.State.Status}}
I0722 10:44:58.802791   37144 ssh_runner.go:195] Run: systemctl --version
I0722 10:44:58.802853   37144 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" functional-430070
I0722 10:44:58.818814   37144 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32778 SSHKeyPath:/home/jenkins/minikube-integration/19313-2237/.minikube/machines/functional-430070/id_rsa Username:docker}
I0722 10:44:58.910462   37144 ssh_runner.go:195] Run: sudo crictl images --output json
--- PASS: TestFunctional/parallel/ImageCommands/ImageListYaml (0.23s)

                                                
                                    
x
+
TestFunctional/parallel/ImageCommands/ImageBuild (4.83s)

                                                
                                                
=== RUN   TestFunctional/parallel/ImageCommands/ImageBuild
=== PAUSE TestFunctional/parallel/ImageCommands/ImageBuild

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/ImageCommands/ImageBuild
functional_test.go:307: (dbg) Run:  out/minikube-linux-arm64 -p functional-430070 ssh pgrep buildkitd
functional_test.go:307: (dbg) Non-zero exit: out/minikube-linux-arm64 -p functional-430070 ssh pgrep buildkitd: exit status 1 (285.724089ms)

                                                
                                                
** stderr ** 
	ssh: Process exited with status 1

                                                
                                                
** /stderr **
functional_test.go:314: (dbg) Run:  out/minikube-linux-arm64 -p functional-430070 image build -t localhost/my-image:functional-430070 testdata/build --alsologtostderr
functional_test.go:314: (dbg) Done: out/minikube-linux-arm64 -p functional-430070 image build -t localhost/my-image:functional-430070 testdata/build --alsologtostderr: (4.295943777s)
functional_test.go:319: (dbg) Stdout: out/minikube-linux-arm64 -p functional-430070 image build -t localhost/my-image:functional-430070 testdata/build --alsologtostderr:
STEP 1/3: FROM gcr.io/k8s-minikube/busybox
STEP 2/3: RUN true
--> aca1ded3c8f
STEP 3/3: ADD content.txt /
COMMIT localhost/my-image:functional-430070
--> 0f57cfebbd5
Successfully tagged localhost/my-image:functional-430070
0f57cfebbd5d3b1fff75971f5b545229ad8a1e0436e760c9afc6f50d9d6633c1
functional_test.go:322: (dbg) Stderr: out/minikube-linux-arm64 -p functional-430070 image build -t localhost/my-image:functional-430070 testdata/build --alsologtostderr:
I0722 10:44:59.318522   37237 out.go:291] Setting OutFile to fd 1 ...
I0722 10:44:59.318759   37237 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0722 10:44:59.318825   37237 out.go:304] Setting ErrFile to fd 2...
I0722 10:44:59.318847   37237 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0722 10:44:59.319117   37237 root.go:338] Updating PATH: /home/jenkins/minikube-integration/19313-2237/.minikube/bin
I0722 10:44:59.319954   37237 config.go:182] Loaded profile config "functional-430070": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.30.3
I0722 10:44:59.322027   37237 config.go:182] Loaded profile config "functional-430070": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.30.3
I0722 10:44:59.322800   37237 cli_runner.go:164] Run: docker container inspect functional-430070 --format={{.State.Status}}
I0722 10:44:59.343890   37237 ssh_runner.go:195] Run: systemctl --version
I0722 10:44:59.343938   37237 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" functional-430070
I0722 10:44:59.363942   37237 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32778 SSHKeyPath:/home/jenkins/minikube-integration/19313-2237/.minikube/machines/functional-430070/id_rsa Username:docker}
I0722 10:44:59.466412   37237 build_images.go:161] Building image from path: /tmp/build.2956400865.tar
I0722 10:44:59.466483   37237 ssh_runner.go:195] Run: sudo mkdir -p /var/lib/minikube/build
I0722 10:44:59.478817   37237 ssh_runner.go:195] Run: stat -c "%s %y" /var/lib/minikube/build/build.2956400865.tar
I0722 10:44:59.484143   37237 ssh_runner.go:352] existence check for /var/lib/minikube/build/build.2956400865.tar: stat -c "%s %y" /var/lib/minikube/build/build.2956400865.tar: Process exited with status 1
stdout:

                                                
                                                
stderr:
stat: cannot statx '/var/lib/minikube/build/build.2956400865.tar': No such file or directory
I0722 10:44:59.484309   37237 ssh_runner.go:362] scp /tmp/build.2956400865.tar --> /var/lib/minikube/build/build.2956400865.tar (3072 bytes)
I0722 10:44:59.517283   37237 ssh_runner.go:195] Run: sudo mkdir -p /var/lib/minikube/build/build.2956400865
I0722 10:44:59.527572   37237 ssh_runner.go:195] Run: sudo tar -C /var/lib/minikube/build/build.2956400865 -xf /var/lib/minikube/build/build.2956400865.tar
I0722 10:44:59.538435   37237 crio.go:315] Building image: /var/lib/minikube/build/build.2956400865
I0722 10:44:59.538557   37237 ssh_runner.go:195] Run: sudo podman build -t localhost/my-image:functional-430070 /var/lib/minikube/build/build.2956400865 --cgroup-manager=cgroupfs
Trying to pull gcr.io/k8s-minikube/busybox:latest...
Getting image source signatures
Copying blob sha256:a01966dde7f8d5ba10b6d87e776c7c8fb5a5f6bfa678874bd28b33b1fc6dba34
Copying blob sha256:a01966dde7f8d5ba10b6d87e776c7c8fb5a5f6bfa678874bd28b33b1fc6dba34
Copying config sha256:71a676dd070f4b701c3272e566d84951362f1326ea07d5bbad119d1c4f6b3d02
Writing manifest to image destination
Storing signatures
I0722 10:45:03.521722   37237 ssh_runner.go:235] Completed: sudo podman build -t localhost/my-image:functional-430070 /var/lib/minikube/build/build.2956400865 --cgroup-manager=cgroupfs: (3.983053291s)
I0722 10:45:03.521781   37237 ssh_runner.go:195] Run: sudo rm -rf /var/lib/minikube/build/build.2956400865
I0722 10:45:03.531509   37237 ssh_runner.go:195] Run: sudo rm -f /var/lib/minikube/build/build.2956400865.tar
I0722 10:45:03.540930   37237 build_images.go:217] Built localhost/my-image:functional-430070 from /tmp/build.2956400865.tar
I0722 10:45:03.540958   37237 build_images.go:133] succeeded building to: functional-430070
I0722 10:45:03.540973   37237 build_images.go:134] failed building to: 
functional_test.go:447: (dbg) Run:  out/minikube-linux-arm64 -p functional-430070 image ls
--- PASS: TestFunctional/parallel/ImageCommands/ImageBuild (4.83s)

                                                
                                    
x
+
TestFunctional/parallel/ImageCommands/Setup (0.74s)

                                                
                                                
=== RUN   TestFunctional/parallel/ImageCommands/Setup
functional_test.go:341: (dbg) Run:  docker pull docker.io/kicbase/echo-server:1.0
functional_test.go:346: (dbg) Run:  docker tag docker.io/kicbase/echo-server:1.0 docker.io/kicbase/echo-server:functional-430070
--- PASS: TestFunctional/parallel/ImageCommands/Setup (0.74s)

                                                
                                    
x
+
TestFunctional/parallel/UpdateContextCmd/no_changes (0.23s)

                                                
                                                
=== RUN   TestFunctional/parallel/UpdateContextCmd/no_changes
=== PAUSE TestFunctional/parallel/UpdateContextCmd/no_changes

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/UpdateContextCmd/no_changes
functional_test.go:2115: (dbg) Run:  out/minikube-linux-arm64 -p functional-430070 update-context --alsologtostderr -v=2
--- PASS: TestFunctional/parallel/UpdateContextCmd/no_changes (0.23s)

                                                
                                    
x
+
TestFunctional/parallel/UpdateContextCmd/no_minikube_cluster (0.19s)

                                                
                                                
=== RUN   TestFunctional/parallel/UpdateContextCmd/no_minikube_cluster
=== PAUSE TestFunctional/parallel/UpdateContextCmd/no_minikube_cluster

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/UpdateContextCmd/no_minikube_cluster
functional_test.go:2115: (dbg) Run:  out/minikube-linux-arm64 -p functional-430070 update-context --alsologtostderr -v=2
--- PASS: TestFunctional/parallel/UpdateContextCmd/no_minikube_cluster (0.19s)

                                                
                                    
x
+
TestFunctional/parallel/UpdateContextCmd/no_clusters (0.23s)

                                                
                                                
=== RUN   TestFunctional/parallel/UpdateContextCmd/no_clusters
=== PAUSE TestFunctional/parallel/UpdateContextCmd/no_clusters

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/UpdateContextCmd/no_clusters
functional_test.go:2115: (dbg) Run:  out/minikube-linux-arm64 -p functional-430070 update-context --alsologtostderr -v=2
--- PASS: TestFunctional/parallel/UpdateContextCmd/no_clusters (0.23s)

                                                
                                    
x
+
TestFunctional/parallel/ImageCommands/ImageLoadDaemon (1.45s)

                                                
                                                
=== RUN   TestFunctional/parallel/ImageCommands/ImageLoadDaemon
functional_test.go:354: (dbg) Run:  out/minikube-linux-arm64 -p functional-430070 image load --daemon docker.io/kicbase/echo-server:functional-430070 --alsologtostderr
functional_test.go:354: (dbg) Done: out/minikube-linux-arm64 -p functional-430070 image load --daemon docker.io/kicbase/echo-server:functional-430070 --alsologtostderr: (1.19326203s)
functional_test.go:447: (dbg) Run:  out/minikube-linux-arm64 -p functional-430070 image ls
--- PASS: TestFunctional/parallel/ImageCommands/ImageLoadDaemon (1.45s)

                                                
                                    
x
+
TestFunctional/parallel/ImageCommands/ImageReloadDaemon (1.13s)

                                                
                                                
=== RUN   TestFunctional/parallel/ImageCommands/ImageReloadDaemon
functional_test.go:364: (dbg) Run:  out/minikube-linux-arm64 -p functional-430070 image load --daemon docker.io/kicbase/echo-server:functional-430070 --alsologtostderr
functional_test.go:447: (dbg) Run:  out/minikube-linux-arm64 -p functional-430070 image ls
--- PASS: TestFunctional/parallel/ImageCommands/ImageReloadDaemon (1.13s)

                                                
                                    
x
+
TestFunctional/parallel/ServiceCmd/DeployApp (11.27s)

                                                
                                                
=== RUN   TestFunctional/parallel/ServiceCmd/DeployApp
functional_test.go:1433: (dbg) Run:  kubectl --context functional-430070 create deployment hello-node --image=registry.k8s.io/echoserver-arm:1.8
functional_test.go:1441: (dbg) Run:  kubectl --context functional-430070 expose deployment hello-node --type=NodePort --port=8080
functional_test.go:1446: (dbg) TestFunctional/parallel/ServiceCmd/DeployApp: waiting 10m0s for pods matching "app=hello-node" in namespace "default" ...
helpers_test.go:344: "hello-node-65f5d5cc78-xhk7r" [4367ea3e-0ad4-4fda-9387-87256184ab86] Pending / Ready:ContainersNotReady (containers with unready status: [echoserver-arm]) / ContainersReady:ContainersNotReady (containers with unready status: [echoserver-arm])
helpers_test.go:344: "hello-node-65f5d5cc78-xhk7r" [4367ea3e-0ad4-4fda-9387-87256184ab86] Running
functional_test.go:1446: (dbg) TestFunctional/parallel/ServiceCmd/DeployApp: app=hello-node healthy within 11.003603354s
--- PASS: TestFunctional/parallel/ServiceCmd/DeployApp (11.27s)

                                                
                                    
x
+
TestFunctional/parallel/ImageCommands/ImageTagAndLoadDaemon (1.34s)

                                                
                                                
=== RUN   TestFunctional/parallel/ImageCommands/ImageTagAndLoadDaemon
functional_test.go:234: (dbg) Run:  docker pull docker.io/kicbase/echo-server:latest
functional_test.go:239: (dbg) Run:  docker tag docker.io/kicbase/echo-server:latest docker.io/kicbase/echo-server:functional-430070
functional_test.go:244: (dbg) Run:  out/minikube-linux-arm64 -p functional-430070 image load --daemon docker.io/kicbase/echo-server:functional-430070 --alsologtostderr
functional_test.go:447: (dbg) Run:  out/minikube-linux-arm64 -p functional-430070 image ls
--- PASS: TestFunctional/parallel/ImageCommands/ImageTagAndLoadDaemon (1.34s)

                                                
                                    
x
+
TestFunctional/parallel/ImageCommands/ImageSaveToFile (2.3s)

                                                
                                                
=== RUN   TestFunctional/parallel/ImageCommands/ImageSaveToFile
functional_test.go:379: (dbg) Run:  out/minikube-linux-arm64 -p functional-430070 image save docker.io/kicbase/echo-server:functional-430070 /home/jenkins/workspace/Docker_Linux_crio_arm64/echo-server-save.tar --alsologtostderr
functional_test.go:379: (dbg) Done: out/minikube-linux-arm64 -p functional-430070 image save docker.io/kicbase/echo-server:functional-430070 /home/jenkins/workspace/Docker_Linux_crio_arm64/echo-server-save.tar --alsologtostderr: (2.299395996s)
--- PASS: TestFunctional/parallel/ImageCommands/ImageSaveToFile (2.30s)

                                                
                                    
x
+
TestFunctional/parallel/ImageCommands/ImageRemove (0.45s)

                                                
                                                
=== RUN   TestFunctional/parallel/ImageCommands/ImageRemove
functional_test.go:391: (dbg) Run:  out/minikube-linux-arm64 -p functional-430070 image rm docker.io/kicbase/echo-server:functional-430070 --alsologtostderr
functional_test.go:447: (dbg) Run:  out/minikube-linux-arm64 -p functional-430070 image ls
--- PASS: TestFunctional/parallel/ImageCommands/ImageRemove (0.45s)

                                                
                                    
x
+
TestFunctional/parallel/ImageCommands/ImageLoadFromFile (0.79s)

                                                
                                                
=== RUN   TestFunctional/parallel/ImageCommands/ImageLoadFromFile
functional_test.go:408: (dbg) Run:  out/minikube-linux-arm64 -p functional-430070 image load /home/jenkins/workspace/Docker_Linux_crio_arm64/echo-server-save.tar --alsologtostderr
functional_test.go:447: (dbg) Run:  out/minikube-linux-arm64 -p functional-430070 image ls
--- PASS: TestFunctional/parallel/ImageCommands/ImageLoadFromFile (0.79s)

                                                
                                    
x
+
TestFunctional/parallel/ImageCommands/ImageSaveDaemon (0.56s)

                                                
                                                
=== RUN   TestFunctional/parallel/ImageCommands/ImageSaveDaemon
functional_test.go:418: (dbg) Run:  docker rmi docker.io/kicbase/echo-server:functional-430070
functional_test.go:423: (dbg) Run:  out/minikube-linux-arm64 -p functional-430070 image save --daemon docker.io/kicbase/echo-server:functional-430070 --alsologtostderr
functional_test.go:428: (dbg) Run:  docker image inspect docker.io/kicbase/echo-server:functional-430070
--- PASS: TestFunctional/parallel/ImageCommands/ImageSaveDaemon (0.56s)

                                                
                                    
x
+
TestFunctional/parallel/TunnelCmd/serial/RunSecondTunnel (0.49s)

                                                
                                                
=== RUN   TestFunctional/parallel/TunnelCmd/serial/RunSecondTunnel
functional_test_tunnel_test.go:154: (dbg) daemon: [out/minikube-linux-arm64 -p functional-430070 tunnel --alsologtostderr]
functional_test_tunnel_test.go:154: (dbg) daemon: [out/minikube-linux-arm64 -p functional-430070 tunnel --alsologtostderr]
functional_test_tunnel_test.go:194: (dbg) stopping [out/minikube-linux-arm64 -p functional-430070 tunnel --alsologtostderr] ...
helpers_test.go:508: unable to kill pid 33536: os: process already finished
functional_test_tunnel_test.go:194: (dbg) stopping [out/minikube-linux-arm64 -p functional-430070 tunnel --alsologtostderr] ...
helpers_test.go:490: unable to find parent, assuming dead: process does not exist
--- PASS: TestFunctional/parallel/TunnelCmd/serial/RunSecondTunnel (0.49s)

                                                
                                    
x
+
TestFunctional/parallel/TunnelCmd/serial/StartTunnel (0s)

                                                
                                                
=== RUN   TestFunctional/parallel/TunnelCmd/serial/StartTunnel
functional_test_tunnel_test.go:129: (dbg) daemon: [out/minikube-linux-arm64 -p functional-430070 tunnel --alsologtostderr]
--- PASS: TestFunctional/parallel/TunnelCmd/serial/StartTunnel (0.00s)

                                                
                                    
x
+
TestFunctional/parallel/TunnelCmd/serial/WaitService/Setup (8.32s)

                                                
                                                
=== RUN   TestFunctional/parallel/TunnelCmd/serial/WaitService/Setup
functional_test_tunnel_test.go:212: (dbg) Run:  kubectl --context functional-430070 apply -f testdata/testsvc.yaml
functional_test_tunnel_test.go:216: (dbg) TestFunctional/parallel/TunnelCmd/serial/WaitService/Setup: waiting 4m0s for pods matching "run=nginx-svc" in namespace "default" ...
helpers_test.go:344: "nginx-svc" [84caaa42-1f22-4f9a-86ae-3161271a5c1c] Pending / Ready:ContainersNotReady (containers with unready status: [nginx]) / ContainersReady:ContainersNotReady (containers with unready status: [nginx])
helpers_test.go:344: "nginx-svc" [84caaa42-1f22-4f9a-86ae-3161271a5c1c] Running
functional_test_tunnel_test.go:216: (dbg) TestFunctional/parallel/TunnelCmd/serial/WaitService/Setup: run=nginx-svc healthy within 8.004019083s
--- PASS: TestFunctional/parallel/TunnelCmd/serial/WaitService/Setup (8.32s)

                                                
                                    
x
+
TestFunctional/parallel/ServiceCmd/List (0.37s)

                                                
                                                
=== RUN   TestFunctional/parallel/ServiceCmd/List
functional_test.go:1455: (dbg) Run:  out/minikube-linux-arm64 -p functional-430070 service list
--- PASS: TestFunctional/parallel/ServiceCmd/List (0.37s)

                                                
                                    
x
+
TestFunctional/parallel/ServiceCmd/JSONOutput (0.33s)

                                                
                                                
=== RUN   TestFunctional/parallel/ServiceCmd/JSONOutput
functional_test.go:1485: (dbg) Run:  out/minikube-linux-arm64 -p functional-430070 service list -o json
functional_test.go:1490: Took "330.829767ms" to run "out/minikube-linux-arm64 -p functional-430070 service list -o json"
--- PASS: TestFunctional/parallel/ServiceCmd/JSONOutput (0.33s)

                                                
                                    
x
+
TestFunctional/parallel/ServiceCmd/HTTPS (0.39s)

                                                
                                                
=== RUN   TestFunctional/parallel/ServiceCmd/HTTPS
functional_test.go:1505: (dbg) Run:  out/minikube-linux-arm64 -p functional-430070 service --namespace=default --https --url hello-node
functional_test.go:1518: found endpoint: https://192.168.49.2:30330
--- PASS: TestFunctional/parallel/ServiceCmd/HTTPS (0.39s)

                                                
                                    
x
+
TestFunctional/parallel/ServiceCmd/Format (0.35s)

                                                
                                                
=== RUN   TestFunctional/parallel/ServiceCmd/Format
functional_test.go:1536: (dbg) Run:  out/minikube-linux-arm64 -p functional-430070 service hello-node --url --format={{.IP}}
--- PASS: TestFunctional/parallel/ServiceCmd/Format (0.35s)

                                                
                                    
x
+
TestFunctional/parallel/ServiceCmd/URL (0.35s)

                                                
                                                
=== RUN   TestFunctional/parallel/ServiceCmd/URL
functional_test.go:1555: (dbg) Run:  out/minikube-linux-arm64 -p functional-430070 service hello-node --url
functional_test.go:1561: found endpoint for hello-node: http://192.168.49.2:30330
--- PASS: TestFunctional/parallel/ServiceCmd/URL (0.35s)

                                                
                                    
x
+
TestFunctional/parallel/TunnelCmd/serial/WaitService/IngressIP (0.08s)

                                                
                                                
=== RUN   TestFunctional/parallel/TunnelCmd/serial/WaitService/IngressIP
functional_test_tunnel_test.go:234: (dbg) Run:  kubectl --context functional-430070 get svc nginx-svc -o jsonpath={.status.loadBalancer.ingress[0].ip}
--- PASS: TestFunctional/parallel/TunnelCmd/serial/WaitService/IngressIP (0.08s)

                                                
                                    
x
+
TestFunctional/parallel/TunnelCmd/serial/AccessDirect (0s)

                                                
                                                
=== RUN   TestFunctional/parallel/TunnelCmd/serial/AccessDirect
functional_test_tunnel_test.go:299: tunnel at http://10.97.112.73 is working!
--- PASS: TestFunctional/parallel/TunnelCmd/serial/AccessDirect (0.00s)

                                                
                                    
x
+
TestFunctional/parallel/TunnelCmd/serial/DeleteTunnel (0.11s)

                                                
                                                
=== RUN   TestFunctional/parallel/TunnelCmd/serial/DeleteTunnel
functional_test_tunnel_test.go:434: (dbg) stopping [out/minikube-linux-arm64 -p functional-430070 tunnel --alsologtostderr] ...
--- PASS: TestFunctional/parallel/TunnelCmd/serial/DeleteTunnel (0.11s)

                                                
                                    
x
+
TestFunctional/parallel/ProfileCmd/profile_not_create (0.38s)

                                                
                                                
=== RUN   TestFunctional/parallel/ProfileCmd/profile_not_create
functional_test.go:1266: (dbg) Run:  out/minikube-linux-arm64 profile lis
functional_test.go:1271: (dbg) Run:  out/minikube-linux-arm64 profile list --output json
--- PASS: TestFunctional/parallel/ProfileCmd/profile_not_create (0.38s)

                                                
                                    
x
+
TestFunctional/parallel/ProfileCmd/profile_list (0.39s)

                                                
                                                
=== RUN   TestFunctional/parallel/ProfileCmd/profile_list
functional_test.go:1306: (dbg) Run:  out/minikube-linux-arm64 profile list
functional_test.go:1311: Took "327.730125ms" to run "out/minikube-linux-arm64 profile list"
functional_test.go:1320: (dbg) Run:  out/minikube-linux-arm64 profile list -l
functional_test.go:1325: Took "57.210346ms" to run "out/minikube-linux-arm64 profile list -l"
--- PASS: TestFunctional/parallel/ProfileCmd/profile_list (0.39s)

                                                
                                    
x
+
TestFunctional/parallel/ProfileCmd/profile_json_output (0.38s)

                                                
                                                
=== RUN   TestFunctional/parallel/ProfileCmd/profile_json_output
functional_test.go:1357: (dbg) Run:  out/minikube-linux-arm64 profile list -o json
functional_test.go:1362: Took "315.724132ms" to run "out/minikube-linux-arm64 profile list -o json"
functional_test.go:1370: (dbg) Run:  out/minikube-linux-arm64 profile list -o json --light
functional_test.go:1375: Took "64.910717ms" to run "out/minikube-linux-arm64 profile list -o json --light"
--- PASS: TestFunctional/parallel/ProfileCmd/profile_json_output (0.38s)

                                                
                                    
x
+
TestFunctional/parallel/MountCmd/any-port (6.81s)

                                                
                                                
=== RUN   TestFunctional/parallel/MountCmd/any-port
functional_test_mount_test.go:73: (dbg) daemon: [out/minikube-linux-arm64 mount -p functional-430070 /tmp/TestFunctionalparallelMountCmdany-port3041562375/001:/mount-9p --alsologtostderr -v=1]
functional_test_mount_test.go:107: wrote "test-1721645084107596574" to /tmp/TestFunctionalparallelMountCmdany-port3041562375/001/created-by-test
functional_test_mount_test.go:107: wrote "test-1721645084107596574" to /tmp/TestFunctionalparallelMountCmdany-port3041562375/001/created-by-test-removed-by-pod
functional_test_mount_test.go:107: wrote "test-1721645084107596574" to /tmp/TestFunctionalparallelMountCmdany-port3041562375/001/test-1721645084107596574
functional_test_mount_test.go:115: (dbg) Run:  out/minikube-linux-arm64 -p functional-430070 ssh "findmnt -T /mount-9p | grep 9p"
functional_test_mount_test.go:115: (dbg) Non-zero exit: out/minikube-linux-arm64 -p functional-430070 ssh "findmnt -T /mount-9p | grep 9p": exit status 1 (327.544795ms)

                                                
                                                
** stderr ** 
	ssh: Process exited with status 1

                                                
                                                
** /stderr **
functional_test_mount_test.go:115: (dbg) Run:  out/minikube-linux-arm64 -p functional-430070 ssh "findmnt -T /mount-9p | grep 9p"
functional_test_mount_test.go:129: (dbg) Run:  out/minikube-linux-arm64 -p functional-430070 ssh -- ls -la /mount-9p
functional_test_mount_test.go:133: guest mount directory contents
total 2
-rw-r--r-- 1 docker docker 24 Jul 22 10:44 created-by-test
-rw-r--r-- 1 docker docker 24 Jul 22 10:44 created-by-test-removed-by-pod
-rw-r--r-- 1 docker docker 24 Jul 22 10:44 test-1721645084107596574
functional_test_mount_test.go:137: (dbg) Run:  out/minikube-linux-arm64 -p functional-430070 ssh cat /mount-9p/test-1721645084107596574
functional_test_mount_test.go:148: (dbg) Run:  kubectl --context functional-430070 replace --force -f testdata/busybox-mount-test.yaml
functional_test_mount_test.go:153: (dbg) TestFunctional/parallel/MountCmd/any-port: waiting 4m0s for pods matching "integration-test=busybox-mount" in namespace "default" ...
helpers_test.go:344: "busybox-mount" [8d35ad5d-670a-4460-9cab-02da76c4f5bd] Pending
helpers_test.go:344: "busybox-mount" [8d35ad5d-670a-4460-9cab-02da76c4f5bd] Pending / Ready:ContainersNotReady (containers with unready status: [mount-munger]) / ContainersReady:ContainersNotReady (containers with unready status: [mount-munger])
helpers_test.go:344: "busybox-mount" [8d35ad5d-670a-4460-9cab-02da76c4f5bd] Pending / Initialized:PodCompleted / Ready:PodCompleted / ContainersReady:PodCompleted
helpers_test.go:344: "busybox-mount" [8d35ad5d-670a-4460-9cab-02da76c4f5bd] Succeeded / Initialized:PodCompleted / Ready:PodCompleted / ContainersReady:PodCompleted
functional_test_mount_test.go:153: (dbg) TestFunctional/parallel/MountCmd/any-port: integration-test=busybox-mount healthy within 4.003261144s
functional_test_mount_test.go:169: (dbg) Run:  kubectl --context functional-430070 logs busybox-mount
functional_test_mount_test.go:181: (dbg) Run:  out/minikube-linux-arm64 -p functional-430070 ssh stat /mount-9p/created-by-test
functional_test_mount_test.go:181: (dbg) Run:  out/minikube-linux-arm64 -p functional-430070 ssh stat /mount-9p/created-by-pod
functional_test_mount_test.go:90: (dbg) Run:  out/minikube-linux-arm64 -p functional-430070 ssh "sudo umount -f /mount-9p"
functional_test_mount_test.go:94: (dbg) stopping [out/minikube-linux-arm64 mount -p functional-430070 /tmp/TestFunctionalparallelMountCmdany-port3041562375/001:/mount-9p --alsologtostderr -v=1] ...
--- PASS: TestFunctional/parallel/MountCmd/any-port (6.81s)

                                                
                                    
x
+
TestFunctional/parallel/MountCmd/specific-port (1.67s)

                                                
                                                
=== RUN   TestFunctional/parallel/MountCmd/specific-port
functional_test_mount_test.go:213: (dbg) daemon: [out/minikube-linux-arm64 mount -p functional-430070 /tmp/TestFunctionalparallelMountCmdspecific-port3018858487/001:/mount-9p --alsologtostderr -v=1 --port 46464]
functional_test_mount_test.go:243: (dbg) Run:  out/minikube-linux-arm64 -p functional-430070 ssh "findmnt -T /mount-9p | grep 9p"
functional_test_mount_test.go:243: (dbg) Non-zero exit: out/minikube-linux-arm64 -p functional-430070 ssh "findmnt -T /mount-9p | grep 9p": exit status 1 (333.417989ms)

                                                
                                                
** stderr ** 
	ssh: Process exited with status 1

                                                
                                                
** /stderr **
functional_test_mount_test.go:243: (dbg) Run:  out/minikube-linux-arm64 -p functional-430070 ssh "findmnt -T /mount-9p | grep 9p"
functional_test_mount_test.go:257: (dbg) Run:  out/minikube-linux-arm64 -p functional-430070 ssh -- ls -la /mount-9p
functional_test_mount_test.go:261: guest mount directory contents
total 0
functional_test_mount_test.go:263: (dbg) stopping [out/minikube-linux-arm64 mount -p functional-430070 /tmp/TestFunctionalparallelMountCmdspecific-port3018858487/001:/mount-9p --alsologtostderr -v=1 --port 46464] ...
functional_test_mount_test.go:264: reading mount text
functional_test_mount_test.go:278: done reading mount text
functional_test_mount_test.go:230: (dbg) Run:  out/minikube-linux-arm64 -p functional-430070 ssh "sudo umount -f /mount-9p"
functional_test_mount_test.go:230: (dbg) Non-zero exit: out/minikube-linux-arm64 -p functional-430070 ssh "sudo umount -f /mount-9p": exit status 1 (246.833154ms)

                                                
                                                
-- stdout --
	umount: /mount-9p: not mounted.

                                                
                                                
-- /stdout --
** stderr ** 
	ssh: Process exited with status 32

                                                
                                                
** /stderr **
functional_test_mount_test.go:232: "out/minikube-linux-arm64 -p functional-430070 ssh \"sudo umount -f /mount-9p\"": exit status 1
functional_test_mount_test.go:234: (dbg) stopping [out/minikube-linux-arm64 mount -p functional-430070 /tmp/TestFunctionalparallelMountCmdspecific-port3018858487/001:/mount-9p --alsologtostderr -v=1 --port 46464] ...
--- PASS: TestFunctional/parallel/MountCmd/specific-port (1.67s)

                                                
                                    
x
+
TestFunctional/parallel/MountCmd/VerifyCleanup (1.71s)

                                                
                                                
=== RUN   TestFunctional/parallel/MountCmd/VerifyCleanup
functional_test_mount_test.go:298: (dbg) daemon: [out/minikube-linux-arm64 mount -p functional-430070 /tmp/TestFunctionalparallelMountCmdVerifyCleanup2828767875/001:/mount1 --alsologtostderr -v=1]
functional_test_mount_test.go:298: (dbg) daemon: [out/minikube-linux-arm64 mount -p functional-430070 /tmp/TestFunctionalparallelMountCmdVerifyCleanup2828767875/001:/mount2 --alsologtostderr -v=1]
functional_test_mount_test.go:298: (dbg) daemon: [out/minikube-linux-arm64 mount -p functional-430070 /tmp/TestFunctionalparallelMountCmdVerifyCleanup2828767875/001:/mount3 --alsologtostderr -v=1]
functional_test_mount_test.go:325: (dbg) Run:  out/minikube-linux-arm64 -p functional-430070 ssh "findmnt -T" /mount1
E0722 10:44:52.685342    7564 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19313-2237/.minikube/profiles/addons-578168/client.crt: no such file or directory
functional_test_mount_test.go:325: (dbg) Non-zero exit: out/minikube-linux-arm64 -p functional-430070 ssh "findmnt -T" /mount1: exit status 1 (552.493301ms)

                                                
                                                
** stderr ** 
	ssh: Process exited with status 1

                                                
                                                
** /stderr **
functional_test_mount_test.go:325: (dbg) Run:  out/minikube-linux-arm64 -p functional-430070 ssh "findmnt -T" /mount1
functional_test_mount_test.go:325: (dbg) Run:  out/minikube-linux-arm64 -p functional-430070 ssh "findmnt -T" /mount2
functional_test_mount_test.go:325: (dbg) Run:  out/minikube-linux-arm64 -p functional-430070 ssh "findmnt -T" /mount3
functional_test_mount_test.go:370: (dbg) Run:  out/minikube-linux-arm64 mount -p functional-430070 --kill=true
functional_test_mount_test.go:313: (dbg) stopping [out/minikube-linux-arm64 mount -p functional-430070 /tmp/TestFunctionalparallelMountCmdVerifyCleanup2828767875/001:/mount1 --alsologtostderr -v=1] ...
helpers_test.go:490: unable to find parent, assuming dead: process does not exist
functional_test_mount_test.go:313: (dbg) stopping [out/minikube-linux-arm64 mount -p functional-430070 /tmp/TestFunctionalparallelMountCmdVerifyCleanup2828767875/001:/mount2 --alsologtostderr -v=1] ...
helpers_test.go:490: unable to find parent, assuming dead: process does not exist
functional_test_mount_test.go:313: (dbg) stopping [out/minikube-linux-arm64 mount -p functional-430070 /tmp/TestFunctionalparallelMountCmdVerifyCleanup2828767875/001:/mount3 --alsologtostderr -v=1] ...
helpers_test.go:490: unable to find parent, assuming dead: process does not exist
--- PASS: TestFunctional/parallel/MountCmd/VerifyCleanup (1.71s)

                                                
                                    
x
+
TestFunctional/delete_echo-server_images (0.04s)

                                                
                                                
=== RUN   TestFunctional/delete_echo-server_images
functional_test.go:189: (dbg) Run:  docker rmi -f docker.io/kicbase/echo-server:1.0
functional_test.go:189: (dbg) Run:  docker rmi -f docker.io/kicbase/echo-server:functional-430070
--- PASS: TestFunctional/delete_echo-server_images (0.04s)

                                                
                                    
x
+
TestFunctional/delete_my-image_image (0.02s)

                                                
                                                
=== RUN   TestFunctional/delete_my-image_image
functional_test.go:197: (dbg) Run:  docker rmi -f localhost/my-image:functional-430070
--- PASS: TestFunctional/delete_my-image_image (0.02s)

                                                
                                    
x
+
TestFunctional/delete_minikube_cached_images (0.02s)

                                                
                                                
=== RUN   TestFunctional/delete_minikube_cached_images
functional_test.go:205: (dbg) Run:  docker rmi -f minikube-local-cache-test:functional-430070
--- PASS: TestFunctional/delete_minikube_cached_images (0.02s)

                                                
                                    
x
+
TestMultiControlPlane/serial/StartCluster (185.63s)

                                                
                                                
=== RUN   TestMultiControlPlane/serial/StartCluster
ha_test.go:101: (dbg) Run:  out/minikube-linux-arm64 start -p ha-508387 --wait=true --memory=2200 --ha -v=7 --alsologtostderr --driver=docker  --container-runtime=crio
E0722 10:46:14.605831    7564 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19313-2237/.minikube/profiles/addons-578168/client.crt: no such file or directory
ha_test.go:101: (dbg) Done: out/minikube-linux-arm64 start -p ha-508387 --wait=true --memory=2200 --ha -v=7 --alsologtostderr --driver=docker  --container-runtime=crio: (3m4.819142392s)
ha_test.go:107: (dbg) Run:  out/minikube-linux-arm64 -p ha-508387 status -v=7 --alsologtostderr
--- PASS: TestMultiControlPlane/serial/StartCluster (185.63s)

                                                
                                    
x
+
TestMultiControlPlane/serial/DeployApp (6.45s)

                                                
                                                
=== RUN   TestMultiControlPlane/serial/DeployApp
ha_test.go:128: (dbg) Run:  out/minikube-linux-arm64 kubectl -p ha-508387 -- apply -f ./testdata/ha/ha-pod-dns-test.yaml
ha_test.go:133: (dbg) Run:  out/minikube-linux-arm64 kubectl -p ha-508387 -- rollout status deployment/busybox
ha_test.go:133: (dbg) Done: out/minikube-linux-arm64 kubectl -p ha-508387 -- rollout status deployment/busybox: (3.533054337s)
ha_test.go:140: (dbg) Run:  out/minikube-linux-arm64 kubectl -p ha-508387 -- get pods -o jsonpath='{.items[*].status.podIP}'
ha_test.go:163: (dbg) Run:  out/minikube-linux-arm64 kubectl -p ha-508387 -- get pods -o jsonpath='{.items[*].metadata.name}'
ha_test.go:171: (dbg) Run:  out/minikube-linux-arm64 kubectl -p ha-508387 -- exec busybox-fc5497c4f-2chvc -- nslookup kubernetes.io
ha_test.go:171: (dbg) Run:  out/minikube-linux-arm64 kubectl -p ha-508387 -- exec busybox-fc5497c4f-44vdm -- nslookup kubernetes.io
ha_test.go:171: (dbg) Run:  out/minikube-linux-arm64 kubectl -p ha-508387 -- exec busybox-fc5497c4f-mnvgx -- nslookup kubernetes.io
ha_test.go:181: (dbg) Run:  out/minikube-linux-arm64 kubectl -p ha-508387 -- exec busybox-fc5497c4f-2chvc -- nslookup kubernetes.default
ha_test.go:181: (dbg) Run:  out/minikube-linux-arm64 kubectl -p ha-508387 -- exec busybox-fc5497c4f-44vdm -- nslookup kubernetes.default
ha_test.go:181: (dbg) Run:  out/minikube-linux-arm64 kubectl -p ha-508387 -- exec busybox-fc5497c4f-mnvgx -- nslookup kubernetes.default
ha_test.go:189: (dbg) Run:  out/minikube-linux-arm64 kubectl -p ha-508387 -- exec busybox-fc5497c4f-2chvc -- nslookup kubernetes.default.svc.cluster.local
ha_test.go:189: (dbg) Run:  out/minikube-linux-arm64 kubectl -p ha-508387 -- exec busybox-fc5497c4f-44vdm -- nslookup kubernetes.default.svc.cluster.local
ha_test.go:189: (dbg) Run:  out/minikube-linux-arm64 kubectl -p ha-508387 -- exec busybox-fc5497c4f-mnvgx -- nslookup kubernetes.default.svc.cluster.local
--- PASS: TestMultiControlPlane/serial/DeployApp (6.45s)

                                                
                                    
x
+
TestMultiControlPlane/serial/PingHostFromPods (1.57s)

                                                
                                                
=== RUN   TestMultiControlPlane/serial/PingHostFromPods
ha_test.go:199: (dbg) Run:  out/minikube-linux-arm64 kubectl -p ha-508387 -- get pods -o jsonpath='{.items[*].metadata.name}'
ha_test.go:207: (dbg) Run:  out/minikube-linux-arm64 kubectl -p ha-508387 -- exec busybox-fc5497c4f-2chvc -- sh -c "nslookup host.minikube.internal | awk 'NR==5' | cut -d' ' -f3"
ha_test.go:218: (dbg) Run:  out/minikube-linux-arm64 kubectl -p ha-508387 -- exec busybox-fc5497c4f-2chvc -- sh -c "ping -c 1 192.168.49.1"
ha_test.go:207: (dbg) Run:  out/minikube-linux-arm64 kubectl -p ha-508387 -- exec busybox-fc5497c4f-44vdm -- sh -c "nslookup host.minikube.internal | awk 'NR==5' | cut -d' ' -f3"
ha_test.go:218: (dbg) Run:  out/minikube-linux-arm64 kubectl -p ha-508387 -- exec busybox-fc5497c4f-44vdm -- sh -c "ping -c 1 192.168.49.1"
ha_test.go:207: (dbg) Run:  out/minikube-linux-arm64 kubectl -p ha-508387 -- exec busybox-fc5497c4f-mnvgx -- sh -c "nslookup host.minikube.internal | awk 'NR==5' | cut -d' ' -f3"
ha_test.go:218: (dbg) Run:  out/minikube-linux-arm64 kubectl -p ha-508387 -- exec busybox-fc5497c4f-mnvgx -- sh -c "ping -c 1 192.168.49.1"
--- PASS: TestMultiControlPlane/serial/PingHostFromPods (1.57s)

                                                
                                    
x
+
TestMultiControlPlane/serial/AddWorkerNode (35.5s)

                                                
                                                
=== RUN   TestMultiControlPlane/serial/AddWorkerNode
ha_test.go:228: (dbg) Run:  out/minikube-linux-arm64 node add -p ha-508387 -v=7 --alsologtostderr
E0722 10:48:30.762343    7564 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19313-2237/.minikube/profiles/addons-578168/client.crt: no such file or directory
ha_test.go:228: (dbg) Done: out/minikube-linux-arm64 node add -p ha-508387 -v=7 --alsologtostderr: (34.58845121s)
ha_test.go:234: (dbg) Run:  out/minikube-linux-arm64 -p ha-508387 status -v=7 --alsologtostderr
--- PASS: TestMultiControlPlane/serial/AddWorkerNode (35.50s)

                                                
                                    
x
+
TestMultiControlPlane/serial/NodeLabels (0.12s)

                                                
                                                
=== RUN   TestMultiControlPlane/serial/NodeLabels
ha_test.go:255: (dbg) Run:  kubectl --context ha-508387 get nodes -o "jsonpath=[{range .items[*]}{.metadata.labels},{end}]"
--- PASS: TestMultiControlPlane/serial/NodeLabels (0.12s)

                                                
                                    
x
+
TestMultiControlPlane/serial/HAppyAfterClusterStart (0.73s)

                                                
                                                
=== RUN   TestMultiControlPlane/serial/HAppyAfterClusterStart
ha_test.go:281: (dbg) Run:  out/minikube-linux-arm64 profile list --output json
--- PASS: TestMultiControlPlane/serial/HAppyAfterClusterStart (0.73s)

                                                
                                    
x
+
TestMultiControlPlane/serial/CopyFile (18.48s)

                                                
                                                
=== RUN   TestMultiControlPlane/serial/CopyFile
ha_test.go:326: (dbg) Run:  out/minikube-linux-arm64 -p ha-508387 status --output json -v=7 --alsologtostderr
helpers_test.go:556: (dbg) Run:  out/minikube-linux-arm64 -p ha-508387 cp testdata/cp-test.txt ha-508387:/home/docker/cp-test.txt
E0722 10:48:58.446615    7564 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19313-2237/.minikube/profiles/addons-578168/client.crt: no such file or directory
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p ha-508387 ssh -n ha-508387 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:556: (dbg) Run:  out/minikube-linux-arm64 -p ha-508387 cp ha-508387:/home/docker/cp-test.txt /tmp/TestMultiControlPlaneserialCopyFile912130499/001/cp-test_ha-508387.txt
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p ha-508387 ssh -n ha-508387 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:556: (dbg) Run:  out/minikube-linux-arm64 -p ha-508387 cp ha-508387:/home/docker/cp-test.txt ha-508387-m02:/home/docker/cp-test_ha-508387_ha-508387-m02.txt
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p ha-508387 ssh -n ha-508387 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p ha-508387 ssh -n ha-508387-m02 "sudo cat /home/docker/cp-test_ha-508387_ha-508387-m02.txt"
helpers_test.go:556: (dbg) Run:  out/minikube-linux-arm64 -p ha-508387 cp ha-508387:/home/docker/cp-test.txt ha-508387-m03:/home/docker/cp-test_ha-508387_ha-508387-m03.txt
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p ha-508387 ssh -n ha-508387 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p ha-508387 ssh -n ha-508387-m03 "sudo cat /home/docker/cp-test_ha-508387_ha-508387-m03.txt"
helpers_test.go:556: (dbg) Run:  out/minikube-linux-arm64 -p ha-508387 cp ha-508387:/home/docker/cp-test.txt ha-508387-m04:/home/docker/cp-test_ha-508387_ha-508387-m04.txt
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p ha-508387 ssh -n ha-508387 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p ha-508387 ssh -n ha-508387-m04 "sudo cat /home/docker/cp-test_ha-508387_ha-508387-m04.txt"
helpers_test.go:556: (dbg) Run:  out/minikube-linux-arm64 -p ha-508387 cp testdata/cp-test.txt ha-508387-m02:/home/docker/cp-test.txt
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p ha-508387 ssh -n ha-508387-m02 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:556: (dbg) Run:  out/minikube-linux-arm64 -p ha-508387 cp ha-508387-m02:/home/docker/cp-test.txt /tmp/TestMultiControlPlaneserialCopyFile912130499/001/cp-test_ha-508387-m02.txt
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p ha-508387 ssh -n ha-508387-m02 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:556: (dbg) Run:  out/minikube-linux-arm64 -p ha-508387 cp ha-508387-m02:/home/docker/cp-test.txt ha-508387:/home/docker/cp-test_ha-508387-m02_ha-508387.txt
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p ha-508387 ssh -n ha-508387-m02 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p ha-508387 ssh -n ha-508387 "sudo cat /home/docker/cp-test_ha-508387-m02_ha-508387.txt"
helpers_test.go:556: (dbg) Run:  out/minikube-linux-arm64 -p ha-508387 cp ha-508387-m02:/home/docker/cp-test.txt ha-508387-m03:/home/docker/cp-test_ha-508387-m02_ha-508387-m03.txt
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p ha-508387 ssh -n ha-508387-m02 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p ha-508387 ssh -n ha-508387-m03 "sudo cat /home/docker/cp-test_ha-508387-m02_ha-508387-m03.txt"
helpers_test.go:556: (dbg) Run:  out/minikube-linux-arm64 -p ha-508387 cp ha-508387-m02:/home/docker/cp-test.txt ha-508387-m04:/home/docker/cp-test_ha-508387-m02_ha-508387-m04.txt
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p ha-508387 ssh -n ha-508387-m02 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p ha-508387 ssh -n ha-508387-m04 "sudo cat /home/docker/cp-test_ha-508387-m02_ha-508387-m04.txt"
helpers_test.go:556: (dbg) Run:  out/minikube-linux-arm64 -p ha-508387 cp testdata/cp-test.txt ha-508387-m03:/home/docker/cp-test.txt
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p ha-508387 ssh -n ha-508387-m03 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:556: (dbg) Run:  out/minikube-linux-arm64 -p ha-508387 cp ha-508387-m03:/home/docker/cp-test.txt /tmp/TestMultiControlPlaneserialCopyFile912130499/001/cp-test_ha-508387-m03.txt
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p ha-508387 ssh -n ha-508387-m03 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:556: (dbg) Run:  out/minikube-linux-arm64 -p ha-508387 cp ha-508387-m03:/home/docker/cp-test.txt ha-508387:/home/docker/cp-test_ha-508387-m03_ha-508387.txt
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p ha-508387 ssh -n ha-508387-m03 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p ha-508387 ssh -n ha-508387 "sudo cat /home/docker/cp-test_ha-508387-m03_ha-508387.txt"
helpers_test.go:556: (dbg) Run:  out/minikube-linux-arm64 -p ha-508387 cp ha-508387-m03:/home/docker/cp-test.txt ha-508387-m02:/home/docker/cp-test_ha-508387-m03_ha-508387-m02.txt
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p ha-508387 ssh -n ha-508387-m03 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p ha-508387 ssh -n ha-508387-m02 "sudo cat /home/docker/cp-test_ha-508387-m03_ha-508387-m02.txt"
helpers_test.go:556: (dbg) Run:  out/minikube-linux-arm64 -p ha-508387 cp ha-508387-m03:/home/docker/cp-test.txt ha-508387-m04:/home/docker/cp-test_ha-508387-m03_ha-508387-m04.txt
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p ha-508387 ssh -n ha-508387-m03 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p ha-508387 ssh -n ha-508387-m04 "sudo cat /home/docker/cp-test_ha-508387-m03_ha-508387-m04.txt"
helpers_test.go:556: (dbg) Run:  out/minikube-linux-arm64 -p ha-508387 cp testdata/cp-test.txt ha-508387-m04:/home/docker/cp-test.txt
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p ha-508387 ssh -n ha-508387-m04 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:556: (dbg) Run:  out/minikube-linux-arm64 -p ha-508387 cp ha-508387-m04:/home/docker/cp-test.txt /tmp/TestMultiControlPlaneserialCopyFile912130499/001/cp-test_ha-508387-m04.txt
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p ha-508387 ssh -n ha-508387-m04 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:556: (dbg) Run:  out/minikube-linux-arm64 -p ha-508387 cp ha-508387-m04:/home/docker/cp-test.txt ha-508387:/home/docker/cp-test_ha-508387-m04_ha-508387.txt
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p ha-508387 ssh -n ha-508387-m04 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p ha-508387 ssh -n ha-508387 "sudo cat /home/docker/cp-test_ha-508387-m04_ha-508387.txt"
helpers_test.go:556: (dbg) Run:  out/minikube-linux-arm64 -p ha-508387 cp ha-508387-m04:/home/docker/cp-test.txt ha-508387-m02:/home/docker/cp-test_ha-508387-m04_ha-508387-m02.txt
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p ha-508387 ssh -n ha-508387-m04 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p ha-508387 ssh -n ha-508387-m02 "sudo cat /home/docker/cp-test_ha-508387-m04_ha-508387-m02.txt"
helpers_test.go:556: (dbg) Run:  out/minikube-linux-arm64 -p ha-508387 cp ha-508387-m04:/home/docker/cp-test.txt ha-508387-m03:/home/docker/cp-test_ha-508387-m04_ha-508387-m03.txt
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p ha-508387 ssh -n ha-508387-m04 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p ha-508387 ssh -n ha-508387-m03 "sudo cat /home/docker/cp-test_ha-508387-m04_ha-508387-m03.txt"
--- PASS: TestMultiControlPlane/serial/CopyFile (18.48s)

                                                
                                    
x
+
TestMultiControlPlane/serial/StopSecondaryNode (12.66s)

                                                
                                                
=== RUN   TestMultiControlPlane/serial/StopSecondaryNode
ha_test.go:363: (dbg) Run:  out/minikube-linux-arm64 -p ha-508387 node stop m02 -v=7 --alsologtostderr
E0722 10:49:19.083729    7564 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19313-2237/.minikube/profiles/functional-430070/client.crt: no such file or directory
E0722 10:49:19.088950    7564 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19313-2237/.minikube/profiles/functional-430070/client.crt: no such file or directory
E0722 10:49:19.099241    7564 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19313-2237/.minikube/profiles/functional-430070/client.crt: no such file or directory
E0722 10:49:19.119522    7564 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19313-2237/.minikube/profiles/functional-430070/client.crt: no such file or directory
E0722 10:49:19.159780    7564 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19313-2237/.minikube/profiles/functional-430070/client.crt: no such file or directory
E0722 10:49:19.240232    7564 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19313-2237/.minikube/profiles/functional-430070/client.crt: no such file or directory
E0722 10:49:19.400580    7564 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19313-2237/.minikube/profiles/functional-430070/client.crt: no such file or directory
E0722 10:49:19.721094    7564 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19313-2237/.minikube/profiles/functional-430070/client.crt: no such file or directory
E0722 10:49:20.361738    7564 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19313-2237/.minikube/profiles/functional-430070/client.crt: no such file or directory
E0722 10:49:21.642304    7564 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19313-2237/.minikube/profiles/functional-430070/client.crt: no such file or directory
E0722 10:49:24.202970    7564 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19313-2237/.minikube/profiles/functional-430070/client.crt: no such file or directory
ha_test.go:363: (dbg) Done: out/minikube-linux-arm64 -p ha-508387 node stop m02 -v=7 --alsologtostderr: (11.940965095s)
ha_test.go:369: (dbg) Run:  out/minikube-linux-arm64 -p ha-508387 status -v=7 --alsologtostderr
ha_test.go:369: (dbg) Non-zero exit: out/minikube-linux-arm64 -p ha-508387 status -v=7 --alsologtostderr: exit status 7 (716.661675ms)

                                                
                                                
-- stdout --
	ha-508387
	type: Control Plane
	host: Running
	kubelet: Running
	apiserver: Running
	kubeconfig: Configured
	
	ha-508387-m02
	type: Control Plane
	host: Stopped
	kubelet: Stopped
	apiserver: Stopped
	kubeconfig: Stopped
	
	ha-508387-m03
	type: Control Plane
	host: Running
	kubelet: Running
	apiserver: Running
	kubeconfig: Configured
	
	ha-508387-m04
	type: Worker
	host: Running
	kubelet: Running
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0722 10:49:27.813685   53380 out.go:291] Setting OutFile to fd 1 ...
	I0722 10:49:27.813879   53380 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0722 10:49:27.813908   53380 out.go:304] Setting ErrFile to fd 2...
	I0722 10:49:27.813930   53380 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0722 10:49:27.814200   53380 root.go:338] Updating PATH: /home/jenkins/minikube-integration/19313-2237/.minikube/bin
	I0722 10:49:27.814439   53380 out.go:298] Setting JSON to false
	I0722 10:49:27.814504   53380 mustload.go:65] Loading cluster: ha-508387
	I0722 10:49:27.814565   53380 notify.go:220] Checking for updates...
	I0722 10:49:27.815864   53380 config.go:182] Loaded profile config "ha-508387": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.30.3
	I0722 10:49:27.815915   53380 status.go:255] checking status of ha-508387 ...
	I0722 10:49:27.816536   53380 cli_runner.go:164] Run: docker container inspect ha-508387 --format={{.State.Status}}
	I0722 10:49:27.835658   53380 status.go:330] ha-508387 host status = "Running" (err=<nil>)
	I0722 10:49:27.835682   53380 host.go:66] Checking if "ha-508387" exists ...
	I0722 10:49:27.836055   53380 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" ha-508387
	I0722 10:49:27.869701   53380 host.go:66] Checking if "ha-508387" exists ...
	I0722 10:49:27.870043   53380 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
	I0722 10:49:27.870137   53380 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-508387
	I0722 10:49:27.887344   53380 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32783 SSHKeyPath:/home/jenkins/minikube-integration/19313-2237/.minikube/machines/ha-508387/id_rsa Username:docker}
	I0722 10:49:27.974598   53380 ssh_runner.go:195] Run: systemctl --version
	I0722 10:49:27.979012   53380 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
	I0722 10:49:27.992396   53380 cli_runner.go:164] Run: docker system info --format "{{json .}}"
	I0722 10:49:28.055566   53380 info.go:266] docker info: {ID:5FDH:SA5P:5GCT:NLAS:B73P:SGDQ:PBG5:UBVH:UZY3:RXGO:CI7S:WAIH Containers:4 ContainersRunning:3 ContainersPaused:0 ContainersStopped:1 Images:3 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:53 OomKillDisable:true NGoroutines:71 SystemTime:2024-07-22 10:49:28.044283306 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1064-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Architecture:aar
ch64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8214896640 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-21-244 Labels:[] ExperimentalBuild:false ServerVersion:27.0.3 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:2bf793ef6dc9a18e00cb12efb64355c2c9d5eb41 Expected:2bf793ef6dc9a18e00cb12efb64355c2c9d5eb41} RuncCommit:{ID:v1.1.13-0-g58aa920 Expected:v1.1.13-0-g58aa920} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:<nil> ServerErro
rs:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.15.1] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.28.1]] Warnings:<nil>}}
	I0722 10:49:28.056251   53380 kubeconfig.go:125] found "ha-508387" server: "https://192.168.49.254:8443"
	I0722 10:49:28.056283   53380 api_server.go:166] Checking apiserver status ...
	I0722 10:49:28.056326   53380 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0722 10:49:28.069328   53380 ssh_runner.go:195] Run: sudo egrep ^[0-9]+:freezer: /proc/1479/cgroup
	I0722 10:49:28.079817   53380 api_server.go:182] apiserver freezer: "2:freezer:/docker/329171c33f666b62c054e387abda8a46d73526ef6dc8adc9147d854fd12e3cc5/crio/crio-4af5a97a86d4e3a4a430ae70394ebfba2f2954c387a95312cffa4c66a9476ce4"
	I0722 10:49:28.079902   53380 ssh_runner.go:195] Run: sudo cat /sys/fs/cgroup/freezer/docker/329171c33f666b62c054e387abda8a46d73526ef6dc8adc9147d854fd12e3cc5/crio/crio-4af5a97a86d4e3a4a430ae70394ebfba2f2954c387a95312cffa4c66a9476ce4/freezer.state
	I0722 10:49:28.089411   53380 api_server.go:204] freezer state: "THAWED"
	I0722 10:49:28.089443   53380 api_server.go:253] Checking apiserver healthz at https://192.168.49.254:8443/healthz ...
	I0722 10:49:28.098474   53380 api_server.go:279] https://192.168.49.254:8443/healthz returned 200:
	ok
	I0722 10:49:28.098504   53380 status.go:422] ha-508387 apiserver status = Running (err=<nil>)
	I0722 10:49:28.098516   53380 status.go:257] ha-508387 status: &{Name:ha-508387 Host:Running Kubelet:Running APIServer:Running Kubeconfig:Configured Worker:false TimeToStop: DockerEnv: PodManEnv:}
	I0722 10:49:28.098533   53380 status.go:255] checking status of ha-508387-m02 ...
	I0722 10:49:28.098852   53380 cli_runner.go:164] Run: docker container inspect ha-508387-m02 --format={{.State.Status}}
	I0722 10:49:28.115963   53380 status.go:330] ha-508387-m02 host status = "Stopped" (err=<nil>)
	I0722 10:49:28.115982   53380 status.go:343] host is not running, skipping remaining checks
	I0722 10:49:28.115990   53380 status.go:257] ha-508387-m02 status: &{Name:ha-508387-m02 Host:Stopped Kubelet:Stopped APIServer:Stopped Kubeconfig:Stopped Worker:false TimeToStop: DockerEnv: PodManEnv:}
	I0722 10:49:28.116010   53380 status.go:255] checking status of ha-508387-m03 ...
	I0722 10:49:28.116401   53380 cli_runner.go:164] Run: docker container inspect ha-508387-m03 --format={{.State.Status}}
	I0722 10:49:28.132392   53380 status.go:330] ha-508387-m03 host status = "Running" (err=<nil>)
	I0722 10:49:28.132415   53380 host.go:66] Checking if "ha-508387-m03" exists ...
	I0722 10:49:28.132707   53380 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" ha-508387-m03
	I0722 10:49:28.155156   53380 host.go:66] Checking if "ha-508387-m03" exists ...
	I0722 10:49:28.156753   53380 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
	I0722 10:49:28.156800   53380 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-508387-m03
	I0722 10:49:28.177453   53380 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32793 SSHKeyPath:/home/jenkins/minikube-integration/19313-2237/.minikube/machines/ha-508387-m03/id_rsa Username:docker}
	I0722 10:49:28.270076   53380 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
	I0722 10:49:28.283361   53380 kubeconfig.go:125] found "ha-508387" server: "https://192.168.49.254:8443"
	I0722 10:49:28.283387   53380 api_server.go:166] Checking apiserver status ...
	I0722 10:49:28.283429   53380 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0722 10:49:28.295107   53380 ssh_runner.go:195] Run: sudo egrep ^[0-9]+:freezer: /proc/1408/cgroup
	I0722 10:49:28.305084   53380 api_server.go:182] apiserver freezer: "2:freezer:/docker/fa302b1f06d1207688f4758a9e4070c10782e89691923c66d3ff4039a1ec5698/crio/crio-ff733107aaad6eb561cbe1ce95bb3a3f7a438208b3e8e2acd07f4472e9c28cea"
	I0722 10:49:28.305240   53380 ssh_runner.go:195] Run: sudo cat /sys/fs/cgroup/freezer/docker/fa302b1f06d1207688f4758a9e4070c10782e89691923c66d3ff4039a1ec5698/crio/crio-ff733107aaad6eb561cbe1ce95bb3a3f7a438208b3e8e2acd07f4472e9c28cea/freezer.state
	I0722 10:49:28.314568   53380 api_server.go:204] freezer state: "THAWED"
	I0722 10:49:28.314639   53380 api_server.go:253] Checking apiserver healthz at https://192.168.49.254:8443/healthz ...
	I0722 10:49:28.322427   53380 api_server.go:279] https://192.168.49.254:8443/healthz returned 200:
	ok
	I0722 10:49:28.322457   53380 status.go:422] ha-508387-m03 apiserver status = Running (err=<nil>)
	I0722 10:49:28.322468   53380 status.go:257] ha-508387-m03 status: &{Name:ha-508387-m03 Host:Running Kubelet:Running APIServer:Running Kubeconfig:Configured Worker:false TimeToStop: DockerEnv: PodManEnv:}
	I0722 10:49:28.322485   53380 status.go:255] checking status of ha-508387-m04 ...
	I0722 10:49:28.322789   53380 cli_runner.go:164] Run: docker container inspect ha-508387-m04 --format={{.State.Status}}
	I0722 10:49:28.339988   53380 status.go:330] ha-508387-m04 host status = "Running" (err=<nil>)
	I0722 10:49:28.340015   53380 host.go:66] Checking if "ha-508387-m04" exists ...
	I0722 10:49:28.340292   53380 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" ha-508387-m04
	I0722 10:49:28.356735   53380 host.go:66] Checking if "ha-508387-m04" exists ...
	I0722 10:49:28.357094   53380 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
	I0722 10:49:28.357185   53380 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-508387-m04
	I0722 10:49:28.376460   53380 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32798 SSHKeyPath:/home/jenkins/minikube-integration/19313-2237/.minikube/machines/ha-508387-m04/id_rsa Username:docker}
	I0722 10:49:28.466377   53380 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
	I0722 10:49:28.480609   53380 status.go:257] ha-508387-m04 status: &{Name:ha-508387-m04 Host:Running Kubelet:Running APIServer:Irrelevant Kubeconfig:Irrelevant Worker:true TimeToStop: DockerEnv: PodManEnv:}

                                                
                                                
** /stderr **
--- PASS: TestMultiControlPlane/serial/StopSecondaryNode (12.66s)

                                                
                                    
x
+
TestMultiControlPlane/serial/DegradedAfterControlPlaneNodeStop (0.52s)

                                                
                                                
=== RUN   TestMultiControlPlane/serial/DegradedAfterControlPlaneNodeStop
ha_test.go:390: (dbg) Run:  out/minikube-linux-arm64 profile list --output json
--- PASS: TestMultiControlPlane/serial/DegradedAfterControlPlaneNodeStop (0.52s)

                                                
                                    
x
+
TestMultiControlPlane/serial/RestartSecondaryNode (23.07s)

                                                
                                                
=== RUN   TestMultiControlPlane/serial/RestartSecondaryNode
ha_test.go:420: (dbg) Run:  out/minikube-linux-arm64 -p ha-508387 node start m02 -v=7 --alsologtostderr
E0722 10:49:29.323925    7564 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19313-2237/.minikube/profiles/functional-430070/client.crt: no such file or directory
E0722 10:49:39.565678    7564 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19313-2237/.minikube/profiles/functional-430070/client.crt: no such file or directory
ha_test.go:420: (dbg) Done: out/minikube-linux-arm64 -p ha-508387 node start m02 -v=7 --alsologtostderr: (21.397372914s)
ha_test.go:428: (dbg) Run:  out/minikube-linux-arm64 -p ha-508387 status -v=7 --alsologtostderr
ha_test.go:428: (dbg) Done: out/minikube-linux-arm64 -p ha-508387 status -v=7 --alsologtostderr: (1.52555221s)
ha_test.go:448: (dbg) Run:  kubectl get nodes
--- PASS: TestMultiControlPlane/serial/RestartSecondaryNode (23.07s)

                                                
                                    
x
+
TestMultiControlPlane/serial/HAppyAfterSecondaryNodeRestart (5.25s)

                                                
                                                
=== RUN   TestMultiControlPlane/serial/HAppyAfterSecondaryNodeRestart
ha_test.go:281: (dbg) Run:  out/minikube-linux-arm64 profile list --output json
ha_test.go:281: (dbg) Done: out/minikube-linux-arm64 profile list --output json: (5.253016147s)
--- PASS: TestMultiControlPlane/serial/HAppyAfterSecondaryNodeRestart (5.25s)

                                                
                                    
x
+
TestMultiControlPlane/serial/RestartClusterKeepsNodes (211.01s)

                                                
                                                
=== RUN   TestMultiControlPlane/serial/RestartClusterKeepsNodes
ha_test.go:456: (dbg) Run:  out/minikube-linux-arm64 node list -p ha-508387 -v=7 --alsologtostderr
ha_test.go:462: (dbg) Run:  out/minikube-linux-arm64 stop -p ha-508387 -v=7 --alsologtostderr
E0722 10:50:00.046330    7564 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19313-2237/.minikube/profiles/functional-430070/client.crt: no such file or directory
ha_test.go:462: (dbg) Done: out/minikube-linux-arm64 stop -p ha-508387 -v=7 --alsologtostderr: (36.887586969s)
ha_test.go:467: (dbg) Run:  out/minikube-linux-arm64 start -p ha-508387 --wait=true -v=7 --alsologtostderr
E0722 10:50:41.006864    7564 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19313-2237/.minikube/profiles/functional-430070/client.crt: no such file or directory
E0722 10:52:02.927529    7564 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19313-2237/.minikube/profiles/functional-430070/client.crt: no such file or directory
ha_test.go:467: (dbg) Done: out/minikube-linux-arm64 start -p ha-508387 --wait=true -v=7 --alsologtostderr: (2m53.974743772s)
ha_test.go:472: (dbg) Run:  out/minikube-linux-arm64 node list -p ha-508387
--- PASS: TestMultiControlPlane/serial/RestartClusterKeepsNodes (211.01s)

                                                
                                    
x
+
TestMultiControlPlane/serial/DeleteSecondaryNode (12.88s)

                                                
                                                
=== RUN   TestMultiControlPlane/serial/DeleteSecondaryNode
ha_test.go:487: (dbg) Run:  out/minikube-linux-arm64 -p ha-508387 node delete m03 -v=7 --alsologtostderr
E0722 10:53:30.762078    7564 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19313-2237/.minikube/profiles/addons-578168/client.crt: no such file or directory
ha_test.go:487: (dbg) Done: out/minikube-linux-arm64 -p ha-508387 node delete m03 -v=7 --alsologtostderr: (11.991473979s)
ha_test.go:493: (dbg) Run:  out/minikube-linux-arm64 -p ha-508387 status -v=7 --alsologtostderr
ha_test.go:511: (dbg) Run:  kubectl get nodes
ha_test.go:519: (dbg) Run:  kubectl get nodes -o "go-template='{{range .items}}{{range .status.conditions}}{{if eq .type "Ready"}} {{.status}}{{"\n"}}{{end}}{{end}}{{end}}'"
--- PASS: TestMultiControlPlane/serial/DeleteSecondaryNode (12.88s)

                                                
                                    
x
+
TestMultiControlPlane/serial/DegradedAfterSecondaryNodeDelete (0.52s)

                                                
                                                
=== RUN   TestMultiControlPlane/serial/DegradedAfterSecondaryNodeDelete
ha_test.go:390: (dbg) Run:  out/minikube-linux-arm64 profile list --output json
--- PASS: TestMultiControlPlane/serial/DegradedAfterSecondaryNodeDelete (0.52s)

                                                
                                    
x
+
TestMultiControlPlane/serial/StopCluster (35.68s)

                                                
                                                
=== RUN   TestMultiControlPlane/serial/StopCluster
ha_test.go:531: (dbg) Run:  out/minikube-linux-arm64 -p ha-508387 stop -v=7 --alsologtostderr
ha_test.go:531: (dbg) Done: out/minikube-linux-arm64 -p ha-508387 stop -v=7 --alsologtostderr: (35.579169764s)
ha_test.go:537: (dbg) Run:  out/minikube-linux-arm64 -p ha-508387 status -v=7 --alsologtostderr
ha_test.go:537: (dbg) Non-zero exit: out/minikube-linux-arm64 -p ha-508387 status -v=7 --alsologtostderr: exit status 7 (105.078777ms)

                                                
                                                
-- stdout --
	ha-508387
	type: Control Plane
	host: Stopped
	kubelet: Stopped
	apiserver: Stopped
	kubeconfig: Stopped
	
	ha-508387-m02
	type: Control Plane
	host: Stopped
	kubelet: Stopped
	apiserver: Stopped
	kubeconfig: Stopped
	
	ha-508387-m04
	type: Worker
	host: Stopped
	kubelet: Stopped
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0722 10:54:17.353337   67969 out.go:291] Setting OutFile to fd 1 ...
	I0722 10:54:17.353533   67969 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0722 10:54:17.353559   67969 out.go:304] Setting ErrFile to fd 2...
	I0722 10:54:17.353580   67969 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0722 10:54:17.353878   67969 root.go:338] Updating PATH: /home/jenkins/minikube-integration/19313-2237/.minikube/bin
	I0722 10:54:17.354132   67969 out.go:298] Setting JSON to false
	I0722 10:54:17.354213   67969 mustload.go:65] Loading cluster: ha-508387
	I0722 10:54:17.354303   67969 notify.go:220] Checking for updates...
	I0722 10:54:17.354661   67969 config.go:182] Loaded profile config "ha-508387": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.30.3
	I0722 10:54:17.354683   67969 status.go:255] checking status of ha-508387 ...
	I0722 10:54:17.355470   67969 cli_runner.go:164] Run: docker container inspect ha-508387 --format={{.State.Status}}
	I0722 10:54:17.373377   67969 status.go:330] ha-508387 host status = "Stopped" (err=<nil>)
	I0722 10:54:17.373405   67969 status.go:343] host is not running, skipping remaining checks
	I0722 10:54:17.373413   67969 status.go:257] ha-508387 status: &{Name:ha-508387 Host:Stopped Kubelet:Stopped APIServer:Stopped Kubeconfig:Stopped Worker:false TimeToStop: DockerEnv: PodManEnv:}
	I0722 10:54:17.373449   67969 status.go:255] checking status of ha-508387-m02 ...
	I0722 10:54:17.373741   67969 cli_runner.go:164] Run: docker container inspect ha-508387-m02 --format={{.State.Status}}
	I0722 10:54:17.390210   67969 status.go:330] ha-508387-m02 host status = "Stopped" (err=<nil>)
	I0722 10:54:17.390233   67969 status.go:343] host is not running, skipping remaining checks
	I0722 10:54:17.390240   67969 status.go:257] ha-508387-m02 status: &{Name:ha-508387-m02 Host:Stopped Kubelet:Stopped APIServer:Stopped Kubeconfig:Stopped Worker:false TimeToStop: DockerEnv: PodManEnv:}
	I0722 10:54:17.390260   67969 status.go:255] checking status of ha-508387-m04 ...
	I0722 10:54:17.390604   67969 cli_runner.go:164] Run: docker container inspect ha-508387-m04 --format={{.State.Status}}
	I0722 10:54:17.413803   67969 status.go:330] ha-508387-m04 host status = "Stopped" (err=<nil>)
	I0722 10:54:17.413840   67969 status.go:343] host is not running, skipping remaining checks
	I0722 10:54:17.413848   67969 status.go:257] ha-508387-m04 status: &{Name:ha-508387-m04 Host:Stopped Kubelet:Stopped APIServer:Stopped Kubeconfig:Stopped Worker:true TimeToStop: DockerEnv: PodManEnv:}

                                                
                                                
** /stderr **
--- PASS: TestMultiControlPlane/serial/StopCluster (35.68s)

                                                
                                    
x
+
TestMultiControlPlane/serial/RestartCluster (115.65s)

                                                
                                                
=== RUN   TestMultiControlPlane/serial/RestartCluster
ha_test.go:560: (dbg) Run:  out/minikube-linux-arm64 start -p ha-508387 --wait=true -v=7 --alsologtostderr --driver=docker  --container-runtime=crio
E0722 10:54:19.083693    7564 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19313-2237/.minikube/profiles/functional-430070/client.crt: no such file or directory
E0722 10:54:46.768160    7564 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19313-2237/.minikube/profiles/functional-430070/client.crt: no such file or directory
ha_test.go:560: (dbg) Done: out/minikube-linux-arm64 start -p ha-508387 --wait=true -v=7 --alsologtostderr --driver=docker  --container-runtime=crio: (1m54.71454942s)
ha_test.go:566: (dbg) Run:  out/minikube-linux-arm64 -p ha-508387 status -v=7 --alsologtostderr
ha_test.go:584: (dbg) Run:  kubectl get nodes
ha_test.go:592: (dbg) Run:  kubectl get nodes -o "go-template='{{range .items}}{{range .status.conditions}}{{if eq .type "Ready"}} {{.status}}{{"\n"}}{{end}}{{end}}{{end}}'"
--- PASS: TestMultiControlPlane/serial/RestartCluster (115.65s)

                                                
                                    
x
+
TestMultiControlPlane/serial/DegradedAfterClusterRestart (0.55s)

                                                
                                                
=== RUN   TestMultiControlPlane/serial/DegradedAfterClusterRestart
ha_test.go:390: (dbg) Run:  out/minikube-linux-arm64 profile list --output json
--- PASS: TestMultiControlPlane/serial/DegradedAfterClusterRestart (0.55s)

                                                
                                    
x
+
TestMultiControlPlane/serial/AddSecondaryNode (75.36s)

                                                
                                                
=== RUN   TestMultiControlPlane/serial/AddSecondaryNode
ha_test.go:605: (dbg) Run:  out/minikube-linux-arm64 node add -p ha-508387 --control-plane -v=7 --alsologtostderr
ha_test.go:605: (dbg) Done: out/minikube-linux-arm64 node add -p ha-508387 --control-plane -v=7 --alsologtostderr: (1m14.358008533s)
ha_test.go:611: (dbg) Run:  out/minikube-linux-arm64 -p ha-508387 status -v=7 --alsologtostderr
ha_test.go:611: (dbg) Done: out/minikube-linux-arm64 -p ha-508387 status -v=7 --alsologtostderr: (1.001156284s)
--- PASS: TestMultiControlPlane/serial/AddSecondaryNode (75.36s)

                                                
                                    
x
+
TestMultiControlPlane/serial/HAppyAfterSecondaryNodeAdd (0.72s)

                                                
                                                
=== RUN   TestMultiControlPlane/serial/HAppyAfterSecondaryNodeAdd
ha_test.go:281: (dbg) Run:  out/minikube-linux-arm64 profile list --output json
--- PASS: TestMultiControlPlane/serial/HAppyAfterSecondaryNodeAdd (0.72s)

                                                
                                    
x
+
TestJSONOutput/start/Command (58.97s)

                                                
                                                
=== RUN   TestJSONOutput/start/Command
json_output_test.go:63: (dbg) Run:  out/minikube-linux-arm64 start -p json-output-966276 --output=json --user=testUser --memory=2200 --wait=true --driver=docker  --container-runtime=crio
E0722 10:58:30.762472    7564 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19313-2237/.minikube/profiles/addons-578168/client.crt: no such file or directory
json_output_test.go:63: (dbg) Done: out/minikube-linux-arm64 start -p json-output-966276 --output=json --user=testUser --memory=2200 --wait=true --driver=docker  --container-runtime=crio: (58.965471378s)
--- PASS: TestJSONOutput/start/Command (58.97s)

                                                
                                    
x
+
TestJSONOutput/start/Audit (0s)

                                                
                                                
=== RUN   TestJSONOutput/start/Audit
--- PASS: TestJSONOutput/start/Audit (0.00s)

                                                
                                    
x
+
TestJSONOutput/start/parallel/DistinctCurrentSteps (0s)

                                                
                                                
=== RUN   TestJSONOutput/start/parallel/DistinctCurrentSteps
=== PAUSE TestJSONOutput/start/parallel/DistinctCurrentSteps

                                                
                                                

                                                
                                                
=== CONT  TestJSONOutput/start/parallel/DistinctCurrentSteps
--- PASS: TestJSONOutput/start/parallel/DistinctCurrentSteps (0.00s)

                                                
                                    
x
+
TestJSONOutput/start/parallel/IncreasingCurrentSteps (0s)

                                                
                                                
=== RUN   TestJSONOutput/start/parallel/IncreasingCurrentSteps
=== PAUSE TestJSONOutput/start/parallel/IncreasingCurrentSteps

                                                
                                                

                                                
                                                
=== CONT  TestJSONOutput/start/parallel/IncreasingCurrentSteps
--- PASS: TestJSONOutput/start/parallel/IncreasingCurrentSteps (0.00s)

                                                
                                    
x
+
TestJSONOutput/pause/Command (0.71s)

                                                
                                                
=== RUN   TestJSONOutput/pause/Command
json_output_test.go:63: (dbg) Run:  out/minikube-linux-arm64 pause -p json-output-966276 --output=json --user=testUser
--- PASS: TestJSONOutput/pause/Command (0.71s)

                                                
                                    
x
+
TestJSONOutput/pause/Audit (0s)

                                                
                                                
=== RUN   TestJSONOutput/pause/Audit
--- PASS: TestJSONOutput/pause/Audit (0.00s)

                                                
                                    
x
+
TestJSONOutput/pause/parallel/DistinctCurrentSteps (0s)

                                                
                                                
=== RUN   TestJSONOutput/pause/parallel/DistinctCurrentSteps
=== PAUSE TestJSONOutput/pause/parallel/DistinctCurrentSteps

                                                
                                                

                                                
                                                
=== CONT  TestJSONOutput/pause/parallel/DistinctCurrentSteps
--- PASS: TestJSONOutput/pause/parallel/DistinctCurrentSteps (0.00s)

                                                
                                    
x
+
TestJSONOutput/pause/parallel/IncreasingCurrentSteps (0s)

                                                
                                                
=== RUN   TestJSONOutput/pause/parallel/IncreasingCurrentSteps
=== PAUSE TestJSONOutput/pause/parallel/IncreasingCurrentSteps

                                                
                                                

                                                
                                                
=== CONT  TestJSONOutput/pause/parallel/IncreasingCurrentSteps
--- PASS: TestJSONOutput/pause/parallel/IncreasingCurrentSteps (0.00s)

                                                
                                    
x
+
TestJSONOutput/unpause/Command (0.65s)

                                                
                                                
=== RUN   TestJSONOutput/unpause/Command
json_output_test.go:63: (dbg) Run:  out/minikube-linux-arm64 unpause -p json-output-966276 --output=json --user=testUser
--- PASS: TestJSONOutput/unpause/Command (0.65s)

                                                
                                    
x
+
TestJSONOutput/unpause/Audit (0s)

                                                
                                                
=== RUN   TestJSONOutput/unpause/Audit
--- PASS: TestJSONOutput/unpause/Audit (0.00s)

                                                
                                    
x
+
TestJSONOutput/unpause/parallel/DistinctCurrentSteps (0s)

                                                
                                                
=== RUN   TestJSONOutput/unpause/parallel/DistinctCurrentSteps
=== PAUSE TestJSONOutput/unpause/parallel/DistinctCurrentSteps

                                                
                                                

                                                
                                                
=== CONT  TestJSONOutput/unpause/parallel/DistinctCurrentSteps
--- PASS: TestJSONOutput/unpause/parallel/DistinctCurrentSteps (0.00s)

                                                
                                    
x
+
TestJSONOutput/unpause/parallel/IncreasingCurrentSteps (0s)

                                                
                                                
=== RUN   TestJSONOutput/unpause/parallel/IncreasingCurrentSteps
=== PAUSE TestJSONOutput/unpause/parallel/IncreasingCurrentSteps

                                                
                                                

                                                
                                                
=== CONT  TestJSONOutput/unpause/parallel/IncreasingCurrentSteps
--- PASS: TestJSONOutput/unpause/parallel/IncreasingCurrentSteps (0.00s)

                                                
                                    
x
+
TestJSONOutput/stop/Command (5.9s)

                                                
                                                
=== RUN   TestJSONOutput/stop/Command
json_output_test.go:63: (dbg) Run:  out/minikube-linux-arm64 stop -p json-output-966276 --output=json --user=testUser
json_output_test.go:63: (dbg) Done: out/minikube-linux-arm64 stop -p json-output-966276 --output=json --user=testUser: (5.896371413s)
--- PASS: TestJSONOutput/stop/Command (5.90s)

                                                
                                    
x
+
TestJSONOutput/stop/Audit (0s)

                                                
                                                
=== RUN   TestJSONOutput/stop/Audit
--- PASS: TestJSONOutput/stop/Audit (0.00s)

                                                
                                    
x
+
TestJSONOutput/stop/parallel/DistinctCurrentSteps (0s)

                                                
                                                
=== RUN   TestJSONOutput/stop/parallel/DistinctCurrentSteps
=== PAUSE TestJSONOutput/stop/parallel/DistinctCurrentSteps

                                                
                                                

                                                
                                                
=== CONT  TestJSONOutput/stop/parallel/DistinctCurrentSteps
--- PASS: TestJSONOutput/stop/parallel/DistinctCurrentSteps (0.00s)

                                                
                                    
x
+
TestJSONOutput/stop/parallel/IncreasingCurrentSteps (0s)

                                                
                                                
=== RUN   TestJSONOutput/stop/parallel/IncreasingCurrentSteps
=== PAUSE TestJSONOutput/stop/parallel/IncreasingCurrentSteps

                                                
                                                

                                                
                                                
=== CONT  TestJSONOutput/stop/parallel/IncreasingCurrentSteps
--- PASS: TestJSONOutput/stop/parallel/IncreasingCurrentSteps (0.00s)

                                                
                                    
x
+
TestErrorJSONOutput (0.22s)

                                                
                                                
=== RUN   TestErrorJSONOutput
json_output_test.go:160: (dbg) Run:  out/minikube-linux-arm64 start -p json-output-error-439398 --memory=2200 --output=json --wait=true --driver=fail
json_output_test.go:160: (dbg) Non-zero exit: out/minikube-linux-arm64 start -p json-output-error-439398 --memory=2200 --output=json --wait=true --driver=fail: exit status 56 (79.587996ms)

                                                
                                                
-- stdout --
	{"specversion":"1.0","id":"eb4b33bd-a0ff-4310-b7c5-aad95acba64f","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.step","datacontenttype":"application/json","data":{"currentstep":"0","message":"[json-output-error-439398] minikube v1.33.1 on Ubuntu 20.04 (arm64)","name":"Initial Minikube Setup","totalsteps":"19"}}
	{"specversion":"1.0","id":"9c2d7b49-dba2-4711-9fea-ec1abc91d5cb","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_LOCATION=19313"}}
	{"specversion":"1.0","id":"7c51e0ae-b0e6-4376-8185-0579a46903ba","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true"}}
	{"specversion":"1.0","id":"9dd2c7b2-63ce-48b3-9d01-d9e074dc8944","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"KUBECONFIG=/home/jenkins/minikube-integration/19313-2237/kubeconfig"}}
	{"specversion":"1.0","id":"48c3ea5c-7f5d-4390-b32c-64452228c2d5","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_HOME=/home/jenkins/minikube-integration/19313-2237/.minikube"}}
	{"specversion":"1.0","id":"201908ed-c490-4d8b-9901-9290e2148b3b","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_BIN=out/minikube-linux-arm64"}}
	{"specversion":"1.0","id":"bba932d5-82bd-4e4e-966e-aa942b6b66f7","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_FORCE_SYSTEMD="}}
	{"specversion":"1.0","id":"7a62562e-55b2-4bcc-9c47-ee82343bea06","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.error","datacontenttype":"application/json","data":{"advice":"","exitcode":"56","issues":"","message":"The driver 'fail' is not supported on linux/arm64","name":"DRV_UNSUPPORTED_OS","url":""}}

                                                
                                                
-- /stdout --
helpers_test.go:175: Cleaning up "json-output-error-439398" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-arm64 delete -p json-output-error-439398
--- PASS: TestErrorJSONOutput (0.22s)

                                                
                                    
x
+
TestKicCustomNetwork/create_custom_network (38.38s)

                                                
                                                
=== RUN   TestKicCustomNetwork/create_custom_network
kic_custom_network_test.go:57: (dbg) Run:  out/minikube-linux-arm64 start -p docker-network-563444 --network=
E0722 10:59:19.085021    7564 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19313-2237/.minikube/profiles/functional-430070/client.crt: no such file or directory
kic_custom_network_test.go:57: (dbg) Done: out/minikube-linux-arm64 start -p docker-network-563444 --network=: (36.325777062s)
kic_custom_network_test.go:150: (dbg) Run:  docker network ls --format {{.Name}}
helpers_test.go:175: Cleaning up "docker-network-563444" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-arm64 delete -p docker-network-563444
helpers_test.go:178: (dbg) Done: out/minikube-linux-arm64 delete -p docker-network-563444: (2.028084201s)
--- PASS: TestKicCustomNetwork/create_custom_network (38.38s)

                                                
                                    
x
+
TestKicCustomNetwork/use_default_bridge_network (34.05s)

                                                
                                                
=== RUN   TestKicCustomNetwork/use_default_bridge_network
kic_custom_network_test.go:57: (dbg) Run:  out/minikube-linux-arm64 start -p docker-network-695179 --network=bridge
E0722 10:59:53.807198    7564 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19313-2237/.minikube/profiles/addons-578168/client.crt: no such file or directory
kic_custom_network_test.go:57: (dbg) Done: out/minikube-linux-arm64 start -p docker-network-695179 --network=bridge: (31.837536756s)
kic_custom_network_test.go:150: (dbg) Run:  docker network ls --format {{.Name}}
helpers_test.go:175: Cleaning up "docker-network-695179" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-arm64 delete -p docker-network-695179
helpers_test.go:178: (dbg) Done: out/minikube-linux-arm64 delete -p docker-network-695179: (2.184777659s)
--- PASS: TestKicCustomNetwork/use_default_bridge_network (34.05s)

                                                
                                    
x
+
TestKicExistingNetwork (33.17s)

                                                
                                                
=== RUN   TestKicExistingNetwork
kic_custom_network_test.go:150: (dbg) Run:  docker network ls --format {{.Name}}
kic_custom_network_test.go:93: (dbg) Run:  out/minikube-linux-arm64 start -p existing-network-044375 --network=existing-network
kic_custom_network_test.go:93: (dbg) Done: out/minikube-linux-arm64 start -p existing-network-044375 --network=existing-network: (30.980584065s)
helpers_test.go:175: Cleaning up "existing-network-044375" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-arm64 delete -p existing-network-044375
helpers_test.go:178: (dbg) Done: out/minikube-linux-arm64 delete -p existing-network-044375: (2.031350958s)
--- PASS: TestKicExistingNetwork (33.17s)

                                                
                                    
x
+
TestKicCustomSubnet (32.67s)

                                                
                                                
=== RUN   TestKicCustomSubnet
kic_custom_network_test.go:112: (dbg) Run:  out/minikube-linux-arm64 start -p custom-subnet-119672 --subnet=192.168.60.0/24
kic_custom_network_test.go:112: (dbg) Done: out/minikube-linux-arm64 start -p custom-subnet-119672 --subnet=192.168.60.0/24: (30.647492021s)
kic_custom_network_test.go:161: (dbg) Run:  docker network inspect custom-subnet-119672 --format "{{(index .IPAM.Config 0).Subnet}}"
helpers_test.go:175: Cleaning up "custom-subnet-119672" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-arm64 delete -p custom-subnet-119672
helpers_test.go:178: (dbg) Done: out/minikube-linux-arm64 delete -p custom-subnet-119672: (1.998971697s)
--- PASS: TestKicCustomSubnet (32.67s)

                                                
                                    
x
+
TestKicStaticIP (34.46s)

                                                
                                                
=== RUN   TestKicStaticIP
kic_custom_network_test.go:132: (dbg) Run:  out/minikube-linux-arm64 start -p static-ip-594777 --static-ip=192.168.200.200
kic_custom_network_test.go:132: (dbg) Done: out/minikube-linux-arm64 start -p static-ip-594777 --static-ip=192.168.200.200: (32.267150363s)
kic_custom_network_test.go:138: (dbg) Run:  out/minikube-linux-arm64 -p static-ip-594777 ip
helpers_test.go:175: Cleaning up "static-ip-594777" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-arm64 delete -p static-ip-594777
helpers_test.go:178: (dbg) Done: out/minikube-linux-arm64 delete -p static-ip-594777: (2.048782541s)
--- PASS: TestKicStaticIP (34.46s)

                                                
                                    
x
+
TestMainNoArgs (0.05s)

                                                
                                                
=== RUN   TestMainNoArgs
main_test.go:68: (dbg) Run:  out/minikube-linux-arm64
--- PASS: TestMainNoArgs (0.05s)

                                                
                                    
x
+
TestMinikubeProfile (69.27s)

                                                
                                                
=== RUN   TestMinikubeProfile
minikube_profile_test.go:44: (dbg) Run:  out/minikube-linux-arm64 start -p first-736609 --driver=docker  --container-runtime=crio
minikube_profile_test.go:44: (dbg) Done: out/minikube-linux-arm64 start -p first-736609 --driver=docker  --container-runtime=crio: (31.106317301s)
minikube_profile_test.go:44: (dbg) Run:  out/minikube-linux-arm64 start -p second-739382 --driver=docker  --container-runtime=crio
minikube_profile_test.go:44: (dbg) Done: out/minikube-linux-arm64 start -p second-739382 --driver=docker  --container-runtime=crio: (32.775309685s)
minikube_profile_test.go:51: (dbg) Run:  out/minikube-linux-arm64 profile first-736609
minikube_profile_test.go:55: (dbg) Run:  out/minikube-linux-arm64 profile list -ojson
minikube_profile_test.go:51: (dbg) Run:  out/minikube-linux-arm64 profile second-739382
minikube_profile_test.go:55: (dbg) Run:  out/minikube-linux-arm64 profile list -ojson
helpers_test.go:175: Cleaning up "second-739382" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-arm64 delete -p second-739382
helpers_test.go:178: (dbg) Done: out/minikube-linux-arm64 delete -p second-739382: (1.940435282s)
helpers_test.go:175: Cleaning up "first-736609" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-arm64 delete -p first-736609
helpers_test.go:178: (dbg) Done: out/minikube-linux-arm64 delete -p first-736609: (2.224078118s)
--- PASS: TestMinikubeProfile (69.27s)

                                                
                                    
x
+
TestMountStart/serial/StartWithMountFirst (6.7s)

                                                
                                                
=== RUN   TestMountStart/serial/StartWithMountFirst
mount_start_test.go:98: (dbg) Run:  out/minikube-linux-arm64 start -p mount-start-1-118372 --memory=2048 --mount --mount-gid 0 --mount-msize 6543 --mount-port 46464 --mount-uid 0 --no-kubernetes --driver=docker  --container-runtime=crio
mount_start_test.go:98: (dbg) Done: out/minikube-linux-arm64 start -p mount-start-1-118372 --memory=2048 --mount --mount-gid 0 --mount-msize 6543 --mount-port 46464 --mount-uid 0 --no-kubernetes --driver=docker  --container-runtime=crio: (5.702791295s)
--- PASS: TestMountStart/serial/StartWithMountFirst (6.70s)

                                                
                                    
x
+
TestMountStart/serial/VerifyMountFirst (0.26s)

                                                
                                                
=== RUN   TestMountStart/serial/VerifyMountFirst
mount_start_test.go:114: (dbg) Run:  out/minikube-linux-arm64 -p mount-start-1-118372 ssh -- ls /minikube-host
--- PASS: TestMountStart/serial/VerifyMountFirst (0.26s)

                                                
                                    
x
+
TestMountStart/serial/StartWithMountSecond (6.78s)

                                                
                                                
=== RUN   TestMountStart/serial/StartWithMountSecond
mount_start_test.go:98: (dbg) Run:  out/minikube-linux-arm64 start -p mount-start-2-130868 --memory=2048 --mount --mount-gid 0 --mount-msize 6543 --mount-port 46465 --mount-uid 0 --no-kubernetes --driver=docker  --container-runtime=crio
mount_start_test.go:98: (dbg) Done: out/minikube-linux-arm64 start -p mount-start-2-130868 --memory=2048 --mount --mount-gid 0 --mount-msize 6543 --mount-port 46465 --mount-uid 0 --no-kubernetes --driver=docker  --container-runtime=crio: (5.782767507s)
--- PASS: TestMountStart/serial/StartWithMountSecond (6.78s)

                                                
                                    
x
+
TestMountStart/serial/VerifyMountSecond (0.27s)

                                                
                                                
=== RUN   TestMountStart/serial/VerifyMountSecond
mount_start_test.go:114: (dbg) Run:  out/minikube-linux-arm64 -p mount-start-2-130868 ssh -- ls /minikube-host
--- PASS: TestMountStart/serial/VerifyMountSecond (0.27s)

                                                
                                    
x
+
TestMountStart/serial/DeleteFirst (1.61s)

                                                
                                                
=== RUN   TestMountStart/serial/DeleteFirst
pause_test.go:132: (dbg) Run:  out/minikube-linux-arm64 delete -p mount-start-1-118372 --alsologtostderr -v=5
pause_test.go:132: (dbg) Done: out/minikube-linux-arm64 delete -p mount-start-1-118372 --alsologtostderr -v=5: (1.610759974s)
--- PASS: TestMountStart/serial/DeleteFirst (1.61s)

                                                
                                    
x
+
TestMountStart/serial/VerifyMountPostDelete (0.24s)

                                                
                                                
=== RUN   TestMountStart/serial/VerifyMountPostDelete
mount_start_test.go:114: (dbg) Run:  out/minikube-linux-arm64 -p mount-start-2-130868 ssh -- ls /minikube-host
--- PASS: TestMountStart/serial/VerifyMountPostDelete (0.24s)

                                                
                                    
x
+
TestMountStart/serial/Stop (1.2s)

                                                
                                                
=== RUN   TestMountStart/serial/Stop
mount_start_test.go:155: (dbg) Run:  out/minikube-linux-arm64 stop -p mount-start-2-130868
mount_start_test.go:155: (dbg) Done: out/minikube-linux-arm64 stop -p mount-start-2-130868: (1.196441713s)
--- PASS: TestMountStart/serial/Stop (1.20s)

                                                
                                    
x
+
TestMountStart/serial/RestartStopped (7.9s)

                                                
                                                
=== RUN   TestMountStart/serial/RestartStopped
mount_start_test.go:166: (dbg) Run:  out/minikube-linux-arm64 start -p mount-start-2-130868
mount_start_test.go:166: (dbg) Done: out/minikube-linux-arm64 start -p mount-start-2-130868: (6.894842118s)
--- PASS: TestMountStart/serial/RestartStopped (7.90s)

                                                
                                    
x
+
TestMountStart/serial/VerifyMountPostStop (0.25s)

                                                
                                                
=== RUN   TestMountStart/serial/VerifyMountPostStop
mount_start_test.go:114: (dbg) Run:  out/minikube-linux-arm64 -p mount-start-2-130868 ssh -- ls /minikube-host
--- PASS: TestMountStart/serial/VerifyMountPostStop (0.25s)

                                                
                                    
x
+
TestMultiNode/serial/FreshStart2Nodes (86.92s)

                                                
                                                
=== RUN   TestMultiNode/serial/FreshStart2Nodes
multinode_test.go:96: (dbg) Run:  out/minikube-linux-arm64 start -p multinode-083613 --wait=true --memory=2200 --nodes=2 -v=8 --alsologtostderr --driver=docker  --container-runtime=crio
E0722 11:03:30.762380    7564 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19313-2237/.minikube/profiles/addons-578168/client.crt: no such file or directory
E0722 11:04:19.083719    7564 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19313-2237/.minikube/profiles/functional-430070/client.crt: no such file or directory
multinode_test.go:96: (dbg) Done: out/minikube-linux-arm64 start -p multinode-083613 --wait=true --memory=2200 --nodes=2 -v=8 --alsologtostderr --driver=docker  --container-runtime=crio: (1m26.391249381s)
multinode_test.go:102: (dbg) Run:  out/minikube-linux-arm64 -p multinode-083613 status --alsologtostderr
--- PASS: TestMultiNode/serial/FreshStart2Nodes (86.92s)

                                                
                                    
x
+
TestMultiNode/serial/DeployApp2Nodes (4.38s)

                                                
                                                
=== RUN   TestMultiNode/serial/DeployApp2Nodes
multinode_test.go:493: (dbg) Run:  out/minikube-linux-arm64 kubectl -p multinode-083613 -- apply -f ./testdata/multinodes/multinode-pod-dns-test.yaml
multinode_test.go:498: (dbg) Run:  out/minikube-linux-arm64 kubectl -p multinode-083613 -- rollout status deployment/busybox
multinode_test.go:498: (dbg) Done: out/minikube-linux-arm64 kubectl -p multinode-083613 -- rollout status deployment/busybox: (2.461361934s)
multinode_test.go:505: (dbg) Run:  out/minikube-linux-arm64 kubectl -p multinode-083613 -- get pods -o jsonpath='{.items[*].status.podIP}'
multinode_test.go:528: (dbg) Run:  out/minikube-linux-arm64 kubectl -p multinode-083613 -- get pods -o jsonpath='{.items[*].metadata.name}'
multinode_test.go:536: (dbg) Run:  out/minikube-linux-arm64 kubectl -p multinode-083613 -- exec busybox-fc5497c4f-22xq2 -- nslookup kubernetes.io
multinode_test.go:536: (dbg) Run:  out/minikube-linux-arm64 kubectl -p multinode-083613 -- exec busybox-fc5497c4f-lp8cm -- nslookup kubernetes.io
multinode_test.go:546: (dbg) Run:  out/minikube-linux-arm64 kubectl -p multinode-083613 -- exec busybox-fc5497c4f-22xq2 -- nslookup kubernetes.default
multinode_test.go:546: (dbg) Run:  out/minikube-linux-arm64 kubectl -p multinode-083613 -- exec busybox-fc5497c4f-lp8cm -- nslookup kubernetes.default
multinode_test.go:554: (dbg) Run:  out/minikube-linux-arm64 kubectl -p multinode-083613 -- exec busybox-fc5497c4f-22xq2 -- nslookup kubernetes.default.svc.cluster.local
multinode_test.go:554: (dbg) Run:  out/minikube-linux-arm64 kubectl -p multinode-083613 -- exec busybox-fc5497c4f-lp8cm -- nslookup kubernetes.default.svc.cluster.local
--- PASS: TestMultiNode/serial/DeployApp2Nodes (4.38s)

                                                
                                    
x
+
TestMultiNode/serial/PingHostFrom2Pods (0.96s)

                                                
                                                
=== RUN   TestMultiNode/serial/PingHostFrom2Pods
multinode_test.go:564: (dbg) Run:  out/minikube-linux-arm64 kubectl -p multinode-083613 -- get pods -o jsonpath='{.items[*].metadata.name}'
multinode_test.go:572: (dbg) Run:  out/minikube-linux-arm64 kubectl -p multinode-083613 -- exec busybox-fc5497c4f-22xq2 -- sh -c "nslookup host.minikube.internal | awk 'NR==5' | cut -d' ' -f3"
multinode_test.go:583: (dbg) Run:  out/minikube-linux-arm64 kubectl -p multinode-083613 -- exec busybox-fc5497c4f-22xq2 -- sh -c "ping -c 1 192.168.58.1"
multinode_test.go:572: (dbg) Run:  out/minikube-linux-arm64 kubectl -p multinode-083613 -- exec busybox-fc5497c4f-lp8cm -- sh -c "nslookup host.minikube.internal | awk 'NR==5' | cut -d' ' -f3"
multinode_test.go:583: (dbg) Run:  out/minikube-linux-arm64 kubectl -p multinode-083613 -- exec busybox-fc5497c4f-lp8cm -- sh -c "ping -c 1 192.168.58.1"
--- PASS: TestMultiNode/serial/PingHostFrom2Pods (0.96s)

                                                
                                    
x
+
TestMultiNode/serial/AddNode (32.96s)

                                                
                                                
=== RUN   TestMultiNode/serial/AddNode
multinode_test.go:121: (dbg) Run:  out/minikube-linux-arm64 node add -p multinode-083613 -v 3 --alsologtostderr
multinode_test.go:121: (dbg) Done: out/minikube-linux-arm64 node add -p multinode-083613 -v 3 --alsologtostderr: (32.314203925s)
multinode_test.go:127: (dbg) Run:  out/minikube-linux-arm64 -p multinode-083613 status --alsologtostderr
--- PASS: TestMultiNode/serial/AddNode (32.96s)

                                                
                                    
x
+
TestMultiNode/serial/MultiNodeLabels (0.09s)

                                                
                                                
=== RUN   TestMultiNode/serial/MultiNodeLabels
multinode_test.go:221: (dbg) Run:  kubectl --context multinode-083613 get nodes -o "jsonpath=[{range .items[*]}{.metadata.labels},{end}]"
--- PASS: TestMultiNode/serial/MultiNodeLabels (0.09s)

                                                
                                    
x
+
TestMultiNode/serial/ProfileList (0.33s)

                                                
                                                
=== RUN   TestMultiNode/serial/ProfileList
multinode_test.go:143: (dbg) Run:  out/minikube-linux-arm64 profile list --output json
--- PASS: TestMultiNode/serial/ProfileList (0.33s)

                                                
                                    
x
+
TestMultiNode/serial/CopyFile (9.5s)

                                                
                                                
=== RUN   TestMultiNode/serial/CopyFile
multinode_test.go:184: (dbg) Run:  out/minikube-linux-arm64 -p multinode-083613 status --output json --alsologtostderr
helpers_test.go:556: (dbg) Run:  out/minikube-linux-arm64 -p multinode-083613 cp testdata/cp-test.txt multinode-083613:/home/docker/cp-test.txt
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p multinode-083613 ssh -n multinode-083613 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:556: (dbg) Run:  out/minikube-linux-arm64 -p multinode-083613 cp multinode-083613:/home/docker/cp-test.txt /tmp/TestMultiNodeserialCopyFile235991368/001/cp-test_multinode-083613.txt
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p multinode-083613 ssh -n multinode-083613 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:556: (dbg) Run:  out/minikube-linux-arm64 -p multinode-083613 cp multinode-083613:/home/docker/cp-test.txt multinode-083613-m02:/home/docker/cp-test_multinode-083613_multinode-083613-m02.txt
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p multinode-083613 ssh -n multinode-083613 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p multinode-083613 ssh -n multinode-083613-m02 "sudo cat /home/docker/cp-test_multinode-083613_multinode-083613-m02.txt"
helpers_test.go:556: (dbg) Run:  out/minikube-linux-arm64 -p multinode-083613 cp multinode-083613:/home/docker/cp-test.txt multinode-083613-m03:/home/docker/cp-test_multinode-083613_multinode-083613-m03.txt
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p multinode-083613 ssh -n multinode-083613 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p multinode-083613 ssh -n multinode-083613-m03 "sudo cat /home/docker/cp-test_multinode-083613_multinode-083613-m03.txt"
helpers_test.go:556: (dbg) Run:  out/minikube-linux-arm64 -p multinode-083613 cp testdata/cp-test.txt multinode-083613-m02:/home/docker/cp-test.txt
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p multinode-083613 ssh -n multinode-083613-m02 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:556: (dbg) Run:  out/minikube-linux-arm64 -p multinode-083613 cp multinode-083613-m02:/home/docker/cp-test.txt /tmp/TestMultiNodeserialCopyFile235991368/001/cp-test_multinode-083613-m02.txt
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p multinode-083613 ssh -n multinode-083613-m02 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:556: (dbg) Run:  out/minikube-linux-arm64 -p multinode-083613 cp multinode-083613-m02:/home/docker/cp-test.txt multinode-083613:/home/docker/cp-test_multinode-083613-m02_multinode-083613.txt
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p multinode-083613 ssh -n multinode-083613-m02 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p multinode-083613 ssh -n multinode-083613 "sudo cat /home/docker/cp-test_multinode-083613-m02_multinode-083613.txt"
helpers_test.go:556: (dbg) Run:  out/minikube-linux-arm64 -p multinode-083613 cp multinode-083613-m02:/home/docker/cp-test.txt multinode-083613-m03:/home/docker/cp-test_multinode-083613-m02_multinode-083613-m03.txt
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p multinode-083613 ssh -n multinode-083613-m02 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p multinode-083613 ssh -n multinode-083613-m03 "sudo cat /home/docker/cp-test_multinode-083613-m02_multinode-083613-m03.txt"
helpers_test.go:556: (dbg) Run:  out/minikube-linux-arm64 -p multinode-083613 cp testdata/cp-test.txt multinode-083613-m03:/home/docker/cp-test.txt
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p multinode-083613 ssh -n multinode-083613-m03 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:556: (dbg) Run:  out/minikube-linux-arm64 -p multinode-083613 cp multinode-083613-m03:/home/docker/cp-test.txt /tmp/TestMultiNodeserialCopyFile235991368/001/cp-test_multinode-083613-m03.txt
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p multinode-083613 ssh -n multinode-083613-m03 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:556: (dbg) Run:  out/minikube-linux-arm64 -p multinode-083613 cp multinode-083613-m03:/home/docker/cp-test.txt multinode-083613:/home/docker/cp-test_multinode-083613-m03_multinode-083613.txt
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p multinode-083613 ssh -n multinode-083613-m03 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p multinode-083613 ssh -n multinode-083613 "sudo cat /home/docker/cp-test_multinode-083613-m03_multinode-083613.txt"
helpers_test.go:556: (dbg) Run:  out/minikube-linux-arm64 -p multinode-083613 cp multinode-083613-m03:/home/docker/cp-test.txt multinode-083613-m02:/home/docker/cp-test_multinode-083613-m03_multinode-083613-m02.txt
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p multinode-083613 ssh -n multinode-083613-m03 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p multinode-083613 ssh -n multinode-083613-m02 "sudo cat /home/docker/cp-test_multinode-083613-m03_multinode-083613-m02.txt"
--- PASS: TestMultiNode/serial/CopyFile (9.50s)

                                                
                                    
x
+
TestMultiNode/serial/StopNode (2.2s)

                                                
                                                
=== RUN   TestMultiNode/serial/StopNode
multinode_test.go:248: (dbg) Run:  out/minikube-linux-arm64 -p multinode-083613 node stop m03
multinode_test.go:248: (dbg) Done: out/minikube-linux-arm64 -p multinode-083613 node stop m03: (1.204916835s)
multinode_test.go:254: (dbg) Run:  out/minikube-linux-arm64 -p multinode-083613 status
multinode_test.go:254: (dbg) Non-zero exit: out/minikube-linux-arm64 -p multinode-083613 status: exit status 7 (509.249799ms)

                                                
                                                
-- stdout --
	multinode-083613
	type: Control Plane
	host: Running
	kubelet: Running
	apiserver: Running
	kubeconfig: Configured
	
	multinode-083613-m02
	type: Worker
	host: Running
	kubelet: Running
	
	multinode-083613-m03
	type: Worker
	host: Stopped
	kubelet: Stopped
	

                                                
                                                
-- /stdout --
multinode_test.go:261: (dbg) Run:  out/minikube-linux-arm64 -p multinode-083613 status --alsologtostderr
multinode_test.go:261: (dbg) Non-zero exit: out/minikube-linux-arm64 -p multinode-083613 status --alsologtostderr: exit status 7 (485.133299ms)

                                                
                                                
-- stdout --
	multinode-083613
	type: Control Plane
	host: Running
	kubelet: Running
	apiserver: Running
	kubeconfig: Configured
	
	multinode-083613-m02
	type: Worker
	host: Running
	kubelet: Running
	
	multinode-083613-m03
	type: Worker
	host: Stopped
	kubelet: Stopped
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0722 11:05:36.174871  122671 out.go:291] Setting OutFile to fd 1 ...
	I0722 11:05:36.175046  122671 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0722 11:05:36.175077  122671 out.go:304] Setting ErrFile to fd 2...
	I0722 11:05:36.175101  122671 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0722 11:05:36.175362  122671 root.go:338] Updating PATH: /home/jenkins/minikube-integration/19313-2237/.minikube/bin
	I0722 11:05:36.175580  122671 out.go:298] Setting JSON to false
	I0722 11:05:36.175632  122671 mustload.go:65] Loading cluster: multinode-083613
	I0722 11:05:36.176066  122671 config.go:182] Loaded profile config "multinode-083613": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.30.3
	I0722 11:05:36.176098  122671 status.go:255] checking status of multinode-083613 ...
	I0722 11:05:36.176184  122671 notify.go:220] Checking for updates...
	I0722 11:05:36.176631  122671 cli_runner.go:164] Run: docker container inspect multinode-083613 --format={{.State.Status}}
	I0722 11:05:36.197082  122671 status.go:330] multinode-083613 host status = "Running" (err=<nil>)
	I0722 11:05:36.197108  122671 host.go:66] Checking if "multinode-083613" exists ...
	I0722 11:05:36.197447  122671 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" multinode-083613
	I0722 11:05:36.221210  122671 host.go:66] Checking if "multinode-083613" exists ...
	I0722 11:05:36.221513  122671 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
	I0722 11:05:36.221578  122671 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" multinode-083613
	I0722 11:05:36.240513  122671 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32903 SSHKeyPath:/home/jenkins/minikube-integration/19313-2237/.minikube/machines/multinode-083613/id_rsa Username:docker}
	I0722 11:05:36.326320  122671 ssh_runner.go:195] Run: systemctl --version
	I0722 11:05:36.330935  122671 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
	I0722 11:05:36.342825  122671 cli_runner.go:164] Run: docker system info --format "{{json .}}"
	I0722 11:05:36.400988  122671 info.go:266] docker info: {ID:5FDH:SA5P:5GCT:NLAS:B73P:SGDQ:PBG5:UBVH:UZY3:RXGO:CI7S:WAIH Containers:3 ContainersRunning:2 ContainersPaused:0 ContainersStopped:1 Images:3 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:41 OomKillDisable:true NGoroutines:61 SystemTime:2024-07-22 11:05:36.391761198 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1064-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Architecture:aar
ch64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8214896640 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-21-244 Labels:[] ExperimentalBuild:false ServerVersion:27.0.3 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:2bf793ef6dc9a18e00cb12efb64355c2c9d5eb41 Expected:2bf793ef6dc9a18e00cb12efb64355c2c9d5eb41} RuncCommit:{ID:v1.1.13-0-g58aa920 Expected:v1.1.13-0-g58aa920} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:<nil> ServerErro
rs:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.15.1] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.28.1]] Warnings:<nil>}}
	I0722 11:05:36.401574  122671 kubeconfig.go:125] found "multinode-083613" server: "https://192.168.58.2:8443"
	I0722 11:05:36.401618  122671 api_server.go:166] Checking apiserver status ...
	I0722 11:05:36.401674  122671 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0722 11:05:36.412845  122671 ssh_runner.go:195] Run: sudo egrep ^[0-9]+:freezer: /proc/1451/cgroup
	I0722 11:05:36.424620  122671 api_server.go:182] apiserver freezer: "2:freezer:/docker/e58a795a21551e366116de3b892e10b0c0f6d2d3cac0cdbeeb341dc2378183e0/crio/crio-7a50a09e92defd38191a6a361a41e1140bddeaaa6d08eeb84edb6e4d23d5caa4"
	I0722 11:05:36.424695  122671 ssh_runner.go:195] Run: sudo cat /sys/fs/cgroup/freezer/docker/e58a795a21551e366116de3b892e10b0c0f6d2d3cac0cdbeeb341dc2378183e0/crio/crio-7a50a09e92defd38191a6a361a41e1140bddeaaa6d08eeb84edb6e4d23d5caa4/freezer.state
	I0722 11:05:36.433761  122671 api_server.go:204] freezer state: "THAWED"
	I0722 11:05:36.433792  122671 api_server.go:253] Checking apiserver healthz at https://192.168.58.2:8443/healthz ...
	I0722 11:05:36.441385  122671 api_server.go:279] https://192.168.58.2:8443/healthz returned 200:
	ok
	I0722 11:05:36.441413  122671 status.go:422] multinode-083613 apiserver status = Running (err=<nil>)
	I0722 11:05:36.441425  122671 status.go:257] multinode-083613 status: &{Name:multinode-083613 Host:Running Kubelet:Running APIServer:Running Kubeconfig:Configured Worker:false TimeToStop: DockerEnv: PodManEnv:}
	I0722 11:05:36.441443  122671 status.go:255] checking status of multinode-083613-m02 ...
	I0722 11:05:36.441771  122671 cli_runner.go:164] Run: docker container inspect multinode-083613-m02 --format={{.State.Status}}
	I0722 11:05:36.458233  122671 status.go:330] multinode-083613-m02 host status = "Running" (err=<nil>)
	I0722 11:05:36.458259  122671 host.go:66] Checking if "multinode-083613-m02" exists ...
	I0722 11:05:36.458562  122671 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" multinode-083613-m02
	I0722 11:05:36.475117  122671 host.go:66] Checking if "multinode-083613-m02" exists ...
	I0722 11:05:36.475476  122671 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
	I0722 11:05:36.475525  122671 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" multinode-083613-m02
	I0722 11:05:36.493238  122671 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32908 SSHKeyPath:/home/jenkins/minikube-integration/19313-2237/.minikube/machines/multinode-083613-m02/id_rsa Username:docker}
	I0722 11:05:36.581777  122671 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
	I0722 11:05:36.593479  122671 status.go:257] multinode-083613-m02 status: &{Name:multinode-083613-m02 Host:Running Kubelet:Running APIServer:Irrelevant Kubeconfig:Irrelevant Worker:true TimeToStop: DockerEnv: PodManEnv:}
	I0722 11:05:36.593521  122671 status.go:255] checking status of multinode-083613-m03 ...
	I0722 11:05:36.593810  122671 cli_runner.go:164] Run: docker container inspect multinode-083613-m03 --format={{.State.Status}}
	I0722 11:05:36.609794  122671 status.go:330] multinode-083613-m03 host status = "Stopped" (err=<nil>)
	I0722 11:05:36.609817  122671 status.go:343] host is not running, skipping remaining checks
	I0722 11:05:36.609825  122671 status.go:257] multinode-083613-m03 status: &{Name:multinode-083613-m03 Host:Stopped Kubelet:Stopped APIServer:Stopped Kubeconfig:Stopped Worker:true TimeToStop: DockerEnv: PodManEnv:}

                                                
                                                
** /stderr **
--- PASS: TestMultiNode/serial/StopNode (2.20s)

                                                
                                    
x
+
TestMultiNode/serial/StartAfterStop (9.91s)

                                                
                                                
=== RUN   TestMultiNode/serial/StartAfterStop
multinode_test.go:282: (dbg) Run:  out/minikube-linux-arm64 -p multinode-083613 node start m03 -v=7 --alsologtostderr
E0722 11:05:42.129222    7564 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19313-2237/.minikube/profiles/functional-430070/client.crt: no such file or directory
multinode_test.go:282: (dbg) Done: out/minikube-linux-arm64 -p multinode-083613 node start m03 -v=7 --alsologtostderr: (9.161274286s)
multinode_test.go:290: (dbg) Run:  out/minikube-linux-arm64 -p multinode-083613 status -v=7 --alsologtostderr
multinode_test.go:306: (dbg) Run:  kubectl get nodes
--- PASS: TestMultiNode/serial/StartAfterStop (9.91s)

                                                
                                    
x
+
TestMultiNode/serial/RestartKeepsNodes (88.36s)

                                                
                                                
=== RUN   TestMultiNode/serial/RestartKeepsNodes
multinode_test.go:314: (dbg) Run:  out/minikube-linux-arm64 node list -p multinode-083613
multinode_test.go:321: (dbg) Run:  out/minikube-linux-arm64 stop -p multinode-083613
multinode_test.go:321: (dbg) Done: out/minikube-linux-arm64 stop -p multinode-083613: (24.748205538s)
multinode_test.go:326: (dbg) Run:  out/minikube-linux-arm64 start -p multinode-083613 --wait=true -v=8 --alsologtostderr
multinode_test.go:326: (dbg) Done: out/minikube-linux-arm64 start -p multinode-083613 --wait=true -v=8 --alsologtostderr: (1m3.481471259s)
multinode_test.go:331: (dbg) Run:  out/minikube-linux-arm64 node list -p multinode-083613
--- PASS: TestMultiNode/serial/RestartKeepsNodes (88.36s)

                                                
                                    
x
+
TestMultiNode/serial/DeleteNode (5.28s)

                                                
                                                
=== RUN   TestMultiNode/serial/DeleteNode
multinode_test.go:416: (dbg) Run:  out/minikube-linux-arm64 -p multinode-083613 node delete m03
multinode_test.go:416: (dbg) Done: out/minikube-linux-arm64 -p multinode-083613 node delete m03: (4.592883695s)
multinode_test.go:422: (dbg) Run:  out/minikube-linux-arm64 -p multinode-083613 status --alsologtostderr
multinode_test.go:436: (dbg) Run:  kubectl get nodes
multinode_test.go:444: (dbg) Run:  kubectl get nodes -o "go-template='{{range .items}}{{range .status.conditions}}{{if eq .type "Ready"}} {{.status}}{{"\n"}}{{end}}{{end}}{{end}}'"
--- PASS: TestMultiNode/serial/DeleteNode (5.28s)

                                                
                                    
x
+
TestMultiNode/serial/StopMultiNode (23.82s)

                                                
                                                
=== RUN   TestMultiNode/serial/StopMultiNode
multinode_test.go:345: (dbg) Run:  out/minikube-linux-arm64 -p multinode-083613 stop
multinode_test.go:345: (dbg) Done: out/minikube-linux-arm64 -p multinode-083613 stop: (23.649278807s)
multinode_test.go:351: (dbg) Run:  out/minikube-linux-arm64 -p multinode-083613 status
multinode_test.go:351: (dbg) Non-zero exit: out/minikube-linux-arm64 -p multinode-083613 status: exit status 7 (79.955523ms)

                                                
                                                
-- stdout --
	multinode-083613
	type: Control Plane
	host: Stopped
	kubelet: Stopped
	apiserver: Stopped
	kubeconfig: Stopped
	
	multinode-083613-m02
	type: Worker
	host: Stopped
	kubelet: Stopped
	

                                                
                                                
-- /stdout --
multinode_test.go:358: (dbg) Run:  out/minikube-linux-arm64 -p multinode-083613 status --alsologtostderr
multinode_test.go:358: (dbg) Non-zero exit: out/minikube-linux-arm64 -p multinode-083613 status --alsologtostderr: exit status 7 (88.150996ms)

                                                
                                                
-- stdout --
	multinode-083613
	type: Control Plane
	host: Stopped
	kubelet: Stopped
	apiserver: Stopped
	kubeconfig: Stopped
	
	multinode-083613-m02
	type: Worker
	host: Stopped
	kubelet: Stopped
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0722 11:07:43.952690  130171 out.go:291] Setting OutFile to fd 1 ...
	I0722 11:07:43.952815  130171 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0722 11:07:43.952857  130171 out.go:304] Setting ErrFile to fd 2...
	I0722 11:07:43.952887  130171 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0722 11:07:43.953142  130171 root.go:338] Updating PATH: /home/jenkins/minikube-integration/19313-2237/.minikube/bin
	I0722 11:07:43.953340  130171 out.go:298] Setting JSON to false
	I0722 11:07:43.953380  130171 mustload.go:65] Loading cluster: multinode-083613
	I0722 11:07:43.953448  130171 notify.go:220] Checking for updates...
	I0722 11:07:43.954323  130171 config.go:182] Loaded profile config "multinode-083613": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.30.3
	I0722 11:07:43.954347  130171 status.go:255] checking status of multinode-083613 ...
	I0722 11:07:43.954863  130171 cli_runner.go:164] Run: docker container inspect multinode-083613 --format={{.State.Status}}
	I0722 11:07:43.971916  130171 status.go:330] multinode-083613 host status = "Stopped" (err=<nil>)
	I0722 11:07:43.971941  130171 status.go:343] host is not running, skipping remaining checks
	I0722 11:07:43.971949  130171 status.go:257] multinode-083613 status: &{Name:multinode-083613 Host:Stopped Kubelet:Stopped APIServer:Stopped Kubeconfig:Stopped Worker:false TimeToStop: DockerEnv: PodManEnv:}
	I0722 11:07:43.971986  130171 status.go:255] checking status of multinode-083613-m02 ...
	I0722 11:07:43.972284  130171 cli_runner.go:164] Run: docker container inspect multinode-083613-m02 --format={{.State.Status}}
	I0722 11:07:43.991717  130171 status.go:330] multinode-083613-m02 host status = "Stopped" (err=<nil>)
	I0722 11:07:43.991745  130171 status.go:343] host is not running, skipping remaining checks
	I0722 11:07:43.991754  130171 status.go:257] multinode-083613-m02 status: &{Name:multinode-083613-m02 Host:Stopped Kubelet:Stopped APIServer:Stopped Kubeconfig:Stopped Worker:true TimeToStop: DockerEnv: PodManEnv:}

                                                
                                                
** /stderr **
--- PASS: TestMultiNode/serial/StopMultiNode (23.82s)

                                                
                                    
x
+
TestMultiNode/serial/RestartMultiNode (55.07s)

                                                
                                                
=== RUN   TestMultiNode/serial/RestartMultiNode
multinode_test.go:376: (dbg) Run:  out/minikube-linux-arm64 start -p multinode-083613 --wait=true -v=8 --alsologtostderr --driver=docker  --container-runtime=crio
E0722 11:08:30.762113    7564 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19313-2237/.minikube/profiles/addons-578168/client.crt: no such file or directory
multinode_test.go:376: (dbg) Done: out/minikube-linux-arm64 start -p multinode-083613 --wait=true -v=8 --alsologtostderr --driver=docker  --container-runtime=crio: (54.433356183s)
multinode_test.go:382: (dbg) Run:  out/minikube-linux-arm64 -p multinode-083613 status --alsologtostderr
multinode_test.go:396: (dbg) Run:  kubectl get nodes
multinode_test.go:404: (dbg) Run:  kubectl get nodes -o "go-template='{{range .items}}{{range .status.conditions}}{{if eq .type "Ready"}} {{.status}}{{"\n"}}{{end}}{{end}}{{end}}'"
--- PASS: TestMultiNode/serial/RestartMultiNode (55.07s)

                                                
                                    
x
+
TestMultiNode/serial/ValidateNameConflict (34.91s)

                                                
                                                
=== RUN   TestMultiNode/serial/ValidateNameConflict
multinode_test.go:455: (dbg) Run:  out/minikube-linux-arm64 node list -p multinode-083613
multinode_test.go:464: (dbg) Run:  out/minikube-linux-arm64 start -p multinode-083613-m02 --driver=docker  --container-runtime=crio
multinode_test.go:464: (dbg) Non-zero exit: out/minikube-linux-arm64 start -p multinode-083613-m02 --driver=docker  --container-runtime=crio: exit status 14 (83.682651ms)

                                                
                                                
-- stdout --
	* [multinode-083613-m02] minikube v1.33.1 on Ubuntu 20.04 (arm64)
	  - MINIKUBE_LOCATION=19313
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - KUBECONFIG=/home/jenkins/minikube-integration/19313-2237/kubeconfig
	  - MINIKUBE_HOME=/home/jenkins/minikube-integration/19313-2237/.minikube
	  - MINIKUBE_BIN=out/minikube-linux-arm64
	  - MINIKUBE_FORCE_SYSTEMD=
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	! Profile name 'multinode-083613-m02' is duplicated with machine name 'multinode-083613-m02' in profile 'multinode-083613'
	X Exiting due to MK_USAGE: Profile name should be unique

                                                
                                                
** /stderr **
multinode_test.go:472: (dbg) Run:  out/minikube-linux-arm64 start -p multinode-083613-m03 --driver=docker  --container-runtime=crio
multinode_test.go:472: (dbg) Done: out/minikube-linux-arm64 start -p multinode-083613-m03 --driver=docker  --container-runtime=crio: (32.539710867s)
multinode_test.go:479: (dbg) Run:  out/minikube-linux-arm64 node add -p multinode-083613
multinode_test.go:479: (dbg) Non-zero exit: out/minikube-linux-arm64 node add -p multinode-083613: exit status 80 (287.688312ms)

                                                
                                                
-- stdout --
	* Adding node m03 to cluster multinode-083613 as [worker]
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	X Exiting due to GUEST_NODE_ADD: failed to add node: Node multinode-083613-m03 already exists in multinode-083613-m03 profile
	* 
	╭─────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                             │
	│    * If the above advice does not help, please let us know:                                 │
	│      https://github.com/kubernetes/minikube/issues/new/choose                               │
	│                                                                                             │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │
	│    * Please also attach the following file to the GitHub issue:                             │
	│    * - /tmp/minikube_node_040ea7097fd6ed71e65be9a474587f81f0ccd21d_0.log                    │
	│                                                                                             │
	╰─────────────────────────────────────────────────────────────────────────────────────────────╯

                                                
                                                
** /stderr **
multinode_test.go:484: (dbg) Run:  out/minikube-linux-arm64 delete -p multinode-083613-m03
multinode_test.go:484: (dbg) Done: out/minikube-linux-arm64 delete -p multinode-083613-m03: (1.948877716s)
--- PASS: TestMultiNode/serial/ValidateNameConflict (34.91s)

                                                
                                    
x
+
TestPreload (129.24s)

                                                
                                                
=== RUN   TestPreload
preload_test.go:44: (dbg) Run:  out/minikube-linux-arm64 start -p test-preload-733279 --memory=2200 --alsologtostderr --wait=true --preload=false --driver=docker  --container-runtime=crio --kubernetes-version=v1.24.4
E0722 11:09:19.083477    7564 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19313-2237/.minikube/profiles/functional-430070/client.crt: no such file or directory
preload_test.go:44: (dbg) Done: out/minikube-linux-arm64 start -p test-preload-733279 --memory=2200 --alsologtostderr --wait=true --preload=false --driver=docker  --container-runtime=crio --kubernetes-version=v1.24.4: (1m36.970727166s)
preload_test.go:52: (dbg) Run:  out/minikube-linux-arm64 -p test-preload-733279 image pull gcr.io/k8s-minikube/busybox
preload_test.go:52: (dbg) Done: out/minikube-linux-arm64 -p test-preload-733279 image pull gcr.io/k8s-minikube/busybox: (1.842942888s)
preload_test.go:58: (dbg) Run:  out/minikube-linux-arm64 stop -p test-preload-733279
preload_test.go:58: (dbg) Done: out/minikube-linux-arm64 stop -p test-preload-733279: (5.779210521s)
preload_test.go:66: (dbg) Run:  out/minikube-linux-arm64 start -p test-preload-733279 --memory=2200 --alsologtostderr -v=1 --wait=true --driver=docker  --container-runtime=crio
preload_test.go:66: (dbg) Done: out/minikube-linux-arm64 start -p test-preload-733279 --memory=2200 --alsologtostderr -v=1 --wait=true --driver=docker  --container-runtime=crio: (22.014903024s)
preload_test.go:71: (dbg) Run:  out/minikube-linux-arm64 -p test-preload-733279 image list
helpers_test.go:175: Cleaning up "test-preload-733279" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-arm64 delete -p test-preload-733279
helpers_test.go:178: (dbg) Done: out/minikube-linux-arm64 delete -p test-preload-733279: (2.340316571s)
--- PASS: TestPreload (129.24s)

                                                
                                    
x
+
TestScheduledStopUnix (106.43s)

                                                
                                                
=== RUN   TestScheduledStopUnix
scheduled_stop_test.go:128: (dbg) Run:  out/minikube-linux-arm64 start -p scheduled-stop-273746 --memory=2048 --driver=docker  --container-runtime=crio
scheduled_stop_test.go:128: (dbg) Done: out/minikube-linux-arm64 start -p scheduled-stop-273746 --memory=2048 --driver=docker  --container-runtime=crio: (29.752217908s)
scheduled_stop_test.go:137: (dbg) Run:  out/minikube-linux-arm64 stop -p scheduled-stop-273746 --schedule 5m
scheduled_stop_test.go:191: (dbg) Run:  out/minikube-linux-arm64 status --format={{.TimeToStop}} -p scheduled-stop-273746 -n scheduled-stop-273746
scheduled_stop_test.go:169: signal error was:  <nil>
scheduled_stop_test.go:137: (dbg) Run:  out/minikube-linux-arm64 stop -p scheduled-stop-273746 --schedule 15s
scheduled_stop_test.go:169: signal error was:  os: process already finished
scheduled_stop_test.go:137: (dbg) Run:  out/minikube-linux-arm64 stop -p scheduled-stop-273746 --cancel-scheduled
scheduled_stop_test.go:176: (dbg) Run:  out/minikube-linux-arm64 status --format={{.Host}} -p scheduled-stop-273746 -n scheduled-stop-273746
scheduled_stop_test.go:205: (dbg) Run:  out/minikube-linux-arm64 status -p scheduled-stop-273746
scheduled_stop_test.go:137: (dbg) Run:  out/minikube-linux-arm64 stop -p scheduled-stop-273746 --schedule 15s
scheduled_stop_test.go:169: signal error was:  os: process already finished
scheduled_stop_test.go:205: (dbg) Run:  out/minikube-linux-arm64 status -p scheduled-stop-273746
scheduled_stop_test.go:205: (dbg) Non-zero exit: out/minikube-linux-arm64 status -p scheduled-stop-273746: exit status 7 (62.812197ms)

                                                
                                                
-- stdout --
	scheduled-stop-273746
	type: Control Plane
	host: Stopped
	kubelet: Stopped
	apiserver: Stopped
	kubeconfig: Stopped
	

                                                
                                                
-- /stdout --
scheduled_stop_test.go:176: (dbg) Run:  out/minikube-linux-arm64 status --format={{.Host}} -p scheduled-stop-273746 -n scheduled-stop-273746
scheduled_stop_test.go:176: (dbg) Non-zero exit: out/minikube-linux-arm64 status --format={{.Host}} -p scheduled-stop-273746 -n scheduled-stop-273746: exit status 7 (64.602513ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
scheduled_stop_test.go:176: status error: exit status 7 (may be ok)
helpers_test.go:175: Cleaning up "scheduled-stop-273746" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-arm64 delete -p scheduled-stop-273746
helpers_test.go:178: (dbg) Done: out/minikube-linux-arm64 delete -p scheduled-stop-273746: (5.184047575s)
--- PASS: TestScheduledStopUnix (106.43s)

                                                
                                    
x
+
TestInsufficientStorage (11.81s)

                                                
                                                
=== RUN   TestInsufficientStorage
status_test.go:50: (dbg) Run:  out/minikube-linux-arm64 start -p insufficient-storage-897427 --memory=2048 --output=json --wait=true --driver=docker  --container-runtime=crio
status_test.go:50: (dbg) Non-zero exit: out/minikube-linux-arm64 start -p insufficient-storage-897427 --memory=2048 --output=json --wait=true --driver=docker  --container-runtime=crio: exit status 26 (9.330494487s)

                                                
                                                
-- stdout --
	{"specversion":"1.0","id":"b2c38cf1-5f10-4e9f-bc2a-09f30bb909f1","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.step","datacontenttype":"application/json","data":{"currentstep":"0","message":"[insufficient-storage-897427] minikube v1.33.1 on Ubuntu 20.04 (arm64)","name":"Initial Minikube Setup","totalsteps":"19"}}
	{"specversion":"1.0","id":"8b7704df-e18a-4c8e-9436-1c1b0dd011b4","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_LOCATION=19313"}}
	{"specversion":"1.0","id":"6021aa3d-c5d0-42b4-a362-28b8f1e1c093","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true"}}
	{"specversion":"1.0","id":"effeba6b-7c20-4085-be34-c446477bd1f9","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"KUBECONFIG=/home/jenkins/minikube-integration/19313-2237/kubeconfig"}}
	{"specversion":"1.0","id":"40d31e58-df45-4c81-ba97-773662ed4d2e","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_HOME=/home/jenkins/minikube-integration/19313-2237/.minikube"}}
	{"specversion":"1.0","id":"359cdd42-342c-4a45-8bec-64f9a575b9ec","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_BIN=out/minikube-linux-arm64"}}
	{"specversion":"1.0","id":"6623b0c9-8304-4dd3-be28-6312cceaa025","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_FORCE_SYSTEMD="}}
	{"specversion":"1.0","id":"d42ae12b-c455-4109-a5e4-06b70280e15d","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_TEST_STORAGE_CAPACITY=100"}}
	{"specversion":"1.0","id":"abf6a0b2-c3b2-40f0-81f8-87ba9af46a27","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_TEST_AVAILABLE_STORAGE=19"}}
	{"specversion":"1.0","id":"1004fd8f-db8c-4b1f-8241-4db0a5901934","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.step","datacontenttype":"application/json","data":{"currentstep":"1","message":"Using the docker driver based on user configuration","name":"Selecting Driver","totalsteps":"19"}}
	{"specversion":"1.0","id":"2e1a9917-4abb-4f56-a0ab-a0b923eff4c0","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"Using Docker driver with root privileges"}}
	{"specversion":"1.0","id":"fe967e05-9bb5-4ae7-89f5-309878a13d82","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.step","datacontenttype":"application/json","data":{"currentstep":"3","message":"Starting \"insufficient-storage-897427\" primary control-plane node in \"insufficient-storage-897427\" cluster","name":"Starting Node","totalsteps":"19"}}
	{"specversion":"1.0","id":"8bdf9f23-5b55-48cc-bf63-8c0da8152dec","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.step","datacontenttype":"application/json","data":{"currentstep":"5","message":"Pulling base image v0.0.44-1721324606-19298 ...","name":"Pulling Base Image","totalsteps":"19"}}
	{"specversion":"1.0","id":"d76480c6-05bf-4aaa-9393-9f18b6419ba7","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.step","datacontenttype":"application/json","data":{"currentstep":"8","message":"Creating docker container (CPUs=2, Memory=2048MB) ...","name":"Creating Container","totalsteps":"19"}}
	{"specversion":"1.0","id":"e59bd2c5-2043-4304-99fd-731bdc984b06","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.error","datacontenttype":"application/json","data":{"advice":"Try one or more of the following to free up space on the device:\n\t\n\t\t\t1. Run \"docker system prune\" to remove unused Docker data (optionally with \"-a\")\n\t\t\t2. Increase the storage allocated to Docker for Desktop by clicking on:\n\t\t\t\tDocker icon \u003e Preferences \u003e Resources \u003e Disk Image Size\n\t\t\t3. Run \"minikube ssh -- docker system prune\" if using the Docker container runtime","exitcode":"26","issues":"https://github.com/kubernetes/minikube/issues/9024","message":"Docker is out of disk space! (/var is at 100%% of capacity). You can pass '--force' to skip this check.","name":"RSRC_DOCKER_STORAGE","url":""}}

                                                
                                                
-- /stdout --
status_test.go:76: (dbg) Run:  out/minikube-linux-arm64 status -p insufficient-storage-897427 --output=json --layout=cluster
status_test.go:76: (dbg) Non-zero exit: out/minikube-linux-arm64 status -p insufficient-storage-897427 --output=json --layout=cluster: exit status 7 (296.528883ms)

                                                
                                                
-- stdout --
	{"Name":"insufficient-storage-897427","StatusCode":507,"StatusName":"InsufficientStorage","StatusDetail":"/var is almost out of disk space","Step":"Creating Container","StepDetail":"Creating docker container (CPUs=2, Memory=2048MB) ...","BinaryVersion":"v1.33.1","Components":{"kubeconfig":{"Name":"kubeconfig","StatusCode":500,"StatusName":"Error"}},"Nodes":[{"Name":"insufficient-storage-897427","StatusCode":507,"StatusName":"InsufficientStorage","Components":{"apiserver":{"Name":"apiserver","StatusCode":405,"StatusName":"Stopped"},"kubelet":{"Name":"kubelet","StatusCode":405,"StatusName":"Stopped"}}}]}

                                                
                                                
-- /stdout --
** stderr ** 
	E0722 11:13:23.250479  147994 status.go:417] kubeconfig endpoint: get endpoint: "insufficient-storage-897427" does not appear in /home/jenkins/minikube-integration/19313-2237/kubeconfig

                                                
                                                
** /stderr **
status_test.go:76: (dbg) Run:  out/minikube-linux-arm64 status -p insufficient-storage-897427 --output=json --layout=cluster
status_test.go:76: (dbg) Non-zero exit: out/minikube-linux-arm64 status -p insufficient-storage-897427 --output=json --layout=cluster: exit status 7 (273.345868ms)

                                                
                                                
-- stdout --
	{"Name":"insufficient-storage-897427","StatusCode":507,"StatusName":"InsufficientStorage","StatusDetail":"/var is almost out of disk space","BinaryVersion":"v1.33.1","Components":{"kubeconfig":{"Name":"kubeconfig","StatusCode":500,"StatusName":"Error"}},"Nodes":[{"Name":"insufficient-storage-897427","StatusCode":507,"StatusName":"InsufficientStorage","Components":{"apiserver":{"Name":"apiserver","StatusCode":405,"StatusName":"Stopped"},"kubelet":{"Name":"kubelet","StatusCode":405,"StatusName":"Stopped"}}}]}

                                                
                                                
-- /stdout --
** stderr ** 
	E0722 11:13:23.525277  148055 status.go:417] kubeconfig endpoint: get endpoint: "insufficient-storage-897427" does not appear in /home/jenkins/minikube-integration/19313-2237/kubeconfig
	E0722 11:13:23.535465  148055 status.go:560] unable to read event log: stat: stat /home/jenkins/minikube-integration/19313-2237/.minikube/profiles/insufficient-storage-897427/events.json: no such file or directory

                                                
                                                
** /stderr **
helpers_test.go:175: Cleaning up "insufficient-storage-897427" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-arm64 delete -p insufficient-storage-897427
helpers_test.go:178: (dbg) Done: out/minikube-linux-arm64 delete -p insufficient-storage-897427: (1.907568471s)
--- PASS: TestInsufficientStorage (11.81s)

                                                
                                    
x
+
TestRunningBinaryUpgrade (71.06s)

                                                
                                                
=== RUN   TestRunningBinaryUpgrade
=== PAUSE TestRunningBinaryUpgrade

                                                
                                                

                                                
                                                
=== CONT  TestRunningBinaryUpgrade
version_upgrade_test.go:120: (dbg) Run:  /tmp/minikube-v1.26.0.2834188783 start -p running-upgrade-923383 --memory=2200 --vm-driver=docker  --container-runtime=crio
version_upgrade_test.go:120: (dbg) Done: /tmp/minikube-v1.26.0.2834188783 start -p running-upgrade-923383 --memory=2200 --vm-driver=docker  --container-runtime=crio: (33.828657696s)
version_upgrade_test.go:130: (dbg) Run:  out/minikube-linux-arm64 start -p running-upgrade-923383 --memory=2200 --alsologtostderr -v=1 --driver=docker  --container-runtime=crio
version_upgrade_test.go:130: (dbg) Done: out/minikube-linux-arm64 start -p running-upgrade-923383 --memory=2200 --alsologtostderr -v=1 --driver=docker  --container-runtime=crio: (33.721967769s)
helpers_test.go:175: Cleaning up "running-upgrade-923383" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-arm64 delete -p running-upgrade-923383
E0722 11:18:30.762047    7564 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19313-2237/.minikube/profiles/addons-578168/client.crt: no such file or directory
helpers_test.go:178: (dbg) Done: out/minikube-linux-arm64 delete -p running-upgrade-923383: (2.858270088s)
--- PASS: TestRunningBinaryUpgrade (71.06s)

                                                
                                    
x
+
TestKubernetesUpgrade (397.28s)

                                                
                                                
=== RUN   TestKubernetesUpgrade
=== PAUSE TestKubernetesUpgrade

                                                
                                                

                                                
                                                
=== CONT  TestKubernetesUpgrade
version_upgrade_test.go:222: (dbg) Run:  out/minikube-linux-arm64 start -p kubernetes-upgrade-176274 --memory=2200 --kubernetes-version=v1.20.0 --alsologtostderr -v=1 --driver=docker  --container-runtime=crio
version_upgrade_test.go:222: (dbg) Done: out/minikube-linux-arm64 start -p kubernetes-upgrade-176274 --memory=2200 --kubernetes-version=v1.20.0 --alsologtostderr -v=1 --driver=docker  --container-runtime=crio: (1m20.824855238s)
version_upgrade_test.go:227: (dbg) Run:  out/minikube-linux-arm64 stop -p kubernetes-upgrade-176274
version_upgrade_test.go:227: (dbg) Done: out/minikube-linux-arm64 stop -p kubernetes-upgrade-176274: (1.659531066s)
version_upgrade_test.go:232: (dbg) Run:  out/minikube-linux-arm64 -p kubernetes-upgrade-176274 status --format={{.Host}}
version_upgrade_test.go:232: (dbg) Non-zero exit: out/minikube-linux-arm64 -p kubernetes-upgrade-176274 status --format={{.Host}}: exit status 7 (93.45495ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
version_upgrade_test.go:234: status error: exit status 7 (may be ok)
version_upgrade_test.go:243: (dbg) Run:  out/minikube-linux-arm64 start -p kubernetes-upgrade-176274 --memory=2200 --kubernetes-version=v1.31.0-beta.0 --alsologtostderr -v=1 --driver=docker  --container-runtime=crio
version_upgrade_test.go:243: (dbg) Done: out/minikube-linux-arm64 start -p kubernetes-upgrade-176274 --memory=2200 --kubernetes-version=v1.31.0-beta.0 --alsologtostderr -v=1 --driver=docker  --container-runtime=crio: (4m39.202210545s)
version_upgrade_test.go:248: (dbg) Run:  kubectl --context kubernetes-upgrade-176274 version --output=json
version_upgrade_test.go:267: Attempting to downgrade Kubernetes (should fail)
version_upgrade_test.go:269: (dbg) Run:  out/minikube-linux-arm64 start -p kubernetes-upgrade-176274 --memory=2200 --kubernetes-version=v1.20.0 --driver=docker  --container-runtime=crio
version_upgrade_test.go:269: (dbg) Non-zero exit: out/minikube-linux-arm64 start -p kubernetes-upgrade-176274 --memory=2200 --kubernetes-version=v1.20.0 --driver=docker  --container-runtime=crio: exit status 106 (87.511891ms)

                                                
                                                
-- stdout --
	* [kubernetes-upgrade-176274] minikube v1.33.1 on Ubuntu 20.04 (arm64)
	  - MINIKUBE_LOCATION=19313
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - KUBECONFIG=/home/jenkins/minikube-integration/19313-2237/kubeconfig
	  - MINIKUBE_HOME=/home/jenkins/minikube-integration/19313-2237/.minikube
	  - MINIKUBE_BIN=out/minikube-linux-arm64
	  - MINIKUBE_FORCE_SYSTEMD=
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	X Exiting due to K8S_DOWNGRADE_UNSUPPORTED: Unable to safely downgrade existing Kubernetes v1.31.0-beta.0 cluster to v1.20.0
	* Suggestion: 
	
	    1) Recreate the cluster with Kubernetes 1.20.0, by running:
	    
	    minikube delete -p kubernetes-upgrade-176274
	    minikube start -p kubernetes-upgrade-176274 --kubernetes-version=v1.20.0
	    
	    2) Create a second cluster with Kubernetes 1.20.0, by running:
	    
	    minikube start -p kubernetes-upgrade-1762742 --kubernetes-version=v1.20.0
	    
	    3) Use the existing cluster at version Kubernetes 1.31.0-beta.0, by running:
	    
	    minikube start -p kubernetes-upgrade-176274 --kubernetes-version=v1.31.0-beta.0
	    

                                                
                                                
** /stderr **
version_upgrade_test.go:273: Attempting restart after unsuccessful downgrade
version_upgrade_test.go:275: (dbg) Run:  out/minikube-linux-arm64 start -p kubernetes-upgrade-176274 --memory=2200 --kubernetes-version=v1.31.0-beta.0 --alsologtostderr -v=1 --driver=docker  --container-runtime=crio
version_upgrade_test.go:275: (dbg) Done: out/minikube-linux-arm64 start -p kubernetes-upgrade-176274 --memory=2200 --kubernetes-version=v1.31.0-beta.0 --alsologtostderr -v=1 --driver=docker  --container-runtime=crio: (33.049683729s)
helpers_test.go:175: Cleaning up "kubernetes-upgrade-176274" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-arm64 delete -p kubernetes-upgrade-176274
helpers_test.go:178: (dbg) Done: out/minikube-linux-arm64 delete -p kubernetes-upgrade-176274: (2.247979284s)
--- PASS: TestKubernetesUpgrade (397.28s)

                                                
                                    
x
+
TestMissingContainerUpgrade (139.91s)

                                                
                                                
=== RUN   TestMissingContainerUpgrade
=== PAUSE TestMissingContainerUpgrade

                                                
                                                

                                                
                                                
=== CONT  TestMissingContainerUpgrade
version_upgrade_test.go:309: (dbg) Run:  /tmp/minikube-v1.26.0.1655803652 start -p missing-upgrade-012745 --memory=2200 --driver=docker  --container-runtime=crio
E0722 11:13:30.763022    7564 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19313-2237/.minikube/profiles/addons-578168/client.crt: no such file or directory
E0722 11:14:19.084356    7564 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19313-2237/.minikube/profiles/functional-430070/client.crt: no such file or directory
version_upgrade_test.go:309: (dbg) Done: /tmp/minikube-v1.26.0.1655803652 start -p missing-upgrade-012745 --memory=2200 --driver=docker  --container-runtime=crio: (1m10.174248549s)
version_upgrade_test.go:318: (dbg) Run:  docker stop missing-upgrade-012745
version_upgrade_test.go:318: (dbg) Done: docker stop missing-upgrade-012745: (10.418476463s)
version_upgrade_test.go:323: (dbg) Run:  docker rm missing-upgrade-012745
version_upgrade_test.go:329: (dbg) Run:  out/minikube-linux-arm64 start -p missing-upgrade-012745 --memory=2200 --alsologtostderr -v=1 --driver=docker  --container-runtime=crio
version_upgrade_test.go:329: (dbg) Done: out/minikube-linux-arm64 start -p missing-upgrade-012745 --memory=2200 --alsologtostderr -v=1 --driver=docker  --container-runtime=crio: (56.102084085s)
helpers_test.go:175: Cleaning up "missing-upgrade-012745" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-arm64 delete -p missing-upgrade-012745
helpers_test.go:178: (dbg) Done: out/minikube-linux-arm64 delete -p missing-upgrade-012745: (2.517184384s)
--- PASS: TestMissingContainerUpgrade (139.91s)

                                                
                                    
x
+
TestPause/serial/Start (68.44s)

                                                
                                                
=== RUN   TestPause/serial/Start
pause_test.go:80: (dbg) Run:  out/minikube-linux-arm64 start -p pause-797892 --memory=2048 --install-addons=false --wait=all --driver=docker  --container-runtime=crio
pause_test.go:80: (dbg) Done: out/minikube-linux-arm64 start -p pause-797892 --memory=2048 --install-addons=false --wait=all --driver=docker  --container-runtime=crio: (1m8.442802203s)
--- PASS: TestPause/serial/Start (68.44s)

                                                
                                    
x
+
TestPause/serial/SecondStartNoReconfiguration (37.08s)

                                                
                                                
=== RUN   TestPause/serial/SecondStartNoReconfiguration
pause_test.go:92: (dbg) Run:  out/minikube-linux-arm64 start -p pause-797892 --alsologtostderr -v=1 --driver=docker  --container-runtime=crio
pause_test.go:92: (dbg) Done: out/minikube-linux-arm64 start -p pause-797892 --alsologtostderr -v=1 --driver=docker  --container-runtime=crio: (37.05952478s)
--- PASS: TestPause/serial/SecondStartNoReconfiguration (37.08s)

                                                
                                    
x
+
TestPause/serial/Pause (0.92s)

                                                
                                                
=== RUN   TestPause/serial/Pause
pause_test.go:110: (dbg) Run:  out/minikube-linux-arm64 pause -p pause-797892 --alsologtostderr -v=5
--- PASS: TestPause/serial/Pause (0.92s)

                                                
                                    
x
+
TestPause/serial/VerifyStatus (0.35s)

                                                
                                                
=== RUN   TestPause/serial/VerifyStatus
status_test.go:76: (dbg) Run:  out/minikube-linux-arm64 status -p pause-797892 --output=json --layout=cluster
status_test.go:76: (dbg) Non-zero exit: out/minikube-linux-arm64 status -p pause-797892 --output=json --layout=cluster: exit status 2 (350.502417ms)

                                                
                                                
-- stdout --
	{"Name":"pause-797892","StatusCode":418,"StatusName":"Paused","Step":"Done","StepDetail":"* Paused 6 containers in: kube-system, kubernetes-dashboard, storage-gluster, istio-operator","BinaryVersion":"v1.33.1","Components":{"kubeconfig":{"Name":"kubeconfig","StatusCode":200,"StatusName":"OK"}},"Nodes":[{"Name":"pause-797892","StatusCode":200,"StatusName":"OK","Components":{"apiserver":{"Name":"apiserver","StatusCode":418,"StatusName":"Paused"},"kubelet":{"Name":"kubelet","StatusCode":405,"StatusName":"Stopped"}}}]}

                                                
                                                
-- /stdout --
--- PASS: TestPause/serial/VerifyStatus (0.35s)

                                                
                                    
x
+
TestPause/serial/Unpause (0.86s)

                                                
                                                
=== RUN   TestPause/serial/Unpause
pause_test.go:121: (dbg) Run:  out/minikube-linux-arm64 unpause -p pause-797892 --alsologtostderr -v=5
--- PASS: TestPause/serial/Unpause (0.86s)

                                                
                                    
x
+
TestPause/serial/PauseAgain (1.11s)

                                                
                                                
=== RUN   TestPause/serial/PauseAgain
pause_test.go:110: (dbg) Run:  out/minikube-linux-arm64 pause -p pause-797892 --alsologtostderr -v=5
pause_test.go:110: (dbg) Done: out/minikube-linux-arm64 pause -p pause-797892 --alsologtostderr -v=5: (1.107613029s)
--- PASS: TestPause/serial/PauseAgain (1.11s)

                                                
                                    
x
+
TestPause/serial/DeletePaused (3.43s)

                                                
                                                
=== RUN   TestPause/serial/DeletePaused
pause_test.go:132: (dbg) Run:  out/minikube-linux-arm64 delete -p pause-797892 --alsologtostderr -v=5
pause_test.go:132: (dbg) Done: out/minikube-linux-arm64 delete -p pause-797892 --alsologtostderr -v=5: (3.434221375s)
--- PASS: TestPause/serial/DeletePaused (3.43s)

                                                
                                    
x
+
TestPause/serial/VerifyDeletedResources (0.43s)

                                                
                                                
=== RUN   TestPause/serial/VerifyDeletedResources
pause_test.go:142: (dbg) Run:  out/minikube-linux-arm64 profile list --output json
pause_test.go:168: (dbg) Run:  docker ps -a
pause_test.go:173: (dbg) Run:  docker volume inspect pause-797892
pause_test.go:173: (dbg) Non-zero exit: docker volume inspect pause-797892: exit status 1 (17.064963ms)

                                                
                                                
-- stdout --
	[]

                                                
                                                
-- /stdout --
** stderr ** 
	Error response from daemon: get pause-797892: no such volume

                                                
                                                
** /stderr **
pause_test.go:178: (dbg) Run:  docker network ls
--- PASS: TestPause/serial/VerifyDeletedResources (0.43s)

                                                
                                    
x
+
TestStoppedBinaryUpgrade/Setup (0.74s)

                                                
                                                
=== RUN   TestStoppedBinaryUpgrade/Setup
--- PASS: TestStoppedBinaryUpgrade/Setup (0.74s)

                                                
                                    
x
+
TestStoppedBinaryUpgrade/Upgrade (91.03s)

                                                
                                                
=== RUN   TestStoppedBinaryUpgrade/Upgrade
version_upgrade_test.go:183: (dbg) Run:  /tmp/minikube-v1.26.0.4205174355 start -p stopped-upgrade-057378 --memory=2200 --vm-driver=docker  --container-runtime=crio
version_upgrade_test.go:183: (dbg) Done: /tmp/minikube-v1.26.0.4205174355 start -p stopped-upgrade-057378 --memory=2200 --vm-driver=docker  --container-runtime=crio: (41.375553018s)
version_upgrade_test.go:192: (dbg) Run:  /tmp/minikube-v1.26.0.4205174355 -p stopped-upgrade-057378 stop
version_upgrade_test.go:192: (dbg) Done: /tmp/minikube-v1.26.0.4205174355 -p stopped-upgrade-057378 stop: (3.058054598s)
version_upgrade_test.go:198: (dbg) Run:  out/minikube-linux-arm64 start -p stopped-upgrade-057378 --memory=2200 --alsologtostderr -v=1 --driver=docker  --container-runtime=crio
E0722 11:16:33.807814    7564 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19313-2237/.minikube/profiles/addons-578168/client.crt: no such file or directory
version_upgrade_test.go:198: (dbg) Done: out/minikube-linux-arm64 start -p stopped-upgrade-057378 --memory=2200 --alsologtostderr -v=1 --driver=docker  --container-runtime=crio: (46.600435476s)
--- PASS: TestStoppedBinaryUpgrade/Upgrade (91.03s)

                                                
                                    
x
+
TestStoppedBinaryUpgrade/MinikubeLogs (1.52s)

                                                
                                                
=== RUN   TestStoppedBinaryUpgrade/MinikubeLogs
version_upgrade_test.go:206: (dbg) Run:  out/minikube-linux-arm64 logs -p stopped-upgrade-057378
version_upgrade_test.go:206: (dbg) Done: out/minikube-linux-arm64 logs -p stopped-upgrade-057378: (1.515595102s)
--- PASS: TestStoppedBinaryUpgrade/MinikubeLogs (1.52s)

                                                
                                    
x
+
TestNoKubernetes/serial/StartNoK8sWithVersion (0.08s)

                                                
                                                
=== RUN   TestNoKubernetes/serial/StartNoK8sWithVersion
no_kubernetes_test.go:83: (dbg) Run:  out/minikube-linux-arm64 start -p NoKubernetes-138885 --no-kubernetes --kubernetes-version=1.20 --driver=docker  --container-runtime=crio
no_kubernetes_test.go:83: (dbg) Non-zero exit: out/minikube-linux-arm64 start -p NoKubernetes-138885 --no-kubernetes --kubernetes-version=1.20 --driver=docker  --container-runtime=crio: exit status 14 (81.131014ms)

                                                
                                                
-- stdout --
	* [NoKubernetes-138885] minikube v1.33.1 on Ubuntu 20.04 (arm64)
	  - MINIKUBE_LOCATION=19313
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - KUBECONFIG=/home/jenkins/minikube-integration/19313-2237/kubeconfig
	  - MINIKUBE_HOME=/home/jenkins/minikube-integration/19313-2237/.minikube
	  - MINIKUBE_BIN=out/minikube-linux-arm64
	  - MINIKUBE_FORCE_SYSTEMD=
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	X Exiting due to MK_USAGE: cannot specify --kubernetes-version with --no-kubernetes,
	to unset a global config run:
	
	$ minikube config unset kubernetes-version

                                                
                                                
** /stderr **
--- PASS: TestNoKubernetes/serial/StartNoK8sWithVersion (0.08s)

                                                
                                    
x
+
TestNoKubernetes/serial/StartWithK8s (32.42s)

                                                
                                                
=== RUN   TestNoKubernetes/serial/StartWithK8s
no_kubernetes_test.go:95: (dbg) Run:  out/minikube-linux-arm64 start -p NoKubernetes-138885 --driver=docker  --container-runtime=crio
E0722 11:19:19.082980    7564 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19313-2237/.minikube/profiles/functional-430070/client.crt: no such file or directory
no_kubernetes_test.go:95: (dbg) Done: out/minikube-linux-arm64 start -p NoKubernetes-138885 --driver=docker  --container-runtime=crio: (32.051504981s)
no_kubernetes_test.go:200: (dbg) Run:  out/minikube-linux-arm64 -p NoKubernetes-138885 status -o json
--- PASS: TestNoKubernetes/serial/StartWithK8s (32.42s)

                                                
                                    
x
+
TestNoKubernetes/serial/StartWithStopK8s (6.48s)

                                                
                                                
=== RUN   TestNoKubernetes/serial/StartWithStopK8s
no_kubernetes_test.go:112: (dbg) Run:  out/minikube-linux-arm64 start -p NoKubernetes-138885 --no-kubernetes --driver=docker  --container-runtime=crio
no_kubernetes_test.go:112: (dbg) Done: out/minikube-linux-arm64 start -p NoKubernetes-138885 --no-kubernetes --driver=docker  --container-runtime=crio: (4.159219451s)
no_kubernetes_test.go:200: (dbg) Run:  out/minikube-linux-arm64 -p NoKubernetes-138885 status -o json
no_kubernetes_test.go:200: (dbg) Non-zero exit: out/minikube-linux-arm64 -p NoKubernetes-138885 status -o json: exit status 2 (291.469594ms)

                                                
                                                
-- stdout --
	{"Name":"NoKubernetes-138885","Host":"Running","Kubelet":"Stopped","APIServer":"Stopped","Kubeconfig":"Configured","Worker":false}

                                                
                                                
-- /stdout --
no_kubernetes_test.go:124: (dbg) Run:  out/minikube-linux-arm64 delete -p NoKubernetes-138885
no_kubernetes_test.go:124: (dbg) Done: out/minikube-linux-arm64 delete -p NoKubernetes-138885: (2.030687018s)
--- PASS: TestNoKubernetes/serial/StartWithStopK8s (6.48s)

                                                
                                    
x
+
TestNoKubernetes/serial/Start (5.88s)

                                                
                                                
=== RUN   TestNoKubernetes/serial/Start
no_kubernetes_test.go:136: (dbg) Run:  out/minikube-linux-arm64 start -p NoKubernetes-138885 --no-kubernetes --driver=docker  --container-runtime=crio
no_kubernetes_test.go:136: (dbg) Done: out/minikube-linux-arm64 start -p NoKubernetes-138885 --no-kubernetes --driver=docker  --container-runtime=crio: (5.878843046s)
--- PASS: TestNoKubernetes/serial/Start (5.88s)

                                                
                                    
x
+
TestNoKubernetes/serial/VerifyK8sNotRunning (0.26s)

                                                
                                                
=== RUN   TestNoKubernetes/serial/VerifyK8sNotRunning
no_kubernetes_test.go:147: (dbg) Run:  out/minikube-linux-arm64 ssh -p NoKubernetes-138885 "sudo systemctl is-active --quiet service kubelet"
no_kubernetes_test.go:147: (dbg) Non-zero exit: out/minikube-linux-arm64 ssh -p NoKubernetes-138885 "sudo systemctl is-active --quiet service kubelet": exit status 1 (260.468219ms)

                                                
                                                
** stderr ** 
	ssh: Process exited with status 3

                                                
                                                
** /stderr **
--- PASS: TestNoKubernetes/serial/VerifyK8sNotRunning (0.26s)

                                                
                                    
x
+
TestNoKubernetes/serial/ProfileList (1.06s)

                                                
                                                
=== RUN   TestNoKubernetes/serial/ProfileList
no_kubernetes_test.go:169: (dbg) Run:  out/minikube-linux-arm64 profile list
no_kubernetes_test.go:179: (dbg) Run:  out/minikube-linux-arm64 profile list --output=json
--- PASS: TestNoKubernetes/serial/ProfileList (1.06s)

                                                
                                    
x
+
TestNoKubernetes/serial/Stop (1.21s)

                                                
                                                
=== RUN   TestNoKubernetes/serial/Stop
no_kubernetes_test.go:158: (dbg) Run:  out/minikube-linux-arm64 stop -p NoKubernetes-138885
no_kubernetes_test.go:158: (dbg) Done: out/minikube-linux-arm64 stop -p NoKubernetes-138885: (1.208757862s)
--- PASS: TestNoKubernetes/serial/Stop (1.21s)

                                                
                                    
x
+
TestNoKubernetes/serial/StartNoArgs (7.07s)

                                                
                                                
=== RUN   TestNoKubernetes/serial/StartNoArgs
no_kubernetes_test.go:191: (dbg) Run:  out/minikube-linux-arm64 start -p NoKubernetes-138885 --driver=docker  --container-runtime=crio
no_kubernetes_test.go:191: (dbg) Done: out/minikube-linux-arm64 start -p NoKubernetes-138885 --driver=docker  --container-runtime=crio: (7.07452956s)
--- PASS: TestNoKubernetes/serial/StartNoArgs (7.07s)

                                                
                                    
x
+
TestNoKubernetes/serial/VerifyK8sNotRunningSecond (0.25s)

                                                
                                                
=== RUN   TestNoKubernetes/serial/VerifyK8sNotRunningSecond
no_kubernetes_test.go:147: (dbg) Run:  out/minikube-linux-arm64 ssh -p NoKubernetes-138885 "sudo systemctl is-active --quiet service kubelet"
no_kubernetes_test.go:147: (dbg) Non-zero exit: out/minikube-linux-arm64 ssh -p NoKubernetes-138885 "sudo systemctl is-active --quiet service kubelet": exit status 1 (251.520564ms)

                                                
                                                
** stderr ** 
	ssh: Process exited with status 3

                                                
                                                
** /stderr **
--- PASS: TestNoKubernetes/serial/VerifyK8sNotRunningSecond (0.25s)

                                                
                                    
x
+
TestNetworkPlugins/group/false (3.64s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/false
net_test.go:246: (dbg) Run:  out/minikube-linux-arm64 start -p false-507554 --memory=2048 --alsologtostderr --cni=false --driver=docker  --container-runtime=crio
net_test.go:246: (dbg) Non-zero exit: out/minikube-linux-arm64 start -p false-507554 --memory=2048 --alsologtostderr --cni=false --driver=docker  --container-runtime=crio: exit status 14 (179.635596ms)

                                                
                                                
-- stdout --
	* [false-507554] minikube v1.33.1 on Ubuntu 20.04 (arm64)
	  - MINIKUBE_LOCATION=19313
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - KUBECONFIG=/home/jenkins/minikube-integration/19313-2237/kubeconfig
	  - MINIKUBE_HOME=/home/jenkins/minikube-integration/19313-2237/.minikube
	  - MINIKUBE_BIN=out/minikube-linux-arm64
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the docker driver based on user configuration
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0722 11:20:11.138827  186029 out.go:291] Setting OutFile to fd 1 ...
	I0722 11:20:11.139033  186029 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0722 11:20:11.139060  186029 out.go:304] Setting ErrFile to fd 2...
	I0722 11:20:11.139079  186029 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0722 11:20:11.139348  186029 root.go:338] Updating PATH: /home/jenkins/minikube-integration/19313-2237/.minikube/bin
	I0722 11:20:11.139795  186029 out.go:298] Setting JSON to false
	I0722 11:20:11.140753  186029 start.go:129] hostinfo: {"hostname":"ip-172-31-21-244","uptime":3756,"bootTime":1721643455,"procs":200,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1064-aws","kernelArch":"aarch64","virtualizationSystem":"","virtualizationRole":"","hostId":"da8ac1fd-6236-412a-a346-95873c98230d"}
	I0722 11:20:11.140903  186029 start.go:139] virtualization:  
	I0722 11:20:11.145299  186029 out.go:177] * [false-507554] minikube v1.33.1 on Ubuntu 20.04 (arm64)
	I0722 11:20:11.147462  186029 out.go:177]   - MINIKUBE_LOCATION=19313
	I0722 11:20:11.147556  186029 notify.go:220] Checking for updates...
	I0722 11:20:11.151814  186029 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I0722 11:20:11.154176  186029 out.go:177]   - KUBECONFIG=/home/jenkins/minikube-integration/19313-2237/kubeconfig
	I0722 11:20:11.156399  186029 out.go:177]   - MINIKUBE_HOME=/home/jenkins/minikube-integration/19313-2237/.minikube
	I0722 11:20:11.158587  186029 out.go:177]   - MINIKUBE_BIN=out/minikube-linux-arm64
	I0722 11:20:11.160598  186029 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=
	I0722 11:20:11.163479  186029 config.go:182] Loaded profile config "kubernetes-upgrade-176274": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.31.0-beta.0
	I0722 11:20:11.163589  186029 driver.go:392] Setting default libvirt URI to qemu:///system
	I0722 11:20:11.189782  186029 docker.go:123] docker version: linux-27.0.3:Docker Engine - Community
	I0722 11:20:11.189896  186029 cli_runner.go:164] Run: docker system info --format "{{json .}}"
	I0722 11:20:11.259281  186029 info.go:266] docker info: {ID:5FDH:SA5P:5GCT:NLAS:B73P:SGDQ:PBG5:UBVH:UZY3:RXGO:CI7S:WAIH Containers:1 ContainersRunning:1 ContainersPaused:0 ContainersStopped:0 Images:4 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:35 OomKillDisable:true NGoroutines:53 SystemTime:2024-07-22 11:20:11.250220222 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1064-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Architecture:aar
ch64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8214896640 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-21-244 Labels:[] ExperimentalBuild:false ServerVersion:27.0.3 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:2bf793ef6dc9a18e00cb12efb64355c2c9d5eb41 Expected:2bf793ef6dc9a18e00cb12efb64355c2c9d5eb41} RuncCommit:{ID:v1.1.13-0-g58aa920 Expected:v1.1.13-0-g58aa920} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:<nil> ServerErro
rs:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.15.1] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.28.1]] Warnings:<nil>}}
	I0722 11:20:11.259393  186029 docker.go:307] overlay module found
	I0722 11:20:11.261535  186029 out.go:177] * Using the docker driver based on user configuration
	I0722 11:20:11.263583  186029 start.go:297] selected driver: docker
	I0722 11:20:11.263600  186029 start.go:901] validating driver "docker" against <nil>
	I0722 11:20:11.263621  186029 start.go:912] status for docker: {Installed:true Healthy:true Running:false NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I0722 11:20:11.266131  186029 out.go:177] 
	W0722 11:20:11.268062  186029 out.go:239] X Exiting due to MK_USAGE: The "crio" container runtime requires CNI
	X Exiting due to MK_USAGE: The "crio" container runtime requires CNI
	I0722 11:20:11.269720  186029 out.go:177] 

                                                
                                                
** /stderr **
net_test.go:88: 
----------------------- debugLogs start: false-507554 [pass: true] --------------------------------
>>> netcat: nslookup kubernetes.default:
Error in configuration: context was not found for specified context: false-507554

                                                
                                                

                                                
                                                
>>> netcat: nslookup debug kubernetes.default a-records:
Error in configuration: context was not found for specified context: false-507554

                                                
                                                

                                                
                                                
>>> netcat: dig search kubernetes.default:
Error in configuration: context was not found for specified context: false-507554

                                                
                                                

                                                
                                                
>>> netcat: dig @10.96.0.10 kubernetes.default.svc.cluster.local udp/53:
Error in configuration: context was not found for specified context: false-507554

                                                
                                                

                                                
                                                
>>> netcat: dig @10.96.0.10 kubernetes.default.svc.cluster.local tcp/53:
Error in configuration: context was not found for specified context: false-507554

                                                
                                                

                                                
                                                
>>> netcat: nc 10.96.0.10 udp/53:
Error in configuration: context was not found for specified context: false-507554

                                                
                                                

                                                
                                                
>>> netcat: nc 10.96.0.10 tcp/53:
Error in configuration: context was not found for specified context: false-507554

                                                
                                                

                                                
                                                
>>> netcat: /etc/nsswitch.conf:
Error in configuration: context was not found for specified context: false-507554

                                                
                                                

                                                
                                                
>>> netcat: /etc/hosts:
Error in configuration: context was not found for specified context: false-507554

                                                
                                                

                                                
                                                
>>> netcat: /etc/resolv.conf:
Error in configuration: context was not found for specified context: false-507554

                                                
                                                

                                                
                                                
>>> host: /etc/nsswitch.conf:
* Profile "false-507554" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-507554"

                                                
                                                

                                                
                                                
>>> host: /etc/hosts:
* Profile "false-507554" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-507554"

                                                
                                                

                                                
                                                
>>> host: /etc/resolv.conf:
* Profile "false-507554" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-507554"

                                                
                                                

                                                
                                                
>>> k8s: nodes, services, endpoints, daemon sets, deployments and pods, :
Error in configuration: context was not found for specified context: false-507554

                                                
                                                

                                                
                                                
>>> host: crictl pods:
* Profile "false-507554" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-507554"

                                                
                                                

                                                
                                                
>>> host: crictl containers:
* Profile "false-507554" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-507554"

                                                
                                                

                                                
                                                
>>> k8s: describe netcat deployment:
error: context "false-507554" does not exist

                                                
                                                

                                                
                                                
>>> k8s: describe netcat pod(s):
error: context "false-507554" does not exist

                                                
                                                

                                                
                                                
>>> k8s: netcat logs:
error: context "false-507554" does not exist

                                                
                                                

                                                
                                                
>>> k8s: describe coredns deployment:
error: context "false-507554" does not exist

                                                
                                                

                                                
                                                
>>> k8s: describe coredns pods:
error: context "false-507554" does not exist

                                                
                                                

                                                
                                                
>>> k8s: coredns logs:
error: context "false-507554" does not exist

                                                
                                                

                                                
                                                
>>> k8s: describe api server pod(s):
error: context "false-507554" does not exist

                                                
                                                

                                                
                                                
>>> k8s: api server logs:
error: context "false-507554" does not exist

                                                
                                                

                                                
                                                
>>> host: /etc/cni:
* Profile "false-507554" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-507554"

                                                
                                                

                                                
                                                
>>> host: ip a s:
* Profile "false-507554" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-507554"

                                                
                                                

                                                
                                                
>>> host: ip r s:
* Profile "false-507554" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-507554"

                                                
                                                

                                                
                                                
>>> host: iptables-save:
* Profile "false-507554" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-507554"

                                                
                                                

                                                
                                                
>>> host: iptables table nat:
* Profile "false-507554" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-507554"

                                                
                                                

                                                
                                                
>>> k8s: describe kube-proxy daemon set:
error: context "false-507554" does not exist

                                                
                                                

                                                
                                                
>>> k8s: describe kube-proxy pod(s):
error: context "false-507554" does not exist

                                                
                                                

                                                
                                                
>>> k8s: kube-proxy logs:
error: context "false-507554" does not exist

                                                
                                                

                                                
                                                
>>> host: kubelet daemon status:
* Profile "false-507554" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-507554"

                                                
                                                

                                                
                                                
>>> host: kubelet daemon config:
* Profile "false-507554" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-507554"

                                                
                                                

                                                
                                                
>>> k8s: kubelet logs:
* Profile "false-507554" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-507554"

                                                
                                                

                                                
                                                
>>> host: /etc/kubernetes/kubelet.conf:
* Profile "false-507554" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-507554"

                                                
                                                

                                                
                                                
>>> host: /var/lib/kubelet/config.yaml:
* Profile "false-507554" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-507554"

                                                
                                                

                                                
                                                
>>> k8s: kubectl config:
apiVersion: v1
clusters:
- cluster:
certificate-authority: /home/jenkins/minikube-integration/19313-2237/.minikube/ca.crt
extensions:
- extension:
last-update: Mon, 22 Jul 2024 11:16:57 UTC
provider: minikube.sigs.k8s.io
version: v1.33.1
name: cluster_info
server: https://192.168.76.2:8443
name: kubernetes-upgrade-176274
contexts:
- context:
cluster: kubernetes-upgrade-176274
user: kubernetes-upgrade-176274
name: kubernetes-upgrade-176274
current-context: ""
kind: Config
preferences: {}
users:
- name: kubernetes-upgrade-176274
user:
client-certificate: /home/jenkins/minikube-integration/19313-2237/.minikube/profiles/kubernetes-upgrade-176274/client.crt
client-key: /home/jenkins/minikube-integration/19313-2237/.minikube/profiles/kubernetes-upgrade-176274/client.key

                                                
                                                

                                                
                                                
>>> k8s: cms:
Error in configuration: context was not found for specified context: false-507554

                                                
                                                

                                                
                                                
>>> host: docker daemon status:
* Profile "false-507554" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-507554"

                                                
                                                

                                                
                                                
>>> host: docker daemon config:
* Profile "false-507554" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-507554"

                                                
                                                

                                                
                                                
>>> host: /etc/docker/daemon.json:
* Profile "false-507554" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-507554"

                                                
                                                

                                                
                                                
>>> host: docker system info:
* Profile "false-507554" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-507554"

                                                
                                                

                                                
                                                
>>> host: cri-docker daemon status:
* Profile "false-507554" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-507554"

                                                
                                                

                                                
                                                
>>> host: cri-docker daemon config:
* Profile "false-507554" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-507554"

                                                
                                                

                                                
                                                
>>> host: /etc/systemd/system/cri-docker.service.d/10-cni.conf:
* Profile "false-507554" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-507554"

                                                
                                                

                                                
                                                
>>> host: /usr/lib/systemd/system/cri-docker.service:
* Profile "false-507554" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-507554"

                                                
                                                

                                                
                                                
>>> host: cri-dockerd version:
* Profile "false-507554" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-507554"

                                                
                                                

                                                
                                                
>>> host: containerd daemon status:
* Profile "false-507554" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-507554"

                                                
                                                

                                                
                                                
>>> host: containerd daemon config:
* Profile "false-507554" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-507554"

                                                
                                                

                                                
                                                
>>> host: /lib/systemd/system/containerd.service:
* Profile "false-507554" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-507554"

                                                
                                                

                                                
                                                
>>> host: /etc/containerd/config.toml:
* Profile "false-507554" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-507554"

                                                
                                                

                                                
                                                
>>> host: containerd config dump:
* Profile "false-507554" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-507554"

                                                
                                                

                                                
                                                
>>> host: crio daemon status:
* Profile "false-507554" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-507554"

                                                
                                                

                                                
                                                
>>> host: crio daemon config:
* Profile "false-507554" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-507554"

                                                
                                                

                                                
                                                
>>> host: /etc/crio:
* Profile "false-507554" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-507554"

                                                
                                                

                                                
                                                
>>> host: crio config:
* Profile "false-507554" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-507554"

                                                
                                                
----------------------- debugLogs end: false-507554 [took: 3.321091832s] --------------------------------
helpers_test.go:175: Cleaning up "false-507554" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-arm64 delete -p false-507554
--- PASS: TestNetworkPlugins/group/false (3.64s)

                                                
                                    
x
+
TestStartStop/group/old-k8s-version/serial/FirstStart (163.66s)

                                                
                                                
=== RUN   TestStartStop/group/old-k8s-version/serial/FirstStart
start_stop_delete_test.go:186: (dbg) Run:  out/minikube-linux-arm64 start -p old-k8s-version-584140 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=docker  --container-runtime=crio --kubernetes-version=v1.20.0
E0722 11:23:30.762231    7564 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19313-2237/.minikube/profiles/addons-578168/client.crt: no such file or directory
start_stop_delete_test.go:186: (dbg) Done: out/minikube-linux-arm64 start -p old-k8s-version-584140 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=docker  --container-runtime=crio --kubernetes-version=v1.20.0: (2m43.662773191s)
--- PASS: TestStartStop/group/old-k8s-version/serial/FirstStart (163.66s)

                                                
                                    
x
+
TestStartStop/group/embed-certs/serial/FirstStart (63.89s)

                                                
                                                
=== RUN   TestStartStop/group/embed-certs/serial/FirstStart
start_stop_delete_test.go:186: (dbg) Run:  out/minikube-linux-arm64 start -p embed-certs-981687 --memory=2200 --alsologtostderr --wait=true --embed-certs --driver=docker  --container-runtime=crio --kubernetes-version=v1.30.3
start_stop_delete_test.go:186: (dbg) Done: out/minikube-linux-arm64 start -p embed-certs-981687 --memory=2200 --alsologtostderr --wait=true --embed-certs --driver=docker  --container-runtime=crio --kubernetes-version=v1.30.3: (1m3.889194859s)
--- PASS: TestStartStop/group/embed-certs/serial/FirstStart (63.89s)

                                                
                                    
x
+
TestStartStop/group/embed-certs/serial/DeployApp (9.4s)

                                                
                                                
=== RUN   TestStartStop/group/embed-certs/serial/DeployApp
start_stop_delete_test.go:196: (dbg) Run:  kubectl --context embed-certs-981687 create -f testdata/busybox.yaml
start_stop_delete_test.go:196: (dbg) TestStartStop/group/embed-certs/serial/DeployApp: waiting 8m0s for pods matching "integration-test=busybox" in namespace "default" ...
helpers_test.go:344: "busybox" [abe25f5a-d2a5-4a46-9586-931058e35155] Pending / Ready:ContainersNotReady (containers with unready status: [busybox]) / ContainersReady:ContainersNotReady (containers with unready status: [busybox])
helpers_test.go:344: "busybox" [abe25f5a-d2a5-4a46-9586-931058e35155] Running
start_stop_delete_test.go:196: (dbg) TestStartStop/group/embed-certs/serial/DeployApp: integration-test=busybox healthy within 9.003388727s
start_stop_delete_test.go:196: (dbg) Run:  kubectl --context embed-certs-981687 exec busybox -- /bin/sh -c "ulimit -n"
--- PASS: TestStartStop/group/embed-certs/serial/DeployApp (9.40s)

                                                
                                    
x
+
TestStartStop/group/embed-certs/serial/EnableAddonWhileActive (1.07s)

                                                
                                                
=== RUN   TestStartStop/group/embed-certs/serial/EnableAddonWhileActive
start_stop_delete_test.go:205: (dbg) Run:  out/minikube-linux-arm64 addons enable metrics-server -p embed-certs-981687 --images=MetricsServer=registry.k8s.io/echoserver:1.4 --registries=MetricsServer=fake.domain
start_stop_delete_test.go:215: (dbg) Run:  kubectl --context embed-certs-981687 describe deploy/metrics-server -n kube-system
--- PASS: TestStartStop/group/embed-certs/serial/EnableAddonWhileActive (1.07s)

                                                
                                    
x
+
TestStartStop/group/embed-certs/serial/Stop (11.92s)

                                                
                                                
=== RUN   TestStartStop/group/embed-certs/serial/Stop
start_stop_delete_test.go:228: (dbg) Run:  out/minikube-linux-arm64 stop -p embed-certs-981687 --alsologtostderr -v=3
start_stop_delete_test.go:228: (dbg) Done: out/minikube-linux-arm64 stop -p embed-certs-981687 --alsologtostderr -v=3: (11.920889309s)
--- PASS: TestStartStop/group/embed-certs/serial/Stop (11.92s)

                                                
                                    
x
+
TestStartStop/group/embed-certs/serial/EnableAddonAfterStop (0.18s)

                                                
                                                
=== RUN   TestStartStop/group/embed-certs/serial/EnableAddonAfterStop
start_stop_delete_test.go:239: (dbg) Run:  out/minikube-linux-arm64 status --format={{.Host}} -p embed-certs-981687 -n embed-certs-981687
start_stop_delete_test.go:239: (dbg) Non-zero exit: out/minikube-linux-arm64 status --format={{.Host}} -p embed-certs-981687 -n embed-certs-981687: exit status 7 (73.276187ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
start_stop_delete_test.go:239: status error: exit status 7 (may be ok)
start_stop_delete_test.go:246: (dbg) Run:  out/minikube-linux-arm64 addons enable dashboard -p embed-certs-981687 --images=MetricsScraper=registry.k8s.io/echoserver:1.4
--- PASS: TestStartStop/group/embed-certs/serial/EnableAddonAfterStop (0.18s)

                                                
                                    
x
+
TestStartStop/group/embed-certs/serial/SecondStart (273.58s)

                                                
                                                
=== RUN   TestStartStop/group/embed-certs/serial/SecondStart
start_stop_delete_test.go:256: (dbg) Run:  out/minikube-linux-arm64 start -p embed-certs-981687 --memory=2200 --alsologtostderr --wait=true --embed-certs --driver=docker  --container-runtime=crio --kubernetes-version=v1.30.3
start_stop_delete_test.go:256: (dbg) Done: out/minikube-linux-arm64 start -p embed-certs-981687 --memory=2200 --alsologtostderr --wait=true --embed-certs --driver=docker  --container-runtime=crio --kubernetes-version=v1.30.3: (4m33.225884966s)
start_stop_delete_test.go:262: (dbg) Run:  out/minikube-linux-arm64 status --format={{.Host}} -p embed-certs-981687 -n embed-certs-981687
--- PASS: TestStartStop/group/embed-certs/serial/SecondStart (273.58s)

                                                
                                    
x
+
TestStartStop/group/old-k8s-version/serial/DeployApp (8.7s)

                                                
                                                
=== RUN   TestStartStop/group/old-k8s-version/serial/DeployApp
start_stop_delete_test.go:196: (dbg) Run:  kubectl --context old-k8s-version-584140 create -f testdata/busybox.yaml
start_stop_delete_test.go:196: (dbg) TestStartStop/group/old-k8s-version/serial/DeployApp: waiting 8m0s for pods matching "integration-test=busybox" in namespace "default" ...
helpers_test.go:344: "busybox" [b7feb2da-ec6f-4f75-806c-528d03dd42e2] Pending
helpers_test.go:344: "busybox" [b7feb2da-ec6f-4f75-806c-528d03dd42e2] Pending / Ready:ContainersNotReady (containers with unready status: [busybox]) / ContainersReady:ContainersNotReady (containers with unready status: [busybox])
helpers_test.go:344: "busybox" [b7feb2da-ec6f-4f75-806c-528d03dd42e2] Running
start_stop_delete_test.go:196: (dbg) TestStartStop/group/old-k8s-version/serial/DeployApp: integration-test=busybox healthy within 8.004221869s
start_stop_delete_test.go:196: (dbg) Run:  kubectl --context old-k8s-version-584140 exec busybox -- /bin/sh -c "ulimit -n"
--- PASS: TestStartStop/group/old-k8s-version/serial/DeployApp (8.70s)

                                                
                                    
x
+
TestStartStop/group/old-k8s-version/serial/EnableAddonWhileActive (1.85s)

                                                
                                                
=== RUN   TestStartStop/group/old-k8s-version/serial/EnableAddonWhileActive
start_stop_delete_test.go:205: (dbg) Run:  out/minikube-linux-arm64 addons enable metrics-server -p old-k8s-version-584140 --images=MetricsServer=registry.k8s.io/echoserver:1.4 --registries=MetricsServer=fake.domain
start_stop_delete_test.go:205: (dbg) Done: out/minikube-linux-arm64 addons enable metrics-server -p old-k8s-version-584140 --images=MetricsServer=registry.k8s.io/echoserver:1.4 --registries=MetricsServer=fake.domain: (1.695898129s)
start_stop_delete_test.go:215: (dbg) Run:  kubectl --context old-k8s-version-584140 describe deploy/metrics-server -n kube-system
--- PASS: TestStartStop/group/old-k8s-version/serial/EnableAddonWhileActive (1.85s)

                                                
                                    
x
+
TestStartStop/group/old-k8s-version/serial/Stop (12.25s)

                                                
                                                
=== RUN   TestStartStop/group/old-k8s-version/serial/Stop
start_stop_delete_test.go:228: (dbg) Run:  out/minikube-linux-arm64 stop -p old-k8s-version-584140 --alsologtostderr -v=3
start_stop_delete_test.go:228: (dbg) Done: out/minikube-linux-arm64 stop -p old-k8s-version-584140 --alsologtostderr -v=3: (12.249803658s)
--- PASS: TestStartStop/group/old-k8s-version/serial/Stop (12.25s)

                                                
                                    
x
+
TestStartStop/group/old-k8s-version/serial/EnableAddonAfterStop (0.18s)

                                                
                                                
=== RUN   TestStartStop/group/old-k8s-version/serial/EnableAddonAfterStop
start_stop_delete_test.go:239: (dbg) Run:  out/minikube-linux-arm64 status --format={{.Host}} -p old-k8s-version-584140 -n old-k8s-version-584140
start_stop_delete_test.go:239: (dbg) Non-zero exit: out/minikube-linux-arm64 status --format={{.Host}} -p old-k8s-version-584140 -n old-k8s-version-584140: exit status 7 (67.804927ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
start_stop_delete_test.go:239: status error: exit status 7 (may be ok)
start_stop_delete_test.go:246: (dbg) Run:  out/minikube-linux-arm64 addons enable dashboard -p old-k8s-version-584140 --images=MetricsScraper=registry.k8s.io/echoserver:1.4
--- PASS: TestStartStop/group/old-k8s-version/serial/EnableAddonAfterStop (0.18s)

                                                
                                    
x
+
TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop (6s)

                                                
                                                
=== RUN   TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop
start_stop_delete_test.go:274: (dbg) TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: waiting 9m0s for pods matching "k8s-app=kubernetes-dashboard" in namespace "kubernetes-dashboard" ...
helpers_test.go:344: "kubernetes-dashboard-779776cb65-znzt9" [6a40035a-2fda-4730-8f22-540b1b41ccae] Running
start_stop_delete_test.go:274: (dbg) TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: k8s-app=kubernetes-dashboard healthy within 6.003408522s
--- PASS: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop (6.00s)

                                                
                                    
x
+
TestStartStop/group/embed-certs/serial/AddonExistsAfterStop (5.1s)

                                                
                                                
=== RUN   TestStartStop/group/embed-certs/serial/AddonExistsAfterStop
start_stop_delete_test.go:287: (dbg) TestStartStop/group/embed-certs/serial/AddonExistsAfterStop: waiting 9m0s for pods matching "k8s-app=kubernetes-dashboard" in namespace "kubernetes-dashboard" ...
helpers_test.go:344: "kubernetes-dashboard-779776cb65-znzt9" [6a40035a-2fda-4730-8f22-540b1b41ccae] Running
start_stop_delete_test.go:287: (dbg) TestStartStop/group/embed-certs/serial/AddonExistsAfterStop: k8s-app=kubernetes-dashboard healthy within 5.003578003s
start_stop_delete_test.go:291: (dbg) Run:  kubectl --context embed-certs-981687 describe deploy/dashboard-metrics-scraper -n kubernetes-dashboard
--- PASS: TestStartStop/group/embed-certs/serial/AddonExistsAfterStop (5.10s)

                                                
                                    
x
+
TestStartStop/group/embed-certs/serial/VerifyKubernetesImages (0.26s)

                                                
                                                
=== RUN   TestStartStop/group/embed-certs/serial/VerifyKubernetesImages
start_stop_delete_test.go:304: (dbg) Run:  out/minikube-linux-arm64 -p embed-certs-981687 image list --format=json
start_stop_delete_test.go:304: Found non-minikube image: kindest/kindnetd:v20240719-e7903573
start_stop_delete_test.go:304: Found non-minikube image: gcr.io/k8s-minikube/busybox:1.28.4-glibc
start_stop_delete_test.go:304: Found non-minikube image: kindest/kindnetd:v20240715-585640e9
--- PASS: TestStartStop/group/embed-certs/serial/VerifyKubernetesImages (0.26s)

                                                
                                    
x
+
TestStartStop/group/embed-certs/serial/Pause (3.09s)

                                                
                                                
=== RUN   TestStartStop/group/embed-certs/serial/Pause
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 pause -p embed-certs-981687 --alsologtostderr -v=1
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 status --format={{.APIServer}} -p embed-certs-981687 -n embed-certs-981687
start_stop_delete_test.go:311: (dbg) Non-zero exit: out/minikube-linux-arm64 status --format={{.APIServer}} -p embed-certs-981687 -n embed-certs-981687: exit status 2 (324.067708ms)

                                                
                                                
-- stdout --
	Paused

                                                
                                                
-- /stdout --
start_stop_delete_test.go:311: status error: exit status 2 (may be ok)
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 status --format={{.Kubelet}} -p embed-certs-981687 -n embed-certs-981687
start_stop_delete_test.go:311: (dbg) Non-zero exit: out/minikube-linux-arm64 status --format={{.Kubelet}} -p embed-certs-981687 -n embed-certs-981687: exit status 2 (311.472584ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
start_stop_delete_test.go:311: status error: exit status 2 (may be ok)
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 unpause -p embed-certs-981687 --alsologtostderr -v=1
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 status --format={{.APIServer}} -p embed-certs-981687 -n embed-certs-981687
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 status --format={{.Kubelet}} -p embed-certs-981687 -n embed-certs-981687
--- PASS: TestStartStop/group/embed-certs/serial/Pause (3.09s)

                                                
                                    
x
+
TestStartStop/group/no-preload/serial/FirstStart (60.87s)

                                                
                                                
=== RUN   TestStartStop/group/no-preload/serial/FirstStart
start_stop_delete_test.go:186: (dbg) Run:  out/minikube-linux-arm64 start -p no-preload-076896 --memory=2200 --alsologtostderr --wait=true --preload=false --driver=docker  --container-runtime=crio --kubernetes-version=v1.31.0-beta.0
start_stop_delete_test.go:186: (dbg) Done: out/minikube-linux-arm64 start -p no-preload-076896 --memory=2200 --alsologtostderr --wait=true --preload=false --driver=docker  --container-runtime=crio --kubernetes-version=v1.31.0-beta.0: (1m0.873118962s)
--- PASS: TestStartStop/group/no-preload/serial/FirstStart (60.87s)

                                                
                                    
x
+
TestStartStop/group/no-preload/serial/DeployApp (8.37s)

                                                
                                                
=== RUN   TestStartStop/group/no-preload/serial/DeployApp
start_stop_delete_test.go:196: (dbg) Run:  kubectl --context no-preload-076896 create -f testdata/busybox.yaml
start_stop_delete_test.go:196: (dbg) TestStartStop/group/no-preload/serial/DeployApp: waiting 8m0s for pods matching "integration-test=busybox" in namespace "default" ...
helpers_test.go:344: "busybox" [5d20f7c8-f34c-461a-9002-ea0728bf105d] Pending
helpers_test.go:344: "busybox" [5d20f7c8-f34c-461a-9002-ea0728bf105d] Pending / Ready:ContainersNotReady (containers with unready status: [busybox]) / ContainersReady:ContainersNotReady (containers with unready status: [busybox])
helpers_test.go:344: "busybox" [5d20f7c8-f34c-461a-9002-ea0728bf105d] Running
start_stop_delete_test.go:196: (dbg) TestStartStop/group/no-preload/serial/DeployApp: integration-test=busybox healthy within 8.004802549s
start_stop_delete_test.go:196: (dbg) Run:  kubectl --context no-preload-076896 exec busybox -- /bin/sh -c "ulimit -n"
--- PASS: TestStartStop/group/no-preload/serial/DeployApp (8.37s)

                                                
                                    
x
+
TestStartStop/group/no-preload/serial/EnableAddonWhileActive (1.15s)

                                                
                                                
=== RUN   TestStartStop/group/no-preload/serial/EnableAddonWhileActive
start_stop_delete_test.go:205: (dbg) Run:  out/minikube-linux-arm64 addons enable metrics-server -p no-preload-076896 --images=MetricsServer=registry.k8s.io/echoserver:1.4 --registries=MetricsServer=fake.domain
start_stop_delete_test.go:205: (dbg) Done: out/minikube-linux-arm64 addons enable metrics-server -p no-preload-076896 --images=MetricsServer=registry.k8s.io/echoserver:1.4 --registries=MetricsServer=fake.domain: (1.005902943s)
start_stop_delete_test.go:215: (dbg) Run:  kubectl --context no-preload-076896 describe deploy/metrics-server -n kube-system
--- PASS: TestStartStop/group/no-preload/serial/EnableAddonWhileActive (1.15s)

                                                
                                    
x
+
TestStartStop/group/no-preload/serial/Stop (11.94s)

                                                
                                                
=== RUN   TestStartStop/group/no-preload/serial/Stop
start_stop_delete_test.go:228: (dbg) Run:  out/minikube-linux-arm64 stop -p no-preload-076896 --alsologtostderr -v=3
start_stop_delete_test.go:228: (dbg) Done: out/minikube-linux-arm64 stop -p no-preload-076896 --alsologtostderr -v=3: (11.943446204s)
--- PASS: TestStartStop/group/no-preload/serial/Stop (11.94s)

                                                
                                    
x
+
TestStartStop/group/no-preload/serial/EnableAddonAfterStop (0.28s)

                                                
                                                
=== RUN   TestStartStop/group/no-preload/serial/EnableAddonAfterStop
start_stop_delete_test.go:239: (dbg) Run:  out/minikube-linux-arm64 status --format={{.Host}} -p no-preload-076896 -n no-preload-076896
start_stop_delete_test.go:239: (dbg) Non-zero exit: out/minikube-linux-arm64 status --format={{.Host}} -p no-preload-076896 -n no-preload-076896: exit status 7 (82.045617ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
start_stop_delete_test.go:239: status error: exit status 7 (may be ok)
start_stop_delete_test.go:246: (dbg) Run:  out/minikube-linux-arm64 addons enable dashboard -p no-preload-076896 --images=MetricsScraper=registry.k8s.io/echoserver:1.4
--- PASS: TestStartStop/group/no-preload/serial/EnableAddonAfterStop (0.28s)

                                                
                                    
x
+
TestStartStop/group/no-preload/serial/SecondStart (276.26s)

                                                
                                                
=== RUN   TestStartStop/group/no-preload/serial/SecondStart
start_stop_delete_test.go:256: (dbg) Run:  out/minikube-linux-arm64 start -p no-preload-076896 --memory=2200 --alsologtostderr --wait=true --preload=false --driver=docker  --container-runtime=crio --kubernetes-version=v1.31.0-beta.0
start_stop_delete_test.go:256: (dbg) Done: out/minikube-linux-arm64 start -p no-preload-076896 --memory=2200 --alsologtostderr --wait=true --preload=false --driver=docker  --container-runtime=crio --kubernetes-version=v1.31.0-beta.0: (4m35.893266022s)
start_stop_delete_test.go:262: (dbg) Run:  out/minikube-linux-arm64 status --format={{.Host}} -p no-preload-076896 -n no-preload-076896
--- PASS: TestStartStop/group/no-preload/serial/SecondStart (276.26s)

                                                
                                    
x
+
TestStartStop/group/old-k8s-version/serial/UserAppExistsAfterStop (6.01s)

                                                
                                                
=== RUN   TestStartStop/group/old-k8s-version/serial/UserAppExistsAfterStop
start_stop_delete_test.go:274: (dbg) TestStartStop/group/old-k8s-version/serial/UserAppExistsAfterStop: waiting 9m0s for pods matching "k8s-app=kubernetes-dashboard" in namespace "kubernetes-dashboard" ...
helpers_test.go:344: "kubernetes-dashboard-cd95d586-pmxh6" [3ecafe84-5507-40cf-afcc-bb0e9d44d224] Running
start_stop_delete_test.go:274: (dbg) TestStartStop/group/old-k8s-version/serial/UserAppExistsAfterStop: k8s-app=kubernetes-dashboard healthy within 6.0039141s
--- PASS: TestStartStop/group/old-k8s-version/serial/UserAppExistsAfterStop (6.01s)

                                                
                                    
x
+
TestStartStop/group/old-k8s-version/serial/AddonExistsAfterStop (6.11s)

                                                
                                                
=== RUN   TestStartStop/group/old-k8s-version/serial/AddonExistsAfterStop
start_stop_delete_test.go:287: (dbg) TestStartStop/group/old-k8s-version/serial/AddonExistsAfterStop: waiting 9m0s for pods matching "k8s-app=kubernetes-dashboard" in namespace "kubernetes-dashboard" ...
helpers_test.go:344: "kubernetes-dashboard-cd95d586-pmxh6" [3ecafe84-5507-40cf-afcc-bb0e9d44d224] Running
start_stop_delete_test.go:287: (dbg) TestStartStop/group/old-k8s-version/serial/AddonExistsAfterStop: k8s-app=kubernetes-dashboard healthy within 6.004344408s
start_stop_delete_test.go:291: (dbg) Run:  kubectl --context old-k8s-version-584140 describe deploy/dashboard-metrics-scraper -n kubernetes-dashboard
--- PASS: TestStartStop/group/old-k8s-version/serial/AddonExistsAfterStop (6.11s)

                                                
                                    
x
+
TestStartStop/group/old-k8s-version/serial/VerifyKubernetesImages (0.23s)

                                                
                                                
=== RUN   TestStartStop/group/old-k8s-version/serial/VerifyKubernetesImages
start_stop_delete_test.go:304: (dbg) Run:  out/minikube-linux-arm64 -p old-k8s-version-584140 image list --format=json
start_stop_delete_test.go:304: Found non-minikube image: kindest/kindnetd:v20240202-8f1494ea
start_stop_delete_test.go:304: Found non-minikube image: gcr.io/k8s-minikube/busybox:1.28.4-glibc
start_stop_delete_test.go:304: Found non-minikube image: kindest/kindnetd:v20240719-e7903573
--- PASS: TestStartStop/group/old-k8s-version/serial/VerifyKubernetesImages (0.23s)

                                                
                                    
x
+
TestStartStop/group/old-k8s-version/serial/Pause (2.95s)

                                                
                                                
=== RUN   TestStartStop/group/old-k8s-version/serial/Pause
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 pause -p old-k8s-version-584140 --alsologtostderr -v=1
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 status --format={{.APIServer}} -p old-k8s-version-584140 -n old-k8s-version-584140
start_stop_delete_test.go:311: (dbg) Non-zero exit: out/minikube-linux-arm64 status --format={{.APIServer}} -p old-k8s-version-584140 -n old-k8s-version-584140: exit status 2 (316.399275ms)

                                                
                                                
-- stdout --
	Paused

                                                
                                                
-- /stdout --
start_stop_delete_test.go:311: status error: exit status 2 (may be ok)
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 status --format={{.Kubelet}} -p old-k8s-version-584140 -n old-k8s-version-584140
start_stop_delete_test.go:311: (dbg) Non-zero exit: out/minikube-linux-arm64 status --format={{.Kubelet}} -p old-k8s-version-584140 -n old-k8s-version-584140: exit status 2 (320.078592ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
start_stop_delete_test.go:311: status error: exit status 2 (may be ok)
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 unpause -p old-k8s-version-584140 --alsologtostderr -v=1
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 status --format={{.APIServer}} -p old-k8s-version-584140 -n old-k8s-version-584140
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 status --format={{.Kubelet}} -p old-k8s-version-584140 -n old-k8s-version-584140
--- PASS: TestStartStop/group/old-k8s-version/serial/Pause (2.95s)

                                                
                                    
x
+
TestStartStop/group/default-k8s-diff-port/serial/FirstStart (61.19s)

                                                
                                                
=== RUN   TestStartStop/group/default-k8s-diff-port/serial/FirstStart
start_stop_delete_test.go:186: (dbg) Run:  out/minikube-linux-arm64 start -p default-k8s-diff-port-019273 --memory=2200 --alsologtostderr --wait=true --apiserver-port=8444 --driver=docker  --container-runtime=crio --kubernetes-version=v1.30.3
E0722 11:33:13.808086    7564 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19313-2237/.minikube/profiles/addons-578168/client.crt: no such file or directory
E0722 11:33:30.762042    7564 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19313-2237/.minikube/profiles/addons-578168/client.crt: no such file or directory
start_stop_delete_test.go:186: (dbg) Done: out/minikube-linux-arm64 start -p default-k8s-diff-port-019273 --memory=2200 --alsologtostderr --wait=true --apiserver-port=8444 --driver=docker  --container-runtime=crio --kubernetes-version=v1.30.3: (1m1.191223745s)
--- PASS: TestStartStop/group/default-k8s-diff-port/serial/FirstStart (61.19s)

                                                
                                    
x
+
TestStartStop/group/default-k8s-diff-port/serial/DeployApp (9.36s)

                                                
                                                
=== RUN   TestStartStop/group/default-k8s-diff-port/serial/DeployApp
start_stop_delete_test.go:196: (dbg) Run:  kubectl --context default-k8s-diff-port-019273 create -f testdata/busybox.yaml
start_stop_delete_test.go:196: (dbg) TestStartStop/group/default-k8s-diff-port/serial/DeployApp: waiting 8m0s for pods matching "integration-test=busybox" in namespace "default" ...
helpers_test.go:344: "busybox" [d6e50a81-76e2-4a5c-bda4-1c4994398873] Pending / Ready:ContainersNotReady (containers with unready status: [busybox]) / ContainersReady:ContainersNotReady (containers with unready status: [busybox])
helpers_test.go:344: "busybox" [d6e50a81-76e2-4a5c-bda4-1c4994398873] Running
start_stop_delete_test.go:196: (dbg) TestStartStop/group/default-k8s-diff-port/serial/DeployApp: integration-test=busybox healthy within 9.003478736s
start_stop_delete_test.go:196: (dbg) Run:  kubectl --context default-k8s-diff-port-019273 exec busybox -- /bin/sh -c "ulimit -n"
--- PASS: TestStartStop/group/default-k8s-diff-port/serial/DeployApp (9.36s)

                                                
                                    
x
+
TestStartStop/group/default-k8s-diff-port/serial/EnableAddonWhileActive (1.04s)

                                                
                                                
=== RUN   TestStartStop/group/default-k8s-diff-port/serial/EnableAddonWhileActive
start_stop_delete_test.go:205: (dbg) Run:  out/minikube-linux-arm64 addons enable metrics-server -p default-k8s-diff-port-019273 --images=MetricsServer=registry.k8s.io/echoserver:1.4 --registries=MetricsServer=fake.domain
start_stop_delete_test.go:215: (dbg) Run:  kubectl --context default-k8s-diff-port-019273 describe deploy/metrics-server -n kube-system
--- PASS: TestStartStop/group/default-k8s-diff-port/serial/EnableAddonWhileActive (1.04s)

                                                
                                    
x
+
TestStartStop/group/default-k8s-diff-port/serial/Stop (12.18s)

                                                
                                                
=== RUN   TestStartStop/group/default-k8s-diff-port/serial/Stop
start_stop_delete_test.go:228: (dbg) Run:  out/minikube-linux-arm64 stop -p default-k8s-diff-port-019273 --alsologtostderr -v=3
start_stop_delete_test.go:228: (dbg) Done: out/minikube-linux-arm64 stop -p default-k8s-diff-port-019273 --alsologtostderr -v=3: (12.17967475s)
--- PASS: TestStartStop/group/default-k8s-diff-port/serial/Stop (12.18s)

                                                
                                    
x
+
TestStartStop/group/default-k8s-diff-port/serial/EnableAddonAfterStop (0.18s)

                                                
                                                
=== RUN   TestStartStop/group/default-k8s-diff-port/serial/EnableAddonAfterStop
start_stop_delete_test.go:239: (dbg) Run:  out/minikube-linux-arm64 status --format={{.Host}} -p default-k8s-diff-port-019273 -n default-k8s-diff-port-019273
start_stop_delete_test.go:239: (dbg) Non-zero exit: out/minikube-linux-arm64 status --format={{.Host}} -p default-k8s-diff-port-019273 -n default-k8s-diff-port-019273: exit status 7 (70.380529ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
start_stop_delete_test.go:239: status error: exit status 7 (may be ok)
start_stop_delete_test.go:246: (dbg) Run:  out/minikube-linux-arm64 addons enable dashboard -p default-k8s-diff-port-019273 --images=MetricsScraper=registry.k8s.io/echoserver:1.4
--- PASS: TestStartStop/group/default-k8s-diff-port/serial/EnableAddonAfterStop (0.18s)

                                                
                                    
x
+
TestStartStop/group/default-k8s-diff-port/serial/SecondStart (301.79s)

                                                
                                                
=== RUN   TestStartStop/group/default-k8s-diff-port/serial/SecondStart
start_stop_delete_test.go:256: (dbg) Run:  out/minikube-linux-arm64 start -p default-k8s-diff-port-019273 --memory=2200 --alsologtostderr --wait=true --apiserver-port=8444 --driver=docker  --container-runtime=crio --kubernetes-version=v1.30.3
E0722 11:34:19.083838    7564 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19313-2237/.minikube/profiles/functional-430070/client.crt: no such file or directory
E0722 11:35:50.982226    7564 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19313-2237/.minikube/profiles/old-k8s-version-584140/client.crt: no such file or directory
E0722 11:35:50.987612    7564 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19313-2237/.minikube/profiles/old-k8s-version-584140/client.crt: no such file or directory
E0722 11:35:50.998172    7564 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19313-2237/.minikube/profiles/old-k8s-version-584140/client.crt: no such file or directory
E0722 11:35:51.018461    7564 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19313-2237/.minikube/profiles/old-k8s-version-584140/client.crt: no such file or directory
E0722 11:35:51.059211    7564 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19313-2237/.minikube/profiles/old-k8s-version-584140/client.crt: no such file or directory
E0722 11:35:51.139565    7564 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19313-2237/.minikube/profiles/old-k8s-version-584140/client.crt: no such file or directory
E0722 11:35:51.300284    7564 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19313-2237/.minikube/profiles/old-k8s-version-584140/client.crt: no such file or directory
E0722 11:35:51.621104    7564 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19313-2237/.minikube/profiles/old-k8s-version-584140/client.crt: no such file or directory
E0722 11:35:52.261379    7564 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19313-2237/.minikube/profiles/old-k8s-version-584140/client.crt: no such file or directory
E0722 11:35:53.541676    7564 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19313-2237/.minikube/profiles/old-k8s-version-584140/client.crt: no such file or directory
E0722 11:35:56.102322    7564 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19313-2237/.minikube/profiles/old-k8s-version-584140/client.crt: no such file or directory
E0722 11:36:01.222976    7564 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19313-2237/.minikube/profiles/old-k8s-version-584140/client.crt: no such file or directory
E0722 11:36:11.463617    7564 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19313-2237/.minikube/profiles/old-k8s-version-584140/client.crt: no such file or directory
E0722 11:36:31.944214    7564 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19313-2237/.minikube/profiles/old-k8s-version-584140/client.crt: no such file or directory
start_stop_delete_test.go:256: (dbg) Done: out/minikube-linux-arm64 start -p default-k8s-diff-port-019273 --memory=2200 --alsologtostderr --wait=true --apiserver-port=8444 --driver=docker  --container-runtime=crio --kubernetes-version=v1.30.3: (5m1.346261894s)
start_stop_delete_test.go:262: (dbg) Run:  out/minikube-linux-arm64 status --format={{.Host}} -p default-k8s-diff-port-019273 -n default-k8s-diff-port-019273
--- PASS: TestStartStop/group/default-k8s-diff-port/serial/SecondStart (301.79s)

                                                
                                    
x
+
TestStartStop/group/no-preload/serial/UserAppExistsAfterStop (6.01s)

                                                
                                                
=== RUN   TestStartStop/group/no-preload/serial/UserAppExistsAfterStop
start_stop_delete_test.go:274: (dbg) TestStartStop/group/no-preload/serial/UserAppExistsAfterStop: waiting 9m0s for pods matching "k8s-app=kubernetes-dashboard" in namespace "kubernetes-dashboard" ...
helpers_test.go:344: "kubernetes-dashboard-5cc9f66cf4-vlxdk" [5db8d154-b7b8-4746-9a89-f0ec6ada9254] Running
start_stop_delete_test.go:274: (dbg) TestStartStop/group/no-preload/serial/UserAppExistsAfterStop: k8s-app=kubernetes-dashboard healthy within 6.004208727s
--- PASS: TestStartStop/group/no-preload/serial/UserAppExistsAfterStop (6.01s)

                                                
                                    
x
+
TestStartStop/group/no-preload/serial/AddonExistsAfterStop (5.11s)

                                                
                                                
=== RUN   TestStartStop/group/no-preload/serial/AddonExistsAfterStop
start_stop_delete_test.go:287: (dbg) TestStartStop/group/no-preload/serial/AddonExistsAfterStop: waiting 9m0s for pods matching "k8s-app=kubernetes-dashboard" in namespace "kubernetes-dashboard" ...
helpers_test.go:344: "kubernetes-dashboard-5cc9f66cf4-vlxdk" [5db8d154-b7b8-4746-9a89-f0ec6ada9254] Running
start_stop_delete_test.go:287: (dbg) TestStartStop/group/no-preload/serial/AddonExistsAfterStop: k8s-app=kubernetes-dashboard healthy within 5.004532144s
start_stop_delete_test.go:291: (dbg) Run:  kubectl --context no-preload-076896 describe deploy/dashboard-metrics-scraper -n kubernetes-dashboard
--- PASS: TestStartStop/group/no-preload/serial/AddonExistsAfterStop (5.11s)

                                                
                                    
x
+
TestStartStop/group/no-preload/serial/VerifyKubernetesImages (0.25s)

                                                
                                                
=== RUN   TestStartStop/group/no-preload/serial/VerifyKubernetesImages
start_stop_delete_test.go:304: (dbg) Run:  out/minikube-linux-arm64 -p no-preload-076896 image list --format=json
start_stop_delete_test.go:304: Found non-minikube image: kindest/kindnetd:v20240719-e7903573
start_stop_delete_test.go:304: Found non-minikube image: gcr.io/k8s-minikube/busybox:1.28.4-glibc
--- PASS: TestStartStop/group/no-preload/serial/VerifyKubernetesImages (0.25s)

                                                
                                    
x
+
TestStartStop/group/no-preload/serial/Pause (3.06s)

                                                
                                                
=== RUN   TestStartStop/group/no-preload/serial/Pause
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 pause -p no-preload-076896 --alsologtostderr -v=1
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 status --format={{.APIServer}} -p no-preload-076896 -n no-preload-076896
start_stop_delete_test.go:311: (dbg) Non-zero exit: out/minikube-linux-arm64 status --format={{.APIServer}} -p no-preload-076896 -n no-preload-076896: exit status 2 (299.199136ms)

                                                
                                                
-- stdout --
	Paused

                                                
                                                
-- /stdout --
start_stop_delete_test.go:311: status error: exit status 2 (may be ok)
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 status --format={{.Kubelet}} -p no-preload-076896 -n no-preload-076896
start_stop_delete_test.go:311: (dbg) Non-zero exit: out/minikube-linux-arm64 status --format={{.Kubelet}} -p no-preload-076896 -n no-preload-076896: exit status 2 (312.001793ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
start_stop_delete_test.go:311: status error: exit status 2 (may be ok)
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 unpause -p no-preload-076896 --alsologtostderr -v=1
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 status --format={{.APIServer}} -p no-preload-076896 -n no-preload-076896
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 status --format={{.Kubelet}} -p no-preload-076896 -n no-preload-076896
--- PASS: TestStartStop/group/no-preload/serial/Pause (3.06s)

                                                
                                    
x
+
TestStartStop/group/newest-cni/serial/FirstStart (35.28s)

                                                
                                                
=== RUN   TestStartStop/group/newest-cni/serial/FirstStart
start_stop_delete_test.go:186: (dbg) Run:  out/minikube-linux-arm64 start -p newest-cni-576362 --memory=2200 --alsologtostderr --wait=apiserver,system_pods,default_sa --feature-gates ServerSideApply=true --network-plugin=cni --extra-config=kubeadm.pod-network-cidr=10.42.0.0/16 --driver=docker  --container-runtime=crio --kubernetes-version=v1.31.0-beta.0
E0722 11:37:12.905402    7564 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19313-2237/.minikube/profiles/old-k8s-version-584140/client.crt: no such file or directory
start_stop_delete_test.go:186: (dbg) Done: out/minikube-linux-arm64 start -p newest-cni-576362 --memory=2200 --alsologtostderr --wait=apiserver,system_pods,default_sa --feature-gates ServerSideApply=true --network-plugin=cni --extra-config=kubeadm.pod-network-cidr=10.42.0.0/16 --driver=docker  --container-runtime=crio --kubernetes-version=v1.31.0-beta.0: (35.282816143s)
--- PASS: TestStartStop/group/newest-cni/serial/FirstStart (35.28s)

                                                
                                    
x
+
TestStartStop/group/newest-cni/serial/DeployApp (0s)

                                                
                                                
=== RUN   TestStartStop/group/newest-cni/serial/DeployApp
--- PASS: TestStartStop/group/newest-cni/serial/DeployApp (0.00s)

                                                
                                    
x
+
TestStartStop/group/newest-cni/serial/EnableAddonWhileActive (1.11s)

                                                
                                                
=== RUN   TestStartStop/group/newest-cni/serial/EnableAddonWhileActive
start_stop_delete_test.go:205: (dbg) Run:  out/minikube-linux-arm64 addons enable metrics-server -p newest-cni-576362 --images=MetricsServer=registry.k8s.io/echoserver:1.4 --registries=MetricsServer=fake.domain
start_stop_delete_test.go:205: (dbg) Done: out/minikube-linux-arm64 addons enable metrics-server -p newest-cni-576362 --images=MetricsServer=registry.k8s.io/echoserver:1.4 --registries=MetricsServer=fake.domain: (1.11108996s)
start_stop_delete_test.go:211: WARNING: cni mode requires additional setup before pods can schedule :(
--- PASS: TestStartStop/group/newest-cni/serial/EnableAddonWhileActive (1.11s)

                                                
                                    
x
+
TestStartStop/group/newest-cni/serial/Stop (1.26s)

                                                
                                                
=== RUN   TestStartStop/group/newest-cni/serial/Stop
start_stop_delete_test.go:228: (dbg) Run:  out/minikube-linux-arm64 stop -p newest-cni-576362 --alsologtostderr -v=3
start_stop_delete_test.go:228: (dbg) Done: out/minikube-linux-arm64 stop -p newest-cni-576362 --alsologtostderr -v=3: (1.260846912s)
--- PASS: TestStartStop/group/newest-cni/serial/Stop (1.26s)

                                                
                                    
x
+
TestStartStop/group/newest-cni/serial/EnableAddonAfterStop (0.17s)

                                                
                                                
=== RUN   TestStartStop/group/newest-cni/serial/EnableAddonAfterStop
start_stop_delete_test.go:239: (dbg) Run:  out/minikube-linux-arm64 status --format={{.Host}} -p newest-cni-576362 -n newest-cni-576362
start_stop_delete_test.go:239: (dbg) Non-zero exit: out/minikube-linux-arm64 status --format={{.Host}} -p newest-cni-576362 -n newest-cni-576362: exit status 7 (63.059137ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
start_stop_delete_test.go:239: status error: exit status 7 (may be ok)
start_stop_delete_test.go:246: (dbg) Run:  out/minikube-linux-arm64 addons enable dashboard -p newest-cni-576362 --images=MetricsScraper=registry.k8s.io/echoserver:1.4
--- PASS: TestStartStop/group/newest-cni/serial/EnableAddonAfterStop (0.17s)

                                                
                                    
x
+
TestStartStop/group/newest-cni/serial/SecondStart (15.95s)

                                                
                                                
=== RUN   TestStartStop/group/newest-cni/serial/SecondStart
start_stop_delete_test.go:256: (dbg) Run:  out/minikube-linux-arm64 start -p newest-cni-576362 --memory=2200 --alsologtostderr --wait=apiserver,system_pods,default_sa --feature-gates ServerSideApply=true --network-plugin=cni --extra-config=kubeadm.pod-network-cidr=10.42.0.0/16 --driver=docker  --container-runtime=crio --kubernetes-version=v1.31.0-beta.0
start_stop_delete_test.go:256: (dbg) Done: out/minikube-linux-arm64 start -p newest-cni-576362 --memory=2200 --alsologtostderr --wait=apiserver,system_pods,default_sa --feature-gates ServerSideApply=true --network-plugin=cni --extra-config=kubeadm.pod-network-cidr=10.42.0.0/16 --driver=docker  --container-runtime=crio --kubernetes-version=v1.31.0-beta.0: (15.450948724s)
start_stop_delete_test.go:262: (dbg) Run:  out/minikube-linux-arm64 status --format={{.Host}} -p newest-cni-576362 -n newest-cni-576362
--- PASS: TestStartStop/group/newest-cni/serial/SecondStart (15.95s)

                                                
                                    
x
+
TestStartStop/group/newest-cni/serial/UserAppExistsAfterStop (0s)

                                                
                                                
=== RUN   TestStartStop/group/newest-cni/serial/UserAppExistsAfterStop
start_stop_delete_test.go:273: WARNING: cni mode requires additional setup before pods can schedule :(
--- PASS: TestStartStop/group/newest-cni/serial/UserAppExistsAfterStop (0.00s)

                                                
                                    
x
+
TestStartStop/group/newest-cni/serial/AddonExistsAfterStop (0s)

                                                
                                                
=== RUN   TestStartStop/group/newest-cni/serial/AddonExistsAfterStop
start_stop_delete_test.go:284: WARNING: cni mode requires additional setup before pods can schedule :(
--- PASS: TestStartStop/group/newest-cni/serial/AddonExistsAfterStop (0.00s)

                                                
                                    
x
+
TestStartStop/group/newest-cni/serial/VerifyKubernetesImages (0.43s)

                                                
                                                
=== RUN   TestStartStop/group/newest-cni/serial/VerifyKubernetesImages
start_stop_delete_test.go:304: (dbg) Run:  out/minikube-linux-arm64 -p newest-cni-576362 image list --format=json
start_stop_delete_test.go:304: Found non-minikube image: kindest/kindnetd:v20240715-f6ad1f6e
--- PASS: TestStartStop/group/newest-cni/serial/VerifyKubernetesImages (0.43s)

                                                
                                    
x
+
TestStartStop/group/newest-cni/serial/Pause (3.41s)

                                                
                                                
=== RUN   TestStartStop/group/newest-cni/serial/Pause
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 pause -p newest-cni-576362 --alsologtostderr -v=1
start_stop_delete_test.go:311: (dbg) Done: out/minikube-linux-arm64 pause -p newest-cni-576362 --alsologtostderr -v=1: (1.110036721s)
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 status --format={{.APIServer}} -p newest-cni-576362 -n newest-cni-576362
start_stop_delete_test.go:311: (dbg) Non-zero exit: out/minikube-linux-arm64 status --format={{.APIServer}} -p newest-cni-576362 -n newest-cni-576362: exit status 2 (355.464529ms)

                                                
                                                
-- stdout --
	Paused

                                                
                                                
-- /stdout --
start_stop_delete_test.go:311: status error: exit status 2 (may be ok)
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 status --format={{.Kubelet}} -p newest-cni-576362 -n newest-cni-576362
start_stop_delete_test.go:311: (dbg) Non-zero exit: out/minikube-linux-arm64 status --format={{.Kubelet}} -p newest-cni-576362 -n newest-cni-576362: exit status 2 (325.009123ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
start_stop_delete_test.go:311: status error: exit status 2 (may be ok)
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 unpause -p newest-cni-576362 --alsologtostderr -v=1
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 status --format={{.APIServer}} -p newest-cni-576362 -n newest-cni-576362
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 status --format={{.Kubelet}} -p newest-cni-576362 -n newest-cni-576362
--- PASS: TestStartStop/group/newest-cni/serial/Pause (3.41s)

                                                
                                    
x
+
TestNetworkPlugins/group/auto/Start (60.04s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/auto/Start
net_test.go:112: (dbg) Run:  out/minikube-linux-arm64 start -p auto-507554 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --driver=docker  --container-runtime=crio
E0722 11:38:30.762141    7564 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19313-2237/.minikube/profiles/addons-578168/client.crt: no such file or directory
E0722 11:38:34.825873    7564 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19313-2237/.minikube/profiles/old-k8s-version-584140/client.crt: no such file or directory
net_test.go:112: (dbg) Done: out/minikube-linux-arm64 start -p auto-507554 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --driver=docker  --container-runtime=crio: (1m0.041190918s)
--- PASS: TestNetworkPlugins/group/auto/Start (60.04s)

                                                
                                    
x
+
TestNetworkPlugins/group/auto/KubeletFlags (0.29s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/auto/KubeletFlags
net_test.go:133: (dbg) Run:  out/minikube-linux-arm64 ssh -p auto-507554 "pgrep -a kubelet"
--- PASS: TestNetworkPlugins/group/auto/KubeletFlags (0.29s)

                                                
                                    
x
+
TestNetworkPlugins/group/auto/NetCatPod (10.28s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/auto/NetCatPod
net_test.go:149: (dbg) Run:  kubectl --context auto-507554 replace --force -f testdata/netcat-deployment.yaml
net_test.go:163: (dbg) TestNetworkPlugins/group/auto/NetCatPod: waiting 15m0s for pods matching "app=netcat" in namespace "default" ...
helpers_test.go:344: "netcat-6bc787d567-pk8w8" [5d6907f1-f38f-459c-bdef-1b70c81e2756] Pending / Ready:ContainersNotReady (containers with unready status: [dnsutils]) / ContainersReady:ContainersNotReady (containers with unready status: [dnsutils])
helpers_test.go:344: "netcat-6bc787d567-pk8w8" [5d6907f1-f38f-459c-bdef-1b70c81e2756] Running
E0722 11:39:02.131033    7564 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19313-2237/.minikube/profiles/functional-430070/client.crt: no such file or directory
net_test.go:163: (dbg) TestNetworkPlugins/group/auto/NetCatPod: app=netcat healthy within 10.004109139s
--- PASS: TestNetworkPlugins/group/auto/NetCatPod (10.28s)

                                                
                                    
x
+
TestNetworkPlugins/group/auto/DNS (0.18s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/auto/DNS
net_test.go:175: (dbg) Run:  kubectl --context auto-507554 exec deployment/netcat -- nslookup kubernetes.default
--- PASS: TestNetworkPlugins/group/auto/DNS (0.18s)

                                                
                                    
x
+
TestNetworkPlugins/group/auto/Localhost (0.16s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/auto/Localhost
net_test.go:194: (dbg) Run:  kubectl --context auto-507554 exec deployment/netcat -- /bin/sh -c "nc -w 5 -i 5 -z localhost 8080"
--- PASS: TestNetworkPlugins/group/auto/Localhost (0.16s)

                                                
                                    
x
+
TestNetworkPlugins/group/auto/HairPin (0.15s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/auto/HairPin
net_test.go:264: (dbg) Run:  kubectl --context auto-507554 exec deployment/netcat -- /bin/sh -c "nc -w 5 -i 5 -z netcat 8080"
--- PASS: TestNetworkPlugins/group/auto/HairPin (0.15s)

                                                
                                    
x
+
TestStartStop/group/default-k8s-diff-port/serial/UserAppExistsAfterStop (6.01s)

                                                
                                                
=== RUN   TestStartStop/group/default-k8s-diff-port/serial/UserAppExistsAfterStop
start_stop_delete_test.go:274: (dbg) TestStartStop/group/default-k8s-diff-port/serial/UserAppExistsAfterStop: waiting 9m0s for pods matching "k8s-app=kubernetes-dashboard" in namespace "kubernetes-dashboard" ...
helpers_test.go:344: "kubernetes-dashboard-779776cb65-2kkg4" [2b26214b-b340-4ab2-9b9a-de73cc9d9fed] Running
start_stop_delete_test.go:274: (dbg) TestStartStop/group/default-k8s-diff-port/serial/UserAppExistsAfterStop: k8s-app=kubernetes-dashboard healthy within 6.006019826s
--- PASS: TestStartStop/group/default-k8s-diff-port/serial/UserAppExistsAfterStop (6.01s)

                                                
                                    
x
+
TestStartStop/group/default-k8s-diff-port/serial/AddonExistsAfterStop (6.14s)

                                                
                                                
=== RUN   TestStartStop/group/default-k8s-diff-port/serial/AddonExistsAfterStop
start_stop_delete_test.go:287: (dbg) TestStartStop/group/default-k8s-diff-port/serial/AddonExistsAfterStop: waiting 9m0s for pods matching "k8s-app=kubernetes-dashboard" in namespace "kubernetes-dashboard" ...
helpers_test.go:344: "kubernetes-dashboard-779776cb65-2kkg4" [2b26214b-b340-4ab2-9b9a-de73cc9d9fed] Running
E0722 11:39:19.083408    7564 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19313-2237/.minikube/profiles/functional-430070/client.crt: no such file or directory
start_stop_delete_test.go:287: (dbg) TestStartStop/group/default-k8s-diff-port/serial/AddonExistsAfterStop: k8s-app=kubernetes-dashboard healthy within 6.004909796s
start_stop_delete_test.go:291: (dbg) Run:  kubectl --context default-k8s-diff-port-019273 describe deploy/dashboard-metrics-scraper -n kubernetes-dashboard
--- PASS: TestStartStop/group/default-k8s-diff-port/serial/AddonExistsAfterStop (6.14s)

                                                
                                    
x
+
TestStartStop/group/default-k8s-diff-port/serial/VerifyKubernetesImages (0.31s)

                                                
                                                
=== RUN   TestStartStop/group/default-k8s-diff-port/serial/VerifyKubernetesImages
start_stop_delete_test.go:304: (dbg) Run:  out/minikube-linux-arm64 -p default-k8s-diff-port-019273 image list --format=json
start_stop_delete_test.go:304: Found non-minikube image: gcr.io/k8s-minikube/busybox:1.28.4-glibc
start_stop_delete_test.go:304: Found non-minikube image: kindest/kindnetd:v20240715-585640e9
start_stop_delete_test.go:304: Found non-minikube image: kindest/kindnetd:v20240719-e7903573
--- PASS: TestStartStop/group/default-k8s-diff-port/serial/VerifyKubernetesImages (0.31s)

                                                
                                    
x
+
TestNetworkPlugins/group/kindnet/Start (70.04s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/kindnet/Start
net_test.go:112: (dbg) Run:  out/minikube-linux-arm64 start -p kindnet-507554 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --cni=kindnet --driver=docker  --container-runtime=crio
net_test.go:112: (dbg) Done: out/minikube-linux-arm64 start -p kindnet-507554 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --cni=kindnet --driver=docker  --container-runtime=crio: (1m10.043250938s)
--- PASS: TestNetworkPlugins/group/kindnet/Start (70.04s)

                                                
                                    
x
+
TestStartStop/group/default-k8s-diff-port/serial/Pause (3.86s)

                                                
                                                
=== RUN   TestStartStop/group/default-k8s-diff-port/serial/Pause
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 pause -p default-k8s-diff-port-019273 --alsologtostderr -v=1
start_stop_delete_test.go:311: (dbg) Done: out/minikube-linux-arm64 pause -p default-k8s-diff-port-019273 --alsologtostderr -v=1: (1.146357098s)
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 status --format={{.APIServer}} -p default-k8s-diff-port-019273 -n default-k8s-diff-port-019273
start_stop_delete_test.go:311: (dbg) Non-zero exit: out/minikube-linux-arm64 status --format={{.APIServer}} -p default-k8s-diff-port-019273 -n default-k8s-diff-port-019273: exit status 2 (385.398891ms)

                                                
                                                
-- stdout --
	Paused

                                                
                                                
-- /stdout --
start_stop_delete_test.go:311: status error: exit status 2 (may be ok)
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 status --format={{.Kubelet}} -p default-k8s-diff-port-019273 -n default-k8s-diff-port-019273
start_stop_delete_test.go:311: (dbg) Non-zero exit: out/minikube-linux-arm64 status --format={{.Kubelet}} -p default-k8s-diff-port-019273 -n default-k8s-diff-port-019273: exit status 2 (367.670999ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
start_stop_delete_test.go:311: status error: exit status 2 (may be ok)
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 unpause -p default-k8s-diff-port-019273 --alsologtostderr -v=1
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 status --format={{.APIServer}} -p default-k8s-diff-port-019273 -n default-k8s-diff-port-019273
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 status --format={{.Kubelet}} -p default-k8s-diff-port-019273 -n default-k8s-diff-port-019273
--- PASS: TestStartStop/group/default-k8s-diff-port/serial/Pause (3.86s)
E0722 11:45:10.295151    7564 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19313-2237/.minikube/profiles/default-k8s-diff-port-019273/client.crt: no such file or directory

                                                
                                    
x
+
TestNetworkPlugins/group/calico/Start (77.63s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/calico/Start
net_test.go:112: (dbg) Run:  out/minikube-linux-arm64 start -p calico-507554 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --cni=calico --driver=docker  --container-runtime=crio
net_test.go:112: (dbg) Done: out/minikube-linux-arm64 start -p calico-507554 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --cni=calico --driver=docker  --container-runtime=crio: (1m17.631796992s)
--- PASS: TestNetworkPlugins/group/calico/Start (77.63s)

                                                
                                    
x
+
TestNetworkPlugins/group/kindnet/ControllerPod (6.01s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/kindnet/ControllerPod
net_test.go:120: (dbg) TestNetworkPlugins/group/kindnet/ControllerPod: waiting 10m0s for pods matching "app=kindnet" in namespace "kube-system" ...
helpers_test.go:344: "kindnet-8nb8g" [d70c1930-f426-4131-9ede-d67df4f7ba72] Running
net_test.go:120: (dbg) TestNetworkPlugins/group/kindnet/ControllerPod: app=kindnet healthy within 6.005264549s
--- PASS: TestNetworkPlugins/group/kindnet/ControllerPod (6.01s)

                                                
                                    
x
+
TestNetworkPlugins/group/kindnet/KubeletFlags (0.31s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/kindnet/KubeletFlags
net_test.go:133: (dbg) Run:  out/minikube-linux-arm64 ssh -p kindnet-507554 "pgrep -a kubelet"
--- PASS: TestNetworkPlugins/group/kindnet/KubeletFlags (0.31s)

                                                
                                    
x
+
TestNetworkPlugins/group/kindnet/NetCatPod (11.29s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/kindnet/NetCatPod
net_test.go:149: (dbg) Run:  kubectl --context kindnet-507554 replace --force -f testdata/netcat-deployment.yaml
net_test.go:163: (dbg) TestNetworkPlugins/group/kindnet/NetCatPod: waiting 15m0s for pods matching "app=netcat" in namespace "default" ...
helpers_test.go:344: "netcat-6bc787d567-blf9k" [ea0b58ee-054b-414c-a73a-9fac2272fc7f] Pending / Ready:ContainersNotReady (containers with unready status: [dnsutils]) / ContainersReady:ContainersNotReady (containers with unready status: [dnsutils])
helpers_test.go:344: "netcat-6bc787d567-blf9k" [ea0b58ee-054b-414c-a73a-9fac2272fc7f] Running
E0722 11:40:50.981982    7564 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19313-2237/.minikube/profiles/old-k8s-version-584140/client.crt: no such file or directory
net_test.go:163: (dbg) TestNetworkPlugins/group/kindnet/NetCatPod: app=netcat healthy within 11.003912064s
--- PASS: TestNetworkPlugins/group/kindnet/NetCatPod (11.29s)

                                                
                                    
x
+
TestNetworkPlugins/group/calico/ControllerPod (6.01s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/calico/ControllerPod
net_test.go:120: (dbg) TestNetworkPlugins/group/calico/ControllerPod: waiting 10m0s for pods matching "k8s-app=calico-node" in namespace "kube-system" ...
helpers_test.go:344: "calico-node-mql7d" [d6380247-d38e-4a36-a5ec-fb67f84aecae] Running
net_test.go:120: (dbg) TestNetworkPlugins/group/calico/ControllerPod: k8s-app=calico-node healthy within 6.005029021s
--- PASS: TestNetworkPlugins/group/calico/ControllerPod (6.01s)

                                                
                                    
x
+
TestNetworkPlugins/group/kindnet/DNS (0.22s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/kindnet/DNS
net_test.go:175: (dbg) Run:  kubectl --context kindnet-507554 exec deployment/netcat -- nslookup kubernetes.default
--- PASS: TestNetworkPlugins/group/kindnet/DNS (0.22s)

                                                
                                    
x
+
TestNetworkPlugins/group/kindnet/Localhost (0.15s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/kindnet/Localhost
net_test.go:194: (dbg) Run:  kubectl --context kindnet-507554 exec deployment/netcat -- /bin/sh -c "nc -w 5 -i 5 -z localhost 8080"
--- PASS: TestNetworkPlugins/group/kindnet/Localhost (0.15s)

                                                
                                    
x
+
TestNetworkPlugins/group/kindnet/HairPin (0.16s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/kindnet/HairPin
net_test.go:264: (dbg) Run:  kubectl --context kindnet-507554 exec deployment/netcat -- /bin/sh -c "nc -w 5 -i 5 -z netcat 8080"
--- PASS: TestNetworkPlugins/group/kindnet/HairPin (0.16s)

                                                
                                    
x
+
TestNetworkPlugins/group/calico/KubeletFlags (0.29s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/calico/KubeletFlags
net_test.go:133: (dbg) Run:  out/minikube-linux-arm64 ssh -p calico-507554 "pgrep -a kubelet"
--- PASS: TestNetworkPlugins/group/calico/KubeletFlags (0.29s)

                                                
                                    
x
+
TestNetworkPlugins/group/calico/NetCatPod (12.26s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/calico/NetCatPod
net_test.go:149: (dbg) Run:  kubectl --context calico-507554 replace --force -f testdata/netcat-deployment.yaml
net_test.go:163: (dbg) TestNetworkPlugins/group/calico/NetCatPod: waiting 15m0s for pods matching "app=netcat" in namespace "default" ...
helpers_test.go:344: "netcat-6bc787d567-9k596" [41ab524d-0b28-424b-a71e-cd931d6e7adc] Pending / Ready:ContainersNotReady (containers with unready status: [dnsutils]) / ContainersReady:ContainersNotReady (containers with unready status: [dnsutils])
helpers_test.go:344: "netcat-6bc787d567-9k596" [41ab524d-0b28-424b-a71e-cd931d6e7adc] Running
net_test.go:163: (dbg) TestNetworkPlugins/group/calico/NetCatPod: app=netcat healthy within 12.004948609s
--- PASS: TestNetworkPlugins/group/calico/NetCatPod (12.26s)

                                                
                                    
x
+
TestNetworkPlugins/group/calico/DNS (0.34s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/calico/DNS
net_test.go:175: (dbg) Run:  kubectl --context calico-507554 exec deployment/netcat -- nslookup kubernetes.default
--- PASS: TestNetworkPlugins/group/calico/DNS (0.34s)

                                                
                                    
x
+
TestNetworkPlugins/group/calico/Localhost (0.2s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/calico/Localhost
net_test.go:194: (dbg) Run:  kubectl --context calico-507554 exec deployment/netcat -- /bin/sh -c "nc -w 5 -i 5 -z localhost 8080"
--- PASS: TestNetworkPlugins/group/calico/Localhost (0.20s)

                                                
                                    
x
+
TestNetworkPlugins/group/calico/HairPin (0.2s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/calico/HairPin
net_test.go:264: (dbg) Run:  kubectl --context calico-507554 exec deployment/netcat -- /bin/sh -c "nc -w 5 -i 5 -z netcat 8080"
--- PASS: TestNetworkPlugins/group/calico/HairPin (0.20s)

                                                
                                    
x
+
TestNetworkPlugins/group/custom-flannel/Start (75.74s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/custom-flannel/Start
net_test.go:112: (dbg) Run:  out/minikube-linux-arm64 start -p custom-flannel-507554 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --cni=testdata/kube-flannel.yaml --driver=docker  --container-runtime=crio
E0722 11:41:18.666715    7564 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19313-2237/.minikube/profiles/old-k8s-version-584140/client.crt: no such file or directory
net_test.go:112: (dbg) Done: out/minikube-linux-arm64 start -p custom-flannel-507554 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --cni=testdata/kube-flannel.yaml --driver=docker  --container-runtime=crio: (1m15.743448257s)
--- PASS: TestNetworkPlugins/group/custom-flannel/Start (75.74s)

                                                
                                    
x
+
TestNetworkPlugins/group/enable-default-cni/Start (90.45s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/enable-default-cni/Start
net_test.go:112: (dbg) Run:  out/minikube-linux-arm64 start -p enable-default-cni-507554 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --enable-default-cni=true --driver=docker  --container-runtime=crio
E0722 11:41:38.539712    7564 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19313-2237/.minikube/profiles/no-preload-076896/client.crt: no such file or directory
E0722 11:41:38.544990    7564 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19313-2237/.minikube/profiles/no-preload-076896/client.crt: no such file or directory
E0722 11:41:38.555289    7564 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19313-2237/.minikube/profiles/no-preload-076896/client.crt: no such file or directory
E0722 11:41:38.575522    7564 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19313-2237/.minikube/profiles/no-preload-076896/client.crt: no such file or directory
E0722 11:41:38.615753    7564 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19313-2237/.minikube/profiles/no-preload-076896/client.crt: no such file or directory
E0722 11:41:38.695982    7564 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19313-2237/.minikube/profiles/no-preload-076896/client.crt: no such file or directory
E0722 11:41:38.856289    7564 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19313-2237/.minikube/profiles/no-preload-076896/client.crt: no such file or directory
E0722 11:41:39.177088    7564 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19313-2237/.minikube/profiles/no-preload-076896/client.crt: no such file or directory
E0722 11:41:39.818059    7564 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19313-2237/.minikube/profiles/no-preload-076896/client.crt: no such file or directory
E0722 11:41:41.098554    7564 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19313-2237/.minikube/profiles/no-preload-076896/client.crt: no such file or directory
E0722 11:41:43.660221    7564 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19313-2237/.minikube/profiles/no-preload-076896/client.crt: no such file or directory
E0722 11:41:48.780709    7564 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19313-2237/.minikube/profiles/no-preload-076896/client.crt: no such file or directory
E0722 11:41:59.021727    7564 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19313-2237/.minikube/profiles/no-preload-076896/client.crt: no such file or directory
E0722 11:42:19.502091    7564 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19313-2237/.minikube/profiles/no-preload-076896/client.crt: no such file or directory
net_test.go:112: (dbg) Done: out/minikube-linux-arm64 start -p enable-default-cni-507554 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --enable-default-cni=true --driver=docker  --container-runtime=crio: (1m30.453143817s)
--- PASS: TestNetworkPlugins/group/enable-default-cni/Start (90.45s)

                                                
                                    
x
+
TestNetworkPlugins/group/custom-flannel/KubeletFlags (0.28s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/custom-flannel/KubeletFlags
net_test.go:133: (dbg) Run:  out/minikube-linux-arm64 ssh -p custom-flannel-507554 "pgrep -a kubelet"
--- PASS: TestNetworkPlugins/group/custom-flannel/KubeletFlags (0.28s)

                                                
                                    
x
+
TestNetworkPlugins/group/custom-flannel/NetCatPod (12.29s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/custom-flannel/NetCatPod
net_test.go:149: (dbg) Run:  kubectl --context custom-flannel-507554 replace --force -f testdata/netcat-deployment.yaml
net_test.go:163: (dbg) TestNetworkPlugins/group/custom-flannel/NetCatPod: waiting 15m0s for pods matching "app=netcat" in namespace "default" ...
helpers_test.go:344: "netcat-6bc787d567-pfvbp" [6ea56a37-0d69-4ba5-92aa-e3d7e7237a45] Pending / Ready:ContainersNotReady (containers with unready status: [dnsutils]) / ContainersReady:ContainersNotReady (containers with unready status: [dnsutils])
helpers_test.go:344: "netcat-6bc787d567-pfvbp" [6ea56a37-0d69-4ba5-92aa-e3d7e7237a45] Running
net_test.go:163: (dbg) TestNetworkPlugins/group/custom-flannel/NetCatPod: app=netcat healthy within 12.003957885s
--- PASS: TestNetworkPlugins/group/custom-flannel/NetCatPod (12.29s)

                                                
                                    
x
+
TestNetworkPlugins/group/custom-flannel/DNS (0.17s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/custom-flannel/DNS
net_test.go:175: (dbg) Run:  kubectl --context custom-flannel-507554 exec deployment/netcat -- nslookup kubernetes.default
--- PASS: TestNetworkPlugins/group/custom-flannel/DNS (0.17s)

                                                
                                    
x
+
TestNetworkPlugins/group/custom-flannel/Localhost (0.15s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/custom-flannel/Localhost
net_test.go:194: (dbg) Run:  kubectl --context custom-flannel-507554 exec deployment/netcat -- /bin/sh -c "nc -w 5 -i 5 -z localhost 8080"
--- PASS: TestNetworkPlugins/group/custom-flannel/Localhost (0.15s)

                                                
                                    
x
+
TestNetworkPlugins/group/custom-flannel/HairPin (0.15s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/custom-flannel/HairPin
net_test.go:264: (dbg) Run:  kubectl --context custom-flannel-507554 exec deployment/netcat -- /bin/sh -c "nc -w 5 -i 5 -z netcat 8080"
--- PASS: TestNetworkPlugins/group/custom-flannel/HairPin (0.15s)

                                                
                                    
x
+
TestNetworkPlugins/group/flannel/Start (78.23s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/flannel/Start
net_test.go:112: (dbg) Run:  out/minikube-linux-arm64 start -p flannel-507554 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --cni=flannel --driver=docker  --container-runtime=crio
net_test.go:112: (dbg) Done: out/minikube-linux-arm64 start -p flannel-507554 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --cni=flannel --driver=docker  --container-runtime=crio: (1m18.225145675s)
--- PASS: TestNetworkPlugins/group/flannel/Start (78.23s)

                                                
                                    
x
+
TestNetworkPlugins/group/enable-default-cni/KubeletFlags (0.34s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/enable-default-cni/KubeletFlags
net_test.go:133: (dbg) Run:  out/minikube-linux-arm64 ssh -p enable-default-cni-507554 "pgrep -a kubelet"
--- PASS: TestNetworkPlugins/group/enable-default-cni/KubeletFlags (0.34s)

                                                
                                    
x
+
TestNetworkPlugins/group/enable-default-cni/NetCatPod (12.31s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/enable-default-cni/NetCatPod
net_test.go:149: (dbg) Run:  kubectl --context enable-default-cni-507554 replace --force -f testdata/netcat-deployment.yaml
net_test.go:163: (dbg) TestNetworkPlugins/group/enable-default-cni/NetCatPod: waiting 15m0s for pods matching "app=netcat" in namespace "default" ...
helpers_test.go:344: "netcat-6bc787d567-jtlf8" [7f60cb29-c92f-4360-b906-ee70743b92c6] Pending / Ready:ContainersNotReady (containers with unready status: [dnsutils]) / ContainersReady:ContainersNotReady (containers with unready status: [dnsutils])
helpers_test.go:344: "netcat-6bc787d567-jtlf8" [7f60cb29-c92f-4360-b906-ee70743b92c6] Running
net_test.go:163: (dbg) TestNetworkPlugins/group/enable-default-cni/NetCatPod: app=netcat healthy within 12.004241451s
--- PASS: TestNetworkPlugins/group/enable-default-cni/NetCatPod (12.31s)

                                                
                                    
x
+
TestNetworkPlugins/group/enable-default-cni/DNS (0.25s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/enable-default-cni/DNS
net_test.go:175: (dbg) Run:  kubectl --context enable-default-cni-507554 exec deployment/netcat -- nslookup kubernetes.default
--- PASS: TestNetworkPlugins/group/enable-default-cni/DNS (0.25s)

                                                
                                    
x
+
TestNetworkPlugins/group/enable-default-cni/Localhost (0.19s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/enable-default-cni/Localhost
net_test.go:194: (dbg) Run:  kubectl --context enable-default-cni-507554 exec deployment/netcat -- /bin/sh -c "nc -w 5 -i 5 -z localhost 8080"
--- PASS: TestNetworkPlugins/group/enable-default-cni/Localhost (0.19s)

                                                
                                    
x
+
TestNetworkPlugins/group/enable-default-cni/HairPin (0.21s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/enable-default-cni/HairPin
net_test.go:264: (dbg) Run:  kubectl --context enable-default-cni-507554 exec deployment/netcat -- /bin/sh -c "nc -w 5 -i 5 -z netcat 8080"
--- PASS: TestNetworkPlugins/group/enable-default-cni/HairPin (0.21s)

                                                
                                    
x
+
TestNetworkPlugins/group/bridge/Start (91.29s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/bridge/Start
net_test.go:112: (dbg) Run:  out/minikube-linux-arm64 start -p bridge-507554 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --cni=bridge --driver=docker  --container-runtime=crio
E0722 11:43:48.365013    7564 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19313-2237/.minikube/profiles/default-k8s-diff-port-019273/client.crt: no such file or directory
E0722 11:43:48.370262    7564 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19313-2237/.minikube/profiles/default-k8s-diff-port-019273/client.crt: no such file or directory
E0722 11:43:48.380829    7564 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19313-2237/.minikube/profiles/default-k8s-diff-port-019273/client.crt: no such file or directory
E0722 11:43:48.401042    7564 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19313-2237/.minikube/profiles/default-k8s-diff-port-019273/client.crt: no such file or directory
E0722 11:43:48.441284    7564 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19313-2237/.minikube/profiles/default-k8s-diff-port-019273/client.crt: no such file or directory
E0722 11:43:48.521453    7564 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19313-2237/.minikube/profiles/default-k8s-diff-port-019273/client.crt: no such file or directory
E0722 11:43:48.681965    7564 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19313-2237/.minikube/profiles/default-k8s-diff-port-019273/client.crt: no such file or directory
E0722 11:43:49.011727    7564 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19313-2237/.minikube/profiles/default-k8s-diff-port-019273/client.crt: no such file or directory
E0722 11:43:49.652044    7564 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19313-2237/.minikube/profiles/default-k8s-diff-port-019273/client.crt: no such file or directory
E0722 11:43:50.932776    7564 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19313-2237/.minikube/profiles/default-k8s-diff-port-019273/client.crt: no such file or directory
E0722 11:43:53.492992    7564 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19313-2237/.minikube/profiles/default-k8s-diff-port-019273/client.crt: no such file or directory
E0722 11:43:54.113884    7564 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19313-2237/.minikube/profiles/auto-507554/client.crt: no such file or directory
E0722 11:43:54.119141    7564 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19313-2237/.minikube/profiles/auto-507554/client.crt: no such file or directory
E0722 11:43:54.129399    7564 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19313-2237/.minikube/profiles/auto-507554/client.crt: no such file or directory
E0722 11:43:54.149643    7564 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19313-2237/.minikube/profiles/auto-507554/client.crt: no such file or directory
E0722 11:43:54.189902    7564 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19313-2237/.minikube/profiles/auto-507554/client.crt: no such file or directory
E0722 11:43:54.270597    7564 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19313-2237/.minikube/profiles/auto-507554/client.crt: no such file or directory
E0722 11:43:54.430909    7564 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19313-2237/.minikube/profiles/auto-507554/client.crt: no such file or directory
E0722 11:43:54.751036    7564 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19313-2237/.minikube/profiles/auto-507554/client.crt: no such file or directory
E0722 11:43:55.391252    7564 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19313-2237/.minikube/profiles/auto-507554/client.crt: no such file or directory
E0722 11:43:56.672305    7564 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19313-2237/.minikube/profiles/auto-507554/client.crt: no such file or directory
E0722 11:43:58.613422    7564 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19313-2237/.minikube/profiles/default-k8s-diff-port-019273/client.crt: no such file or directory
E0722 11:43:59.233185    7564 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19313-2237/.minikube/profiles/auto-507554/client.crt: no such file or directory
E0722 11:44:04.354039    7564 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19313-2237/.minikube/profiles/auto-507554/client.crt: no such file or directory
E0722 11:44:08.854058    7564 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19313-2237/.minikube/profiles/default-k8s-diff-port-019273/client.crt: no such file or directory
E0722 11:44:14.594690    7564 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19313-2237/.minikube/profiles/auto-507554/client.crt: no such file or directory
E0722 11:44:19.083168    7564 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19313-2237/.minikube/profiles/functional-430070/client.crt: no such file or directory
E0722 11:44:22.383926    7564 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19313-2237/.minikube/profiles/no-preload-076896/client.crt: no such file or directory
net_test.go:112: (dbg) Done: out/minikube-linux-arm64 start -p bridge-507554 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --cni=bridge --driver=docker  --container-runtime=crio: (1m31.293576239s)
--- PASS: TestNetworkPlugins/group/bridge/Start (91.29s)

                                                
                                    
x
+
TestNetworkPlugins/group/flannel/ControllerPod (6.01s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/flannel/ControllerPod
net_test.go:120: (dbg) TestNetworkPlugins/group/flannel/ControllerPod: waiting 10m0s for pods matching "app=flannel" in namespace "kube-flannel" ...
helpers_test.go:344: "kube-flannel-ds-xck9h" [9d9e1033-3763-4596-84c2-4c5043a95675] Running
E0722 11:44:29.334351    7564 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19313-2237/.minikube/profiles/default-k8s-diff-port-019273/client.crt: no such file or directory
net_test.go:120: (dbg) TestNetworkPlugins/group/flannel/ControllerPod: app=flannel healthy within 6.004150238s
--- PASS: TestNetworkPlugins/group/flannel/ControllerPod (6.01s)

                                                
                                    
x
+
TestNetworkPlugins/group/flannel/KubeletFlags (0.28s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/flannel/KubeletFlags
net_test.go:133: (dbg) Run:  out/minikube-linux-arm64 ssh -p flannel-507554 "pgrep -a kubelet"
--- PASS: TestNetworkPlugins/group/flannel/KubeletFlags (0.28s)

                                                
                                    
x
+
TestNetworkPlugins/group/flannel/NetCatPod (12.35s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/flannel/NetCatPod
net_test.go:149: (dbg) Run:  kubectl --context flannel-507554 replace --force -f testdata/netcat-deployment.yaml
net_test.go:163: (dbg) TestNetworkPlugins/group/flannel/NetCatPod: waiting 15m0s for pods matching "app=netcat" in namespace "default" ...
helpers_test.go:344: "netcat-6bc787d567-bvsk8" [bdf407d0-bd5c-460f-ad10-e83210acc6a8] Pending / Ready:ContainersNotReady (containers with unready status: [dnsutils]) / ContainersReady:ContainersNotReady (containers with unready status: [dnsutils])
E0722 11:44:35.075410    7564 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19313-2237/.minikube/profiles/auto-507554/client.crt: no such file or directory
helpers_test.go:344: "netcat-6bc787d567-bvsk8" [bdf407d0-bd5c-460f-ad10-e83210acc6a8] Running
net_test.go:163: (dbg) TestNetworkPlugins/group/flannel/NetCatPod: app=netcat healthy within 12.003265957s
--- PASS: TestNetworkPlugins/group/flannel/NetCatPod (12.35s)

                                                
                                    
x
+
TestNetworkPlugins/group/flannel/DNS (0.18s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/flannel/DNS
net_test.go:175: (dbg) Run:  kubectl --context flannel-507554 exec deployment/netcat -- nslookup kubernetes.default
--- PASS: TestNetworkPlugins/group/flannel/DNS (0.18s)

                                                
                                    
x
+
TestNetworkPlugins/group/flannel/Localhost (0.16s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/flannel/Localhost
net_test.go:194: (dbg) Run:  kubectl --context flannel-507554 exec deployment/netcat -- /bin/sh -c "nc -w 5 -i 5 -z localhost 8080"
--- PASS: TestNetworkPlugins/group/flannel/Localhost (0.16s)

                                                
                                    
x
+
TestNetworkPlugins/group/flannel/HairPin (0.16s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/flannel/HairPin
net_test.go:264: (dbg) Run:  kubectl --context flannel-507554 exec deployment/netcat -- /bin/sh -c "nc -w 5 -i 5 -z netcat 8080"
--- PASS: TestNetworkPlugins/group/flannel/HairPin (0.16s)

                                                
                                    
x
+
TestNetworkPlugins/group/bridge/KubeletFlags (0.28s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/bridge/KubeletFlags
net_test.go:133: (dbg) Run:  out/minikube-linux-arm64 ssh -p bridge-507554 "pgrep -a kubelet"
E0722 11:45:16.036461    7564 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19313-2237/.minikube/profiles/auto-507554/client.crt: no such file or directory
--- PASS: TestNetworkPlugins/group/bridge/KubeletFlags (0.28s)

                                                
                                    
x
+
TestNetworkPlugins/group/bridge/NetCatPod (12.26s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/bridge/NetCatPod
net_test.go:149: (dbg) Run:  kubectl --context bridge-507554 replace --force -f testdata/netcat-deployment.yaml
net_test.go:163: (dbg) TestNetworkPlugins/group/bridge/NetCatPod: waiting 15m0s for pods matching "app=netcat" in namespace "default" ...
helpers_test.go:344: "netcat-6bc787d567-54hsn" [256313b1-95a6-47d9-be0f-b4d6acee7542] Pending / Ready:ContainersNotReady (containers with unready status: [dnsutils]) / ContainersReady:ContainersNotReady (containers with unready status: [dnsutils])
helpers_test.go:344: "netcat-6bc787d567-54hsn" [256313b1-95a6-47d9-be0f-b4d6acee7542] Running
net_test.go:163: (dbg) TestNetworkPlugins/group/bridge/NetCatPod: app=netcat healthy within 12.003741478s
--- PASS: TestNetworkPlugins/group/bridge/NetCatPod (12.26s)

                                                
                                    
x
+
TestNetworkPlugins/group/bridge/DNS (0.17s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/bridge/DNS
net_test.go:175: (dbg) Run:  kubectl --context bridge-507554 exec deployment/netcat -- nslookup kubernetes.default
--- PASS: TestNetworkPlugins/group/bridge/DNS (0.17s)

                                                
                                    
x
+
TestNetworkPlugins/group/bridge/Localhost (0.15s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/bridge/Localhost
net_test.go:194: (dbg) Run:  kubectl --context bridge-507554 exec deployment/netcat -- /bin/sh -c "nc -w 5 -i 5 -z localhost 8080"
--- PASS: TestNetworkPlugins/group/bridge/Localhost (0.15s)

                                                
                                    
x
+
TestNetworkPlugins/group/bridge/HairPin (0.15s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/bridge/HairPin
net_test.go:264: (dbg) Run:  kubectl --context bridge-507554 exec deployment/netcat -- /bin/sh -c "nc -w 5 -i 5 -z netcat 8080"
--- PASS: TestNetworkPlugins/group/bridge/HairPin (0.15s)

                                                
                                    

Test skip (33/336)

x
+
TestDownloadOnly/v1.20.0/cached-images (0s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.20.0/cached-images
aaa_download_only_test.go:129: Preload exists, images won't be cached
--- SKIP: TestDownloadOnly/v1.20.0/cached-images (0.00s)

                                                
                                    
x
+
TestDownloadOnly/v1.20.0/binaries (0s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.20.0/binaries
aaa_download_only_test.go:151: Preload exists, binaries are present within.
--- SKIP: TestDownloadOnly/v1.20.0/binaries (0.00s)

                                                
                                    
x
+
TestDownloadOnly/v1.20.0/kubectl (0s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.20.0/kubectl
aaa_download_only_test.go:167: Test for darwin and windows
--- SKIP: TestDownloadOnly/v1.20.0/kubectl (0.00s)

                                                
                                    
x
+
TestDownloadOnly/v1.30.3/cached-images (0s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.30.3/cached-images
aaa_download_only_test.go:129: Preload exists, images won't be cached
--- SKIP: TestDownloadOnly/v1.30.3/cached-images (0.00s)

                                                
                                    
x
+
TestDownloadOnly/v1.30.3/binaries (0s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.30.3/binaries
aaa_download_only_test.go:151: Preload exists, binaries are present within.
--- SKIP: TestDownloadOnly/v1.30.3/binaries (0.00s)

                                                
                                    
x
+
TestDownloadOnly/v1.30.3/kubectl (0s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.30.3/kubectl
aaa_download_only_test.go:167: Test for darwin and windows
--- SKIP: TestDownloadOnly/v1.30.3/kubectl (0.00s)

                                                
                                    
x
+
TestDownloadOnly/v1.31.0-beta.0/cached-images (0s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.31.0-beta.0/cached-images
aaa_download_only_test.go:129: Preload exists, images won't be cached
--- SKIP: TestDownloadOnly/v1.31.0-beta.0/cached-images (0.00s)

                                                
                                    
x
+
TestDownloadOnly/v1.31.0-beta.0/binaries (0s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.31.0-beta.0/binaries
aaa_download_only_test.go:151: Preload exists, binaries are present within.
--- SKIP: TestDownloadOnly/v1.31.0-beta.0/binaries (0.00s)

                                                
                                    
x
+
TestDownloadOnly/v1.31.0-beta.0/kubectl (0s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.31.0-beta.0/kubectl
aaa_download_only_test.go:167: Test for darwin and windows
--- SKIP: TestDownloadOnly/v1.31.0-beta.0/kubectl (0.00s)

                                                
                                    
x
+
TestDownloadOnlyKic (0.53s)

                                                
                                                
=== RUN   TestDownloadOnlyKic
aaa_download_only_test.go:232: (dbg) Run:  out/minikube-linux-arm64 start --download-only -p download-docker-568204 --alsologtostderr --driver=docker  --container-runtime=crio
aaa_download_only_test.go:244: Skip for arm64 platform. See https://github.com/kubernetes/minikube/issues/10144
helpers_test.go:175: Cleaning up "download-docker-568204" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-arm64 delete -p download-docker-568204
--- SKIP: TestDownloadOnlyKic (0.53s)

                                                
                                    
x
+
TestOffline (0s)

                                                
                                                
=== RUN   TestOffline
=== PAUSE TestOffline

                                                
                                                

                                                
                                                
=== CONT  TestOffline
aab_offline_test.go:35: skipping TestOffline - only docker runtime supported on arm64. See https://github.com/kubernetes/minikube/issues/10144
--- SKIP: TestOffline (0.00s)

                                                
                                    
x
+
TestAddons/parallel/HelmTiller (0s)

                                                
                                                
=== RUN   TestAddons/parallel/HelmTiller
=== PAUSE TestAddons/parallel/HelmTiller

                                                
                                                

                                                
                                                
=== CONT  TestAddons/parallel/HelmTiller
addons_test.go:446: skip Helm test on arm64
--- SKIP: TestAddons/parallel/HelmTiller (0.00s)

                                                
                                    
x
+
TestAddons/parallel/Olm (0s)

                                                
                                                
=== RUN   TestAddons/parallel/Olm
=== PAUSE TestAddons/parallel/Olm

                                                
                                                

                                                
                                                
=== CONT  TestAddons/parallel/Olm
addons_test.go:500: Skipping OLM addon test until https://github.com/operator-framework/operator-lifecycle-manager/issues/2534 is resolved
--- SKIP: TestAddons/parallel/Olm (0.00s)

                                                
                                    
x
+
TestAddons/parallel/Volcano (0s)

                                                
                                                
=== RUN   TestAddons/parallel/Volcano
=== PAUSE TestAddons/parallel/Volcano

                                                
                                                

                                                
                                                
=== CONT  TestAddons/parallel/Volcano
addons_test.go:871: skipping: crio not supported
--- SKIP: TestAddons/parallel/Volcano (0.00s)

                                                
                                    
x
+
TestDockerFlags (0s)

                                                
                                                
=== RUN   TestDockerFlags
docker_test.go:41: skipping: only runs with docker container runtime, currently testing crio
--- SKIP: TestDockerFlags (0.00s)

                                                
                                    
x
+
TestDockerEnvContainerd (0s)

                                                
                                                
=== RUN   TestDockerEnvContainerd
docker_test.go:170: running with crio true linux arm64
docker_test.go:172: skipping: TestDockerEnvContainerd can only be run with the containerd runtime on Docker driver
--- SKIP: TestDockerEnvContainerd (0.00s)

                                                
                                    
x
+
TestKVMDriverInstallOrUpdate (0s)

                                                
                                                
=== RUN   TestKVMDriverInstallOrUpdate
driver_install_or_update_test.go:45: Skip if arm64. See https://github.com/kubernetes/minikube/issues/10144
--- SKIP: TestKVMDriverInstallOrUpdate (0.00s)

                                                
                                    
x
+
TestHyperKitDriverInstallOrUpdate (0s)

                                                
                                                
=== RUN   TestHyperKitDriverInstallOrUpdate
driver_install_or_update_test.go:105: Skip if not darwin.
--- SKIP: TestHyperKitDriverInstallOrUpdate (0.00s)

                                                
                                    
x
+
TestHyperkitDriverSkipUpgrade (0s)

                                                
                                                
=== RUN   TestHyperkitDriverSkipUpgrade
driver_install_or_update_test.go:169: Skip if not darwin.
--- SKIP: TestHyperkitDriverSkipUpgrade (0.00s)

                                                
                                    
x
+
TestFunctional/parallel/MySQL (0s)

                                                
                                                
=== RUN   TestFunctional/parallel/MySQL
=== PAUSE TestFunctional/parallel/MySQL

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/MySQL
functional_test.go:1783: arm64 is not supported by mysql. Skip the test. See https://github.com/kubernetes/minikube/issues/10144
--- SKIP: TestFunctional/parallel/MySQL (0.00s)

                                                
                                    
x
+
TestFunctional/parallel/DockerEnv (0s)

                                                
                                                
=== RUN   TestFunctional/parallel/DockerEnv
=== PAUSE TestFunctional/parallel/DockerEnv

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/DockerEnv
functional_test.go:459: only validate docker env with docker container runtime, currently testing crio
--- SKIP: TestFunctional/parallel/DockerEnv (0.00s)

                                                
                                    
x
+
TestFunctional/parallel/PodmanEnv (0s)

                                                
                                                
=== RUN   TestFunctional/parallel/PodmanEnv
=== PAUSE TestFunctional/parallel/PodmanEnv

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/PodmanEnv
functional_test.go:546: only validate podman env with docker container runtime, currently testing crio
--- SKIP: TestFunctional/parallel/PodmanEnv (0.00s)

                                                
                                    
x
+
TestFunctional/parallel/TunnelCmd/serial/DNSResolutionByDig (0s)

                                                
                                                
=== RUN   TestFunctional/parallel/TunnelCmd/serial/DNSResolutionByDig
functional_test_tunnel_test.go:99: DNS forwarding is only supported for Hyperkit on Darwin, skipping test DNS forwarding
--- SKIP: TestFunctional/parallel/TunnelCmd/serial/DNSResolutionByDig (0.00s)

                                                
                                    
x
+
TestFunctional/parallel/TunnelCmd/serial/DNSResolutionByDscacheutil (0s)

                                                
                                                
=== RUN   TestFunctional/parallel/TunnelCmd/serial/DNSResolutionByDscacheutil
functional_test_tunnel_test.go:99: DNS forwarding is only supported for Hyperkit on Darwin, skipping test DNS forwarding
--- SKIP: TestFunctional/parallel/TunnelCmd/serial/DNSResolutionByDscacheutil (0.00s)

                                                
                                    
x
+
TestFunctional/parallel/TunnelCmd/serial/AccessThroughDNS (0s)

                                                
                                                
=== RUN   TestFunctional/parallel/TunnelCmd/serial/AccessThroughDNS
functional_test_tunnel_test.go:99: DNS forwarding is only supported for Hyperkit on Darwin, skipping test DNS forwarding
--- SKIP: TestFunctional/parallel/TunnelCmd/serial/AccessThroughDNS (0.00s)

                                                
                                    
x
+
TestGvisorAddon (0s)

                                                
                                                
=== RUN   TestGvisorAddon
gvisor_addon_test.go:34: skipping test because --gvisor=false
--- SKIP: TestGvisorAddon (0.00s)

                                                
                                    
x
+
TestImageBuild (0s)

                                                
                                                
=== RUN   TestImageBuild
image_test.go:33: 
--- SKIP: TestImageBuild (0.00s)

                                                
                                    
x
+
TestChangeNoneUser (0s)

                                                
                                                
=== RUN   TestChangeNoneUser
none_test.go:38: Test requires none driver and SUDO_USER env to not be empty
--- SKIP: TestChangeNoneUser (0.00s)

                                                
                                    
x
+
TestScheduledStopWindows (0s)

                                                
                                                
=== RUN   TestScheduledStopWindows
scheduled_stop_test.go:42: test only runs on windows
--- SKIP: TestScheduledStopWindows (0.00s)

                                                
                                    
x
+
TestSkaffold (0s)

                                                
                                                
=== RUN   TestSkaffold
skaffold_test.go:45: skaffold requires docker-env, currently testing crio container runtime
--- SKIP: TestSkaffold (0.00s)

                                                
                                    
x
+
TestStartStop/group/disable-driver-mounts (0.17s)

                                                
                                                
=== RUN   TestStartStop/group/disable-driver-mounts
=== PAUSE TestStartStop/group/disable-driver-mounts

                                                
                                                

                                                
                                                
=== CONT  TestStartStop/group/disable-driver-mounts
start_stop_delete_test.go:103: skipping TestStartStop/group/disable-driver-mounts - only runs on virtualbox
helpers_test.go:175: Cleaning up "disable-driver-mounts-498326" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-arm64 delete -p disable-driver-mounts-498326
--- SKIP: TestStartStop/group/disable-driver-mounts (0.17s)

                                                
                                    
x
+
TestNetworkPlugins/group/kubenet (3.53s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/kubenet
net_test.go:93: Skipping the test as crio container runtimes requires CNI
panic.go:626: 
----------------------- debugLogs start: kubenet-507554 [pass: true] --------------------------------
>>> netcat: nslookup kubernetes.default:
Error in configuration: context was not found for specified context: kubenet-507554

                                                
                                                

                                                
                                                
>>> netcat: nslookup debug kubernetes.default a-records:
Error in configuration: context was not found for specified context: kubenet-507554

                                                
                                                

                                                
                                                
>>> netcat: dig search kubernetes.default:
Error in configuration: context was not found for specified context: kubenet-507554

                                                
                                                

                                                
                                                
>>> netcat: dig @10.96.0.10 kubernetes.default.svc.cluster.local udp/53:
Error in configuration: context was not found for specified context: kubenet-507554

                                                
                                                

                                                
                                                
>>> netcat: dig @10.96.0.10 kubernetes.default.svc.cluster.local tcp/53:
Error in configuration: context was not found for specified context: kubenet-507554

                                                
                                                

                                                
                                                
>>> netcat: nc 10.96.0.10 udp/53:
Error in configuration: context was not found for specified context: kubenet-507554

                                                
                                                

                                                
                                                
>>> netcat: nc 10.96.0.10 tcp/53:
Error in configuration: context was not found for specified context: kubenet-507554

                                                
                                                

                                                
                                                
>>> netcat: /etc/nsswitch.conf:
Error in configuration: context was not found for specified context: kubenet-507554

                                                
                                                

                                                
                                                
>>> netcat: /etc/hosts:
Error in configuration: context was not found for specified context: kubenet-507554

                                                
                                                

                                                
                                                
>>> netcat: /etc/resolv.conf:
Error in configuration: context was not found for specified context: kubenet-507554

                                                
                                                

                                                
                                                
>>> host: /etc/nsswitch.conf:
* Profile "kubenet-507554" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-507554"

                                                
                                                

                                                
                                                
>>> host: /etc/hosts:
* Profile "kubenet-507554" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-507554"

                                                
                                                

                                                
                                                
>>> host: /etc/resolv.conf:
* Profile "kubenet-507554" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-507554"

                                                
                                                

                                                
                                                
>>> k8s: nodes, services, endpoints, daemon sets, deployments and pods, :
Error in configuration: context was not found for specified context: kubenet-507554

                                                
                                                

                                                
                                                
>>> host: crictl pods:
* Profile "kubenet-507554" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-507554"

                                                
                                                

                                                
                                                
>>> host: crictl containers:
* Profile "kubenet-507554" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-507554"

                                                
                                                

                                                
                                                
>>> k8s: describe netcat deployment:
error: context "kubenet-507554" does not exist

                                                
                                                

                                                
                                                
>>> k8s: describe netcat pod(s):
error: context "kubenet-507554" does not exist

                                                
                                                

                                                
                                                
>>> k8s: netcat logs:
error: context "kubenet-507554" does not exist

                                                
                                                

                                                
                                                
>>> k8s: describe coredns deployment:
error: context "kubenet-507554" does not exist

                                                
                                                

                                                
                                                
>>> k8s: describe coredns pods:
error: context "kubenet-507554" does not exist

                                                
                                                

                                                
                                                
>>> k8s: coredns logs:
error: context "kubenet-507554" does not exist

                                                
                                                

                                                
                                                
>>> k8s: describe api server pod(s):
error: context "kubenet-507554" does not exist

                                                
                                                

                                                
                                                
>>> k8s: api server logs:
error: context "kubenet-507554" does not exist

                                                
                                                

                                                
                                                
>>> host: /etc/cni:
* Profile "kubenet-507554" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-507554"

                                                
                                                

                                                
                                                
>>> host: ip a s:
* Profile "kubenet-507554" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-507554"

                                                
                                                

                                                
                                                
>>> host: ip r s:
* Profile "kubenet-507554" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-507554"

                                                
                                                

                                                
                                                
>>> host: iptables-save:
* Profile "kubenet-507554" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-507554"

                                                
                                                

                                                
                                                
>>> host: iptables table nat:
* Profile "kubenet-507554" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-507554"

                                                
                                                

                                                
                                                
>>> k8s: describe kube-proxy daemon set:
error: context "kubenet-507554" does not exist

                                                
                                                

                                                
                                                
>>> k8s: describe kube-proxy pod(s):
error: context "kubenet-507554" does not exist

                                                
                                                

                                                
                                                
>>> k8s: kube-proxy logs:
error: context "kubenet-507554" does not exist

                                                
                                                

                                                
                                                
>>> host: kubelet daemon status:
* Profile "kubenet-507554" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-507554"

                                                
                                                

                                                
                                                
>>> host: kubelet daemon config:
* Profile "kubenet-507554" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-507554"

                                                
                                                

                                                
                                                
>>> k8s: kubelet logs:
* Profile "kubenet-507554" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-507554"

                                                
                                                

                                                
                                                
>>> host: /etc/kubernetes/kubelet.conf:
* Profile "kubenet-507554" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-507554"

                                                
                                                

                                                
                                                
>>> host: /var/lib/kubelet/config.yaml:
* Profile "kubenet-507554" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-507554"

                                                
                                                

                                                
                                                
>>> k8s: kubectl config:
apiVersion: v1
clusters:
- cluster:
certificate-authority: /home/jenkins/minikube-integration/19313-2237/.minikube/ca.crt
extensions:
- extension:
last-update: Mon, 22 Jul 2024 11:16:57 UTC
provider: minikube.sigs.k8s.io
version: v1.33.1
name: cluster_info
server: https://192.168.76.2:8443
name: kubernetes-upgrade-176274
contexts:
- context:
cluster: kubernetes-upgrade-176274
user: kubernetes-upgrade-176274
name: kubernetes-upgrade-176274
current-context: ""
kind: Config
preferences: {}
users:
- name: kubernetes-upgrade-176274
user:
client-certificate: /home/jenkins/minikube-integration/19313-2237/.minikube/profiles/kubernetes-upgrade-176274/client.crt
client-key: /home/jenkins/minikube-integration/19313-2237/.minikube/profiles/kubernetes-upgrade-176274/client.key

                                                
                                                

                                                
                                                
>>> k8s: cms:
Error in configuration: context was not found for specified context: kubenet-507554

                                                
                                                

                                                
                                                
>>> host: docker daemon status:
* Profile "kubenet-507554" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-507554"

                                                
                                                

                                                
                                                
>>> host: docker daemon config:
* Profile "kubenet-507554" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-507554"

                                                
                                                

                                                
                                                
>>> host: /etc/docker/daemon.json:
* Profile "kubenet-507554" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-507554"

                                                
                                                

                                                
                                                
>>> host: docker system info:
* Profile "kubenet-507554" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-507554"

                                                
                                                

                                                
                                                
>>> host: cri-docker daemon status:
* Profile "kubenet-507554" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-507554"

                                                
                                                

                                                
                                                
>>> host: cri-docker daemon config:
* Profile "kubenet-507554" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-507554"

                                                
                                                

                                                
                                                
>>> host: /etc/systemd/system/cri-docker.service.d/10-cni.conf:
* Profile "kubenet-507554" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-507554"

                                                
                                                

                                                
                                                
>>> host: /usr/lib/systemd/system/cri-docker.service:
* Profile "kubenet-507554" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-507554"

                                                
                                                

                                                
                                                
>>> host: cri-dockerd version:
* Profile "kubenet-507554" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-507554"

                                                
                                                

                                                
                                                
>>> host: containerd daemon status:
* Profile "kubenet-507554" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-507554"

                                                
                                                

                                                
                                                
>>> host: containerd daemon config:
* Profile "kubenet-507554" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-507554"

                                                
                                                

                                                
                                                
>>> host: /lib/systemd/system/containerd.service:
* Profile "kubenet-507554" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-507554"

                                                
                                                

                                                
                                                
>>> host: /etc/containerd/config.toml:
* Profile "kubenet-507554" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-507554"

                                                
                                                

                                                
                                                
>>> host: containerd config dump:
* Profile "kubenet-507554" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-507554"

                                                
                                                

                                                
                                                
>>> host: crio daemon status:
* Profile "kubenet-507554" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-507554"

                                                
                                                

                                                
                                                
>>> host: crio daemon config:
* Profile "kubenet-507554" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-507554"

                                                
                                                

                                                
                                                
>>> host: /etc/crio:
* Profile "kubenet-507554" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-507554"

                                                
                                                

                                                
                                                
>>> host: crio config:
* Profile "kubenet-507554" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-507554"

                                                
                                                
----------------------- debugLogs end: kubenet-507554 [took: 3.382268097s] --------------------------------
helpers_test.go:175: Cleaning up "kubenet-507554" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-arm64 delete -p kubenet-507554
--- SKIP: TestNetworkPlugins/group/kubenet (3.53s)

                                                
                                    
x
+
TestNetworkPlugins/group/cilium (4.01s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/cilium
net_test.go:102: Skipping the test as it's interfering with other tests and is outdated
panic.go:626: 
----------------------- debugLogs start: cilium-507554 [pass: true] --------------------------------
>>> netcat: nslookup kubernetes.default:
Error in configuration: context was not found for specified context: cilium-507554

                                                
                                                

                                                
                                                
>>> netcat: nslookup debug kubernetes.default a-records:
Error in configuration: context was not found for specified context: cilium-507554

                                                
                                                

                                                
                                                
>>> netcat: dig search kubernetes.default:
Error in configuration: context was not found for specified context: cilium-507554

                                                
                                                

                                                
                                                
>>> netcat: dig @10.96.0.10 kubernetes.default.svc.cluster.local udp/53:
Error in configuration: context was not found for specified context: cilium-507554

                                                
                                                

                                                
                                                
>>> netcat: dig @10.96.0.10 kubernetes.default.svc.cluster.local tcp/53:
Error in configuration: context was not found for specified context: cilium-507554

                                                
                                                

                                                
                                                
>>> netcat: nc 10.96.0.10 udp/53:
Error in configuration: context was not found for specified context: cilium-507554

                                                
                                                

                                                
                                                
>>> netcat: nc 10.96.0.10 tcp/53:
Error in configuration: context was not found for specified context: cilium-507554

                                                
                                                

                                                
                                                
>>> netcat: /etc/nsswitch.conf:
Error in configuration: context was not found for specified context: cilium-507554

                                                
                                                

                                                
                                                
>>> netcat: /etc/hosts:
Error in configuration: context was not found for specified context: cilium-507554

                                                
                                                

                                                
                                                
>>> netcat: /etc/resolv.conf:
Error in configuration: context was not found for specified context: cilium-507554

                                                
                                                

                                                
                                                
>>> host: /etc/nsswitch.conf:
* Profile "cilium-507554" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-507554"

                                                
                                                

                                                
                                                
>>> host: /etc/hosts:
* Profile "cilium-507554" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-507554"

                                                
                                                

                                                
                                                
>>> host: /etc/resolv.conf:
* Profile "cilium-507554" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-507554"

                                                
                                                

                                                
                                                
>>> k8s: nodes, services, endpoints, daemon sets, deployments and pods, :
Error in configuration: context was not found for specified context: cilium-507554

                                                
                                                

                                                
                                                
>>> host: crictl pods:
* Profile "cilium-507554" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-507554"

                                                
                                                

                                                
                                                
>>> host: crictl containers:
* Profile "cilium-507554" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-507554"

                                                
                                                

                                                
                                                
>>> k8s: describe netcat deployment:
error: context "cilium-507554" does not exist

                                                
                                                

                                                
                                                
>>> k8s: describe netcat pod(s):
error: context "cilium-507554" does not exist

                                                
                                                

                                                
                                                
>>> k8s: netcat logs:
error: context "cilium-507554" does not exist

                                                
                                                

                                                
                                                
>>> k8s: describe coredns deployment:
error: context "cilium-507554" does not exist

                                                
                                                

                                                
                                                
>>> k8s: describe coredns pods:
error: context "cilium-507554" does not exist

                                                
                                                

                                                
                                                
>>> k8s: coredns logs:
error: context "cilium-507554" does not exist

                                                
                                                

                                                
                                                
>>> k8s: describe api server pod(s):
error: context "cilium-507554" does not exist

                                                
                                                

                                                
                                                
>>> k8s: api server logs:
error: context "cilium-507554" does not exist

                                                
                                                

                                                
                                                
>>> host: /etc/cni:
* Profile "cilium-507554" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-507554"

                                                
                                                

                                                
                                                
>>> host: ip a s:
* Profile "cilium-507554" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-507554"

                                                
                                                

                                                
                                                
>>> host: ip r s:
* Profile "cilium-507554" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-507554"

                                                
                                                

                                                
                                                
>>> host: iptables-save:
* Profile "cilium-507554" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-507554"

                                                
                                                

                                                
                                                
>>> host: iptables table nat:
* Profile "cilium-507554" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-507554"

                                                
                                                

                                                
                                                
>>> k8s: describe cilium daemon set:
Error in configuration: context was not found for specified context: cilium-507554

                                                
                                                

                                                
                                                
>>> k8s: describe cilium daemon set pod(s):
Error in configuration: context was not found for specified context: cilium-507554

                                                
                                                

                                                
                                                
>>> k8s: cilium daemon set container(s) logs (current):
error: context "cilium-507554" does not exist

                                                
                                                

                                                
                                                
>>> k8s: cilium daemon set container(s) logs (previous):
error: context "cilium-507554" does not exist

                                                
                                                

                                                
                                                
>>> k8s: describe cilium deployment:
Error in configuration: context was not found for specified context: cilium-507554

                                                
                                                

                                                
                                                
>>> k8s: describe cilium deployment pod(s):
Error in configuration: context was not found for specified context: cilium-507554

                                                
                                                

                                                
                                                
>>> k8s: cilium deployment container(s) logs (current):
error: context "cilium-507554" does not exist

                                                
                                                

                                                
                                                
>>> k8s: cilium deployment container(s) logs (previous):
error: context "cilium-507554" does not exist

                                                
                                                

                                                
                                                
>>> k8s: describe kube-proxy daemon set:
error: context "cilium-507554" does not exist

                                                
                                                

                                                
                                                
>>> k8s: describe kube-proxy pod(s):
error: context "cilium-507554" does not exist

                                                
                                                

                                                
                                                
>>> k8s: kube-proxy logs:
error: context "cilium-507554" does not exist

                                                
                                                

                                                
                                                
>>> host: kubelet daemon status:
* Profile "cilium-507554" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-507554"

                                                
                                                

                                                
                                                
>>> host: kubelet daemon config:
* Profile "cilium-507554" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-507554"

                                                
                                                

                                                
                                                
>>> k8s: kubelet logs:
* Profile "cilium-507554" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-507554"

                                                
                                                

                                                
                                                
>>> host: /etc/kubernetes/kubelet.conf:
* Profile "cilium-507554" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-507554"

                                                
                                                

                                                
                                                
>>> host: /var/lib/kubelet/config.yaml:
* Profile "cilium-507554" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-507554"

                                                
                                                

                                                
                                                
>>> k8s: kubectl config:
apiVersion: v1
clusters:
- cluster:
certificate-authority: /home/jenkins/minikube-integration/19313-2237/.minikube/ca.crt
extensions:
- extension:
last-update: Mon, 22 Jul 2024 11:16:57 UTC
provider: minikube.sigs.k8s.io
version: v1.33.1
name: cluster_info
server: https://192.168.76.2:8443
name: kubernetes-upgrade-176274
contexts:
- context:
cluster: kubernetes-upgrade-176274
user: kubernetes-upgrade-176274
name: kubernetes-upgrade-176274
current-context: ""
kind: Config
preferences: {}
users:
- name: kubernetes-upgrade-176274
user:
client-certificate: /home/jenkins/minikube-integration/19313-2237/.minikube/profiles/kubernetes-upgrade-176274/client.crt
client-key: /home/jenkins/minikube-integration/19313-2237/.minikube/profiles/kubernetes-upgrade-176274/client.key

                                                
                                                

                                                
                                                
>>> k8s: cms:
Error in configuration: context was not found for specified context: cilium-507554

                                                
                                                

                                                
                                                
>>> host: docker daemon status:
* Profile "cilium-507554" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-507554"

                                                
                                                

                                                
                                                
>>> host: docker daemon config:
* Profile "cilium-507554" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-507554"

                                                
                                                

                                                
                                                
>>> host: /etc/docker/daemon.json:
* Profile "cilium-507554" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-507554"

                                                
                                                

                                                
                                                
>>> host: docker system info:
* Profile "cilium-507554" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-507554"

                                                
                                                

                                                
                                                
>>> host: cri-docker daemon status:
* Profile "cilium-507554" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-507554"

                                                
                                                

                                                
                                                
>>> host: cri-docker daemon config:
* Profile "cilium-507554" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-507554"

                                                
                                                

                                                
                                                
>>> host: /etc/systemd/system/cri-docker.service.d/10-cni.conf:
* Profile "cilium-507554" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-507554"

                                                
                                                

                                                
                                                
>>> host: /usr/lib/systemd/system/cri-docker.service:
* Profile "cilium-507554" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-507554"

                                                
                                                

                                                
                                                
>>> host: cri-dockerd version:
* Profile "cilium-507554" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-507554"

                                                
                                                

                                                
                                                
>>> host: containerd daemon status:
* Profile "cilium-507554" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-507554"

                                                
                                                

                                                
                                                
>>> host: containerd daemon config:
* Profile "cilium-507554" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-507554"

                                                
                                                

                                                
                                                
>>> host: /lib/systemd/system/containerd.service:
* Profile "cilium-507554" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-507554"

                                                
                                                

                                                
                                                
>>> host: /etc/containerd/config.toml:
* Profile "cilium-507554" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-507554"

                                                
                                                

                                                
                                                
>>> host: containerd config dump:
* Profile "cilium-507554" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-507554"

                                                
                                                

                                                
                                                
>>> host: crio daemon status:
* Profile "cilium-507554" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-507554"

                                                
                                                

                                                
                                                
>>> host: crio daemon config:
* Profile "cilium-507554" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-507554"

                                                
                                                

                                                
                                                
>>> host: /etc/crio:
* Profile "cilium-507554" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-507554"

                                                
                                                

                                                
                                                
>>> host: crio config:
* Profile "cilium-507554" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-507554"

                                                
                                                
----------------------- debugLogs end: cilium-507554 [took: 3.860325695s] --------------------------------
helpers_test.go:175: Cleaning up "cilium-507554" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-arm64 delete -p cilium-507554
--- SKIP: TestNetworkPlugins/group/cilium (4.01s)

                                                
                                    
Copied to clipboard