Test Report: Docker_Linux_containerd_arm64 19339

                    
                      8887856610da967907ca11fca489a0af319d423c:2024-07-29:35555
                    
                

Test fail (2/336)

Order failed test Duration
38 TestAddons/serial/Volcano 200.32
311 TestStartStop/group/old-k8s-version/serial/SecondStart 374.58
x
+
TestAddons/serial/Volcano (200.32s)

                                                
                                                
=== RUN   TestAddons/serial/Volcano
addons_test.go:897: volcano-scheduler stabilized in 40.134879ms
addons_test.go:913: volcano-controller stabilized in 40.622311ms
addons_test.go:905: volcano-admission stabilized in 40.665616ms
addons_test.go:919: (dbg) TestAddons/serial/Volcano: waiting 6m0s for pods matching "app=volcano-scheduler" in namespace "volcano-system" ...
helpers_test.go:344: "volcano-scheduler-844f6db89b-znvvt" [7916a0f7-fb00-42c9-9748-5ecf7af8bd4c] Running
addons_test.go:919: (dbg) TestAddons/serial/Volcano: app=volcano-scheduler healthy within 6.00411095s
addons_test.go:923: (dbg) TestAddons/serial/Volcano: waiting 6m0s for pods matching "app=volcano-admission" in namespace "volcano-system" ...
helpers_test.go:344: "volcano-admission-5f7844f7bc-6c299" [4a0b19a8-28c6-462c-9ffa-045baceeee29] Running
addons_test.go:923: (dbg) TestAddons/serial/Volcano: app=volcano-admission healthy within 5.003728735s
addons_test.go:927: (dbg) TestAddons/serial/Volcano: waiting 6m0s for pods matching "app=volcano-controller" in namespace "volcano-system" ...
helpers_test.go:344: "volcano-controllers-59cb4746db-rb47v" [03d4e979-1ece-4967-ac94-17d2ae10474a] Running
addons_test.go:927: (dbg) TestAddons/serial/Volcano: app=volcano-controller healthy within 5.003486961s
addons_test.go:932: (dbg) Run:  kubectl --context addons-675434 delete -n volcano-system job volcano-admission-init
addons_test.go:938: (dbg) Run:  kubectl --context addons-675434 create -f testdata/vcjob.yaml
addons_test.go:946: (dbg) Run:  kubectl --context addons-675434 get vcjob -n my-volcano
addons_test.go:964: (dbg) TestAddons/serial/Volcano: waiting 3m0s for pods matching "volcano.sh/job-name=test-job" in namespace "my-volcano" ...
helpers_test.go:344: "test-job-nginx-0" [2e112876-83f6-4480-9f6c-319f3d8d4eae] Pending: PodScheduled:Unschedulable (0/1 nodes are unavailable: 1 Insufficient cpu.)
helpers_test.go:329: TestAddons/serial/Volcano: WARNING: pod list for "my-volcano" "volcano.sh/job-name=test-job" returned: client rate limiter Wait returned an error: context deadline exceeded
addons_test.go:964: ***** TestAddons/serial/Volcano: pod "volcano.sh/job-name=test-job" failed to start within 3m0s: context deadline exceeded ****
addons_test.go:964: (dbg) Run:  out/minikube-linux-arm64 status --format={{.APIServer}} -p addons-675434 -n addons-675434
addons_test.go:964: TestAddons/serial/Volcano: showing logs for failed pods as of 2024-07-29 20:20:14.22787148 +0000 UTC m=+441.849099025
addons_test.go:964: (dbg) Run:  kubectl --context addons-675434 describe po test-job-nginx-0 -n my-volcano
addons_test.go:964: (dbg) kubectl --context addons-675434 describe po test-job-nginx-0 -n my-volcano:
Name:             test-job-nginx-0
Namespace:        my-volcano
Priority:         0
Service Account:  default
Node:             <none>
Labels:           volcano.sh/job-name=test-job
volcano.sh/job-namespace=my-volcano
volcano.sh/queue-name=test
volcano.sh/task-index=0
volcano.sh/task-spec=nginx
Annotations:      scheduling.k8s.io/group-name: test-job-54acede1-d037-4248-b512-f199125982ce
volcano.sh/job-name: test-job
volcano.sh/job-version: 0
volcano.sh/queue-name: test
volcano.sh/task-index: 0
volcano.sh/task-spec: nginx
volcano.sh/template-uid: test-job-nginx
Status:           Pending
IP:               
IPs:              <none>
Controlled By:    Job/test-job
Containers:
nginx:
Image:      nginx:latest
Port:       <none>
Host Port:  <none>
Command:
sleep
10m
Limits:
cpu:  1
Requests:
cpu:  1
Environment:
GOOGLE_APPLICATION_CREDENTIALS:  /google-app-creds.json
PROJECT_ID:                      this_is_fake
GCP_PROJECT:                     this_is_fake
GCLOUD_PROJECT:                  this_is_fake
GOOGLE_CLOUD_PROJECT:            this_is_fake
CLOUDSDK_CORE_PROJECT:           this_is_fake
Mounts:
/google-app-creds.json from gcp-creds (ro)
/var/run/secrets/kubernetes.io/serviceaccount from kube-api-access-q2szf (ro)
Conditions:
Type           Status
PodScheduled   False 
Volumes:
kube-api-access-q2szf:
Type:                    Projected (a volume that contains injected data from multiple sources)
TokenExpirationSeconds:  3607
ConfigMapName:           kube-root-ca.crt
ConfigMapOptional:       <nil>
DownwardAPI:             true
gcp-creds:
Type:          HostPath (bare host directory volume)
Path:          /var/lib/minikube/google_application_credentials.json
HostPathType:  File
QoS Class:         Burstable
Node-Selectors:    <none>
Tolerations:       node.kubernetes.io/not-ready:NoExecute op=Exists for 300s
node.kubernetes.io/unreachable:NoExecute op=Exists for 300s
Events:
Type     Reason            Age    From     Message
----     ------            ----   ----     -------
Warning  FailedScheduling  2m59s  volcano  0/1 nodes are unavailable: 1 Insufficient cpu.
addons_test.go:964: (dbg) Run:  kubectl --context addons-675434 logs test-job-nginx-0 -n my-volcano
addons_test.go:964: (dbg) kubectl --context addons-675434 logs test-job-nginx-0 -n my-volcano:
addons_test.go:965: failed waiting for test-local-path pod: volcano.sh/job-name=test-job within 3m0s: context deadline exceeded
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:230: ======>  post-mortem[TestAddons/serial/Volcano]: docker inspect <======
helpers_test.go:231: (dbg) Run:  docker inspect addons-675434
helpers_test.go:235: (dbg) docker inspect addons-675434:

                                                
                                                
-- stdout --
	[
	    {
	        "Id": "d82e7838467d78863ce31bfae8e94e982b0a1686500227ddf9bd4f185041ed1f",
	        "Created": "2024-07-29T20:13:38.970154843Z",
	        "Path": "/usr/local/bin/entrypoint",
	        "Args": [
	            "/sbin/init"
	        ],
	        "State": {
	            "Status": "running",
	            "Running": true,
	            "Paused": false,
	            "Restarting": false,
	            "OOMKilled": false,
	            "Dead": false,
	            "Pid": 141240,
	            "ExitCode": 0,
	            "Error": "",
	            "StartedAt": "2024-07-29T20:13:39.109624951Z",
	            "FinishedAt": "0001-01-01T00:00:00Z"
	        },
	        "Image": "sha256:2cd84ab2172023a68162f38a55db46353562cea41552fd8e8bdec97b31b2c495",
	        "ResolvConfPath": "/var/lib/docker/containers/d82e7838467d78863ce31bfae8e94e982b0a1686500227ddf9bd4f185041ed1f/resolv.conf",
	        "HostnamePath": "/var/lib/docker/containers/d82e7838467d78863ce31bfae8e94e982b0a1686500227ddf9bd4f185041ed1f/hostname",
	        "HostsPath": "/var/lib/docker/containers/d82e7838467d78863ce31bfae8e94e982b0a1686500227ddf9bd4f185041ed1f/hosts",
	        "LogPath": "/var/lib/docker/containers/d82e7838467d78863ce31bfae8e94e982b0a1686500227ddf9bd4f185041ed1f/d82e7838467d78863ce31bfae8e94e982b0a1686500227ddf9bd4f185041ed1f-json.log",
	        "Name": "/addons-675434",
	        "RestartCount": 0,
	        "Driver": "overlay2",
	        "Platform": "linux",
	        "MountLabel": "",
	        "ProcessLabel": "",
	        "AppArmorProfile": "unconfined",
	        "ExecIDs": null,
	        "HostConfig": {
	            "Binds": [
	                "/lib/modules:/lib/modules:ro",
	                "addons-675434:/var"
	            ],
	            "ContainerIDFile": "",
	            "LogConfig": {
	                "Type": "json-file",
	                "Config": {}
	            },
	            "NetworkMode": "addons-675434",
	            "PortBindings": {
	                "22/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": ""
	                    }
	                ],
	                "2376/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": ""
	                    }
	                ],
	                "32443/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": ""
	                    }
	                ],
	                "5000/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": ""
	                    }
	                ],
	                "8443/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": ""
	                    }
	                ]
	            },
	            "RestartPolicy": {
	                "Name": "no",
	                "MaximumRetryCount": 0
	            },
	            "AutoRemove": false,
	            "VolumeDriver": "",
	            "VolumesFrom": null,
	            "ConsoleSize": [
	                0,
	                0
	            ],
	            "CapAdd": null,
	            "CapDrop": null,
	            "CgroupnsMode": "host",
	            "Dns": [],
	            "DnsOptions": [],
	            "DnsSearch": [],
	            "ExtraHosts": null,
	            "GroupAdd": null,
	            "IpcMode": "private",
	            "Cgroup": "",
	            "Links": null,
	            "OomScoreAdj": 0,
	            "PidMode": "",
	            "Privileged": true,
	            "PublishAllPorts": false,
	            "ReadonlyRootfs": false,
	            "SecurityOpt": [
	                "seccomp=unconfined",
	                "apparmor=unconfined",
	                "label=disable"
	            ],
	            "Tmpfs": {
	                "/run": "",
	                "/tmp": ""
	            },
	            "UTSMode": "",
	            "UsernsMode": "",
	            "ShmSize": 67108864,
	            "Runtime": "runc",
	            "Isolation": "",
	            "CpuShares": 0,
	            "Memory": 4194304000,
	            "NanoCpus": 2000000000,
	            "CgroupParent": "",
	            "BlkioWeight": 0,
	            "BlkioWeightDevice": [],
	            "BlkioDeviceReadBps": [],
	            "BlkioDeviceWriteBps": [],
	            "BlkioDeviceReadIOps": [],
	            "BlkioDeviceWriteIOps": [],
	            "CpuPeriod": 0,
	            "CpuQuota": 0,
	            "CpuRealtimePeriod": 0,
	            "CpuRealtimeRuntime": 0,
	            "CpusetCpus": "",
	            "CpusetMems": "",
	            "Devices": [],
	            "DeviceCgroupRules": null,
	            "DeviceRequests": null,
	            "MemoryReservation": 0,
	            "MemorySwap": 8388608000,
	            "MemorySwappiness": null,
	            "OomKillDisable": false,
	            "PidsLimit": null,
	            "Ulimits": [],
	            "CpuCount": 0,
	            "CpuPercent": 0,
	            "IOMaximumIOps": 0,
	            "IOMaximumBandwidth": 0,
	            "MaskedPaths": null,
	            "ReadonlyPaths": null
	        },
	        "GraphDriver": {
	            "Data": {
	                "LowerDir": "/var/lib/docker/overlay2/edf722b44fb6907c9fee64ca9c0594c5c8d2b87653e659a48d08e6c7d411b7a9-init/diff:/var/lib/docker/overlay2/84384c93b44c85d0a89240736a5f26774082ee345f8159e04443d01c613189a6/diff",
	                "MergedDir": "/var/lib/docker/overlay2/edf722b44fb6907c9fee64ca9c0594c5c8d2b87653e659a48d08e6c7d411b7a9/merged",
	                "UpperDir": "/var/lib/docker/overlay2/edf722b44fb6907c9fee64ca9c0594c5c8d2b87653e659a48d08e6c7d411b7a9/diff",
	                "WorkDir": "/var/lib/docker/overlay2/edf722b44fb6907c9fee64ca9c0594c5c8d2b87653e659a48d08e6c7d411b7a9/work"
	            },
	            "Name": "overlay2"
	        },
	        "Mounts": [
	            {
	                "Type": "bind",
	                "Source": "/lib/modules",
	                "Destination": "/lib/modules",
	                "Mode": "ro",
	                "RW": false,
	                "Propagation": "rprivate"
	            },
	            {
	                "Type": "volume",
	                "Name": "addons-675434",
	                "Source": "/var/lib/docker/volumes/addons-675434/_data",
	                "Destination": "/var",
	                "Driver": "local",
	                "Mode": "z",
	                "RW": true,
	                "Propagation": ""
	            }
	        ],
	        "Config": {
	            "Hostname": "addons-675434",
	            "Domainname": "",
	            "User": "",
	            "AttachStdin": false,
	            "AttachStdout": false,
	            "AttachStderr": false,
	            "ExposedPorts": {
	                "22/tcp": {},
	                "2376/tcp": {},
	                "32443/tcp": {},
	                "5000/tcp": {},
	                "8443/tcp": {}
	            },
	            "Tty": true,
	            "OpenStdin": false,
	            "StdinOnce": false,
	            "Env": [
	                "container=docker",
	                "PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin"
	            ],
	            "Cmd": null,
	            "Image": "gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721902582-19326@sha256:540fb5dc7f38be17ff5276a38dfe6c8a4b1d9ba1c27c62244e6eebd7e37696e7",
	            "Volumes": null,
	            "WorkingDir": "/",
	            "Entrypoint": [
	                "/usr/local/bin/entrypoint",
	                "/sbin/init"
	            ],
	            "OnBuild": null,
	            "Labels": {
	                "created_by.minikube.sigs.k8s.io": "true",
	                "mode.minikube.sigs.k8s.io": "addons-675434",
	                "name.minikube.sigs.k8s.io": "addons-675434",
	                "role.minikube.sigs.k8s.io": ""
	            },
	            "StopSignal": "SIGRTMIN+3"
	        },
	        "NetworkSettings": {
	            "Bridge": "",
	            "SandboxID": "3b3cb84feab75a6332cd4e2997be8fb7cfd2bdb73f422143ea73651dbca65ec5",
	            "SandboxKey": "/var/run/docker/netns/3b3cb84feab7",
	            "Ports": {
	                "22/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": "37035"
	                    }
	                ],
	                "2376/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": "37036"
	                    }
	                ],
	                "32443/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": "37039"
	                    }
	                ],
	                "5000/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": "37037"
	                    }
	                ],
	                "8443/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": "37038"
	                    }
	                ]
	            },
	            "HairpinMode": false,
	            "LinkLocalIPv6Address": "",
	            "LinkLocalIPv6PrefixLen": 0,
	            "SecondaryIPAddresses": null,
	            "SecondaryIPv6Addresses": null,
	            "EndpointID": "",
	            "Gateway": "",
	            "GlobalIPv6Address": "",
	            "GlobalIPv6PrefixLen": 0,
	            "IPAddress": "",
	            "IPPrefixLen": 0,
	            "IPv6Gateway": "",
	            "MacAddress": "",
	            "Networks": {
	                "addons-675434": {
	                    "IPAMConfig": {
	                        "IPv4Address": "192.168.49.2"
	                    },
	                    "Links": null,
	                    "Aliases": null,
	                    "MacAddress": "02:42:c0:a8:31:02",
	                    "DriverOpts": null,
	                    "NetworkID": "5dfcb656265dd025a32a65641cbbd49972082787af327ee5add2289a4574555a",
	                    "EndpointID": "6a92cce8256a31147159cdb45c35657e4be5e2a132f624fbb4dd836c1d2cae13",
	                    "Gateway": "192.168.49.1",
	                    "IPAddress": "192.168.49.2",
	                    "IPPrefixLen": 24,
	                    "IPv6Gateway": "",
	                    "GlobalIPv6Address": "",
	                    "GlobalIPv6PrefixLen": 0,
	                    "DNSNames": [
	                        "addons-675434",
	                        "d82e7838467d"
	                    ]
	                }
	            }
	        }
	    }
	]

                                                
                                                
-- /stdout --
helpers_test.go:239: (dbg) Run:  out/minikube-linux-arm64 status --format={{.Host}} -p addons-675434 -n addons-675434
helpers_test.go:244: <<< TestAddons/serial/Volcano FAILED: start of post-mortem logs <<<
helpers_test.go:245: ======>  post-mortem[TestAddons/serial/Volcano]: minikube logs <======
helpers_test.go:247: (dbg) Run:  out/minikube-linux-arm64 -p addons-675434 logs -n 25
helpers_test.go:247: (dbg) Done: out/minikube-linux-arm64 -p addons-675434 logs -n 25: (1.594594323s)
helpers_test.go:252: TestAddons/serial/Volcano logs: 
-- stdout --
	
	==> Audit <==
	|---------|--------------------------------------|------------------------|---------|---------|---------------------|---------------------|
	| Command |                 Args                 |        Profile         |  User   | Version |     Start Time      |      End Time       |
	|---------|--------------------------------------|------------------------|---------|---------|---------------------|---------------------|
	| start   | -o=json --download-only              | download-only-651312   | jenkins | v1.33.1 | 29 Jul 24 20:12 UTC |                     |
	|         | -p download-only-651312              |                        |         |         |                     |                     |
	|         | --force --alsologtostderr            |                        |         |         |                     |                     |
	|         | --kubernetes-version=v1.20.0         |                        |         |         |                     |                     |
	|         | --container-runtime=containerd       |                        |         |         |                     |                     |
	|         | --driver=docker                      |                        |         |         |                     |                     |
	|         | --container-runtime=containerd       |                        |         |         |                     |                     |
	| delete  | --all                                | minikube               | jenkins | v1.33.1 | 29 Jul 24 20:12 UTC | 29 Jul 24 20:12 UTC |
	| delete  | -p download-only-651312              | download-only-651312   | jenkins | v1.33.1 | 29 Jul 24 20:12 UTC | 29 Jul 24 20:12 UTC |
	| start   | -o=json --download-only              | download-only-877691   | jenkins | v1.33.1 | 29 Jul 24 20:13 UTC |                     |
	|         | -p download-only-877691              |                        |         |         |                     |                     |
	|         | --force --alsologtostderr            |                        |         |         |                     |                     |
	|         | --kubernetes-version=v1.30.3         |                        |         |         |                     |                     |
	|         | --container-runtime=containerd       |                        |         |         |                     |                     |
	|         | --driver=docker                      |                        |         |         |                     |                     |
	|         | --container-runtime=containerd       |                        |         |         |                     |                     |
	| delete  | --all                                | minikube               | jenkins | v1.33.1 | 29 Jul 24 20:13 UTC | 29 Jul 24 20:13 UTC |
	| delete  | -p download-only-877691              | download-only-877691   | jenkins | v1.33.1 | 29 Jul 24 20:13 UTC | 29 Jul 24 20:13 UTC |
	| start   | -o=json --download-only              | download-only-926923   | jenkins | v1.33.1 | 29 Jul 24 20:13 UTC |                     |
	|         | -p download-only-926923              |                        |         |         |                     |                     |
	|         | --force --alsologtostderr            |                        |         |         |                     |                     |
	|         | --kubernetes-version=v1.31.0-beta.0  |                        |         |         |                     |                     |
	|         | --container-runtime=containerd       |                        |         |         |                     |                     |
	|         | --driver=docker                      |                        |         |         |                     |                     |
	|         | --container-runtime=containerd       |                        |         |         |                     |                     |
	| delete  | --all                                | minikube               | jenkins | v1.33.1 | 29 Jul 24 20:13 UTC | 29 Jul 24 20:13 UTC |
	| delete  | -p download-only-926923              | download-only-926923   | jenkins | v1.33.1 | 29 Jul 24 20:13 UTC | 29 Jul 24 20:13 UTC |
	| delete  | -p download-only-651312              | download-only-651312   | jenkins | v1.33.1 | 29 Jul 24 20:13 UTC | 29 Jul 24 20:13 UTC |
	| delete  | -p download-only-877691              | download-only-877691   | jenkins | v1.33.1 | 29 Jul 24 20:13 UTC | 29 Jul 24 20:13 UTC |
	| delete  | -p download-only-926923              | download-only-926923   | jenkins | v1.33.1 | 29 Jul 24 20:13 UTC | 29 Jul 24 20:13 UTC |
	| start   | --download-only -p                   | download-docker-477815 | jenkins | v1.33.1 | 29 Jul 24 20:13 UTC |                     |
	|         | download-docker-477815               |                        |         |         |                     |                     |
	|         | --alsologtostderr                    |                        |         |         |                     |                     |
	|         | --driver=docker                      |                        |         |         |                     |                     |
	|         | --container-runtime=containerd       |                        |         |         |                     |                     |
	| delete  | -p download-docker-477815            | download-docker-477815 | jenkins | v1.33.1 | 29 Jul 24 20:13 UTC | 29 Jul 24 20:13 UTC |
	| start   | --download-only -p                   | binary-mirror-229872   | jenkins | v1.33.1 | 29 Jul 24 20:13 UTC |                     |
	|         | binary-mirror-229872                 |                        |         |         |                     |                     |
	|         | --alsologtostderr                    |                        |         |         |                     |                     |
	|         | --binary-mirror                      |                        |         |         |                     |                     |
	|         | http://127.0.0.1:37529               |                        |         |         |                     |                     |
	|         | --driver=docker                      |                        |         |         |                     |                     |
	|         | --container-runtime=containerd       |                        |         |         |                     |                     |
	| delete  | -p binary-mirror-229872              | binary-mirror-229872   | jenkins | v1.33.1 | 29 Jul 24 20:13 UTC | 29 Jul 24 20:13 UTC |
	| addons  | enable dashboard -p                  | addons-675434          | jenkins | v1.33.1 | 29 Jul 24 20:13 UTC |                     |
	|         | addons-675434                        |                        |         |         |                     |                     |
	| addons  | disable dashboard -p                 | addons-675434          | jenkins | v1.33.1 | 29 Jul 24 20:13 UTC |                     |
	|         | addons-675434                        |                        |         |         |                     |                     |
	| start   | -p addons-675434 --wait=true         | addons-675434          | jenkins | v1.33.1 | 29 Jul 24 20:13 UTC | 29 Jul 24 20:16 UTC |
	|         | --memory=4000 --alsologtostderr      |                        |         |         |                     |                     |
	|         | --addons=registry                    |                        |         |         |                     |                     |
	|         | --addons=metrics-server              |                        |         |         |                     |                     |
	|         | --addons=volumesnapshots             |                        |         |         |                     |                     |
	|         | --addons=csi-hostpath-driver         |                        |         |         |                     |                     |
	|         | --addons=gcp-auth                    |                        |         |         |                     |                     |
	|         | --addons=cloud-spanner               |                        |         |         |                     |                     |
	|         | --addons=inspektor-gadget            |                        |         |         |                     |                     |
	|         | --addons=storage-provisioner-rancher |                        |         |         |                     |                     |
	|         | --addons=nvidia-device-plugin        |                        |         |         |                     |                     |
	|         | --addons=yakd --addons=volcano       |                        |         |         |                     |                     |
	|         | --driver=docker                      |                        |         |         |                     |                     |
	|         | --container-runtime=containerd       |                        |         |         |                     |                     |
	|         | --addons=ingress                     |                        |         |         |                     |                     |
	|         | --addons=ingress-dns                 |                        |         |         |                     |                     |
	|---------|--------------------------------------|------------------------|---------|---------|---------------------|---------------------|
	
	
	==> Last Start <==
	Log file created at: 2024/07/29 20:13:14
	Running on machine: ip-172-31-29-130
	Binary: Built with gc go1.22.5 for linux/arm64
	Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg
	I0729 20:13:14.709638  140748 out.go:291] Setting OutFile to fd 1 ...
	I0729 20:13:14.709772  140748 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0729 20:13:14.709783  140748 out.go:304] Setting ErrFile to fd 2...
	I0729 20:13:14.709788  140748 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0729 20:13:14.710016  140748 root.go:338] Updating PATH: /home/jenkins/minikube-integration/19339-134334/.minikube/bin
	I0729 20:13:14.710437  140748 out.go:298] Setting JSON to false
	I0729 20:13:14.711291  140748 start.go:129] hostinfo: {"hostname":"ip-172-31-29-130","uptime":64541,"bootTime":1722219454,"procs":171,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1065-aws","kernelArch":"aarch64","virtualizationSystem":"","virtualizationRole":"","hostId":"36adf542-ef4f-4e2d-a0c8-6868d1383ff9"}
	I0729 20:13:14.711359  140748 start.go:139] virtualization:  
	I0729 20:13:14.713844  140748 out.go:177] * [addons-675434] minikube v1.33.1 on Ubuntu 20.04 (arm64)
	I0729 20:13:14.715815  140748 out.go:177]   - MINIKUBE_LOCATION=19339
	I0729 20:13:14.715876  140748 notify.go:220] Checking for updates...
	I0729 20:13:14.719816  140748 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I0729 20:13:14.721761  140748 out.go:177]   - KUBECONFIG=/home/jenkins/minikube-integration/19339-134334/kubeconfig
	I0729 20:13:14.723355  140748 out.go:177]   - MINIKUBE_HOME=/home/jenkins/minikube-integration/19339-134334/.minikube
	I0729 20:13:14.724858  140748 out.go:177]   - MINIKUBE_BIN=out/minikube-linux-arm64
	I0729 20:13:14.726573  140748 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=
	I0729 20:13:14.728434  140748 driver.go:392] Setting default libvirt URI to qemu:///system
	I0729 20:13:14.758064  140748 docker.go:123] docker version: linux-27.1.1:Docker Engine - Community
	I0729 20:13:14.758182  140748 cli_runner.go:164] Run: docker system info --format "{{json .}}"
	I0729 20:13:14.808162  140748 info.go:266] docker info: {ID:U5VK:ZNT5:35M3:FHLW:Q7TL:ELFX:BNAG:AV4T:UD2H:SK5L:SEJV:SJJL Containers:0 ContainersRunning:0 ContainersPaused:0 ContainersStopped:0 Images:1 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:29 OomKillDisable:true NGoroutines:44 SystemTime:2024-07-29 20:13:14.79899292 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1065-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Architecture:aarc
h64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8214900736 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-29-130 Labels:[] ExperimentalBuild:false ServerVersion:27.1.1 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:2bf793ef6dc9a18e00cb12efb64355c2c9d5eb41 Expected:2bf793ef6dc9a18e00cb12efb64355c2c9d5eb41} RuncCommit:{ID:v1.1.13-0-g58aa920 Expected:v1.1.13-0-g58aa920} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:<nil> ServerError
s:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.16.1] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.29.1]] Warnings:<nil>}}
	I0729 20:13:14.808272  140748 docker.go:307] overlay module found
	I0729 20:13:14.810689  140748 out.go:177] * Using the docker driver based on user configuration
	I0729 20:13:14.812521  140748 start.go:297] selected driver: docker
	I0729 20:13:14.812536  140748 start.go:901] validating driver "docker" against <nil>
	I0729 20:13:14.812551  140748 start.go:912] status for docker: {Installed:true Healthy:true Running:false NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I0729 20:13:14.813197  140748 cli_runner.go:164] Run: docker system info --format "{{json .}}"
	I0729 20:13:14.865437  140748 info.go:266] docker info: {ID:U5VK:ZNT5:35M3:FHLW:Q7TL:ELFX:BNAG:AV4T:UD2H:SK5L:SEJV:SJJL Containers:0 ContainersRunning:0 ContainersPaused:0 ContainersStopped:0 Images:1 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:29 OomKillDisable:true NGoroutines:44 SystemTime:2024-07-29 20:13:14.856762814 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1065-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Architecture:aar
ch64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8214900736 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-29-130 Labels:[] ExperimentalBuild:false ServerVersion:27.1.1 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:2bf793ef6dc9a18e00cb12efb64355c2c9d5eb41 Expected:2bf793ef6dc9a18e00cb12efb64355c2c9d5eb41} RuncCommit:{ID:v1.1.13-0-g58aa920 Expected:v1.1.13-0-g58aa920} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:<nil> ServerErro
rs:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.16.1] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.29.1]] Warnings:<nil>}}
	I0729 20:13:14.865607  140748 start_flags.go:310] no existing cluster config was found, will generate one from the flags 
	I0729 20:13:14.865844  140748 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
	I0729 20:13:14.867812  140748 out.go:177] * Using Docker driver with root privileges
	I0729 20:13:14.869688  140748 cni.go:84] Creating CNI manager for ""
	I0729 20:13:14.869719  140748 cni.go:143] "docker" driver + "containerd" runtime found, recommending kindnet
	I0729 20:13:14.869729  140748 start_flags.go:319] Found "CNI" CNI - setting NetworkPlugin=cni
	I0729 20:13:14.869814  140748 start.go:340] cluster config:
	{Name:addons-675434 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721902582-19326@sha256:540fb5dc7f38be17ff5276a38dfe6c8a4b1d9ba1c27c62244e6eebd7e37696e7 Memory:4000 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.30.3 ClusterName:addons-675434 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime
:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.30.3 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHA
uthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I0729 20:13:14.872579  140748 out.go:177] * Starting "addons-675434" primary control-plane node in "addons-675434" cluster
	I0729 20:13:14.874323  140748 cache.go:121] Beginning downloading kic base image for docker with containerd
	I0729 20:13:14.876109  140748 out.go:177] * Pulling base image v0.0.44-1721902582-19326 ...
	I0729 20:13:14.877738  140748 preload.go:131] Checking if preload exists for k8s version v1.30.3 and runtime containerd
	I0729 20:13:14.877788  140748 preload.go:146] Found local preload: /home/jenkins/minikube-integration/19339-134334/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.30.3-containerd-overlay2-arm64.tar.lz4
	I0729 20:13:14.877815  140748 cache.go:56] Caching tarball of preloaded images
	I0729 20:13:14.877830  140748 image.go:79] Checking for gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721902582-19326@sha256:540fb5dc7f38be17ff5276a38dfe6c8a4b1d9ba1c27c62244e6eebd7e37696e7 in local docker daemon
	I0729 20:13:14.877897  140748 preload.go:172] Found /home/jenkins/minikube-integration/19339-134334/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.30.3-containerd-overlay2-arm64.tar.lz4 in cache, skipping download
	I0729 20:13:14.877908  140748 cache.go:59] Finished verifying existence of preloaded tar for v1.30.3 on containerd
	I0729 20:13:14.878269  140748 profile.go:143] Saving config to /home/jenkins/minikube-integration/19339-134334/.minikube/profiles/addons-675434/config.json ...
	I0729 20:13:14.878289  140748 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19339-134334/.minikube/profiles/addons-675434/config.json: {Name:mk4e1b4606d4d572051a5a3519d0021d65145c50 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0729 20:13:14.892881  140748 cache.go:149] Downloading gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721902582-19326@sha256:540fb5dc7f38be17ff5276a38dfe6c8a4b1d9ba1c27c62244e6eebd7e37696e7 to local cache
	I0729 20:13:14.893013  140748 image.go:63] Checking for gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721902582-19326@sha256:540fb5dc7f38be17ff5276a38dfe6c8a4b1d9ba1c27c62244e6eebd7e37696e7 in local cache directory
	I0729 20:13:14.893036  140748 image.go:66] Found gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721902582-19326@sha256:540fb5dc7f38be17ff5276a38dfe6c8a4b1d9ba1c27c62244e6eebd7e37696e7 in local cache directory, skipping pull
	I0729 20:13:14.893042  140748 image.go:135] gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721902582-19326@sha256:540fb5dc7f38be17ff5276a38dfe6c8a4b1d9ba1c27c62244e6eebd7e37696e7 exists in cache, skipping pull
	I0729 20:13:14.893050  140748 cache.go:152] successfully saved gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721902582-19326@sha256:540fb5dc7f38be17ff5276a38dfe6c8a4b1d9ba1c27c62244e6eebd7e37696e7 as a tarball
	I0729 20:13:14.893065  140748 cache.go:162] Loading gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721902582-19326@sha256:540fb5dc7f38be17ff5276a38dfe6c8a4b1d9ba1c27c62244e6eebd7e37696e7 from local cache
	I0729 20:13:31.752944  140748 cache.go:164] successfully loaded and using gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721902582-19326@sha256:540fb5dc7f38be17ff5276a38dfe6c8a4b1d9ba1c27c62244e6eebd7e37696e7 from cached tarball
	I0729 20:13:31.752988  140748 cache.go:194] Successfully downloaded all kic artifacts
	I0729 20:13:31.753033  140748 start.go:360] acquireMachinesLock for addons-675434: {Name:mkc3cb08ca1983c5a8ee1e1d0c067247c9c4bde3 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0729 20:13:31.753697  140748 start.go:364] duration metric: took 637.951µs to acquireMachinesLock for "addons-675434"
	I0729 20:13:31.753733  140748 start.go:93] Provisioning new machine with config: &{Name:addons-675434 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721902582-19326@sha256:540fb5dc7f38be17ff5276a38dfe6c8a4b1d9ba1c27c62244e6eebd7e37696e7 Memory:4000 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.30.3 ClusterName:addons-675434 Namespace:default APIServerHAVIP: APIServerName:min
ikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.30.3 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:fa
lse CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.30.3 ContainerRuntime:containerd ControlPlane:true Worker:true}
	I0729 20:13:31.753838  140748 start.go:125] createHost starting for "" (driver="docker")
	I0729 20:13:31.756191  140748 out.go:204] * Creating docker container (CPUs=2, Memory=4000MB) ...
	I0729 20:13:31.756451  140748 start.go:159] libmachine.API.Create for "addons-675434" (driver="docker")
	I0729 20:13:31.756493  140748 client.go:168] LocalClient.Create starting
	I0729 20:13:31.756609  140748 main.go:141] libmachine: Creating CA: /home/jenkins/minikube-integration/19339-134334/.minikube/certs/ca.pem
	I0729 20:13:32.219159  140748 main.go:141] libmachine: Creating client certificate: /home/jenkins/minikube-integration/19339-134334/.minikube/certs/cert.pem
	I0729 20:13:32.527662  140748 cli_runner.go:164] Run: docker network inspect addons-675434 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
	W0729 20:13:32.546963  140748 cli_runner.go:211] docker network inspect addons-675434 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}" returned with exit code 1
	I0729 20:13:32.547059  140748 network_create.go:284] running [docker network inspect addons-675434] to gather additional debugging logs...
	I0729 20:13:32.547080  140748 cli_runner.go:164] Run: docker network inspect addons-675434
	W0729 20:13:32.565834  140748 cli_runner.go:211] docker network inspect addons-675434 returned with exit code 1
	I0729 20:13:32.565871  140748 network_create.go:287] error running [docker network inspect addons-675434]: docker network inspect addons-675434: exit status 1
	stdout:
	[]
	
	stderr:
	Error response from daemon: network addons-675434 not found
	I0729 20:13:32.565885  140748 network_create.go:289] output of [docker network inspect addons-675434]: -- stdout --
	[]
	
	-- /stdout --
	** stderr ** 
	Error response from daemon: network addons-675434 not found
	
	** /stderr **
	I0729 20:13:32.565992  140748 cli_runner.go:164] Run: docker network inspect bridge --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
	I0729 20:13:32.584131  140748 network.go:206] using free private subnet 192.168.49.0/24: &{IP:192.168.49.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.49.0/24 Gateway:192.168.49.1 ClientMin:192.168.49.2 ClientMax:192.168.49.254 Broadcast:192.168.49.255 IsPrivate:true Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:} reservation:0x4001aa3e80}
	I0729 20:13:32.584171  140748 network_create.go:124] attempt to create docker network addons-675434 192.168.49.0/24 with gateway 192.168.49.1 and MTU of 1500 ...
	I0729 20:13:32.584231  140748 cli_runner.go:164] Run: docker network create --driver=bridge --subnet=192.168.49.0/24 --gateway=192.168.49.1 -o --ip-masq -o --icc -o com.docker.network.driver.mtu=1500 --label=created_by.minikube.sigs.k8s.io=true --label=name.minikube.sigs.k8s.io=addons-675434 addons-675434
	I0729 20:13:32.658065  140748 network_create.go:108] docker network addons-675434 192.168.49.0/24 created
	I0729 20:13:32.658100  140748 kic.go:121] calculated static IP "192.168.49.2" for the "addons-675434" container
	I0729 20:13:32.658201  140748 cli_runner.go:164] Run: docker ps -a --format {{.Names}}
	I0729 20:13:32.674104  140748 cli_runner.go:164] Run: docker volume create addons-675434 --label name.minikube.sigs.k8s.io=addons-675434 --label created_by.minikube.sigs.k8s.io=true
	I0729 20:13:32.691312  140748 oci.go:103] Successfully created a docker volume addons-675434
	I0729 20:13:32.691418  140748 cli_runner.go:164] Run: docker run --rm --name addons-675434-preload-sidecar --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=addons-675434 --entrypoint /usr/bin/test -v addons-675434:/var gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721902582-19326@sha256:540fb5dc7f38be17ff5276a38dfe6c8a4b1d9ba1c27c62244e6eebd7e37696e7 -d /var/lib
	I0729 20:13:34.706261  140748 cli_runner.go:217] Completed: docker run --rm --name addons-675434-preload-sidecar --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=addons-675434 --entrypoint /usr/bin/test -v addons-675434:/var gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721902582-19326@sha256:540fb5dc7f38be17ff5276a38dfe6c8a4b1d9ba1c27c62244e6eebd7e37696e7 -d /var/lib: (2.014799601s)
	I0729 20:13:34.706292  140748 oci.go:107] Successfully prepared a docker volume addons-675434
	I0729 20:13:34.706310  140748 preload.go:131] Checking if preload exists for k8s version v1.30.3 and runtime containerd
	I0729 20:13:34.706329  140748 kic.go:194] Starting extracting preloaded images to volume ...
	I0729 20:13:34.706421  140748 cli_runner.go:164] Run: docker run --rm --entrypoint /usr/bin/tar -v /home/jenkins/minikube-integration/19339-134334/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.30.3-containerd-overlay2-arm64.tar.lz4:/preloaded.tar:ro -v addons-675434:/extractDir gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721902582-19326@sha256:540fb5dc7f38be17ff5276a38dfe6c8a4b1d9ba1c27c62244e6eebd7e37696e7 -I lz4 -xf /preloaded.tar -C /extractDir
	I0729 20:13:38.898051  140748 cli_runner.go:217] Completed: docker run --rm --entrypoint /usr/bin/tar -v /home/jenkins/minikube-integration/19339-134334/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.30.3-containerd-overlay2-arm64.tar.lz4:/preloaded.tar:ro -v addons-675434:/extractDir gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721902582-19326@sha256:540fb5dc7f38be17ff5276a38dfe6c8a4b1d9ba1c27c62244e6eebd7e37696e7 -I lz4 -xf /preloaded.tar -C /extractDir: (4.191577998s)
	I0729 20:13:38.898088  140748 kic.go:203] duration metric: took 4.191752788s to extract preloaded images to volume ...
	W0729 20:13:38.898278  140748 cgroups_linux.go:77] Your kernel does not support swap limit capabilities or the cgroup is not mounted.
	I0729 20:13:38.898452  140748 cli_runner.go:164] Run: docker info --format "'{{json .SecurityOptions}}'"
	I0729 20:13:38.956110  140748 cli_runner.go:164] Run: docker run -d -t --privileged --security-opt seccomp=unconfined --tmpfs /tmp --tmpfs /run -v /lib/modules:/lib/modules:ro --hostname addons-675434 --name addons-675434 --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=addons-675434 --label role.minikube.sigs.k8s.io= --label mode.minikube.sigs.k8s.io=addons-675434 --network addons-675434 --ip 192.168.49.2 --volume addons-675434:/var --security-opt apparmor=unconfined --memory=4000mb --cpus=2 -e container=docker --expose 8443 --publish=127.0.0.1::8443 --publish=127.0.0.1::22 --publish=127.0.0.1::2376 --publish=127.0.0.1::5000 --publish=127.0.0.1::32443 gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721902582-19326@sha256:540fb5dc7f38be17ff5276a38dfe6c8a4b1d9ba1c27c62244e6eebd7e37696e7
	I0729 20:13:39.276794  140748 cli_runner.go:164] Run: docker container inspect addons-675434 --format={{.State.Running}}
	I0729 20:13:39.295881  140748 cli_runner.go:164] Run: docker container inspect addons-675434 --format={{.State.Status}}
	I0729 20:13:39.327593  140748 cli_runner.go:164] Run: docker exec addons-675434 stat /var/lib/dpkg/alternatives/iptables
	I0729 20:13:39.401436  140748 oci.go:144] the created container "addons-675434" has a running status.
	I0729 20:13:39.401467  140748 kic.go:225] Creating ssh key for kic: /home/jenkins/minikube-integration/19339-134334/.minikube/machines/addons-675434/id_rsa...
	I0729 20:13:40.396215  140748 kic_runner.go:191] docker (temp): /home/jenkins/minikube-integration/19339-134334/.minikube/machines/addons-675434/id_rsa.pub --> /home/docker/.ssh/authorized_keys (381 bytes)
	I0729 20:13:40.421688  140748 cli_runner.go:164] Run: docker container inspect addons-675434 --format={{.State.Status}}
	I0729 20:13:40.444775  140748 kic_runner.go:93] Run: chown docker:docker /home/docker/.ssh/authorized_keys
	I0729 20:13:40.444812  140748 kic_runner.go:114] Args: [docker exec --privileged addons-675434 chown docker:docker /home/docker/.ssh/authorized_keys]
	I0729 20:13:40.502408  140748 cli_runner.go:164] Run: docker container inspect addons-675434 --format={{.State.Status}}
	I0729 20:13:40.518181  140748 machine.go:94] provisionDockerMachine start ...
	I0729 20:13:40.518277  140748 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-675434
	I0729 20:13:40.535226  140748 main.go:141] libmachine: Using SSH client type: native
	I0729 20:13:40.535517  140748 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x3e2cd0] 0x3e5530 <nil>  [] 0s} 127.0.0.1 37035 <nil> <nil>}
	I0729 20:13:40.535532  140748 main.go:141] libmachine: About to run SSH command:
	hostname
	I0729 20:13:40.667686  140748 main.go:141] libmachine: SSH cmd err, output: <nil>: addons-675434
	
	I0729 20:13:40.667712  140748 ubuntu.go:169] provisioning hostname "addons-675434"
	I0729 20:13:40.667779  140748 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-675434
	I0729 20:13:40.684679  140748 main.go:141] libmachine: Using SSH client type: native
	I0729 20:13:40.684943  140748 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x3e2cd0] 0x3e5530 <nil>  [] 0s} 127.0.0.1 37035 <nil> <nil>}
	I0729 20:13:40.684961  140748 main.go:141] libmachine: About to run SSH command:
	sudo hostname addons-675434 && echo "addons-675434" | sudo tee /etc/hostname
	I0729 20:13:40.827069  140748 main.go:141] libmachine: SSH cmd err, output: <nil>: addons-675434
	
	I0729 20:13:40.827150  140748 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-675434
	I0729 20:13:40.844221  140748 main.go:141] libmachine: Using SSH client type: native
	I0729 20:13:40.844469  140748 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x3e2cd0] 0x3e5530 <nil>  [] 0s} 127.0.0.1 37035 <nil> <nil>}
	I0729 20:13:40.844505  140748 main.go:141] libmachine: About to run SSH command:
	
			if ! grep -xq '.*\saddons-675434' /etc/hosts; then
				if grep -xq '127.0.1.1\s.*' /etc/hosts; then
					sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 addons-675434/g' /etc/hosts;
				else 
					echo '127.0.1.1 addons-675434' | sudo tee -a /etc/hosts; 
				fi
			fi
	I0729 20:13:40.975924  140748 main.go:141] libmachine: SSH cmd err, output: <nil>: 
	I0729 20:13:40.975951  140748 ubuntu.go:175] set auth options {CertDir:/home/jenkins/minikube-integration/19339-134334/.minikube CaCertPath:/home/jenkins/minikube-integration/19339-134334/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/19339-134334/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/19339-134334/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/19339-134334/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/19339-134334/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/19339-134334/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/19339-134334/.minikube}
	I0729 20:13:40.976000  140748 ubuntu.go:177] setting up certificates
	I0729 20:13:40.976015  140748 provision.go:84] configureAuth start
	I0729 20:13:40.976080  140748 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" addons-675434
	I0729 20:13:40.992237  140748 provision.go:143] copyHostCerts
	I0729 20:13:40.992315  140748 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19339-134334/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/19339-134334/.minikube/ca.pem (1078 bytes)
	I0729 20:13:40.992473  140748 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19339-134334/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/19339-134334/.minikube/cert.pem (1123 bytes)
	I0729 20:13:40.992550  140748 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19339-134334/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/19339-134334/.minikube/key.pem (1679 bytes)
	I0729 20:13:40.992609  140748 provision.go:117] generating server cert: /home/jenkins/minikube-integration/19339-134334/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/19339-134334/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/19339-134334/.minikube/certs/ca-key.pem org=jenkins.addons-675434 san=[127.0.0.1 192.168.49.2 addons-675434 localhost minikube]
	I0729 20:13:41.410930  140748 provision.go:177] copyRemoteCerts
	I0729 20:13:41.410999  140748 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
	I0729 20:13:41.411049  140748 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-675434
	I0729 20:13:41.427499  140748 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:37035 SSHKeyPath:/home/jenkins/minikube-integration/19339-134334/.minikube/machines/addons-675434/id_rsa Username:docker}
	I0729 20:13:41.521516  140748 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19339-134334/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1078 bytes)
	I0729 20:13:41.548194  140748 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19339-134334/.minikube/machines/server.pem --> /etc/docker/server.pem (1208 bytes)
	I0729 20:13:41.572286  140748 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19339-134334/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1675 bytes)
	I0729 20:13:41.595866  140748 provision.go:87] duration metric: took 619.834432ms to configureAuth
	I0729 20:13:41.595895  140748 ubuntu.go:193] setting minikube options for container-runtime
	I0729 20:13:41.596157  140748 config.go:182] Loaded profile config "addons-675434": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.30.3
	I0729 20:13:41.596176  140748 machine.go:97] duration metric: took 1.077976458s to provisionDockerMachine
	I0729 20:13:41.596183  140748 client.go:171] duration metric: took 9.839680527s to LocalClient.Create
	I0729 20:13:41.596202  140748 start.go:167] duration metric: took 9.839752181s to libmachine.API.Create "addons-675434"
	I0729 20:13:41.596215  140748 start.go:293] postStartSetup for "addons-675434" (driver="docker")
	I0729 20:13:41.596225  140748 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
	I0729 20:13:41.596281  140748 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
	I0729 20:13:41.596327  140748 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-675434
	I0729 20:13:41.612799  140748 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:37035 SSHKeyPath:/home/jenkins/minikube-integration/19339-134334/.minikube/machines/addons-675434/id_rsa Username:docker}
	I0729 20:13:41.709257  140748 ssh_runner.go:195] Run: cat /etc/os-release
	I0729 20:13:41.712292  140748 main.go:141] libmachine: Couldn't set key VERSION_CODENAME, no corresponding struct field found
	I0729 20:13:41.712334  140748 main.go:141] libmachine: Couldn't set key PRIVACY_POLICY_URL, no corresponding struct field found
	I0729 20:13:41.712346  140748 main.go:141] libmachine: Couldn't set key UBUNTU_CODENAME, no corresponding struct field found
	I0729 20:13:41.712353  140748 info.go:137] Remote host: Ubuntu 22.04.4 LTS
	I0729 20:13:41.712364  140748 filesync.go:126] Scanning /home/jenkins/minikube-integration/19339-134334/.minikube/addons for local assets ...
	I0729 20:13:41.712428  140748 filesync.go:126] Scanning /home/jenkins/minikube-integration/19339-134334/.minikube/files for local assets ...
	I0729 20:13:41.712461  140748 start.go:296] duration metric: took 116.240006ms for postStartSetup
	I0729 20:13:41.712786  140748 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" addons-675434
	I0729 20:13:41.729628  140748 profile.go:143] Saving config to /home/jenkins/minikube-integration/19339-134334/.minikube/profiles/addons-675434/config.json ...
	I0729 20:13:41.729927  140748 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
	I0729 20:13:41.729978  140748 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-675434
	I0729 20:13:41.746626  140748 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:37035 SSHKeyPath:/home/jenkins/minikube-integration/19339-134334/.minikube/machines/addons-675434/id_rsa Username:docker}
	I0729 20:13:41.841252  140748 ssh_runner.go:195] Run: sh -c "df -BG /var | awk 'NR==2{print $4}'"
	I0729 20:13:41.845752  140748 start.go:128] duration metric: took 10.091897148s to createHost
	I0729 20:13:41.845779  140748 start.go:83] releasing machines lock for "addons-675434", held for 10.092067409s
	I0729 20:13:41.845854  140748 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" addons-675434
	I0729 20:13:41.865826  140748 ssh_runner.go:195] Run: cat /version.json
	I0729 20:13:41.865884  140748 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-675434
	I0729 20:13:41.865932  140748 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/
	I0729 20:13:41.866011  140748 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-675434
	I0729 20:13:41.885467  140748 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:37035 SSHKeyPath:/home/jenkins/minikube-integration/19339-134334/.minikube/machines/addons-675434/id_rsa Username:docker}
	I0729 20:13:41.892113  140748 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:37035 SSHKeyPath:/home/jenkins/minikube-integration/19339-134334/.minikube/machines/addons-675434/id_rsa Username:docker}
	I0729 20:13:41.975355  140748 ssh_runner.go:195] Run: systemctl --version
	I0729 20:13:42.109262  140748 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"
	I0729 20:13:42.114595  140748 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f -name *loopback.conf* -not -name *.mk_disabled -exec sh -c "grep -q loopback {} && ( grep -q name {} || sudo sed -i '/"type": "loopback"/i \ \ \ \ "name": "loopback",' {} ) && sudo sed -i 's|"cniVersion": ".*"|"cniVersion": "1.0.0"|g' {}" ;
	I0729 20:13:42.145703  140748 cni.go:230] loopback cni configuration patched: "/etc/cni/net.d/*loopback.conf*" found
	I0729 20:13:42.145800  140748 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%!p(MISSING), " -exec sh -c "sudo mv {} {}.mk_disabled" ;
	I0729 20:13:42.179055  140748 cni.go:262] disabled [/etc/cni/net.d/87-podman-bridge.conflist, /etc/cni/net.d/100-crio-bridge.conf] bridge cni config(s)
	I0729 20:13:42.179129  140748 start.go:495] detecting cgroup driver to use...
	I0729 20:13:42.179181  140748 detect.go:187] detected "cgroupfs" cgroup driver on host os
	I0729 20:13:42.179265  140748 ssh_runner.go:195] Run: sudo systemctl stop -f crio
	I0729 20:13:42.194021  140748 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service crio
	I0729 20:13:42.207660  140748 docker.go:217] disabling cri-docker service (if available) ...
	I0729 20:13:42.207733  140748 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.socket
	I0729 20:13:42.223946  140748 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.service
	I0729 20:13:42.240533  140748 ssh_runner.go:195] Run: sudo systemctl disable cri-docker.socket
	I0729 20:13:42.346274  140748 ssh_runner.go:195] Run: sudo systemctl mask cri-docker.service
	I0729 20:13:42.447915  140748 docker.go:233] disabling docker service ...
	I0729 20:13:42.448022  140748 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket
	I0729 20:13:42.466955  140748 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service
	I0729 20:13:42.478683  140748 ssh_runner.go:195] Run: sudo systemctl disable docker.socket
	I0729 20:13:42.570183  140748 ssh_runner.go:195] Run: sudo systemctl mask docker.service
	I0729 20:13:42.657262  140748 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker
	I0729 20:13:42.668342  140748 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %!s(MISSING) "runtime-endpoint: unix:///run/containerd/containerd.sock
	" | sudo tee /etc/crictl.yaml"
	I0729 20:13:42.684669  140748 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)sandbox_image = .*$|\1sandbox_image = "registry.k8s.io/pause:3.9"|' /etc/containerd/config.toml"
	I0729 20:13:42.695223  140748 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)restrict_oom_score_adj = .*$|\1restrict_oom_score_adj = false|' /etc/containerd/config.toml"
	I0729 20:13:42.705908  140748 containerd.go:146] configuring containerd to use "cgroupfs" as cgroup driver...
	I0729 20:13:42.705976  140748 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)SystemdCgroup = .*$|\1SystemdCgroup = false|g' /etc/containerd/config.toml"
	I0729 20:13:42.716550  140748 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runtime.v1.linux"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"
	I0729 20:13:42.726790  140748 ssh_runner.go:195] Run: sh -c "sudo sed -i '/systemd_cgroup/d' /etc/containerd/config.toml"
	I0729 20:13:42.737203  140748 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runc.v1"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"
	I0729 20:13:42.746909  140748 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"
	I0729 20:13:42.757155  140748 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)conf_dir = .*$|\1conf_dir = "/etc/cni/net.d"|g' /etc/containerd/config.toml"
	I0729 20:13:42.766885  140748 ssh_runner.go:195] Run: sh -c "sudo sed -i '/^ *enable_unprivileged_ports = .*/d' /etc/containerd/config.toml"
	I0729 20:13:42.776484  140748 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)\[plugins."io.containerd.grpc.v1.cri"\]|&\n\1  enable_unprivileged_ports = true|' /etc/containerd/config.toml"
	I0729 20:13:42.786352  140748 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
	I0729 20:13:42.794982  140748 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
	I0729 20:13:42.803455  140748 ssh_runner.go:195] Run: sudo systemctl daemon-reload
	I0729 20:13:42.884401  140748 ssh_runner.go:195] Run: sudo systemctl restart containerd
	I0729 20:13:43.006580  140748 start.go:542] Will wait 60s for socket path /run/containerd/containerd.sock
	I0729 20:13:43.006698  140748 ssh_runner.go:195] Run: stat /run/containerd/containerd.sock
	I0729 20:13:43.010957  140748 start.go:563] Will wait 60s for crictl version
	I0729 20:13:43.011086  140748 ssh_runner.go:195] Run: which crictl
	I0729 20:13:43.014816  140748 ssh_runner.go:195] Run: sudo /usr/bin/crictl version
	I0729 20:13:43.051214  140748 start.go:579] Version:  0.1.0
	RuntimeName:  containerd
	RuntimeVersion:  1.7.19
	RuntimeApiVersion:  v1
	I0729 20:13:43.051360  140748 ssh_runner.go:195] Run: containerd --version
	I0729 20:13:43.078372  140748 ssh_runner.go:195] Run: containerd --version
	I0729 20:13:43.103456  140748 out.go:177] * Preparing Kubernetes v1.30.3 on containerd 1.7.19 ...
	I0729 20:13:43.105044  140748 cli_runner.go:164] Run: docker network inspect addons-675434 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
	I0729 20:13:43.120470  140748 ssh_runner.go:195] Run: grep 192.168.49.1	host.minikube.internal$ /etc/hosts
	I0729 20:13:43.124683  140748 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.49.1	host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
	I0729 20:13:43.136726  140748 kubeadm.go:883] updating cluster {Name:addons-675434 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721902582-19326@sha256:540fb5dc7f38be17ff5276a38dfe6c8a4b1d9ba1c27c62244e6eebd7e37696e7 Memory:4000 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.30.3 ClusterName:addons-675434 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNa
mes:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.49.2 Port:8443 KubernetesVersion:v1.30.3 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false Cus
tomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} ...
	I0729 20:13:43.136871  140748 preload.go:131] Checking if preload exists for k8s version v1.30.3 and runtime containerd
	I0729 20:13:43.136947  140748 ssh_runner.go:195] Run: sudo crictl images --output json
	I0729 20:13:43.173371  140748 containerd.go:627] all images are preloaded for containerd runtime.
	I0729 20:13:43.173397  140748 containerd.go:534] Images already preloaded, skipping extraction
	I0729 20:13:43.173461  140748 ssh_runner.go:195] Run: sudo crictl images --output json
	I0729 20:13:43.209289  140748 containerd.go:627] all images are preloaded for containerd runtime.
	I0729 20:13:43.209313  140748 cache_images.go:84] Images are preloaded, skipping loading
	I0729 20:13:43.209322  140748 kubeadm.go:934] updating node { 192.168.49.2 8443 v1.30.3 containerd true true} ...
	I0729 20:13:43.209433  140748 kubeadm.go:946] kubelet [Unit]
	Wants=containerd.service
	
	[Service]
	ExecStart=
	ExecStart=/var/lib/minikube/binaries/v1.30.3/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --hostname-override=addons-675434 --kubeconfig=/etc/kubernetes/kubelet.conf --node-ip=192.168.49.2
	
	[Install]
	 config:
	{KubernetesVersion:v1.30.3 ClusterName:addons-675434 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:}
	I0729 20:13:43.209510  140748 ssh_runner.go:195] Run: sudo crictl info
	I0729 20:13:43.245033  140748 cni.go:84] Creating CNI manager for ""
	I0729 20:13:43.245057  140748 cni.go:143] "docker" driver + "containerd" runtime found, recommending kindnet
	I0729 20:13:43.245067  140748 kubeadm.go:84] Using pod CIDR: 10.244.0.0/16
	I0729 20:13:43.245089  140748 kubeadm.go:181] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.49.2 APIServerPort:8443 KubernetesVersion:v1.30.3 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:addons-675434 NodeName:addons-675434 DNSDomain:cluster.local CRISocket:/run/containerd/containerd.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.49.2"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.49.2 CgroupDriver:cgroupfs ClientCAFile:/var/lib/minikube/certs/ca.crt StaticPodPath:/etc
/kubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[containerRuntimeEndpoint:unix:///run/containerd/containerd.sock hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:true}
	I0729 20:13:43.245227  140748 kubeadm.go:187] kubeadm config:
	apiVersion: kubeadm.k8s.io/v1beta3
	kind: InitConfiguration
	localAPIEndpoint:
	  advertiseAddress: 192.168.49.2
	  bindPort: 8443
	bootstrapTokens:
	  - groups:
	      - system:bootstrappers:kubeadm:default-node-token
	    ttl: 24h0m0s
	    usages:
	      - signing
	      - authentication
	nodeRegistration:
	  criSocket: unix:///run/containerd/containerd.sock
	  name: "addons-675434"
	  kubeletExtraArgs:
	    node-ip: 192.168.49.2
	  taints: []
	---
	apiVersion: kubeadm.k8s.io/v1beta3
	kind: ClusterConfiguration
	apiServer:
	  certSANs: ["127.0.0.1", "localhost", "192.168.49.2"]
	  extraArgs:
	    enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"
	controllerManager:
	  extraArgs:
	    allocate-node-cidrs: "true"
	    leader-elect: "false"
	scheduler:
	  extraArgs:
	    leader-elect: "false"
	certificatesDir: /var/lib/minikube/certs
	clusterName: mk
	controlPlaneEndpoint: control-plane.minikube.internal:8443
	etcd:
	  local:
	    dataDir: /var/lib/minikube/etcd
	    extraArgs:
	      proxy-refresh-interval: "70000"
	kubernetesVersion: v1.30.3
	networking:
	  dnsDomain: cluster.local
	  podSubnet: "10.244.0.0/16"
	  serviceSubnet: 10.96.0.0/12
	---
	apiVersion: kubelet.config.k8s.io/v1beta1
	kind: KubeletConfiguration
	authentication:
	  x509:
	    clientCAFile: /var/lib/minikube/certs/ca.crt
	cgroupDriver: cgroupfs
	containerRuntimeEndpoint: unix:///run/containerd/containerd.sock
	hairpinMode: hairpin-veth
	runtimeRequestTimeout: 15m
	clusterDomain: "cluster.local"
	# disable disk resource management by default
	imageGCHighThresholdPercent: 100
	evictionHard:
	  nodefs.available: "0%!"(MISSING)
	  nodefs.inodesFree: "0%!"(MISSING)
	  imagefs.available: "0%!"(MISSING)
	failSwapOn: false
	staticPodPath: /etc/kubernetes/manifests
	---
	apiVersion: kubeproxy.config.k8s.io/v1alpha1
	kind: KubeProxyConfiguration
	clusterCIDR: "10.244.0.0/16"
	metricsBindAddress: 0.0.0.0:10249
	conntrack:
	  maxPerCore: 0
	# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"
	  tcpEstablishedTimeout: 0s
	# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"
	  tcpCloseWaitTimeout: 0s
	
	I0729 20:13:43.245300  140748 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.30.3
	I0729 20:13:43.254185  140748 binaries.go:44] Found k8s binaries, skipping transfer
	I0729 20:13:43.254286  140748 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube
	I0729 20:13:43.263139  140748 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (317 bytes)
	I0729 20:13:43.282387  140748 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)
	I0729 20:13:43.300496  140748 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2167 bytes)
	I0729 20:13:43.318864  140748 ssh_runner.go:195] Run: grep 192.168.49.2	control-plane.minikube.internal$ /etc/hosts
	I0729 20:13:43.322143  140748 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.49.2	control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
	I0729 20:13:43.333144  140748 ssh_runner.go:195] Run: sudo systemctl daemon-reload
	I0729 20:13:43.426276  140748 ssh_runner.go:195] Run: sudo systemctl start kubelet
	I0729 20:13:43.440468  140748 certs.go:68] Setting up /home/jenkins/minikube-integration/19339-134334/.minikube/profiles/addons-675434 for IP: 192.168.49.2
	I0729 20:13:43.440492  140748 certs.go:194] generating shared ca certs ...
	I0729 20:13:43.440519  140748 certs.go:226] acquiring lock for ca certs: {Name:mk3aee57cd6443b182ded24fc10ff956bd250ae4 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0729 20:13:43.441240  140748 certs.go:240] generating "minikubeCA" ca cert: /home/jenkins/minikube-integration/19339-134334/.minikube/ca.key
	I0729 20:13:43.953452  140748 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19339-134334/.minikube/ca.crt ...
	I0729 20:13:43.953498  140748 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19339-134334/.minikube/ca.crt: {Name:mk614a00e7bb3c235c233e9a9af217a06c66e383 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0729 20:13:43.954232  140748 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19339-134334/.minikube/ca.key ...
	I0729 20:13:43.954248  140748 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19339-134334/.minikube/ca.key: {Name:mkfcbbcb330d208ca95ec3255379c52447e5f0f5 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0729 20:13:43.954350  140748 certs.go:240] generating "proxyClientCA" ca cert: /home/jenkins/minikube-integration/19339-134334/.minikube/proxy-client-ca.key
	I0729 20:13:44.251039  140748 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19339-134334/.minikube/proxy-client-ca.crt ...
	I0729 20:13:44.251075  140748 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19339-134334/.minikube/proxy-client-ca.crt: {Name:mka841cdea59c67c7e1ca037b102cc9e072ccdab Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0729 20:13:44.251309  140748 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19339-134334/.minikube/proxy-client-ca.key ...
	I0729 20:13:44.251326  140748 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19339-134334/.minikube/proxy-client-ca.key: {Name:mkeb804af711d484cb8db7b935afb86e5e1ed52d Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0729 20:13:44.251907  140748 certs.go:256] generating profile certs ...
	I0729 20:13:44.252000  140748 certs.go:363] generating signed profile cert for "minikube-user": /home/jenkins/minikube-integration/19339-134334/.minikube/profiles/addons-675434/client.key
	I0729 20:13:44.252018  140748 crypto.go:68] Generating cert /home/jenkins/minikube-integration/19339-134334/.minikube/profiles/addons-675434/client.crt with IP's: []
	I0729 20:13:44.480176  140748 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19339-134334/.minikube/profiles/addons-675434/client.crt ...
	I0729 20:13:44.480207  140748 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19339-134334/.minikube/profiles/addons-675434/client.crt: {Name:mkb2c0f1aa678247b26f158044287ba3995d2bd4 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0729 20:13:44.480402  140748 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19339-134334/.minikube/profiles/addons-675434/client.key ...
	I0729 20:13:44.480419  140748 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19339-134334/.minikube/profiles/addons-675434/client.key: {Name:mk282b4555e8ed52897b4b4b386eb216699bfca6 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0729 20:13:44.480902  140748 certs.go:363] generating signed profile cert for "minikube": /home/jenkins/minikube-integration/19339-134334/.minikube/profiles/addons-675434/apiserver.key.7a410823
	I0729 20:13:44.480929  140748 crypto.go:68] Generating cert /home/jenkins/minikube-integration/19339-134334/.minikube/profiles/addons-675434/apiserver.crt.7a410823 with IP's: [10.96.0.1 127.0.0.1 10.0.0.1 192.168.49.2]
	I0729 20:13:45.280766  140748 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19339-134334/.minikube/profiles/addons-675434/apiserver.crt.7a410823 ...
	I0729 20:13:45.280799  140748 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19339-134334/.minikube/profiles/addons-675434/apiserver.crt.7a410823: {Name:mkcf6780325d7b18d81ace0af876a8d857f174da Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0729 20:13:45.281433  140748 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19339-134334/.minikube/profiles/addons-675434/apiserver.key.7a410823 ...
	I0729 20:13:45.281460  140748 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19339-134334/.minikube/profiles/addons-675434/apiserver.key.7a410823: {Name:mk752a24323566a1c80856d97fdbb9ca3a008533 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0729 20:13:45.281953  140748 certs.go:381] copying /home/jenkins/minikube-integration/19339-134334/.minikube/profiles/addons-675434/apiserver.crt.7a410823 -> /home/jenkins/minikube-integration/19339-134334/.minikube/profiles/addons-675434/apiserver.crt
	I0729 20:13:45.282084  140748 certs.go:385] copying /home/jenkins/minikube-integration/19339-134334/.minikube/profiles/addons-675434/apiserver.key.7a410823 -> /home/jenkins/minikube-integration/19339-134334/.minikube/profiles/addons-675434/apiserver.key
	I0729 20:13:45.282153  140748 certs.go:363] generating signed profile cert for "aggregator": /home/jenkins/minikube-integration/19339-134334/.minikube/profiles/addons-675434/proxy-client.key
	I0729 20:13:45.282180  140748 crypto.go:68] Generating cert /home/jenkins/minikube-integration/19339-134334/.minikube/profiles/addons-675434/proxy-client.crt with IP's: []
	I0729 20:13:45.923348  140748 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19339-134334/.minikube/profiles/addons-675434/proxy-client.crt ...
	I0729 20:13:45.923383  140748 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19339-134334/.minikube/profiles/addons-675434/proxy-client.crt: {Name:mk1e4cbc3236af8d834f6744133a30e2a715f395 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0729 20:13:45.923576  140748 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19339-134334/.minikube/profiles/addons-675434/proxy-client.key ...
	I0729 20:13:45.923592  140748 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19339-134334/.minikube/profiles/addons-675434/proxy-client.key: {Name:mk5a4b275d0d414e0861357f48643fc79e070433 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0729 20:13:45.923789  140748 certs.go:484] found cert: /home/jenkins/minikube-integration/19339-134334/.minikube/certs/ca-key.pem (1675 bytes)
	I0729 20:13:45.923881  140748 certs.go:484] found cert: /home/jenkins/minikube-integration/19339-134334/.minikube/certs/ca.pem (1078 bytes)
	I0729 20:13:45.923912  140748 certs.go:484] found cert: /home/jenkins/minikube-integration/19339-134334/.minikube/certs/cert.pem (1123 bytes)
	I0729 20:13:45.923941  140748 certs.go:484] found cert: /home/jenkins/minikube-integration/19339-134334/.minikube/certs/key.pem (1679 bytes)
	I0729 20:13:45.924603  140748 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19339-134334/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
	I0729 20:13:45.950497  140748 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19339-134334/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1679 bytes)
	I0729 20:13:45.974805  140748 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19339-134334/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
	I0729 20:13:45.998919  140748 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19339-134334/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1679 bytes)
	I0729 20:13:46.025973  140748 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19339-134334/.minikube/profiles/addons-675434/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1419 bytes)
	I0729 20:13:46.050493  140748 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19339-134334/.minikube/profiles/addons-675434/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1675 bytes)
	I0729 20:13:46.075353  140748 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19339-134334/.minikube/profiles/addons-675434/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
	I0729 20:13:46.099256  140748 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19339-134334/.minikube/profiles/addons-675434/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1675 bytes)
	I0729 20:13:46.123559  140748 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19339-134334/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
	I0729 20:13:46.148319  140748 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)
	I0729 20:13:46.166552  140748 ssh_runner.go:195] Run: openssl version
	I0729 20:13:46.172113  140748 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
	I0729 20:13:46.181754  140748 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
	I0729 20:13:46.185535  140748 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 Jul 29 20:13 /usr/share/ca-certificates/minikubeCA.pem
	I0729 20:13:46.185606  140748 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
	I0729 20:13:46.192705  140748 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
	I0729 20:13:46.202304  140748 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt
	I0729 20:13:46.205703  140748 certs.go:399] 'apiserver-kubelet-client' cert doesn't exist, likely first start: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt: Process exited with status 1
	stdout:
	
	stderr:
	stat: cannot statx '/var/lib/minikube/certs/apiserver-kubelet-client.crt': No such file or directory
	I0729 20:13:46.205753  140748 kubeadm.go:392] StartCluster: {Name:addons-675434 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721902582-19326@sha256:540fb5dc7f38be17ff5276a38dfe6c8a4b1d9ba1c27c62244e6eebd7e37696e7 Memory:4000 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.30.3 ClusterName:addons-675434 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames
:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.49.2 Port:8443 KubernetesVersion:v1.30.3 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false Custom
QemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I0729 20:13:46.205839  140748 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:paused Name: Namespaces:[kube-system]}
	I0729 20:13:46.205898  140748 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"
	I0729 20:13:46.241652  140748 cri.go:89] found id: ""
	I0729 20:13:46.241783  140748 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd
	I0729 20:13:46.250604  140748 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml
	I0729 20:13:46.259423  140748 kubeadm.go:214] ignoring SystemVerification for kubeadm because of docker driver
	I0729 20:13:46.259514  140748 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
	I0729 20:13:46.268408  140748 kubeadm.go:155] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
	stdout:
	
	stderr:
	ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
	ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
	ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
	ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
	I0729 20:13:46.268428  140748 kubeadm.go:157] found existing configuration files:
	
	I0729 20:13:46.268481  140748 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf
	I0729 20:13:46.277051  140748 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/admin.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf: Process exited with status 2
	stdout:
	
	stderr:
	grep: /etc/kubernetes/admin.conf: No such file or directory
	I0729 20:13:46.277125  140748 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/admin.conf
	I0729 20:13:46.285667  140748 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf
	I0729 20:13:46.294271  140748 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/kubelet.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf: Process exited with status 2
	stdout:
	
	stderr:
	grep: /etc/kubernetes/kubelet.conf: No such file or directory
	I0729 20:13:46.294338  140748 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/kubelet.conf
	I0729 20:13:46.302532  140748 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf
	I0729 20:13:46.311098  140748 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/controller-manager.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf: Process exited with status 2
	stdout:
	
	stderr:
	grep: /etc/kubernetes/controller-manager.conf: No such file or directory
	I0729 20:13:46.311182  140748 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/controller-manager.conf
	I0729 20:13:46.319567  140748 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf
	I0729 20:13:46.328042  140748 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/scheduler.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf: Process exited with status 2
	stdout:
	
	stderr:
	grep: /etc/kubernetes/scheduler.conf: No such file or directory
	I0729 20:13:46.328147  140748 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/scheduler.conf
	I0729 20:13:46.336199  140748 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.30.3:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml  --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem,SystemVerification,FileContent--proc-sys-net-bridge-bridge-nf-call-iptables"
	I0729 20:13:46.425719  140748 kubeadm.go:310] 	[WARNING SystemVerification]: failed to parse kernel config: unable to load kernel module: "configs", output: "modprobe: FATAL: Module configs not found in directory /lib/modules/5.15.0-1065-aws\n", err: exit status 1
	I0729 20:13:46.495828  140748 kubeadm.go:310] 	[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
	I0729 20:14:02.938049  140748 kubeadm.go:310] [init] Using Kubernetes version: v1.30.3
	I0729 20:14:02.938118  140748 kubeadm.go:310] [preflight] Running pre-flight checks
	I0729 20:14:02.938213  140748 kubeadm.go:310] [preflight] The system verification failed. Printing the output from the verification:
	I0729 20:14:02.938269  140748 kubeadm.go:310] KERNEL_VERSION: 5.15.0-1065-aws
	I0729 20:14:02.938303  140748 kubeadm.go:310] OS: Linux
	I0729 20:14:02.938356  140748 kubeadm.go:310] CGROUPS_CPU: enabled
	I0729 20:14:02.938415  140748 kubeadm.go:310] CGROUPS_CPUACCT: enabled
	I0729 20:14:02.938475  140748 kubeadm.go:310] CGROUPS_CPUSET: enabled
	I0729 20:14:02.938532  140748 kubeadm.go:310] CGROUPS_DEVICES: enabled
	I0729 20:14:02.938594  140748 kubeadm.go:310] CGROUPS_FREEZER: enabled
	I0729 20:14:02.938663  140748 kubeadm.go:310] CGROUPS_MEMORY: enabled
	I0729 20:14:02.938710  140748 kubeadm.go:310] CGROUPS_PIDS: enabled
	I0729 20:14:02.938762  140748 kubeadm.go:310] CGROUPS_HUGETLB: enabled
	I0729 20:14:02.938820  140748 kubeadm.go:310] CGROUPS_BLKIO: enabled
	I0729 20:14:02.938901  140748 kubeadm.go:310] [preflight] Pulling images required for setting up a Kubernetes cluster
	I0729 20:14:02.939003  140748 kubeadm.go:310] [preflight] This might take a minute or two, depending on the speed of your internet connection
	I0729 20:14:02.939105  140748 kubeadm.go:310] [preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
	I0729 20:14:02.939183  140748 kubeadm.go:310] [certs] Using certificateDir folder "/var/lib/minikube/certs"
	I0729 20:14:02.941270  140748 out.go:204]   - Generating certificates and keys ...
	I0729 20:14:02.941376  140748 kubeadm.go:310] [certs] Using existing ca certificate authority
	I0729 20:14:02.941447  140748 kubeadm.go:310] [certs] Using existing apiserver certificate and key on disk
	I0729 20:14:02.941519  140748 kubeadm.go:310] [certs] Generating "apiserver-kubelet-client" certificate and key
	I0729 20:14:02.941585  140748 kubeadm.go:310] [certs] Generating "front-proxy-ca" certificate and key
	I0729 20:14:02.941663  140748 kubeadm.go:310] [certs] Generating "front-proxy-client" certificate and key
	I0729 20:14:02.941717  140748 kubeadm.go:310] [certs] Generating "etcd/ca" certificate and key
	I0729 20:14:02.941774  140748 kubeadm.go:310] [certs] Generating "etcd/server" certificate and key
	I0729 20:14:02.941900  140748 kubeadm.go:310] [certs] etcd/server serving cert is signed for DNS names [addons-675434 localhost] and IPs [192.168.49.2 127.0.0.1 ::1]
	I0729 20:14:02.941955  140748 kubeadm.go:310] [certs] Generating "etcd/peer" certificate and key
	I0729 20:14:02.942074  140748 kubeadm.go:310] [certs] etcd/peer serving cert is signed for DNS names [addons-675434 localhost] and IPs [192.168.49.2 127.0.0.1 ::1]
	I0729 20:14:02.942151  140748 kubeadm.go:310] [certs] Generating "etcd/healthcheck-client" certificate and key
	I0729 20:14:02.942230  140748 kubeadm.go:310] [certs] Generating "apiserver-etcd-client" certificate and key
	I0729 20:14:02.942275  140748 kubeadm.go:310] [certs] Generating "sa" key and public key
	I0729 20:14:02.942345  140748 kubeadm.go:310] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"
	I0729 20:14:02.942397  140748 kubeadm.go:310] [kubeconfig] Writing "admin.conf" kubeconfig file
	I0729 20:14:02.942461  140748 kubeadm.go:310] [kubeconfig] Writing "super-admin.conf" kubeconfig file
	I0729 20:14:02.942522  140748 kubeadm.go:310] [kubeconfig] Writing "kubelet.conf" kubeconfig file
	I0729 20:14:02.942586  140748 kubeadm.go:310] [kubeconfig] Writing "controller-manager.conf" kubeconfig file
	I0729 20:14:02.942650  140748 kubeadm.go:310] [kubeconfig] Writing "scheduler.conf" kubeconfig file
	I0729 20:14:02.942742  140748 kubeadm.go:310] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
	I0729 20:14:02.942809  140748 kubeadm.go:310] [control-plane] Using manifest folder "/etc/kubernetes/manifests"
	I0729 20:14:02.944924  140748 out.go:204]   - Booting up control plane ...
	I0729 20:14:02.945052  140748 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-apiserver"
	I0729 20:14:02.945163  140748 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-controller-manager"
	I0729 20:14:02.945242  140748 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-scheduler"
	I0729 20:14:02.945349  140748 kubeadm.go:310] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
	I0729 20:14:02.945438  140748 kubeadm.go:310] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
	I0729 20:14:02.945479  140748 kubeadm.go:310] [kubelet-start] Starting the kubelet
	I0729 20:14:02.945609  140748 kubeadm.go:310] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests"
	I0729 20:14:02.945693  140748 kubeadm.go:310] [kubelet-check] Waiting for a healthy kubelet. This can take up to 4m0s
	I0729 20:14:02.945769  140748 kubeadm.go:310] [kubelet-check] The kubelet is healthy after 1.501496004s
	I0729 20:14:02.945843  140748 kubeadm.go:310] [api-check] Waiting for a healthy API server. This can take up to 4m0s
	I0729 20:14:02.945903  140748 kubeadm.go:310] [api-check] The API server is healthy after 6.501646854s
	I0729 20:14:02.946012  140748 kubeadm.go:310] [upload-config] Storing the configuration used in ConfigMap "kubeadm-config" in the "kube-system" Namespace
	I0729 20:14:02.946141  140748 kubeadm.go:310] [kubelet] Creating a ConfigMap "kubelet-config" in namespace kube-system with the configuration for the kubelets in the cluster
	I0729 20:14:02.946216  140748 kubeadm.go:310] [upload-certs] Skipping phase. Please see --upload-certs
	I0729 20:14:02.946425  140748 kubeadm.go:310] [mark-control-plane] Marking the node addons-675434 as control-plane by adding the labels: [node-role.kubernetes.io/control-plane node.kubernetes.io/exclude-from-external-load-balancers]
	I0729 20:14:02.946503  140748 kubeadm.go:310] [bootstrap-token] Using token: fj9ubq.rwf37r5r0lj176lk
	I0729 20:14:02.948977  140748 out.go:204]   - Configuring RBAC rules ...
	I0729 20:14:02.949136  140748 kubeadm.go:310] [bootstrap-token] Configuring bootstrap tokens, cluster-info ConfigMap, RBAC Roles
	I0729 20:14:02.949260  140748 kubeadm.go:310] [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to get nodes
	I0729 20:14:02.949450  140748 kubeadm.go:310] [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to post CSRs in order for nodes to get long term certificate credentials
	I0729 20:14:02.949587  140748 kubeadm.go:310] [bootstrap-token] Configured RBAC rules to allow the csrapprover controller automatically approve CSRs from a Node Bootstrap Token
	I0729 20:14:02.949714  140748 kubeadm.go:310] [bootstrap-token] Configured RBAC rules to allow certificate rotation for all node client certificates in the cluster
	I0729 20:14:02.949800  140748 kubeadm.go:310] [bootstrap-token] Creating the "cluster-info" ConfigMap in the "kube-public" namespace
	I0729 20:14:02.949914  140748 kubeadm.go:310] [kubelet-finalize] Updating "/etc/kubernetes/kubelet.conf" to point to a rotatable kubelet client certificate and key
	I0729 20:14:02.949964  140748 kubeadm.go:310] [addons] Applied essential addon: CoreDNS
	I0729 20:14:02.950012  140748 kubeadm.go:310] [addons] Applied essential addon: kube-proxy
	I0729 20:14:02.950020  140748 kubeadm.go:310] 
	I0729 20:14:02.950078  140748 kubeadm.go:310] Your Kubernetes control-plane has initialized successfully!
	I0729 20:14:02.950091  140748 kubeadm.go:310] 
	I0729 20:14:02.950165  140748 kubeadm.go:310] To start using your cluster, you need to run the following as a regular user:
	I0729 20:14:02.950173  140748 kubeadm.go:310] 
	I0729 20:14:02.950202  140748 kubeadm.go:310]   mkdir -p $HOME/.kube
	I0729 20:14:02.950282  140748 kubeadm.go:310]   sudo cp -i /etc/kubernetes/admin.conf $HOME/.kube/config
	I0729 20:14:02.950341  140748 kubeadm.go:310]   sudo chown $(id -u):$(id -g) $HOME/.kube/config
	I0729 20:14:02.950349  140748 kubeadm.go:310] 
	I0729 20:14:02.950420  140748 kubeadm.go:310] Alternatively, if you are the root user, you can run:
	I0729 20:14:02.950446  140748 kubeadm.go:310] 
	I0729 20:14:02.950506  140748 kubeadm.go:310]   export KUBECONFIG=/etc/kubernetes/admin.conf
	I0729 20:14:02.950521  140748 kubeadm.go:310] 
	I0729 20:14:02.950579  140748 kubeadm.go:310] You should now deploy a pod network to the cluster.
	I0729 20:14:02.950664  140748 kubeadm.go:310] Run "kubectl apply -f [podnetwork].yaml" with one of the options listed at:
	I0729 20:14:02.950771  140748 kubeadm.go:310]   https://kubernetes.io/docs/concepts/cluster-administration/addons/
	I0729 20:14:02.950793  140748 kubeadm.go:310] 
	I0729 20:14:02.950879  140748 kubeadm.go:310] You can now join any number of control-plane nodes by copying certificate authorities
	I0729 20:14:02.950957  140748 kubeadm.go:310] and service account keys on each node and then running the following as root:
	I0729 20:14:02.950965  140748 kubeadm.go:310] 
	I0729 20:14:02.951046  140748 kubeadm.go:310]   kubeadm join control-plane.minikube.internal:8443 --token fj9ubq.rwf37r5r0lj176lk \
	I0729 20:14:02.951152  140748 kubeadm.go:310] 	--discovery-token-ca-cert-hash sha256:7c36d57f63d64bb2286daf6ade52bba8177bb251cba63f76ff5f373ddebae3f4 \
	I0729 20:14:02.951177  140748 kubeadm.go:310] 	--control-plane 
	I0729 20:14:02.951182  140748 kubeadm.go:310] 
	I0729 20:14:02.951266  140748 kubeadm.go:310] Then you can join any number of worker nodes by running the following on each as root:
	I0729 20:14:02.951275  140748 kubeadm.go:310] 
	I0729 20:14:02.951354  140748 kubeadm.go:310] kubeadm join control-plane.minikube.internal:8443 --token fj9ubq.rwf37r5r0lj176lk \
	I0729 20:14:02.951468  140748 kubeadm.go:310] 	--discovery-token-ca-cert-hash sha256:7c36d57f63d64bb2286daf6ade52bba8177bb251cba63f76ff5f373ddebae3f4 
	I0729 20:14:02.951487  140748 cni.go:84] Creating CNI manager for ""
	I0729 20:14:02.951495  140748 cni.go:143] "docker" driver + "containerd" runtime found, recommending kindnet
	I0729 20:14:02.954438  140748 out.go:177] * Configuring CNI (Container Networking Interface) ...
	I0729 20:14:02.956312  140748 ssh_runner.go:195] Run: stat /opt/cni/bin/portmap
	I0729 20:14:02.960130  140748 cni.go:182] applying CNI manifest using /var/lib/minikube/binaries/v1.30.3/kubectl ...
	I0729 20:14:02.960151  140748 ssh_runner.go:362] scp memory --> /var/tmp/minikube/cni.yaml (2438 bytes)
	I0729 20:14:02.978462  140748 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.3/kubectl apply --kubeconfig=/var/lib/minikube/kubeconfig -f /var/tmp/minikube/cni.yaml
	I0729 20:14:03.233565  140748 ssh_runner.go:195] Run: /bin/bash -c "cat /proc/$(pgrep kube-apiserver)/oom_adj"
	I0729 20:14:03.233714  140748 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.3/kubectl create clusterrolebinding minikube-rbac --clusterrole=cluster-admin --serviceaccount=kube-system:default --kubeconfig=/var/lib/minikube/kubeconfig
	I0729 20:14:03.233818  140748 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.3/kubectl --kubeconfig=/var/lib/minikube/kubeconfig label --overwrite nodes addons-675434 minikube.k8s.io/updated_at=2024_07_29T20_14_03_0700 minikube.k8s.io/version=v1.33.1 minikube.k8s.io/commit=de53afae5e8f4269438099f4dad14d93a8a17e35 minikube.k8s.io/name=addons-675434 minikube.k8s.io/primary=true
	I0729 20:14:03.435841  140748 ops.go:34] apiserver oom_adj: -16
	I0729 20:14:03.435930  140748 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0729 20:14:03.936449  140748 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0729 20:14:04.436143  140748 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0729 20:14:04.936362  140748 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0729 20:14:05.436656  140748 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0729 20:14:05.936896  140748 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0729 20:14:06.436689  140748 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0729 20:14:06.936732  140748 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0729 20:14:07.436096  140748 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0729 20:14:07.936210  140748 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0729 20:14:08.436395  140748 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0729 20:14:08.937075  140748 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0729 20:14:09.437013  140748 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0729 20:14:09.936985  140748 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0729 20:14:10.436633  140748 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0729 20:14:10.936036  140748 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0729 20:14:11.436881  140748 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0729 20:14:11.936112  140748 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0729 20:14:12.436855  140748 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0729 20:14:12.936093  140748 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0729 20:14:13.436880  140748 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0729 20:14:13.936721  140748 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0729 20:14:14.436102  140748 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0729 20:14:14.936975  140748 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0729 20:14:15.436820  140748 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0729 20:14:15.936101  140748 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0729 20:14:16.077576  140748 kubeadm.go:1113] duration metric: took 12.843916115s to wait for elevateKubeSystemPrivileges
	I0729 20:14:16.077603  140748 kubeadm.go:394] duration metric: took 29.871855432s to StartCluster
	I0729 20:14:16.077619  140748 settings.go:142] acquiring lock: {Name:mk81a3d209173dd596c551ea10229601901fa17b Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0729 20:14:16.078077  140748 settings.go:150] Updating kubeconfig:  /home/jenkins/minikube-integration/19339-134334/kubeconfig
	I0729 20:14:16.078463  140748 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19339-134334/kubeconfig: {Name:mkb30bb25d5aba25f4f65bf257c4658c6f12d204 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0729 20:14:16.079201  140748 start.go:235] Will wait 6m0s for node &{Name: IP:192.168.49.2 Port:8443 KubernetesVersion:v1.30.3 ContainerRuntime:containerd ControlPlane:true Worker:true}
	I0729 20:14:16.079295  140748 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.30.3/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml"
	I0729 20:14:16.079551  140748 config.go:182] Loaded profile config "addons-675434": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.30.3
	I0729 20:14:16.079580  140748 addons.go:507] enable addons start: toEnable=map[ambassador:false auto-pause:false cloud-spanner:true csi-hostpath-driver:true dashboard:false default-storageclass:true efk:false freshpod:false gcp-auth:true gvisor:false headlamp:false helm-tiller:false inaccel:false ingress:true ingress-dns:true inspektor-gadget:true istio:false istio-provisioner:false kong:false kubeflow:false kubevirt:false logviewer:false metallb:false metrics-server:true nvidia-device-plugin:true nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:true registry-aliases:false registry-creds:false storage-provisioner:true storage-provisioner-gluster:false storage-provisioner-rancher:true volcano:true volumesnapshots:true yakd:true]
	I0729 20:14:16.079653  140748 addons.go:69] Setting yakd=true in profile "addons-675434"
	I0729 20:14:16.079674  140748 addons.go:234] Setting addon yakd=true in "addons-675434"
	I0729 20:14:16.079698  140748 host.go:66] Checking if "addons-675434" exists ...
	I0729 20:14:16.080190  140748 cli_runner.go:164] Run: docker container inspect addons-675434 --format={{.State.Status}}
	I0729 20:14:16.080703  140748 addons.go:69] Setting cloud-spanner=true in profile "addons-675434"
	I0729 20:14:16.080745  140748 addons.go:234] Setting addon cloud-spanner=true in "addons-675434"
	I0729 20:14:16.080778  140748 host.go:66] Checking if "addons-675434" exists ...
	I0729 20:14:16.080767  140748 addons.go:69] Setting csi-hostpath-driver=true in profile "addons-675434"
	I0729 20:14:16.080844  140748 addons.go:234] Setting addon csi-hostpath-driver=true in "addons-675434"
	I0729 20:14:16.080895  140748 host.go:66] Checking if "addons-675434" exists ...
	I0729 20:14:16.081221  140748 cli_runner.go:164] Run: docker container inspect addons-675434 --format={{.State.Status}}
	I0729 20:14:16.081397  140748 cli_runner.go:164] Run: docker container inspect addons-675434 --format={{.State.Status}}
	I0729 20:14:16.080715  140748 addons.go:69] Setting nvidia-device-plugin=true in profile "addons-675434"
	I0729 20:14:16.084190  140748 addons.go:234] Setting addon nvidia-device-plugin=true in "addons-675434"
	I0729 20:14:16.084263  140748 host.go:66] Checking if "addons-675434" exists ...
	I0729 20:14:16.085779  140748 addons.go:69] Setting default-storageclass=true in profile "addons-675434"
	I0729 20:14:16.086598  140748 addons_storage_classes.go:33] enableOrDisableStorageClasses default-storageclass=true on "addons-675434"
	I0729 20:14:16.086890  140748 cli_runner.go:164] Run: docker container inspect addons-675434 --format={{.State.Status}}
	I0729 20:14:16.087844  140748 addons.go:69] Setting registry=true in profile "addons-675434"
	I0729 20:14:16.087916  140748 addons.go:234] Setting addon registry=true in "addons-675434"
	I0729 20:14:16.088011  140748 host.go:66] Checking if "addons-675434" exists ...
	I0729 20:14:16.088497  140748 cli_runner.go:164] Run: docker container inspect addons-675434 --format={{.State.Status}}
	I0729 20:14:16.103192  140748 addons.go:69] Setting storage-provisioner=true in profile "addons-675434"
	I0729 20:14:16.103243  140748 addons.go:234] Setting addon storage-provisioner=true in "addons-675434"
	I0729 20:14:16.103267  140748 out.go:177] * Verifying Kubernetes components...
	I0729 20:14:16.103288  140748 host.go:66] Checking if "addons-675434" exists ...
	I0729 20:14:16.103714  140748 cli_runner.go:164] Run: docker container inspect addons-675434 --format={{.State.Status}}
	I0729 20:14:16.085794  140748 addons.go:69] Setting ingress=true in profile "addons-675434"
	I0729 20:14:16.105407  140748 addons.go:234] Setting addon ingress=true in "addons-675434"
	I0729 20:14:16.105462  140748 host.go:66] Checking if "addons-675434" exists ...
	I0729 20:14:16.105866  140748 cli_runner.go:164] Run: docker container inspect addons-675434 --format={{.State.Status}}
	I0729 20:14:16.116020  140748 addons.go:69] Setting storage-provisioner-rancher=true in profile "addons-675434"
	I0729 20:14:16.116068  140748 addons_storage_classes.go:33] enableOrDisableStorageClasses storage-provisioner-rancher=true on "addons-675434"
	I0729 20:14:16.116408  140748 cli_runner.go:164] Run: docker container inspect addons-675434 --format={{.State.Status}}
	I0729 20:14:16.128056  140748 addons.go:69] Setting volcano=true in profile "addons-675434"
	I0729 20:14:16.128108  140748 addons.go:234] Setting addon volcano=true in "addons-675434"
	I0729 20:14:16.128145  140748 host.go:66] Checking if "addons-675434" exists ...
	I0729 20:14:16.128597  140748 cli_runner.go:164] Run: docker container inspect addons-675434 --format={{.State.Status}}
	I0729 20:14:16.131004  140748 addons.go:69] Setting volumesnapshots=true in profile "addons-675434"
	I0729 20:14:16.131043  140748 addons.go:234] Setting addon volumesnapshots=true in "addons-675434"
	I0729 20:14:16.131090  140748 host.go:66] Checking if "addons-675434" exists ...
	I0729 20:14:16.131504  140748 cli_runner.go:164] Run: docker container inspect addons-675434 --format={{.State.Status}}
	I0729 20:14:16.085800  140748 addons.go:69] Setting ingress-dns=true in profile "addons-675434"
	I0729 20:14:16.149567  140748 addons.go:234] Setting addon ingress-dns=true in "addons-675434"
	I0729 20:14:16.149637  140748 host.go:66] Checking if "addons-675434" exists ...
	I0729 20:14:16.150079  140748 cli_runner.go:164] Run: docker container inspect addons-675434 --format={{.State.Status}}
	I0729 20:14:16.165061  140748 cli_runner.go:164] Run: docker container inspect addons-675434 --format={{.State.Status}}
	I0729 20:14:16.085803  140748 addons.go:69] Setting inspektor-gadget=true in profile "addons-675434"
	I0729 20:14:16.168059  140748 addons.go:234] Setting addon inspektor-gadget=true in "addons-675434"
	I0729 20:14:16.168101  140748 host.go:66] Checking if "addons-675434" exists ...
	I0729 20:14:16.168665  140748 cli_runner.go:164] Run: docker container inspect addons-675434 --format={{.State.Status}}
	I0729 20:14:16.182876  140748 ssh_runner.go:195] Run: sudo systemctl daemon-reload
	I0729 20:14:16.085807  140748 addons.go:69] Setting metrics-server=true in profile "addons-675434"
	I0729 20:14:16.183667  140748 addons.go:234] Setting addon metrics-server=true in "addons-675434"
	I0729 20:14:16.183738  140748 host.go:66] Checking if "addons-675434" exists ...
	I0729 20:14:16.184255  140748 cli_runner.go:164] Run: docker container inspect addons-675434 --format={{.State.Status}}
	I0729 20:14:16.085789  140748 addons.go:69] Setting gcp-auth=true in profile "addons-675434"
	I0729 20:14:16.205096  140748 mustload.go:65] Loading cluster: addons-675434
	I0729 20:14:16.205301  140748 config.go:182] Loaded profile config "addons-675434": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.30.3
	I0729 20:14:16.205594  140748 cli_runner.go:164] Run: docker container inspect addons-675434 --format={{.State.Status}}
	I0729 20:14:16.252419  140748 out.go:177]   - Using image gcr.io/cloud-spanner-emulator/emulator:1.5.22
	I0729 20:14:16.300310  140748 addons.go:431] installing /etc/kubernetes/addons/deployment.yaml
	I0729 20:14:16.300330  140748 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/deployment.yaml (1004 bytes)
	I0729 20:14:16.300397  140748 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-675434
	I0729 20:14:16.342854  140748 addons.go:234] Setting addon default-storageclass=true in "addons-675434"
	I0729 20:14:16.342896  140748 host.go:66] Checking if "addons-675434" exists ...
	I0729 20:14:16.343281  140748 cli_runner.go:164] Run: docker container inspect addons-675434 --format={{.State.Status}}
	I0729 20:14:16.373535  140748 out.go:177]   - Using image docker.io/volcanosh/vc-controller-manager:v1.9.0
	I0729 20:14:16.373875  140748 out.go:177]   - Using image docker.io/marcnuri/yakd:0.0.5
	I0729 20:14:16.380155  140748 addons.go:234] Setting addon storage-provisioner-rancher=true in "addons-675434"
	I0729 20:14:16.380224  140748 host.go:66] Checking if "addons-675434" exists ...
	I0729 20:14:16.380690  140748 cli_runner.go:164] Run: docker container inspect addons-675434 --format={{.State.Status}}
	I0729 20:14:16.386734  140748 out.go:177]   - Using image registry.k8s.io/sig-storage/snapshot-controller:v6.1.0
	I0729 20:14:16.387059  140748 out.go:177]   - Using image registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.6.0
	I0729 20:14:16.387130  140748 addons.go:431] installing /etc/kubernetes/addons/yakd-ns.yaml
	I0729 20:14:16.387142  140748 ssh_runner.go:362] scp yakd/yakd-ns.yaml --> /etc/kubernetes/addons/yakd-ns.yaml (171 bytes)
	I0729 20:14:16.387211  140748 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-675434
	I0729 20:14:16.387359  140748 out.go:177]   - Using image docker.io/registry:2.8.3
	I0729 20:14:16.387555  140748 out.go:177]   - Using image gcr.io/k8s-minikube/storage-provisioner:v5
	I0729 20:14:16.387686  140748 out.go:177]   - Using image registry.k8s.io/ingress-nginx/controller:v1.11.1
	I0729 20:14:16.390156  140748 out.go:177]   - Using image docker.io/volcanosh/vc-scheduler:v1.9.0
	I0729 20:14:16.397973  140748 out.go:177]   - Using image registry.k8s.io/ingress-nginx/kube-webhook-certgen:v1.4.1
	I0729 20:14:16.402449  140748 out.go:177]   - Using image registry.k8s.io/sig-storage/hostpathplugin:v1.9.0
	I0729 20:14:16.402547  140748 addons.go:431] installing /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml
	I0729 20:14:16.402992  140748 ssh_runner.go:362] scp volumesnapshots/csi-hostpath-snapshotclass.yaml --> /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml (934 bytes)
	I0729 20:14:16.403057  140748 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-675434
	I0729 20:14:16.402651  140748 addons.go:431] installing /etc/kubernetes/addons/storage-provisioner.yaml
	I0729 20:14:16.403330  140748 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storage-provisioner.yaml (2676 bytes)
	I0729 20:14:16.403397  140748 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-675434
	I0729 20:14:16.412092  140748 out.go:177]   - Using image nvcr.io/nvidia/k8s-device-plugin:v0.16.1
	I0729 20:14:16.402686  140748 out.go:177]   - Using image ghcr.io/inspektor-gadget/inspektor-gadget:v0.30.0
	I0729 20:14:16.412543  140748 out.go:177]   - Using image registry.k8s.io/metrics-server/metrics-server:v0.7.1
	I0729 20:14:16.402837  140748 host.go:66] Checking if "addons-675434" exists ...
	I0729 20:14:16.420030  140748 out.go:177]   - Using image registry.k8s.io/ingress-nginx/kube-webhook-certgen:v1.4.1
	I0729 20:14:16.420079  140748 addons.go:431] installing /etc/kubernetes/addons/ig-namespace.yaml
	I0729 20:14:16.420334  140748 ssh_runner.go:362] scp inspektor-gadget/ig-namespace.yaml --> /etc/kubernetes/addons/ig-namespace.yaml (55 bytes)
	I0729 20:14:16.420423  140748 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-675434
	I0729 20:14:16.420193  140748 addons.go:431] installing /etc/kubernetes/addons/nvidia-device-plugin.yaml
	I0729 20:14:16.420665  140748 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/nvidia-device-plugin.yaml (1966 bytes)
	I0729 20:14:16.420713  140748 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-675434
	I0729 20:14:16.434460  140748 addons.go:431] installing /etc/kubernetes/addons/ingress-deploy.yaml
	I0729 20:14:16.434483  140748 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/ingress-deploy.yaml (16078 bytes)
	I0729 20:14:16.434552  140748 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-675434
	I0729 20:14:16.434823  140748 out.go:177]   - Using image gcr.io/k8s-minikube/kube-registry-proxy:0.0.6
	I0729 20:14:16.440472  140748 out.go:177]   - Using image docker.io/volcanosh/vc-webhook-manager:v1.9.0
	I0729 20:14:16.440678  140748 out.go:177]   - Using image registry.k8s.io/sig-storage/livenessprobe:v2.8.0
	I0729 20:14:16.440719  140748 addons.go:431] installing /etc/kubernetes/addons/metrics-apiservice.yaml
	I0729 20:14:16.441106  140748 ssh_runner.go:362] scp metrics-server/metrics-apiservice.yaml --> /etc/kubernetes/addons/metrics-apiservice.yaml (424 bytes)
	I0729 20:14:16.441190  140748 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-675434
	I0729 20:14:16.467923  140748 addons.go:431] installing /etc/kubernetes/addons/registry-rc.yaml
	I0729 20:14:16.467944  140748 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/registry-rc.yaml (860 bytes)
	I0729 20:14:16.468083  140748 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-675434
	I0729 20:14:16.498546  140748 out.go:177]   - Using image registry.k8s.io/sig-storage/csi-resizer:v1.6.0
	I0729 20:14:16.500595  140748 addons.go:431] installing /etc/kubernetes/addons/volcano-deployment.yaml
	I0729 20:14:16.500619  140748 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/volcano-deployment.yaml (434001 bytes)
	I0729 20:14:16.500686  140748 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-675434
	I0729 20:14:16.506912  140748 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:37035 SSHKeyPath:/home/jenkins/minikube-integration/19339-134334/.minikube/machines/addons-675434/id_rsa Username:docker}
	I0729 20:14:16.508509  140748 addons.go:431] installing /etc/kubernetes/addons/storageclass.yaml
	I0729 20:14:16.508534  140748 ssh_runner.go:362] scp storageclass/storageclass.yaml --> /etc/kubernetes/addons/storageclass.yaml (271 bytes)
	I0729 20:14:16.508611  140748 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-675434
	I0729 20:14:16.544618  140748 out.go:177]   - Using image registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0
	I0729 20:14:16.546609  140748 out.go:177]   - Using image registry.k8s.io/sig-storage/csi-provisioner:v3.3.0
	I0729 20:14:16.555369  140748 out.go:177]   - Using image registry.k8s.io/sig-storage/csi-attacher:v4.0.0
	I0729 20:14:16.557204  140748 out.go:177]   - Using image registry.k8s.io/sig-storage/csi-external-health-monitor-controller:v0.7.0
	I0729 20:14:16.560156  140748 addons.go:431] installing /etc/kubernetes/addons/rbac-external-attacher.yaml
	I0729 20:14:16.560182  140748 ssh_runner.go:362] scp csi-hostpath-driver/rbac/rbac-external-attacher.yaml --> /etc/kubernetes/addons/rbac-external-attacher.yaml (3073 bytes)
	I0729 20:14:16.560272  140748 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-675434
	I0729 20:14:16.568566  140748 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:37035 SSHKeyPath:/home/jenkins/minikube-integration/19339-134334/.minikube/machines/addons-675434/id_rsa Username:docker}
	I0729 20:14:16.571552  140748 out.go:177]   - Using image gcr.io/k8s-minikube/minikube-ingress-dns:0.0.3
	I0729 20:14:16.573169  140748 addons.go:431] installing /etc/kubernetes/addons/ingress-dns-pod.yaml
	I0729 20:14:16.573189  140748 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/ingress-dns-pod.yaml (2442 bytes)
	I0729 20:14:16.573255  140748 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-675434
	I0729 20:14:16.594947  140748 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:37035 SSHKeyPath:/home/jenkins/minikube-integration/19339-134334/.minikube/machines/addons-675434/id_rsa Username:docker}
	I0729 20:14:16.595643  140748 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:37035 SSHKeyPath:/home/jenkins/minikube-integration/19339-134334/.minikube/machines/addons-675434/id_rsa Username:docker}
	I0729 20:14:16.604006  140748 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:37035 SSHKeyPath:/home/jenkins/minikube-integration/19339-134334/.minikube/machines/addons-675434/id_rsa Username:docker}
	I0729 20:14:16.645460  140748 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:37035 SSHKeyPath:/home/jenkins/minikube-integration/19339-134334/.minikube/machines/addons-675434/id_rsa Username:docker}
	I0729 20:14:16.675803  140748 out.go:177]   - Using image docker.io/rancher/local-path-provisioner:v0.0.22
	I0729 20:14:16.678271  140748 out.go:177]   - Using image docker.io/busybox:stable
	I0729 20:14:16.680860  140748 addons.go:431] installing /etc/kubernetes/addons/storage-provisioner-rancher.yaml
	I0729 20:14:16.680881  140748 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storage-provisioner-rancher.yaml (3113 bytes)
	I0729 20:14:16.680950  140748 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-675434
	I0729 20:14:16.697980  140748 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:37035 SSHKeyPath:/home/jenkins/minikube-integration/19339-134334/.minikube/machines/addons-675434/id_rsa Username:docker}
	I0729 20:14:16.719748  140748 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:37035 SSHKeyPath:/home/jenkins/minikube-integration/19339-134334/.minikube/machines/addons-675434/id_rsa Username:docker}
	I0729 20:14:16.726818  140748 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:37035 SSHKeyPath:/home/jenkins/minikube-integration/19339-134334/.minikube/machines/addons-675434/id_rsa Username:docker}
	I0729 20:14:16.727506  140748 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:37035 SSHKeyPath:/home/jenkins/minikube-integration/19339-134334/.minikube/machines/addons-675434/id_rsa Username:docker}
	I0729 20:14:16.740565  140748 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:37035 SSHKeyPath:/home/jenkins/minikube-integration/19339-134334/.minikube/machines/addons-675434/id_rsa Username:docker}
	I0729 20:14:16.741105  140748 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:37035 SSHKeyPath:/home/jenkins/minikube-integration/19339-134334/.minikube/machines/addons-675434/id_rsa Username:docker}
	I0729 20:14:16.756226  140748 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:37035 SSHKeyPath:/home/jenkins/minikube-integration/19339-134334/.minikube/machines/addons-675434/id_rsa Username:docker}
	W0729 20:14:16.759737  140748 sshutil.go:64] dial failure (will retry): ssh: handshake failed: EOF
	I0729 20:14:16.759766  140748 retry.go:31] will retry after 292.346988ms: ssh: handshake failed: EOF
	W0729 20:14:16.762007  140748 sshutil.go:64] dial failure (will retry): ssh: handshake failed: EOF
	I0729 20:14:16.762029  140748 retry.go:31] will retry after 357.23477ms: ssh: handshake failed: EOF
	I0729 20:14:16.767671  140748 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:37035 SSHKeyPath:/home/jenkins/minikube-integration/19339-134334/.minikube/machines/addons-675434/id_rsa Username:docker}
	I0729 20:14:16.908442  140748 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.30.3/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml | sed -e '/^        forward . \/etc\/resolv.conf.*/i \        hosts {\n           192.168.49.1 host.minikube.internal\n           fallthrough\n        }' -e '/^        errors *$/i \        log' | sudo /var/lib/minikube/binaries/v1.30.3/kubectl --kubeconfig=/var/lib/minikube/kubeconfig replace -f -"
	I0729 20:14:16.908625  140748 ssh_runner.go:195] Run: sudo systemctl start kubelet
	W0729 20:14:17.053682  140748 sshutil.go:64] dial failure (will retry): ssh: handshake failed: EOF
	I0729 20:14:17.053769  140748 retry.go:31] will retry after 355.069468ms: ssh: handshake failed: EOF
	I0729 20:14:17.273332  140748 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.3/kubectl apply -f /etc/kubernetes/addons/ingress-dns-pod.yaml
	I0729 20:14:17.284999  140748 addons.go:431] installing /etc/kubernetes/addons/registry-svc.yaml
	I0729 20:14:17.285025  140748 ssh_runner.go:362] scp registry/registry-svc.yaml --> /etc/kubernetes/addons/registry-svc.yaml (398 bytes)
	I0729 20:14:17.340590  140748 addons.go:431] installing /etc/kubernetes/addons/ig-serviceaccount.yaml
	I0729 20:14:17.340618  140748 ssh_runner.go:362] scp inspektor-gadget/ig-serviceaccount.yaml --> /etc/kubernetes/addons/ig-serviceaccount.yaml (80 bytes)
	I0729 20:14:17.347201  140748 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.3/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml
	I0729 20:14:17.399127  140748 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.3/kubectl apply -f /etc/kubernetes/addons/nvidia-device-plugin.yaml
	I0729 20:14:17.404268  140748 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.3/kubectl apply -f /etc/kubernetes/addons/ingress-deploy.yaml
	I0729 20:14:17.410349  140748 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.3/kubectl apply -f /etc/kubernetes/addons/deployment.yaml
	I0729 20:14:17.453892  140748 addons.go:431] installing /etc/kubernetes/addons/metrics-server-deployment.yaml
	I0729 20:14:17.453976  140748 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-server-deployment.yaml (1907 bytes)
	I0729 20:14:17.471701  140748 addons.go:431] installing /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml
	I0729 20:14:17.471792  140748 ssh_runner.go:362] scp volumesnapshots/snapshot.storage.k8s.io_volumesnapshotclasses.yaml --> /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml (6471 bytes)
	I0729 20:14:17.516632  140748 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.3/kubectl apply -f /etc/kubernetes/addons/volcano-deployment.yaml
	I0729 20:14:17.531036  140748 addons.go:431] installing /etc/kubernetes/addons/yakd-sa.yaml
	I0729 20:14:17.531108  140748 ssh_runner.go:362] scp yakd/yakd-sa.yaml --> /etc/kubernetes/addons/yakd-sa.yaml (247 bytes)
	I0729 20:14:17.551598  140748 addons.go:431] installing /etc/kubernetes/addons/registry-proxy.yaml
	I0729 20:14:17.551677  140748 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/registry-proxy.yaml (947 bytes)
	I0729 20:14:17.588421  140748 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.3/kubectl apply -f /etc/kubernetes/addons/storage-provisioner-rancher.yaml
	I0729 20:14:17.613262  140748 addons.go:431] installing /etc/kubernetes/addons/ig-role.yaml
	I0729 20:14:17.613282  140748 ssh_runner.go:362] scp inspektor-gadget/ig-role.yaml --> /etc/kubernetes/addons/ig-role.yaml (210 bytes)
	I0729 20:14:17.726567  140748 addons.go:431] installing /etc/kubernetes/addons/metrics-server-rbac.yaml
	I0729 20:14:17.726645  140748 ssh_runner.go:362] scp metrics-server/metrics-server-rbac.yaml --> /etc/kubernetes/addons/metrics-server-rbac.yaml (2175 bytes)
	I0729 20:14:17.774563  140748 addons.go:431] installing /etc/kubernetes/addons/yakd-crb.yaml
	I0729 20:14:17.774657  140748 ssh_runner.go:362] scp yakd/yakd-crb.yaml --> /etc/kubernetes/addons/yakd-crb.yaml (422 bytes)
	I0729 20:14:17.810312  140748 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.3/kubectl apply -f /etc/kubernetes/addons/registry-rc.yaml -f /etc/kubernetes/addons/registry-svc.yaml -f /etc/kubernetes/addons/registry-proxy.yaml
	I0729 20:14:17.831389  140748 addons.go:431] installing /etc/kubernetes/addons/metrics-server-service.yaml
	I0729 20:14:17.831469  140748 ssh_runner.go:362] scp metrics-server/metrics-server-service.yaml --> /etc/kubernetes/addons/metrics-server-service.yaml (446 bytes)
	I0729 20:14:17.840148  140748 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.3/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml
	I0729 20:14:17.846116  140748 addons.go:431] installing /etc/kubernetes/addons/rbac-hostpath.yaml
	I0729 20:14:17.846141  140748 ssh_runner.go:362] scp csi-hostpath-driver/rbac/rbac-hostpath.yaml --> /etc/kubernetes/addons/rbac-hostpath.yaml (4266 bytes)
	I0729 20:14:17.854436  140748 addons.go:431] installing /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml
	I0729 20:14:17.854458  140748 ssh_runner.go:362] scp volumesnapshots/snapshot.storage.k8s.io_volumesnapshotcontents.yaml --> /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml (23126 bytes)
	I0729 20:14:17.953431  140748 addons.go:431] installing /etc/kubernetes/addons/ig-rolebinding.yaml
	I0729 20:14:17.953459  140748 ssh_runner.go:362] scp inspektor-gadget/ig-rolebinding.yaml --> /etc/kubernetes/addons/ig-rolebinding.yaml (244 bytes)
	I0729 20:14:18.054253  140748 addons.go:431] installing /etc/kubernetes/addons/ig-clusterrole.yaml
	I0729 20:14:18.054329  140748 ssh_runner.go:362] scp inspektor-gadget/ig-clusterrole.yaml --> /etc/kubernetes/addons/ig-clusterrole.yaml (1485 bytes)
	I0729 20:14:18.139418  140748 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.3/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
	I0729 20:14:18.265033  140748 addons.go:431] installing /etc/kubernetes/addons/ig-clusterrolebinding.yaml
	I0729 20:14:18.265116  140748 ssh_runner.go:362] scp inspektor-gadget/ig-clusterrolebinding.yaml --> /etc/kubernetes/addons/ig-clusterrolebinding.yaml (274 bytes)
	I0729 20:14:18.273243  140748 addons.go:431] installing /etc/kubernetes/addons/rbac-external-health-monitor-controller.yaml
	I0729 20:14:18.273318  140748 ssh_runner.go:362] scp csi-hostpath-driver/rbac/rbac-external-health-monitor-controller.yaml --> /etc/kubernetes/addons/rbac-external-health-monitor-controller.yaml (3038 bytes)
	I0729 20:14:18.277829  140748 addons.go:431] installing /etc/kubernetes/addons/yakd-svc.yaml
	I0729 20:14:18.277912  140748 ssh_runner.go:362] scp yakd/yakd-svc.yaml --> /etc/kubernetes/addons/yakd-svc.yaml (412 bytes)
	I0729 20:14:18.403579  140748 addons.go:431] installing /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml
	I0729 20:14:18.403658  140748 ssh_runner.go:362] scp volumesnapshots/snapshot.storage.k8s.io_volumesnapshots.yaml --> /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml (19582 bytes)
	I0729 20:14:18.678748  140748 addons.go:431] installing /etc/kubernetes/addons/rbac-external-provisioner.yaml
	I0729 20:14:18.678855  140748 ssh_runner.go:362] scp csi-hostpath-driver/rbac/rbac-external-provisioner.yaml --> /etc/kubernetes/addons/rbac-external-provisioner.yaml (4442 bytes)
	I0729 20:14:18.695409  140748 addons.go:431] installing /etc/kubernetes/addons/yakd-dp.yaml
	I0729 20:14:18.695482  140748 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/yakd-dp.yaml (2017 bytes)
	I0729 20:14:18.974508  140748 addons.go:431] installing /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml
	I0729 20:14:18.974584  140748 ssh_runner.go:362] scp volumesnapshots/rbac-volume-snapshot-controller.yaml --> /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml (3545 bytes)
	I0729 20:14:18.983315  140748 addons.go:431] installing /etc/kubernetes/addons/ig-crd.yaml
	I0729 20:14:18.983391  140748 ssh_runner.go:362] scp inspektor-gadget/ig-crd.yaml --> /etc/kubernetes/addons/ig-crd.yaml (5216 bytes)
	I0729 20:14:19.089000  140748 addons.go:431] installing /etc/kubernetes/addons/rbac-external-resizer.yaml
	I0729 20:14:19.089075  140748 ssh_runner.go:362] scp csi-hostpath-driver/rbac/rbac-external-resizer.yaml --> /etc/kubernetes/addons/rbac-external-resizer.yaml (2943 bytes)
	I0729 20:14:19.107913  140748 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.3/kubectl apply -f /etc/kubernetes/addons/yakd-ns.yaml -f /etc/kubernetes/addons/yakd-sa.yaml -f /etc/kubernetes/addons/yakd-crb.yaml -f /etc/kubernetes/addons/yakd-svc.yaml -f /etc/kubernetes/addons/yakd-dp.yaml
	I0729 20:14:19.283913  140748 addons.go:431] installing /etc/kubernetes/addons/ig-daemonset.yaml
	I0729 20:14:19.283990  140748 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/ig-daemonset.yaml (7735 bytes)
	I0729 20:14:19.287313  140748 addons.go:431] installing /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml
	I0729 20:14:19.287371  140748 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml (1475 bytes)
	I0729 20:14:19.411217  140748 addons.go:431] installing /etc/kubernetes/addons/rbac-external-snapshotter.yaml
	I0729 20:14:19.411295  140748 ssh_runner.go:362] scp csi-hostpath-driver/rbac/rbac-external-snapshotter.yaml --> /etc/kubernetes/addons/rbac-external-snapshotter.yaml (3149 bytes)
	I0729 20:14:19.528855  140748 ssh_runner.go:235] Completed: sudo systemctl start kubelet: (2.620183202s)
	I0729 20:14:19.529023  140748 ssh_runner.go:235] Completed: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.30.3/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml | sed -e '/^        forward . \/etc\/resolv.conf.*/i \        hosts {\n           192.168.49.1 host.minikube.internal\n           fallthrough\n        }' -e '/^        errors *$/i \        log' | sudo /var/lib/minikube/binaries/v1.30.3/kubectl --kubeconfig=/var/lib/minikube/kubeconfig replace -f -": (2.620550923s)
	I0729 20:14:19.529060  140748 start.go:971] {"host.minikube.internal": 192.168.49.1} host record injected into CoreDNS's ConfigMap
	I0729 20:14:19.529905  140748 node_ready.go:35] waiting up to 6m0s for node "addons-675434" to be "Ready" ...
	I0729 20:14:19.534056  140748 node_ready.go:49] node "addons-675434" has status "Ready":"True"
	I0729 20:14:19.534087  140748 node_ready.go:38] duration metric: took 4.149774ms for node "addons-675434" to be "Ready" ...
	I0729 20:14:19.534099  140748 pod_ready.go:35] extra waiting up to 6m0s for all system-critical pods including labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
	I0729 20:14:19.550429  140748 pod_ready.go:78] waiting up to 6m0s for pod "coredns-7db6d8ff4d-464tf" in "kube-system" namespace to be "Ready" ...
	I0729 20:14:19.633128  140748 addons.go:431] installing /etc/kubernetes/addons/csi-hostpath-attacher.yaml
	I0729 20:14:19.633198  140748 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/csi-hostpath-attacher.yaml (2143 bytes)
	I0729 20:14:19.804726  140748 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.3/kubectl apply -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml
	I0729 20:14:19.854260  140748 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.3/kubectl apply -f /etc/kubernetes/addons/ig-namespace.yaml -f /etc/kubernetes/addons/ig-serviceaccount.yaml -f /etc/kubernetes/addons/ig-role.yaml -f /etc/kubernetes/addons/ig-rolebinding.yaml -f /etc/kubernetes/addons/ig-clusterrole.yaml -f /etc/kubernetes/addons/ig-clusterrolebinding.yaml -f /etc/kubernetes/addons/ig-crd.yaml -f /etc/kubernetes/addons/ig-daemonset.yaml
	I0729 20:14:19.884872  140748 addons.go:431] installing /etc/kubernetes/addons/csi-hostpath-driverinfo.yaml
	I0729 20:14:19.884946  140748 ssh_runner.go:362] scp csi-hostpath-driver/deploy/csi-hostpath-driverinfo.yaml --> /etc/kubernetes/addons/csi-hostpath-driverinfo.yaml (1274 bytes)
	I0729 20:14:20.035100  140748 kapi.go:214] "coredns" deployment in "kube-system" namespace and "addons-675434" context rescaled to 1 replicas
	I0729 20:14:20.154462  140748 addons.go:431] installing /etc/kubernetes/addons/csi-hostpath-plugin.yaml
	I0729 20:14:20.154537  140748 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/csi-hostpath-plugin.yaml (8201 bytes)
	I0729 20:14:20.395876  140748 addons.go:431] installing /etc/kubernetes/addons/csi-hostpath-resizer.yaml
	I0729 20:14:20.395946  140748 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/csi-hostpath-resizer.yaml (2191 bytes)
	I0729 20:14:20.553037  140748 addons.go:431] installing /etc/kubernetes/addons/csi-hostpath-storageclass.yaml
	I0729 20:14:20.553116  140748 ssh_runner.go:362] scp csi-hostpath-driver/deploy/csi-hostpath-storageclass.yaml --> /etc/kubernetes/addons/csi-hostpath-storageclass.yaml (846 bytes)
	I0729 20:14:20.554661  140748 pod_ready.go:97] error getting pod "coredns-7db6d8ff4d-464tf" in "kube-system" namespace (skipping!): pods "coredns-7db6d8ff4d-464tf" not found
	I0729 20:14:20.554737  140748 pod_ready.go:81] duration metric: took 1.004275138s for pod "coredns-7db6d8ff4d-464tf" in "kube-system" namespace to be "Ready" ...
	E0729 20:14:20.554763  140748 pod_ready.go:66] WaitExtra: waitPodCondition: error getting pod "coredns-7db6d8ff4d-464tf" in "kube-system" namespace (skipping!): pods "coredns-7db6d8ff4d-464tf" not found
	I0729 20:14:20.554793  140748 pod_ready.go:78] waiting up to 6m0s for pod "coredns-7db6d8ff4d-8k8vs" in "kube-system" namespace to be "Ready" ...
	I0729 20:14:20.829875  140748 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.3/kubectl apply -f /etc/kubernetes/addons/ingress-dns-pod.yaml: (3.556468638s)
	I0729 20:14:20.861134  140748 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.3/kubectl apply -f /etc/kubernetes/addons/rbac-external-attacher.yaml -f /etc/kubernetes/addons/rbac-hostpath.yaml -f /etc/kubernetes/addons/rbac-external-health-monitor-controller.yaml -f /etc/kubernetes/addons/rbac-external-provisioner.yaml -f /etc/kubernetes/addons/rbac-external-resizer.yaml -f /etc/kubernetes/addons/rbac-external-snapshotter.yaml -f /etc/kubernetes/addons/csi-hostpath-attacher.yaml -f /etc/kubernetes/addons/csi-hostpath-driverinfo.yaml -f /etc/kubernetes/addons/csi-hostpath-plugin.yaml -f /etc/kubernetes/addons/csi-hostpath-resizer.yaml -f /etc/kubernetes/addons/csi-hostpath-storageclass.yaml
	I0729 20:14:21.240892  140748 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.3/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml: (3.893656452s)
	I0729 20:14:21.241006  140748 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.3/kubectl apply -f /etc/kubernetes/addons/nvidia-device-plugin.yaml: (3.841801775s)
	I0729 20:14:22.576531  140748 pod_ready.go:102] pod "coredns-7db6d8ff4d-8k8vs" in "kube-system" namespace has status "Ready":"False"
	I0729 20:14:23.647172  140748 ssh_runner.go:362] scp memory --> /var/lib/minikube/google_application_credentials.json (162 bytes)
	I0729 20:14:23.647257  140748 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-675434
	I0729 20:14:23.680711  140748 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:37035 SSHKeyPath:/home/jenkins/minikube-integration/19339-134334/.minikube/machines/addons-675434/id_rsa Username:docker}
	I0729 20:14:23.991193  140748 ssh_runner.go:362] scp memory --> /var/lib/minikube/google_cloud_project (12 bytes)
	I0729 20:14:24.176834  140748 addons.go:234] Setting addon gcp-auth=true in "addons-675434"
	I0729 20:14:24.176894  140748 host.go:66] Checking if "addons-675434" exists ...
	I0729 20:14:24.177386  140748 cli_runner.go:164] Run: docker container inspect addons-675434 --format={{.State.Status}}
	I0729 20:14:24.204163  140748 ssh_runner.go:195] Run: cat /var/lib/minikube/google_application_credentials.json
	I0729 20:14:24.204221  140748 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-675434
	I0729 20:14:24.229398  140748 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:37035 SSHKeyPath:/home/jenkins/minikube-integration/19339-134334/.minikube/machines/addons-675434/id_rsa Username:docker}
	I0729 20:14:24.591138  140748 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.3/kubectl apply -f /etc/kubernetes/addons/ingress-deploy.yaml: (7.186791473s)
	I0729 20:14:24.591179  140748 addons.go:475] Verifying addon ingress=true in "addons-675434"
	I0729 20:14:24.591447  140748 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.3/kubectl apply -f /etc/kubernetes/addons/deployment.yaml: (7.180942012s)
	I0729 20:14:24.593425  140748 out.go:177] * Verifying ingress addon...
	I0729 20:14:24.595909  140748 kapi.go:75] Waiting for pod with label "app.kubernetes.io/name=ingress-nginx" in ns "ingress-nginx" ...
	I0729 20:14:24.600012  140748 kapi.go:86] Found 3 Pods for label selector app.kubernetes.io/name=ingress-nginx
	I0729 20:14:24.600044  140748 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0729 20:14:25.112393  140748 pod_ready.go:102] pod "coredns-7db6d8ff4d-8k8vs" in "kube-system" namespace has status "Ready":"False"
	I0729 20:14:25.118298  140748 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0729 20:14:25.610377  140748 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0729 20:14:26.115020  140748 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0729 20:14:26.232319  140748 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.3/kubectl apply -f /etc/kubernetes/addons/volcano-deployment.yaml: (8.715598955s)
	I0729 20:14:26.232439  140748 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.3/kubectl apply -f /etc/kubernetes/addons/storage-provisioner-rancher.yaml: (8.643999185s)
	I0729 20:14:26.232686  140748 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.3/kubectl apply -f /etc/kubernetes/addons/registry-rc.yaml -f /etc/kubernetes/addons/registry-svc.yaml -f /etc/kubernetes/addons/registry-proxy.yaml: (8.422296133s)
	I0729 20:14:26.232725  140748 addons.go:475] Verifying addon registry=true in "addons-675434"
	I0729 20:14:26.232958  140748 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.3/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml: (8.392725069s)
	I0729 20:14:26.233174  140748 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.3/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: (8.093681993s)
	I0729 20:14:26.233500  140748 addons.go:475] Verifying addon metrics-server=true in "addons-675434"
	I0729 20:14:26.233246  140748 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.3/kubectl apply -f /etc/kubernetes/addons/yakd-ns.yaml -f /etc/kubernetes/addons/yakd-sa.yaml -f /etc/kubernetes/addons/yakd-crb.yaml -f /etc/kubernetes/addons/yakd-svc.yaml -f /etc/kubernetes/addons/yakd-dp.yaml: (7.125189342s)
	I0729 20:14:26.233346  140748 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.3/kubectl apply -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml: (6.428541201s)
	W0729 20:14:26.233697  140748 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.3/kubectl apply -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml: Process exited with status 1
	stdout:
	customresourcedefinition.apiextensions.k8s.io/volumesnapshotclasses.snapshot.storage.k8s.io created
	customresourcedefinition.apiextensions.k8s.io/volumesnapshotcontents.snapshot.storage.k8s.io created
	customresourcedefinition.apiextensions.k8s.io/volumesnapshots.snapshot.storage.k8s.io created
	serviceaccount/snapshot-controller created
	clusterrole.rbac.authorization.k8s.io/snapshot-controller-runner created
	clusterrolebinding.rbac.authorization.k8s.io/snapshot-controller-role created
	role.rbac.authorization.k8s.io/snapshot-controller-leaderelection created
	rolebinding.rbac.authorization.k8s.io/snapshot-controller-leaderelection created
	deployment.apps/snapshot-controller created
	
	stderr:
	error: resource mapping not found for name: "csi-hostpath-snapclass" namespace: "" from "/etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml": no matches for kind "VolumeSnapshotClass" in version "snapshot.storage.k8s.io/v1"
	ensure CRDs are installed first
	I0729 20:14:26.233713  140748 retry.go:31] will retry after 341.630641ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.3/kubectl apply -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml: Process exited with status 1
	stdout:
	customresourcedefinition.apiextensions.k8s.io/volumesnapshotclasses.snapshot.storage.k8s.io created
	customresourcedefinition.apiextensions.k8s.io/volumesnapshotcontents.snapshot.storage.k8s.io created
	customresourcedefinition.apiextensions.k8s.io/volumesnapshots.snapshot.storage.k8s.io created
	serviceaccount/snapshot-controller created
	clusterrole.rbac.authorization.k8s.io/snapshot-controller-runner created
	clusterrolebinding.rbac.authorization.k8s.io/snapshot-controller-role created
	role.rbac.authorization.k8s.io/snapshot-controller-leaderelection created
	rolebinding.rbac.authorization.k8s.io/snapshot-controller-leaderelection created
	deployment.apps/snapshot-controller created
	
	stderr:
	error: resource mapping not found for name: "csi-hostpath-snapclass" namespace: "" from "/etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml": no matches for kind "VolumeSnapshotClass" in version "snapshot.storage.k8s.io/v1"
	ensure CRDs are installed first
	I0729 20:14:26.233402  140748 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.3/kubectl apply -f /etc/kubernetes/addons/ig-namespace.yaml -f /etc/kubernetes/addons/ig-serviceaccount.yaml -f /etc/kubernetes/addons/ig-role.yaml -f /etc/kubernetes/addons/ig-rolebinding.yaml -f /etc/kubernetes/addons/ig-clusterrole.yaml -f /etc/kubernetes/addons/ig-clusterrolebinding.yaml -f /etc/kubernetes/addons/ig-crd.yaml -f /etc/kubernetes/addons/ig-daemonset.yaml: (6.379064251s)
	I0729 20:14:26.236331  140748 out.go:177] * Verifying registry addon...
	I0729 20:14:26.236453  140748 out.go:177] * To access YAKD - Kubernetes Dashboard, wait for Pod to be ready and run the following command:
	
		minikube -p addons-675434 service yakd-dashboard -n yakd-dashboard
	
	I0729 20:14:26.240628  140748 kapi.go:75] Waiting for pod with label "kubernetes.io/minikube-addons=registry" in ns "kube-system" ...
	I0729 20:14:26.251448  140748 kapi.go:86] Found 2 Pods for label selector kubernetes.io/minikube-addons=registry
	I0729 20:14:26.251475  140748 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	W0729 20:14:26.281922  140748 out.go:239] ! Enabling 'storage-provisioner-rancher' returned an error: running callbacks: [Error making local-path the default storage class: Error while marking storage class local-path as default: Operation cannot be fulfilled on storageclasses.storage.k8s.io "local-path": the object has been modified; please apply your changes to the latest version and try again]
	I0729 20:14:26.575982  140748 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.3/kubectl apply --force -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml
	I0729 20:14:26.612633  140748 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0729 20:14:26.748565  140748 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0729 20:14:27.043665  140748 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.3/kubectl apply -f /etc/kubernetes/addons/rbac-external-attacher.yaml -f /etc/kubernetes/addons/rbac-hostpath.yaml -f /etc/kubernetes/addons/rbac-external-health-monitor-controller.yaml -f /etc/kubernetes/addons/rbac-external-provisioner.yaml -f /etc/kubernetes/addons/rbac-external-resizer.yaml -f /etc/kubernetes/addons/rbac-external-snapshotter.yaml -f /etc/kubernetes/addons/csi-hostpath-attacher.yaml -f /etc/kubernetes/addons/csi-hostpath-driverinfo.yaml -f /etc/kubernetes/addons/csi-hostpath-plugin.yaml -f /etc/kubernetes/addons/csi-hostpath-resizer.yaml -f /etc/kubernetes/addons/csi-hostpath-storageclass.yaml: (6.182439654s)
	I0729 20:14:27.043707  140748 addons.go:475] Verifying addon csi-hostpath-driver=true in "addons-675434"
	I0729 20:14:27.043909  140748 ssh_runner.go:235] Completed: cat /var/lib/minikube/google_application_credentials.json: (2.839723717s)
	I0729 20:14:27.046426  140748 out.go:177] * Verifying csi-hostpath-driver addon...
	I0729 20:14:27.046493  140748 out.go:177]   - Using image registry.k8s.io/ingress-nginx/kube-webhook-certgen:v1.4.1
	I0729 20:14:27.049110  140748 kapi.go:75] Waiting for pod with label "kubernetes.io/minikube-addons=csi-hostpath-driver" in ns "kube-system" ...
	I0729 20:14:27.051608  140748 out.go:177]   - Using image gcr.io/k8s-minikube/gcp-auth-webhook:v0.1.2
	I0729 20:14:27.053219  140748 addons.go:431] installing /etc/kubernetes/addons/gcp-auth-ns.yaml
	I0729 20:14:27.053247  140748 ssh_runner.go:362] scp gcp-auth/gcp-auth-ns.yaml --> /etc/kubernetes/addons/gcp-auth-ns.yaml (700 bytes)
	I0729 20:14:27.069348  140748 kapi.go:86] Found 3 Pods for label selector kubernetes.io/minikube-addons=csi-hostpath-driver
	I0729 20:14:27.069375  140748 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0729 20:14:27.104408  140748 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0729 20:14:27.145533  140748 addons.go:431] installing /etc/kubernetes/addons/gcp-auth-service.yaml
	I0729 20:14:27.145561  140748 ssh_runner.go:362] scp gcp-auth/gcp-auth-service.yaml --> /etc/kubernetes/addons/gcp-auth-service.yaml (788 bytes)
	I0729 20:14:27.236533  140748 addons.go:431] installing /etc/kubernetes/addons/gcp-auth-webhook.yaml
	I0729 20:14:27.236558  140748 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/gcp-auth-webhook.yaml (5421 bytes)
	I0729 20:14:27.246041  140748 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0729 20:14:27.303167  140748 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.3/kubectl apply -f /etc/kubernetes/addons/gcp-auth-ns.yaml -f /etc/kubernetes/addons/gcp-auth-service.yaml -f /etc/kubernetes/addons/gcp-auth-webhook.yaml
	I0729 20:14:27.555100  140748 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0729 20:14:27.571075  140748 pod_ready.go:102] pod "coredns-7db6d8ff4d-8k8vs" in "kube-system" namespace has status "Ready":"False"
	I0729 20:14:27.600387  140748 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0729 20:14:27.744855  140748 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0729 20:14:28.063100  140748 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0729 20:14:28.102768  140748 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0729 20:14:28.245365  140748 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0729 20:14:28.333806  140748 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.3/kubectl apply --force -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml: (1.757770848s)
	I0729 20:14:28.333909  140748 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.3/kubectl apply -f /etc/kubernetes/addons/gcp-auth-ns.yaml -f /etc/kubernetes/addons/gcp-auth-service.yaml -f /etc/kubernetes/addons/gcp-auth-webhook.yaml: (1.030680617s)
	I0729 20:14:28.337446  140748 addons.go:475] Verifying addon gcp-auth=true in "addons-675434"
	I0729 20:14:28.339536  140748 out.go:177] * Verifying gcp-auth addon...
	I0729 20:14:28.342369  140748 kapi.go:75] Waiting for pod with label "kubernetes.io/minikube-addons=gcp-auth" in ns "gcp-auth" ...
	I0729 20:14:28.347272  140748 kapi.go:86] Found 0 Pods for label selector kubernetes.io/minikube-addons=gcp-auth
	I0729 20:14:28.554956  140748 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0729 20:14:28.600789  140748 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0729 20:14:28.745607  140748 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0729 20:14:29.054403  140748 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0729 20:14:29.103441  140748 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0729 20:14:29.261440  140748 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0729 20:14:29.558855  140748 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0729 20:14:29.601125  140748 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0729 20:14:29.745983  140748 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0729 20:14:30.064918  140748 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0729 20:14:30.066798  140748 pod_ready.go:102] pod "coredns-7db6d8ff4d-8k8vs" in "kube-system" namespace has status "Ready":"False"
	I0729 20:14:30.101430  140748 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0729 20:14:30.246004  140748 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0729 20:14:30.567097  140748 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0729 20:14:30.602721  140748 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0729 20:14:30.745804  140748 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0729 20:14:31.056712  140748 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0729 20:14:31.115027  140748 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0729 20:14:31.246551  140748 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0729 20:14:31.555986  140748 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0729 20:14:31.601484  140748 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0729 20:14:31.745091  140748 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0729 20:14:32.055990  140748 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0729 20:14:32.101083  140748 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0729 20:14:32.245950  140748 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0729 20:14:32.555666  140748 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0729 20:14:32.561369  140748 pod_ready.go:102] pod "coredns-7db6d8ff4d-8k8vs" in "kube-system" namespace has status "Ready":"False"
	I0729 20:14:32.600760  140748 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0729 20:14:32.745526  140748 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0729 20:14:33.055834  140748 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0729 20:14:33.101300  140748 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0729 20:14:33.248828  140748 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0729 20:14:33.557486  140748 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0729 20:14:33.601991  140748 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0729 20:14:33.747930  140748 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0729 20:14:34.084197  140748 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0729 20:14:34.103842  140748 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0729 20:14:34.246759  140748 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0729 20:14:34.554953  140748 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0729 20:14:34.562170  140748 pod_ready.go:102] pod "coredns-7db6d8ff4d-8k8vs" in "kube-system" namespace has status "Ready":"False"
	I0729 20:14:34.600494  140748 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0729 20:14:34.745840  140748 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0729 20:14:35.055913  140748 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0729 20:14:35.101567  140748 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0729 20:14:35.246017  140748 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0729 20:14:35.556438  140748 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0729 20:14:35.601394  140748 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0729 20:14:35.746430  140748 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0729 20:14:36.056188  140748 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0729 20:14:36.100503  140748 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0729 20:14:36.246180  140748 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0729 20:14:36.556229  140748 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0729 20:14:36.565469  140748 pod_ready.go:102] pod "coredns-7db6d8ff4d-8k8vs" in "kube-system" namespace has status "Ready":"False"
	I0729 20:14:36.600549  140748 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0729 20:14:36.745475  140748 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0729 20:14:37.054874  140748 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0729 20:14:37.100485  140748 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0729 20:14:37.245662  140748 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0729 20:14:37.564760  140748 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0729 20:14:37.601862  140748 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0729 20:14:37.746036  140748 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0729 20:14:38.055430  140748 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0729 20:14:38.101235  140748 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0729 20:14:38.246324  140748 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0729 20:14:38.562662  140748 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0729 20:14:38.573526  140748 pod_ready.go:102] pod "coredns-7db6d8ff4d-8k8vs" in "kube-system" namespace has status "Ready":"False"
	I0729 20:14:38.606000  140748 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0729 20:14:38.745772  140748 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0729 20:14:39.055064  140748 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0729 20:14:39.100368  140748 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0729 20:14:39.245919  140748 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0729 20:14:39.555953  140748 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0729 20:14:39.600800  140748 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0729 20:14:39.745671  140748 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0729 20:14:40.055388  140748 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0729 20:14:40.101372  140748 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0729 20:14:40.246284  140748 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0729 20:14:40.554475  140748 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0729 20:14:40.600095  140748 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0729 20:14:40.745617  140748 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0729 20:14:41.055038  140748 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0729 20:14:41.060024  140748 pod_ready.go:102] pod "coredns-7db6d8ff4d-8k8vs" in "kube-system" namespace has status "Ready":"False"
	I0729 20:14:41.100145  140748 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0729 20:14:41.245429  140748 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0729 20:14:41.554656  140748 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0729 20:14:41.600873  140748 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0729 20:14:41.745609  140748 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0729 20:14:42.060935  140748 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0729 20:14:42.104417  140748 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0729 20:14:42.246942  140748 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0729 20:14:42.573984  140748 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0729 20:14:42.603995  140748 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0729 20:14:42.745845  140748 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0729 20:14:43.055028  140748 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0729 20:14:43.060888  140748 pod_ready.go:102] pod "coredns-7db6d8ff4d-8k8vs" in "kube-system" namespace has status "Ready":"False"
	I0729 20:14:43.102802  140748 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0729 20:14:43.259733  140748 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0729 20:14:43.562468  140748 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0729 20:14:43.600346  140748 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0729 20:14:43.746020  140748 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0729 20:14:44.054621  140748 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0729 20:14:44.101055  140748 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0729 20:14:44.246584  140748 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0729 20:14:44.554844  140748 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0729 20:14:44.602066  140748 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0729 20:14:44.747560  140748 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0729 20:14:45.062431  140748 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0729 20:14:45.068398  140748 pod_ready.go:102] pod "coredns-7db6d8ff4d-8k8vs" in "kube-system" namespace has status "Ready":"False"
	I0729 20:14:45.111077  140748 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0729 20:14:45.246973  140748 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0729 20:14:45.561346  140748 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0729 20:14:45.569992  140748 pod_ready.go:92] pod "coredns-7db6d8ff4d-8k8vs" in "kube-system" namespace has status "Ready":"True"
	I0729 20:14:45.570063  140748 pod_ready.go:81] duration metric: took 25.015244064s for pod "coredns-7db6d8ff4d-8k8vs" in "kube-system" namespace to be "Ready" ...
	I0729 20:14:45.570090  140748 pod_ready.go:78] waiting up to 6m0s for pod "etcd-addons-675434" in "kube-system" namespace to be "Ready" ...
	I0729 20:14:45.580981  140748 pod_ready.go:92] pod "etcd-addons-675434" in "kube-system" namespace has status "Ready":"True"
	I0729 20:14:45.581008  140748 pod_ready.go:81] duration metric: took 10.896831ms for pod "etcd-addons-675434" in "kube-system" namespace to be "Ready" ...
	I0729 20:14:45.581033  140748 pod_ready.go:78] waiting up to 6m0s for pod "kube-apiserver-addons-675434" in "kube-system" namespace to be "Ready" ...
	I0729 20:14:45.586505  140748 pod_ready.go:92] pod "kube-apiserver-addons-675434" in "kube-system" namespace has status "Ready":"True"
	I0729 20:14:45.586597  140748 pod_ready.go:81] duration metric: took 5.552573ms for pod "kube-apiserver-addons-675434" in "kube-system" namespace to be "Ready" ...
	I0729 20:14:45.586625  140748 pod_ready.go:78] waiting up to 6m0s for pod "kube-controller-manager-addons-675434" in "kube-system" namespace to be "Ready" ...
	I0729 20:14:45.591783  140748 pod_ready.go:92] pod "kube-controller-manager-addons-675434" in "kube-system" namespace has status "Ready":"True"
	I0729 20:14:45.591846  140748 pod_ready.go:81] duration metric: took 5.197792ms for pod "kube-controller-manager-addons-675434" in "kube-system" namespace to be "Ready" ...
	I0729 20:14:45.591873  140748 pod_ready.go:78] waiting up to 6m0s for pod "kube-proxy-lgnf6" in "kube-system" namespace to be "Ready" ...
	I0729 20:14:45.597699  140748 pod_ready.go:92] pod "kube-proxy-lgnf6" in "kube-system" namespace has status "Ready":"True"
	I0729 20:14:45.597771  140748 pod_ready.go:81] duration metric: took 5.877448ms for pod "kube-proxy-lgnf6" in "kube-system" namespace to be "Ready" ...
	I0729 20:14:45.597798  140748 pod_ready.go:78] waiting up to 6m0s for pod "kube-scheduler-addons-675434" in "kube-system" namespace to be "Ready" ...
	I0729 20:14:45.605832  140748 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0729 20:14:45.755772  140748 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0729 20:14:45.959927  140748 pod_ready.go:92] pod "kube-scheduler-addons-675434" in "kube-system" namespace has status "Ready":"True"
	I0729 20:14:45.960007  140748 pod_ready.go:81] duration metric: took 362.187999ms for pod "kube-scheduler-addons-675434" in "kube-system" namespace to be "Ready" ...
	I0729 20:14:45.960034  140748 pod_ready.go:78] waiting up to 6m0s for pod "nvidia-device-plugin-daemonset-zlp6c" in "kube-system" namespace to be "Ready" ...
	I0729 20:14:46.054567  140748 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0729 20:14:46.108068  140748 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0729 20:14:46.247787  140748 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0729 20:14:46.554689  140748 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0729 20:14:46.600779  140748 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0729 20:14:46.745531  140748 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0729 20:14:46.759016  140748 pod_ready.go:92] pod "nvidia-device-plugin-daemonset-zlp6c" in "kube-system" namespace has status "Ready":"True"
	I0729 20:14:46.759040  140748 pod_ready.go:81] duration metric: took 798.98361ms for pod "nvidia-device-plugin-daemonset-zlp6c" in "kube-system" namespace to be "Ready" ...
	I0729 20:14:46.759051  140748 pod_ready.go:38] duration metric: took 27.224936452s for extra waiting for all system-critical and pods with labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
	I0729 20:14:46.759068  140748 api_server.go:52] waiting for apiserver process to appear ...
	I0729 20:14:46.759167  140748 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0729 20:14:46.775339  140748 api_server.go:72] duration metric: took 30.696099297s to wait for apiserver process to appear ...
	I0729 20:14:46.775365  140748 api_server.go:88] waiting for apiserver healthz status ...
	I0729 20:14:46.775385  140748 api_server.go:253] Checking apiserver healthz at https://192.168.49.2:8443/healthz ...
	I0729 20:14:46.784121  140748 api_server.go:279] https://192.168.49.2:8443/healthz returned 200:
	ok
	I0729 20:14:46.785619  140748 api_server.go:141] control plane version: v1.30.3
	I0729 20:14:46.785649  140748 api_server.go:131] duration metric: took 10.273707ms to wait for apiserver health ...
	I0729 20:14:46.785666  140748 system_pods.go:43] waiting for kube-system pods to appear ...
	I0729 20:14:46.965763  140748 system_pods.go:59] 18 kube-system pods found
	I0729 20:14:46.965800  140748 system_pods.go:61] "coredns-7db6d8ff4d-8k8vs" [f54cd0d1-6144-43e9-95e0-5850e8a0f6c1] Running
	I0729 20:14:46.965813  140748 system_pods.go:61] "csi-hostpath-attacher-0" [989b010b-d86c-42a2-aa3f-9fbd3403e532] Pending / Ready:ContainersNotReady (containers with unready status: [csi-attacher]) / ContainersReady:ContainersNotReady (containers with unready status: [csi-attacher])
	I0729 20:14:46.965821  140748 system_pods.go:61] "csi-hostpath-resizer-0" [469cb6dc-941b-4d60-bf13-5be21fb501bf] Pending / Ready:ContainersNotReady (containers with unready status: [csi-resizer]) / ContainersReady:ContainersNotReady (containers with unready status: [csi-resizer])
	I0729 20:14:46.965831  140748 system_pods.go:61] "csi-hostpathplugin-6bk8q" [8af4593c-f2de-418f-a833-fb96ab96e099] Pending / Ready:ContainersNotReady (containers with unready status: [csi-external-health-monitor-controller node-driver-registrar hostpath liveness-probe csi-provisioner csi-snapshotter]) / ContainersReady:ContainersNotReady (containers with unready status: [csi-external-health-monitor-controller node-driver-registrar hostpath liveness-probe csi-provisioner csi-snapshotter])
	I0729 20:14:46.965836  140748 system_pods.go:61] "etcd-addons-675434" [9ff0b643-4a6b-4010-8319-814caf5e3746] Running
	I0729 20:14:46.965840  140748 system_pods.go:61] "kindnet-lkf87" [b720690d-973b-43b3-ae11-e6d8ccb632d6] Running
	I0729 20:14:46.965854  140748 system_pods.go:61] "kube-apiserver-addons-675434" [ae737cb0-9a44-4360-b1d6-3af88ba3c3ce] Running
	I0729 20:14:46.965858  140748 system_pods.go:61] "kube-controller-manager-addons-675434" [d1c97bca-68e7-4aef-a5b2-fe68c021c7c0] Running
	I0729 20:14:46.965863  140748 system_pods.go:61] "kube-ingress-dns-minikube" [0053c042-4aa2-4aaf-b829-aaf8afe65e62] Running
	I0729 20:14:46.965872  140748 system_pods.go:61] "kube-proxy-lgnf6" [3335338b-02ba-4e79-936b-86683475fac3] Running
	I0729 20:14:46.965876  140748 system_pods.go:61] "kube-scheduler-addons-675434" [1ec8dd9d-30f9-4754-9fa4-2f1b3e5f0345] Running
	I0729 20:14:46.965882  140748 system_pods.go:61] "metrics-server-c59844bb4-s7q62" [841ddb7c-acf0-4fc5-abf4-3effec07c7b8] Pending / Ready:ContainersNotReady (containers with unready status: [metrics-server]) / ContainersReady:ContainersNotReady (containers with unready status: [metrics-server])
	I0729 20:14:46.965895  140748 system_pods.go:61] "nvidia-device-plugin-daemonset-zlp6c" [f89a77f0-18bd-4f03-acf1-71808e39670a] Running
	I0729 20:14:46.965902  140748 system_pods.go:61] "registry-698f998955-n5fxq" [ddd3ed00-254f-4d67-bfa5-adb9d6cd97e0] Pending / Ready:ContainersNotReady (containers with unready status: [registry]) / ContainersReady:ContainersNotReady (containers with unready status: [registry])
	I0729 20:14:46.965906  140748 system_pods.go:61] "registry-proxy-dhzfq" [0fbb00ba-0628-4de1-abac-af3a3c6ac389] Running
	I0729 20:14:46.965913  140748 system_pods.go:61] "snapshot-controller-745499f584-4clsd" [ca3eda70-c770-4fa8-af09-16e1d18fa9e1] Pending / Ready:ContainersNotReady (containers with unready status: [volume-snapshot-controller]) / ContainersReady:ContainersNotReady (containers with unready status: [volume-snapshot-controller])
	I0729 20:14:46.965925  140748 system_pods.go:61] "snapshot-controller-745499f584-ndqsg" [2322697a-a20e-420e-a6d1-86eb75018105] Pending / Ready:ContainersNotReady (containers with unready status: [volume-snapshot-controller]) / ContainersReady:ContainersNotReady (containers with unready status: [volume-snapshot-controller])
	I0729 20:14:46.965930  140748 system_pods.go:61] "storage-provisioner" [60569edf-da28-4f9a-a60b-77e8c97c48dd] Running
	I0729 20:14:46.965937  140748 system_pods.go:74] duration metric: took 180.26509ms to wait for pod list to return data ...
	I0729 20:14:46.965948  140748 default_sa.go:34] waiting for default service account to be created ...
	I0729 20:14:47.055611  140748 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0729 20:14:47.117683  140748 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0729 20:14:47.160143  140748 default_sa.go:45] found service account: "default"
	I0729 20:14:47.160173  140748 default_sa.go:55] duration metric: took 194.216911ms for default service account to be created ...
	I0729 20:14:47.160183  140748 system_pods.go:116] waiting for k8s-apps to be running ...
	I0729 20:14:47.248213  140748 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0729 20:14:47.366366  140748 system_pods.go:86] 18 kube-system pods found
	I0729 20:14:47.366448  140748 system_pods.go:89] "coredns-7db6d8ff4d-8k8vs" [f54cd0d1-6144-43e9-95e0-5850e8a0f6c1] Running
	I0729 20:14:47.366474  140748 system_pods.go:89] "csi-hostpath-attacher-0" [989b010b-d86c-42a2-aa3f-9fbd3403e532] Pending / Ready:ContainersNotReady (containers with unready status: [csi-attacher]) / ContainersReady:ContainersNotReady (containers with unready status: [csi-attacher])
	I0729 20:14:47.366499  140748 system_pods.go:89] "csi-hostpath-resizer-0" [469cb6dc-941b-4d60-bf13-5be21fb501bf] Pending / Ready:ContainersNotReady (containers with unready status: [csi-resizer]) / ContainersReady:ContainersNotReady (containers with unready status: [csi-resizer])
	I0729 20:14:47.366544  140748 system_pods.go:89] "csi-hostpathplugin-6bk8q" [8af4593c-f2de-418f-a833-fb96ab96e099] Pending / Ready:ContainersNotReady (containers with unready status: [csi-external-health-monitor-controller node-driver-registrar hostpath liveness-probe csi-provisioner csi-snapshotter]) / ContainersReady:ContainersNotReady (containers with unready status: [csi-external-health-monitor-controller node-driver-registrar hostpath liveness-probe csi-provisioner csi-snapshotter])
	I0729 20:14:47.366562  140748 system_pods.go:89] "etcd-addons-675434" [9ff0b643-4a6b-4010-8319-814caf5e3746] Running
	I0729 20:14:47.366583  140748 system_pods.go:89] "kindnet-lkf87" [b720690d-973b-43b3-ae11-e6d8ccb632d6] Running
	I0729 20:14:47.366619  140748 system_pods.go:89] "kube-apiserver-addons-675434" [ae737cb0-9a44-4360-b1d6-3af88ba3c3ce] Running
	I0729 20:14:47.366637  140748 system_pods.go:89] "kube-controller-manager-addons-675434" [d1c97bca-68e7-4aef-a5b2-fe68c021c7c0] Running
	I0729 20:14:47.366657  140748 system_pods.go:89] "kube-ingress-dns-minikube" [0053c042-4aa2-4aaf-b829-aaf8afe65e62] Running
	I0729 20:14:47.366689  140748 system_pods.go:89] "kube-proxy-lgnf6" [3335338b-02ba-4e79-936b-86683475fac3] Running
	I0729 20:14:47.366713  140748 system_pods.go:89] "kube-scheduler-addons-675434" [1ec8dd9d-30f9-4754-9fa4-2f1b3e5f0345] Running
	I0729 20:14:47.366735  140748 system_pods.go:89] "metrics-server-c59844bb4-s7q62" [841ddb7c-acf0-4fc5-abf4-3effec07c7b8] Pending / Ready:ContainersNotReady (containers with unready status: [metrics-server]) / ContainersReady:ContainersNotReady (containers with unready status: [metrics-server])
	I0729 20:14:47.366771  140748 system_pods.go:89] "nvidia-device-plugin-daemonset-zlp6c" [f89a77f0-18bd-4f03-acf1-71808e39670a] Running
	I0729 20:14:47.366798  140748 system_pods.go:89] "registry-698f998955-n5fxq" [ddd3ed00-254f-4d67-bfa5-adb9d6cd97e0] Pending / Ready:ContainersNotReady (containers with unready status: [registry]) / ContainersReady:ContainersNotReady (containers with unready status: [registry])
	I0729 20:14:47.366818  140748 system_pods.go:89] "registry-proxy-dhzfq" [0fbb00ba-0628-4de1-abac-af3a3c6ac389] Running
	I0729 20:14:47.366856  140748 system_pods.go:89] "snapshot-controller-745499f584-4clsd" [ca3eda70-c770-4fa8-af09-16e1d18fa9e1] Pending / Ready:ContainersNotReady (containers with unready status: [volume-snapshot-controller]) / ContainersReady:ContainersNotReady (containers with unready status: [volume-snapshot-controller])
	I0729 20:14:47.366884  140748 system_pods.go:89] "snapshot-controller-745499f584-ndqsg" [2322697a-a20e-420e-a6d1-86eb75018105] Pending / Ready:ContainersNotReady (containers with unready status: [volume-snapshot-controller]) / ContainersReady:ContainersNotReady (containers with unready status: [volume-snapshot-controller])
	I0729 20:14:47.366904  140748 system_pods.go:89] "storage-provisioner" [60569edf-da28-4f9a-a60b-77e8c97c48dd] Running
	I0729 20:14:47.366940  140748 system_pods.go:126] duration metric: took 206.750234ms to wait for k8s-apps to be running ...
	I0729 20:14:47.366967  140748 system_svc.go:44] waiting for kubelet service to be running ....
	I0729 20:14:47.367059  140748 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
	I0729 20:14:47.388085  140748 system_svc.go:56] duration metric: took 21.108402ms WaitForService to wait for kubelet
	I0729 20:14:47.388110  140748 kubeadm.go:582] duration metric: took 31.308876033s to wait for: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
	I0729 20:14:47.388130  140748 node_conditions.go:102] verifying NodePressure condition ...
	I0729 20:14:47.560562  140748 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0729 20:14:47.569316  140748 node_conditions.go:122] node storage ephemeral capacity is 203034800Ki
	I0729 20:14:47.569393  140748 node_conditions.go:123] node cpu capacity is 2
	I0729 20:14:47.569419  140748 node_conditions.go:105] duration metric: took 181.283644ms to run NodePressure ...
	I0729 20:14:47.569445  140748 start.go:241] waiting for startup goroutines ...
	I0729 20:14:47.601311  140748 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0729 20:14:47.746367  140748 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0729 20:14:48.056686  140748 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0729 20:14:48.101362  140748 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0729 20:14:48.246779  140748 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0729 20:14:48.554803  140748 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0729 20:14:48.601309  140748 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0729 20:14:48.746910  140748 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0729 20:14:49.069800  140748 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0729 20:14:49.101292  140748 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0729 20:14:49.245732  140748 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0729 20:14:49.554700  140748 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0729 20:14:49.600822  140748 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0729 20:14:49.745774  140748 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0729 20:14:50.055079  140748 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0729 20:14:50.102031  140748 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0729 20:14:50.245558  140748 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0729 20:14:50.556580  140748 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0729 20:14:50.600767  140748 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0729 20:14:50.745602  140748 kapi.go:107] duration metric: took 24.504972135s to wait for kubernetes.io/minikube-addons=registry ...
	I0729 20:14:51.054989  140748 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0729 20:14:51.100670  140748 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0729 20:14:51.565206  140748 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0729 20:14:51.601514  140748 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0729 20:14:52.058905  140748 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0729 20:14:52.100261  140748 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0729 20:14:52.560902  140748 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0729 20:14:52.606450  140748 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0729 20:14:53.055949  140748 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0729 20:14:53.100695  140748 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0729 20:14:53.557070  140748 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0729 20:14:53.602904  140748 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0729 20:14:54.054498  140748 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0729 20:14:54.100669  140748 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0729 20:14:54.555557  140748 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0729 20:14:54.606172  140748 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0729 20:14:55.055240  140748 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0729 20:14:55.101030  140748 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0729 20:14:55.556475  140748 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0729 20:14:55.602273  140748 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0729 20:14:56.054969  140748 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0729 20:14:56.100775  140748 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0729 20:14:56.555031  140748 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0729 20:14:56.601481  140748 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0729 20:14:57.055720  140748 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0729 20:14:57.101314  140748 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0729 20:14:57.555054  140748 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0729 20:14:57.604484  140748 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0729 20:14:58.056124  140748 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0729 20:14:58.102903  140748 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0729 20:14:58.556232  140748 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0729 20:14:58.603011  140748 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0729 20:14:59.056519  140748 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0729 20:14:59.102218  140748 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0729 20:14:59.560461  140748 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0729 20:14:59.600713  140748 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0729 20:15:00.190130  140748 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0729 20:15:00.198849  140748 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0729 20:15:00.557320  140748 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0729 20:15:00.602079  140748 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0729 20:15:01.054724  140748 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0729 20:15:01.100906  140748 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0729 20:15:01.554840  140748 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0729 20:15:01.601671  140748 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0729 20:15:02.055563  140748 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0729 20:15:02.101704  140748 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0729 20:15:02.555698  140748 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0729 20:15:02.601332  140748 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0729 20:15:03.055070  140748 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0729 20:15:03.100766  140748 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0729 20:15:03.556222  140748 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0729 20:15:03.601438  140748 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0729 20:15:04.055245  140748 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0729 20:15:04.100819  140748 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0729 20:15:04.555273  140748 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0729 20:15:04.601171  140748 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0729 20:15:05.055256  140748 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0729 20:15:05.101447  140748 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0729 20:15:05.555041  140748 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0729 20:15:05.600487  140748 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0729 20:15:06.054961  140748 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0729 20:15:06.100798  140748 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0729 20:15:06.555017  140748 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0729 20:15:06.600485  140748 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0729 20:15:07.056421  140748 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0729 20:15:07.101924  140748 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0729 20:15:07.556728  140748 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0729 20:15:07.601549  140748 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0729 20:15:08.056544  140748 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0729 20:15:08.101801  140748 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0729 20:15:08.555695  140748 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0729 20:15:08.600811  140748 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0729 20:15:09.055194  140748 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0729 20:15:09.100460  140748 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0729 20:15:09.556942  140748 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0729 20:15:09.602908  140748 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0729 20:15:10.059874  140748 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0729 20:15:10.101911  140748 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0729 20:15:10.555663  140748 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0729 20:15:10.601374  140748 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0729 20:15:11.056033  140748 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0729 20:15:11.101395  140748 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0729 20:15:11.555615  140748 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0729 20:15:11.600991  140748 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0729 20:15:12.056121  140748 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0729 20:15:12.103462  140748 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0729 20:15:12.555110  140748 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0729 20:15:12.600391  140748 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0729 20:15:13.056510  140748 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0729 20:15:13.101259  140748 kapi.go:107] duration metric: took 48.505345759s to wait for app.kubernetes.io/name=ingress-nginx ...
	I0729 20:15:13.556215  140748 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0729 20:15:14.055527  140748 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0729 20:15:14.554911  140748 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0729 20:15:15.063303  140748 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0729 20:15:15.555220  140748 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0729 20:15:16.055362  140748 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0729 20:15:16.554828  140748 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0729 20:15:17.055912  140748 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0729 20:15:17.555418  140748 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0729 20:15:18.056385  140748 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0729 20:15:18.554444  140748 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0729 20:15:19.055303  140748 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0729 20:15:19.567253  140748 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0729 20:15:20.059132  140748 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0729 20:15:20.556241  140748 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0729 20:15:21.055319  140748 kapi.go:107] duration metric: took 54.006204512s to wait for kubernetes.io/minikube-addons=csi-hostpath-driver ...
	I0729 20:15:50.345424  140748 kapi.go:86] Found 1 Pods for label selector kubernetes.io/minikube-addons=gcp-auth
	I0729 20:15:50.345454  140748 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0729 20:15:50.846044  140748 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0729 20:15:51.345715  140748 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0729 20:15:51.846409  140748 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0729 20:15:52.346315  140748 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0729 20:15:52.846116  140748 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0729 20:15:53.345808  140748 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0729 20:15:53.845363  140748 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0729 20:15:54.345781  140748 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0729 20:15:54.846341  140748 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0729 20:15:55.346023  140748 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0729 20:15:55.846237  140748 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0729 20:15:56.345497  140748 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0729 20:15:56.846046  140748 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0729 20:15:57.345967  140748 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0729 20:15:57.845551  140748 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0729 20:15:58.346169  140748 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0729 20:15:58.845999  140748 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0729 20:15:59.345651  140748 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0729 20:15:59.857222  140748 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0729 20:16:00.348500  140748 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0729 20:16:00.846598  140748 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0729 20:16:01.347162  140748 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0729 20:16:01.846414  140748 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0729 20:16:02.346263  140748 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0729 20:16:02.846708  140748 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0729 20:16:03.346430  140748 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0729 20:16:03.846238  140748 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0729 20:16:04.346622  140748 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0729 20:16:04.845658  140748 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0729 20:16:05.346243  140748 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0729 20:16:05.845517  140748 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0729 20:16:06.346355  140748 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0729 20:16:06.846253  140748 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0729 20:16:07.345781  140748 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0729 20:16:07.846364  140748 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0729 20:16:08.345875  140748 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0729 20:16:08.845920  140748 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0729 20:16:09.345751  140748 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0729 20:16:09.845927  140748 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0729 20:16:10.346185  140748 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0729 20:16:10.845630  140748 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0729 20:16:11.346565  140748 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0729 20:16:11.848129  140748 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0729 20:16:12.346093  140748 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0729 20:16:12.845758  140748 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0729 20:16:13.346758  140748 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0729 20:16:13.847528  140748 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0729 20:16:14.345655  140748 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0729 20:16:14.846311  140748 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0729 20:16:15.345619  140748 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0729 20:16:15.846462  140748 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0729 20:16:16.345842  140748 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0729 20:16:16.846451  140748 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0729 20:16:17.346491  140748 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0729 20:16:17.846452  140748 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0729 20:16:18.346435  140748 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0729 20:16:18.846053  140748 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0729 20:16:19.346011  140748 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0729 20:16:19.846106  140748 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0729 20:16:20.346673  140748 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0729 20:16:20.845652  140748 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0729 20:16:21.345822  140748 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0729 20:16:21.845875  140748 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0729 20:16:22.345728  140748 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0729 20:16:22.846499  140748 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0729 20:16:23.346156  140748 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0729 20:16:23.845895  140748 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0729 20:16:24.346397  140748 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0729 20:16:24.846423  140748 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0729 20:16:25.345879  140748 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0729 20:16:25.846263  140748 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0729 20:16:26.345801  140748 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0729 20:16:26.846793  140748 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0729 20:16:27.346396  140748 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0729 20:16:27.846510  140748 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0729 20:16:28.345782  140748 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0729 20:16:28.845771  140748 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0729 20:16:29.346638  140748 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0729 20:16:29.845961  140748 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0729 20:16:30.345619  140748 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0729 20:16:30.846365  140748 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0729 20:16:31.345619  140748 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0729 20:16:31.846484  140748 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0729 20:16:32.353717  140748 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0729 20:16:32.846513  140748 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0729 20:16:33.345978  140748 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0729 20:16:33.845724  140748 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0729 20:16:34.346623  140748 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0729 20:16:34.845636  140748 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0729 20:16:35.346390  140748 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0729 20:16:35.845992  140748 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0729 20:16:36.345549  140748 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0729 20:16:36.846247  140748 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0729 20:16:37.345711  140748 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0729 20:16:37.845866  140748 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0729 20:16:38.349709  140748 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0729 20:16:38.846033  140748 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0729 20:16:39.345692  140748 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0729 20:16:39.846475  140748 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0729 20:16:40.346345  140748 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0729 20:16:40.846070  140748 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0729 20:16:41.346008  140748 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0729 20:16:41.846137  140748 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0729 20:16:42.346181  140748 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0729 20:16:42.846338  140748 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0729 20:16:43.346125  140748 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0729 20:16:43.845705  140748 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0729 20:16:44.348550  140748 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0729 20:16:44.846505  140748 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0729 20:16:45.346568  140748 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0729 20:16:45.846299  140748 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0729 20:16:46.345684  140748 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0729 20:16:46.846192  140748 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0729 20:16:47.346391  140748 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0729 20:16:47.845745  140748 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0729 20:16:48.345788  140748 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0729 20:16:48.846320  140748 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0729 20:16:49.346809  140748 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0729 20:16:49.846103  140748 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0729 20:16:50.345505  140748 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0729 20:16:50.846282  140748 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0729 20:16:51.346925  140748 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0729 20:16:51.845597  140748 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0729 20:16:52.346509  140748 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0729 20:16:52.846421  140748 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0729 20:16:53.346233  140748 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0729 20:16:53.845806  140748 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0729 20:16:54.346982  140748 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0729 20:16:54.845659  140748 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0729 20:16:55.346583  140748 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0729 20:16:55.846159  140748 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0729 20:16:56.346067  140748 kapi.go:107] duration metric: took 2m28.003693915s to wait for kubernetes.io/minikube-addons=gcp-auth ...
	I0729 20:16:56.348187  140748 out.go:177] * Your GCP credentials will now be mounted into every pod created in the addons-675434 cluster.
	I0729 20:16:56.350258  140748 out.go:177] * If you don't want your credentials mounted into a specific pod, add a label with the `gcp-auth-skip-secret` key to your pod configuration.
	I0729 20:16:56.352011  140748 out.go:177] * If you want existing pods to be mounted with credentials, either recreate them or rerun addons enable with --refresh.
	I0729 20:16:56.353555  140748 out.go:177] * Enabled addons: ingress-dns, storage-provisioner, nvidia-device-plugin, cloud-spanner, volcano, metrics-server, inspektor-gadget, yakd, default-storageclass, volumesnapshots, registry, ingress, csi-hostpath-driver, gcp-auth
	I0729 20:16:56.355610  140748 addons.go:510] duration metric: took 2m40.276027244s for enable addons: enabled=[ingress-dns storage-provisioner nvidia-device-plugin cloud-spanner volcano metrics-server inspektor-gadget yakd default-storageclass volumesnapshots registry ingress csi-hostpath-driver gcp-auth]
	I0729 20:16:56.355651  140748 start.go:246] waiting for cluster config update ...
	I0729 20:16:56.355671  140748 start.go:255] writing updated cluster config ...
	I0729 20:16:56.356030  140748 ssh_runner.go:195] Run: rm -f paused
	I0729 20:16:56.731541  140748 start.go:600] kubectl: 1.30.3, cluster: 1.30.3 (minor skew: 0)
	I0729 20:16:56.733347  140748 out.go:177] * Done! kubectl is now configured to use "addons-675434" cluster and "default" namespace by default
	
	
	==> container status <==
	CONTAINER           IMAGE               CREATED             STATE               NAME                                     ATTEMPT             POD ID              POD
	28e10d0c99b61       d1ca868ab82aa       2 minutes ago       Exited              gadget                                   5                   647c6e19c463c       gadget-p7qgn
	cf5e818bc1a3a       6ef582f3ec844       3 minutes ago       Running             gcp-auth                                 0                   e6a1755c7f597       gcp-auth-5db96cd9b4-zjqmm
	47ffe1726917d       8b46b1cd48760       4 minutes ago       Running             admission                                0                   16c5cffe2cc93       volcano-admission-5f7844f7bc-6c299
	bc6c2e90f10c7       ee6d597e62dc8       4 minutes ago       Running             csi-snapshotter                          0                   c2e7412849082       csi-hostpathplugin-6bk8q
	5dd94551f43bd       642ded511e141       4 minutes ago       Running             csi-provisioner                          0                   c2e7412849082       csi-hostpathplugin-6bk8q
	6e2923c7bab0a       922312104da8a       4 minutes ago       Running             liveness-probe                           0                   c2e7412849082       csi-hostpathplugin-6bk8q
	dd1b2f572f867       08f6b2990811a       4 minutes ago       Running             hostpath                                 0                   c2e7412849082       csi-hostpathplugin-6bk8q
	2a49ab2673f44       0107d56dbc0be       5 minutes ago       Running             node-driver-registrar                    0                   c2e7412849082       csi-hostpathplugin-6bk8q
	b62644e3ec2bf       24f8f979639f1       5 minutes ago       Running             controller                               0                   bcdb66046b529       ingress-nginx-controller-6d9bd977d4-7b9mc
	b3aba9e68923d       d9c7ad4c226bf       5 minutes ago       Running             volcano-scheduler                        0                   b39828f89f098       volcano-scheduler-844f6db89b-znvvt
	9a8705e80c93f       1461903ec4fe9       5 minutes ago       Running             csi-external-health-monitor-controller   0                   c2e7412849082       csi-hostpathplugin-6bk8q
	37aeb9e5b3d67       296b5f799fcd8       5 minutes ago       Exited              patch                                    0                   b85d5afeaa792       ingress-nginx-admission-patch-klphm
	2a330a6601ba5       9a80d518f102c       5 minutes ago       Running             csi-attacher                             0                   cd3b0436d3f0c       csi-hostpath-attacher-0
	46d3714b5495a       1505f556b3a7b       5 minutes ago       Running             volcano-controllers                      0                   d6eddb1b89f6a       volcano-controllers-59cb4746db-rb47v
	691956196029c       487fa743e1e22       5 minutes ago       Running             csi-resizer                              0                   5888a09151f81       csi-hostpath-resizer-0
	705986f1c0041       4d1e5c3e97420       5 minutes ago       Running             volume-snapshot-controller               0                   cdd42b02ef630       snapshot-controller-745499f584-4clsd
	dc7a4f793905f       95dccb4df54ab       5 minutes ago       Running             metrics-server                           0                   d9a488298fa65       metrics-server-c59844bb4-s7q62
	89b7b9f4b1ffa       296b5f799fcd8       5 minutes ago       Exited              create                                   0                   a3e7a83bb80b1       ingress-nginx-admission-create-p5ggn
	3664bd2378516       4d1e5c3e97420       5 minutes ago       Running             volume-snapshot-controller               0                   add5036ff284e       snapshot-controller-745499f584-ndqsg
	960a1fe209415       7ce2150c8929b       5 minutes ago       Running             local-path-provisioner                   0                   6e045fe8e2ec2       local-path-provisioner-8d985888d-6sdx2
	e6237b0648966       6fed88f43b276       5 minutes ago       Running             registry                                 0                   789230b91c017       registry-698f998955-n5fxq
	1177eb9ebbd8a       77bdba588b953       5 minutes ago       Running             yakd                                     0                   3a39873005232       yakd-dashboard-799879c74f-bhl8b
	7d74b17b04b36       e396bbd29d2f6       5 minutes ago       Running             nvidia-device-plugin-ctr                 0                   11eab20526a71       nvidia-device-plugin-daemonset-zlp6c
	e840fbb5b8a78       2437cf7621777       5 minutes ago       Running             coredns                                  0                   87e6a0e185c38       coredns-7db6d8ff4d-8k8vs
	1db5bc4ded7d5       3410e1561990a       5 minutes ago       Running             registry-proxy                           0                   a1316d4cfaa6b       registry-proxy-dhzfq
	8f38f92bfdf68       53af6e2c4c343       5 minutes ago       Running             cloud-spanner-emulator                   0                   35f43b3a432b1       cloud-spanner-emulator-5455fb9b69-kjpzj
	3d57f30084463       35508c2f890c4       5 minutes ago       Running             minikube-ingress-dns                     0                   b5b95a484ce77       kube-ingress-dns-minikube
	3282895f69531       ba04bb24b9575       5 minutes ago       Running             storage-provisioner                      0                   1e5d8fbf50d5a       storage-provisioner
	3d64ba114607f       f42786f8afd22       5 minutes ago       Running             kindnet-cni                              0                   2ffbdd025cf8f       kindnet-lkf87
	5d4a2bc500417       2351f570ed0ea       5 minutes ago       Running             kube-proxy                               0                   05f24b000f565       kube-proxy-lgnf6
	bb048f546b4b6       8e97cdb19e7cc       6 minutes ago       Running             kube-controller-manager                  0                   2508e57533885       kube-controller-manager-addons-675434
	4a0a19b5bbfe7       61773190d42ff       6 minutes ago       Running             kube-apiserver                           0                   3cd257337f6a9       kube-apiserver-addons-675434
	ca46b507e99ce       d48f992a22722       6 minutes ago       Running             kube-scheduler                           0                   5efd06e4757aa       kube-scheduler-addons-675434
	91ce10c58e618       014faa467e297       6 minutes ago       Running             etcd                                     0                   b4b2ace30efe2       etcd-addons-675434
	
	
	==> containerd <==
	Jul 29 20:18:02 addons-675434 containerd[819]: time="2024-07-29T20:18:02.348786938Z" level=info msg="TearDown network for sandbox \"5b6c0b468a8a658777d33c8847bc0e958dc06afe1689f54675e308c380542de2\" successfully"
	Jul 29 20:18:02 addons-675434 containerd[819]: time="2024-07-29T20:18:02.355603549Z" level=warning msg="Failed to get podSandbox status for container event for sandboxID \"5b6c0b468a8a658777d33c8847bc0e958dc06afe1689f54675e308c380542de2\": an error occurred when try to find sandbox: not found. Sending the event with nil podSandboxStatus."
	Jul 29 20:18:02 addons-675434 containerd[819]: time="2024-07-29T20:18:02.356092375Z" level=info msg="RemovePodSandbox \"5b6c0b468a8a658777d33c8847bc0e958dc06afe1689f54675e308c380542de2\" returns successfully"
	Jul 29 20:18:02 addons-675434 containerd[819]: time="2024-07-29T20:18:02.356895983Z" level=info msg="StopPodSandbox for \"196faf862cd94c82c9f641a518253b464604adb01cd1a83d44cd1f7abd2ae768\""
	Jul 29 20:18:02 addons-675434 containerd[819]: time="2024-07-29T20:18:02.364472297Z" level=info msg="TearDown network for sandbox \"196faf862cd94c82c9f641a518253b464604adb01cd1a83d44cd1f7abd2ae768\" successfully"
	Jul 29 20:18:02 addons-675434 containerd[819]: time="2024-07-29T20:18:02.364511058Z" level=info msg="StopPodSandbox for \"196faf862cd94c82c9f641a518253b464604adb01cd1a83d44cd1f7abd2ae768\" returns successfully"
	Jul 29 20:18:02 addons-675434 containerd[819]: time="2024-07-29T20:18:02.365034426Z" level=info msg="RemovePodSandbox for \"196faf862cd94c82c9f641a518253b464604adb01cd1a83d44cd1f7abd2ae768\""
	Jul 29 20:18:02 addons-675434 containerd[819]: time="2024-07-29T20:18:02.365080579Z" level=info msg="Forcibly stopping sandbox \"196faf862cd94c82c9f641a518253b464604adb01cd1a83d44cd1f7abd2ae768\""
	Jul 29 20:18:02 addons-675434 containerd[819]: time="2024-07-29T20:18:02.373696378Z" level=info msg="TearDown network for sandbox \"196faf862cd94c82c9f641a518253b464604adb01cd1a83d44cd1f7abd2ae768\" successfully"
	Jul 29 20:18:02 addons-675434 containerd[819]: time="2024-07-29T20:18:02.380085962Z" level=warning msg="Failed to get podSandbox status for container event for sandboxID \"196faf862cd94c82c9f641a518253b464604adb01cd1a83d44cd1f7abd2ae768\": an error occurred when try to find sandbox: not found. Sending the event with nil podSandboxStatus."
	Jul 29 20:18:02 addons-675434 containerd[819]: time="2024-07-29T20:18:02.380209758Z" level=info msg="RemovePodSandbox \"196faf862cd94c82c9f641a518253b464604adb01cd1a83d44cd1f7abd2ae768\" returns successfully"
	Jul 29 20:18:14 addons-675434 containerd[819]: time="2024-07-29T20:18:14.279054017Z" level=info msg="PullImage \"ghcr.io/inspektor-gadget/inspektor-gadget:v0.30.0@sha256:bda802dd37a41ba160bf10134538fd1a1ce05efcc14ab4c38b5f6b1e6dccd734\""
	Jul 29 20:18:14 addons-675434 containerd[819]: time="2024-07-29T20:18:14.404267736Z" level=info msg="ImageUpdate event name:\"ghcr.io/inspektor-gadget/inspektor-gadget@sha256:bda802dd37a41ba160bf10134538fd1a1ce05efcc14ab4c38b5f6b1e6dccd734\" labels:{key:\"io.cri-containerd.image\" value:\"managed\"}"
	Jul 29 20:18:14 addons-675434 containerd[819]: time="2024-07-29T20:18:14.405834544Z" level=info msg="stop pulling image ghcr.io/inspektor-gadget/inspektor-gadget@sha256:bda802dd37a41ba160bf10134538fd1a1ce05efcc14ab4c38b5f6b1e6dccd734: active requests=0, bytes read=89"
	Jul 29 20:18:14 addons-675434 containerd[819]: time="2024-07-29T20:18:14.409440502Z" level=info msg="Pulled image \"ghcr.io/inspektor-gadget/inspektor-gadget:v0.30.0@sha256:bda802dd37a41ba160bf10134538fd1a1ce05efcc14ab4c38b5f6b1e6dccd734\" with image id \"sha256:d1ca868ab82aa865a5f7b689c320359f3e31172de7b93dd0107fe2e49e617eeb\", repo tag \"\", repo digest \"ghcr.io/inspektor-gadget/inspektor-gadget@sha256:bda802dd37a41ba160bf10134538fd1a1ce05efcc14ab4c38b5f6b1e6dccd734\", size \"73046218\" in 129.731418ms"
	Jul 29 20:18:14 addons-675434 containerd[819]: time="2024-07-29T20:18:14.409490552Z" level=info msg="PullImage \"ghcr.io/inspektor-gadget/inspektor-gadget:v0.30.0@sha256:bda802dd37a41ba160bf10134538fd1a1ce05efcc14ab4c38b5f6b1e6dccd734\" returns image reference \"sha256:d1ca868ab82aa865a5f7b689c320359f3e31172de7b93dd0107fe2e49e617eeb\""
	Jul 29 20:18:14 addons-675434 containerd[819]: time="2024-07-29T20:18:14.411818984Z" level=info msg="CreateContainer within sandbox \"647c6e19c463c28bb5518e0f62556df88dbf303d69b9476b77e5c44bd43bf967\" for container &ContainerMetadata{Name:gadget,Attempt:5,}"
	Jul 29 20:18:14 addons-675434 containerd[819]: time="2024-07-29T20:18:14.443302619Z" level=info msg="CreateContainer within sandbox \"647c6e19c463c28bb5518e0f62556df88dbf303d69b9476b77e5c44bd43bf967\" for &ContainerMetadata{Name:gadget,Attempt:5,} returns container id \"28e10d0c99b61d91280920af08157e6932ce183fe139c9eece0d925119f86846\""
	Jul 29 20:18:14 addons-675434 containerd[819]: time="2024-07-29T20:18:14.444170685Z" level=info msg="StartContainer for \"28e10d0c99b61d91280920af08157e6932ce183fe139c9eece0d925119f86846\""
	Jul 29 20:18:14 addons-675434 containerd[819]: time="2024-07-29T20:18:14.502281014Z" level=info msg="StartContainer for \"28e10d0c99b61d91280920af08157e6932ce183fe139c9eece0d925119f86846\" returns successfully"
	Jul 29 20:18:15 addons-675434 containerd[819]: time="2024-07-29T20:18:15.702932774Z" level=info msg="shim disconnected" id=28e10d0c99b61d91280920af08157e6932ce183fe139c9eece0d925119f86846 namespace=k8s.io
	Jul 29 20:18:15 addons-675434 containerd[819]: time="2024-07-29T20:18:15.702998873Z" level=warning msg="cleaning up after shim disconnected" id=28e10d0c99b61d91280920af08157e6932ce183fe139c9eece0d925119f86846 namespace=k8s.io
	Jul 29 20:18:15 addons-675434 containerd[819]: time="2024-07-29T20:18:15.703044952Z" level=info msg="cleaning up dead shim" namespace=k8s.io
	Jul 29 20:18:16 addons-675434 containerd[819]: time="2024-07-29T20:18:16.373426997Z" level=info msg="RemoveContainer for \"035fb4e2f2dafe28dff047bc2c91544f158846d513695c178d17554e18cfb27b\""
	Jul 29 20:18:16 addons-675434 containerd[819]: time="2024-07-29T20:18:16.401076568Z" level=info msg="RemoveContainer for \"035fb4e2f2dafe28dff047bc2c91544f158846d513695c178d17554e18cfb27b\" returns successfully"
	
	
	==> coredns [e840fbb5b8a78303353a280806256592cc44ce0ee998e981216df7e055b361ac] <==
	[INFO] 10.244.0.2:48378 - 30819 "AAAA IN registry.kube-system.svc.cluster.local.cluster.local. udp 70 false 512" NXDOMAIN qr,aa,rd 163 0.000046358s
	[INFO] 10.244.0.2:52370 - 1169 "A IN registry.kube-system.svc.cluster.local.us-east-2.compute.internal. udp 83 false 512" NXDOMAIN qr,rd,ra 83 0.001835274s
	[INFO] 10.244.0.2:52370 - 8343 "AAAA IN registry.kube-system.svc.cluster.local.us-east-2.compute.internal. udp 83 false 512" NXDOMAIN qr,rd,ra 83 0.001493644s
	[INFO] 10.244.0.2:46592 - 24432 "A IN registry.kube-system.svc.cluster.local. udp 56 false 512" NOERROR qr,aa,rd 110 0.000071736s
	[INFO] 10.244.0.2:46592 - 41334 "AAAA IN registry.kube-system.svc.cluster.local. udp 56 false 512" NOERROR qr,aa,rd 149 0.000334515s
	[INFO] 10.244.0.2:38093 - 29185 "AAAA IN registry.kube-system.svc.cluster.local.kube-system.svc.cluster.local. udp 86 false 512" NXDOMAIN qr,aa,rd 179 0.00012446s
	[INFO] 10.244.0.2:38093 - 9220 "A IN registry.kube-system.svc.cluster.local.kube-system.svc.cluster.local. udp 86 false 512" NXDOMAIN qr,aa,rd 179 0.00018841s
	[INFO] 10.244.0.2:43747 - 50868 "AAAA IN registry.kube-system.svc.cluster.local.svc.cluster.local. udp 74 false 512" NXDOMAIN qr,aa,rd 167 0.000091338s
	[INFO] 10.244.0.2:43747 - 16056 "A IN registry.kube-system.svc.cluster.local.svc.cluster.local. udp 74 false 512" NXDOMAIN qr,aa,rd 167 0.000044865s
	[INFO] 10.244.0.2:45595 - 160 "AAAA IN registry.kube-system.svc.cluster.local.cluster.local. udp 70 false 512" NXDOMAIN qr,aa,rd 163 0.000115066s
	[INFO] 10.244.0.2:45595 - 3490 "A IN registry.kube-system.svc.cluster.local.cluster.local. udp 70 false 512" NXDOMAIN qr,aa,rd 163 0.000243777s
	[INFO] 10.244.0.2:56733 - 36273 "A IN registry.kube-system.svc.cluster.local.us-east-2.compute.internal. udp 83 false 512" NXDOMAIN qr,rd,ra 83 0.008024633s
	[INFO] 10.244.0.2:56733 - 20147 "AAAA IN registry.kube-system.svc.cluster.local.us-east-2.compute.internal. udp 83 false 512" NXDOMAIN qr,rd,ra 83 0.001975603s
	[INFO] 10.244.0.2:59055 - 44410 "A IN registry.kube-system.svc.cluster.local. udp 56 false 512" NOERROR qr,aa,rd 110 0.000102521s
	[INFO] 10.244.0.2:59055 - 4724 "AAAA IN registry.kube-system.svc.cluster.local. udp 56 false 512" NOERROR qr,aa,rd 149 0.000057484s
	[INFO] 10.244.0.24:52817 - 34564 "AAAA IN storage.googleapis.com.gcp-auth.svc.cluster.local. udp 78 false 1232" NXDOMAIN qr,aa,rd 160 0.00025295s
	[INFO] 10.244.0.24:54524 - 62072 "A IN storage.googleapis.com.gcp-auth.svc.cluster.local. udp 78 false 1232" NXDOMAIN qr,aa,rd 160 0.000303845s
	[INFO] 10.244.0.24:58192 - 58302 "AAAA IN storage.googleapis.com.svc.cluster.local. udp 69 false 1232" NXDOMAIN qr,aa,rd 151 0.000123238s
	[INFO] 10.244.0.24:44692 - 35376 "A IN storage.googleapis.com.svc.cluster.local. udp 69 false 1232" NXDOMAIN qr,aa,rd 151 0.000165371s
	[INFO] 10.244.0.24:49261 - 46156 "AAAA IN storage.googleapis.com.cluster.local. udp 65 false 1232" NXDOMAIN qr,aa,rd 147 0.000099346s
	[INFO] 10.244.0.24:44413 - 25345 "A IN storage.googleapis.com.cluster.local. udp 65 false 1232" NXDOMAIN qr,aa,rd 147 0.000080482s
	[INFO] 10.244.0.24:56923 - 1208 "AAAA IN storage.googleapis.com.us-east-2.compute.internal. udp 78 false 1232" NXDOMAIN qr,rd,ra 67 0.002052467s
	[INFO] 10.244.0.24:58145 - 49950 "A IN storage.googleapis.com.us-east-2.compute.internal. udp 78 false 1232" NXDOMAIN qr,rd,ra 67 0.001913196s
	[INFO] 10.244.0.24:52286 - 61209 "AAAA IN storage.googleapis.com. udp 51 false 1232" NOERROR qr,rd,ra 240 0.000754642s
	[INFO] 10.244.0.24:54929 - 64542 "A IN storage.googleapis.com. udp 51 false 1232" NOERROR qr,rd,ra 648 0.000735638s
	
	
	==> describe nodes <==
	Name:               addons-675434
	Roles:              control-plane
	Labels:             beta.kubernetes.io/arch=arm64
	                    beta.kubernetes.io/os=linux
	                    kubernetes.io/arch=arm64
	                    kubernetes.io/hostname=addons-675434
	                    kubernetes.io/os=linux
	                    minikube.k8s.io/commit=de53afae5e8f4269438099f4dad14d93a8a17e35
	                    minikube.k8s.io/name=addons-675434
	                    minikube.k8s.io/primary=true
	                    minikube.k8s.io/updated_at=2024_07_29T20_14_03_0700
	                    minikube.k8s.io/version=v1.33.1
	                    node-role.kubernetes.io/control-plane=
	                    node.kubernetes.io/exclude-from-external-load-balancers=
	                    topology.hostpath.csi/node=addons-675434
	Annotations:        csi.volume.kubernetes.io/nodeid: {"hostpath.csi.k8s.io":"addons-675434"}
	                    kubeadm.alpha.kubernetes.io/cri-socket: unix:///run/containerd/containerd.sock
	                    node.alpha.kubernetes.io/ttl: 0
	                    volumes.kubernetes.io/controller-managed-attach-detach: true
	CreationTimestamp:  Mon, 29 Jul 2024 20:13:59 +0000
	Taints:             <none>
	Unschedulable:      false
	Lease:
	  HolderIdentity:  addons-675434
	  AcquireTime:     <unset>
	  RenewTime:       Mon, 29 Jul 2024 20:20:09 +0000
	Conditions:
	  Type             Status  LastHeartbeatTime                 LastTransitionTime                Reason                       Message
	  ----             ------  -----------------                 ------------------                ------                       -------
	  MemoryPressure   False   Mon, 29 Jul 2024 20:17:06 +0000   Mon, 29 Jul 2024 20:13:56 +0000   KubeletHasSufficientMemory   kubelet has sufficient memory available
	  DiskPressure     False   Mon, 29 Jul 2024 20:17:06 +0000   Mon, 29 Jul 2024 20:13:56 +0000   KubeletHasNoDiskPressure     kubelet has no disk pressure
	  PIDPressure      False   Mon, 29 Jul 2024 20:17:06 +0000   Mon, 29 Jul 2024 20:13:56 +0000   KubeletHasSufficientPID      kubelet has sufficient PID available
	  Ready            True    Mon, 29 Jul 2024 20:17:06 +0000   Mon, 29 Jul 2024 20:14:02 +0000   KubeletReady                 kubelet is posting ready status
	Addresses:
	  InternalIP:  192.168.49.2
	  Hostname:    addons-675434
	Capacity:
	  cpu:                2
	  ephemeral-storage:  203034800Ki
	  hugepages-1Gi:      0
	  hugepages-2Mi:      0
	  hugepages-32Mi:     0
	  hugepages-64Ki:     0
	  memory:             8022364Ki
	  pods:               110
	Allocatable:
	  cpu:                2
	  ephemeral-storage:  203034800Ki
	  hugepages-1Gi:      0
	  hugepages-2Mi:      0
	  hugepages-32Mi:     0
	  hugepages-64Ki:     0
	  memory:             8022364Ki
	  pods:               110
	System Info:
	  Machine ID:                 b454746fdafd488b9e56e3099d682b70
	  System UUID:                a0c62109-9d19-49be-a08a-359f159d5cb7
	  Boot ID:                    f43244bd-8d62-45f7-a4e7-2b350386049a
	  Kernel Version:             5.15.0-1065-aws
	  OS Image:                   Ubuntu 22.04.4 LTS
	  Operating System:           linux
	  Architecture:               arm64
	  Container Runtime Version:  containerd://1.7.19
	  Kubelet Version:            v1.30.3
	  Kube-Proxy Version:         v1.30.3
	PodCIDR:                      10.244.0.0/24
	PodCIDRs:                     10.244.0.0/24
	Non-terminated Pods:          (27 in total)
	  Namespace                   Name                                         CPU Requests  CPU Limits  Memory Requests  Memory Limits  Age
	  ---------                   ----                                         ------------  ----------  ---------------  -------------  ---
	  default                     cloud-spanner-emulator-5455fb9b69-kjpzj      0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         5m56s
	  gadget                      gadget-p7qgn                                 0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         5m53s
	  gcp-auth                    gcp-auth-5db96cd9b4-zjqmm                    0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         4m25s
	  ingress-nginx               ingress-nginx-controller-6d9bd977d4-7b9mc    100m (5%!)(MISSING)     0 (0%!)(MISSING)      90Mi (1%!)(MISSING)        0 (0%!)(MISSING)         5m51s
	  kube-system                 coredns-7db6d8ff4d-8k8vs                     100m (5%!)(MISSING)     0 (0%!)(MISSING)      70Mi (0%!)(MISSING)        170Mi (2%!)(MISSING)     5m59s
	  kube-system                 csi-hostpath-attacher-0                      0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         5m49s
	  kube-system                 csi-hostpath-resizer-0                       0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         5m49s
	  kube-system                 csi-hostpathplugin-6bk8q                     0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         5m49s
	  kube-system                 etcd-addons-675434                           100m (5%!)(MISSING)     0 (0%!)(MISSING)      100Mi (1%!)(MISSING)       0 (0%!)(MISSING)         6m13s
	  kube-system                 kindnet-lkf87                                100m (5%!)(MISSING)     100m (5%!)(MISSING)   50Mi (0%!)(MISSING)        50Mi (0%!)(MISSING)      5m59s
	  kube-system                 kube-apiserver-addons-675434                 250m (12%!)(MISSING)    0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         6m13s
	  kube-system                 kube-controller-manager-addons-675434        200m (10%!)(MISSING)    0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         6m14s
	  kube-system                 kube-ingress-dns-minikube                    0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         5m55s
	  kube-system                 kube-proxy-lgnf6                             0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         5m59s
	  kube-system                 kube-scheduler-addons-675434                 100m (5%!)(MISSING)     0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         6m13s
	  kube-system                 metrics-server-c59844bb4-s7q62               100m (5%!)(MISSING)     0 (0%!)(MISSING)      200Mi (2%!)(MISSING)       0 (0%!)(MISSING)         5m54s
	  kube-system                 nvidia-device-plugin-daemonset-zlp6c         0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         5m56s
	  kube-system                 registry-698f998955-n5fxq                    0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         5m55s
	  kube-system                 registry-proxy-dhzfq                         0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         5m55s
	  kube-system                 snapshot-controller-745499f584-4clsd         0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         5m52s
	  kube-system                 snapshot-controller-745499f584-ndqsg         0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         5m52s
	  kube-system                 storage-provisioner                          0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         5m54s
	  local-path-storage          local-path-provisioner-8d985888d-6sdx2       0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         5m53s
	  volcano-system              volcano-admission-5f7844f7bc-6c299           0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         5m51s
	  volcano-system              volcano-controllers-59cb4746db-rb47v         0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         5m50s
	  volcano-system              volcano-scheduler-844f6db89b-znvvt           0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         5m50s
	  yakd-dashboard              yakd-dashboard-799879c74f-bhl8b              0 (0%!)(MISSING)        0 (0%!)(MISSING)      128Mi (1%!)(MISSING)       256Mi (3%!)(MISSING)     5m53s
	Allocated resources:
	  (Total limits may be over 100 percent, i.e., overcommitted.)
	  Resource           Requests     Limits
	  --------           --------     ------
	  cpu                1050m (52%!)(MISSING)  100m (5%!)(MISSING)
	  memory             638Mi (8%!)(MISSING)   476Mi (6%!)(MISSING)
	  ephemeral-storage  0 (0%!)(MISSING)       0 (0%!)(MISSING)
	  hugepages-1Gi      0 (0%!)(MISSING)       0 (0%!)(MISSING)
	  hugepages-2Mi      0 (0%!)(MISSING)       0 (0%!)(MISSING)
	  hugepages-32Mi     0 (0%!)(MISSING)       0 (0%!)(MISSING)
	  hugepages-64Ki     0 (0%!)(MISSING)       0 (0%!)(MISSING)
	Events:
	  Type    Reason                   Age    From             Message
	  ----    ------                   ----   ----             -------
	  Normal  Starting                 5m58s  kube-proxy       
	  Normal  Starting                 6m13s  kubelet          Starting kubelet.
	  Normal  NodeHasSufficientMemory  6m13s  kubelet          Node addons-675434 status is now: NodeHasSufficientMemory
	  Normal  NodeHasNoDiskPressure    6m13s  kubelet          Node addons-675434 status is now: NodeHasNoDiskPressure
	  Normal  NodeHasSufficientPID     6m13s  kubelet          Node addons-675434 status is now: NodeHasSufficientPID
	  Normal  NodeNotReady             6m13s  kubelet          Node addons-675434 status is now: NodeNotReady
	  Normal  NodeAllocatableEnforced  6m13s  kubelet          Updated Node Allocatable limit across pods
	  Normal  NodeReady                6m13s  kubelet          Node addons-675434 status is now: NodeReady
	  Normal  RegisteredNode           6m     node-controller  Node addons-675434 event: Registered Node addons-675434 in Controller
	
	
	==> dmesg <==
	[  +0.000756] FS-Cache: N-cookie c=000000bf [p=000000b6 fl=2 nc=0 na=1]
	[  +0.000938] FS-Cache: N-cookie d=0000000075a7dcb2{9p.inode} n=00000000de0d9c89
	[  +0.001059] FS-Cache: N-key=[8] 'a2e4c90000000000'
	[  +0.007811] FS-Cache: Duplicate cookie detected
	[  +0.000711] FS-Cache: O-cookie c=000000b9 [p=000000b6 fl=226 nc=0 na=1]
	[  +0.001020] FS-Cache: O-cookie d=0000000075a7dcb2{9p.inode} n=00000000ba4d94c9
	[  +0.001133] FS-Cache: O-key=[8] 'a2e4c90000000000'
	[  +0.000766] FS-Cache: N-cookie c=000000c0 [p=000000b6 fl=2 nc=0 na=1]
	[  +0.000952] FS-Cache: N-cookie d=0000000075a7dcb2{9p.inode} n=00000000387dd0f7
	[  +0.001040] FS-Cache: N-key=[8] 'a2e4c90000000000'
	[  +2.417137] FS-Cache: Duplicate cookie detected
	[  +0.000709] FS-Cache: O-cookie c=000000b7 [p=000000b6 fl=226 nc=0 na=1]
	[  +0.000958] FS-Cache: O-cookie d=0000000075a7dcb2{9p.inode} n=000000008a02a494
	[  +0.001044] FS-Cache: O-key=[8] 'a1e4c90000000000'
	[  +0.000810] FS-Cache: N-cookie c=000000c2 [p=000000b6 fl=2 nc=0 na=1]
	[  +0.000940] FS-Cache: N-cookie d=0000000075a7dcb2{9p.inode} n=00000000de0d9c89
	[  +0.001042] FS-Cache: N-key=[8] 'a1e4c90000000000'
	[  +0.303041] FS-Cache: Duplicate cookie detected
	[  +0.000701] FS-Cache: O-cookie c=000000bc [p=000000b6 fl=226 nc=0 na=1]
	[  +0.000968] FS-Cache: O-cookie d=0000000075a7dcb2{9p.inode} n=000000008a938d3f
	[  +0.001041] FS-Cache: O-key=[8] 'a7e4c90000000000'
	[  +0.000757] FS-Cache: N-cookie c=000000c3 [p=000000b6 fl=2 nc=0 na=1]
	[  +0.000955] FS-Cache: N-cookie d=0000000075a7dcb2{9p.inode} n=00000000775b4a71
	[  +0.001393] FS-Cache: N-key=[8] 'a7e4c90000000000'
	[Jul29 20:00] systemd-journald[222]: Failed to send stream file descriptor to service manager: Connection refused
	
	
	==> etcd [91ce10c58e61842c4b4fe4895a48c3dc0a266480e4c61fe72e03402ec11bd494] <==
	{"level":"info","ts":"2024-07-29T20:13:55.604548Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"aec36adc501070cc switched to configuration voters=(12593026477526642892)"}
	{"level":"info","ts":"2024-07-29T20:13:55.604626Z","caller":"membership/cluster.go:421","msg":"added member","cluster-id":"fa54960ea34d58be","local-member-id":"aec36adc501070cc","added-peer-id":"aec36adc501070cc","added-peer-peer-urls":["https://192.168.49.2:2380"]}
	{"level":"info","ts":"2024-07-29T20:13:55.606011Z","caller":"embed/etcd.go:726","msg":"starting with client TLS","tls-info":"cert = /var/lib/minikube/certs/etcd/server.crt, key = /var/lib/minikube/certs/etcd/server.key, client-cert=, client-key=, trusted-ca = /var/lib/minikube/certs/etcd/ca.crt, client-cert-auth = true, crl-file = ","cipher-suites":[]}
	{"level":"info","ts":"2024-07-29T20:13:55.606193Z","caller":"embed/etcd.go:277","msg":"now serving peer/client/metrics","local-member-id":"aec36adc501070cc","initial-advertise-peer-urls":["https://192.168.49.2:2380"],"listen-peer-urls":["https://192.168.49.2:2380"],"advertise-client-urls":["https://192.168.49.2:2379"],"listen-client-urls":["https://127.0.0.1:2379","https://192.168.49.2:2379"],"listen-metrics-urls":["http://127.0.0.1:2381"]}
	{"level":"info","ts":"2024-07-29T20:13:55.606215Z","caller":"embed/etcd.go:857","msg":"serving metrics","address":"http://127.0.0.1:2381"}
	{"level":"info","ts":"2024-07-29T20:13:55.606313Z","caller":"embed/etcd.go:597","msg":"serving peer traffic","address":"192.168.49.2:2380"}
	{"level":"info","ts":"2024-07-29T20:13:55.606322Z","caller":"embed/etcd.go:569","msg":"cmux::serve","address":"192.168.49.2:2380"}
	{"level":"info","ts":"2024-07-29T20:13:56.556011Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"aec36adc501070cc is starting a new election at term 1"}
	{"level":"info","ts":"2024-07-29T20:13:56.556234Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"aec36adc501070cc became pre-candidate at term 1"}
	{"level":"info","ts":"2024-07-29T20:13:56.556379Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"aec36adc501070cc received MsgPreVoteResp from aec36adc501070cc at term 1"}
	{"level":"info","ts":"2024-07-29T20:13:56.556485Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"aec36adc501070cc became candidate at term 2"}
	{"level":"info","ts":"2024-07-29T20:13:56.556587Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"aec36adc501070cc received MsgVoteResp from aec36adc501070cc at term 2"}
	{"level":"info","ts":"2024-07-29T20:13:56.556669Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"aec36adc501070cc became leader at term 2"}
	{"level":"info","ts":"2024-07-29T20:13:56.556766Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"raft.node: aec36adc501070cc elected leader aec36adc501070cc at term 2"}
	{"level":"info","ts":"2024-07-29T20:13:56.564101Z","caller":"etcdserver/server.go:2578","msg":"setting up initial cluster version using v2 API","cluster-version":"3.5"}
	{"level":"info","ts":"2024-07-29T20:13:56.565328Z","caller":"etcdserver/server.go:2068","msg":"published local member to cluster through raft","local-member-id":"aec36adc501070cc","local-member-attributes":"{Name:addons-675434 ClientURLs:[https://192.168.49.2:2379]}","request-path":"/0/members/aec36adc501070cc/attributes","cluster-id":"fa54960ea34d58be","publish-timeout":"7s"}
	{"level":"info","ts":"2024-07-29T20:13:56.565851Z","caller":"membership/cluster.go:584","msg":"set initial cluster version","cluster-id":"fa54960ea34d58be","local-member-id":"aec36adc501070cc","cluster-version":"3.5"}
	{"level":"info","ts":"2024-07-29T20:13:56.566061Z","caller":"api/capability.go:75","msg":"enabled capabilities for version","cluster-version":"3.5"}
	{"level":"info","ts":"2024-07-29T20:13:56.566207Z","caller":"etcdserver/server.go:2602","msg":"cluster version is updated","cluster-version":"3.5"}
	{"level":"info","ts":"2024-07-29T20:13:56.566298Z","caller":"embed/serve.go:103","msg":"ready to serve client requests"}
	{"level":"info","ts":"2024-07-29T20:13:56.566665Z","caller":"embed/serve.go:103","msg":"ready to serve client requests"}
	{"level":"info","ts":"2024-07-29T20:13:56.569597Z","caller":"embed/serve.go:250","msg":"serving client traffic securely","traffic":"grpc+http","address":"192.168.49.2:2379"}
	{"level":"info","ts":"2024-07-29T20:13:56.578411Z","caller":"embed/serve.go:250","msg":"serving client traffic securely","traffic":"grpc+http","address":"127.0.0.1:2379"}
	{"level":"info","ts":"2024-07-29T20:13:56.58814Z","caller":"etcdmain/main.go:44","msg":"notifying init daemon"}
	{"level":"info","ts":"2024-07-29T20:13:56.588281Z","caller":"etcdmain/main.go:50","msg":"successfully notified init daemon"}
	
	
	==> gcp-auth [cf5e818bc1a3abdb8ff353fc27cf353f381b972cbb902d5600daf532a76e4008] <==
	2024/07/29 20:16:55 GCP Auth Webhook started!
	2024/07/29 20:17:13 Ready to marshal response ...
	2024/07/29 20:17:13 Ready to write response ...
	2024/07/29 20:17:14 Ready to marshal response ...
	2024/07/29 20:17:14 Ready to write response ...
	
	
	==> kernel <==
	 20:20:16 up 18:02,  0 users,  load average: 0.31, 1.24, 2.42
	Linux addons-675434 5.15.0-1065-aws #71~20.04.1-Ubuntu SMP Fri Jun 28 19:59:49 UTC 2024 aarch64 aarch64 aarch64 GNU/Linux
	PRETTY_NAME="Ubuntu 22.04.4 LTS"
	
	
	==> kindnet [3d64ba114607f832cc3df912af4ed636759c71f2fbb47b7c5909f800f662660e] <==
	I0729 20:19:09.581087       1 main.go:299] handling current node
	W0729 20:19:12.848725       1 reflector.go:547] pkg/mod/k8s.io/client-go@v0.30.2/tools/cache/reflector.go:232: failed to list *v1.Pod: pods is forbidden: User "system:serviceaccount:kube-system:kindnet" cannot list resource "pods" in API group "" at the cluster scope
	E0729 20:19:12.848760       1 reflector.go:150] pkg/mod/k8s.io/client-go@v0.30.2/tools/cache/reflector.go:232: Failed to watch *v1.Pod: failed to list *v1.Pod: pods is forbidden: User "system:serviceaccount:kube-system:kindnet" cannot list resource "pods" in API group "" at the cluster scope
	I0729 20:19:19.581705       1 main.go:295] Handling node with IPs: map[192.168.49.2:{}]
	I0729 20:19:19.581935       1 main.go:299] handling current node
	W0729 20:19:20.283929       1 reflector.go:547] pkg/mod/k8s.io/client-go@v0.30.2/tools/cache/reflector.go:232: failed to list *v1.Namespace: namespaces is forbidden: User "system:serviceaccount:kube-system:kindnet" cannot list resource "namespaces" in API group "" at the cluster scope
	E0729 20:19:20.284149       1 reflector.go:150] pkg/mod/k8s.io/client-go@v0.30.2/tools/cache/reflector.go:232: Failed to watch *v1.Namespace: failed to list *v1.Namespace: namespaces is forbidden: User "system:serviceaccount:kube-system:kindnet" cannot list resource "namespaces" in API group "" at the cluster scope
	I0729 20:19:29.581785       1 main.go:295] Handling node with IPs: map[192.168.49.2:{}]
	I0729 20:19:29.581823       1 main.go:299] handling current node
	W0729 20:19:33.918107       1 reflector.go:547] pkg/mod/k8s.io/client-go@v0.30.2/tools/cache/reflector.go:232: failed to list *v1.NetworkPolicy: networkpolicies.networking.k8s.io is forbidden: User "system:serviceaccount:kube-system:kindnet" cannot list resource "networkpolicies" in API group "networking.k8s.io" at the cluster scope
	E0729 20:19:33.918159       1 reflector.go:150] pkg/mod/k8s.io/client-go@v0.30.2/tools/cache/reflector.go:232: Failed to watch *v1.NetworkPolicy: failed to list *v1.NetworkPolicy: networkpolicies.networking.k8s.io is forbidden: User "system:serviceaccount:kube-system:kindnet" cannot list resource "networkpolicies" in API group "networking.k8s.io" at the cluster scope
	I0729 20:19:39.581293       1 main.go:295] Handling node with IPs: map[192.168.49.2:{}]
	I0729 20:19:39.581334       1 main.go:299] handling current node
	I0729 20:19:49.581776       1 main.go:295] Handling node with IPs: map[192.168.49.2:{}]
	I0729 20:19:49.581816       1 main.go:299] handling current node
	W0729 20:19:50.119855       1 reflector.go:547] pkg/mod/k8s.io/client-go@v0.30.2/tools/cache/reflector.go:232: failed to list *v1.Pod: pods is forbidden: User "system:serviceaccount:kube-system:kindnet" cannot list resource "pods" in API group "" at the cluster scope
	E0729 20:19:50.119890       1 reflector.go:150] pkg/mod/k8s.io/client-go@v0.30.2/tools/cache/reflector.go:232: Failed to watch *v1.Pod: failed to list *v1.Pod: pods is forbidden: User "system:serviceaccount:kube-system:kindnet" cannot list resource "pods" in API group "" at the cluster scope
	I0729 20:19:59.581731       1 main.go:295] Handling node with IPs: map[192.168.49.2:{}]
	I0729 20:19:59.581767       1 main.go:299] handling current node
	I0729 20:20:09.581294       1 main.go:295] Handling node with IPs: map[192.168.49.2:{}]
	I0729 20:20:09.581398       1 main.go:299] handling current node
	W0729 20:20:11.591939       1 reflector.go:547] pkg/mod/k8s.io/client-go@v0.30.2/tools/cache/reflector.go:232: failed to list *v1.NetworkPolicy: networkpolicies.networking.k8s.io is forbidden: User "system:serviceaccount:kube-system:kindnet" cannot list resource "networkpolicies" in API group "networking.k8s.io" at the cluster scope
	E0729 20:20:11.592018       1 reflector.go:150] pkg/mod/k8s.io/client-go@v0.30.2/tools/cache/reflector.go:232: Failed to watch *v1.NetworkPolicy: failed to list *v1.NetworkPolicy: networkpolicies.networking.k8s.io is forbidden: User "system:serviceaccount:kube-system:kindnet" cannot list resource "networkpolicies" in API group "networking.k8s.io" at the cluster scope
	W0729 20:20:11.670330       1 reflector.go:547] pkg/mod/k8s.io/client-go@v0.30.2/tools/cache/reflector.go:232: failed to list *v1.Namespace: namespaces is forbidden: User "system:serviceaccount:kube-system:kindnet" cannot list resource "namespaces" in API group "" at the cluster scope
	E0729 20:20:11.670367       1 reflector.go:150] pkg/mod/k8s.io/client-go@v0.30.2/tools/cache/reflector.go:232: Failed to watch *v1.Namespace: failed to list *v1.Namespace: namespaces is forbidden: User "system:serviceaccount:kube-system:kindnet" cannot list resource "namespaces" in API group "" at the cluster scope
	
	
	==> kube-apiserver [4a0a19b5bbfe76d2aef8f24ddce1abc45f4b269196aaae5b7a4e79edb16cad1e] <==
	W0729 20:15:25.467602       1 dispatcher.go:225] Failed calling webhook, failing closed mutatequeue.volcano.sh: failed calling webhook "mutatequeue.volcano.sh": failed to call webhook: Post "https://volcano-admission-service.volcano-system.svc:443/queues/mutate?timeout=10s": dial tcp 10.110.71.29:443: connect: connection refused
	W0729 20:15:26.536858       1 dispatcher.go:225] Failed calling webhook, failing closed mutatequeue.volcano.sh: failed calling webhook "mutatequeue.volcano.sh": failed to call webhook: Post "https://volcano-admission-service.volcano-system.svc:443/queues/mutate?timeout=10s": dial tcp 10.110.71.29:443: connect: connection refused
	W0729 20:15:27.576705       1 dispatcher.go:225] Failed calling webhook, failing closed mutatequeue.volcano.sh: failed calling webhook "mutatequeue.volcano.sh": failed to call webhook: Post "https://volcano-admission-service.volcano-system.svc:443/queues/mutate?timeout=10s": dial tcp 10.110.71.29:443: connect: connection refused
	W0729 20:15:28.657287       1 dispatcher.go:225] Failed calling webhook, failing closed mutatequeue.volcano.sh: failed calling webhook "mutatequeue.volcano.sh": failed to call webhook: Post "https://volcano-admission-service.volcano-system.svc:443/queues/mutate?timeout=10s": dial tcp 10.110.71.29:443: connect: connection refused
	W0729 20:15:29.724157       1 dispatcher.go:225] Failed calling webhook, failing closed mutatequeue.volcano.sh: failed calling webhook "mutatequeue.volcano.sh": failed to call webhook: Post "https://volcano-admission-service.volcano-system.svc:443/queues/mutate?timeout=10s": dial tcp 10.110.71.29:443: connect: connection refused
	W0729 20:15:30.779679       1 dispatcher.go:225] Failed calling webhook, failing closed mutatequeue.volcano.sh: failed calling webhook "mutatequeue.volcano.sh": failed to call webhook: Post "https://volcano-admission-service.volcano-system.svc:443/queues/mutate?timeout=10s": dial tcp 10.110.71.29:443: connect: connection refused
	W0729 20:15:31.193945       1 dispatcher.go:210] Failed calling webhook, failing open gcp-auth-mutate.k8s.io: failed calling webhook "gcp-auth-mutate.k8s.io": failed to call webhook: Post "https://gcp-auth.gcp-auth.svc:443/mutate?timeout=10s": dial tcp 10.99.168.69:443: connect: connection refused
	E0729 20:15:31.193982       1 dispatcher.go:214] failed calling webhook "gcp-auth-mutate.k8s.io": failed to call webhook: Post "https://gcp-auth.gcp-auth.svc:443/mutate?timeout=10s": dial tcp 10.99.168.69:443: connect: connection refused
	W0729 20:15:31.194526       1 dispatcher.go:225] Failed calling webhook, failing closed mutatepod.volcano.sh: failed calling webhook "mutatepod.volcano.sh": failed to call webhook: Post "https://volcano-admission-service.volcano-system.svc:443/pods/mutate?timeout=10s": dial tcp 10.110.71.29:443: connect: connection refused
	W0729 20:15:31.269460       1 dispatcher.go:210] Failed calling webhook, failing open gcp-auth-mutate.k8s.io: failed calling webhook "gcp-auth-mutate.k8s.io": failed to call webhook: Post "https://gcp-auth.gcp-auth.svc:443/mutate?timeout=10s": dial tcp 10.99.168.69:443: connect: connection refused
	E0729 20:15:31.269503       1 dispatcher.go:214] failed calling webhook "gcp-auth-mutate.k8s.io": failed to call webhook: Post "https://gcp-auth.gcp-auth.svc:443/mutate?timeout=10s": dial tcp 10.99.168.69:443: connect: connection refused
	W0729 20:15:31.269863       1 dispatcher.go:225] Failed calling webhook, failing closed mutatepod.volcano.sh: failed calling webhook "mutatepod.volcano.sh": failed to call webhook: Post "https://volcano-admission-service.volcano-system.svc:443/pods/mutate?timeout=10s": dial tcp 10.110.71.29:443: connect: connection refused
	W0729 20:15:31.787063       1 dispatcher.go:225] Failed calling webhook, failing closed mutatequeue.volcano.sh: failed calling webhook "mutatequeue.volcano.sh": failed to call webhook: Post "https://volcano-admission-service.volcano-system.svc:443/queues/mutate?timeout=10s": dial tcp 10.110.71.29:443: connect: connection refused
	W0729 20:15:32.796683       1 dispatcher.go:225] Failed calling webhook, failing closed mutatequeue.volcano.sh: failed calling webhook "mutatequeue.volcano.sh": failed to call webhook: Post "https://volcano-admission-service.volcano-system.svc:443/queues/mutate?timeout=10s": dial tcp 10.110.71.29:443: connect: connection refused
	W0729 20:15:33.831425       1 dispatcher.go:225] Failed calling webhook, failing closed mutatequeue.volcano.sh: failed calling webhook "mutatequeue.volcano.sh": failed to call webhook: Post "https://volcano-admission-service.volcano-system.svc:443/queues/mutate?timeout=10s": dial tcp 10.110.71.29:443: connect: connection refused
	W0729 20:15:34.853327       1 dispatcher.go:225] Failed calling webhook, failing closed mutatequeue.volcano.sh: failed calling webhook "mutatequeue.volcano.sh": failed to call webhook: Post "https://volcano-admission-service.volcano-system.svc:443/queues/mutate?timeout=10s": dial tcp 10.110.71.29:443: connect: connection refused
	W0729 20:15:35.918037       1 dispatcher.go:225] Failed calling webhook, failing closed mutatequeue.volcano.sh: failed calling webhook "mutatequeue.volcano.sh": failed to call webhook: Post "https://volcano-admission-service.volcano-system.svc:443/queues/mutate?timeout=10s": dial tcp 10.110.71.29:443: connect: connection refused
	W0729 20:15:50.147191       1 dispatcher.go:210] Failed calling webhook, failing open gcp-auth-mutate.k8s.io: failed calling webhook "gcp-auth-mutate.k8s.io": failed to call webhook: Post "https://gcp-auth.gcp-auth.svc:443/mutate?timeout=10s": dial tcp 10.99.168.69:443: connect: connection refused
	E0729 20:15:50.147230       1 dispatcher.go:214] failed calling webhook "gcp-auth-mutate.k8s.io": failed to call webhook: Post "https://gcp-auth.gcp-auth.svc:443/mutate?timeout=10s": dial tcp 10.99.168.69:443: connect: connection refused
	W0729 20:16:31.201112       1 dispatcher.go:210] Failed calling webhook, failing open gcp-auth-mutate.k8s.io: failed calling webhook "gcp-auth-mutate.k8s.io": failed to call webhook: Post "https://gcp-auth.gcp-auth.svc:443/mutate?timeout=10s": dial tcp 10.99.168.69:443: connect: connection refused
	E0729 20:16:31.201152       1 dispatcher.go:214] failed calling webhook "gcp-auth-mutate.k8s.io": failed to call webhook: Post "https://gcp-auth.gcp-auth.svc:443/mutate?timeout=10s": dial tcp 10.99.168.69:443: connect: connection refused
	W0729 20:16:31.275115       1 dispatcher.go:210] Failed calling webhook, failing open gcp-auth-mutate.k8s.io: failed calling webhook "gcp-auth-mutate.k8s.io": failed to call webhook: Post "https://gcp-auth.gcp-auth.svc:443/mutate?timeout=10s": dial tcp 10.99.168.69:443: connect: connection refused
	E0729 20:16:31.275149       1 dispatcher.go:214] failed calling webhook "gcp-auth-mutate.k8s.io": failed to call webhook: Post "https://gcp-auth.gcp-auth.svc:443/mutate?timeout=10s": dial tcp 10.99.168.69:443: connect: connection refused
	I0729 20:17:13.236205       1 controller.go:615] quota admission added evaluator for: jobs.batch.volcano.sh
	I0729 20:17:13.281002       1 controller.go:615] quota admission added evaluator for: podgroups.scheduling.volcano.sh
	
	
	==> kube-controller-manager [bb048f546b4b6377e8bfd37474ef6921e3871d0458de169ba90296673b4b7506] <==
	I0729 20:16:31.225828       1 job_controller.go:566] "enqueueing job" logger="job-controller" key="gcp-auth/gcp-auth-certs-create"
	I0729 20:16:31.236746       1 job_controller.go:566] "enqueueing job" logger="job-controller" key="gcp-auth/gcp-auth-certs-create"
	I0729 20:16:31.283475       1 job_controller.go:566] "enqueueing job" logger="job-controller" key="gcp-auth/gcp-auth-certs-patch"
	I0729 20:16:31.290065       1 job_controller.go:566] "enqueueing job" logger="job-controller" key="gcp-auth/gcp-auth-certs-patch"
	I0729 20:16:31.297944       1 job_controller.go:566] "enqueueing job" logger="job-controller" key="gcp-auth/gcp-auth-certs-patch"
	I0729 20:16:31.310673       1 job_controller.go:566] "enqueueing job" logger="job-controller" key="gcp-auth/gcp-auth-certs-patch"
	I0729 20:16:32.064134       1 job_controller.go:566] "enqueueing job" logger="job-controller" key="gcp-auth/gcp-auth-certs-create"
	I0729 20:16:32.077167       1 job_controller.go:566] "enqueueing job" logger="job-controller" key="gcp-auth/gcp-auth-certs-patch"
	I0729 20:16:33.209721       1 job_controller.go:566] "enqueueing job" logger="job-controller" key="gcp-auth/gcp-auth-certs-create"
	I0729 20:16:33.231890       1 job_controller.go:566] "enqueueing job" logger="job-controller" key="gcp-auth/gcp-auth-certs-patch"
	I0729 20:16:34.081055       1 job_controller.go:566] "enqueueing job" logger="job-controller" key="gcp-auth/gcp-auth-certs-patch"
	I0729 20:16:34.097267       1 job_controller.go:566] "enqueueing job" logger="job-controller" key="gcp-auth/gcp-auth-certs-create"
	I0729 20:16:34.217204       1 job_controller.go:566] "enqueueing job" logger="job-controller" key="gcp-auth/gcp-auth-certs-create"
	I0729 20:16:34.228166       1 job_controller.go:566] "enqueueing job" logger="job-controller" key="gcp-auth/gcp-auth-certs-create"
	I0729 20:16:34.230156       1 job_controller.go:566] "enqueueing job" logger="job-controller" key="gcp-auth/gcp-auth-certs-create"
	I0729 20:16:34.236900       1 job_controller.go:566] "enqueueing job" logger="job-controller" key="gcp-auth/gcp-auth-certs-patch"
	I0729 20:16:34.246504       1 job_controller.go:566] "enqueueing job" logger="job-controller" key="gcp-auth/gcp-auth-certs-patch"
	I0729 20:16:34.252636       1 job_controller.go:566] "enqueueing job" logger="job-controller" key="gcp-auth/gcp-auth-certs-patch"
	I0729 20:16:56.164618       1 replica_set.go:676] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="gcp-auth/gcp-auth-5db96cd9b4" duration="15.071253ms"
	I0729 20:16:56.164716       1 replica_set.go:676] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="gcp-auth/gcp-auth-5db96cd9b4" duration="40.828µs"
	I0729 20:17:04.026683       1 job_controller.go:566] "enqueueing job" logger="job-controller" key="gcp-auth/gcp-auth-certs-create"
	I0729 20:17:04.033702       1 job_controller.go:566] "enqueueing job" logger="job-controller" key="gcp-auth/gcp-auth-certs-patch"
	I0729 20:17:04.080902       1 job_controller.go:566] "enqueueing job" logger="job-controller" key="gcp-auth/gcp-auth-certs-patch"
	I0729 20:17:04.084473       1 job_controller.go:566] "enqueueing job" logger="job-controller" key="gcp-auth/gcp-auth-certs-create"
	I0729 20:17:12.957579       1 job_controller.go:566] "enqueueing job" logger="job-controller" key="volcano-system/volcano-admission-init"
	
	
	==> kube-proxy [5d4a2bc5004174c24320171cf9f6de56efa26a203492b2b063e4ef1fe0175aac] <==
	I0729 20:14:17.825744       1 server_linux.go:69] "Using iptables proxy"
	I0729 20:14:17.843378       1 server.go:1062] "Successfully retrieved node IP(s)" IPs=["192.168.49.2"]
	I0729 20:14:17.876898       1 server.go:659] "kube-proxy running in dual-stack mode" primary ipFamily="IPv4"
	I0729 20:14:17.876944       1 server_linux.go:165] "Using iptables Proxier"
	I0729 20:14:17.878861       1 server_linux.go:511] "Detect-local-mode set to ClusterCIDR, but no cluster CIDR for family" ipFamily="IPv6"
	I0729 20:14:17.878877       1 server_linux.go:528] "Defaulting to no-op detect-local"
	I0729 20:14:17.878901       1 proxier.go:243] "Setting route_localnet=1 to allow node-ports on localhost; to change this either disable iptables.localhostNodePorts (--iptables-localhost-nodeports) or set nodePortAddresses (--nodeport-addresses) to filter loopback addresses"
	I0729 20:14:17.879098       1 server.go:872] "Version info" version="v1.30.3"
	I0729 20:14:17.879111       1 server.go:874] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
	I0729 20:14:17.883258       1 config.go:192] "Starting service config controller"
	I0729 20:14:17.883282       1 shared_informer.go:313] Waiting for caches to sync for service config
	I0729 20:14:17.883325       1 config.go:101] "Starting endpoint slice config controller"
	I0729 20:14:17.883330       1 shared_informer.go:313] Waiting for caches to sync for endpoint slice config
	I0729 20:14:17.883837       1 config.go:319] "Starting node config controller"
	I0729 20:14:17.883844       1 shared_informer.go:313] Waiting for caches to sync for node config
	I0729 20:14:17.983840       1 shared_informer.go:320] Caches are synced for endpoint slice config
	I0729 20:14:17.983896       1 shared_informer.go:320] Caches are synced for node config
	I0729 20:14:17.983908       1 shared_informer.go:320] Caches are synced for service config
	
	
	==> kube-scheduler [ca46b507e99cef4dede30badaf21fe138bcdddcf08757ecea85a42ebce12ae28] <==
	W0729 20:14:00.095679       1 reflector.go:547] k8s.io/client-go/informers/factory.go:160: failed to list *v1.Node: nodes is forbidden: User "system:kube-scheduler" cannot list resource "nodes" in API group "" at the cluster scope
	E0729 20:14:00.099436       1 reflector.go:150] k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.Node: failed to list *v1.Node: nodes is forbidden: User "system:kube-scheduler" cannot list resource "nodes" in API group "" at the cluster scope
	W0729 20:14:00.098490       1 reflector.go:547] k8s.io/client-go/informers/factory.go:160: failed to list *v1.PersistentVolume: persistentvolumes is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumes" in API group "" at the cluster scope
	E0729 20:14:00.099891       1 reflector.go:150] k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.PersistentVolume: failed to list *v1.PersistentVolume: persistentvolumes is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumes" in API group "" at the cluster scope
	W0729 20:14:00.098577       1 reflector.go:547] k8s.io/client-go/informers/factory.go:160: failed to list *v1.PersistentVolumeClaim: persistentvolumeclaims is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumeclaims" in API group "" at the cluster scope
	E0729 20:14:00.100220       1 reflector.go:150] k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.PersistentVolumeClaim: failed to list *v1.PersistentVolumeClaim: persistentvolumeclaims is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumeclaims" in API group "" at the cluster scope
	W0729 20:14:00.098640       1 reflector.go:547] k8s.io/client-go/informers/factory.go:160: failed to list *v1.StorageClass: storageclasses.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "storageclasses" in API group "storage.k8s.io" at the cluster scope
	E0729 20:14:00.100315       1 reflector.go:150] k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.StorageClass: failed to list *v1.StorageClass: storageclasses.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "storageclasses" in API group "storage.k8s.io" at the cluster scope
	W0729 20:14:00.098695       1 reflector.go:547] k8s.io/client-go/informers/factory.go:160: failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csidrivers" in API group "storage.k8s.io" at the cluster scope
	E0729 20:14:00.104242       1 reflector.go:150] k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.CSIDriver: failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csidrivers" in API group "storage.k8s.io" at the cluster scope
	W0729 20:14:00.098928       1 reflector.go:547] k8s.io/client-go/informers/factory.go:160: failed to list *v1.ReplicaSet: replicasets.apps is forbidden: User "system:kube-scheduler" cannot list resource "replicasets" in API group "apps" at the cluster scope
	E0729 20:14:00.104348       1 reflector.go:150] k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.ReplicaSet: failed to list *v1.ReplicaSet: replicasets.apps is forbidden: User "system:kube-scheduler" cannot list resource "replicasets" in API group "apps" at the cluster scope
	W0729 20:14:00.099106       1 reflector.go:547] k8s.io/client-go/informers/factory.go:160: failed to list *v1.Service: services is forbidden: User "system:kube-scheduler" cannot list resource "services" in API group "" at the cluster scope
	E0729 20:14:00.104447       1 reflector.go:150] k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.Service: failed to list *v1.Service: services is forbidden: User "system:kube-scheduler" cannot list resource "services" in API group "" at the cluster scope
	W0729 20:14:00.099185       1 reflector.go:547] k8s.io/client-go/informers/factory.go:160: failed to list *v1.Pod: pods is forbidden: User "system:kube-scheduler" cannot list resource "pods" in API group "" at the cluster scope
	E0729 20:14:00.104571       1 reflector.go:150] k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.Pod: failed to list *v1.Pod: pods is forbidden: User "system:kube-scheduler" cannot list resource "pods" in API group "" at the cluster scope
	W0729 20:14:00.099318       1 reflector.go:547] k8s.io/client-go/informers/factory.go:160: failed to list *v1.PodDisruptionBudget: poddisruptionbudgets.policy is forbidden: User "system:kube-scheduler" cannot list resource "poddisruptionbudgets" in API group "policy" at the cluster scope
	E0729 20:14:00.104665       1 reflector.go:150] k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.PodDisruptionBudget: failed to list *v1.PodDisruptionBudget: poddisruptionbudgets.policy is forbidden: User "system:kube-scheduler" cannot list resource "poddisruptionbudgets" in API group "policy" at the cluster scope
	W0729 20:14:00.099384       1 reflector.go:547] k8s.io/client-go/informers/factory.go:160: failed to list *v1.CSIStorageCapacity: csistoragecapacities.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csistoragecapacities" in API group "storage.k8s.io" at the cluster scope
	E0729 20:14:00.104755       1 reflector.go:150] k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.CSIStorageCapacity: failed to list *v1.CSIStorageCapacity: csistoragecapacities.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csistoragecapacities" in API group "storage.k8s.io" at the cluster scope
	W0729 20:14:00.105796       1 reflector.go:547] k8s.io/client-go/informers/factory.go:160: failed to list *v1.CSINode: csinodes.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csinodes" in API group "storage.k8s.io" at the cluster scope
	E0729 20:14:00.106042       1 reflector.go:150] k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.CSINode: failed to list *v1.CSINode: csinodes.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csinodes" in API group "storage.k8s.io" at the cluster scope
	W0729 20:14:01.011935       1 reflector.go:547] runtime/asm_arm64.s:1222: failed to list *v1.ConfigMap: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot list resource "configmaps" in API group "" in the namespace "kube-system"
	E0729 20:14:01.011990       1 reflector.go:150] runtime/asm_arm64.s:1222: Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot list resource "configmaps" in API group "" in the namespace "kube-system"
	I0729 20:14:02.646982       1 shared_informer.go:320] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file
	
	
	==> kubelet <==
	Jul 29 20:18:17 addons-675434 kubelet[1555]: I0729 20:18:17.373970    1555 scope.go:117] "RemoveContainer" containerID="28e10d0c99b61d91280920af08157e6932ce183fe139c9eece0d925119f86846"
	Jul 29 20:18:17 addons-675434 kubelet[1555]: E0729 20:18:17.374428    1555 pod_workers.go:1298] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"gadget\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=gadget pod=gadget-p7qgn_gadget(37add603-1500-4066-a0f1-21a3afed4ec9)\"" pod="gadget/gadget-p7qgn" podUID="37add603-1500-4066-a0f1-21a3afed4ec9"
	Jul 29 20:18:18 addons-675434 kubelet[1555]: I0729 20:18:18.375717    1555 scope.go:117] "RemoveContainer" containerID="28e10d0c99b61d91280920af08157e6932ce183fe139c9eece0d925119f86846"
	Jul 29 20:18:18 addons-675434 kubelet[1555]: E0729 20:18:18.376238    1555 pod_workers.go:1298] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"gadget\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=gadget pod=gadget-p7qgn_gadget(37add603-1500-4066-a0f1-21a3afed4ec9)\"" pod="gadget/gadget-p7qgn" podUID="37add603-1500-4066-a0f1-21a3afed4ec9"
	Jul 29 20:18:29 addons-675434 kubelet[1555]: I0729 20:18:29.276544    1555 kubelet_pods.go:988] "Unable to retrieve pull secret, the image pull may not succeed." pod="kube-system/registry-698f998955-n5fxq" secret="" err="secret \"gcp-auth\" not found"
	Jul 29 20:18:33 addons-675434 kubelet[1555]: I0729 20:18:33.276049    1555 scope.go:117] "RemoveContainer" containerID="28e10d0c99b61d91280920af08157e6932ce183fe139c9eece0d925119f86846"
	Jul 29 20:18:33 addons-675434 kubelet[1555]: E0729 20:18:33.276688    1555 pod_workers.go:1298] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"gadget\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=gadget pod=gadget-p7qgn_gadget(37add603-1500-4066-a0f1-21a3afed4ec9)\"" pod="gadget/gadget-p7qgn" podUID="37add603-1500-4066-a0f1-21a3afed4ec9"
	Jul 29 20:18:47 addons-675434 kubelet[1555]: I0729 20:18:47.275642    1555 kubelet_pods.go:988] "Unable to retrieve pull secret, the image pull may not succeed." pod="kube-system/nvidia-device-plugin-daemonset-zlp6c" secret="" err="secret \"gcp-auth\" not found"
	Jul 29 20:18:48 addons-675434 kubelet[1555]: I0729 20:18:48.275770    1555 scope.go:117] "RemoveContainer" containerID="28e10d0c99b61d91280920af08157e6932ce183fe139c9eece0d925119f86846"
	Jul 29 20:18:48 addons-675434 kubelet[1555]: E0729 20:18:48.276265    1555 pod_workers.go:1298] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"gadget\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=gadget pod=gadget-p7qgn_gadget(37add603-1500-4066-a0f1-21a3afed4ec9)\"" pod="gadget/gadget-p7qgn" podUID="37add603-1500-4066-a0f1-21a3afed4ec9"
	Jul 29 20:19:02 addons-675434 kubelet[1555]: I0729 20:19:02.278195    1555 scope.go:117] "RemoveContainer" containerID="28e10d0c99b61d91280920af08157e6932ce183fe139c9eece0d925119f86846"
	Jul 29 20:19:02 addons-675434 kubelet[1555]: E0729 20:19:02.278645    1555 pod_workers.go:1298] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"gadget\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=gadget pod=gadget-p7qgn_gadget(37add603-1500-4066-a0f1-21a3afed4ec9)\"" pod="gadget/gadget-p7qgn" podUID="37add603-1500-4066-a0f1-21a3afed4ec9"
	Jul 29 20:19:14 addons-675434 kubelet[1555]: I0729 20:19:14.275311    1555 scope.go:117] "RemoveContainer" containerID="28e10d0c99b61d91280920af08157e6932ce183fe139c9eece0d925119f86846"
	Jul 29 20:19:14 addons-675434 kubelet[1555]: E0729 20:19:14.275822    1555 pod_workers.go:1298] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"gadget\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=gadget pod=gadget-p7qgn_gadget(37add603-1500-4066-a0f1-21a3afed4ec9)\"" pod="gadget/gadget-p7qgn" podUID="37add603-1500-4066-a0f1-21a3afed4ec9"
	Jul 29 20:19:27 addons-675434 kubelet[1555]: I0729 20:19:27.275319    1555 scope.go:117] "RemoveContainer" containerID="28e10d0c99b61d91280920af08157e6932ce183fe139c9eece0d925119f86846"
	Jul 29 20:19:27 addons-675434 kubelet[1555]: E0729 20:19:27.275802    1555 pod_workers.go:1298] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"gadget\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=gadget pod=gadget-p7qgn_gadget(37add603-1500-4066-a0f1-21a3afed4ec9)\"" pod="gadget/gadget-p7qgn" podUID="37add603-1500-4066-a0f1-21a3afed4ec9"
	Jul 29 20:19:27 addons-675434 kubelet[1555]: I0729 20:19:27.276201    1555 kubelet_pods.go:988] "Unable to retrieve pull secret, the image pull may not succeed." pod="kube-system/registry-proxy-dhzfq" secret="" err="secret \"gcp-auth\" not found"
	Jul 29 20:19:35 addons-675434 kubelet[1555]: I0729 20:19:35.275696    1555 kubelet_pods.go:988] "Unable to retrieve pull secret, the image pull may not succeed." pod="kube-system/registry-698f998955-n5fxq" secret="" err="secret \"gcp-auth\" not found"
	Jul 29 20:19:41 addons-675434 kubelet[1555]: I0729 20:19:41.275237    1555 scope.go:117] "RemoveContainer" containerID="28e10d0c99b61d91280920af08157e6932ce183fe139c9eece0d925119f86846"
	Jul 29 20:19:41 addons-675434 kubelet[1555]: E0729 20:19:41.276220    1555 pod_workers.go:1298] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"gadget\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=gadget pod=gadget-p7qgn_gadget(37add603-1500-4066-a0f1-21a3afed4ec9)\"" pod="gadget/gadget-p7qgn" podUID="37add603-1500-4066-a0f1-21a3afed4ec9"
	Jul 29 20:19:52 addons-675434 kubelet[1555]: I0729 20:19:52.277283    1555 scope.go:117] "RemoveContainer" containerID="28e10d0c99b61d91280920af08157e6932ce183fe139c9eece0d925119f86846"
	Jul 29 20:19:52 addons-675434 kubelet[1555]: E0729 20:19:52.278206    1555 pod_workers.go:1298] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"gadget\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=gadget pod=gadget-p7qgn_gadget(37add603-1500-4066-a0f1-21a3afed4ec9)\"" pod="gadget/gadget-p7qgn" podUID="37add603-1500-4066-a0f1-21a3afed4ec9"
	Jul 29 20:19:57 addons-675434 kubelet[1555]: I0729 20:19:57.275824    1555 kubelet_pods.go:988] "Unable to retrieve pull secret, the image pull may not succeed." pod="kube-system/nvidia-device-plugin-daemonset-zlp6c" secret="" err="secret \"gcp-auth\" not found"
	Jul 29 20:20:06 addons-675434 kubelet[1555]: I0729 20:20:06.275659    1555 scope.go:117] "RemoveContainer" containerID="28e10d0c99b61d91280920af08157e6932ce183fe139c9eece0d925119f86846"
	Jul 29 20:20:06 addons-675434 kubelet[1555]: E0729 20:20:06.276668    1555 pod_workers.go:1298] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"gadget\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=gadget pod=gadget-p7qgn_gadget(37add603-1500-4066-a0f1-21a3afed4ec9)\"" pod="gadget/gadget-p7qgn" podUID="37add603-1500-4066-a0f1-21a3afed4ec9"
	
	
	==> storage-provisioner [3282895f695315fd82d6fd463bed7422790d35df4a5ee90561acc65a6785e3ec] <==
	I0729 20:14:21.958672       1 storage_provisioner.go:116] Initializing the minikube storage provisioner...
	I0729 20:14:21.971919       1 storage_provisioner.go:141] Storage provisioner initialized, now starting service!
	I0729 20:14:21.971979       1 leaderelection.go:243] attempting to acquire leader lease kube-system/k8s.io-minikube-hostpath...
	I0729 20:14:21.980643       1 leaderelection.go:253] successfully acquired lease kube-system/k8s.io-minikube-hostpath
	I0729 20:14:21.981834       1 event.go:282] Event(v1.ObjectReference{Kind:"Endpoints", Namespace:"kube-system", Name:"k8s.io-minikube-hostpath", UID:"9a639326-0aa2-4054-b4c8-db3dc53f0cc1", APIVersion:"v1", ResourceVersion:"537", FieldPath:""}): type: 'Normal' reason: 'LeaderElection' addons-675434_b6ef1648-abb2-4c6f-99e6-c7cf870c0af8 became leader
	I0729 20:14:21.981878       1 controller.go:835] Starting provisioner controller k8s.io/minikube-hostpath_addons-675434_b6ef1648-abb2-4c6f-99e6-c7cf870c0af8!
	I0729 20:14:22.082856       1 controller.go:884] Started provisioner controller k8s.io/minikube-hostpath_addons-675434_b6ef1648-abb2-4c6f-99e6-c7cf870c0af8!
	

                                                
                                                
-- /stdout --
helpers_test.go:254: (dbg) Run:  out/minikube-linux-arm64 status --format={{.APIServer}} -p addons-675434 -n addons-675434
helpers_test.go:261: (dbg) Run:  kubectl --context addons-675434 get po -o=jsonpath={.items[*].metadata.name} -A --field-selector=status.phase!=Running
helpers_test.go:272: non-running pods: ingress-nginx-admission-create-p5ggn ingress-nginx-admission-patch-klphm test-job-nginx-0
helpers_test.go:274: ======> post-mortem[TestAddons/serial/Volcano]: describe non-running pods <======
helpers_test.go:277: (dbg) Run:  kubectl --context addons-675434 describe pod ingress-nginx-admission-create-p5ggn ingress-nginx-admission-patch-klphm test-job-nginx-0
helpers_test.go:277: (dbg) Non-zero exit: kubectl --context addons-675434 describe pod ingress-nginx-admission-create-p5ggn ingress-nginx-admission-patch-klphm test-job-nginx-0: exit status 1 (88.76298ms)

                                                
                                                
** stderr ** 
	Error from server (NotFound): pods "ingress-nginx-admission-create-p5ggn" not found
	Error from server (NotFound): pods "ingress-nginx-admission-patch-klphm" not found
	Error from server (NotFound): pods "test-job-nginx-0" not found

                                                
                                                
** /stderr **
helpers_test.go:279: kubectl --context addons-675434 describe pod ingress-nginx-admission-create-p5ggn ingress-nginx-admission-patch-klphm test-job-nginx-0: exit status 1
--- FAIL: TestAddons/serial/Volcano (200.32s)

                                                
                                    
x
+
TestStartStop/group/old-k8s-version/serial/SecondStart (374.58s)

                                                
                                                
=== RUN   TestStartStop/group/old-k8s-version/serial/SecondStart
start_stop_delete_test.go:256: (dbg) Run:  out/minikube-linux-arm64 start -p old-k8s-version-884192 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=docker  --container-runtime=containerd --kubernetes-version=v1.20.0
E0729 21:03:56.549545  139728 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19339-134334/.minikube/profiles/functional-479263/client.crt: no such file or directory
start_stop_delete_test.go:256: (dbg) Non-zero exit: out/minikube-linux-arm64 start -p old-k8s-version-884192 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=docker  --container-runtime=containerd --kubernetes-version=v1.20.0: exit status 102 (6m10.373675386s)

                                                
                                                
-- stdout --
	* [old-k8s-version-884192] minikube v1.33.1 on Ubuntu 20.04 (arm64)
	  - MINIKUBE_LOCATION=19339
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - KUBECONFIG=/home/jenkins/minikube-integration/19339-134334/kubeconfig
	  - MINIKUBE_HOME=/home/jenkins/minikube-integration/19339-134334/.minikube
	  - MINIKUBE_BIN=out/minikube-linux-arm64
	  - MINIKUBE_FORCE_SYSTEMD=
	* Kubernetes 1.30.3 is now available. If you would like to upgrade, specify: --kubernetes-version=v1.30.3
	* Using the docker driver based on existing profile
	* Starting "old-k8s-version-884192" primary control-plane node in "old-k8s-version-884192" cluster
	* Pulling base image v0.0.44-1721902582-19326 ...
	* Restarting existing docker container for "old-k8s-version-884192" ...
	* Preparing Kubernetes v1.20.0 on containerd 1.7.19 ...
	* Verifying Kubernetes components...
	  - Using image docker.io/kubernetesui/dashboard:v2.7.0
	  - Using image gcr.io/k8s-minikube/storage-provisioner:v5
	  - Using image registry.k8s.io/echoserver:1.4
	  - Using image fake.domain/registry.k8s.io/echoserver:1.4
	* Some dashboard features require the metrics-server addon. To enable all features please run:
	
		minikube -p old-k8s-version-884192 addons enable metrics-server
	
	* Enabled addons: metrics-server, dashboard, storage-provisioner, default-storageclass
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0729 21:03:22.864100  345638 out.go:291] Setting OutFile to fd 1 ...
	I0729 21:03:22.864298  345638 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0729 21:03:22.864309  345638 out.go:304] Setting ErrFile to fd 2...
	I0729 21:03:22.864315  345638 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0729 21:03:22.864586  345638 root.go:338] Updating PATH: /home/jenkins/minikube-integration/19339-134334/.minikube/bin
	I0729 21:03:22.864964  345638 out.go:298] Setting JSON to false
	I0729 21:03:22.865969  345638 start.go:129] hostinfo: {"hostname":"ip-172-31-29-130","uptime":67549,"bootTime":1722219454,"procs":196,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1065-aws","kernelArch":"aarch64","virtualizationSystem":"","virtualizationRole":"","hostId":"36adf542-ef4f-4e2d-a0c8-6868d1383ff9"}
	I0729 21:03:22.866034  345638 start.go:139] virtualization:  
	I0729 21:03:22.870266  345638 out.go:177] * [old-k8s-version-884192] minikube v1.33.1 on Ubuntu 20.04 (arm64)
	I0729 21:03:22.872110  345638 out.go:177]   - MINIKUBE_LOCATION=19339
	I0729 21:03:22.872167  345638 notify.go:220] Checking for updates...
	I0729 21:03:22.877794  345638 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I0729 21:03:22.879710  345638 out.go:177]   - KUBECONFIG=/home/jenkins/minikube-integration/19339-134334/kubeconfig
	I0729 21:03:22.881430  345638 out.go:177]   - MINIKUBE_HOME=/home/jenkins/minikube-integration/19339-134334/.minikube
	I0729 21:03:22.883313  345638 out.go:177]   - MINIKUBE_BIN=out/minikube-linux-arm64
	I0729 21:03:22.885056  345638 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=
	I0729 21:03:22.886995  345638 config.go:182] Loaded profile config "old-k8s-version-884192": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.20.0
	I0729 21:03:22.889261  345638 out.go:177] * Kubernetes 1.30.3 is now available. If you would like to upgrade, specify: --kubernetes-version=v1.30.3
	I0729 21:03:22.890903  345638 driver.go:392] Setting default libvirt URI to qemu:///system
	I0729 21:03:22.925331  345638 docker.go:123] docker version: linux-27.1.1:Docker Engine - Community
	I0729 21:03:22.925916  345638 cli_runner.go:164] Run: docker system info --format "{{json .}}"
	I0729 21:03:22.999767  345638 info.go:266] docker info: {ID:U5VK:ZNT5:35M3:FHLW:Q7TL:ELFX:BNAG:AV4T:UD2H:SK5L:SEJV:SJJL Containers:2 ContainersRunning:1 ContainersPaused:0 ContainersStopped:1 Images:4 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:52 OomKillDisable:true NGoroutines:68 SystemTime:2024-07-29 21:03:22.989456988 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1065-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Architecture:aar
ch64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8214900736 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-29-130 Labels:[] ExperimentalBuild:false ServerVersion:27.1.1 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:2bf793ef6dc9a18e00cb12efb64355c2c9d5eb41 Expected:2bf793ef6dc9a18e00cb12efb64355c2c9d5eb41} RuncCommit:{ID:v1.1.13-0-g58aa920 Expected:v1.1.13-0-g58aa920} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:<nil> ServerErro
rs:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.16.1] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.29.1]] Warnings:<nil>}}
	I0729 21:03:22.999875  345638 docker.go:307] overlay module found
	I0729 21:03:23.008164  345638 out.go:177] * Using the docker driver based on existing profile
	I0729 21:03:23.010217  345638 start.go:297] selected driver: docker
	I0729 21:03:23.010245  345638 start.go:901] validating driver "docker" against &{Name:old-k8s-version-884192 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721902582-19326@sha256:540fb5dc7f38be17ff5276a38dfe6c8a4b1d9ba1c27c62244e6eebd7e37696e7 Memory:2200 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-884192 Namespace:default APIServerHAVIP: AP
IServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.76.2 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[dashboard:true default-storageclass:true metrics-server:true storage-provisioner:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4 MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:fa
lse MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I0729 21:03:23.010396  345638 start.go:912] status for docker: {Installed:true Healthy:true Running:false NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I0729 21:03:23.011148  345638 cli_runner.go:164] Run: docker system info --format "{{json .}}"
	I0729 21:03:23.116617  345638 info.go:266] docker info: {ID:U5VK:ZNT5:35M3:FHLW:Q7TL:ELFX:BNAG:AV4T:UD2H:SK5L:SEJV:SJJL Containers:2 ContainersRunning:1 ContainersPaused:0 ContainersStopped:1 Images:4 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:52 OomKillDisable:true NGoroutines:68 SystemTime:2024-07-29 21:03:23.105722776 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1065-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Architecture:aar
ch64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8214900736 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-29-130 Labels:[] ExperimentalBuild:false ServerVersion:27.1.1 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:2bf793ef6dc9a18e00cb12efb64355c2c9d5eb41 Expected:2bf793ef6dc9a18e00cb12efb64355c2c9d5eb41} RuncCommit:{ID:v1.1.13-0-g58aa920 Expected:v1.1.13-0-g58aa920} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:<nil> ServerErro
rs:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.16.1] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.29.1]] Warnings:<nil>}}
	I0729 21:03:23.116976  345638 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
	I0729 21:03:23.117009  345638 cni.go:84] Creating CNI manager for ""
	I0729 21:03:23.117018  345638 cni.go:143] "docker" driver + "containerd" runtime found, recommending kindnet
	I0729 21:03:23.117068  345638 start.go:340] cluster config:
	{Name:old-k8s-version-884192 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721902582-19326@sha256:540fb5dc7f38be17ff5276a38dfe6c8a4b1d9ba1c27c62244e6eebd7e37696e7 Memory:2200 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-884192 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local
ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.76.2 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[dashboard:true default-storageclass:true metrics-server:true storage-provisioner:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4 MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:do
cker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I0729 21:03:23.119373  345638 out.go:177] * Starting "old-k8s-version-884192" primary control-plane node in "old-k8s-version-884192" cluster
	I0729 21:03:23.121342  345638 cache.go:121] Beginning downloading kic base image for docker with containerd
	I0729 21:03:23.123009  345638 out.go:177] * Pulling base image v0.0.44-1721902582-19326 ...
	I0729 21:03:23.124586  345638 preload.go:131] Checking if preload exists for k8s version v1.20.0 and runtime containerd
	I0729 21:03:23.124639  345638 preload.go:146] Found local preload: /home/jenkins/minikube-integration/19339-134334/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-containerd-overlay2-arm64.tar.lz4
	I0729 21:03:23.124654  345638 cache.go:56] Caching tarball of preloaded images
	I0729 21:03:23.124677  345638 image.go:79] Checking for gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721902582-19326@sha256:540fb5dc7f38be17ff5276a38dfe6c8a4b1d9ba1c27c62244e6eebd7e37696e7 in local docker daemon
	I0729 21:03:23.124735  345638 preload.go:172] Found /home/jenkins/minikube-integration/19339-134334/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-containerd-overlay2-arm64.tar.lz4 in cache, skipping download
	I0729 21:03:23.124745  345638 cache.go:59] Finished verifying existence of preloaded tar for v1.20.0 on containerd
	I0729 21:03:23.124864  345638 profile.go:143] Saving config to /home/jenkins/minikube-integration/19339-134334/.minikube/profiles/old-k8s-version-884192/config.json ...
	W0729 21:03:23.148796  345638 image.go:95] image gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721902582-19326@sha256:540fb5dc7f38be17ff5276a38dfe6c8a4b1d9ba1c27c62244e6eebd7e37696e7 is of wrong architecture
	I0729 21:03:23.148818  345638 cache.go:149] Downloading gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721902582-19326@sha256:540fb5dc7f38be17ff5276a38dfe6c8a4b1d9ba1c27c62244e6eebd7e37696e7 to local cache
	I0729 21:03:23.148897  345638 image.go:63] Checking for gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721902582-19326@sha256:540fb5dc7f38be17ff5276a38dfe6c8a4b1d9ba1c27c62244e6eebd7e37696e7 in local cache directory
	I0729 21:03:23.148921  345638 image.go:66] Found gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721902582-19326@sha256:540fb5dc7f38be17ff5276a38dfe6c8a4b1d9ba1c27c62244e6eebd7e37696e7 in local cache directory, skipping pull
	I0729 21:03:23.148926  345638 image.go:135] gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721902582-19326@sha256:540fb5dc7f38be17ff5276a38dfe6c8a4b1d9ba1c27c62244e6eebd7e37696e7 exists in cache, skipping pull
	I0729 21:03:23.148935  345638 cache.go:152] successfully saved gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721902582-19326@sha256:540fb5dc7f38be17ff5276a38dfe6c8a4b1d9ba1c27c62244e6eebd7e37696e7 as a tarball
	I0729 21:03:23.148941  345638 cache.go:162] Loading gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721902582-19326@sha256:540fb5dc7f38be17ff5276a38dfe6c8a4b1d9ba1c27c62244e6eebd7e37696e7 from local cache
	I0729 21:03:23.287740  345638 cache.go:164] successfully loaded and using gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721902582-19326@sha256:540fb5dc7f38be17ff5276a38dfe6c8a4b1d9ba1c27c62244e6eebd7e37696e7 from cached tarball
	I0729 21:03:23.287777  345638 cache.go:194] Successfully downloaded all kic artifacts
	I0729 21:03:23.287814  345638 start.go:360] acquireMachinesLock for old-k8s-version-884192: {Name:mk7b2e4f73017f7bc4d5115a5808dc85f6b52565 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0729 21:03:23.287874  345638 start.go:364] duration metric: took 39.466µs to acquireMachinesLock for "old-k8s-version-884192"
	I0729 21:03:23.287894  345638 start.go:96] Skipping create...Using existing machine configuration
	I0729 21:03:23.287899  345638 fix.go:54] fixHost starting: 
	I0729 21:03:23.288257  345638 cli_runner.go:164] Run: docker container inspect old-k8s-version-884192 --format={{.State.Status}}
	I0729 21:03:23.311648  345638 fix.go:112] recreateIfNeeded on old-k8s-version-884192: state=Stopped err=<nil>
	W0729 21:03:23.311675  345638 fix.go:138] unexpected machine state, will restart: <nil>
	I0729 21:03:23.314011  345638 out.go:177] * Restarting existing docker container for "old-k8s-version-884192" ...
	I0729 21:03:23.315919  345638 cli_runner.go:164] Run: docker start old-k8s-version-884192
	I0729 21:03:23.682233  345638 cli_runner.go:164] Run: docker container inspect old-k8s-version-884192 --format={{.State.Status}}
	I0729 21:03:23.704264  345638 kic.go:430] container "old-k8s-version-884192" state is running.
	I0729 21:03:23.705266  345638 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" old-k8s-version-884192
	I0729 21:03:23.748602  345638 profile.go:143] Saving config to /home/jenkins/minikube-integration/19339-134334/.minikube/profiles/old-k8s-version-884192/config.json ...
	I0729 21:03:23.748853  345638 machine.go:94] provisionDockerMachine start ...
	I0729 21:03:23.748914  345638 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-884192
	I0729 21:03:23.770885  345638 main.go:141] libmachine: Using SSH client type: native
	I0729 21:03:23.771168  345638 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x3e2cd0] 0x3e5530 <nil>  [] 0s} 127.0.0.1 37330 <nil> <nil>}
	I0729 21:03:23.771184  345638 main.go:141] libmachine: About to run SSH command:
	hostname
	I0729 21:03:23.771868  345638 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: EOF
	I0729 21:03:26.911748  345638 main.go:141] libmachine: SSH cmd err, output: <nil>: old-k8s-version-884192
	
	I0729 21:03:26.911770  345638 ubuntu.go:169] provisioning hostname "old-k8s-version-884192"
	I0729 21:03:26.911834  345638 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-884192
	I0729 21:03:26.935441  345638 main.go:141] libmachine: Using SSH client type: native
	I0729 21:03:26.935937  345638 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x3e2cd0] 0x3e5530 <nil>  [] 0s} 127.0.0.1 37330 <nil> <nil>}
	I0729 21:03:26.935971  345638 main.go:141] libmachine: About to run SSH command:
	sudo hostname old-k8s-version-884192 && echo "old-k8s-version-884192" | sudo tee /etc/hostname
	I0729 21:03:27.097648  345638 main.go:141] libmachine: SSH cmd err, output: <nil>: old-k8s-version-884192
	
	I0729 21:03:27.097740  345638 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-884192
	I0729 21:03:27.119795  345638 main.go:141] libmachine: Using SSH client type: native
	I0729 21:03:27.120087  345638 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x3e2cd0] 0x3e5530 <nil>  [] 0s} 127.0.0.1 37330 <nil> <nil>}
	I0729 21:03:27.120109  345638 main.go:141] libmachine: About to run SSH command:
	
			if ! grep -xq '.*\sold-k8s-version-884192' /etc/hosts; then
				if grep -xq '127.0.1.1\s.*' /etc/hosts; then
					sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 old-k8s-version-884192/g' /etc/hosts;
				else 
					echo '127.0.1.1 old-k8s-version-884192' | sudo tee -a /etc/hosts; 
				fi
			fi
	I0729 21:03:27.255852  345638 main.go:141] libmachine: SSH cmd err, output: <nil>: 
	I0729 21:03:27.255880  345638 ubuntu.go:175] set auth options {CertDir:/home/jenkins/minikube-integration/19339-134334/.minikube CaCertPath:/home/jenkins/minikube-integration/19339-134334/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/19339-134334/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/19339-134334/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/19339-134334/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/19339-134334/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/19339-134334/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/19339-134334/.minikube}
	I0729 21:03:27.255912  345638 ubuntu.go:177] setting up certificates
	I0729 21:03:27.255922  345638 provision.go:84] configureAuth start
	I0729 21:03:27.256012  345638 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" old-k8s-version-884192
	I0729 21:03:27.276254  345638 provision.go:143] copyHostCerts
	I0729 21:03:27.276371  345638 exec_runner.go:144] found /home/jenkins/minikube-integration/19339-134334/.minikube/ca.pem, removing ...
	I0729 21:03:27.276412  345638 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19339-134334/.minikube/ca.pem
	I0729 21:03:27.276516  345638 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19339-134334/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/19339-134334/.minikube/ca.pem (1078 bytes)
	I0729 21:03:27.276675  345638 exec_runner.go:144] found /home/jenkins/minikube-integration/19339-134334/.minikube/cert.pem, removing ...
	I0729 21:03:27.276755  345638 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19339-134334/.minikube/cert.pem
	I0729 21:03:27.276817  345638 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19339-134334/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/19339-134334/.minikube/cert.pem (1123 bytes)
	I0729 21:03:27.276940  345638 exec_runner.go:144] found /home/jenkins/minikube-integration/19339-134334/.minikube/key.pem, removing ...
	I0729 21:03:27.276965  345638 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19339-134334/.minikube/key.pem
	I0729 21:03:27.277027  345638 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19339-134334/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/19339-134334/.minikube/key.pem (1679 bytes)
	I0729 21:03:27.277161  345638 provision.go:117] generating server cert: /home/jenkins/minikube-integration/19339-134334/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/19339-134334/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/19339-134334/.minikube/certs/ca-key.pem org=jenkins.old-k8s-version-884192 san=[127.0.0.1 192.168.76.2 localhost minikube old-k8s-version-884192]
	I0729 21:03:27.585585  345638 provision.go:177] copyRemoteCerts
	I0729 21:03:27.585700  345638 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
	I0729 21:03:27.585781  345638 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-884192
	I0729 21:03:27.617344  345638 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:37330 SSHKeyPath:/home/jenkins/minikube-integration/19339-134334/.minikube/machines/old-k8s-version-884192/id_rsa Username:docker}
	I0729 21:03:27.713819  345638 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19339-134334/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1078 bytes)
	I0729 21:03:27.743409  345638 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19339-134334/.minikube/machines/server.pem --> /etc/docker/server.pem (1233 bytes)
	I0729 21:03:27.770269  345638 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19339-134334/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1679 bytes)
	I0729 21:03:27.797959  345638 provision.go:87] duration metric: took 542.01922ms to configureAuth
	I0729 21:03:27.797988  345638 ubuntu.go:193] setting minikube options for container-runtime
	I0729 21:03:27.798178  345638 config.go:182] Loaded profile config "old-k8s-version-884192": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.20.0
	I0729 21:03:27.798193  345638 machine.go:97] duration metric: took 4.049332067s to provisionDockerMachine
	I0729 21:03:27.798202  345638 start.go:293] postStartSetup for "old-k8s-version-884192" (driver="docker")
	I0729 21:03:27.798213  345638 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
	I0729 21:03:27.798263  345638 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
	I0729 21:03:27.798318  345638 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-884192
	I0729 21:03:27.818148  345638 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:37330 SSHKeyPath:/home/jenkins/minikube-integration/19339-134334/.minikube/machines/old-k8s-version-884192/id_rsa Username:docker}
	I0729 21:03:27.922351  345638 ssh_runner.go:195] Run: cat /etc/os-release
	I0729 21:03:27.926542  345638 main.go:141] libmachine: Couldn't set key VERSION_CODENAME, no corresponding struct field found
	I0729 21:03:27.926581  345638 main.go:141] libmachine: Couldn't set key PRIVACY_POLICY_URL, no corresponding struct field found
	I0729 21:03:27.926591  345638 main.go:141] libmachine: Couldn't set key UBUNTU_CODENAME, no corresponding struct field found
	I0729 21:03:27.926598  345638 info.go:137] Remote host: Ubuntu 22.04.4 LTS
	I0729 21:03:27.926609  345638 filesync.go:126] Scanning /home/jenkins/minikube-integration/19339-134334/.minikube/addons for local assets ...
	I0729 21:03:27.926665  345638 filesync.go:126] Scanning /home/jenkins/minikube-integration/19339-134334/.minikube/files for local assets ...
	I0729 21:03:27.926745  345638 filesync.go:149] local asset: /home/jenkins/minikube-integration/19339-134334/.minikube/files/etc/ssl/certs/1397282.pem -> 1397282.pem in /etc/ssl/certs
	I0729 21:03:27.926849  345638 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs
	I0729 21:03:27.936532  345638 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19339-134334/.minikube/files/etc/ssl/certs/1397282.pem --> /etc/ssl/certs/1397282.pem (1708 bytes)
	I0729 21:03:27.963060  345638 start.go:296] duration metric: took 164.843412ms for postStartSetup
	I0729 21:03:27.963139  345638 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
	I0729 21:03:27.963178  345638 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-884192
	I0729 21:03:27.981602  345638 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:37330 SSHKeyPath:/home/jenkins/minikube-integration/19339-134334/.minikube/machines/old-k8s-version-884192/id_rsa Username:docker}
	I0729 21:03:28.074477  345638 ssh_runner.go:195] Run: sh -c "df -BG /var | awk 'NR==2{print $4}'"
	I0729 21:03:28.080039  345638 fix.go:56] duration metric: took 4.792130493s for fixHost
	I0729 21:03:28.080063  345638 start.go:83] releasing machines lock for "old-k8s-version-884192", held for 4.792180691s
	I0729 21:03:28.080153  345638 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" old-k8s-version-884192
	I0729 21:03:28.113524  345638 ssh_runner.go:195] Run: cat /version.json
	I0729 21:03:28.113587  345638 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-884192
	I0729 21:03:28.113643  345638 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/
	I0729 21:03:28.113708  345638 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-884192
	I0729 21:03:28.135378  345638 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:37330 SSHKeyPath:/home/jenkins/minikube-integration/19339-134334/.minikube/machines/old-k8s-version-884192/id_rsa Username:docker}
	I0729 21:03:28.152220  345638 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:37330 SSHKeyPath:/home/jenkins/minikube-integration/19339-134334/.minikube/machines/old-k8s-version-884192/id_rsa Username:docker}
	I0729 21:03:28.256225  345638 ssh_runner.go:195] Run: systemctl --version
	I0729 21:03:28.394910  345638 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"
	I0729 21:03:28.399769  345638 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f -name *loopback.conf* -not -name *.mk_disabled -exec sh -c "grep -q loopback {} && ( grep -q name {} || sudo sed -i '/"type": "loopback"/i \ \ \ \ "name": "loopback",' {} ) && sudo sed -i 's|"cniVersion": ".*"|"cniVersion": "1.0.0"|g' {}" ;
	I0729 21:03:28.419440  345638 cni.go:230] loopback cni configuration patched: "/etc/cni/net.d/*loopback.conf*" found
	I0729 21:03:28.419521  345638 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%p, " -exec sh -c "sudo mv {} {}.mk_disabled" ;
	I0729 21:03:28.429487  345638 cni.go:259] no active bridge cni configs found in "/etc/cni/net.d" - nothing to disable
	I0729 21:03:28.429517  345638 start.go:495] detecting cgroup driver to use...
	I0729 21:03:28.429551  345638 detect.go:187] detected "cgroupfs" cgroup driver on host os
	I0729 21:03:28.429612  345638 ssh_runner.go:195] Run: sudo systemctl stop -f crio
	I0729 21:03:28.447076  345638 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service crio
	I0729 21:03:28.460382  345638 docker.go:217] disabling cri-docker service (if available) ...
	I0729 21:03:28.460452  345638 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.socket
	I0729 21:03:28.474856  345638 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.service
	I0729 21:03:28.491285  345638 ssh_runner.go:195] Run: sudo systemctl disable cri-docker.socket
	I0729 21:03:28.620459  345638 ssh_runner.go:195] Run: sudo systemctl mask cri-docker.service
	I0729 21:03:28.742869  345638 docker.go:233] disabling docker service ...
	I0729 21:03:28.742981  345638 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket
	I0729 21:03:28.757333  345638 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service
	I0729 21:03:28.769778  345638 ssh_runner.go:195] Run: sudo systemctl disable docker.socket
	I0729 21:03:28.881030  345638 ssh_runner.go:195] Run: sudo systemctl mask docker.service
	I0729 21:03:29.024649  345638 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker
	I0729 21:03:29.041618  345638 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///run/containerd/containerd.sock
	" | sudo tee /etc/crictl.yaml"
	I0729 21:03:29.071210  345638 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)sandbox_image = .*$|\1sandbox_image = "registry.k8s.io/pause:3.2"|' /etc/containerd/config.toml"
	I0729 21:03:29.085907  345638 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)restrict_oom_score_adj = .*$|\1restrict_oom_score_adj = false|' /etc/containerd/config.toml"
	I0729 21:03:29.099952  345638 containerd.go:146] configuring containerd to use "cgroupfs" as cgroup driver...
	I0729 21:03:29.100119  345638 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)SystemdCgroup = .*$|\1SystemdCgroup = false|g' /etc/containerd/config.toml"
	I0729 21:03:29.115116  345638 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runtime.v1.linux"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"
	I0729 21:03:29.142961  345638 ssh_runner.go:195] Run: sh -c "sudo sed -i '/systemd_cgroup/d' /etc/containerd/config.toml"
	I0729 21:03:29.164638  345638 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runc.v1"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"
	I0729 21:03:29.184860  345638 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"
	I0729 21:03:29.211616  345638 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)conf_dir = .*$|\1conf_dir = "/etc/cni/net.d"|g' /etc/containerd/config.toml"
	I0729 21:03:29.224960  345638 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
	I0729 21:03:29.236641  345638 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
	I0729 21:03:29.246346  345638 ssh_runner.go:195] Run: sudo systemctl daemon-reload
	I0729 21:03:29.367544  345638 ssh_runner.go:195] Run: sudo systemctl restart containerd
	I0729 21:03:29.593231  345638 start.go:542] Will wait 60s for socket path /run/containerd/containerd.sock
	I0729 21:03:29.593308  345638 ssh_runner.go:195] Run: stat /run/containerd/containerd.sock
	I0729 21:03:29.598681  345638 start.go:563] Will wait 60s for crictl version
	I0729 21:03:29.598750  345638 ssh_runner.go:195] Run: which crictl
	I0729 21:03:29.602596  345638 ssh_runner.go:195] Run: sudo /usr/bin/crictl version
	I0729 21:03:29.658711  345638 start.go:579] Version:  0.1.0
	RuntimeName:  containerd
	RuntimeVersion:  1.7.19
	RuntimeApiVersion:  v1
	I0729 21:03:29.658791  345638 ssh_runner.go:195] Run: containerd --version
	I0729 21:03:29.682728  345638 ssh_runner.go:195] Run: containerd --version
	I0729 21:03:29.712176  345638 out.go:177] * Preparing Kubernetes v1.20.0 on containerd 1.7.19 ...
	I0729 21:03:29.713926  345638 cli_runner.go:164] Run: docker network inspect old-k8s-version-884192 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
	I0729 21:03:29.751859  345638 ssh_runner.go:195] Run: grep 192.168.76.1	host.minikube.internal$ /etc/hosts
	I0729 21:03:29.755902  345638 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.76.1	host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
	I0729 21:03:29.770945  345638 kubeadm.go:883] updating cluster {Name:old-k8s-version-884192 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721902582-19326@sha256:540fb5dc7f38be17ff5276a38dfe6c8a4b1d9ba1c27c62244e6eebd7e37696e7 Memory:2200 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-884192 Namespace:default APIServerHAVIP: APIServerName:minik
ubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.76.2 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[dashboard:true default-storageclass:true metrics-server:true storage-provisioner:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4 MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/
home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} ...
	I0729 21:03:29.771077  345638 preload.go:131] Checking if preload exists for k8s version v1.20.0 and runtime containerd
	I0729 21:03:29.771142  345638 ssh_runner.go:195] Run: sudo crictl images --output json
	I0729 21:03:29.816087  345638 containerd.go:627] all images are preloaded for containerd runtime.
	I0729 21:03:29.816113  345638 containerd.go:534] Images already preloaded, skipping extraction
	I0729 21:03:29.816174  345638 ssh_runner.go:195] Run: sudo crictl images --output json
	I0729 21:03:29.861779  345638 containerd.go:627] all images are preloaded for containerd runtime.
	I0729 21:03:29.861807  345638 cache_images.go:84] Images are preloaded, skipping loading
	I0729 21:03:29.861816  345638 kubeadm.go:934] updating node { 192.168.76.2 8443 v1.20.0 containerd true true} ...
	I0729 21:03:29.861930  345638 kubeadm.go:946] kubelet [Unit]
	Wants=containerd.service
	
	[Service]
	ExecStart=
	ExecStart=/var/lib/minikube/binaries/v1.20.0/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --container-runtime=remote --container-runtime-endpoint=unix:///run/containerd/containerd.sock --hostname-override=old-k8s-version-884192 --kubeconfig=/etc/kubernetes/kubelet.conf --network-plugin=cni --node-ip=192.168.76.2
	
	[Install]
	 config:
	{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-884192 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:}
	I0729 21:03:29.862006  345638 ssh_runner.go:195] Run: sudo crictl info
	I0729 21:03:29.915274  345638 cni.go:84] Creating CNI manager for ""
	I0729 21:03:29.915299  345638 cni.go:143] "docker" driver + "containerd" runtime found, recommending kindnet
	I0729 21:03:29.915308  345638 kubeadm.go:84] Using pod CIDR: 10.244.0.0/16
	I0729 21:03:29.915328  345638 kubeadm.go:181] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.76.2 APIServerPort:8443 KubernetesVersion:v1.20.0 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:old-k8s-version-884192 NodeName:old-k8s-version-884192 DNSDomain:cluster.local CRISocket:/run/containerd/containerd.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.76.2"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.76.2 CgroupDriver:cgroupfs ClientCAFile:/var/lib/minikube/certs/ca.crt
StaticPodPath:/etc/kubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:false}
	I0729 21:03:29.915464  345638 kubeadm.go:187] kubeadm config:
	apiVersion: kubeadm.k8s.io/v1beta2
	kind: InitConfiguration
	localAPIEndpoint:
	  advertiseAddress: 192.168.76.2
	  bindPort: 8443
	bootstrapTokens:
	  - groups:
	      - system:bootstrappers:kubeadm:default-node-token
	    ttl: 24h0m0s
	    usages:
	      - signing
	      - authentication
	nodeRegistration:
	  criSocket: /run/containerd/containerd.sock
	  name: "old-k8s-version-884192"
	  kubeletExtraArgs:
	    node-ip: 192.168.76.2
	  taints: []
	---
	apiVersion: kubeadm.k8s.io/v1beta2
	kind: ClusterConfiguration
	apiServer:
	  certSANs: ["127.0.0.1", "localhost", "192.168.76.2"]
	  extraArgs:
	    enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"
	controllerManager:
	  extraArgs:
	    allocate-node-cidrs: "true"
	    leader-elect: "false"
	scheduler:
	  extraArgs:
	    leader-elect: "false"
	certificatesDir: /var/lib/minikube/certs
	clusterName: mk
	controlPlaneEndpoint: control-plane.minikube.internal:8443
	dns:
	  type: CoreDNS
	etcd:
	  local:
	    dataDir: /var/lib/minikube/etcd
	    extraArgs:
	      proxy-refresh-interval: "70000"
	kubernetesVersion: v1.20.0
	networking:
	  dnsDomain: cluster.local
	  podSubnet: "10.244.0.0/16"
	  serviceSubnet: 10.96.0.0/12
	---
	apiVersion: kubelet.config.k8s.io/v1beta1
	kind: KubeletConfiguration
	authentication:
	  x509:
	    clientCAFile: /var/lib/minikube/certs/ca.crt
	cgroupDriver: cgroupfs
	hairpinMode: hairpin-veth
	runtimeRequestTimeout: 15m
	clusterDomain: "cluster.local"
	# disable disk resource management by default
	imageGCHighThresholdPercent: 100
	evictionHard:
	  nodefs.available: "0%"
	  nodefs.inodesFree: "0%"
	  imagefs.available: "0%"
	failSwapOn: false
	staticPodPath: /etc/kubernetes/manifests
	---
	apiVersion: kubeproxy.config.k8s.io/v1alpha1
	kind: KubeProxyConfiguration
	clusterCIDR: "10.244.0.0/16"
	metricsBindAddress: 0.0.0.0:10249
	conntrack:
	  maxPerCore: 0
	# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"
	  tcpEstablishedTimeout: 0s
	# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"
	  tcpCloseWaitTimeout: 0s
	
	I0729 21:03:29.915539  345638 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.20.0
	I0729 21:03:29.925438  345638 binaries.go:44] Found k8s binaries, skipping transfer
	I0729 21:03:29.925532  345638 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube
	I0729 21:03:29.935166  345638 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (442 bytes)
	I0729 21:03:29.954638  345638 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)
	I0729 21:03:29.974440  345638 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2125 bytes)
	I0729 21:03:29.994080  345638 ssh_runner.go:195] Run: grep 192.168.76.2	control-plane.minikube.internal$ /etc/hosts
	I0729 21:03:29.997870  345638 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.76.2	control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
	I0729 21:03:30.011070  345638 ssh_runner.go:195] Run: sudo systemctl daemon-reload
	I0729 21:03:30.134259  345638 ssh_runner.go:195] Run: sudo systemctl start kubelet
	I0729 21:03:30.150807  345638 certs.go:68] Setting up /home/jenkins/minikube-integration/19339-134334/.minikube/profiles/old-k8s-version-884192 for IP: 192.168.76.2
	I0729 21:03:30.150880  345638 certs.go:194] generating shared ca certs ...
	I0729 21:03:30.150911  345638 certs.go:226] acquiring lock for ca certs: {Name:mk3aee57cd6443b182ded24fc10ff956bd250ae4 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0729 21:03:30.151104  345638 certs.go:235] skipping valid "minikubeCA" ca cert: /home/jenkins/minikube-integration/19339-134334/.minikube/ca.key
	I0729 21:03:30.151186  345638 certs.go:235] skipping valid "proxyClientCA" ca cert: /home/jenkins/minikube-integration/19339-134334/.minikube/proxy-client-ca.key
	I0729 21:03:30.151221  345638 certs.go:256] generating profile certs ...
	I0729 21:03:30.151359  345638 certs.go:359] skipping valid signed profile cert regeneration for "minikube-user": /home/jenkins/minikube-integration/19339-134334/.minikube/profiles/old-k8s-version-884192/client.key
	I0729 21:03:30.151466  345638 certs.go:359] skipping valid signed profile cert regeneration for "minikube": /home/jenkins/minikube-integration/19339-134334/.minikube/profiles/old-k8s-version-884192/apiserver.key.104cfb7f
	I0729 21:03:30.151536  345638 certs.go:359] skipping valid signed profile cert regeneration for "aggregator": /home/jenkins/minikube-integration/19339-134334/.minikube/profiles/old-k8s-version-884192/proxy-client.key
	I0729 21:03:30.151685  345638 certs.go:484] found cert: /home/jenkins/minikube-integration/19339-134334/.minikube/certs/139728.pem (1338 bytes)
	W0729 21:03:30.151741  345638 certs.go:480] ignoring /home/jenkins/minikube-integration/19339-134334/.minikube/certs/139728_empty.pem, impossibly tiny 0 bytes
	I0729 21:03:30.151765  345638 certs.go:484] found cert: /home/jenkins/minikube-integration/19339-134334/.minikube/certs/ca-key.pem (1675 bytes)
	I0729 21:03:30.151820  345638 certs.go:484] found cert: /home/jenkins/minikube-integration/19339-134334/.minikube/certs/ca.pem (1078 bytes)
	I0729 21:03:30.151871  345638 certs.go:484] found cert: /home/jenkins/minikube-integration/19339-134334/.minikube/certs/cert.pem (1123 bytes)
	I0729 21:03:30.151929  345638 certs.go:484] found cert: /home/jenkins/minikube-integration/19339-134334/.minikube/certs/key.pem (1679 bytes)
	I0729 21:03:30.152029  345638 certs.go:484] found cert: /home/jenkins/minikube-integration/19339-134334/.minikube/files/etc/ssl/certs/1397282.pem (1708 bytes)
	I0729 21:03:30.152714  345638 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19339-134334/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
	I0729 21:03:30.182183  345638 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19339-134334/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1679 bytes)
	I0729 21:03:30.231444  345638 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19339-134334/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
	I0729 21:03:30.270410  345638 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19339-134334/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1679 bytes)
	I0729 21:03:30.345831  345638 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19339-134334/.minikube/profiles/old-k8s-version-884192/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1432 bytes)
	I0729 21:03:30.394926  345638 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19339-134334/.minikube/profiles/old-k8s-version-884192/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1679 bytes)
	I0729 21:03:30.421252  345638 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19339-134334/.minikube/profiles/old-k8s-version-884192/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
	I0729 21:03:30.447064  345638 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19339-134334/.minikube/profiles/old-k8s-version-884192/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1675 bytes)
	I0729 21:03:30.473338  345638 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19339-134334/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
	I0729 21:03:30.499589  345638 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19339-134334/.minikube/certs/139728.pem --> /usr/share/ca-certificates/139728.pem (1338 bytes)
	I0729 21:03:30.525559  345638 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19339-134334/.minikube/files/etc/ssl/certs/1397282.pem --> /usr/share/ca-certificates/1397282.pem (1708 bytes)
	I0729 21:03:30.563475  345638 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)
	I0729 21:03:30.600341  345638 ssh_runner.go:195] Run: openssl version
	I0729 21:03:30.606454  345638 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
	I0729 21:03:30.616332  345638 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
	I0729 21:03:30.620718  345638 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 Jul 29 20:13 /usr/share/ca-certificates/minikubeCA.pem
	I0729 21:03:30.620801  345638 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
	I0729 21:03:30.628680  345638 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
	I0729 21:03:30.637976  345638 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/139728.pem && ln -fs /usr/share/ca-certificates/139728.pem /etc/ssl/certs/139728.pem"
	I0729 21:03:30.647463  345638 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/139728.pem
	I0729 21:03:30.651569  345638 certs.go:528] hashing: -rw-r--r-- 1 root root 1338 Jul 29 20:23 /usr/share/ca-certificates/139728.pem
	I0729 21:03:30.651657  345638 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/139728.pem
	I0729 21:03:30.659314  345638 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/139728.pem /etc/ssl/certs/51391683.0"
	I0729 21:03:30.668415  345638 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/1397282.pem && ln -fs /usr/share/ca-certificates/1397282.pem /etc/ssl/certs/1397282.pem"
	I0729 21:03:30.677742  345638 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/1397282.pem
	I0729 21:03:30.682012  345638 certs.go:528] hashing: -rw-r--r-- 1 root root 1708 Jul 29 20:23 /usr/share/ca-certificates/1397282.pem
	I0729 21:03:30.682092  345638 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/1397282.pem
	I0729 21:03:30.689276  345638 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/1397282.pem /etc/ssl/certs/3ec20f2e.0"
	I0729 21:03:30.698204  345638 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt
	I0729 21:03:30.702503  345638 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/apiserver-etcd-client.crt -checkend 86400
	I0729 21:03:30.710023  345638 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/apiserver-kubelet-client.crt -checkend 86400
	I0729 21:03:30.717857  345638 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/server.crt -checkend 86400
	I0729 21:03:30.725354  345638 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/healthcheck-client.crt -checkend 86400
	I0729 21:03:30.733098  345638 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/peer.crt -checkend 86400
	I0729 21:03:30.740928  345638 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/front-proxy-client.crt -checkend 86400
	I0729 21:03:30.748388  345638 kubeadm.go:392] StartCluster: {Name:old-k8s-version-884192 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721902582-19326@sha256:540fb5dc7f38be17ff5276a38dfe6c8a4b1d9ba1c27c62244e6eebd7e37696e7 Memory:2200 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-884192 Namespace:default APIServerHAVIP: APIServerName:minikube
CA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.76.2 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[dashboard:true default-storageclass:true metrics-server:true storage-provisioner:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4 MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/hom
e/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I0729 21:03:30.748532  345638 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:paused Name: Namespaces:[kube-system]}
	I0729 21:03:30.748607  345638 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"
	I0729 21:03:30.799473  345638 cri.go:89] found id: "a11607490336d465d0dc075fbb00de0bc707a72aed0c22c0881dcd60db427adf"
	I0729 21:03:30.799503  345638 cri.go:89] found id: "fbbee29f2c588ded9a605a091aba1140ebd1f5d629d5ce39dd1c983e14798d82"
	I0729 21:03:30.799509  345638 cri.go:89] found id: "84762b0e269feace9f180c5b15ab2106b9821cdb586eac87780e8dd9ae3247c4"
	I0729 21:03:30.799512  345638 cri.go:89] found id: "cc4846179f2a5f6f93c7bdb1f437618106e1a00f39b10534afcbbee12f518c4e"
	I0729 21:03:30.799515  345638 cri.go:89] found id: "bc0116b218f41883478ef8c3d93fb1116431f7848779b1dccd7871ccda0dc49f"
	I0729 21:03:30.799519  345638 cri.go:89] found id: "6c3b9526f1351901cc60d713178c281355d6b3994267e1a6de1bf5f38054b4aa"
	I0729 21:03:30.799523  345638 cri.go:89] found id: "efa095c66551bd38c9deb191b3739441869b00874c7d3365c559609dcbd601c1"
	I0729 21:03:30.799525  345638 cri.go:89] found id: "75e8e58f6b60c620418997e5255b74f9697a29827f81dff4f9dbf920bab06deb"
	I0729 21:03:30.799529  345638 cri.go:89] found id: ""
	I0729 21:03:30.799579  345638 ssh_runner.go:195] Run: sudo runc --root /run/containerd/runc/k8s.io list -f json
	I0729 21:03:30.812594  345638 cri.go:116] JSON = null
	W0729 21:03:30.812638  345638 kubeadm.go:399] unpause failed: list paused: list returned 0 containers, but ps returned 8
	I0729 21:03:30.812703  345638 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd
	I0729 21:03:30.821604  345638 kubeadm.go:408] found existing configuration files, will attempt cluster restart
	I0729 21:03:30.821624  345638 kubeadm.go:593] restartPrimaryControlPlane start ...
	I0729 21:03:30.821675  345638 ssh_runner.go:195] Run: sudo test -d /data/minikube
	I0729 21:03:30.833225  345638 kubeadm.go:130] /data/minikube skipping compat symlinks: sudo test -d /data/minikube: Process exited with status 1
	stdout:
	
	stderr:
	I0729 21:03:30.833640  345638 kubeconfig.go:47] verify endpoint returned: get endpoint: "old-k8s-version-884192" does not appear in /home/jenkins/minikube-integration/19339-134334/kubeconfig
	I0729 21:03:30.833735  345638 kubeconfig.go:62] /home/jenkins/minikube-integration/19339-134334/kubeconfig needs updating (will repair): [kubeconfig missing "old-k8s-version-884192" cluster setting kubeconfig missing "old-k8s-version-884192" context setting]
	I0729 21:03:30.833996  345638 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19339-134334/kubeconfig: {Name:mkb30bb25d5aba25f4f65bf257c4658c6f12d204 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0729 21:03:30.835202  345638 ssh_runner.go:195] Run: sudo diff -u /var/tmp/minikube/kubeadm.yaml /var/tmp/minikube/kubeadm.yaml.new
	I0729 21:03:30.844977  345638 kubeadm.go:630] The running cluster does not require reconfiguration: 192.168.76.2
	I0729 21:03:30.845011  345638 kubeadm.go:597] duration metric: took 23.379991ms to restartPrimaryControlPlane
	I0729 21:03:30.845021  345638 kubeadm.go:394] duration metric: took 96.642169ms to StartCluster
	I0729 21:03:30.845045  345638 settings.go:142] acquiring lock: {Name:mk81a3d209173dd596c551ea10229601901fa17b Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0729 21:03:30.845142  345638 settings.go:150] Updating kubeconfig:  /home/jenkins/minikube-integration/19339-134334/kubeconfig
	I0729 21:03:30.845866  345638 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19339-134334/kubeconfig: {Name:mkb30bb25d5aba25f4f65bf257c4658c6f12d204 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0729 21:03:30.846321  345638 config.go:182] Loaded profile config "old-k8s-version-884192": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.20.0
	I0729 21:03:30.846376  345638 start.go:235] Will wait 6m0s for node &{Name: IP:192.168.76.2 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:containerd ControlPlane:true Worker:true}
	I0729 21:03:30.846437  345638 addons.go:507] enable addons start: toEnable=map[ambassador:false auto-pause:false cloud-spanner:false csi-hostpath-driver:false dashboard:true default-storageclass:true efk:false freshpod:false gcp-auth:false gvisor:false headlamp:false helm-tiller:false inaccel:false ingress:false ingress-dns:false inspektor-gadget:false istio:false istio-provisioner:false kong:false kubeflow:false kubevirt:false logviewer:false metallb:false metrics-server:true nvidia-device-plugin:false nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:false registry-aliases:false registry-creds:false storage-provisioner:true storage-provisioner-gluster:false storage-provisioner-rancher:false volcano:false volumesnapshots:false yakd:false]
	I0729 21:03:30.846786  345638 addons.go:69] Setting storage-provisioner=true in profile "old-k8s-version-884192"
	I0729 21:03:30.846825  345638 addons.go:234] Setting addon storage-provisioner=true in "old-k8s-version-884192"
	W0729 21:03:30.846834  345638 addons.go:243] addon storage-provisioner should already be in state true
	I0729 21:03:30.846861  345638 host.go:66] Checking if "old-k8s-version-884192" exists ...
	I0729 21:03:30.847303  345638 cli_runner.go:164] Run: docker container inspect old-k8s-version-884192 --format={{.State.Status}}
	I0729 21:03:30.847467  345638 addons.go:69] Setting default-storageclass=true in profile "old-k8s-version-884192"
	I0729 21:03:30.847498  345638 addons_storage_classes.go:33] enableOrDisableStorageClasses default-storageclass=true on "old-k8s-version-884192"
	I0729 21:03:30.847748  345638 cli_runner.go:164] Run: docker container inspect old-k8s-version-884192 --format={{.State.Status}}
	I0729 21:03:30.847950  345638 addons.go:69] Setting metrics-server=true in profile "old-k8s-version-884192"
	I0729 21:03:30.848083  345638 addons.go:234] Setting addon metrics-server=true in "old-k8s-version-884192"
	W0729 21:03:30.848106  345638 addons.go:243] addon metrics-server should already be in state true
	I0729 21:03:30.848136  345638 host.go:66] Checking if "old-k8s-version-884192" exists ...
	I0729 21:03:30.848548  345638 cli_runner.go:164] Run: docker container inspect old-k8s-version-884192 --format={{.State.Status}}
	I0729 21:03:30.851820  345638 out.go:177] * Verifying Kubernetes components...
	I0729 21:03:30.852193  345638 addons.go:69] Setting dashboard=true in profile "old-k8s-version-884192"
	I0729 21:03:30.852224  345638 addons.go:234] Setting addon dashboard=true in "old-k8s-version-884192"
	W0729 21:03:30.852231  345638 addons.go:243] addon dashboard should already be in state true
	I0729 21:03:30.852278  345638 host.go:66] Checking if "old-k8s-version-884192" exists ...
	I0729 21:03:30.852791  345638 cli_runner.go:164] Run: docker container inspect old-k8s-version-884192 --format={{.State.Status}}
	I0729 21:03:30.855223  345638 ssh_runner.go:195] Run: sudo systemctl daemon-reload
	I0729 21:03:30.942250  345638 out.go:177]   - Using image docker.io/kubernetesui/dashboard:v2.7.0
	I0729 21:03:30.942366  345638 out.go:177]   - Using image gcr.io/k8s-minikube/storage-provisioner:v5
	I0729 21:03:30.945639  345638 out.go:177]   - Using image registry.k8s.io/echoserver:1.4
	I0729 21:03:30.945856  345638 addons.go:431] installing /etc/kubernetes/addons/storage-provisioner.yaml
	I0729 21:03:30.945869  345638 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storage-provisioner.yaml (2676 bytes)
	I0729 21:03:30.945930  345638 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-884192
	I0729 21:03:30.952021  345638 addons.go:431] installing /etc/kubernetes/addons/dashboard-ns.yaml
	I0729 21:03:30.952048  345638 ssh_runner.go:362] scp dashboard/dashboard-ns.yaml --> /etc/kubernetes/addons/dashboard-ns.yaml (759 bytes)
	I0729 21:03:30.952123  345638 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-884192
	I0729 21:03:30.997982  345638 out.go:177]   - Using image fake.domain/registry.k8s.io/echoserver:1.4
	I0729 21:03:30.999709  345638 addons.go:431] installing /etc/kubernetes/addons/metrics-apiservice.yaml
	I0729 21:03:30.999729  345638 ssh_runner.go:362] scp metrics-server/metrics-apiservice.yaml --> /etc/kubernetes/addons/metrics-apiservice.yaml (424 bytes)
	I0729 21:03:30.999801  345638 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-884192
	I0729 21:03:31.022050  345638 addons.go:234] Setting addon default-storageclass=true in "old-k8s-version-884192"
	W0729 21:03:31.022073  345638 addons.go:243] addon default-storageclass should already be in state true
	I0729 21:03:31.022100  345638 host.go:66] Checking if "old-k8s-version-884192" exists ...
	I0729 21:03:31.022516  345638 cli_runner.go:164] Run: docker container inspect old-k8s-version-884192 --format={{.State.Status}}
	I0729 21:03:31.028190  345638 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:37330 SSHKeyPath:/home/jenkins/minikube-integration/19339-134334/.minikube/machines/old-k8s-version-884192/id_rsa Username:docker}
	I0729 21:03:31.049980  345638 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:37330 SSHKeyPath:/home/jenkins/minikube-integration/19339-134334/.minikube/machines/old-k8s-version-884192/id_rsa Username:docker}
	I0729 21:03:31.080259  345638 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:37330 SSHKeyPath:/home/jenkins/minikube-integration/19339-134334/.minikube/machines/old-k8s-version-884192/id_rsa Username:docker}
	I0729 21:03:31.104475  345638 ssh_runner.go:195] Run: sudo systemctl start kubelet
	I0729 21:03:31.114879  345638 addons.go:431] installing /etc/kubernetes/addons/storageclass.yaml
	I0729 21:03:31.114899  345638 ssh_runner.go:362] scp storageclass/storageclass.yaml --> /etc/kubernetes/addons/storageclass.yaml (271 bytes)
	I0729 21:03:31.114965  345638 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-884192
	I0729 21:03:31.162041  345638 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:37330 SSHKeyPath:/home/jenkins/minikube-integration/19339-134334/.minikube/machines/old-k8s-version-884192/id_rsa Username:docker}
	I0729 21:03:31.169667  345638 node_ready.go:35] waiting up to 6m0s for node "old-k8s-version-884192" to be "Ready" ...
	I0729 21:03:31.246963  345638 addons.go:431] installing /etc/kubernetes/addons/dashboard-clusterrole.yaml
	I0729 21:03:31.246990  345638 ssh_runner.go:362] scp dashboard/dashboard-clusterrole.yaml --> /etc/kubernetes/addons/dashboard-clusterrole.yaml (1001 bytes)
	I0729 21:03:31.275701  345638 addons.go:431] installing /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml
	I0729 21:03:31.275722  345638 ssh_runner.go:362] scp dashboard/dashboard-clusterrolebinding.yaml --> /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml (1018 bytes)
	I0729 21:03:31.397820  345638 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml
	I0729 21:03:31.447413  345638 addons.go:431] installing /etc/kubernetes/addons/dashboard-configmap.yaml
	I0729 21:03:31.447435  345638 ssh_runner.go:362] scp dashboard/dashboard-configmap.yaml --> /etc/kubernetes/addons/dashboard-configmap.yaml (837 bytes)
	I0729 21:03:31.462397  345638 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml
	I0729 21:03:31.479168  345638 addons.go:431] installing /etc/kubernetes/addons/metrics-server-deployment.yaml
	I0729 21:03:31.479192  345638 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-server-deployment.yaml (1825 bytes)
	I0729 21:03:31.497846  345638 addons.go:431] installing /etc/kubernetes/addons/dashboard-dp.yaml
	I0729 21:03:31.497866  345638 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-dp.yaml (4201 bytes)
	I0729 21:03:31.533274  345638 addons.go:431] installing /etc/kubernetes/addons/metrics-server-rbac.yaml
	I0729 21:03:31.533295  345638 ssh_runner.go:362] scp metrics-server/metrics-server-rbac.yaml --> /etc/kubernetes/addons/metrics-server-rbac.yaml (2175 bytes)
	I0729 21:03:31.549752  345638 addons.go:431] installing /etc/kubernetes/addons/dashboard-role.yaml
	I0729 21:03:31.549774  345638 ssh_runner.go:362] scp dashboard/dashboard-role.yaml --> /etc/kubernetes/addons/dashboard-role.yaml (1724 bytes)
	I0729 21:03:31.590932  345638 addons.go:431] installing /etc/kubernetes/addons/dashboard-rolebinding.yaml
	I0729 21:03:31.590953  345638 ssh_runner.go:362] scp dashboard/dashboard-rolebinding.yaml --> /etc/kubernetes/addons/dashboard-rolebinding.yaml (1046 bytes)
	I0729 21:03:31.604692  345638 addons.go:431] installing /etc/kubernetes/addons/metrics-server-service.yaml
	I0729 21:03:31.604713  345638 ssh_runner.go:362] scp metrics-server/metrics-server-service.yaml --> /etc/kubernetes/addons/metrics-server-service.yaml (446 bytes)
	I0729 21:03:31.630875  345638 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
	W0729 21:03:31.673996  345638 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
	stdout:
	
	stderr:
	The connection to the server localhost:8443 was refused - did you specify the right host or port?
	I0729 21:03:31.674025  345638 retry.go:31] will retry after 250.554539ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
	stdout:
	
	stderr:
	The connection to the server localhost:8443 was refused - did you specify the right host or port?
	I0729 21:03:31.677460  345638 addons.go:431] installing /etc/kubernetes/addons/dashboard-sa.yaml
	I0729 21:03:31.677484  345638 ssh_runner.go:362] scp dashboard/dashboard-sa.yaml --> /etc/kubernetes/addons/dashboard-sa.yaml (837 bytes)
	W0729 21:03:31.701950  345638 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
	stdout:
	
	stderr:
	The connection to the server localhost:8443 was refused - did you specify the right host or port?
	I0729 21:03:31.701990  345638 retry.go:31] will retry after 264.140914ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
	stdout:
	
	stderr:
	The connection to the server localhost:8443 was refused - did you specify the right host or port?
	I0729 21:03:31.719219  345638 addons.go:431] installing /etc/kubernetes/addons/dashboard-secret.yaml
	I0729 21:03:31.719269  345638 ssh_runner.go:362] scp dashboard/dashboard-secret.yaml --> /etc/kubernetes/addons/dashboard-secret.yaml (1389 bytes)
	I0729 21:03:31.739535  345638 addons.go:431] installing /etc/kubernetes/addons/dashboard-svc.yaml
	I0729 21:03:31.739650  345638 ssh_runner.go:362] scp dashboard/dashboard-svc.yaml --> /etc/kubernetes/addons/dashboard-svc.yaml (1294 bytes)
	W0729 21:03:31.754634  345638 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
	stdout:
	
	stderr:
	The connection to the server localhost:8443 was refused - did you specify the right host or port?
	I0729 21:03:31.754670  345638 retry.go:31] will retry after 153.997205ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
	stdout:
	
	stderr:
	The connection to the server localhost:8443 was refused - did you specify the right host or port?
	I0729 21:03:31.785759  345638 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
	W0729 21:03:31.872637  345638 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
	stdout:
	
	stderr:
	The connection to the server localhost:8443 was refused - did you specify the right host or port?
	I0729 21:03:31.872670  345638 retry.go:31] will retry after 233.150985ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
	stdout:
	
	stderr:
	The connection to the server localhost:8443 was refused - did you specify the right host or port?
	I0729 21:03:31.909903  345638 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
	I0729 21:03:31.925335  345638 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml
	I0729 21:03:31.966800  345638 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml
	W0729 21:03:32.028978  345638 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
	stdout:
	
	stderr:
	The connection to the server localhost:8443 was refused - did you specify the right host or port?
	I0729 21:03:32.029013  345638 retry.go:31] will retry after 230.493904ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
	stdout:
	
	stderr:
	The connection to the server localhost:8443 was refused - did you specify the right host or port?
	W0729 21:03:32.084999  345638 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
	stdout:
	
	stderr:
	The connection to the server localhost:8443 was refused - did you specify the right host or port?
	I0729 21:03:32.085065  345638 retry.go:31] will retry after 227.803399ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
	stdout:
	
	stderr:
	The connection to the server localhost:8443 was refused - did you specify the right host or port?
	I0729 21:03:32.106387  345638 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
	W0729 21:03:32.118372  345638 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
	stdout:
	
	stderr:
	The connection to the server localhost:8443 was refused - did you specify the right host or port?
	I0729 21:03:32.118401  345638 retry.go:31] will retry after 301.683166ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
	stdout:
	
	stderr:
	The connection to the server localhost:8443 was refused - did you specify the right host or port?
	W0729 21:03:32.191267  345638 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
	stdout:
	
	stderr:
	The connection to the server localhost:8443 was refused - did you specify the right host or port?
	I0729 21:03:32.191304  345638 retry.go:31] will retry after 402.689702ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
	stdout:
	
	stderr:
	The connection to the server localhost:8443 was refused - did you specify the right host or port?
	I0729 21:03:32.260583  345638 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
	I0729 21:03:32.313429  345638 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml
	W0729 21:03:32.375458  345638 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
	stdout:
	
	stderr:
	The connection to the server localhost:8443 was refused - did you specify the right host or port?
	I0729 21:03:32.375487  345638 retry.go:31] will retry after 738.309558ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
	stdout:
	
	stderr:
	The connection to the server localhost:8443 was refused - did you specify the right host or port?
	I0729 21:03:32.420828  345638 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml
	W0729 21:03:32.432783  345638 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
	stdout:
	
	stderr:
	The connection to the server localhost:8443 was refused - did you specify the right host or port?
	I0729 21:03:32.432818  345638 retry.go:31] will retry after 435.273118ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
	stdout:
	
	stderr:
	The connection to the server localhost:8443 was refused - did you specify the right host or port?
	W0729 21:03:32.509677  345638 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
	stdout:
	
	stderr:
	The connection to the server localhost:8443 was refused - did you specify the right host or port?
	I0729 21:03:32.509713  345638 retry.go:31] will retry after 746.516345ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
	stdout:
	
	stderr:
	The connection to the server localhost:8443 was refused - did you specify the right host or port?
	I0729 21:03:32.594989  345638 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
	W0729 21:03:32.664231  345638 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
	stdout:
	
	stderr:
	The connection to the server localhost:8443 was refused - did you specify the right host or port?
	I0729 21:03:32.664267  345638 retry.go:31] will retry after 498.801419ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
	stdout:
	
	stderr:
	The connection to the server localhost:8443 was refused - did you specify the right host or port?
	I0729 21:03:32.869235  345638 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml
	W0729 21:03:32.950561  345638 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
	stdout:
	
	stderr:
	The connection to the server localhost:8443 was refused - did you specify the right host or port?
	I0729 21:03:32.950595  345638 retry.go:31] will retry after 575.298372ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
	stdout:
	
	stderr:
	The connection to the server localhost:8443 was refused - did you specify the right host or port?
	I0729 21:03:33.114853  345638 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
	I0729 21:03:33.164231  345638 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
	I0729 21:03:33.170903  345638 node_ready.go:53] error getting node "old-k8s-version-884192": Get "https://192.168.76.2:8443/api/v1/nodes/old-k8s-version-884192": dial tcp 192.168.76.2:8443: connect: connection refused
	W0729 21:03:33.195013  345638 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
	stdout:
	
	stderr:
	The connection to the server localhost:8443 was refused - did you specify the right host or port?
	I0729 21:03:33.195050  345638 retry.go:31] will retry after 743.945511ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
	stdout:
	
	stderr:
	The connection to the server localhost:8443 was refused - did you specify the right host or port?
	W0729 21:03:33.242360  345638 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
	stdout:
	
	stderr:
	The connection to the server localhost:8443 was refused - did you specify the right host or port?
	I0729 21:03:33.242390  345638 retry.go:31] will retry after 910.875532ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
	stdout:
	
	stderr:
	The connection to the server localhost:8443 was refused - did you specify the right host or port?
	I0729 21:03:33.256495  345638 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml
	W0729 21:03:33.335635  345638 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
	stdout:
	
	stderr:
	The connection to the server localhost:8443 was refused - did you specify the right host or port?
	I0729 21:03:33.335665  345638 retry.go:31] will retry after 702.958987ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
	stdout:
	
	stderr:
	The connection to the server localhost:8443 was refused - did you specify the right host or port?
	I0729 21:03:33.526039  345638 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml
	W0729 21:03:33.600337  345638 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
	stdout:
	
	stderr:
	The connection to the server localhost:8443 was refused - did you specify the right host or port?
	I0729 21:03:33.600369  345638 retry.go:31] will retry after 1.381905113s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
	stdout:
	
	stderr:
	The connection to the server localhost:8443 was refused - did you specify the right host or port?
	I0729 21:03:33.939159  345638 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
	W0729 21:03:34.009995  345638 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
	stdout:
	
	stderr:
	The connection to the server localhost:8443 was refused - did you specify the right host or port?
	I0729 21:03:34.010034  345638 retry.go:31] will retry after 1.632900603s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
	stdout:
	
	stderr:
	The connection to the server localhost:8443 was refused - did you specify the right host or port?
	I0729 21:03:34.039169  345638 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml
	W0729 21:03:34.106822  345638 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
	stdout:
	
	stderr:
	The connection to the server localhost:8443 was refused - did you specify the right host or port?
	I0729 21:03:34.106857  345638 retry.go:31] will retry after 1.194657153s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
	stdout:
	
	stderr:
	The connection to the server localhost:8443 was refused - did you specify the right host or port?
	I0729 21:03:34.154087  345638 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
	W0729 21:03:34.226351  345638 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
	stdout:
	
	stderr:
	The connection to the server localhost:8443 was refused - did you specify the right host or port?
	I0729 21:03:34.226385  345638 retry.go:31] will retry after 1.096571677s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
	stdout:
	
	stderr:
	The connection to the server localhost:8443 was refused - did you specify the right host or port?
	I0729 21:03:34.982558  345638 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml
	W0729 21:03:35.100426  345638 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
	stdout:
	
	stderr:
	The connection to the server localhost:8443 was refused - did you specify the right host or port?
	I0729 21:03:35.100461  345638 retry.go:31] will retry after 2.598975505s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
	stdout:
	
	stderr:
	The connection to the server localhost:8443 was refused - did you specify the right host or port?
	I0729 21:03:35.170939  345638 node_ready.go:53] error getting node "old-k8s-version-884192": Get "https://192.168.76.2:8443/api/v1/nodes/old-k8s-version-884192": dial tcp 192.168.76.2:8443: connect: connection refused
	I0729 21:03:35.302278  345638 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml
	I0729 21:03:35.324016  345638 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
	W0729 21:03:35.517099  345638 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
	stdout:
	
	stderr:
	The connection to the server localhost:8443 was refused - did you specify the right host or port?
	I0729 21:03:35.517136  345638 retry.go:31] will retry after 1.296175248s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
	stdout:
	
	stderr:
	The connection to the server localhost:8443 was refused - did you specify the right host or port?
	W0729 21:03:35.561029  345638 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
	stdout:
	
	stderr:
	The connection to the server localhost:8443 was refused - did you specify the right host or port?
	I0729 21:03:35.561072  345638 retry.go:31] will retry after 2.023081772s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
	stdout:
	
	stderr:
	The connection to the server localhost:8443 was refused - did you specify the right host or port?
	I0729 21:03:35.643428  345638 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
	W0729 21:03:35.755701  345638 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
	stdout:
	
	stderr:
	The connection to the server localhost:8443 was refused - did you specify the right host or port?
	I0729 21:03:35.755738  345638 retry.go:31] will retry after 2.732956769s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
	stdout:
	
	stderr:
	The connection to the server localhost:8443 was refused - did you specify the right host or port?
	I0729 21:03:36.813506  345638 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml
	W0729 21:03:36.904546  345638 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
	stdout:
	
	stderr:
	The connection to the server localhost:8443 was refused - did you specify the right host or port?
	I0729 21:03:36.904575  345638 retry.go:31] will retry after 2.969655751s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
	stdout:
	
	stderr:
	The connection to the server localhost:8443 was refused - did you specify the right host or port?
	I0729 21:03:37.584838  345638 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
	I0729 21:03:37.670401  345638 node_ready.go:53] error getting node "old-k8s-version-884192": Get "https://192.168.76.2:8443/api/v1/nodes/old-k8s-version-884192": dial tcp 192.168.76.2:8443: connect: connection refused
	W0729 21:03:37.684143  345638 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
	stdout:
	
	stderr:
	The connection to the server localhost:8443 was refused - did you specify the right host or port?
	I0729 21:03:37.684175  345638 retry.go:31] will retry after 3.664151012s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
	stdout:
	
	stderr:
	The connection to the server localhost:8443 was refused - did you specify the right host or port?
	I0729 21:03:37.700341  345638 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml
	W0729 21:03:37.803519  345638 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
	stdout:
	
	stderr:
	The connection to the server localhost:8443 was refused - did you specify the right host or port?
	I0729 21:03:37.803552  345638 retry.go:31] will retry after 1.542224588s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
	stdout:
	
	stderr:
	The connection to the server localhost:8443 was refused - did you specify the right host or port?
	I0729 21:03:38.489086  345638 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
	W0729 21:03:38.591600  345638 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
	stdout:
	
	stderr:
	The connection to the server localhost:8443 was refused - did you specify the right host or port?
	I0729 21:03:38.591628  345638 retry.go:31] will retry after 3.025200104s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
	stdout:
	
	stderr:
	The connection to the server localhost:8443 was refused - did you specify the right host or port?
	I0729 21:03:39.346476  345638 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml
	W0729 21:03:39.515732  345638 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
	stdout:
	
	stderr:
	The connection to the server localhost:8443 was refused - did you specify the right host or port?
	I0729 21:03:39.515761  345638 retry.go:31] will retry after 4.399451934s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
	stdout:
	
	stderr:
	The connection to the server localhost:8443 was refused - did you specify the right host or port?
	I0729 21:03:39.874840  345638 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml
	I0729 21:03:40.170675  345638 node_ready.go:53] error getting node "old-k8s-version-884192": Get "https://192.168.76.2:8443/api/v1/nodes/old-k8s-version-884192": dial tcp 192.168.76.2:8443: connect: connection refused
	W0729 21:03:40.434593  345638 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
	stdout:
	
	stderr:
	The connection to the server localhost:8443 was refused - did you specify the right host or port?
	I0729 21:03:40.434631  345638 retry.go:31] will retry after 3.006086798s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
	stdout:
	
	stderr:
	The connection to the server localhost:8443 was refused - did you specify the right host or port?
	I0729 21:03:41.348541  345638 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
	I0729 21:03:41.616992  345638 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
	I0729 21:03:43.441531  345638 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml
	I0729 21:03:43.916241  345638 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml
	I0729 21:03:50.636373  345638 node_ready.go:49] node "old-k8s-version-884192" has status "Ready":"True"
	I0729 21:03:50.636395  345638 node_ready.go:38] duration metric: took 19.466700349s for node "old-k8s-version-884192" to be "Ready" ...
	I0729 21:03:50.636405  345638 pod_ready.go:35] extra waiting up to 6m0s for all system-critical pods including labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
	I0729 21:03:50.977211  345638 pod_ready.go:78] waiting up to 6m0s for pod "coredns-74ff55c5b-xgldr" in "kube-system" namespace to be "Ready" ...
	I0729 21:03:51.346538  345638 pod_ready.go:92] pod "coredns-74ff55c5b-xgldr" in "kube-system" namespace has status "Ready":"True"
	I0729 21:03:51.346617  345638 pod_ready.go:81] duration metric: took 369.332263ms for pod "coredns-74ff55c5b-xgldr" in "kube-system" namespace to be "Ready" ...
	I0729 21:03:51.346655  345638 pod_ready.go:78] waiting up to 6m0s for pod "etcd-old-k8s-version-884192" in "kube-system" namespace to be "Ready" ...
	I0729 21:03:51.448893  345638 pod_ready.go:92] pod "etcd-old-k8s-version-884192" in "kube-system" namespace has status "Ready":"True"
	I0729 21:03:51.448976  345638 pod_ready.go:81] duration metric: took 102.27928ms for pod "etcd-old-k8s-version-884192" in "kube-system" namespace to be "Ready" ...
	I0729 21:03:51.449008  345638 pod_ready.go:78] waiting up to 6m0s for pod "kube-apiserver-old-k8s-version-884192" in "kube-system" namespace to be "Ready" ...
	I0729 21:03:53.482058  345638 pod_ready.go:102] pod "kube-apiserver-old-k8s-version-884192" in "kube-system" namespace has status "Ready":"False"
	I0729 21:03:53.967628  345638 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: (12.619022108s)
	I0729 21:03:53.967906  345638 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: (12.350867587s)
	I0729 21:03:53.968028  345638 addons.go:475] Verifying addon metrics-server=true in "old-k8s-version-884192"
	I0729 21:03:53.970199  345638 out.go:177] * Some dashboard features require the metrics-server addon. To enable all features please run:
	
		minikube -p old-k8s-version-884192 addons enable metrics-server
	
	I0729 21:03:54.129111  345638 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: (10.687536424s)
	I0729 21:03:54.129537  345638 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: (10.213217625s)
	I0729 21:03:54.139694  345638 out.go:177] * Enabled addons: metrics-server, dashboard, storage-provisioner, default-storageclass
	I0729 21:03:54.141406  345638 addons.go:510] duration metric: took 23.294968869s for enable addons: enabled=[metrics-server dashboard storage-provisioner default-storageclass]
	I0729 21:03:55.958103  345638 pod_ready.go:102] pod "kube-apiserver-old-k8s-version-884192" in "kube-system" namespace has status "Ready":"False"
	I0729 21:03:58.455442  345638 pod_ready.go:102] pod "kube-apiserver-old-k8s-version-884192" in "kube-system" namespace has status "Ready":"False"
	I0729 21:03:59.956024  345638 pod_ready.go:92] pod "kube-apiserver-old-k8s-version-884192" in "kube-system" namespace has status "Ready":"True"
	I0729 21:03:59.956045  345638 pod_ready.go:81] duration metric: took 8.507000418s for pod "kube-apiserver-old-k8s-version-884192" in "kube-system" namespace to be "Ready" ...
	I0729 21:03:59.956057  345638 pod_ready.go:78] waiting up to 6m0s for pod "kube-controller-manager-old-k8s-version-884192" in "kube-system" namespace to be "Ready" ...
	I0729 21:04:01.969175  345638 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-884192" in "kube-system" namespace has status "Ready":"False"
	I0729 21:04:04.463328  345638 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-884192" in "kube-system" namespace has status "Ready":"False"
	I0729 21:04:06.962572  345638 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-884192" in "kube-system" namespace has status "Ready":"False"
	I0729 21:04:09.465896  345638 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-884192" in "kube-system" namespace has status "Ready":"False"
	I0729 21:04:11.965266  345638 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-884192" in "kube-system" namespace has status "Ready":"False"
	I0729 21:04:14.462704  345638 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-884192" in "kube-system" namespace has status "Ready":"False"
	I0729 21:04:16.965387  345638 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-884192" in "kube-system" namespace has status "Ready":"False"
	I0729 21:04:19.472536  345638 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-884192" in "kube-system" namespace has status "Ready":"False"
	I0729 21:04:21.964194  345638 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-884192" in "kube-system" namespace has status "Ready":"False"
	I0729 21:04:24.462919  345638 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-884192" in "kube-system" namespace has status "Ready":"False"
	I0729 21:04:26.463199  345638 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-884192" in "kube-system" namespace has status "Ready":"False"
	I0729 21:04:28.962726  345638 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-884192" in "kube-system" namespace has status "Ready":"False"
	I0729 21:04:30.964821  345638 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-884192" in "kube-system" namespace has status "Ready":"False"
	I0729 21:04:33.462725  345638 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-884192" in "kube-system" namespace has status "Ready":"False"
	I0729 21:04:35.963228  345638 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-884192" in "kube-system" namespace has status "Ready":"False"
	I0729 21:04:38.462323  345638 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-884192" in "kube-system" namespace has status "Ready":"False"
	I0729 21:04:40.462517  345638 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-884192" in "kube-system" namespace has status "Ready":"False"
	I0729 21:04:42.463144  345638 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-884192" in "kube-system" namespace has status "Ready":"False"
	I0729 21:04:44.467912  345638 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-884192" in "kube-system" namespace has status "Ready":"False"
	I0729 21:04:46.964273  345638 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-884192" in "kube-system" namespace has status "Ready":"False"
	I0729 21:04:49.463008  345638 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-884192" in "kube-system" namespace has status "Ready":"False"
	I0729 21:04:51.965282  345638 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-884192" in "kube-system" namespace has status "Ready":"False"
	I0729 21:04:54.463407  345638 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-884192" in "kube-system" namespace has status "Ready":"False"
	I0729 21:04:56.463717  345638 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-884192" in "kube-system" namespace has status "Ready":"False"
	I0729 21:04:58.963933  345638 pod_ready.go:92] pod "kube-controller-manager-old-k8s-version-884192" in "kube-system" namespace has status "Ready":"True"
	I0729 21:04:58.964012  345638 pod_ready.go:81] duration metric: took 59.007946493s for pod "kube-controller-manager-old-k8s-version-884192" in "kube-system" namespace to be "Ready" ...
	I0729 21:04:58.964043  345638 pod_ready.go:78] waiting up to 6m0s for pod "kube-proxy-kp9qr" in "kube-system" namespace to be "Ready" ...
	I0729 21:04:58.972625  345638 pod_ready.go:92] pod "kube-proxy-kp9qr" in "kube-system" namespace has status "Ready":"True"
	I0729 21:04:58.972694  345638 pod_ready.go:81] duration metric: took 8.605332ms for pod "kube-proxy-kp9qr" in "kube-system" namespace to be "Ready" ...
	I0729 21:04:58.972720  345638 pod_ready.go:78] waiting up to 6m0s for pod "kube-scheduler-old-k8s-version-884192" in "kube-system" namespace to be "Ready" ...
	I0729 21:05:01.037567  345638 pod_ready.go:102] pod "kube-scheduler-old-k8s-version-884192" in "kube-system" namespace has status "Ready":"False"
	I0729 21:05:03.479127  345638 pod_ready.go:102] pod "kube-scheduler-old-k8s-version-884192" in "kube-system" namespace has status "Ready":"False"
	I0729 21:05:05.480215  345638 pod_ready.go:102] pod "kube-scheduler-old-k8s-version-884192" in "kube-system" namespace has status "Ready":"False"
	I0729 21:05:07.981072  345638 pod_ready.go:102] pod "kube-scheduler-old-k8s-version-884192" in "kube-system" namespace has status "Ready":"False"
	I0729 21:05:08.980636  345638 pod_ready.go:92] pod "kube-scheduler-old-k8s-version-884192" in "kube-system" namespace has status "Ready":"True"
	I0729 21:05:08.980660  345638 pod_ready.go:81] duration metric: took 10.007919393s for pod "kube-scheduler-old-k8s-version-884192" in "kube-system" namespace to be "Ready" ...
	I0729 21:05:08.980671  345638 pod_ready.go:78] waiting up to 6m0s for pod "metrics-server-9975d5f86-b5bqk" in "kube-system" namespace to be "Ready" ...
	I0729 21:05:10.993208  345638 pod_ready.go:102] pod "metrics-server-9975d5f86-b5bqk" in "kube-system" namespace has status "Ready":"False"
	I0729 21:05:13.486926  345638 pod_ready.go:102] pod "metrics-server-9975d5f86-b5bqk" in "kube-system" namespace has status "Ready":"False"
	I0729 21:05:15.489131  345638 pod_ready.go:102] pod "metrics-server-9975d5f86-b5bqk" in "kube-system" namespace has status "Ready":"False"
	I0729 21:05:17.987414  345638 pod_ready.go:102] pod "metrics-server-9975d5f86-b5bqk" in "kube-system" namespace has status "Ready":"False"
	I0729 21:05:19.987822  345638 pod_ready.go:102] pod "metrics-server-9975d5f86-b5bqk" in "kube-system" namespace has status "Ready":"False"
	I0729 21:05:22.487809  345638 pod_ready.go:102] pod "metrics-server-9975d5f86-b5bqk" in "kube-system" namespace has status "Ready":"False"
	I0729 21:05:24.986191  345638 pod_ready.go:102] pod "metrics-server-9975d5f86-b5bqk" in "kube-system" namespace has status "Ready":"False"
	I0729 21:05:26.986458  345638 pod_ready.go:102] pod "metrics-server-9975d5f86-b5bqk" in "kube-system" namespace has status "Ready":"False"
	I0729 21:05:28.986517  345638 pod_ready.go:102] pod "metrics-server-9975d5f86-b5bqk" in "kube-system" namespace has status "Ready":"False"
	I0729 21:05:30.987049  345638 pod_ready.go:102] pod "metrics-server-9975d5f86-b5bqk" in "kube-system" namespace has status "Ready":"False"
	I0729 21:05:32.989141  345638 pod_ready.go:102] pod "metrics-server-9975d5f86-b5bqk" in "kube-system" namespace has status "Ready":"False"
	I0729 21:05:35.487681  345638 pod_ready.go:102] pod "metrics-server-9975d5f86-b5bqk" in "kube-system" namespace has status "Ready":"False"
	I0729 21:05:37.987720  345638 pod_ready.go:102] pod "metrics-server-9975d5f86-b5bqk" in "kube-system" namespace has status "Ready":"False"
	I0729 21:05:39.988055  345638 pod_ready.go:102] pod "metrics-server-9975d5f86-b5bqk" in "kube-system" namespace has status "Ready":"False"
	I0729 21:05:42.486720  345638 pod_ready.go:102] pod "metrics-server-9975d5f86-b5bqk" in "kube-system" namespace has status "Ready":"False"
	I0729 21:05:44.486910  345638 pod_ready.go:102] pod "metrics-server-9975d5f86-b5bqk" in "kube-system" namespace has status "Ready":"False"
	I0729 21:05:46.487301  345638 pod_ready.go:102] pod "metrics-server-9975d5f86-b5bqk" in "kube-system" namespace has status "Ready":"False"
	I0729 21:05:48.487414  345638 pod_ready.go:102] pod "metrics-server-9975d5f86-b5bqk" in "kube-system" namespace has status "Ready":"False"
	I0729 21:05:50.987258  345638 pod_ready.go:102] pod "metrics-server-9975d5f86-b5bqk" in "kube-system" namespace has status "Ready":"False"
	I0729 21:05:53.486833  345638 pod_ready.go:102] pod "metrics-server-9975d5f86-b5bqk" in "kube-system" namespace has status "Ready":"False"
	I0729 21:05:55.487327  345638 pod_ready.go:102] pod "metrics-server-9975d5f86-b5bqk" in "kube-system" namespace has status "Ready":"False"
	I0729 21:05:57.987447  345638 pod_ready.go:102] pod "metrics-server-9975d5f86-b5bqk" in "kube-system" namespace has status "Ready":"False"
	I0729 21:05:59.987539  345638 pod_ready.go:102] pod "metrics-server-9975d5f86-b5bqk" in "kube-system" namespace has status "Ready":"False"
	I0729 21:06:02.488423  345638 pod_ready.go:102] pod "metrics-server-9975d5f86-b5bqk" in "kube-system" namespace has status "Ready":"False"
	I0729 21:06:04.986962  345638 pod_ready.go:102] pod "metrics-server-9975d5f86-b5bqk" in "kube-system" namespace has status "Ready":"False"
	I0729 21:06:06.992141  345638 pod_ready.go:102] pod "metrics-server-9975d5f86-b5bqk" in "kube-system" namespace has status "Ready":"False"
	I0729 21:06:09.487371  345638 pod_ready.go:102] pod "metrics-server-9975d5f86-b5bqk" in "kube-system" namespace has status "Ready":"False"
	I0729 21:06:11.565244  345638 pod_ready.go:102] pod "metrics-server-9975d5f86-b5bqk" in "kube-system" namespace has status "Ready":"False"
	I0729 21:06:13.986480  345638 pod_ready.go:102] pod "metrics-server-9975d5f86-b5bqk" in "kube-system" namespace has status "Ready":"False"
	I0729 21:06:15.987614  345638 pod_ready.go:102] pod "metrics-server-9975d5f86-b5bqk" in "kube-system" namespace has status "Ready":"False"
	I0729 21:06:18.486742  345638 pod_ready.go:102] pod "metrics-server-9975d5f86-b5bqk" in "kube-system" namespace has status "Ready":"False"
	I0729 21:06:20.486982  345638 pod_ready.go:102] pod "metrics-server-9975d5f86-b5bqk" in "kube-system" namespace has status "Ready":"False"
	I0729 21:06:22.487281  345638 pod_ready.go:102] pod "metrics-server-9975d5f86-b5bqk" in "kube-system" namespace has status "Ready":"False"
	I0729 21:06:24.986973  345638 pod_ready.go:102] pod "metrics-server-9975d5f86-b5bqk" in "kube-system" namespace has status "Ready":"False"
	I0729 21:06:26.987793  345638 pod_ready.go:102] pod "metrics-server-9975d5f86-b5bqk" in "kube-system" namespace has status "Ready":"False"
	I0729 21:06:29.487159  345638 pod_ready.go:102] pod "metrics-server-9975d5f86-b5bqk" in "kube-system" namespace has status "Ready":"False"
	I0729 21:06:31.489533  345638 pod_ready.go:102] pod "metrics-server-9975d5f86-b5bqk" in "kube-system" namespace has status "Ready":"False"
	I0729 21:06:33.987555  345638 pod_ready.go:102] pod "metrics-server-9975d5f86-b5bqk" in "kube-system" namespace has status "Ready":"False"
	I0729 21:06:36.487595  345638 pod_ready.go:102] pod "metrics-server-9975d5f86-b5bqk" in "kube-system" namespace has status "Ready":"False"
	I0729 21:06:38.987322  345638 pod_ready.go:102] pod "metrics-server-9975d5f86-b5bqk" in "kube-system" namespace has status "Ready":"False"
	I0729 21:06:41.487693  345638 pod_ready.go:102] pod "metrics-server-9975d5f86-b5bqk" in "kube-system" namespace has status "Ready":"False"
	I0729 21:06:43.986420  345638 pod_ready.go:102] pod "metrics-server-9975d5f86-b5bqk" in "kube-system" namespace has status "Ready":"False"
	I0729 21:06:45.987022  345638 pod_ready.go:102] pod "metrics-server-9975d5f86-b5bqk" in "kube-system" namespace has status "Ready":"False"
	I0729 21:06:47.987564  345638 pod_ready.go:102] pod "metrics-server-9975d5f86-b5bqk" in "kube-system" namespace has status "Ready":"False"
	I0729 21:06:50.486865  345638 pod_ready.go:102] pod "metrics-server-9975d5f86-b5bqk" in "kube-system" namespace has status "Ready":"False"
	I0729 21:06:52.496187  345638 pod_ready.go:102] pod "metrics-server-9975d5f86-b5bqk" in "kube-system" namespace has status "Ready":"False"
	I0729 21:06:54.986549  345638 pod_ready.go:102] pod "metrics-server-9975d5f86-b5bqk" in "kube-system" namespace has status "Ready":"False"
	I0729 21:06:56.987871  345638 pod_ready.go:102] pod "metrics-server-9975d5f86-b5bqk" in "kube-system" namespace has status "Ready":"False"
	I0729 21:06:59.488004  345638 pod_ready.go:102] pod "metrics-server-9975d5f86-b5bqk" in "kube-system" namespace has status "Ready":"False"
	I0729 21:07:01.488512  345638 pod_ready.go:102] pod "metrics-server-9975d5f86-b5bqk" in "kube-system" namespace has status "Ready":"False"
	I0729 21:07:03.986589  345638 pod_ready.go:102] pod "metrics-server-9975d5f86-b5bqk" in "kube-system" namespace has status "Ready":"False"
	I0729 21:07:06.486669  345638 pod_ready.go:102] pod "metrics-server-9975d5f86-b5bqk" in "kube-system" namespace has status "Ready":"False"
	I0729 21:07:08.487822  345638 pod_ready.go:102] pod "metrics-server-9975d5f86-b5bqk" in "kube-system" namespace has status "Ready":"False"
	I0729 21:07:10.986868  345638 pod_ready.go:102] pod "metrics-server-9975d5f86-b5bqk" in "kube-system" namespace has status "Ready":"False"
	I0729 21:07:13.487697  345638 pod_ready.go:102] pod "metrics-server-9975d5f86-b5bqk" in "kube-system" namespace has status "Ready":"False"
	I0729 21:07:15.986964  345638 pod_ready.go:102] pod "metrics-server-9975d5f86-b5bqk" in "kube-system" namespace has status "Ready":"False"
	I0729 21:07:17.987320  345638 pod_ready.go:102] pod "metrics-server-9975d5f86-b5bqk" in "kube-system" namespace has status "Ready":"False"
	I0729 21:07:20.486730  345638 pod_ready.go:102] pod "metrics-server-9975d5f86-b5bqk" in "kube-system" namespace has status "Ready":"False"
	I0729 21:07:22.987674  345638 pod_ready.go:102] pod "metrics-server-9975d5f86-b5bqk" in "kube-system" namespace has status "Ready":"False"
	I0729 21:07:25.486629  345638 pod_ready.go:102] pod "metrics-server-9975d5f86-b5bqk" in "kube-system" namespace has status "Ready":"False"
	I0729 21:07:27.487393  345638 pod_ready.go:102] pod "metrics-server-9975d5f86-b5bqk" in "kube-system" namespace has status "Ready":"False"
	I0729 21:07:29.488006  345638 pod_ready.go:102] pod "metrics-server-9975d5f86-b5bqk" in "kube-system" namespace has status "Ready":"False"
	I0729 21:07:31.489052  345638 pod_ready.go:102] pod "metrics-server-9975d5f86-b5bqk" in "kube-system" namespace has status "Ready":"False"
	I0729 21:07:33.987190  345638 pod_ready.go:102] pod "metrics-server-9975d5f86-b5bqk" in "kube-system" namespace has status "Ready":"False"
	I0729 21:07:36.488805  345638 pod_ready.go:102] pod "metrics-server-9975d5f86-b5bqk" in "kube-system" namespace has status "Ready":"False"
	I0729 21:07:38.986671  345638 pod_ready.go:102] pod "metrics-server-9975d5f86-b5bqk" in "kube-system" namespace has status "Ready":"False"
	I0729 21:07:40.986807  345638 pod_ready.go:102] pod "metrics-server-9975d5f86-b5bqk" in "kube-system" namespace has status "Ready":"False"
	I0729 21:07:42.988306  345638 pod_ready.go:102] pod "metrics-server-9975d5f86-b5bqk" in "kube-system" namespace has status "Ready":"False"
	I0729 21:07:45.487648  345638 pod_ready.go:102] pod "metrics-server-9975d5f86-b5bqk" in "kube-system" namespace has status "Ready":"False"
	I0729 21:07:47.987467  345638 pod_ready.go:102] pod "metrics-server-9975d5f86-b5bqk" in "kube-system" namespace has status "Ready":"False"
	I0729 21:07:50.487785  345638 pod_ready.go:102] pod "metrics-server-9975d5f86-b5bqk" in "kube-system" namespace has status "Ready":"False"
	I0729 21:07:52.987777  345638 pod_ready.go:102] pod "metrics-server-9975d5f86-b5bqk" in "kube-system" namespace has status "Ready":"False"
	I0729 21:07:55.487286  345638 pod_ready.go:102] pod "metrics-server-9975d5f86-b5bqk" in "kube-system" namespace has status "Ready":"False"
	I0729 21:07:57.987035  345638 pod_ready.go:102] pod "metrics-server-9975d5f86-b5bqk" in "kube-system" namespace has status "Ready":"False"
	I0729 21:08:00.487490  345638 pod_ready.go:102] pod "metrics-server-9975d5f86-b5bqk" in "kube-system" namespace has status "Ready":"False"
	I0729 21:08:02.552175  345638 pod_ready.go:102] pod "metrics-server-9975d5f86-b5bqk" in "kube-system" namespace has status "Ready":"False"
	I0729 21:08:04.987355  345638 pod_ready.go:102] pod "metrics-server-9975d5f86-b5bqk" in "kube-system" namespace has status "Ready":"False"
	I0729 21:08:07.486675  345638 pod_ready.go:102] pod "metrics-server-9975d5f86-b5bqk" in "kube-system" namespace has status "Ready":"False"
	I0729 21:08:09.486780  345638 pod_ready.go:102] pod "metrics-server-9975d5f86-b5bqk" in "kube-system" namespace has status "Ready":"False"
	I0729 21:08:11.487710  345638 pod_ready.go:102] pod "metrics-server-9975d5f86-b5bqk" in "kube-system" namespace has status "Ready":"False"
	I0729 21:08:13.986392  345638 pod_ready.go:102] pod "metrics-server-9975d5f86-b5bqk" in "kube-system" namespace has status "Ready":"False"
	I0729 21:08:15.987688  345638 pod_ready.go:102] pod "metrics-server-9975d5f86-b5bqk" in "kube-system" namespace has status "Ready":"False"
	I0729 21:08:18.489134  345638 pod_ready.go:102] pod "metrics-server-9975d5f86-b5bqk" in "kube-system" namespace has status "Ready":"False"
	I0729 21:08:20.987362  345638 pod_ready.go:102] pod "metrics-server-9975d5f86-b5bqk" in "kube-system" namespace has status "Ready":"False"
	I0729 21:08:22.988905  345638 pod_ready.go:102] pod "metrics-server-9975d5f86-b5bqk" in "kube-system" namespace has status "Ready":"False"
	I0729 21:08:25.487424  345638 pod_ready.go:102] pod "metrics-server-9975d5f86-b5bqk" in "kube-system" namespace has status "Ready":"False"
	I0729 21:08:27.987294  345638 pod_ready.go:102] pod "metrics-server-9975d5f86-b5bqk" in "kube-system" namespace has status "Ready":"False"
	I0729 21:08:30.486586  345638 pod_ready.go:102] pod "metrics-server-9975d5f86-b5bqk" in "kube-system" namespace has status "Ready":"False"
	I0729 21:08:32.487441  345638 pod_ready.go:102] pod "metrics-server-9975d5f86-b5bqk" in "kube-system" namespace has status "Ready":"False"
	I0729 21:08:34.986635  345638 pod_ready.go:102] pod "metrics-server-9975d5f86-b5bqk" in "kube-system" namespace has status "Ready":"False"
	I0729 21:08:37.487040  345638 pod_ready.go:102] pod "metrics-server-9975d5f86-b5bqk" in "kube-system" namespace has status "Ready":"False"
	I0729 21:08:39.489188  345638 pod_ready.go:102] pod "metrics-server-9975d5f86-b5bqk" in "kube-system" namespace has status "Ready":"False"
	I0729 21:08:41.986785  345638 pod_ready.go:102] pod "metrics-server-9975d5f86-b5bqk" in "kube-system" namespace has status "Ready":"False"
	I0729 21:08:44.487817  345638 pod_ready.go:102] pod "metrics-server-9975d5f86-b5bqk" in "kube-system" namespace has status "Ready":"False"
	I0729 21:08:46.988823  345638 pod_ready.go:102] pod "metrics-server-9975d5f86-b5bqk" in "kube-system" namespace has status "Ready":"False"
	I0729 21:08:49.487450  345638 pod_ready.go:102] pod "metrics-server-9975d5f86-b5bqk" in "kube-system" namespace has status "Ready":"False"
	I0729 21:08:51.987547  345638 pod_ready.go:102] pod "metrics-server-9975d5f86-b5bqk" in "kube-system" namespace has status "Ready":"False"
	I0729 21:08:54.487221  345638 pod_ready.go:102] pod "metrics-server-9975d5f86-b5bqk" in "kube-system" namespace has status "Ready":"False"
	I0729 21:08:56.986550  345638 pod_ready.go:102] pod "metrics-server-9975d5f86-b5bqk" in "kube-system" namespace has status "Ready":"False"
	I0729 21:08:59.487162  345638 pod_ready.go:102] pod "metrics-server-9975d5f86-b5bqk" in "kube-system" namespace has status "Ready":"False"
	I0729 21:09:01.489077  345638 pod_ready.go:102] pod "metrics-server-9975d5f86-b5bqk" in "kube-system" namespace has status "Ready":"False"
	I0729 21:09:03.994872  345638 pod_ready.go:102] pod "metrics-server-9975d5f86-b5bqk" in "kube-system" namespace has status "Ready":"False"
	I0729 21:09:06.487436  345638 pod_ready.go:102] pod "metrics-server-9975d5f86-b5bqk" in "kube-system" namespace has status "Ready":"False"
	I0729 21:09:08.488330  345638 pod_ready.go:102] pod "metrics-server-9975d5f86-b5bqk" in "kube-system" namespace has status "Ready":"False"
	I0729 21:09:08.985800  345638 pod_ready.go:81] duration metric: took 4m0.005110529s for pod "metrics-server-9975d5f86-b5bqk" in "kube-system" namespace to be "Ready" ...
	E0729 21:09:08.985835  345638 pod_ready.go:66] WaitExtra: waitPodCondition: context deadline exceeded
	I0729 21:09:08.985865  345638 pod_ready.go:38] duration metric: took 5m18.349449491s for extra waiting for all system-critical and pods with labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
	I0729 21:09:08.985878  345638 api_server.go:52] waiting for apiserver process to appear ...
	I0729 21:09:08.985914  345638 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-apiserver Namespaces:[]}
	I0729 21:09:08.985983  345638 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
	I0729 21:09:09.046130  345638 cri.go:89] found id: "2b5706f43ae84ffb4c99184b43a6db1890019aa8c76fdb92fdf6129a64fe28fb"
	I0729 21:09:09.046150  345638 cri.go:89] found id: "75e8e58f6b60c620418997e5255b74f9697a29827f81dff4f9dbf920bab06deb"
	I0729 21:09:09.046155  345638 cri.go:89] found id: ""
	I0729 21:09:09.046162  345638 logs.go:276] 2 containers: [2b5706f43ae84ffb4c99184b43a6db1890019aa8c76fdb92fdf6129a64fe28fb 75e8e58f6b60c620418997e5255b74f9697a29827f81dff4f9dbf920bab06deb]
	I0729 21:09:09.046222  345638 ssh_runner.go:195] Run: which crictl
	I0729 21:09:09.050769  345638 ssh_runner.go:195] Run: which crictl
	I0729 21:09:09.054672  345638 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:etcd Namespaces:[]}
	I0729 21:09:09.054743  345638 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
	I0729 21:09:09.129475  345638 cri.go:89] found id: "fdfc2fda8f65bf329c9d58d897a8694516fa614a5e93c26ef5cb777ca3bec6f9"
	I0729 21:09:09.129499  345638 cri.go:89] found id: "bc0116b218f41883478ef8c3d93fb1116431f7848779b1dccd7871ccda0dc49f"
	I0729 21:09:09.129505  345638 cri.go:89] found id: ""
	I0729 21:09:09.129512  345638 logs.go:276] 2 containers: [fdfc2fda8f65bf329c9d58d897a8694516fa614a5e93c26ef5cb777ca3bec6f9 bc0116b218f41883478ef8c3d93fb1116431f7848779b1dccd7871ccda0dc49f]
	I0729 21:09:09.129570  345638 ssh_runner.go:195] Run: which crictl
	I0729 21:09:09.133800  345638 ssh_runner.go:195] Run: which crictl
	I0729 21:09:09.137893  345638 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:coredns Namespaces:[]}
	I0729 21:09:09.137961  345638 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
	I0729 21:09:09.208863  345638 cri.go:89] found id: "4c9c5c5f06999ffd13d4298995cd93d9de27eda2f392872dbd2c9cbef44d6bd9"
	I0729 21:09:09.208888  345638 cri.go:89] found id: "a11607490336d465d0dc075fbb00de0bc707a72aed0c22c0881dcd60db427adf"
	I0729 21:09:09.208893  345638 cri.go:89] found id: ""
	I0729 21:09:09.208901  345638 logs.go:276] 2 containers: [4c9c5c5f06999ffd13d4298995cd93d9de27eda2f392872dbd2c9cbef44d6bd9 a11607490336d465d0dc075fbb00de0bc707a72aed0c22c0881dcd60db427adf]
	I0729 21:09:09.208964  345638 ssh_runner.go:195] Run: which crictl
	I0729 21:09:09.212886  345638 ssh_runner.go:195] Run: which crictl
	I0729 21:09:09.216444  345638 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-scheduler Namespaces:[]}
	I0729 21:09:09.216532  345638 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
	I0729 21:09:09.272565  345638 cri.go:89] found id: "9abfa4fc0bdf34111d54edc320059e70f6aee2b65f28100e1019cce30562b30a"
	I0729 21:09:09.272590  345638 cri.go:89] found id: "efa095c66551bd38c9deb191b3739441869b00874c7d3365c559609dcbd601c1"
	I0729 21:09:09.272596  345638 cri.go:89] found id: ""
	I0729 21:09:09.272604  345638 logs.go:276] 2 containers: [9abfa4fc0bdf34111d54edc320059e70f6aee2b65f28100e1019cce30562b30a efa095c66551bd38c9deb191b3739441869b00874c7d3365c559609dcbd601c1]
	I0729 21:09:09.272666  345638 ssh_runner.go:195] Run: which crictl
	I0729 21:09:09.276825  345638 ssh_runner.go:195] Run: which crictl
	I0729 21:09:09.280686  345638 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-proxy Namespaces:[]}
	I0729 21:09:09.280770  345638 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
	I0729 21:09:09.329576  345638 cri.go:89] found id: "75750dba9bde8fdbcbdd8ebef671cf28647195630a985ee55cf6cd358325a7b2"
	I0729 21:09:09.329635  345638 cri.go:89] found id: "cc4846179f2a5f6f93c7bdb1f437618106e1a00f39b10534afcbbee12f518c4e"
	I0729 21:09:09.329656  345638 cri.go:89] found id: ""
	I0729 21:09:09.329678  345638 logs.go:276] 2 containers: [75750dba9bde8fdbcbdd8ebef671cf28647195630a985ee55cf6cd358325a7b2 cc4846179f2a5f6f93c7bdb1f437618106e1a00f39b10534afcbbee12f518c4e]
	I0729 21:09:09.329763  345638 ssh_runner.go:195] Run: which crictl
	I0729 21:09:09.336826  345638 ssh_runner.go:195] Run: which crictl
	I0729 21:09:09.341076  345638 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-controller-manager Namespaces:[]}
	I0729 21:09:09.341146  345638 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
	I0729 21:09:09.402393  345638 cri.go:89] found id: "7e3ce8149fba57740e3a1eea6ee7778346b641b6e57850a9cad477449b277d98"
	I0729 21:09:09.402417  345638 cri.go:89] found id: "6c3b9526f1351901cc60d713178c281355d6b3994267e1a6de1bf5f38054b4aa"
	I0729 21:09:09.402423  345638 cri.go:89] found id: ""
	I0729 21:09:09.402430  345638 logs.go:276] 2 containers: [7e3ce8149fba57740e3a1eea6ee7778346b641b6e57850a9cad477449b277d98 6c3b9526f1351901cc60d713178c281355d6b3994267e1a6de1bf5f38054b4aa]
	I0729 21:09:09.402488  345638 ssh_runner.go:195] Run: which crictl
	I0729 21:09:09.407595  345638 ssh_runner.go:195] Run: which crictl
	I0729 21:09:09.411190  345638 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kindnet Namespaces:[]}
	I0729 21:09:09.411256  345638 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet
	I0729 21:09:09.469431  345638 cri.go:89] found id: "2e5ae293c129dbb0affcb0f06ae8ebaf6c3ed66d3cb9d4d26ff0dfdef3a13354"
	I0729 21:09:09.469461  345638 cri.go:89] found id: "fbbee29f2c588ded9a605a091aba1140ebd1f5d629d5ce39dd1c983e14798d82"
	I0729 21:09:09.469467  345638 cri.go:89] found id: ""
	I0729 21:09:09.469474  345638 logs.go:276] 2 containers: [2e5ae293c129dbb0affcb0f06ae8ebaf6c3ed66d3cb9d4d26ff0dfdef3a13354 fbbee29f2c588ded9a605a091aba1140ebd1f5d629d5ce39dd1c983e14798d82]
	I0729 21:09:09.469535  345638 ssh_runner.go:195] Run: which crictl
	I0729 21:09:09.473287  345638 ssh_runner.go:195] Run: which crictl
	I0729 21:09:09.477481  345638 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kubernetes-dashboard Namespaces:[]}
	I0729 21:09:09.477598  345638 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kubernetes-dashboard
	I0729 21:09:09.539457  345638 cri.go:89] found id: "34f4a145168f7d8792c43d14323521b0156159cac751496bf394b9275ccc6838"
	I0729 21:09:09.539531  345638 cri.go:89] found id: ""
	I0729 21:09:09.539582  345638 logs.go:276] 1 containers: [34f4a145168f7d8792c43d14323521b0156159cac751496bf394b9275ccc6838]
	I0729 21:09:09.539734  345638 ssh_runner.go:195] Run: which crictl
	I0729 21:09:09.544788  345638 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:storage-provisioner Namespaces:[]}
	I0729 21:09:09.544920  345638 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=storage-provisioner
	I0729 21:09:09.610846  345638 cri.go:89] found id: "4f8799ba1d8a399271f1e0e41066a3adbc2d551c152aa5a3e66f5d0c73490740"
	I0729 21:09:09.610868  345638 cri.go:89] found id: "e688afd0f49445f228b8c750a4ab27a91e60c9078c51532fdfb7ba6584baee4d"
	I0729 21:09:09.610874  345638 cri.go:89] found id: ""
	I0729 21:09:09.610880  345638 logs.go:276] 2 containers: [4f8799ba1d8a399271f1e0e41066a3adbc2d551c152aa5a3e66f5d0c73490740 e688afd0f49445f228b8c750a4ab27a91e60c9078c51532fdfb7ba6584baee4d]
	I0729 21:09:09.610939  345638 ssh_runner.go:195] Run: which crictl
	I0729 21:09:09.615766  345638 ssh_runner.go:195] Run: which crictl
	I0729 21:09:09.619896  345638 logs.go:123] Gathering logs for kube-apiserver [2b5706f43ae84ffb4c99184b43a6db1890019aa8c76fdb92fdf6129a64fe28fb] ...
	I0729 21:09:09.619938  345638 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 2b5706f43ae84ffb4c99184b43a6db1890019aa8c76fdb92fdf6129a64fe28fb"
	I0729 21:09:09.700015  345638 logs.go:123] Gathering logs for coredns [a11607490336d465d0dc075fbb00de0bc707a72aed0c22c0881dcd60db427adf] ...
	I0729 21:09:09.700090  345638 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 a11607490336d465d0dc075fbb00de0bc707a72aed0c22c0881dcd60db427adf"
	I0729 21:09:09.765438  345638 logs.go:123] Gathering logs for kube-proxy [cc4846179f2a5f6f93c7bdb1f437618106e1a00f39b10534afcbbee12f518c4e] ...
	I0729 21:09:09.765466  345638 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 cc4846179f2a5f6f93c7bdb1f437618106e1a00f39b10534afcbbee12f518c4e"
	I0729 21:09:09.811466  345638 logs.go:123] Gathering logs for kube-controller-manager [7e3ce8149fba57740e3a1eea6ee7778346b641b6e57850a9cad477449b277d98] ...
	I0729 21:09:09.811496  345638 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 7e3ce8149fba57740e3a1eea6ee7778346b641b6e57850a9cad477449b277d98"
	I0729 21:09:09.907936  345638 logs.go:123] Gathering logs for kindnet [fbbee29f2c588ded9a605a091aba1140ebd1f5d629d5ce39dd1c983e14798d82] ...
	I0729 21:09:09.908115  345638 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 fbbee29f2c588ded9a605a091aba1140ebd1f5d629d5ce39dd1c983e14798d82"
	I0729 21:09:09.978900  345638 logs.go:123] Gathering logs for storage-provisioner [4f8799ba1d8a399271f1e0e41066a3adbc2d551c152aa5a3e66f5d0c73490740] ...
	I0729 21:09:09.978935  345638 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 4f8799ba1d8a399271f1e0e41066a3adbc2d551c152aa5a3e66f5d0c73490740"
	I0729 21:09:10.047601  345638 logs.go:123] Gathering logs for container status ...
	I0729 21:09:10.047632  345638 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
	I0729 21:09:10.127570  345638 logs.go:123] Gathering logs for kubelet ...
	I0729 21:09:10.127599  345638 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
	W0729 21:09:10.198588  345638 logs.go:138] Found kubelet problem: Jul 29 21:03:50 old-k8s-version-884192 kubelet[665]: E0729 21:03:50.560321     665 reflector.go:138] object-"kube-system"/"kube-proxy": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "kube-proxy" is forbidden: User "system:node:old-k8s-version-884192" cannot list resource "configmaps" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-884192' and this object
	W0729 21:09:10.201452  345638 logs.go:138] Found kubelet problem: Jul 29 21:03:50 old-k8s-version-884192 kubelet[665]: E0729 21:03:50.648505     665 reflector.go:138] object-"kube-system"/"kube-proxy-token-d4t6j": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "kube-proxy-token-d4t6j" is forbidden: User "system:node:old-k8s-version-884192" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-884192' and this object
	W0729 21:09:10.201679  345638 logs.go:138] Found kubelet problem: Jul 29 21:03:50 old-k8s-version-884192 kubelet[665]: E0729 21:03:50.660168     665 reflector.go:138] object-"kube-system"/"kindnet-token-844zg": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "kindnet-token-844zg" is forbidden: User "system:node:old-k8s-version-884192" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-884192' and this object
	W0729 21:09:10.201920  345638 logs.go:138] Found kubelet problem: Jul 29 21:03:50 old-k8s-version-884192 kubelet[665]: E0729 21:03:50.660246     665 reflector.go:138] object-"kube-system"/"storage-provisioner-token-2sjwm": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "storage-provisioner-token-2sjwm" is forbidden: User "system:node:old-k8s-version-884192" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-884192' and this object
	W0729 21:09:10.202135  345638 logs.go:138] Found kubelet problem: Jul 29 21:03:50 old-k8s-version-884192 kubelet[665]: E0729 21:03:50.660318     665 reflector.go:138] object-"kube-system"/"coredns-token-4ccnn": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "coredns-token-4ccnn" is forbidden: User "system:node:old-k8s-version-884192" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-884192' and this object
	W0729 21:09:10.202338  345638 logs.go:138] Found kubelet problem: Jul 29 21:03:50 old-k8s-version-884192 kubelet[665]: E0729 21:03:50.660366     665 reflector.go:138] object-"kube-system"/"coredns": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "coredns" is forbidden: User "system:node:old-k8s-version-884192" cannot list resource "configmaps" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-884192' and this object
	W0729 21:09:10.202552  345638 logs.go:138] Found kubelet problem: Jul 29 21:03:50 old-k8s-version-884192 kubelet[665]: E0729 21:03:50.660431     665 reflector.go:138] object-"default"/"default-token-c99br": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "default-token-c99br" is forbidden: User "system:node:old-k8s-version-884192" cannot list resource "secrets" in API group "" in the namespace "default": no relationship found between node 'old-k8s-version-884192' and this object
	W0729 21:09:10.202778  345638 logs.go:138] Found kubelet problem: Jul 29 21:03:50 old-k8s-version-884192 kubelet[665]: E0729 21:03:50.660512     665 reflector.go:138] object-"kube-system"/"metrics-server-token-2bvqw": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "metrics-server-token-2bvqw" is forbidden: User "system:node:old-k8s-version-884192" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-884192' and this object
	W0729 21:09:10.212568  345638 logs.go:138] Found kubelet problem: Jul 29 21:03:53 old-k8s-version-884192 kubelet[665]: E0729 21:03:53.966940     665 pod_workers.go:191] Error syncing pod 0ffc056a-4cb7-448c-b912-bdc28b63e564 ("metrics-server-9975d5f86-b5bqk_kube-system(0ffc056a-4cb7-448c-b912-bdc28b63e564)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host"
	W0729 21:09:10.212775  345638 logs.go:138] Found kubelet problem: Jul 29 21:03:54 old-k8s-version-884192 kubelet[665]: E0729 21:03:54.376056     665 pod_workers.go:191] Error syncing pod 0ffc056a-4cb7-448c-b912-bdc28b63e564 ("metrics-server-9975d5f86-b5bqk_kube-system(0ffc056a-4cb7-448c-b912-bdc28b63e564)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W0729 21:09:10.215597  345638 logs.go:138] Found kubelet problem: Jul 29 21:04:04 old-k8s-version-884192 kubelet[665]: E0729 21:04:04.895801     665 pod_workers.go:191] Error syncing pod 0ffc056a-4cb7-448c-b912-bdc28b63e564 ("metrics-server-9975d5f86-b5bqk_kube-system(0ffc056a-4cb7-448c-b912-bdc28b63e564)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host"
	W0729 21:09:10.217313  345638 logs.go:138] Found kubelet problem: Jul 29 21:04:15 old-k8s-version-884192 kubelet[665]: E0729 21:04:15.896904     665 pod_workers.go:191] Error syncing pod 0ffc056a-4cb7-448c-b912-bdc28b63e564 ("metrics-server-9975d5f86-b5bqk_kube-system(0ffc056a-4cb7-448c-b912-bdc28b63e564)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W0729 21:09:10.219123  345638 logs.go:138] Found kubelet problem: Jul 29 21:04:21 old-k8s-version-884192 kubelet[665]: E0729 21:04:21.578969     665 pod_workers.go:191] Error syncing pod 27408590-ef02-4a20-bae0-3fb7ec51405b ("dashboard-metrics-scraper-8d5bb5db8-fgznv_kubernetes-dashboard(27408590-ef02-4a20-bae0-3fb7ec51405b)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 10s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-fgznv_kubernetes-dashboard(27408590-ef02-4a20-bae0-3fb7ec51405b)"
	W0729 21:09:10.219626  345638 logs.go:138] Found kubelet problem: Jul 29 21:04:22 old-k8s-version-884192 kubelet[665]: E0729 21:04:22.589373     665 pod_workers.go:191] Error syncing pod 27408590-ef02-4a20-bae0-3fb7ec51405b ("dashboard-metrics-scraper-8d5bb5db8-fgznv_kubernetes-dashboard(27408590-ef02-4a20-bae0-3fb7ec51405b)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 10s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-fgznv_kubernetes-dashboard(27408590-ef02-4a20-bae0-3fb7ec51405b)"
	W0729 21:09:10.220028  345638 logs.go:138] Found kubelet problem: Jul 29 21:04:25 old-k8s-version-884192 kubelet[665]: E0729 21:04:25.253572     665 pod_workers.go:191] Error syncing pod 27408590-ef02-4a20-bae0-3fb7ec51405b ("dashboard-metrics-scraper-8d5bb5db8-fgznv_kubernetes-dashboard(27408590-ef02-4a20-bae0-3fb7ec51405b)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 10s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-fgznv_kubernetes-dashboard(27408590-ef02-4a20-bae0-3fb7ec51405b)"
	W0729 21:09:10.221578  345638 logs.go:138] Found kubelet problem: Jul 29 21:04:25 old-k8s-version-884192 kubelet[665]: E0729 21:04:25.601526     665 pod_workers.go:191] Error syncing pod 7f56d473-96ce-429b-ad45-9312ee772a80 ("storage-provisioner_kube-system(7f56d473-96ce-429b-ad45-9312ee772a80)"), skipping: failed to "StartContainer" for "storage-provisioner" with CrashLoopBackOff: "back-off 10s restarting failed container=storage-provisioner pod=storage-provisioner_kube-system(7f56d473-96ce-429b-ad45-9312ee772a80)"
	W0729 21:09:10.224209  345638 logs.go:138] Found kubelet problem: Jul 29 21:04:28 old-k8s-version-884192 kubelet[665]: E0729 21:04:28.889967     665 pod_workers.go:191] Error syncing pod 0ffc056a-4cb7-448c-b912-bdc28b63e564 ("metrics-server-9975d5f86-b5bqk_kube-system(0ffc056a-4cb7-448c-b912-bdc28b63e564)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host"
	W0729 21:09:10.225152  345638 logs.go:138] Found kubelet problem: Jul 29 21:04:37 old-k8s-version-884192 kubelet[665]: E0729 21:04:37.634375     665 pod_workers.go:191] Error syncing pod 27408590-ef02-4a20-bae0-3fb7ec51405b ("dashboard-metrics-scraper-8d5bb5db8-fgznv_kubernetes-dashboard(27408590-ef02-4a20-bae0-3fb7ec51405b)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-fgznv_kubernetes-dashboard(27408590-ef02-4a20-bae0-3fb7ec51405b)"
	W0729 21:09:10.225537  345638 logs.go:138] Found kubelet problem: Jul 29 21:04:40 old-k8s-version-884192 kubelet[665]: E0729 21:04:40.880652     665 pod_workers.go:191] Error syncing pod 0ffc056a-4cb7-448c-b912-bdc28b63e564 ("metrics-server-9975d5f86-b5bqk_kube-system(0ffc056a-4cb7-448c-b912-bdc28b63e564)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W0729 21:09:10.225906  345638 logs.go:138] Found kubelet problem: Jul 29 21:04:45 old-k8s-version-884192 kubelet[665]: E0729 21:04:45.253793     665 pod_workers.go:191] Error syncing pod 27408590-ef02-4a20-bae0-3fb7ec51405b ("dashboard-metrics-scraper-8d5bb5db8-fgznv_kubernetes-dashboard(27408590-ef02-4a20-bae0-3fb7ec51405b)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-fgznv_kubernetes-dashboard(27408590-ef02-4a20-bae0-3fb7ec51405b)"
	W0729 21:09:10.226129  345638 logs.go:138] Found kubelet problem: Jul 29 21:04:52 old-k8s-version-884192 kubelet[665]: E0729 21:04:52.891131     665 pod_workers.go:191] Error syncing pod 0ffc056a-4cb7-448c-b912-bdc28b63e564 ("metrics-server-9975d5f86-b5bqk_kube-system(0ffc056a-4cb7-448c-b912-bdc28b63e564)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W0729 21:09:10.226509  345638 logs.go:138] Found kubelet problem: Jul 29 21:04:56 old-k8s-version-884192 kubelet[665]: E0729 21:04:56.881492     665 pod_workers.go:191] Error syncing pod 27408590-ef02-4a20-bae0-3fb7ec51405b ("dashboard-metrics-scraper-8d5bb5db8-fgznv_kubernetes-dashboard(27408590-ef02-4a20-bae0-3fb7ec51405b)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-fgznv_kubernetes-dashboard(27408590-ef02-4a20-bae0-3fb7ec51405b)"
	W0729 21:09:10.226716  345638 logs.go:138] Found kubelet problem: Jul 29 21:05:06 old-k8s-version-884192 kubelet[665]: E0729 21:05:06.882217     665 pod_workers.go:191] Error syncing pod 0ffc056a-4cb7-448c-b912-bdc28b63e564 ("metrics-server-9975d5f86-b5bqk_kube-system(0ffc056a-4cb7-448c-b912-bdc28b63e564)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W0729 21:09:10.227361  345638 logs.go:138] Found kubelet problem: Jul 29 21:05:13 old-k8s-version-884192 kubelet[665]: E0729 21:05:13.766948     665 pod_workers.go:191] Error syncing pod 27408590-ef02-4a20-bae0-3fb7ec51405b ("dashboard-metrics-scraper-8d5bb5db8-fgznv_kubernetes-dashboard(27408590-ef02-4a20-bae0-3fb7ec51405b)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-fgznv_kubernetes-dashboard(27408590-ef02-4a20-bae0-3fb7ec51405b)"
	W0729 21:09:10.227700  345638 logs.go:138] Found kubelet problem: Jul 29 21:05:15 old-k8s-version-884192 kubelet[665]: E0729 21:05:15.253612     665 pod_workers.go:191] Error syncing pod 27408590-ef02-4a20-bae0-3fb7ec51405b ("dashboard-metrics-scraper-8d5bb5db8-fgznv_kubernetes-dashboard(27408590-ef02-4a20-bae0-3fb7ec51405b)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-fgznv_kubernetes-dashboard(27408590-ef02-4a20-bae0-3fb7ec51405b)"
	W0729 21:09:10.230865  345638 logs.go:138] Found kubelet problem: Jul 29 21:05:19 old-k8s-version-884192 kubelet[665]: E0729 21:05:19.887299     665 pod_workers.go:191] Error syncing pod 0ffc056a-4cb7-448c-b912-bdc28b63e564 ("metrics-server-9975d5f86-b5bqk_kube-system(0ffc056a-4cb7-448c-b912-bdc28b63e564)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host"
	W0729 21:09:10.231281  345638 logs.go:138] Found kubelet problem: Jul 29 21:05:27 old-k8s-version-884192 kubelet[665]: E0729 21:05:27.878582     665 pod_workers.go:191] Error syncing pod 27408590-ef02-4a20-bae0-3fb7ec51405b ("dashboard-metrics-scraper-8d5bb5db8-fgznv_kubernetes-dashboard(27408590-ef02-4a20-bae0-3fb7ec51405b)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-fgznv_kubernetes-dashboard(27408590-ef02-4a20-bae0-3fb7ec51405b)"
	W0729 21:09:10.231509  345638 logs.go:138] Found kubelet problem: Jul 29 21:05:31 old-k8s-version-884192 kubelet[665]: E0729 21:05:31.878876     665 pod_workers.go:191] Error syncing pod 0ffc056a-4cb7-448c-b912-bdc28b63e564 ("metrics-server-9975d5f86-b5bqk_kube-system(0ffc056a-4cb7-448c-b912-bdc28b63e564)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W0729 21:09:10.231897  345638 logs.go:138] Found kubelet problem: Jul 29 21:05:39 old-k8s-version-884192 kubelet[665]: E0729 21:05:39.878595     665 pod_workers.go:191] Error syncing pod 27408590-ef02-4a20-bae0-3fb7ec51405b ("dashboard-metrics-scraper-8d5bb5db8-fgznv_kubernetes-dashboard(27408590-ef02-4a20-bae0-3fb7ec51405b)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-fgznv_kubernetes-dashboard(27408590-ef02-4a20-bae0-3fb7ec51405b)"
	W0729 21:09:10.232131  345638 logs.go:138] Found kubelet problem: Jul 29 21:05:43 old-k8s-version-884192 kubelet[665]: E0729 21:05:43.880687     665 pod_workers.go:191] Error syncing pod 0ffc056a-4cb7-448c-b912-bdc28b63e564 ("metrics-server-9975d5f86-b5bqk_kube-system(0ffc056a-4cb7-448c-b912-bdc28b63e564)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W0729 21:09:10.232551  345638 logs.go:138] Found kubelet problem: Jul 29 21:05:50 old-k8s-version-884192 kubelet[665]: E0729 21:05:50.885032     665 pod_workers.go:191] Error syncing pod 27408590-ef02-4a20-bae0-3fb7ec51405b ("dashboard-metrics-scraper-8d5bb5db8-fgznv_kubernetes-dashboard(27408590-ef02-4a20-bae0-3fb7ec51405b)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-fgznv_kubernetes-dashboard(27408590-ef02-4a20-bae0-3fb7ec51405b)"
	W0729 21:09:10.232787  345638 logs.go:138] Found kubelet problem: Jul 29 21:05:55 old-k8s-version-884192 kubelet[665]: E0729 21:05:55.878904     665 pod_workers.go:191] Error syncing pod 0ffc056a-4cb7-448c-b912-bdc28b63e564 ("metrics-server-9975d5f86-b5bqk_kube-system(0ffc056a-4cb7-448c-b912-bdc28b63e564)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W0729 21:09:10.233564  345638 logs.go:138] Found kubelet problem: Jul 29 21:06:03 old-k8s-version-884192 kubelet[665]: E0729 21:06:03.905054     665 pod_workers.go:191] Error syncing pod 27408590-ef02-4a20-bae0-3fb7ec51405b ("dashboard-metrics-scraper-8d5bb5db8-fgznv_kubernetes-dashboard(27408590-ef02-4a20-bae0-3fb7ec51405b)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-fgznv_kubernetes-dashboard(27408590-ef02-4a20-bae0-3fb7ec51405b)"
	W0729 21:09:10.234065  345638 logs.go:138] Found kubelet problem: Jul 29 21:06:05 old-k8s-version-884192 kubelet[665]: E0729 21:06:05.254154     665 pod_workers.go:191] Error syncing pod 27408590-ef02-4a20-bae0-3fb7ec51405b ("dashboard-metrics-scraper-8d5bb5db8-fgznv_kubernetes-dashboard(27408590-ef02-4a20-bae0-3fb7ec51405b)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-fgznv_kubernetes-dashboard(27408590-ef02-4a20-bae0-3fb7ec51405b)"
	W0729 21:09:10.234315  345638 logs.go:138] Found kubelet problem: Jul 29 21:06:06 old-k8s-version-884192 kubelet[665]: E0729 21:06:06.878900     665 pod_workers.go:191] Error syncing pod 0ffc056a-4cb7-448c-b912-bdc28b63e564 ("metrics-server-9975d5f86-b5bqk_kube-system(0ffc056a-4cb7-448c-b912-bdc28b63e564)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W0729 21:09:10.234760  345638 logs.go:138] Found kubelet problem: Jul 29 21:06:17 old-k8s-version-884192 kubelet[665]: E0729 21:06:17.878635     665 pod_workers.go:191] Error syncing pod 27408590-ef02-4a20-bae0-3fb7ec51405b ("dashboard-metrics-scraper-8d5bb5db8-fgznv_kubernetes-dashboard(27408590-ef02-4a20-bae0-3fb7ec51405b)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-fgznv_kubernetes-dashboard(27408590-ef02-4a20-bae0-3fb7ec51405b)"
	W0729 21:09:10.234999  345638 logs.go:138] Found kubelet problem: Jul 29 21:06:17 old-k8s-version-884192 kubelet[665]: E0729 21:06:17.879561     665 pod_workers.go:191] Error syncing pod 0ffc056a-4cb7-448c-b912-bdc28b63e564 ("metrics-server-9975d5f86-b5bqk_kube-system(0ffc056a-4cb7-448c-b912-bdc28b63e564)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W0729 21:09:10.235453  345638 logs.go:138] Found kubelet problem: Jul 29 21:06:28 old-k8s-version-884192 kubelet[665]: E0729 21:06:28.879556     665 pod_workers.go:191] Error syncing pod 27408590-ef02-4a20-bae0-3fb7ec51405b ("dashboard-metrics-scraper-8d5bb5db8-fgznv_kubernetes-dashboard(27408590-ef02-4a20-bae0-3fb7ec51405b)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-fgznv_kubernetes-dashboard(27408590-ef02-4a20-bae0-3fb7ec51405b)"
	W0729 21:09:10.235679  345638 logs.go:138] Found kubelet problem: Jul 29 21:06:32 old-k8s-version-884192 kubelet[665]: E0729 21:06:32.879116     665 pod_workers.go:191] Error syncing pod 0ffc056a-4cb7-448c-b912-bdc28b63e564 ("metrics-server-9975d5f86-b5bqk_kube-system(0ffc056a-4cb7-448c-b912-bdc28b63e564)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W0729 21:09:10.236149  345638 logs.go:138] Found kubelet problem: Jul 29 21:06:42 old-k8s-version-884192 kubelet[665]: E0729 21:06:42.879155     665 pod_workers.go:191] Error syncing pod 27408590-ef02-4a20-bae0-3fb7ec51405b ("dashboard-metrics-scraper-8d5bb5db8-fgznv_kubernetes-dashboard(27408590-ef02-4a20-bae0-3fb7ec51405b)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-fgznv_kubernetes-dashboard(27408590-ef02-4a20-bae0-3fb7ec51405b)"
	W0729 21:09:10.238962  345638 logs.go:138] Found kubelet problem: Jul 29 21:06:43 old-k8s-version-884192 kubelet[665]: E0729 21:06:43.887774     665 pod_workers.go:191] Error syncing pod 0ffc056a-4cb7-448c-b912-bdc28b63e564 ("metrics-server-9975d5f86-b5bqk_kube-system(0ffc056a-4cb7-448c-b912-bdc28b63e564)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host"
	W0729 21:09:10.239307  345638 logs.go:138] Found kubelet problem: Jul 29 21:06:57 old-k8s-version-884192 kubelet[665]: E0729 21:06:57.878548     665 pod_workers.go:191] Error syncing pod 27408590-ef02-4a20-bae0-3fb7ec51405b ("dashboard-metrics-scraper-8d5bb5db8-fgznv_kubernetes-dashboard(27408590-ef02-4a20-bae0-3fb7ec51405b)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-fgznv_kubernetes-dashboard(27408590-ef02-4a20-bae0-3fb7ec51405b)"
	W0729 21:09:10.239497  345638 logs.go:138] Found kubelet problem: Jul 29 21:06:58 old-k8s-version-884192 kubelet[665]: E0729 21:06:58.879652     665 pod_workers.go:191] Error syncing pod 0ffc056a-4cb7-448c-b912-bdc28b63e564 ("metrics-server-9975d5f86-b5bqk_kube-system(0ffc056a-4cb7-448c-b912-bdc28b63e564)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W0729 21:09:10.239848  345638 logs.go:138] Found kubelet problem: Jul 29 21:07:10 old-k8s-version-884192 kubelet[665]: E0729 21:07:10.878619     665 pod_workers.go:191] Error syncing pod 27408590-ef02-4a20-bae0-3fb7ec51405b ("dashboard-metrics-scraper-8d5bb5db8-fgznv_kubernetes-dashboard(27408590-ef02-4a20-bae0-3fb7ec51405b)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-fgznv_kubernetes-dashboard(27408590-ef02-4a20-bae0-3fb7ec51405b)"
	W0729 21:09:10.240074  345638 logs.go:138] Found kubelet problem: Jul 29 21:07:12 old-k8s-version-884192 kubelet[665]: E0729 21:07:12.900943     665 pod_workers.go:191] Error syncing pod 0ffc056a-4cb7-448c-b912-bdc28b63e564 ("metrics-server-9975d5f86-b5bqk_kube-system(0ffc056a-4cb7-448c-b912-bdc28b63e564)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W0729 21:09:10.240415  345638 logs.go:138] Found kubelet problem: Jul 29 21:07:21 old-k8s-version-884192 kubelet[665]: E0729 21:07:21.878536     665 pod_workers.go:191] Error syncing pod 27408590-ef02-4a20-bae0-3fb7ec51405b ("dashboard-metrics-scraper-8d5bb5db8-fgznv_kubernetes-dashboard(27408590-ef02-4a20-bae0-3fb7ec51405b)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-fgznv_kubernetes-dashboard(27408590-ef02-4a20-bae0-3fb7ec51405b)"
	W0729 21:09:10.240616  345638 logs.go:138] Found kubelet problem: Jul 29 21:07:25 old-k8s-version-884192 kubelet[665]: E0729 21:07:25.878905     665 pod_workers.go:191] Error syncing pod 0ffc056a-4cb7-448c-b912-bdc28b63e564 ("metrics-server-9975d5f86-b5bqk_kube-system(0ffc056a-4cb7-448c-b912-bdc28b63e564)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W0729 21:09:10.241346  345638 logs.go:138] Found kubelet problem: Jul 29 21:07:34 old-k8s-version-884192 kubelet[665]: E0729 21:07:34.179025     665 pod_workers.go:191] Error syncing pod 27408590-ef02-4a20-bae0-3fb7ec51405b ("dashboard-metrics-scraper-8d5bb5db8-fgznv_kubernetes-dashboard(27408590-ef02-4a20-bae0-3fb7ec51405b)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-fgznv_kubernetes-dashboard(27408590-ef02-4a20-bae0-3fb7ec51405b)"
	W0729 21:09:10.241746  345638 logs.go:138] Found kubelet problem: Jul 29 21:07:35 old-k8s-version-884192 kubelet[665]: E0729 21:07:35.253515     665 pod_workers.go:191] Error syncing pod 27408590-ef02-4a20-bae0-3fb7ec51405b ("dashboard-metrics-scraper-8d5bb5db8-fgznv_kubernetes-dashboard(27408590-ef02-4a20-bae0-3fb7ec51405b)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-fgznv_kubernetes-dashboard(27408590-ef02-4a20-bae0-3fb7ec51405b)"
	W0729 21:09:10.242008  345638 logs.go:138] Found kubelet problem: Jul 29 21:07:36 old-k8s-version-884192 kubelet[665]: E0729 21:07:36.878974     665 pod_workers.go:191] Error syncing pod 0ffc056a-4cb7-448c-b912-bdc28b63e564 ("metrics-server-9975d5f86-b5bqk_kube-system(0ffc056a-4cb7-448c-b912-bdc28b63e564)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W0729 21:09:10.242222  345638 logs.go:138] Found kubelet problem: Jul 29 21:07:47 old-k8s-version-884192 kubelet[665]: E0729 21:07:47.879029     665 pod_workers.go:191] Error syncing pod 0ffc056a-4cb7-448c-b912-bdc28b63e564 ("metrics-server-9975d5f86-b5bqk_kube-system(0ffc056a-4cb7-448c-b912-bdc28b63e564)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W0729 21:09:10.242607  345638 logs.go:138] Found kubelet problem: Jul 29 21:07:49 old-k8s-version-884192 kubelet[665]: E0729 21:07:49.878579     665 pod_workers.go:191] Error syncing pod 27408590-ef02-4a20-bae0-3fb7ec51405b ("dashboard-metrics-scraper-8d5bb5db8-fgznv_kubernetes-dashboard(27408590-ef02-4a20-bae0-3fb7ec51405b)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-fgznv_kubernetes-dashboard(27408590-ef02-4a20-bae0-3fb7ec51405b)"
	W0729 21:09:10.242798  345638 logs.go:138] Found kubelet problem: Jul 29 21:07:58 old-k8s-version-884192 kubelet[665]: E0729 21:07:58.879261     665 pod_workers.go:191] Error syncing pod 0ffc056a-4cb7-448c-b912-bdc28b63e564 ("metrics-server-9975d5f86-b5bqk_kube-system(0ffc056a-4cb7-448c-b912-bdc28b63e564)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W0729 21:09:10.243133  345638 logs.go:138] Found kubelet problem: Jul 29 21:08:00 old-k8s-version-884192 kubelet[665]: E0729 21:08:00.878649     665 pod_workers.go:191] Error syncing pod 27408590-ef02-4a20-bae0-3fb7ec51405b ("dashboard-metrics-scraper-8d5bb5db8-fgznv_kubernetes-dashboard(27408590-ef02-4a20-bae0-3fb7ec51405b)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-fgznv_kubernetes-dashboard(27408590-ef02-4a20-bae0-3fb7ec51405b)"
	W0729 21:09:10.243322  345638 logs.go:138] Found kubelet problem: Jul 29 21:08:09 old-k8s-version-884192 kubelet[665]: E0729 21:08:09.879004     665 pod_workers.go:191] Error syncing pod 0ffc056a-4cb7-448c-b912-bdc28b63e564 ("metrics-server-9975d5f86-b5bqk_kube-system(0ffc056a-4cb7-448c-b912-bdc28b63e564)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W0729 21:09:10.244251  345638 logs.go:138] Found kubelet problem: Jul 29 21:08:15 old-k8s-version-884192 kubelet[665]: E0729 21:08:15.878557     665 pod_workers.go:191] Error syncing pod 27408590-ef02-4a20-bae0-3fb7ec51405b ("dashboard-metrics-scraper-8d5bb5db8-fgznv_kubernetes-dashboard(27408590-ef02-4a20-bae0-3fb7ec51405b)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-fgznv_kubernetes-dashboard(27408590-ef02-4a20-bae0-3fb7ec51405b)"
	W0729 21:09:10.244490  345638 logs.go:138] Found kubelet problem: Jul 29 21:08:24 old-k8s-version-884192 kubelet[665]: E0729 21:08:24.879141     665 pod_workers.go:191] Error syncing pod 0ffc056a-4cb7-448c-b912-bdc28b63e564 ("metrics-server-9975d5f86-b5bqk_kube-system(0ffc056a-4cb7-448c-b912-bdc28b63e564)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W0729 21:09:10.244873  345638 logs.go:138] Found kubelet problem: Jul 29 21:08:29 old-k8s-version-884192 kubelet[665]: E0729 21:08:29.878560     665 pod_workers.go:191] Error syncing pod 27408590-ef02-4a20-bae0-3fb7ec51405b ("dashboard-metrics-scraper-8d5bb5db8-fgznv_kubernetes-dashboard(27408590-ef02-4a20-bae0-3fb7ec51405b)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-fgznv_kubernetes-dashboard(27408590-ef02-4a20-bae0-3fb7ec51405b)"
	W0729 21:09:10.245132  345638 logs.go:138] Found kubelet problem: Jul 29 21:08:39 old-k8s-version-884192 kubelet[665]: E0729 21:08:39.879359     665 pod_workers.go:191] Error syncing pod 0ffc056a-4cb7-448c-b912-bdc28b63e564 ("metrics-server-9975d5f86-b5bqk_kube-system(0ffc056a-4cb7-448c-b912-bdc28b63e564)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W0729 21:09:10.245515  345638 logs.go:138] Found kubelet problem: Jul 29 21:08:41 old-k8s-version-884192 kubelet[665]: E0729 21:08:41.878632     665 pod_workers.go:191] Error syncing pod 27408590-ef02-4a20-bae0-3fb7ec51405b ("dashboard-metrics-scraper-8d5bb5db8-fgznv_kubernetes-dashboard(27408590-ef02-4a20-bae0-3fb7ec51405b)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-fgznv_kubernetes-dashboard(27408590-ef02-4a20-bae0-3fb7ec51405b)"
	W0729 21:09:10.245894  345638 logs.go:138] Found kubelet problem: Jul 29 21:08:52 old-k8s-version-884192 kubelet[665]: E0729 21:08:52.878623     665 pod_workers.go:191] Error syncing pod 27408590-ef02-4a20-bae0-3fb7ec51405b ("dashboard-metrics-scraper-8d5bb5db8-fgznv_kubernetes-dashboard(27408590-ef02-4a20-bae0-3fb7ec51405b)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-fgznv_kubernetes-dashboard(27408590-ef02-4a20-bae0-3fb7ec51405b)"
	W0729 21:09:10.246086  345638 logs.go:138] Found kubelet problem: Jul 29 21:08:54 old-k8s-version-884192 kubelet[665]: E0729 21:08:54.878991     665 pod_workers.go:191] Error syncing pod 0ffc056a-4cb7-448c-b912-bdc28b63e564 ("metrics-server-9975d5f86-b5bqk_kube-system(0ffc056a-4cb7-448c-b912-bdc28b63e564)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W0729 21:09:10.246309  345638 logs.go:138] Found kubelet problem: Jul 29 21:09:05 old-k8s-version-884192 kubelet[665]: E0729 21:09:05.879120     665 pod_workers.go:191] Error syncing pod 0ffc056a-4cb7-448c-b912-bdc28b63e564 ("metrics-server-9975d5f86-b5bqk_kube-system(0ffc056a-4cb7-448c-b912-bdc28b63e564)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W0729 21:09:10.246656  345638 logs.go:138] Found kubelet problem: Jul 29 21:09:07 old-k8s-version-884192 kubelet[665]: E0729 21:09:07.878565     665 pod_workers.go:191] Error syncing pod 27408590-ef02-4a20-bae0-3fb7ec51405b ("dashboard-metrics-scraper-8d5bb5db8-fgznv_kubernetes-dashboard(27408590-ef02-4a20-bae0-3fb7ec51405b)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-fgznv_kubernetes-dashboard(27408590-ef02-4a20-bae0-3fb7ec51405b)"
	I0729 21:09:10.246669  345638 logs.go:123] Gathering logs for coredns [4c9c5c5f06999ffd13d4298995cd93d9de27eda2f392872dbd2c9cbef44d6bd9] ...
	I0729 21:09:10.246683  345638 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 4c9c5c5f06999ffd13d4298995cd93d9de27eda2f392872dbd2c9cbef44d6bd9"
	I0729 21:09:10.313363  345638 logs.go:123] Gathering logs for kindnet [2e5ae293c129dbb0affcb0f06ae8ebaf6c3ed66d3cb9d4d26ff0dfdef3a13354] ...
	I0729 21:09:10.313393  345638 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 2e5ae293c129dbb0affcb0f06ae8ebaf6c3ed66d3cb9d4d26ff0dfdef3a13354"
	I0729 21:09:10.404973  345638 logs.go:123] Gathering logs for storage-provisioner [e688afd0f49445f228b8c750a4ab27a91e60c9078c51532fdfb7ba6584baee4d] ...
	I0729 21:09:10.405007  345638 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 e688afd0f49445f228b8c750a4ab27a91e60c9078c51532fdfb7ba6584baee4d"
	I0729 21:09:10.462782  345638 logs.go:123] Gathering logs for kube-proxy [75750dba9bde8fdbcbdd8ebef671cf28647195630a985ee55cf6cd358325a7b2] ...
	I0729 21:09:10.462808  345638 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 75750dba9bde8fdbcbdd8ebef671cf28647195630a985ee55cf6cd358325a7b2"
	I0729 21:09:10.525881  345638 logs.go:123] Gathering logs for dmesg ...
	I0729 21:09:10.525910  345638 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
	I0729 21:09:10.548911  345638 logs.go:123] Gathering logs for describe nodes ...
	I0729 21:09:10.548940  345638 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
	I0729 21:09:10.729137  345638 logs.go:123] Gathering logs for kube-apiserver [75e8e58f6b60c620418997e5255b74f9697a29827f81dff4f9dbf920bab06deb] ...
	I0729 21:09:10.729166  345638 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 75e8e58f6b60c620418997e5255b74f9697a29827f81dff4f9dbf920bab06deb"
	I0729 21:09:10.830702  345638 logs.go:123] Gathering logs for etcd [fdfc2fda8f65bf329c9d58d897a8694516fa614a5e93c26ef5cb777ca3bec6f9] ...
	I0729 21:09:10.830736  345638 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 fdfc2fda8f65bf329c9d58d897a8694516fa614a5e93c26ef5cb777ca3bec6f9"
	I0729 21:09:10.891430  345638 logs.go:123] Gathering logs for etcd [bc0116b218f41883478ef8c3d93fb1116431f7848779b1dccd7871ccda0dc49f] ...
	I0729 21:09:10.891462  345638 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 bc0116b218f41883478ef8c3d93fb1116431f7848779b1dccd7871ccda0dc49f"
	I0729 21:09:10.961544  345638 logs.go:123] Gathering logs for kube-scheduler [9abfa4fc0bdf34111d54edc320059e70f6aee2b65f28100e1019cce30562b30a] ...
	I0729 21:09:10.961575  345638 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 9abfa4fc0bdf34111d54edc320059e70f6aee2b65f28100e1019cce30562b30a"
	I0729 21:09:11.041531  345638 logs.go:123] Gathering logs for kube-scheduler [efa095c66551bd38c9deb191b3739441869b00874c7d3365c559609dcbd601c1] ...
	I0729 21:09:11.041560  345638 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 efa095c66551bd38c9deb191b3739441869b00874c7d3365c559609dcbd601c1"
	I0729 21:09:11.115170  345638 logs.go:123] Gathering logs for kube-controller-manager [6c3b9526f1351901cc60d713178c281355d6b3994267e1a6de1bf5f38054b4aa] ...
	I0729 21:09:11.115217  345638 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 6c3b9526f1351901cc60d713178c281355d6b3994267e1a6de1bf5f38054b4aa"
	I0729 21:09:11.280745  345638 logs.go:123] Gathering logs for kubernetes-dashboard [34f4a145168f7d8792c43d14323521b0156159cac751496bf394b9275ccc6838] ...
	I0729 21:09:11.280786  345638 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 34f4a145168f7d8792c43d14323521b0156159cac751496bf394b9275ccc6838"
	I0729 21:09:11.349510  345638 logs.go:123] Gathering logs for containerd ...
	I0729 21:09:11.349540  345638 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u containerd -n 400"
	I0729 21:09:11.429450  345638 out.go:304] Setting ErrFile to fd 2...
	I0729 21:09:11.429483  345638 out.go:338] TERM=,COLORTERM=, which probably does not support color
	W0729 21:09:11.429545  345638 out.go:239] X Problems detected in kubelet:
	X Problems detected in kubelet:
	W0729 21:09:11.429557  345638 out.go:239]   Jul 29 21:08:41 old-k8s-version-884192 kubelet[665]: E0729 21:08:41.878632     665 pod_workers.go:191] Error syncing pod 27408590-ef02-4a20-bae0-3fb7ec51405b ("dashboard-metrics-scraper-8d5bb5db8-fgznv_kubernetes-dashboard(27408590-ef02-4a20-bae0-3fb7ec51405b)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-fgznv_kubernetes-dashboard(27408590-ef02-4a20-bae0-3fb7ec51405b)"
	  Jul 29 21:08:41 old-k8s-version-884192 kubelet[665]: E0729 21:08:41.878632     665 pod_workers.go:191] Error syncing pod 27408590-ef02-4a20-bae0-3fb7ec51405b ("dashboard-metrics-scraper-8d5bb5db8-fgznv_kubernetes-dashboard(27408590-ef02-4a20-bae0-3fb7ec51405b)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-fgznv_kubernetes-dashboard(27408590-ef02-4a20-bae0-3fb7ec51405b)"
	W0729 21:09:11.429574  345638 out.go:239]   Jul 29 21:08:52 old-k8s-version-884192 kubelet[665]: E0729 21:08:52.878623     665 pod_workers.go:191] Error syncing pod 27408590-ef02-4a20-bae0-3fb7ec51405b ("dashboard-metrics-scraper-8d5bb5db8-fgznv_kubernetes-dashboard(27408590-ef02-4a20-bae0-3fb7ec51405b)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-fgznv_kubernetes-dashboard(27408590-ef02-4a20-bae0-3fb7ec51405b)"
	  Jul 29 21:08:52 old-k8s-version-884192 kubelet[665]: E0729 21:08:52.878623     665 pod_workers.go:191] Error syncing pod 27408590-ef02-4a20-bae0-3fb7ec51405b ("dashboard-metrics-scraper-8d5bb5db8-fgznv_kubernetes-dashboard(27408590-ef02-4a20-bae0-3fb7ec51405b)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-fgznv_kubernetes-dashboard(27408590-ef02-4a20-bae0-3fb7ec51405b)"
	W0729 21:09:11.429583  345638 out.go:239]   Jul 29 21:08:54 old-k8s-version-884192 kubelet[665]: E0729 21:08:54.878991     665 pod_workers.go:191] Error syncing pod 0ffc056a-4cb7-448c-b912-bdc28b63e564 ("metrics-server-9975d5f86-b5bqk_kube-system(0ffc056a-4cb7-448c-b912-bdc28b63e564)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	  Jul 29 21:08:54 old-k8s-version-884192 kubelet[665]: E0729 21:08:54.878991     665 pod_workers.go:191] Error syncing pod 0ffc056a-4cb7-448c-b912-bdc28b63e564 ("metrics-server-9975d5f86-b5bqk_kube-system(0ffc056a-4cb7-448c-b912-bdc28b63e564)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W0729 21:09:11.429595  345638 out.go:239]   Jul 29 21:09:05 old-k8s-version-884192 kubelet[665]: E0729 21:09:05.879120     665 pod_workers.go:191] Error syncing pod 0ffc056a-4cb7-448c-b912-bdc28b63e564 ("metrics-server-9975d5f86-b5bqk_kube-system(0ffc056a-4cb7-448c-b912-bdc28b63e564)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	  Jul 29 21:09:05 old-k8s-version-884192 kubelet[665]: E0729 21:09:05.879120     665 pod_workers.go:191] Error syncing pod 0ffc056a-4cb7-448c-b912-bdc28b63e564 ("metrics-server-9975d5f86-b5bqk_kube-system(0ffc056a-4cb7-448c-b912-bdc28b63e564)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W0729 21:09:11.429601  345638 out.go:239]   Jul 29 21:09:07 old-k8s-version-884192 kubelet[665]: E0729 21:09:07.878565     665 pod_workers.go:191] Error syncing pod 27408590-ef02-4a20-bae0-3fb7ec51405b ("dashboard-metrics-scraper-8d5bb5db8-fgznv_kubernetes-dashboard(27408590-ef02-4a20-bae0-3fb7ec51405b)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-fgznv_kubernetes-dashboard(27408590-ef02-4a20-bae0-3fb7ec51405b)"
	  Jul 29 21:09:07 old-k8s-version-884192 kubelet[665]: E0729 21:09:07.878565     665 pod_workers.go:191] Error syncing pod 27408590-ef02-4a20-bae0-3fb7ec51405b ("dashboard-metrics-scraper-8d5bb5db8-fgznv_kubernetes-dashboard(27408590-ef02-4a20-bae0-3fb7ec51405b)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-fgznv_kubernetes-dashboard(27408590-ef02-4a20-bae0-3fb7ec51405b)"
	I0729 21:09:11.429609  345638 out.go:304] Setting ErrFile to fd 2...
	I0729 21:09:11.429615  345638 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0729 21:09:21.431691  345638 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0729 21:09:21.444598  345638 api_server.go:72] duration metric: took 5m50.598189551s to wait for apiserver process to appear ...
	I0729 21:09:21.444623  345638 api_server.go:88] waiting for apiserver healthz status ...
	I0729 21:09:21.444751  345638 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-apiserver Namespaces:[]}
	I0729 21:09:21.444819  345638 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
	I0729 21:09:21.483711  345638 cri.go:89] found id: "2b5706f43ae84ffb4c99184b43a6db1890019aa8c76fdb92fdf6129a64fe28fb"
	I0729 21:09:21.483731  345638 cri.go:89] found id: "75e8e58f6b60c620418997e5255b74f9697a29827f81dff4f9dbf920bab06deb"
	I0729 21:09:21.483736  345638 cri.go:89] found id: ""
	I0729 21:09:21.483743  345638 logs.go:276] 2 containers: [2b5706f43ae84ffb4c99184b43a6db1890019aa8c76fdb92fdf6129a64fe28fb 75e8e58f6b60c620418997e5255b74f9697a29827f81dff4f9dbf920bab06deb]
	I0729 21:09:21.483820  345638 ssh_runner.go:195] Run: which crictl
	I0729 21:09:21.487669  345638 ssh_runner.go:195] Run: which crictl
	I0729 21:09:21.491442  345638 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:etcd Namespaces:[]}
	I0729 21:09:21.491553  345638 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
	I0729 21:09:21.540323  345638 cri.go:89] found id: "fdfc2fda8f65bf329c9d58d897a8694516fa614a5e93c26ef5cb777ca3bec6f9"
	I0729 21:09:21.540343  345638 cri.go:89] found id: "bc0116b218f41883478ef8c3d93fb1116431f7848779b1dccd7871ccda0dc49f"
	I0729 21:09:21.540348  345638 cri.go:89] found id: ""
	I0729 21:09:21.540355  345638 logs.go:276] 2 containers: [fdfc2fda8f65bf329c9d58d897a8694516fa614a5e93c26ef5cb777ca3bec6f9 bc0116b218f41883478ef8c3d93fb1116431f7848779b1dccd7871ccda0dc49f]
	I0729 21:09:21.540422  345638 ssh_runner.go:195] Run: which crictl
	I0729 21:09:21.544763  345638 ssh_runner.go:195] Run: which crictl
	I0729 21:09:21.548598  345638 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:coredns Namespaces:[]}
	I0729 21:09:21.548683  345638 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
	I0729 21:09:21.588740  345638 cri.go:89] found id: "4c9c5c5f06999ffd13d4298995cd93d9de27eda2f392872dbd2c9cbef44d6bd9"
	I0729 21:09:21.588764  345638 cri.go:89] found id: "a11607490336d465d0dc075fbb00de0bc707a72aed0c22c0881dcd60db427adf"
	I0729 21:09:21.588770  345638 cri.go:89] found id: ""
	I0729 21:09:21.588777  345638 logs.go:276] 2 containers: [4c9c5c5f06999ffd13d4298995cd93d9de27eda2f392872dbd2c9cbef44d6bd9 a11607490336d465d0dc075fbb00de0bc707a72aed0c22c0881dcd60db427adf]
	I0729 21:09:21.588837  345638 ssh_runner.go:195] Run: which crictl
	I0729 21:09:21.592728  345638 ssh_runner.go:195] Run: which crictl
	I0729 21:09:21.596273  345638 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-scheduler Namespaces:[]}
	I0729 21:09:21.596346  345638 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
	I0729 21:09:21.633949  345638 cri.go:89] found id: "9abfa4fc0bdf34111d54edc320059e70f6aee2b65f28100e1019cce30562b30a"
	I0729 21:09:21.633969  345638 cri.go:89] found id: "efa095c66551bd38c9deb191b3739441869b00874c7d3365c559609dcbd601c1"
	I0729 21:09:21.633974  345638 cri.go:89] found id: ""
	I0729 21:09:21.633982  345638 logs.go:276] 2 containers: [9abfa4fc0bdf34111d54edc320059e70f6aee2b65f28100e1019cce30562b30a efa095c66551bd38c9deb191b3739441869b00874c7d3365c559609dcbd601c1]
	I0729 21:09:21.634044  345638 ssh_runner.go:195] Run: which crictl
	I0729 21:09:21.637738  345638 ssh_runner.go:195] Run: which crictl
	I0729 21:09:21.641244  345638 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-proxy Namespaces:[]}
	I0729 21:09:21.641322  345638 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
	I0729 21:09:21.681581  345638 cri.go:89] found id: "75750dba9bde8fdbcbdd8ebef671cf28647195630a985ee55cf6cd358325a7b2"
	I0729 21:09:21.681603  345638 cri.go:89] found id: "cc4846179f2a5f6f93c7bdb1f437618106e1a00f39b10534afcbbee12f518c4e"
	I0729 21:09:21.681608  345638 cri.go:89] found id: ""
	I0729 21:09:21.681615  345638 logs.go:276] 2 containers: [75750dba9bde8fdbcbdd8ebef671cf28647195630a985ee55cf6cd358325a7b2 cc4846179f2a5f6f93c7bdb1f437618106e1a00f39b10534afcbbee12f518c4e]
	I0729 21:09:21.681672  345638 ssh_runner.go:195] Run: which crictl
	I0729 21:09:21.685415  345638 ssh_runner.go:195] Run: which crictl
	I0729 21:09:21.689070  345638 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-controller-manager Namespaces:[]}
	I0729 21:09:21.689138  345638 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
	I0729 21:09:21.730010  345638 cri.go:89] found id: "7e3ce8149fba57740e3a1eea6ee7778346b641b6e57850a9cad477449b277d98"
	I0729 21:09:21.730033  345638 cri.go:89] found id: "6c3b9526f1351901cc60d713178c281355d6b3994267e1a6de1bf5f38054b4aa"
	I0729 21:09:21.730039  345638 cri.go:89] found id: ""
	I0729 21:09:21.730046  345638 logs.go:276] 2 containers: [7e3ce8149fba57740e3a1eea6ee7778346b641b6e57850a9cad477449b277d98 6c3b9526f1351901cc60d713178c281355d6b3994267e1a6de1bf5f38054b4aa]
	I0729 21:09:21.730132  345638 ssh_runner.go:195] Run: which crictl
	I0729 21:09:21.733773  345638 ssh_runner.go:195] Run: which crictl
	I0729 21:09:21.737366  345638 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kindnet Namespaces:[]}
	I0729 21:09:21.737435  345638 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet
	I0729 21:09:21.775877  345638 cri.go:89] found id: "2e5ae293c129dbb0affcb0f06ae8ebaf6c3ed66d3cb9d4d26ff0dfdef3a13354"
	I0729 21:09:21.775899  345638 cri.go:89] found id: "fbbee29f2c588ded9a605a091aba1140ebd1f5d629d5ce39dd1c983e14798d82"
	I0729 21:09:21.775904  345638 cri.go:89] found id: ""
	I0729 21:09:21.775911  345638 logs.go:276] 2 containers: [2e5ae293c129dbb0affcb0f06ae8ebaf6c3ed66d3cb9d4d26ff0dfdef3a13354 fbbee29f2c588ded9a605a091aba1140ebd1f5d629d5ce39dd1c983e14798d82]
	I0729 21:09:21.776042  345638 ssh_runner.go:195] Run: which crictl
	I0729 21:09:21.779556  345638 ssh_runner.go:195] Run: which crictl
	I0729 21:09:21.782898  345638 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kubernetes-dashboard Namespaces:[]}
	I0729 21:09:21.782967  345638 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kubernetes-dashboard
	I0729 21:09:21.820174  345638 cri.go:89] found id: "34f4a145168f7d8792c43d14323521b0156159cac751496bf394b9275ccc6838"
	I0729 21:09:21.820198  345638 cri.go:89] found id: ""
	I0729 21:09:21.820206  345638 logs.go:276] 1 containers: [34f4a145168f7d8792c43d14323521b0156159cac751496bf394b9275ccc6838]
	I0729 21:09:21.820288  345638 ssh_runner.go:195] Run: which crictl
	I0729 21:09:21.824462  345638 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:storage-provisioner Namespaces:[]}
	I0729 21:09:21.824558  345638 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=storage-provisioner
	I0729 21:09:21.869392  345638 cri.go:89] found id: "4f8799ba1d8a399271f1e0e41066a3adbc2d551c152aa5a3e66f5d0c73490740"
	I0729 21:09:21.869413  345638 cri.go:89] found id: "e688afd0f49445f228b8c750a4ab27a91e60c9078c51532fdfb7ba6584baee4d"
	I0729 21:09:21.869418  345638 cri.go:89] found id: ""
	I0729 21:09:21.869426  345638 logs.go:276] 2 containers: [4f8799ba1d8a399271f1e0e41066a3adbc2d551c152aa5a3e66f5d0c73490740 e688afd0f49445f228b8c750a4ab27a91e60c9078c51532fdfb7ba6584baee4d]
	I0729 21:09:21.869483  345638 ssh_runner.go:195] Run: which crictl
	I0729 21:09:21.873492  345638 ssh_runner.go:195] Run: which crictl
	I0729 21:09:21.876779  345638 logs.go:123] Gathering logs for kube-apiserver [75e8e58f6b60c620418997e5255b74f9697a29827f81dff4f9dbf920bab06deb] ...
	I0729 21:09:21.876805  345638 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 75e8e58f6b60c620418997e5255b74f9697a29827f81dff4f9dbf920bab06deb"
	I0729 21:09:21.930056  345638 logs.go:123] Gathering logs for coredns [4c9c5c5f06999ffd13d4298995cd93d9de27eda2f392872dbd2c9cbef44d6bd9] ...
	I0729 21:09:21.930085  345638 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 4c9c5c5f06999ffd13d4298995cd93d9de27eda2f392872dbd2c9cbef44d6bd9"
	I0729 21:09:21.975298  345638 logs.go:123] Gathering logs for coredns [a11607490336d465d0dc075fbb00de0bc707a72aed0c22c0881dcd60db427adf] ...
	I0729 21:09:21.975326  345638 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 a11607490336d465d0dc075fbb00de0bc707a72aed0c22c0881dcd60db427adf"
	I0729 21:09:22.019790  345638 logs.go:123] Gathering logs for kube-proxy [75750dba9bde8fdbcbdd8ebef671cf28647195630a985ee55cf6cd358325a7b2] ...
	I0729 21:09:22.019817  345638 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 75750dba9bde8fdbcbdd8ebef671cf28647195630a985ee55cf6cd358325a7b2"
	I0729 21:09:22.063052  345638 logs.go:123] Gathering logs for storage-provisioner [4f8799ba1d8a399271f1e0e41066a3adbc2d551c152aa5a3e66f5d0c73490740] ...
	I0729 21:09:22.063081  345638 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 4f8799ba1d8a399271f1e0e41066a3adbc2d551c152aa5a3e66f5d0c73490740"
	I0729 21:09:22.102346  345638 logs.go:123] Gathering logs for dmesg ...
	I0729 21:09:22.102375  345638 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
	I0729 21:09:22.121600  345638 logs.go:123] Gathering logs for etcd [bc0116b218f41883478ef8c3d93fb1116431f7848779b1dccd7871ccda0dc49f] ...
	I0729 21:09:22.121630  345638 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 bc0116b218f41883478ef8c3d93fb1116431f7848779b1dccd7871ccda0dc49f"
	I0729 21:09:22.178706  345638 logs.go:123] Gathering logs for kube-scheduler [9abfa4fc0bdf34111d54edc320059e70f6aee2b65f28100e1019cce30562b30a] ...
	I0729 21:09:22.178734  345638 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 9abfa4fc0bdf34111d54edc320059e70f6aee2b65f28100e1019cce30562b30a"
	I0729 21:09:22.222020  345638 logs.go:123] Gathering logs for kube-scheduler [efa095c66551bd38c9deb191b3739441869b00874c7d3365c559609dcbd601c1] ...
	I0729 21:09:22.222048  345638 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 efa095c66551bd38c9deb191b3739441869b00874c7d3365c559609dcbd601c1"
	I0729 21:09:22.265782  345638 logs.go:123] Gathering logs for kube-proxy [cc4846179f2a5f6f93c7bdb1f437618106e1a00f39b10534afcbbee12f518c4e] ...
	I0729 21:09:22.265815  345638 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 cc4846179f2a5f6f93c7bdb1f437618106e1a00f39b10534afcbbee12f518c4e"
	I0729 21:09:22.305106  345638 logs.go:123] Gathering logs for kube-controller-manager [7e3ce8149fba57740e3a1eea6ee7778346b641b6e57850a9cad477449b277d98] ...
	I0729 21:09:22.305136  345638 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 7e3ce8149fba57740e3a1eea6ee7778346b641b6e57850a9cad477449b277d98"
	I0729 21:09:22.358135  345638 logs.go:123] Gathering logs for kindnet [2e5ae293c129dbb0affcb0f06ae8ebaf6c3ed66d3cb9d4d26ff0dfdef3a13354] ...
	I0729 21:09:22.358172  345638 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 2e5ae293c129dbb0affcb0f06ae8ebaf6c3ed66d3cb9d4d26ff0dfdef3a13354"
	I0729 21:09:22.422356  345638 logs.go:123] Gathering logs for kubernetes-dashboard [34f4a145168f7d8792c43d14323521b0156159cac751496bf394b9275ccc6838] ...
	I0729 21:09:22.422390  345638 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 34f4a145168f7d8792c43d14323521b0156159cac751496bf394b9275ccc6838"
	I0729 21:09:22.462111  345638 logs.go:123] Gathering logs for storage-provisioner [e688afd0f49445f228b8c750a4ab27a91e60c9078c51532fdfb7ba6584baee4d] ...
	I0729 21:09:22.462138  345638 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 e688afd0f49445f228b8c750a4ab27a91e60c9078c51532fdfb7ba6584baee4d"
	I0729 21:09:22.501966  345638 logs.go:123] Gathering logs for containerd ...
	I0729 21:09:22.501992  345638 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u containerd -n 400"
	I0729 21:09:22.564000  345638 logs.go:123] Gathering logs for etcd [fdfc2fda8f65bf329c9d58d897a8694516fa614a5e93c26ef5cb777ca3bec6f9] ...
	I0729 21:09:22.564040  345638 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 fdfc2fda8f65bf329c9d58d897a8694516fa614a5e93c26ef5cb777ca3bec6f9"
	I0729 21:09:22.606042  345638 logs.go:123] Gathering logs for kube-controller-manager [6c3b9526f1351901cc60d713178c281355d6b3994267e1a6de1bf5f38054b4aa] ...
	I0729 21:09:22.606071  345638 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 6c3b9526f1351901cc60d713178c281355d6b3994267e1a6de1bf5f38054b4aa"
	I0729 21:09:22.677014  345638 logs.go:123] Gathering logs for kubelet ...
	I0729 21:09:22.677072  345638 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
	W0729 21:09:22.726988  345638 logs.go:138] Found kubelet problem: Jul 29 21:03:50 old-k8s-version-884192 kubelet[665]: E0729 21:03:50.560321     665 reflector.go:138] object-"kube-system"/"kube-proxy": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "kube-proxy" is forbidden: User "system:node:old-k8s-version-884192" cannot list resource "configmaps" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-884192' and this object
	W0729 21:09:22.729820  345638 logs.go:138] Found kubelet problem: Jul 29 21:03:50 old-k8s-version-884192 kubelet[665]: E0729 21:03:50.648505     665 reflector.go:138] object-"kube-system"/"kube-proxy-token-d4t6j": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "kube-proxy-token-d4t6j" is forbidden: User "system:node:old-k8s-version-884192" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-884192' and this object
	W0729 21:09:22.730041  345638 logs.go:138] Found kubelet problem: Jul 29 21:03:50 old-k8s-version-884192 kubelet[665]: E0729 21:03:50.660168     665 reflector.go:138] object-"kube-system"/"kindnet-token-844zg": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "kindnet-token-844zg" is forbidden: User "system:node:old-k8s-version-884192" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-884192' and this object
	W0729 21:09:22.730293  345638 logs.go:138] Found kubelet problem: Jul 29 21:03:50 old-k8s-version-884192 kubelet[665]: E0729 21:03:50.660246     665 reflector.go:138] object-"kube-system"/"storage-provisioner-token-2sjwm": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "storage-provisioner-token-2sjwm" is forbidden: User "system:node:old-k8s-version-884192" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-884192' and this object
	W0729 21:09:22.730508  345638 logs.go:138] Found kubelet problem: Jul 29 21:03:50 old-k8s-version-884192 kubelet[665]: E0729 21:03:50.660318     665 reflector.go:138] object-"kube-system"/"coredns-token-4ccnn": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "coredns-token-4ccnn" is forbidden: User "system:node:old-k8s-version-884192" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-884192' and this object
	W0729 21:09:22.730711  345638 logs.go:138] Found kubelet problem: Jul 29 21:03:50 old-k8s-version-884192 kubelet[665]: E0729 21:03:50.660366     665 reflector.go:138] object-"kube-system"/"coredns": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "coredns" is forbidden: User "system:node:old-k8s-version-884192" cannot list resource "configmaps" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-884192' and this object
	W0729 21:09:22.730923  345638 logs.go:138] Found kubelet problem: Jul 29 21:03:50 old-k8s-version-884192 kubelet[665]: E0729 21:03:50.660431     665 reflector.go:138] object-"default"/"default-token-c99br": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "default-token-c99br" is forbidden: User "system:node:old-k8s-version-884192" cannot list resource "secrets" in API group "" in the namespace "default": no relationship found between node 'old-k8s-version-884192' and this object
	W0729 21:09:22.731186  345638 logs.go:138] Found kubelet problem: Jul 29 21:03:50 old-k8s-version-884192 kubelet[665]: E0729 21:03:50.660512     665 reflector.go:138] object-"kube-system"/"metrics-server-token-2bvqw": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "metrics-server-token-2bvqw" is forbidden: User "system:node:old-k8s-version-884192" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-884192' and this object
	W0729 21:09:22.740166  345638 logs.go:138] Found kubelet problem: Jul 29 21:03:53 old-k8s-version-884192 kubelet[665]: E0729 21:03:53.966940     665 pod_workers.go:191] Error syncing pod 0ffc056a-4cb7-448c-b912-bdc28b63e564 ("metrics-server-9975d5f86-b5bqk_kube-system(0ffc056a-4cb7-448c-b912-bdc28b63e564)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host"
	W0729 21:09:22.740359  345638 logs.go:138] Found kubelet problem: Jul 29 21:03:54 old-k8s-version-884192 kubelet[665]: E0729 21:03:54.376056     665 pod_workers.go:191] Error syncing pod 0ffc056a-4cb7-448c-b912-bdc28b63e564 ("metrics-server-9975d5f86-b5bqk_kube-system(0ffc056a-4cb7-448c-b912-bdc28b63e564)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W0729 21:09:22.743165  345638 logs.go:138] Found kubelet problem: Jul 29 21:04:04 old-k8s-version-884192 kubelet[665]: E0729 21:04:04.895801     665 pod_workers.go:191] Error syncing pod 0ffc056a-4cb7-448c-b912-bdc28b63e564 ("metrics-server-9975d5f86-b5bqk_kube-system(0ffc056a-4cb7-448c-b912-bdc28b63e564)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host"
	W0729 21:09:22.744923  345638 logs.go:138] Found kubelet problem: Jul 29 21:04:15 old-k8s-version-884192 kubelet[665]: E0729 21:04:15.896904     665 pod_workers.go:191] Error syncing pod 0ffc056a-4cb7-448c-b912-bdc28b63e564 ("metrics-server-9975d5f86-b5bqk_kube-system(0ffc056a-4cb7-448c-b912-bdc28b63e564)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W0729 21:09:22.745728  345638 logs.go:138] Found kubelet problem: Jul 29 21:04:21 old-k8s-version-884192 kubelet[665]: E0729 21:04:21.578969     665 pod_workers.go:191] Error syncing pod 27408590-ef02-4a20-bae0-3fb7ec51405b ("dashboard-metrics-scraper-8d5bb5db8-fgznv_kubernetes-dashboard(27408590-ef02-4a20-bae0-3fb7ec51405b)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 10s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-fgznv_kubernetes-dashboard(27408590-ef02-4a20-bae0-3fb7ec51405b)"
	W0729 21:09:22.746215  345638 logs.go:138] Found kubelet problem: Jul 29 21:04:22 old-k8s-version-884192 kubelet[665]: E0729 21:04:22.589373     665 pod_workers.go:191] Error syncing pod 27408590-ef02-4a20-bae0-3fb7ec51405b ("dashboard-metrics-scraper-8d5bb5db8-fgznv_kubernetes-dashboard(27408590-ef02-4a20-bae0-3fb7ec51405b)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 10s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-fgznv_kubernetes-dashboard(27408590-ef02-4a20-bae0-3fb7ec51405b)"
	W0729 21:09:22.746558  345638 logs.go:138] Found kubelet problem: Jul 29 21:04:25 old-k8s-version-884192 kubelet[665]: E0729 21:04:25.253572     665 pod_workers.go:191] Error syncing pod 27408590-ef02-4a20-bae0-3fb7ec51405b ("dashboard-metrics-scraper-8d5bb5db8-fgznv_kubernetes-dashboard(27408590-ef02-4a20-bae0-3fb7ec51405b)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 10s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-fgznv_kubernetes-dashboard(27408590-ef02-4a20-bae0-3fb7ec51405b)"
	W0729 21:09:22.747014  345638 logs.go:138] Found kubelet problem: Jul 29 21:04:25 old-k8s-version-884192 kubelet[665]: E0729 21:04:25.601526     665 pod_workers.go:191] Error syncing pod 7f56d473-96ce-429b-ad45-9312ee772a80 ("storage-provisioner_kube-system(7f56d473-96ce-429b-ad45-9312ee772a80)"), skipping: failed to "StartContainer" for "storage-provisioner" with CrashLoopBackOff: "back-off 10s restarting failed container=storage-provisioner pod=storage-provisioner_kube-system(7f56d473-96ce-429b-ad45-9312ee772a80)"
	W0729 21:09:22.749592  345638 logs.go:138] Found kubelet problem: Jul 29 21:04:28 old-k8s-version-884192 kubelet[665]: E0729 21:04:28.889967     665 pod_workers.go:191] Error syncing pod 0ffc056a-4cb7-448c-b912-bdc28b63e564 ("metrics-server-9975d5f86-b5bqk_kube-system(0ffc056a-4cb7-448c-b912-bdc28b63e564)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host"
	W0729 21:09:22.750587  345638 logs.go:138] Found kubelet problem: Jul 29 21:04:37 old-k8s-version-884192 kubelet[665]: E0729 21:04:37.634375     665 pod_workers.go:191] Error syncing pod 27408590-ef02-4a20-bae0-3fb7ec51405b ("dashboard-metrics-scraper-8d5bb5db8-fgznv_kubernetes-dashboard(27408590-ef02-4a20-bae0-3fb7ec51405b)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-fgznv_kubernetes-dashboard(27408590-ef02-4a20-bae0-3fb7ec51405b)"
	W0729 21:09:22.750928  345638 logs.go:138] Found kubelet problem: Jul 29 21:04:40 old-k8s-version-884192 kubelet[665]: E0729 21:04:40.880652     665 pod_workers.go:191] Error syncing pod 0ffc056a-4cb7-448c-b912-bdc28b63e564 ("metrics-server-9975d5f86-b5bqk_kube-system(0ffc056a-4cb7-448c-b912-bdc28b63e564)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W0729 21:09:22.751285  345638 logs.go:138] Found kubelet problem: Jul 29 21:04:45 old-k8s-version-884192 kubelet[665]: E0729 21:04:45.253793     665 pod_workers.go:191] Error syncing pod 27408590-ef02-4a20-bae0-3fb7ec51405b ("dashboard-metrics-scraper-8d5bb5db8-fgznv_kubernetes-dashboard(27408590-ef02-4a20-bae0-3fb7ec51405b)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-fgznv_kubernetes-dashboard(27408590-ef02-4a20-bae0-3fb7ec51405b)"
	W0729 21:09:22.751485  345638 logs.go:138] Found kubelet problem: Jul 29 21:04:52 old-k8s-version-884192 kubelet[665]: E0729 21:04:52.891131     665 pod_workers.go:191] Error syncing pod 0ffc056a-4cb7-448c-b912-bdc28b63e564 ("metrics-server-9975d5f86-b5bqk_kube-system(0ffc056a-4cb7-448c-b912-bdc28b63e564)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W0729 21:09:22.751819  345638 logs.go:138] Found kubelet problem: Jul 29 21:04:56 old-k8s-version-884192 kubelet[665]: E0729 21:04:56.881492     665 pod_workers.go:191] Error syncing pod 27408590-ef02-4a20-bae0-3fb7ec51405b ("dashboard-metrics-scraper-8d5bb5db8-fgznv_kubernetes-dashboard(27408590-ef02-4a20-bae0-3fb7ec51405b)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-fgznv_kubernetes-dashboard(27408590-ef02-4a20-bae0-3fb7ec51405b)"
	W0729 21:09:22.752017  345638 logs.go:138] Found kubelet problem: Jul 29 21:05:06 old-k8s-version-884192 kubelet[665]: E0729 21:05:06.882217     665 pod_workers.go:191] Error syncing pod 0ffc056a-4cb7-448c-b912-bdc28b63e564 ("metrics-server-9975d5f86-b5bqk_kube-system(0ffc056a-4cb7-448c-b912-bdc28b63e564)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W0729 21:09:22.752633  345638 logs.go:138] Found kubelet problem: Jul 29 21:05:13 old-k8s-version-884192 kubelet[665]: E0729 21:05:13.766948     665 pod_workers.go:191] Error syncing pod 27408590-ef02-4a20-bae0-3fb7ec51405b ("dashboard-metrics-scraper-8d5bb5db8-fgznv_kubernetes-dashboard(27408590-ef02-4a20-bae0-3fb7ec51405b)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-fgznv_kubernetes-dashboard(27408590-ef02-4a20-bae0-3fb7ec51405b)"
	W0729 21:09:22.752974  345638 logs.go:138] Found kubelet problem: Jul 29 21:05:15 old-k8s-version-884192 kubelet[665]: E0729 21:05:15.253612     665 pod_workers.go:191] Error syncing pod 27408590-ef02-4a20-bae0-3fb7ec51405b ("dashboard-metrics-scraper-8d5bb5db8-fgznv_kubernetes-dashboard(27408590-ef02-4a20-bae0-3fb7ec51405b)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-fgznv_kubernetes-dashboard(27408590-ef02-4a20-bae0-3fb7ec51405b)"
	W0729 21:09:22.755500  345638 logs.go:138] Found kubelet problem: Jul 29 21:05:19 old-k8s-version-884192 kubelet[665]: E0729 21:05:19.887299     665 pod_workers.go:191] Error syncing pod 0ffc056a-4cb7-448c-b912-bdc28b63e564 ("metrics-server-9975d5f86-b5bqk_kube-system(0ffc056a-4cb7-448c-b912-bdc28b63e564)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host"
	W0729 21:09:22.755839  345638 logs.go:138] Found kubelet problem: Jul 29 21:05:27 old-k8s-version-884192 kubelet[665]: E0729 21:05:27.878582     665 pod_workers.go:191] Error syncing pod 27408590-ef02-4a20-bae0-3fb7ec51405b ("dashboard-metrics-scraper-8d5bb5db8-fgznv_kubernetes-dashboard(27408590-ef02-4a20-bae0-3fb7ec51405b)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-fgznv_kubernetes-dashboard(27408590-ef02-4a20-bae0-3fb7ec51405b)"
	W0729 21:09:22.756041  345638 logs.go:138] Found kubelet problem: Jul 29 21:05:31 old-k8s-version-884192 kubelet[665]: E0729 21:05:31.878876     665 pod_workers.go:191] Error syncing pod 0ffc056a-4cb7-448c-b912-bdc28b63e564 ("metrics-server-9975d5f86-b5bqk_kube-system(0ffc056a-4cb7-448c-b912-bdc28b63e564)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W0729 21:09:22.756380  345638 logs.go:138] Found kubelet problem: Jul 29 21:05:39 old-k8s-version-884192 kubelet[665]: E0729 21:05:39.878595     665 pod_workers.go:191] Error syncing pod 27408590-ef02-4a20-bae0-3fb7ec51405b ("dashboard-metrics-scraper-8d5bb5db8-fgznv_kubernetes-dashboard(27408590-ef02-4a20-bae0-3fb7ec51405b)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-fgznv_kubernetes-dashboard(27408590-ef02-4a20-bae0-3fb7ec51405b)"
	W0729 21:09:22.756660  345638 logs.go:138] Found kubelet problem: Jul 29 21:05:43 old-k8s-version-884192 kubelet[665]: E0729 21:05:43.880687     665 pod_workers.go:191] Error syncing pod 0ffc056a-4cb7-448c-b912-bdc28b63e564 ("metrics-server-9975d5f86-b5bqk_kube-system(0ffc056a-4cb7-448c-b912-bdc28b63e564)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W0729 21:09:22.757020  345638 logs.go:138] Found kubelet problem: Jul 29 21:05:50 old-k8s-version-884192 kubelet[665]: E0729 21:05:50.885032     665 pod_workers.go:191] Error syncing pod 27408590-ef02-4a20-bae0-3fb7ec51405b ("dashboard-metrics-scraper-8d5bb5db8-fgznv_kubernetes-dashboard(27408590-ef02-4a20-bae0-3fb7ec51405b)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-fgznv_kubernetes-dashboard(27408590-ef02-4a20-bae0-3fb7ec51405b)"
	W0729 21:09:22.757217  345638 logs.go:138] Found kubelet problem: Jul 29 21:05:55 old-k8s-version-884192 kubelet[665]: E0729 21:05:55.878904     665 pod_workers.go:191] Error syncing pod 0ffc056a-4cb7-448c-b912-bdc28b63e564 ("metrics-server-9975d5f86-b5bqk_kube-system(0ffc056a-4cb7-448c-b912-bdc28b63e564)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W0729 21:09:22.757884  345638 logs.go:138] Found kubelet problem: Jul 29 21:06:03 old-k8s-version-884192 kubelet[665]: E0729 21:06:03.905054     665 pod_workers.go:191] Error syncing pod 27408590-ef02-4a20-bae0-3fb7ec51405b ("dashboard-metrics-scraper-8d5bb5db8-fgznv_kubernetes-dashboard(27408590-ef02-4a20-bae0-3fb7ec51405b)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-fgznv_kubernetes-dashboard(27408590-ef02-4a20-bae0-3fb7ec51405b)"
	W0729 21:09:22.758265  345638 logs.go:138] Found kubelet problem: Jul 29 21:06:05 old-k8s-version-884192 kubelet[665]: E0729 21:06:05.254154     665 pod_workers.go:191] Error syncing pod 27408590-ef02-4a20-bae0-3fb7ec51405b ("dashboard-metrics-scraper-8d5bb5db8-fgznv_kubernetes-dashboard(27408590-ef02-4a20-bae0-3fb7ec51405b)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-fgznv_kubernetes-dashboard(27408590-ef02-4a20-bae0-3fb7ec51405b)"
	W0729 21:09:22.758458  345638 logs.go:138] Found kubelet problem: Jul 29 21:06:06 old-k8s-version-884192 kubelet[665]: E0729 21:06:06.878900     665 pod_workers.go:191] Error syncing pod 0ffc056a-4cb7-448c-b912-bdc28b63e564 ("metrics-server-9975d5f86-b5bqk_kube-system(0ffc056a-4cb7-448c-b912-bdc28b63e564)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W0729 21:09:22.758808  345638 logs.go:138] Found kubelet problem: Jul 29 21:06:17 old-k8s-version-884192 kubelet[665]: E0729 21:06:17.878635     665 pod_workers.go:191] Error syncing pod 27408590-ef02-4a20-bae0-3fb7ec51405b ("dashboard-metrics-scraper-8d5bb5db8-fgznv_kubernetes-dashboard(27408590-ef02-4a20-bae0-3fb7ec51405b)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-fgznv_kubernetes-dashboard(27408590-ef02-4a20-bae0-3fb7ec51405b)"
	W0729 21:09:22.758995  345638 logs.go:138] Found kubelet problem: Jul 29 21:06:17 old-k8s-version-884192 kubelet[665]: E0729 21:06:17.879561     665 pod_workers.go:191] Error syncing pod 0ffc056a-4cb7-448c-b912-bdc28b63e564 ("metrics-server-9975d5f86-b5bqk_kube-system(0ffc056a-4cb7-448c-b912-bdc28b63e564)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W0729 21:09:22.759340  345638 logs.go:138] Found kubelet problem: Jul 29 21:06:28 old-k8s-version-884192 kubelet[665]: E0729 21:06:28.879556     665 pod_workers.go:191] Error syncing pod 27408590-ef02-4a20-bae0-3fb7ec51405b ("dashboard-metrics-scraper-8d5bb5db8-fgznv_kubernetes-dashboard(27408590-ef02-4a20-bae0-3fb7ec51405b)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-fgznv_kubernetes-dashboard(27408590-ef02-4a20-bae0-3fb7ec51405b)"
	W0729 21:09:22.759546  345638 logs.go:138] Found kubelet problem: Jul 29 21:06:32 old-k8s-version-884192 kubelet[665]: E0729 21:06:32.879116     665 pod_workers.go:191] Error syncing pod 0ffc056a-4cb7-448c-b912-bdc28b63e564 ("metrics-server-9975d5f86-b5bqk_kube-system(0ffc056a-4cb7-448c-b912-bdc28b63e564)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W0729 21:09:22.759892  345638 logs.go:138] Found kubelet problem: Jul 29 21:06:42 old-k8s-version-884192 kubelet[665]: E0729 21:06:42.879155     665 pod_workers.go:191] Error syncing pod 27408590-ef02-4a20-bae0-3fb7ec51405b ("dashboard-metrics-scraper-8d5bb5db8-fgznv_kubernetes-dashboard(27408590-ef02-4a20-bae0-3fb7ec51405b)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-fgznv_kubernetes-dashboard(27408590-ef02-4a20-bae0-3fb7ec51405b)"
	W0729 21:09:22.762470  345638 logs.go:138] Found kubelet problem: Jul 29 21:06:43 old-k8s-version-884192 kubelet[665]: E0729 21:06:43.887774     665 pod_workers.go:191] Error syncing pod 0ffc056a-4cb7-448c-b912-bdc28b63e564 ("metrics-server-9975d5f86-b5bqk_kube-system(0ffc056a-4cb7-448c-b912-bdc28b63e564)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host"
	W0729 21:09:22.762816  345638 logs.go:138] Found kubelet problem: Jul 29 21:06:57 old-k8s-version-884192 kubelet[665]: E0729 21:06:57.878548     665 pod_workers.go:191] Error syncing pod 27408590-ef02-4a20-bae0-3fb7ec51405b ("dashboard-metrics-scraper-8d5bb5db8-fgznv_kubernetes-dashboard(27408590-ef02-4a20-bae0-3fb7ec51405b)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-fgznv_kubernetes-dashboard(27408590-ef02-4a20-bae0-3fb7ec51405b)"
	W0729 21:09:22.763015  345638 logs.go:138] Found kubelet problem: Jul 29 21:06:58 old-k8s-version-884192 kubelet[665]: E0729 21:06:58.879652     665 pod_workers.go:191] Error syncing pod 0ffc056a-4cb7-448c-b912-bdc28b63e564 ("metrics-server-9975d5f86-b5bqk_kube-system(0ffc056a-4cb7-448c-b912-bdc28b63e564)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W0729 21:09:22.763376  345638 logs.go:138] Found kubelet problem: Jul 29 21:07:10 old-k8s-version-884192 kubelet[665]: E0729 21:07:10.878619     665 pod_workers.go:191] Error syncing pod 27408590-ef02-4a20-bae0-3fb7ec51405b ("dashboard-metrics-scraper-8d5bb5db8-fgznv_kubernetes-dashboard(27408590-ef02-4a20-bae0-3fb7ec51405b)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-fgznv_kubernetes-dashboard(27408590-ef02-4a20-bae0-3fb7ec51405b)"
	W0729 21:09:22.763573  345638 logs.go:138] Found kubelet problem: Jul 29 21:07:12 old-k8s-version-884192 kubelet[665]: E0729 21:07:12.900943     665 pod_workers.go:191] Error syncing pod 0ffc056a-4cb7-448c-b912-bdc28b63e564 ("metrics-server-9975d5f86-b5bqk_kube-system(0ffc056a-4cb7-448c-b912-bdc28b63e564)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W0729 21:09:22.763909  345638 logs.go:138] Found kubelet problem: Jul 29 21:07:21 old-k8s-version-884192 kubelet[665]: E0729 21:07:21.878536     665 pod_workers.go:191] Error syncing pod 27408590-ef02-4a20-bae0-3fb7ec51405b ("dashboard-metrics-scraper-8d5bb5db8-fgznv_kubernetes-dashboard(27408590-ef02-4a20-bae0-3fb7ec51405b)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-fgznv_kubernetes-dashboard(27408590-ef02-4a20-bae0-3fb7ec51405b)"
	W0729 21:09:22.764101  345638 logs.go:138] Found kubelet problem: Jul 29 21:07:25 old-k8s-version-884192 kubelet[665]: E0729 21:07:25.878905     665 pod_workers.go:191] Error syncing pod 0ffc056a-4cb7-448c-b912-bdc28b63e564 ("metrics-server-9975d5f86-b5bqk_kube-system(0ffc056a-4cb7-448c-b912-bdc28b63e564)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W0729 21:09:22.764731  345638 logs.go:138] Found kubelet problem: Jul 29 21:07:34 old-k8s-version-884192 kubelet[665]: E0729 21:07:34.179025     665 pod_workers.go:191] Error syncing pod 27408590-ef02-4a20-bae0-3fb7ec51405b ("dashboard-metrics-scraper-8d5bb5db8-fgznv_kubernetes-dashboard(27408590-ef02-4a20-bae0-3fb7ec51405b)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-fgznv_kubernetes-dashboard(27408590-ef02-4a20-bae0-3fb7ec51405b)"
	W0729 21:09:22.765078  345638 logs.go:138] Found kubelet problem: Jul 29 21:07:35 old-k8s-version-884192 kubelet[665]: E0729 21:07:35.253515     665 pod_workers.go:191] Error syncing pod 27408590-ef02-4a20-bae0-3fb7ec51405b ("dashboard-metrics-scraper-8d5bb5db8-fgznv_kubernetes-dashboard(27408590-ef02-4a20-bae0-3fb7ec51405b)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-fgznv_kubernetes-dashboard(27408590-ef02-4a20-bae0-3fb7ec51405b)"
	W0729 21:09:22.765273  345638 logs.go:138] Found kubelet problem: Jul 29 21:07:36 old-k8s-version-884192 kubelet[665]: E0729 21:07:36.878974     665 pod_workers.go:191] Error syncing pod 0ffc056a-4cb7-448c-b912-bdc28b63e564 ("metrics-server-9975d5f86-b5bqk_kube-system(0ffc056a-4cb7-448c-b912-bdc28b63e564)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W0729 21:09:22.765463  345638 logs.go:138] Found kubelet problem: Jul 29 21:07:47 old-k8s-version-884192 kubelet[665]: E0729 21:07:47.879029     665 pod_workers.go:191] Error syncing pod 0ffc056a-4cb7-448c-b912-bdc28b63e564 ("metrics-server-9975d5f86-b5bqk_kube-system(0ffc056a-4cb7-448c-b912-bdc28b63e564)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W0729 21:09:22.765799  345638 logs.go:138] Found kubelet problem: Jul 29 21:07:49 old-k8s-version-884192 kubelet[665]: E0729 21:07:49.878579     665 pod_workers.go:191] Error syncing pod 27408590-ef02-4a20-bae0-3fb7ec51405b ("dashboard-metrics-scraper-8d5bb5db8-fgznv_kubernetes-dashboard(27408590-ef02-4a20-bae0-3fb7ec51405b)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-fgznv_kubernetes-dashboard(27408590-ef02-4a20-bae0-3fb7ec51405b)"
	W0729 21:09:22.765996  345638 logs.go:138] Found kubelet problem: Jul 29 21:07:58 old-k8s-version-884192 kubelet[665]: E0729 21:07:58.879261     665 pod_workers.go:191] Error syncing pod 0ffc056a-4cb7-448c-b912-bdc28b63e564 ("metrics-server-9975d5f86-b5bqk_kube-system(0ffc056a-4cb7-448c-b912-bdc28b63e564)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W0729 21:09:22.766338  345638 logs.go:138] Found kubelet problem: Jul 29 21:08:00 old-k8s-version-884192 kubelet[665]: E0729 21:08:00.878649     665 pod_workers.go:191] Error syncing pod 27408590-ef02-4a20-bae0-3fb7ec51405b ("dashboard-metrics-scraper-8d5bb5db8-fgznv_kubernetes-dashboard(27408590-ef02-4a20-bae0-3fb7ec51405b)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-fgznv_kubernetes-dashboard(27408590-ef02-4a20-bae0-3fb7ec51405b)"
	W0729 21:09:22.766544  345638 logs.go:138] Found kubelet problem: Jul 29 21:08:09 old-k8s-version-884192 kubelet[665]: E0729 21:08:09.879004     665 pod_workers.go:191] Error syncing pod 0ffc056a-4cb7-448c-b912-bdc28b63e564 ("metrics-server-9975d5f86-b5bqk_kube-system(0ffc056a-4cb7-448c-b912-bdc28b63e564)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W0729 21:09:22.766883  345638 logs.go:138] Found kubelet problem: Jul 29 21:08:15 old-k8s-version-884192 kubelet[665]: E0729 21:08:15.878557     665 pod_workers.go:191] Error syncing pod 27408590-ef02-4a20-bae0-3fb7ec51405b ("dashboard-metrics-scraper-8d5bb5db8-fgznv_kubernetes-dashboard(27408590-ef02-4a20-bae0-3fb7ec51405b)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-fgznv_kubernetes-dashboard(27408590-ef02-4a20-bae0-3fb7ec51405b)"
	W0729 21:09:22.767086  345638 logs.go:138] Found kubelet problem: Jul 29 21:08:24 old-k8s-version-884192 kubelet[665]: E0729 21:08:24.879141     665 pod_workers.go:191] Error syncing pod 0ffc056a-4cb7-448c-b912-bdc28b63e564 ("metrics-server-9975d5f86-b5bqk_kube-system(0ffc056a-4cb7-448c-b912-bdc28b63e564)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W0729 21:09:22.767426  345638 logs.go:138] Found kubelet problem: Jul 29 21:08:29 old-k8s-version-884192 kubelet[665]: E0729 21:08:29.878560     665 pod_workers.go:191] Error syncing pod 27408590-ef02-4a20-bae0-3fb7ec51405b ("dashboard-metrics-scraper-8d5bb5db8-fgznv_kubernetes-dashboard(27408590-ef02-4a20-bae0-3fb7ec51405b)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-fgznv_kubernetes-dashboard(27408590-ef02-4a20-bae0-3fb7ec51405b)"
	W0729 21:09:22.767617  345638 logs.go:138] Found kubelet problem: Jul 29 21:08:39 old-k8s-version-884192 kubelet[665]: E0729 21:08:39.879359     665 pod_workers.go:191] Error syncing pod 0ffc056a-4cb7-448c-b912-bdc28b63e564 ("metrics-server-9975d5f86-b5bqk_kube-system(0ffc056a-4cb7-448c-b912-bdc28b63e564)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W0729 21:09:22.767966  345638 logs.go:138] Found kubelet problem: Jul 29 21:08:41 old-k8s-version-884192 kubelet[665]: E0729 21:08:41.878632     665 pod_workers.go:191] Error syncing pod 27408590-ef02-4a20-bae0-3fb7ec51405b ("dashboard-metrics-scraper-8d5bb5db8-fgznv_kubernetes-dashboard(27408590-ef02-4a20-bae0-3fb7ec51405b)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-fgznv_kubernetes-dashboard(27408590-ef02-4a20-bae0-3fb7ec51405b)"
	W0729 21:09:22.768302  345638 logs.go:138] Found kubelet problem: Jul 29 21:08:52 old-k8s-version-884192 kubelet[665]: E0729 21:08:52.878623     665 pod_workers.go:191] Error syncing pod 27408590-ef02-4a20-bae0-3fb7ec51405b ("dashboard-metrics-scraper-8d5bb5db8-fgznv_kubernetes-dashboard(27408590-ef02-4a20-bae0-3fb7ec51405b)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-fgznv_kubernetes-dashboard(27408590-ef02-4a20-bae0-3fb7ec51405b)"
	W0729 21:09:22.768491  345638 logs.go:138] Found kubelet problem: Jul 29 21:08:54 old-k8s-version-884192 kubelet[665]: E0729 21:08:54.878991     665 pod_workers.go:191] Error syncing pod 0ffc056a-4cb7-448c-b912-bdc28b63e564 ("metrics-server-9975d5f86-b5bqk_kube-system(0ffc056a-4cb7-448c-b912-bdc28b63e564)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W0729 21:09:22.768678  345638 logs.go:138] Found kubelet problem: Jul 29 21:09:05 old-k8s-version-884192 kubelet[665]: E0729 21:09:05.879120     665 pod_workers.go:191] Error syncing pod 0ffc056a-4cb7-448c-b912-bdc28b63e564 ("metrics-server-9975d5f86-b5bqk_kube-system(0ffc056a-4cb7-448c-b912-bdc28b63e564)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W0729 21:09:22.769019  345638 logs.go:138] Found kubelet problem: Jul 29 21:09:07 old-k8s-version-884192 kubelet[665]: E0729 21:09:07.878565     665 pod_workers.go:191] Error syncing pod 27408590-ef02-4a20-bae0-3fb7ec51405b ("dashboard-metrics-scraper-8d5bb5db8-fgznv_kubernetes-dashboard(27408590-ef02-4a20-bae0-3fb7ec51405b)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-fgznv_kubernetes-dashboard(27408590-ef02-4a20-bae0-3fb7ec51405b)"
	W0729 21:09:22.769354  345638 logs.go:138] Found kubelet problem: Jul 29 21:09:18 old-k8s-version-884192 kubelet[665]: E0729 21:09:18.879147     665 pod_workers.go:191] Error syncing pod 27408590-ef02-4a20-bae0-3fb7ec51405b ("dashboard-metrics-scraper-8d5bb5db8-fgznv_kubernetes-dashboard(27408590-ef02-4a20-bae0-3fb7ec51405b)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-fgznv_kubernetes-dashboard(27408590-ef02-4a20-bae0-3fb7ec51405b)"
	W0729 21:09:22.769544  345638 logs.go:138] Found kubelet problem: Jul 29 21:09:19 old-k8s-version-884192 kubelet[665]: E0729 21:09:19.879053     665 pod_workers.go:191] Error syncing pod 0ffc056a-4cb7-448c-b912-bdc28b63e564 ("metrics-server-9975d5f86-b5bqk_kube-system(0ffc056a-4cb7-448c-b912-bdc28b63e564)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	I0729 21:09:22.769555  345638 logs.go:123] Gathering logs for describe nodes ...
	I0729 21:09:22.769568  345638 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
	I0729 21:09:22.933547  345638 logs.go:123] Gathering logs for kube-apiserver [2b5706f43ae84ffb4c99184b43a6db1890019aa8c76fdb92fdf6129a64fe28fb] ...
	I0729 21:09:22.933579  345638 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 2b5706f43ae84ffb4c99184b43a6db1890019aa8c76fdb92fdf6129a64fe28fb"
	I0729 21:09:23.003441  345638 logs.go:123] Gathering logs for kindnet [fbbee29f2c588ded9a605a091aba1140ebd1f5d629d5ce39dd1c983e14798d82] ...
	I0729 21:09:23.003490  345638 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 fbbee29f2c588ded9a605a091aba1140ebd1f5d629d5ce39dd1c983e14798d82"
	I0729 21:09:23.066552  345638 logs.go:123] Gathering logs for container status ...
	I0729 21:09:23.066588  345638 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
	I0729 21:09:23.129469  345638 out.go:304] Setting ErrFile to fd 2...
	I0729 21:09:23.129502  345638 out.go:338] TERM=,COLORTERM=, which probably does not support color
	W0729 21:09:23.129564  345638 out.go:239] X Problems detected in kubelet:
	X Problems detected in kubelet:
	W0729 21:09:23.129579  345638 out.go:239]   Jul 29 21:08:54 old-k8s-version-884192 kubelet[665]: E0729 21:08:54.878991     665 pod_workers.go:191] Error syncing pod 0ffc056a-4cb7-448c-b912-bdc28b63e564 ("metrics-server-9975d5f86-b5bqk_kube-system(0ffc056a-4cb7-448c-b912-bdc28b63e564)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	  Jul 29 21:08:54 old-k8s-version-884192 kubelet[665]: E0729 21:08:54.878991     665 pod_workers.go:191] Error syncing pod 0ffc056a-4cb7-448c-b912-bdc28b63e564 ("metrics-server-9975d5f86-b5bqk_kube-system(0ffc056a-4cb7-448c-b912-bdc28b63e564)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W0729 21:09:23.129590  345638 out.go:239]   Jul 29 21:09:05 old-k8s-version-884192 kubelet[665]: E0729 21:09:05.879120     665 pod_workers.go:191] Error syncing pod 0ffc056a-4cb7-448c-b912-bdc28b63e564 ("metrics-server-9975d5f86-b5bqk_kube-system(0ffc056a-4cb7-448c-b912-bdc28b63e564)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	  Jul 29 21:09:05 old-k8s-version-884192 kubelet[665]: E0729 21:09:05.879120     665 pod_workers.go:191] Error syncing pod 0ffc056a-4cb7-448c-b912-bdc28b63e564 ("metrics-server-9975d5f86-b5bqk_kube-system(0ffc056a-4cb7-448c-b912-bdc28b63e564)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W0729 21:09:23.129605  345638 out.go:239]   Jul 29 21:09:07 old-k8s-version-884192 kubelet[665]: E0729 21:09:07.878565     665 pod_workers.go:191] Error syncing pod 27408590-ef02-4a20-bae0-3fb7ec51405b ("dashboard-metrics-scraper-8d5bb5db8-fgznv_kubernetes-dashboard(27408590-ef02-4a20-bae0-3fb7ec51405b)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-fgznv_kubernetes-dashboard(27408590-ef02-4a20-bae0-3fb7ec51405b)"
	  Jul 29 21:09:07 old-k8s-version-884192 kubelet[665]: E0729 21:09:07.878565     665 pod_workers.go:191] Error syncing pod 27408590-ef02-4a20-bae0-3fb7ec51405b ("dashboard-metrics-scraper-8d5bb5db8-fgznv_kubernetes-dashboard(27408590-ef02-4a20-bae0-3fb7ec51405b)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-fgznv_kubernetes-dashboard(27408590-ef02-4a20-bae0-3fb7ec51405b)"
	W0729 21:09:23.129614  345638 out.go:239]   Jul 29 21:09:18 old-k8s-version-884192 kubelet[665]: E0729 21:09:18.879147     665 pod_workers.go:191] Error syncing pod 27408590-ef02-4a20-bae0-3fb7ec51405b ("dashboard-metrics-scraper-8d5bb5db8-fgznv_kubernetes-dashboard(27408590-ef02-4a20-bae0-3fb7ec51405b)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-fgznv_kubernetes-dashboard(27408590-ef02-4a20-bae0-3fb7ec51405b)"
	  Jul 29 21:09:18 old-k8s-version-884192 kubelet[665]: E0729 21:09:18.879147     665 pod_workers.go:191] Error syncing pod 27408590-ef02-4a20-bae0-3fb7ec51405b ("dashboard-metrics-scraper-8d5bb5db8-fgznv_kubernetes-dashboard(27408590-ef02-4a20-bae0-3fb7ec51405b)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-fgznv_kubernetes-dashboard(27408590-ef02-4a20-bae0-3fb7ec51405b)"
	W0729 21:09:23.129621  345638 out.go:239]   Jul 29 21:09:19 old-k8s-version-884192 kubelet[665]: E0729 21:09:19.879053     665 pod_workers.go:191] Error syncing pod 0ffc056a-4cb7-448c-b912-bdc28b63e564 ("metrics-server-9975d5f86-b5bqk_kube-system(0ffc056a-4cb7-448c-b912-bdc28b63e564)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	  Jul 29 21:09:19 old-k8s-version-884192 kubelet[665]: E0729 21:09:19.879053     665 pod_workers.go:191] Error syncing pod 0ffc056a-4cb7-448c-b912-bdc28b63e564 ("metrics-server-9975d5f86-b5bqk_kube-system(0ffc056a-4cb7-448c-b912-bdc28b63e564)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	I0729 21:09:23.129636  345638 out.go:304] Setting ErrFile to fd 2...
	I0729 21:09:23.129642  345638 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0729 21:09:33.131515  345638 api_server.go:253] Checking apiserver healthz at https://192.168.76.2:8443/healthz ...
	I0729 21:09:33.150952  345638 api_server.go:279] https://192.168.76.2:8443/healthz returned 200:
	ok
	I0729 21:09:33.153570  345638 out.go:177] 
	W0729 21:09:33.155428  345638 out.go:239] X Exiting due to K8S_UNHEALTHY_CONTROL_PLANE: wait 6m0s for node: wait for healthy API server: controlPlane never updated to v1.20.0
	X Exiting due to K8S_UNHEALTHY_CONTROL_PLANE: wait 6m0s for node: wait for healthy API server: controlPlane never updated to v1.20.0
	W0729 21:09:33.155593  345638 out.go:239] * Suggestion: Control Plane could not update, try minikube delete --all --purge
	* Suggestion: Control Plane could not update, try minikube delete --all --purge
	W0729 21:09:33.155666  345638 out.go:239] * Related issue: https://github.com/kubernetes/minikube/issues/11417
	* Related issue: https://github.com/kubernetes/minikube/issues/11417
	W0729 21:09:33.155732  345638 out.go:239] * 
	* 
	W0729 21:09:33.156702  345638 out.go:239] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                             │
	│    * If the above advice does not help, please let us know:                                 │
	│      https://github.com/kubernetes/minikube/issues/new/choose                               │
	│                                                                                             │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │
	│                                                                                             │
	╰─────────────────────────────────────────────────────────────────────────────────────────────╯
	╭─────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                             │
	│    * If the above advice does not help, please let us know:                                 │
	│      https://github.com/kubernetes/minikube/issues/new/choose                               │
	│                                                                                             │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │
	│                                                                                             │
	╰─────────────────────────────────────────────────────────────────────────────────────────────╯
	I0729 21:09:33.159127  345638 out.go:177] 

                                                
                                                
** /stderr **
start_stop_delete_test.go:259: failed to start minikube post-stop. args "out/minikube-linux-arm64 start -p old-k8s-version-884192 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=docker  --container-runtime=containerd --kubernetes-version=v1.20.0": exit status 102
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:230: ======>  post-mortem[TestStartStop/group/old-k8s-version/serial/SecondStart]: docker inspect <======
helpers_test.go:231: (dbg) Run:  docker inspect old-k8s-version-884192
helpers_test.go:235: (dbg) docker inspect old-k8s-version-884192:

                                                
                                                
-- stdout --
	[
	    {
	        "Id": "8eb1dbb78c860d29ab45b0777b34c5a8c5b1eab4506da2e77eaf655117169fc8",
	        "Created": "2024-07-29T21:00:51.654329524Z",
	        "Path": "/usr/local/bin/entrypoint",
	        "Args": [
	            "/sbin/init"
	        ],
	        "State": {
	            "Status": "running",
	            "Running": true,
	            "Paused": false,
	            "Restarting": false,
	            "OOMKilled": false,
	            "Dead": false,
	            "Pid": 345882,
	            "ExitCode": 0,
	            "Error": "",
	            "StartedAt": "2024-07-29T21:03:23.507053443Z",
	            "FinishedAt": "2024-07-29T21:03:22.256784871Z"
	        },
	        "Image": "sha256:2cd84ab2172023a68162f38a55db46353562cea41552fd8e8bdec97b31b2c495",
	        "ResolvConfPath": "/var/lib/docker/containers/8eb1dbb78c860d29ab45b0777b34c5a8c5b1eab4506da2e77eaf655117169fc8/resolv.conf",
	        "HostnamePath": "/var/lib/docker/containers/8eb1dbb78c860d29ab45b0777b34c5a8c5b1eab4506da2e77eaf655117169fc8/hostname",
	        "HostsPath": "/var/lib/docker/containers/8eb1dbb78c860d29ab45b0777b34c5a8c5b1eab4506da2e77eaf655117169fc8/hosts",
	        "LogPath": "/var/lib/docker/containers/8eb1dbb78c860d29ab45b0777b34c5a8c5b1eab4506da2e77eaf655117169fc8/8eb1dbb78c860d29ab45b0777b34c5a8c5b1eab4506da2e77eaf655117169fc8-json.log",
	        "Name": "/old-k8s-version-884192",
	        "RestartCount": 0,
	        "Driver": "overlay2",
	        "Platform": "linux",
	        "MountLabel": "",
	        "ProcessLabel": "",
	        "AppArmorProfile": "unconfined",
	        "ExecIDs": null,
	        "HostConfig": {
	            "Binds": [
	                "/lib/modules:/lib/modules:ro",
	                "old-k8s-version-884192:/var"
	            ],
	            "ContainerIDFile": "",
	            "LogConfig": {
	                "Type": "json-file",
	                "Config": {}
	            },
	            "NetworkMode": "old-k8s-version-884192",
	            "PortBindings": {
	                "22/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": ""
	                    }
	                ],
	                "2376/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": ""
	                    }
	                ],
	                "32443/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": ""
	                    }
	                ],
	                "5000/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": ""
	                    }
	                ],
	                "8443/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": ""
	                    }
	                ]
	            },
	            "RestartPolicy": {
	                "Name": "no",
	                "MaximumRetryCount": 0
	            },
	            "AutoRemove": false,
	            "VolumeDriver": "",
	            "VolumesFrom": null,
	            "ConsoleSize": [
	                0,
	                0
	            ],
	            "CapAdd": null,
	            "CapDrop": null,
	            "CgroupnsMode": "host",
	            "Dns": [],
	            "DnsOptions": [],
	            "DnsSearch": [],
	            "ExtraHosts": null,
	            "GroupAdd": null,
	            "IpcMode": "private",
	            "Cgroup": "",
	            "Links": null,
	            "OomScoreAdj": 0,
	            "PidMode": "",
	            "Privileged": true,
	            "PublishAllPorts": false,
	            "ReadonlyRootfs": false,
	            "SecurityOpt": [
	                "seccomp=unconfined",
	                "apparmor=unconfined",
	                "label=disable"
	            ],
	            "Tmpfs": {
	                "/run": "",
	                "/tmp": ""
	            },
	            "UTSMode": "",
	            "UsernsMode": "",
	            "ShmSize": 67108864,
	            "Runtime": "runc",
	            "Isolation": "",
	            "CpuShares": 0,
	            "Memory": 2306867200,
	            "NanoCpus": 2000000000,
	            "CgroupParent": "",
	            "BlkioWeight": 0,
	            "BlkioWeightDevice": [],
	            "BlkioDeviceReadBps": [],
	            "BlkioDeviceWriteBps": [],
	            "BlkioDeviceReadIOps": [],
	            "BlkioDeviceWriteIOps": [],
	            "CpuPeriod": 0,
	            "CpuQuota": 0,
	            "CpuRealtimePeriod": 0,
	            "CpuRealtimeRuntime": 0,
	            "CpusetCpus": "",
	            "CpusetMems": "",
	            "Devices": [],
	            "DeviceCgroupRules": null,
	            "DeviceRequests": null,
	            "MemoryReservation": 0,
	            "MemorySwap": 4613734400,
	            "MemorySwappiness": null,
	            "OomKillDisable": false,
	            "PidsLimit": null,
	            "Ulimits": [],
	            "CpuCount": 0,
	            "CpuPercent": 0,
	            "IOMaximumIOps": 0,
	            "IOMaximumBandwidth": 0,
	            "MaskedPaths": null,
	            "ReadonlyPaths": null
	        },
	        "GraphDriver": {
	            "Data": {
	                "LowerDir": "/var/lib/docker/overlay2/6620ca696d9aa4e557e000d7ceaa44f1be1e3082c7e16b2e9a8d29166f27953f-init/diff:/var/lib/docker/overlay2/84384c93b44c85d0a89240736a5f26774082ee345f8159e04443d01c613189a6/diff",
	                "MergedDir": "/var/lib/docker/overlay2/6620ca696d9aa4e557e000d7ceaa44f1be1e3082c7e16b2e9a8d29166f27953f/merged",
	                "UpperDir": "/var/lib/docker/overlay2/6620ca696d9aa4e557e000d7ceaa44f1be1e3082c7e16b2e9a8d29166f27953f/diff",
	                "WorkDir": "/var/lib/docker/overlay2/6620ca696d9aa4e557e000d7ceaa44f1be1e3082c7e16b2e9a8d29166f27953f/work"
	            },
	            "Name": "overlay2"
	        },
	        "Mounts": [
	            {
	                "Type": "bind",
	                "Source": "/lib/modules",
	                "Destination": "/lib/modules",
	                "Mode": "ro",
	                "RW": false,
	                "Propagation": "rprivate"
	            },
	            {
	                "Type": "volume",
	                "Name": "old-k8s-version-884192",
	                "Source": "/var/lib/docker/volumes/old-k8s-version-884192/_data",
	                "Destination": "/var",
	                "Driver": "local",
	                "Mode": "z",
	                "RW": true,
	                "Propagation": ""
	            }
	        ],
	        "Config": {
	            "Hostname": "old-k8s-version-884192",
	            "Domainname": "",
	            "User": "",
	            "AttachStdin": false,
	            "AttachStdout": false,
	            "AttachStderr": false,
	            "ExposedPorts": {
	                "22/tcp": {},
	                "2376/tcp": {},
	                "32443/tcp": {},
	                "5000/tcp": {},
	                "8443/tcp": {}
	            },
	            "Tty": true,
	            "OpenStdin": false,
	            "StdinOnce": false,
	            "Env": [
	                "container=docker",
	                "PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin"
	            ],
	            "Cmd": null,
	            "Image": "gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721902582-19326@sha256:540fb5dc7f38be17ff5276a38dfe6c8a4b1d9ba1c27c62244e6eebd7e37696e7",
	            "Volumes": null,
	            "WorkingDir": "/",
	            "Entrypoint": [
	                "/usr/local/bin/entrypoint",
	                "/sbin/init"
	            ],
	            "OnBuild": null,
	            "Labels": {
	                "created_by.minikube.sigs.k8s.io": "true",
	                "mode.minikube.sigs.k8s.io": "old-k8s-version-884192",
	                "name.minikube.sigs.k8s.io": "old-k8s-version-884192",
	                "role.minikube.sigs.k8s.io": ""
	            },
	            "StopSignal": "SIGRTMIN+3"
	        },
	        "NetworkSettings": {
	            "Bridge": "",
	            "SandboxID": "ad2b29335908660ea239af74c0881e6363ec39481e388b3b30013544a3255213",
	            "SandboxKey": "/var/run/docker/netns/ad2b29335908",
	            "Ports": {
	                "22/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": "37330"
	                    }
	                ],
	                "2376/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": "37331"
	                    }
	                ],
	                "32443/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": "37334"
	                    }
	                ],
	                "5000/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": "37332"
	                    }
	                ],
	                "8443/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": "37333"
	                    }
	                ]
	            },
	            "HairpinMode": false,
	            "LinkLocalIPv6Address": "",
	            "LinkLocalIPv6PrefixLen": 0,
	            "SecondaryIPAddresses": null,
	            "SecondaryIPv6Addresses": null,
	            "EndpointID": "",
	            "Gateway": "",
	            "GlobalIPv6Address": "",
	            "GlobalIPv6PrefixLen": 0,
	            "IPAddress": "",
	            "IPPrefixLen": 0,
	            "IPv6Gateway": "",
	            "MacAddress": "",
	            "Networks": {
	                "old-k8s-version-884192": {
	                    "IPAMConfig": {
	                        "IPv4Address": "192.168.76.2"
	                    },
	                    "Links": null,
	                    "Aliases": null,
	                    "MacAddress": "02:42:c0:a8:4c:02",
	                    "DriverOpts": null,
	                    "NetworkID": "c359a82e5cd05bcc1b5258598b641d14526d29c4896824d3675689903e620d67",
	                    "EndpointID": "99f51c39daa0050e128a4f0d05d48822a3c55cf44e257448004750f79155a476",
	                    "Gateway": "192.168.76.1",
	                    "IPAddress": "192.168.76.2",
	                    "IPPrefixLen": 24,
	                    "IPv6Gateway": "",
	                    "GlobalIPv6Address": "",
	                    "GlobalIPv6PrefixLen": 0,
	                    "DNSNames": [
	                        "old-k8s-version-884192",
	                        "8eb1dbb78c86"
	                    ]
	                }
	            }
	        }
	    }
	]

                                                
                                                
-- /stdout --
helpers_test.go:239: (dbg) Run:  out/minikube-linux-arm64 status --format={{.Host}} -p old-k8s-version-884192 -n old-k8s-version-884192
helpers_test.go:244: <<< TestStartStop/group/old-k8s-version/serial/SecondStart FAILED: start of post-mortem logs <<<
helpers_test.go:245: ======>  post-mortem[TestStartStop/group/old-k8s-version/serial/SecondStart]: minikube logs <======
helpers_test.go:247: (dbg) Run:  out/minikube-linux-arm64 -p old-k8s-version-884192 logs -n 25
helpers_test.go:247: (dbg) Done: out/minikube-linux-arm64 -p old-k8s-version-884192 logs -n 25: (2.695458012s)
helpers_test.go:252: TestStartStop/group/old-k8s-version/serial/SecondStart logs: 
-- stdout --
	
	==> Audit <==
	|---------|--------------------------------------------------------|--------------------------|---------|---------|---------------------|---------------------|
	| Command |                          Args                          |         Profile          |  User   | Version |     Start Time      |      End Time       |
	|---------|--------------------------------------------------------|--------------------------|---------|---------|---------------------|---------------------|
	| start   | -p cert-expiration-457758                              | cert-expiration-457758   | jenkins | v1.33.1 | 29 Jul 24 20:59 UTC | 29 Jul 24 21:00 UTC |
	|         | --memory=2048                                          |                          |         |         |                     |                     |
	|         | --cert-expiration=3m                                   |                          |         |         |                     |                     |
	|         | --driver=docker                                        |                          |         |         |                     |                     |
	|         | --container-runtime=containerd                         |                          |         |         |                     |                     |
	| ssh     | force-systemd-env-888896                               | force-systemd-env-888896 | jenkins | v1.33.1 | 29 Jul 24 21:00 UTC | 29 Jul 24 21:00 UTC |
	|         | ssh cat                                                |                          |         |         |                     |                     |
	|         | /etc/containerd/config.toml                            |                          |         |         |                     |                     |
	| delete  | -p force-systemd-env-888896                            | force-systemd-env-888896 | jenkins | v1.33.1 | 29 Jul 24 21:00 UTC | 29 Jul 24 21:00 UTC |
	| start   | -p cert-options-291015                                 | cert-options-291015      | jenkins | v1.33.1 | 29 Jul 24 21:00 UTC | 29 Jul 24 21:00 UTC |
	|         | --memory=2048                                          |                          |         |         |                     |                     |
	|         | --apiserver-ips=127.0.0.1                              |                          |         |         |                     |                     |
	|         | --apiserver-ips=192.168.15.15                          |                          |         |         |                     |                     |
	|         | --apiserver-names=localhost                            |                          |         |         |                     |                     |
	|         | --apiserver-names=www.google.com                       |                          |         |         |                     |                     |
	|         | --apiserver-port=8555                                  |                          |         |         |                     |                     |
	|         | --driver=docker                                        |                          |         |         |                     |                     |
	|         | --container-runtime=containerd                         |                          |         |         |                     |                     |
	| ssh     | cert-options-291015 ssh                                | cert-options-291015      | jenkins | v1.33.1 | 29 Jul 24 21:00 UTC | 29 Jul 24 21:00 UTC |
	|         | openssl x509 -text -noout -in                          |                          |         |         |                     |                     |
	|         | /var/lib/minikube/certs/apiserver.crt                  |                          |         |         |                     |                     |
	| ssh     | -p cert-options-291015 -- sudo                         | cert-options-291015      | jenkins | v1.33.1 | 29 Jul 24 21:00 UTC | 29 Jul 24 21:00 UTC |
	|         | cat /etc/kubernetes/admin.conf                         |                          |         |         |                     |                     |
	| delete  | -p cert-options-291015                                 | cert-options-291015      | jenkins | v1.33.1 | 29 Jul 24 21:00 UTC | 29 Jul 24 21:00 UTC |
	| start   | -p old-k8s-version-884192                              | old-k8s-version-884192   | jenkins | v1.33.1 | 29 Jul 24 21:00 UTC | 29 Jul 24 21:02 UTC |
	|         | --memory=2200                                          |                          |         |         |                     |                     |
	|         | --alsologtostderr --wait=true                          |                          |         |         |                     |                     |
	|         | --kvm-network=default                                  |                          |         |         |                     |                     |
	|         | --kvm-qemu-uri=qemu:///system                          |                          |         |         |                     |                     |
	|         | --disable-driver-mounts                                |                          |         |         |                     |                     |
	|         | --keep-context=false                                   |                          |         |         |                     |                     |
	|         | --driver=docker                                        |                          |         |         |                     |                     |
	|         | --container-runtime=containerd                         |                          |         |         |                     |                     |
	|         | --kubernetes-version=v1.20.0                           |                          |         |         |                     |                     |
	| start   | -p cert-expiration-457758                              | cert-expiration-457758   | jenkins | v1.33.1 | 29 Jul 24 21:03 UTC | 29 Jul 24 21:03 UTC |
	|         | --memory=2048                                          |                          |         |         |                     |                     |
	|         | --cert-expiration=8760h                                |                          |         |         |                     |                     |
	|         | --driver=docker                                        |                          |         |         |                     |                     |
	|         | --container-runtime=containerd                         |                          |         |         |                     |                     |
	| addons  | enable metrics-server -p old-k8s-version-884192        | old-k8s-version-884192   | jenkins | v1.33.1 | 29 Jul 24 21:03 UTC | 29 Jul 24 21:03 UTC |
	|         | --images=MetricsServer=registry.k8s.io/echoserver:1.4  |                          |         |         |                     |                     |
	|         | --registries=MetricsServer=fake.domain                 |                          |         |         |                     |                     |
	| stop    | -p old-k8s-version-884192                              | old-k8s-version-884192   | jenkins | v1.33.1 | 29 Jul 24 21:03 UTC | 29 Jul 24 21:03 UTC |
	|         | --alsologtostderr -v=3                                 |                          |         |         |                     |                     |
	| delete  | -p cert-expiration-457758                              | cert-expiration-457758   | jenkins | v1.33.1 | 29 Jul 24 21:03 UTC | 29 Jul 24 21:03 UTC |
	| start   | -p no-preload-992167 --memory=2200                     | no-preload-992167        | jenkins | v1.33.1 | 29 Jul 24 21:03 UTC | 29 Jul 24 21:04 UTC |
	|         | --alsologtostderr --wait=true                          |                          |         |         |                     |                     |
	|         | --preload=false --driver=docker                        |                          |         |         |                     |                     |
	|         |  --container-runtime=containerd                        |                          |         |         |                     |                     |
	|         | --kubernetes-version=v1.31.0-beta.0                    |                          |         |         |                     |                     |
	| addons  | enable dashboard -p old-k8s-version-884192             | old-k8s-version-884192   | jenkins | v1.33.1 | 29 Jul 24 21:03 UTC | 29 Jul 24 21:03 UTC |
	|         | --images=MetricsScraper=registry.k8s.io/echoserver:1.4 |                          |         |         |                     |                     |
	| start   | -p old-k8s-version-884192                              | old-k8s-version-884192   | jenkins | v1.33.1 | 29 Jul 24 21:03 UTC |                     |
	|         | --memory=2200                                          |                          |         |         |                     |                     |
	|         | --alsologtostderr --wait=true                          |                          |         |         |                     |                     |
	|         | --kvm-network=default                                  |                          |         |         |                     |                     |
	|         | --kvm-qemu-uri=qemu:///system                          |                          |         |         |                     |                     |
	|         | --disable-driver-mounts                                |                          |         |         |                     |                     |
	|         | --keep-context=false                                   |                          |         |         |                     |                     |
	|         | --driver=docker                                        |                          |         |         |                     |                     |
	|         | --container-runtime=containerd                         |                          |         |         |                     |                     |
	|         | --kubernetes-version=v1.20.0                           |                          |         |         |                     |                     |
	| addons  | enable metrics-server -p no-preload-992167             | no-preload-992167        | jenkins | v1.33.1 | 29 Jul 24 21:04 UTC | 29 Jul 24 21:04 UTC |
	|         | --images=MetricsServer=registry.k8s.io/echoserver:1.4  |                          |         |         |                     |                     |
	|         | --registries=MetricsServer=fake.domain                 |                          |         |         |                     |                     |
	| stop    | -p no-preload-992167                                   | no-preload-992167        | jenkins | v1.33.1 | 29 Jul 24 21:04 UTC | 29 Jul 24 21:04 UTC |
	|         | --alsologtostderr -v=3                                 |                          |         |         |                     |                     |
	| addons  | enable dashboard -p no-preload-992167                  | no-preload-992167        | jenkins | v1.33.1 | 29 Jul 24 21:04 UTC | 29 Jul 24 21:04 UTC |
	|         | --images=MetricsScraper=registry.k8s.io/echoserver:1.4 |                          |         |         |                     |                     |
	| start   | -p no-preload-992167 --memory=2200                     | no-preload-992167        | jenkins | v1.33.1 | 29 Jul 24 21:04 UTC | 29 Jul 24 21:09 UTC |
	|         | --alsologtostderr --wait=true                          |                          |         |         |                     |                     |
	|         | --preload=false --driver=docker                        |                          |         |         |                     |                     |
	|         |  --container-runtime=containerd                        |                          |         |         |                     |                     |
	|         | --kubernetes-version=v1.31.0-beta.0                    |                          |         |         |                     |                     |
	| image   | no-preload-992167 image list                           | no-preload-992167        | jenkins | v1.33.1 | 29 Jul 24 21:09 UTC | 29 Jul 24 21:09 UTC |
	|         | --format=json                                          |                          |         |         |                     |                     |
	| pause   | -p no-preload-992167                                   | no-preload-992167        | jenkins | v1.33.1 | 29 Jul 24 21:09 UTC | 29 Jul 24 21:09 UTC |
	|         | --alsologtostderr -v=1                                 |                          |         |         |                     |                     |
	| unpause | -p no-preload-992167                                   | no-preload-992167        | jenkins | v1.33.1 | 29 Jul 24 21:09 UTC | 29 Jul 24 21:09 UTC |
	|         | --alsologtostderr -v=1                                 |                          |         |         |                     |                     |
	| delete  | -p no-preload-992167                                   | no-preload-992167        | jenkins | v1.33.1 | 29 Jul 24 21:09 UTC | 29 Jul 24 21:09 UTC |
	| delete  | -p no-preload-992167                                   | no-preload-992167        | jenkins | v1.33.1 | 29 Jul 24 21:09 UTC | 29 Jul 24 21:09 UTC |
	| start   | -p embed-certs-159530                                  | embed-certs-159530       | jenkins | v1.33.1 | 29 Jul 24 21:09 UTC |                     |
	|         | --memory=2200                                          |                          |         |         |                     |                     |
	|         | --alsologtostderr --wait=true                          |                          |         |         |                     |                     |
	|         | --embed-certs --driver=docker                          |                          |         |         |                     |                     |
	|         | --container-runtime=containerd                         |                          |         |         |                     |                     |
	|         | --kubernetes-version=v1.30.3                           |                          |         |         |                     |                     |
	|---------|--------------------------------------------------------|--------------------------|---------|---------|---------------------|---------------------|
	
	
	==> Last Start <==
	Log file created at: 2024/07/29 21:09:31
	Running on machine: ip-172-31-29-130
	Binary: Built with gc go1.22.5 for linux/arm64
	Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg
	I0729 21:09:31.771468  357284 out.go:291] Setting OutFile to fd 1 ...
	I0729 21:09:31.771606  357284 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0729 21:09:31.771618  357284 out.go:304] Setting ErrFile to fd 2...
	I0729 21:09:31.771624  357284 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0729 21:09:31.771872  357284 root.go:338] Updating PATH: /home/jenkins/minikube-integration/19339-134334/.minikube/bin
	I0729 21:09:31.772360  357284 out.go:298] Setting JSON to false
	I0729 21:09:31.773370  357284 start.go:129] hostinfo: {"hostname":"ip-172-31-29-130","uptime":67918,"bootTime":1722219454,"procs":218,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1065-aws","kernelArch":"aarch64","virtualizationSystem":"","virtualizationRole":"","hostId":"36adf542-ef4f-4e2d-a0c8-6868d1383ff9"}
	I0729 21:09:31.773445  357284 start.go:139] virtualization:  
	I0729 21:09:31.776029  357284 out.go:177] * [embed-certs-159530] minikube v1.33.1 on Ubuntu 20.04 (arm64)
	I0729 21:09:31.778349  357284 out.go:177]   - MINIKUBE_LOCATION=19339
	I0729 21:09:31.778514  357284 notify.go:220] Checking for updates...
	I0729 21:09:31.782361  357284 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I0729 21:09:31.784208  357284 out.go:177]   - KUBECONFIG=/home/jenkins/minikube-integration/19339-134334/kubeconfig
	I0729 21:09:31.785790  357284 out.go:177]   - MINIKUBE_HOME=/home/jenkins/minikube-integration/19339-134334/.minikube
	I0729 21:09:31.787556  357284 out.go:177]   - MINIKUBE_BIN=out/minikube-linux-arm64
	I0729 21:09:31.789378  357284 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=
	I0729 21:09:31.791667  357284 config.go:182] Loaded profile config "old-k8s-version-884192": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.20.0
	I0729 21:09:31.791778  357284 driver.go:392] Setting default libvirt URI to qemu:///system
	I0729 21:09:31.816174  357284 docker.go:123] docker version: linux-27.1.1:Docker Engine - Community
	I0729 21:09:31.816305  357284 cli_runner.go:164] Run: docker system info --format "{{json .}}"
	I0729 21:09:31.895020  357284 info.go:266] docker info: {ID:U5VK:ZNT5:35M3:FHLW:Q7TL:ELFX:BNAG:AV4T:UD2H:SK5L:SEJV:SJJL Containers:1 ContainersRunning:1 ContainersPaused:0 ContainersStopped:0 Images:4 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:35 OomKillDisable:true NGoroutines:53 SystemTime:2024-07-29 21:09:31.88365718 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1065-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Architecture:aarc
h64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8214900736 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-29-130 Labels:[] ExperimentalBuild:false ServerVersion:27.1.1 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:2bf793ef6dc9a18e00cb12efb64355c2c9d5eb41 Expected:2bf793ef6dc9a18e00cb12efb64355c2c9d5eb41} RuncCommit:{ID:v1.1.13-0-g58aa920 Expected:v1.1.13-0-g58aa920} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:<nil> ServerError
s:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.16.1] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.29.1]] Warnings:<nil>}}
	I0729 21:09:31.895135  357284 docker.go:307] overlay module found
	I0729 21:09:31.897084  357284 out.go:177] * Using the docker driver based on user configuration
	I0729 21:09:31.898859  357284 start.go:297] selected driver: docker
	I0729 21:09:31.898880  357284 start.go:901] validating driver "docker" against <nil>
	I0729 21:09:31.898901  357284 start.go:912] status for docker: {Installed:true Healthy:true Running:false NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I0729 21:09:31.899557  357284 cli_runner.go:164] Run: docker system info --format "{{json .}}"
	I0729 21:09:31.961910  357284 info.go:266] docker info: {ID:U5VK:ZNT5:35M3:FHLW:Q7TL:ELFX:BNAG:AV4T:UD2H:SK5L:SEJV:SJJL Containers:1 ContainersRunning:1 ContainersPaused:0 ContainersStopped:0 Images:4 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:35 OomKillDisable:true NGoroutines:53 SystemTime:2024-07-29 21:09:31.945175079 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1065-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Architecture:aar
ch64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8214900736 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-29-130 Labels:[] ExperimentalBuild:false ServerVersion:27.1.1 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:2bf793ef6dc9a18e00cb12efb64355c2c9d5eb41 Expected:2bf793ef6dc9a18e00cb12efb64355c2c9d5eb41} RuncCommit:{ID:v1.1.13-0-g58aa920 Expected:v1.1.13-0-g58aa920} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:<nil> ServerErro
rs:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.16.1] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.29.1]] Warnings:<nil>}}
	I0729 21:09:31.962080  357284 start_flags.go:310] no existing cluster config was found, will generate one from the flags 
	I0729 21:09:31.962333  357284 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
	I0729 21:09:31.964909  357284 out.go:177] * Using Docker driver with root privileges
	I0729 21:09:31.966515  357284 cni.go:84] Creating CNI manager for ""
	I0729 21:09:31.966543  357284 cni.go:143] "docker" driver + "containerd" runtime found, recommending kindnet
	I0729 21:09:31.966556  357284 start_flags.go:319] Found "CNI" CNI - setting NetworkPlugin=cni
	I0729 21:09:31.966670  357284 start.go:340] cluster config:
	{Name:embed-certs-159530 KeepContext:false EmbedCerts:true MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721902582-19326@sha256:540fb5dc7f38be17ff5276a38dfe6c8a4b1d9ba1c27c62244e6eebd7e37696e7 Memory:2200 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.30.3 ClusterName:embed-certs-159530 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local Contain
erRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.30.3 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: Stati
cIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I0729 21:09:31.968771  357284 out.go:177] * Starting "embed-certs-159530" primary control-plane node in "embed-certs-159530" cluster
	I0729 21:09:31.970780  357284 cache.go:121] Beginning downloading kic base image for docker with containerd
	I0729 21:09:31.972675  357284 out.go:177] * Pulling base image v0.0.44-1721902582-19326 ...
	I0729 21:09:31.974160  357284 preload.go:131] Checking if preload exists for k8s version v1.30.3 and runtime containerd
	I0729 21:09:31.974171  357284 image.go:79] Checking for gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721902582-19326@sha256:540fb5dc7f38be17ff5276a38dfe6c8a4b1d9ba1c27c62244e6eebd7e37696e7 in local docker daemon
	I0729 21:09:31.974260  357284 preload.go:146] Found local preload: /home/jenkins/minikube-integration/19339-134334/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.30.3-containerd-overlay2-arm64.tar.lz4
	I0729 21:09:31.974288  357284 cache.go:56] Caching tarball of preloaded images
	I0729 21:09:31.974370  357284 preload.go:172] Found /home/jenkins/minikube-integration/19339-134334/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.30.3-containerd-overlay2-arm64.tar.lz4 in cache, skipping download
	I0729 21:09:31.974386  357284 cache.go:59] Finished verifying existence of preloaded tar for v1.30.3 on containerd
	I0729 21:09:31.974491  357284 profile.go:143] Saving config to /home/jenkins/minikube-integration/19339-134334/.minikube/profiles/embed-certs-159530/config.json ...
	I0729 21:09:31.974515  357284 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19339-134334/.minikube/profiles/embed-certs-159530/config.json: {Name:mk41de80d4d1128a1fb8f4fe12713d13fa5e8af3 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	W0729 21:09:31.993891  357284 image.go:95] image gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721902582-19326@sha256:540fb5dc7f38be17ff5276a38dfe6c8a4b1d9ba1c27c62244e6eebd7e37696e7 is of wrong architecture
	I0729 21:09:31.993913  357284 cache.go:149] Downloading gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721902582-19326@sha256:540fb5dc7f38be17ff5276a38dfe6c8a4b1d9ba1c27c62244e6eebd7e37696e7 to local cache
	I0729 21:09:31.993990  357284 image.go:63] Checking for gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721902582-19326@sha256:540fb5dc7f38be17ff5276a38dfe6c8a4b1d9ba1c27c62244e6eebd7e37696e7 in local cache directory
	I0729 21:09:31.994017  357284 image.go:66] Found gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721902582-19326@sha256:540fb5dc7f38be17ff5276a38dfe6c8a4b1d9ba1c27c62244e6eebd7e37696e7 in local cache directory, skipping pull
	I0729 21:09:31.994026  357284 image.go:135] gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721902582-19326@sha256:540fb5dc7f38be17ff5276a38dfe6c8a4b1d9ba1c27c62244e6eebd7e37696e7 exists in cache, skipping pull
	I0729 21:09:31.994035  357284 cache.go:152] successfully saved gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721902582-19326@sha256:540fb5dc7f38be17ff5276a38dfe6c8a4b1d9ba1c27c62244e6eebd7e37696e7 as a tarball
	I0729 21:09:31.994044  357284 cache.go:162] Loading gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721902582-19326@sha256:540fb5dc7f38be17ff5276a38dfe6c8a4b1d9ba1c27c62244e6eebd7e37696e7 from local cache
	I0729 21:09:32.117449  357284 cache.go:164] successfully loaded and using gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721902582-19326@sha256:540fb5dc7f38be17ff5276a38dfe6c8a4b1d9ba1c27c62244e6eebd7e37696e7 from cached tarball
	I0729 21:09:32.117489  357284 cache.go:194] Successfully downloaded all kic artifacts
	I0729 21:09:32.117535  357284 start.go:360] acquireMachinesLock for embed-certs-159530: {Name:mk18791333f70748dc7e93d587d5226c3f7006cc Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0729 21:09:32.118206  357284 start.go:364] duration metric: took 641.674µs to acquireMachinesLock for "embed-certs-159530"
	I0729 21:09:32.118248  357284 start.go:93] Provisioning new machine with config: &{Name:embed-certs-159530 KeepContext:false EmbedCerts:true MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721902582-19326@sha256:540fb5dc7f38be17ff5276a38dfe6c8a4b1d9ba1c27c62244e6eebd7e37696e7 Memory:2200 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.30.3 ClusterName:embed-certs-159530 Namespace:default APIServerHAVIP: APIServe
rName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.30.3 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableM
etrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.30.3 ContainerRuntime:containerd ControlPlane:true Worker:true}
	I0729 21:09:32.118340  357284 start.go:125] createHost starting for "" (driver="docker")
	I0729 21:09:33.131515  345638 api_server.go:253] Checking apiserver healthz at https://192.168.76.2:8443/healthz ...
	I0729 21:09:33.150952  345638 api_server.go:279] https://192.168.76.2:8443/healthz returned 200:
	ok
	I0729 21:09:33.153570  345638 out.go:177] 
	W0729 21:09:33.155428  345638 out.go:239] X Exiting due to K8S_UNHEALTHY_CONTROL_PLANE: wait 6m0s for node: wait for healthy API server: controlPlane never updated to v1.20.0
	W0729 21:09:33.155593  345638 out.go:239] * Suggestion: Control Plane could not update, try minikube delete --all --purge
	W0729 21:09:33.155666  345638 out.go:239] * Related issue: https://github.com/kubernetes/minikube/issues/11417
	W0729 21:09:33.155732  345638 out.go:239] * 
	W0729 21:09:33.156702  345638 out.go:239] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                             │
	│    * If the above advice does not help, please let us know:                                 │
	│      https://github.com/kubernetes/minikube/issues/new/choose                               │
	│                                                                                             │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │
	│                                                                                             │
	╰─────────────────────────────────────────────────────────────────────────────────────────────╯
	I0729 21:09:33.159127  345638 out.go:177] 
	
	
	==> container status <==
	CONTAINER           IMAGE               CREATED             STATE               NAME                        ATTEMPT             POD ID              POD
	551715fdc9241       523cad1a4df73       2 minutes ago       Exited              dashboard-metrics-scraper   5                   706a5fcbe1bc9       dashboard-metrics-scraper-8d5bb5db8-fgznv
	4f8799ba1d8a3       ba04bb24b9575       4 minutes ago       Running             storage-provisioner         2                   a307493b5b2eb       storage-provisioner
	34f4a145168f7       20b332c9a70d8       5 minutes ago       Running             kubernetes-dashboard        0                   2dfafb472d623       kubernetes-dashboard-cd95d586-c7zlw
	e688afd0f4944       ba04bb24b9575       5 minutes ago       Exited              storage-provisioner         1                   a307493b5b2eb       storage-provisioner
	75750dba9bde8       25a5233254979       5 minutes ago       Running             kube-proxy                  1                   0f8af615d67d6       kube-proxy-kp9qr
	4c9c5c5f06999       db91994f4ee8f       5 minutes ago       Running             coredns                     1                   3da27b5606d05       coredns-74ff55c5b-xgldr
	c43af0a50a1dd       1611cd07b61d5       5 minutes ago       Running             busybox                     1                   608e9bbaf995e       busybox
	2e5ae293c129d       f42786f8afd22       5 minutes ago       Running             kindnet-cni                 1                   c7cd6681af3a0       kindnet-dr2zz
	7e3ce8149fba5       1df8a2b116bd1       5 minutes ago       Running             kube-controller-manager     1                   2503590b7c155       kube-controller-manager-old-k8s-version-884192
	9abfa4fc0bdf3       e7605f88f17d6       5 minutes ago       Running             kube-scheduler              1                   a47c3ed6e0265       kube-scheduler-old-k8s-version-884192
	2b5706f43ae84       2c08bbbc02d3a       5 minutes ago       Running             kube-apiserver              1                   1c3e78909e902       kube-apiserver-old-k8s-version-884192
	fdfc2fda8f65b       05b738aa1bc63       5 minutes ago       Running             etcd                        1                   65973a7fedef8       etcd-old-k8s-version-884192
	286de759421a0       1611cd07b61d5       6 minutes ago       Exited              busybox                     0                   f038e55238d23       busybox
	a11607490336d       db91994f4ee8f       7 minutes ago       Exited              coredns                     0                   0d8f85fb8a106       coredns-74ff55c5b-xgldr
	fbbee29f2c588       f42786f8afd22       7 minutes ago       Exited              kindnet-cni                 0                   b9812b15752fd       kindnet-dr2zz
	cc4846179f2a5       25a5233254979       7 minutes ago       Exited              kube-proxy                  0                   1f1d0e57e039b       kube-proxy-kp9qr
	bc0116b218f41       05b738aa1bc63       8 minutes ago       Exited              etcd                        0                   e86af4c7f0742       etcd-old-k8s-version-884192
	6c3b9526f1351       1df8a2b116bd1       8 minutes ago       Exited              kube-controller-manager     0                   ecf885bc13f39       kube-controller-manager-old-k8s-version-884192
	efa095c66551b       e7605f88f17d6       8 minutes ago       Exited              kube-scheduler              0                   dc12180584cbb       kube-scheduler-old-k8s-version-884192
	75e8e58f6b60c       2c08bbbc02d3a       8 minutes ago       Exited              kube-apiserver              0                   f7d51922673d9       kube-apiserver-old-k8s-version-884192
	
	
	==> containerd <==
	Jul 29 21:06:02 old-k8s-version-884192 containerd[571]: time="2024-07-29T21:06:02.898354745Z" level=info msg="CreateContainer within sandbox \"706a5fcbe1bc9198d5f92fca52cbfef5a38515247cc2172415afd9344538dba8\" for name:\"dashboard-metrics-scraper\" attempt:4 returns container id \"904fd4ab47a43bb399df5a891733e2518ade2f553e0d99a1b3410adf3fe28f2f\""
	Jul 29 21:06:02 old-k8s-version-884192 containerd[571]: time="2024-07-29T21:06:02.899317568Z" level=info msg="StartContainer for \"904fd4ab47a43bb399df5a891733e2518ade2f553e0d99a1b3410adf3fe28f2f\""
	Jul 29 21:06:02 old-k8s-version-884192 containerd[571]: time="2024-07-29T21:06:02.965200819Z" level=info msg="StartContainer for \"904fd4ab47a43bb399df5a891733e2518ade2f553e0d99a1b3410adf3fe28f2f\" returns successfully"
	Jul 29 21:06:03 old-k8s-version-884192 containerd[571]: time="2024-07-29T21:06:03.000519555Z" level=info msg="shim disconnected" id=904fd4ab47a43bb399df5a891733e2518ade2f553e0d99a1b3410adf3fe28f2f namespace=k8s.io
	Jul 29 21:06:03 old-k8s-version-884192 containerd[571]: time="2024-07-29T21:06:03.000623167Z" level=warning msg="cleaning up after shim disconnected" id=904fd4ab47a43bb399df5a891733e2518ade2f553e0d99a1b3410adf3fe28f2f namespace=k8s.io
	Jul 29 21:06:03 old-k8s-version-884192 containerd[571]: time="2024-07-29T21:06:03.000636984Z" level=info msg="cleaning up dead shim" namespace=k8s.io
	Jul 29 21:06:03 old-k8s-version-884192 containerd[571]: time="2024-07-29T21:06:03.906395332Z" level=info msg="RemoveContainer for \"1f12a18858ac3ff7cf9dd93d73830d6a9d069b9de07f0f1f8bcb57de5b74d8c3\""
	Jul 29 21:06:03 old-k8s-version-884192 containerd[571]: time="2024-07-29T21:06:03.917863119Z" level=info msg="RemoveContainer for \"1f12a18858ac3ff7cf9dd93d73830d6a9d069b9de07f0f1f8bcb57de5b74d8c3\" returns successfully"
	Jul 29 21:06:43 old-k8s-version-884192 containerd[571]: time="2024-07-29T21:06:43.879863711Z" level=info msg="PullImage \"fake.domain/registry.k8s.io/echoserver:1.4\""
	Jul 29 21:06:43 old-k8s-version-884192 containerd[571]: time="2024-07-29T21:06:43.884956854Z" level=info msg="trying next host" error="failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host" host=fake.domain
	Jul 29 21:06:43 old-k8s-version-884192 containerd[571]: time="2024-07-29T21:06:43.886747481Z" level=error msg="PullImage \"fake.domain/registry.k8s.io/echoserver:1.4\" failed" error="failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host"
	Jul 29 21:06:43 old-k8s-version-884192 containerd[571]: time="2024-07-29T21:06:43.886775132Z" level=info msg="stop pulling image fake.domain/registry.k8s.io/echoserver:1.4: active requests=0, bytes read=0"
	Jul 29 21:07:33 old-k8s-version-884192 containerd[571]: time="2024-07-29T21:07:33.880665929Z" level=info msg="CreateContainer within sandbox \"706a5fcbe1bc9198d5f92fca52cbfef5a38515247cc2172415afd9344538dba8\" for container name:\"dashboard-metrics-scraper\" attempt:5"
	Jul 29 21:07:33 old-k8s-version-884192 containerd[571]: time="2024-07-29T21:07:33.894902089Z" level=info msg="CreateContainer within sandbox \"706a5fcbe1bc9198d5f92fca52cbfef5a38515247cc2172415afd9344538dba8\" for name:\"dashboard-metrics-scraper\" attempt:5 returns container id \"551715fdc9241acf5a697db07991c198b35d4e3db030df08bada74c01ad4d18e\""
	Jul 29 21:07:33 old-k8s-version-884192 containerd[571]: time="2024-07-29T21:07:33.895608869Z" level=info msg="StartContainer for \"551715fdc9241acf5a697db07991c198b35d4e3db030df08bada74c01ad4d18e\""
	Jul 29 21:07:33 old-k8s-version-884192 containerd[571]: time="2024-07-29T21:07:33.963333766Z" level=info msg="StartContainer for \"551715fdc9241acf5a697db07991c198b35d4e3db030df08bada74c01ad4d18e\" returns successfully"
	Jul 29 21:07:33 old-k8s-version-884192 containerd[571]: time="2024-07-29T21:07:33.990970888Z" level=info msg="shim disconnected" id=551715fdc9241acf5a697db07991c198b35d4e3db030df08bada74c01ad4d18e namespace=k8s.io
	Jul 29 21:07:33 old-k8s-version-884192 containerd[571]: time="2024-07-29T21:07:33.991042180Z" level=warning msg="cleaning up after shim disconnected" id=551715fdc9241acf5a697db07991c198b35d4e3db030df08bada74c01ad4d18e namespace=k8s.io
	Jul 29 21:07:33 old-k8s-version-884192 containerd[571]: time="2024-07-29T21:07:33.991052666Z" level=info msg="cleaning up dead shim" namespace=k8s.io
	Jul 29 21:07:34 old-k8s-version-884192 containerd[571]: time="2024-07-29T21:07:34.178239427Z" level=info msg="RemoveContainer for \"904fd4ab47a43bb399df5a891733e2518ade2f553e0d99a1b3410adf3fe28f2f\""
	Jul 29 21:07:34 old-k8s-version-884192 containerd[571]: time="2024-07-29T21:07:34.184134127Z" level=info msg="RemoveContainer for \"904fd4ab47a43bb399df5a891733e2518ade2f553e0d99a1b3410adf3fe28f2f\" returns successfully"
	Jul 29 21:09:30 old-k8s-version-884192 containerd[571]: time="2024-07-29T21:09:30.879416593Z" level=info msg="PullImage \"fake.domain/registry.k8s.io/echoserver:1.4\""
	Jul 29 21:09:30 old-k8s-version-884192 containerd[571]: time="2024-07-29T21:09:30.885747806Z" level=info msg="trying next host" error="failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host" host=fake.domain
	Jul 29 21:09:30 old-k8s-version-884192 containerd[571]: time="2024-07-29T21:09:30.887377962Z" level=error msg="PullImage \"fake.domain/registry.k8s.io/echoserver:1.4\" failed" error="failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host"
	Jul 29 21:09:30 old-k8s-version-884192 containerd[571]: time="2024-07-29T21:09:30.887489730Z" level=info msg="stop pulling image fake.domain/registry.k8s.io/echoserver:1.4: active requests=0, bytes read=0"
	
	
	==> coredns [4c9c5c5f06999ffd13d4298995cd93d9de27eda2f392872dbd2c9cbef44d6bd9] <==
	.:53
	[INFO] plugin/reload: Running configuration MD5 = b494d968e357ba1b925cee838fbd78ed
	CoreDNS-1.7.0
	linux/arm64, go1.14.4, f59c03d
	[INFO] 127.0.0.1:38473 - 22764 "HINFO IN 3571904024478405419.6773580557100247176. udp 57 false 512" NXDOMAIN qr,rd,ra 57 0.023951179s
	[INFO] plugin/ready: Still waiting on: "kubernetes"
	[INFO] plugin/ready: Still waiting on: "kubernetes"
	[INFO] plugin/ready: Still waiting on: "kubernetes"
	I0729 21:04:24.936854       1 trace.go:116] Trace[2019727887]: "Reflector ListAndWatch" name:pkg/mod/k8s.io/client-go@v0.18.3/tools/cache/reflector.go:125 (started: 2024-07-29 21:03:54.936142786 +0000 UTC m=+0.064634044) (total time: 30.000602539s):
	Trace[2019727887]: [30.000602539s] [30.000602539s] END
	E0729 21:04:24.936890       1 reflector.go:178] pkg/mod/k8s.io/client-go@v0.18.3/tools/cache/reflector.go:125: Failed to list *v1.Namespace: Get "https://10.96.0.1:443/api/v1/namespaces?limit=500&resourceVersion=0": dial tcp 10.96.0.1:443: i/o timeout
	I0729 21:04:24.937094       1 trace.go:116] Trace[939984059]: "Reflector ListAndWatch" name:pkg/mod/k8s.io/client-go@v0.18.3/tools/cache/reflector.go:125 (started: 2024-07-29 21:03:54.936780245 +0000 UTC m=+0.065271511) (total time: 30.000300942s):
	Trace[939984059]: [30.000300942s] [30.000300942s] END
	E0729 21:04:24.937108       1 reflector.go:178] pkg/mod/k8s.io/client-go@v0.18.3/tools/cache/reflector.go:125: Failed to list *v1.Service: Get "https://10.96.0.1:443/api/v1/services?limit=500&resourceVersion=0": dial tcp 10.96.0.1:443: i/o timeout
	I0729 21:04:24.937391       1 trace.go:116] Trace[911902081]: "Reflector ListAndWatch" name:pkg/mod/k8s.io/client-go@v0.18.3/tools/cache/reflector.go:125 (started: 2024-07-29 21:03:54.937021709 +0000 UTC m=+0.065512966) (total time: 30.000353487s):
	Trace[911902081]: [30.000353487s] [30.000353487s] END
	E0729 21:04:24.937497       1 reflector.go:178] pkg/mod/k8s.io/client-go@v0.18.3/tools/cache/reflector.go:125: Failed to list *v1.Endpoints: Get "https://10.96.0.1:443/api/v1/endpoints?limit=500&resourceVersion=0": dial tcp 10.96.0.1:443: i/o timeout
	
	
	==> coredns [a11607490336d465d0dc075fbb00de0bc707a72aed0c22c0881dcd60db427adf] <==
	.:53
	[INFO] plugin/reload: Running configuration MD5 = b494d968e357ba1b925cee838fbd78ed
	CoreDNS-1.7.0
	linux/arm64, go1.14.4, f59c03d
	[INFO] 127.0.0.1:56671 - 27139 "HINFO IN 1940358916785085516.9053459842535364042. udp 57 false 512" NXDOMAIN qr,rd,ra 57 0.021412913s
	
	
	==> describe nodes <==
	Name:               old-k8s-version-884192
	Roles:              control-plane,master
	Labels:             beta.kubernetes.io/arch=arm64
	                    beta.kubernetes.io/os=linux
	                    kubernetes.io/arch=arm64
	                    kubernetes.io/hostname=old-k8s-version-884192
	                    kubernetes.io/os=linux
	                    minikube.k8s.io/commit=de53afae5e8f4269438099f4dad14d93a8a17e35
	                    minikube.k8s.io/name=old-k8s-version-884192
	                    minikube.k8s.io/primary=true
	                    minikube.k8s.io/updated_at=2024_07_29T21_01_26_0700
	                    minikube.k8s.io/version=v1.33.1
	                    node-role.kubernetes.io/control-plane=
	                    node-role.kubernetes.io/master=
	Annotations:        kubeadm.alpha.kubernetes.io/cri-socket: /run/containerd/containerd.sock
	                    node.alpha.kubernetes.io/ttl: 0
	                    volumes.kubernetes.io/controller-managed-attach-detach: true
	CreationTimestamp:  Mon, 29 Jul 2024 21:01:23 +0000
	Taints:             <none>
	Unschedulable:      false
	Lease:
	  HolderIdentity:  old-k8s-version-884192
	  AcquireTime:     <unset>
	  RenewTime:       Mon, 29 Jul 2024 21:09:33 +0000
	Conditions:
	  Type             Status  LastHeartbeatTime                 LastTransitionTime                Reason                       Message
	  ----             ------  -----------------                 ------------------                ------                       -------
	  MemoryPressure   False   Mon, 29 Jul 2024 21:04:41 +0000   Mon, 29 Jul 2024 21:01:16 +0000   KubeletHasSufficientMemory   kubelet has sufficient memory available
	  DiskPressure     False   Mon, 29 Jul 2024 21:04:41 +0000   Mon, 29 Jul 2024 21:01:16 +0000   KubeletHasNoDiskPressure     kubelet has no disk pressure
	  PIDPressure      False   Mon, 29 Jul 2024 21:04:41 +0000   Mon, 29 Jul 2024 21:01:16 +0000   KubeletHasSufficientPID      kubelet has sufficient PID available
	  Ready            True    Mon, 29 Jul 2024 21:04:41 +0000   Mon, 29 Jul 2024 21:01:42 +0000   KubeletReady                 kubelet is posting ready status
	Addresses:
	  InternalIP:  192.168.76.2
	  Hostname:    old-k8s-version-884192
	Capacity:
	  cpu:                2
	  ephemeral-storage:  203034800Ki
	  hugepages-1Gi:      0
	  hugepages-2Mi:      0
	  hugepages-32Mi:     0
	  hugepages-64Ki:     0
	  memory:             8022364Ki
	  pods:               110
	Allocatable:
	  cpu:                2
	  ephemeral-storage:  203034800Ki
	  hugepages-1Gi:      0
	  hugepages-2Mi:      0
	  hugepages-32Mi:     0
	  hugepages-64Ki:     0
	  memory:             8022364Ki
	  pods:               110
	System Info:
	  Machine ID:                 097ba3eacbc04a529d88efcafba32e67
	  System UUID:                4a112dc2-2ee3-45dd-9097-a7f4af0416c4
	  Boot ID:                    f43244bd-8d62-45f7-a4e7-2b350386049a
	  Kernel Version:             5.15.0-1065-aws
	  OS Image:                   Ubuntu 22.04.4 LTS
	  Operating System:           linux
	  Architecture:               arm64
	  Container Runtime Version:  containerd://1.7.19
	  Kubelet Version:            v1.20.0
	  Kube-Proxy Version:         v1.20.0
	PodCIDR:                      10.244.0.0/24
	PodCIDRs:                     10.244.0.0/24
	Non-terminated Pods:          (12 in total)
	  Namespace                   Name                                              CPU Requests  CPU Limits  Memory Requests  Memory Limits  AGE
	  ---------                   ----                                              ------------  ----------  ---------------  -------------  ---
	  default                     busybox                                           0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         6m37s
	  kube-system                 coredns-74ff55c5b-xgldr                           100m (5%!)(MISSING)     0 (0%!)(MISSING)      70Mi (0%!)(MISSING)        170Mi (2%!)(MISSING)     7m53s
	  kube-system                 etcd-old-k8s-version-884192                       100m (5%!)(MISSING)     0 (0%!)(MISSING)      100Mi (1%!)(MISSING)       0 (0%!)(MISSING)         8m
	  kube-system                 kindnet-dr2zz                                     100m (5%!)(MISSING)     100m (5%!)(MISSING)   50Mi (0%!)(MISSING)        50Mi (0%!)(MISSING)      7m53s
	  kube-system                 kube-apiserver-old-k8s-version-884192             250m (12%!)(MISSING)    0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         8m
	  kube-system                 kube-controller-manager-old-k8s-version-884192    200m (10%!)(MISSING)    0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         8m
	  kube-system                 kube-proxy-kp9qr                                  0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         7m53s
	  kube-system                 kube-scheduler-old-k8s-version-884192             100m (5%!)(MISSING)     0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         8m
	  kube-system                 metrics-server-9975d5f86-b5bqk                    100m (5%!)(MISSING)     0 (0%!)(MISSING)      200Mi (2%!)(MISSING)       0 (0%!)(MISSING)         6m25s
	  kube-system                 storage-provisioner                               0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         7m52s
	  kubernetes-dashboard        dashboard-metrics-scraper-8d5bb5db8-fgznv         0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         5m25s
	  kubernetes-dashboard        kubernetes-dashboard-cd95d586-c7zlw               0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         5m25s
	Allocated resources:
	  (Total limits may be over 100 percent, i.e., overcommitted.)
	  Resource           Requests    Limits
	  --------           --------    ------
	  cpu                950m (47%!)(MISSING)  100m (5%!)(MISSING)
	  memory             420Mi (5%!)(MISSING)  220Mi (2%!)(MISSING)
	  ephemeral-storage  100Mi (0%!)(MISSING)  0 (0%!)(MISSING)
	  hugepages-1Gi      0 (0%!)(MISSING)      0 (0%!)(MISSING)
	  hugepages-2Mi      0 (0%!)(MISSING)      0 (0%!)(MISSING)
	  hugepages-32Mi     0 (0%!)(MISSING)      0 (0%!)(MISSING)
	  hugepages-64Ki     0 (0%!)(MISSING)      0 (0%!)(MISSING)
	Events:
	  Type    Reason                   Age                    From        Message
	  ----    ------                   ----                   ----        -------
	  Normal  Starting                 8m20s                  kubelet     Starting kubelet.
	  Normal  NodeHasSufficientMemory  8m20s (x4 over 8m20s)  kubelet     Node old-k8s-version-884192 status is now: NodeHasSufficientMemory
	  Normal  NodeHasNoDiskPressure    8m20s (x5 over 8m20s)  kubelet     Node old-k8s-version-884192 status is now: NodeHasNoDiskPressure
	  Normal  NodeHasSufficientPID     8m20s (x4 over 8m20s)  kubelet     Node old-k8s-version-884192 status is now: NodeHasSufficientPID
	  Normal  NodeAllocatableEnforced  8m20s                  kubelet     Updated Node Allocatable limit across pods
	  Normal  Starting                 8m1s                   kubelet     Starting kubelet.
	  Normal  NodeHasSufficientMemory  8m1s                   kubelet     Node old-k8s-version-884192 status is now: NodeHasSufficientMemory
	  Normal  NodeHasNoDiskPressure    8m1s                   kubelet     Node old-k8s-version-884192 status is now: NodeHasNoDiskPressure
	  Normal  NodeHasSufficientPID     8m1s                   kubelet     Node old-k8s-version-884192 status is now: NodeHasSufficientPID
	  Normal  NodeAllocatableEnforced  8m                     kubelet     Updated Node Allocatable limit across pods
	  Normal  NodeReady                7m53s                  kubelet     Node old-k8s-version-884192 status is now: NodeReady
	  Normal  Starting                 7m52s                  kube-proxy  Starting kube-proxy.
	  Normal  Starting                 5m57s                  kubelet     Starting kubelet.
	  Normal  NodeHasSufficientMemory  5m57s (x8 over 5m57s)  kubelet     Node old-k8s-version-884192 status is now: NodeHasSufficientMemory
	  Normal  NodeHasNoDiskPressure    5m57s (x8 over 5m57s)  kubelet     Node old-k8s-version-884192 status is now: NodeHasNoDiskPressure
	  Normal  NodeHasSufficientPID     5m57s (x7 over 5m57s)  kubelet     Node old-k8s-version-884192 status is now: NodeHasSufficientPID
	  Normal  NodeAllocatableEnforced  5m57s                  kubelet     Updated Node Allocatable limit across pods
	  Normal  Starting                 5m40s                  kube-proxy  Starting kube-proxy.
	
	
	==> dmesg <==
	[  +0.001084] FS-Cache: O-key=[8] 'd1e6c90000000000'
	[  +0.000711] FS-Cache: N-cookie c=000000d1 [p=000000c8 fl=2 nc=0 na=1]
	[  +0.000950] FS-Cache: N-cookie d=0000000075a7dcb2{9p.inode} n=00000000912105b7
	[  +0.001076] FS-Cache: N-key=[8] 'd1e6c90000000000'
	[  +0.002928] FS-Cache: Duplicate cookie detected
	[  +0.000718] FS-Cache: O-cookie c=000000cb [p=000000c8 fl=226 nc=0 na=1]
	[  +0.001031] FS-Cache: O-cookie d=0000000075a7dcb2{9p.inode} n=0000000027b63aff
	[  +0.001079] FS-Cache: O-key=[8] 'd1e6c90000000000'
	[  +0.000715] FS-Cache: N-cookie c=000000d2 [p=000000c8 fl=2 nc=0 na=1]
	[  +0.000947] FS-Cache: N-cookie d=0000000075a7dcb2{9p.inode} n=000000008a938d3f
	[  +0.001105] FS-Cache: N-key=[8] 'd1e6c90000000000'
	[  +2.417302] FS-Cache: Duplicate cookie detected
	[  +0.000713] FS-Cache: O-cookie c=000000c9 [p=000000c8 fl=226 nc=0 na=1]
	[  +0.000958] FS-Cache: O-cookie d=0000000075a7dcb2{9p.inode} n=00000000d4a8cf17
	[  +0.001060] FS-Cache: O-key=[8] 'd0e6c90000000000'
	[  +0.000741] FS-Cache: N-cookie c=000000d4 [p=000000c8 fl=2 nc=0 na=1]
	[  +0.000968] FS-Cache: N-cookie d=0000000075a7dcb2{9p.inode} n=00000000e0512023
	[  +0.001047] FS-Cache: N-key=[8] 'd0e6c90000000000'
	[  +0.290142] FS-Cache: Duplicate cookie detected
	[  +0.000707] FS-Cache: O-cookie c=000000ce [p=000000c8 fl=226 nc=0 na=1]
	[  +0.000972] FS-Cache: O-cookie d=0000000075a7dcb2{9p.inode} n=00000000aad0397a
	[  +0.001067] FS-Cache: O-key=[8] 'd6e6c90000000000'
	[  +0.000786] FS-Cache: N-cookie c=000000d5 [p=000000c8 fl=2 nc=0 na=1]
	[  +0.000969] FS-Cache: N-cookie d=0000000075a7dcb2{9p.inode} n=00000000715dc7d8
	[  +0.001068] FS-Cache: N-key=[8] 'd6e6c90000000000'
	
	
	==> etcd [bc0116b218f41883478ef8c3d93fb1116431f7848779b1dccd7871ccda0dc49f] <==
	2024-07-29 21:01:16.378947 I | embed: listening for peers on 192.168.76.2:2380
	raft2024/07/29 21:01:16 INFO: ea7e25599daad906 switched to configuration voters=(16896983918768216326)
	2024-07-29 21:01:16.381880 I | etcdserver/membership: added member ea7e25599daad906 [https://192.168.76.2:2380] to cluster 6f20f2c4b2fb5f8a
	raft2024/07/29 21:01:16 INFO: ea7e25599daad906 is starting a new election at term 1
	raft2024/07/29 21:01:16 INFO: ea7e25599daad906 became candidate at term 2
	raft2024/07/29 21:01:16 INFO: ea7e25599daad906 received MsgVoteResp from ea7e25599daad906 at term 2
	raft2024/07/29 21:01:16 INFO: ea7e25599daad906 became leader at term 2
	raft2024/07/29 21:01:16 INFO: raft.node: ea7e25599daad906 elected leader ea7e25599daad906 at term 2
	2024-07-29 21:01:16.761944 I | etcdserver: setting up the initial cluster version to 3.4
	2024-07-29 21:01:16.762953 N | etcdserver/membership: set the initial cluster version to 3.4
	2024-07-29 21:01:16.763164 I | etcdserver/api: enabled capabilities for version 3.4
	2024-07-29 21:01:16.763296 I | etcdserver: published {Name:old-k8s-version-884192 ClientURLs:[https://192.168.76.2:2379]} to cluster 6f20f2c4b2fb5f8a
	2024-07-29 21:01:16.763613 I | embed: ready to serve client requests
	2024-07-29 21:01:16.763764 I | embed: ready to serve client requests
	2024-07-29 21:01:16.777245 I | embed: serving client requests on 127.0.0.1:2379
	2024-07-29 21:01:16.778195 I | embed: serving client requests on 192.168.76.2:2379
	2024-07-29 21:01:43.297184 I | etcdserver/api/etcdhttp: /health OK (status code 200)
	2024-07-29 21:01:52.693707 I | etcdserver/api/etcdhttp: /health OK (status code 200)
	2024-07-29 21:02:02.693808 I | etcdserver/api/etcdhttp: /health OK (status code 200)
	2024-07-29 21:02:12.693756 I | etcdserver/api/etcdhttp: /health OK (status code 200)
	2024-07-29 21:02:22.693606 I | etcdserver/api/etcdhttp: /health OK (status code 200)
	2024-07-29 21:02:32.693598 I | etcdserver/api/etcdhttp: /health OK (status code 200)
	2024-07-29 21:02:42.693641 I | etcdserver/api/etcdhttp: /health OK (status code 200)
	2024-07-29 21:02:52.693593 I | etcdserver/api/etcdhttp: /health OK (status code 200)
	2024-07-29 21:03:02.693789 I | etcdserver/api/etcdhttp: /health OK (status code 200)
	
	
	==> etcd [fdfc2fda8f65bf329c9d58d897a8694516fa614a5e93c26ef5cb777ca3bec6f9] <==
	2024-07-29 21:05:34.677925 I | etcdserver/api/etcdhttp: /health OK (status code 200)
	2024-07-29 21:05:44.677709 I | etcdserver/api/etcdhttp: /health OK (status code 200)
	2024-07-29 21:05:54.678615 I | etcdserver/api/etcdhttp: /health OK (status code 200)
	2024-07-29 21:06:04.677768 I | etcdserver/api/etcdhttp: /health OK (status code 200)
	2024-07-29 21:06:14.677846 I | etcdserver/api/etcdhttp: /health OK (status code 200)
	2024-07-29 21:06:24.677923 I | etcdserver/api/etcdhttp: /health OK (status code 200)
	2024-07-29 21:06:34.677786 I | etcdserver/api/etcdhttp: /health OK (status code 200)
	2024-07-29 21:06:44.677743 I | etcdserver/api/etcdhttp: /health OK (status code 200)
	2024-07-29 21:06:54.677902 I | etcdserver/api/etcdhttp: /health OK (status code 200)
	2024-07-29 21:07:04.677734 I | etcdserver/api/etcdhttp: /health OK (status code 200)
	2024-07-29 21:07:14.677855 I | etcdserver/api/etcdhttp: /health OK (status code 200)
	2024-07-29 21:07:24.678427 I | etcdserver/api/etcdhttp: /health OK (status code 200)
	2024-07-29 21:07:34.677756 I | etcdserver/api/etcdhttp: /health OK (status code 200)
	2024-07-29 21:07:44.677887 I | etcdserver/api/etcdhttp: /health OK (status code 200)
	2024-07-29 21:07:54.677807 I | etcdserver/api/etcdhttp: /health OK (status code 200)
	2024-07-29 21:08:04.677701 I | etcdserver/api/etcdhttp: /health OK (status code 200)
	2024-07-29 21:08:14.677720 I | etcdserver/api/etcdhttp: /health OK (status code 200)
	2024-07-29 21:08:24.678299 I | etcdserver/api/etcdhttp: /health OK (status code 200)
	2024-07-29 21:08:34.677765 I | etcdserver/api/etcdhttp: /health OK (status code 200)
	2024-07-29 21:08:44.677689 I | etcdserver/api/etcdhttp: /health OK (status code 200)
	2024-07-29 21:08:54.678774 I | etcdserver/api/etcdhttp: /health OK (status code 200)
	2024-07-29 21:09:04.677808 I | etcdserver/api/etcdhttp: /health OK (status code 200)
	2024-07-29 21:09:14.677671 I | etcdserver/api/etcdhttp: /health OK (status code 200)
	2024-07-29 21:09:24.680564 I | etcdserver/api/etcdhttp: /health OK (status code 200)
	2024-07-29 21:09:34.678007 I | etcdserver/api/etcdhttp: /health OK (status code 200)
	
	
	==> kernel <==
	 21:09:35 up 18:52,  0 users,  load average: 1.21, 2.05, 2.54
	Linux old-k8s-version-884192 5.15.0-1065-aws #71~20.04.1-Ubuntu SMP Fri Jun 28 19:59:49 UTC 2024 aarch64 aarch64 aarch64 GNU/Linux
	PRETTY_NAME="Ubuntu 22.04.4 LTS"
	
	
	==> kindnet [2e5ae293c129dbb0affcb0f06ae8ebaf6c3ed66d3cb9d4d26ff0dfdef3a13354] <==
	I0729 21:08:14.682352       1 main.go:299] handling current node
	W0729 21:08:20.835010       1 reflector.go:547] pkg/mod/k8s.io/client-go@v0.30.2/tools/cache/reflector.go:232: failed to list *v1.NetworkPolicy: networkpolicies.networking.k8s.io is forbidden: User "system:serviceaccount:kube-system:kindnet" cannot list resource "networkpolicies" in API group "networking.k8s.io" at the cluster scope
	E0729 21:08:20.835046       1 reflector.go:150] pkg/mod/k8s.io/client-go@v0.30.2/tools/cache/reflector.go:232: Failed to watch *v1.NetworkPolicy: failed to list *v1.NetworkPolicy: networkpolicies.networking.k8s.io is forbidden: User "system:serviceaccount:kube-system:kindnet" cannot list resource "networkpolicies" in API group "networking.k8s.io" at the cluster scope
	I0729 21:08:24.681392       1 main.go:295] Handling node with IPs: map[192.168.76.2:{}]
	I0729 21:08:24.681424       1 main.go:299] handling current node
	I0729 21:08:34.682462       1 main.go:295] Handling node with IPs: map[192.168.76.2:{}]
	I0729 21:08:34.682498       1 main.go:299] handling current node
	I0729 21:08:44.681726       1 main.go:295] Handling node with IPs: map[192.168.76.2:{}]
	I0729 21:08:44.681761       1 main.go:299] handling current node
	W0729 21:08:47.060967       1 reflector.go:547] pkg/mod/k8s.io/client-go@v0.30.2/tools/cache/reflector.go:232: failed to list *v1.Pod: pods is forbidden: User "system:serviceaccount:kube-system:kindnet" cannot list resource "pods" in API group "" at the cluster scope
	E0729 21:08:47.061237       1 reflector.go:150] pkg/mod/k8s.io/client-go@v0.30.2/tools/cache/reflector.go:232: Failed to watch *v1.Pod: failed to list *v1.Pod: pods is forbidden: User "system:serviceaccount:kube-system:kindnet" cannot list resource "pods" in API group "" at the cluster scope
	I0729 21:08:54.681506       1 main.go:295] Handling node with IPs: map[192.168.76.2:{}]
	I0729 21:08:54.681617       1 main.go:299] handling current node
	W0729 21:08:59.850846       1 reflector.go:547] pkg/mod/k8s.io/client-go@v0.30.2/tools/cache/reflector.go:232: failed to list *v1.Namespace: namespaces is forbidden: User "system:serviceaccount:kube-system:kindnet" cannot list resource "namespaces" in API group "" at the cluster scope
	E0729 21:08:59.850883       1 reflector.go:150] pkg/mod/k8s.io/client-go@v0.30.2/tools/cache/reflector.go:232: Failed to watch *v1.Namespace: failed to list *v1.Namespace: namespaces is forbidden: User "system:serviceaccount:kube-system:kindnet" cannot list resource "namespaces" in API group "" at the cluster scope
	I0729 21:09:04.681557       1 main.go:295] Handling node with IPs: map[192.168.76.2:{}]
	I0729 21:09:04.681593       1 main.go:299] handling current node
	I0729 21:09:14.682277       1 main.go:295] Handling node with IPs: map[192.168.76.2:{}]
	I0729 21:09:14.682310       1 main.go:299] handling current node
	W0729 21:09:17.801037       1 reflector.go:547] pkg/mod/k8s.io/client-go@v0.30.2/tools/cache/reflector.go:232: failed to list *v1.NetworkPolicy: networkpolicies.networking.k8s.io is forbidden: User "system:serviceaccount:kube-system:kindnet" cannot list resource "networkpolicies" in API group "networking.k8s.io" at the cluster scope
	E0729 21:09:17.801073       1 reflector.go:150] pkg/mod/k8s.io/client-go@v0.30.2/tools/cache/reflector.go:232: Failed to watch *v1.NetworkPolicy: failed to list *v1.NetworkPolicy: networkpolicies.networking.k8s.io is forbidden: User "system:serviceaccount:kube-system:kindnet" cannot list resource "networkpolicies" in API group "networking.k8s.io" at the cluster scope
	I0729 21:09:24.681864       1 main.go:295] Handling node with IPs: map[192.168.76.2:{}]
	I0729 21:09:24.681962       1 main.go:299] handling current node
	I0729 21:09:34.682267       1 main.go:295] Handling node with IPs: map[192.168.76.2:{}]
	I0729 21:09:34.682298       1 main.go:299] handling current node
	
	
	==> kindnet [fbbee29f2c588ded9a605a091aba1140ebd1f5d629d5ce39dd1c983e14798d82] <==
	E0729 21:02:05.563781       1 reflector.go:150] pkg/mod/k8s.io/client-go@v0.30.2/tools/cache/reflector.go:232: Failed to watch *v1.Namespace: failed to list *v1.Namespace: namespaces is forbidden: User "system:serviceaccount:kube-system:kindnet" cannot list resource "namespaces" in API group "" at the cluster scope
	I0729 21:02:05.997682       1 main.go:295] Handling node with IPs: map[192.168.76.2:{}]
	I0729 21:02:05.997725       1 main.go:299] handling current node
	I0729 21:02:15.997261       1 main.go:295] Handling node with IPs: map[192.168.76.2:{}]
	I0729 21:02:15.997297       1 main.go:299] handling current node
	W0729 21:02:23.508524       1 reflector.go:547] pkg/mod/k8s.io/client-go@v0.30.2/tools/cache/reflector.go:232: failed to list *v1.NetworkPolicy: networkpolicies.networking.k8s.io is forbidden: User "system:serviceaccount:kube-system:kindnet" cannot list resource "networkpolicies" in API group "networking.k8s.io" at the cluster scope
	E0729 21:02:23.508567       1 reflector.go:150] pkg/mod/k8s.io/client-go@v0.30.2/tools/cache/reflector.go:232: Failed to watch *v1.NetworkPolicy: failed to list *v1.NetworkPolicy: networkpolicies.networking.k8s.io is forbidden: User "system:serviceaccount:kube-system:kindnet" cannot list resource "networkpolicies" in API group "networking.k8s.io" at the cluster scope
	W0729 21:02:25.268636       1 reflector.go:547] pkg/mod/k8s.io/client-go@v0.30.2/tools/cache/reflector.go:232: failed to list *v1.Pod: pods is forbidden: User "system:serviceaccount:kube-system:kindnet" cannot list resource "pods" in API group "" at the cluster scope
	E0729 21:02:25.268675       1 reflector.go:150] pkg/mod/k8s.io/client-go@v0.30.2/tools/cache/reflector.go:232: Failed to watch *v1.Pod: failed to list *v1.Pod: pods is forbidden: User "system:serviceaccount:kube-system:kindnet" cannot list resource "pods" in API group "" at the cluster scope
	W0729 21:02:25.780898       1 reflector.go:547] pkg/mod/k8s.io/client-go@v0.30.2/tools/cache/reflector.go:232: failed to list *v1.Namespace: namespaces is forbidden: User "system:serviceaccount:kube-system:kindnet" cannot list resource "namespaces" in API group "" at the cluster scope
	E0729 21:02:25.780935       1 reflector.go:150] pkg/mod/k8s.io/client-go@v0.30.2/tools/cache/reflector.go:232: Failed to watch *v1.Namespace: failed to list *v1.Namespace: namespaces is forbidden: User "system:serviceaccount:kube-system:kindnet" cannot list resource "namespaces" in API group "" at the cluster scope
	I0729 21:02:25.997290       1 main.go:295] Handling node with IPs: map[192.168.76.2:{}]
	I0729 21:02:25.997336       1 main.go:299] handling current node
	I0729 21:02:35.997607       1 main.go:295] Handling node with IPs: map[192.168.76.2:{}]
	I0729 21:02:35.997653       1 main.go:299] handling current node
	I0729 21:02:45.997590       1 main.go:295] Handling node with IPs: map[192.168.76.2:{}]
	I0729 21:02:45.997627       1 main.go:299] handling current node
	I0729 21:02:55.997447       1 main.go:295] Handling node with IPs: map[192.168.76.2:{}]
	I0729 21:02:55.997488       1 main.go:299] handling current node
	W0729 21:03:05.066012       1 reflector.go:547] pkg/mod/k8s.io/client-go@v0.30.2/tools/cache/reflector.go:232: failed to list *v1.Pod: pods is forbidden: User "system:serviceaccount:kube-system:kindnet" cannot list resource "pods" in API group "" at the cluster scope
	E0729 21:03:05.066322       1 reflector.go:150] pkg/mod/k8s.io/client-go@v0.30.2/tools/cache/reflector.go:232: Failed to watch *v1.Pod: failed to list *v1.Pod: pods is forbidden: User "system:serviceaccount:kube-system:kindnet" cannot list resource "pods" in API group "" at the cluster scope
	W0729 21:03:05.412995       1 reflector.go:547] pkg/mod/k8s.io/client-go@v0.30.2/tools/cache/reflector.go:232: failed to list *v1.NetworkPolicy: networkpolicies.networking.k8s.io is forbidden: User "system:serviceaccount:kube-system:kindnet" cannot list resource "networkpolicies" in API group "networking.k8s.io" at the cluster scope
	E0729 21:03:05.413032       1 reflector.go:150] pkg/mod/k8s.io/client-go@v0.30.2/tools/cache/reflector.go:232: Failed to watch *v1.NetworkPolicy: failed to list *v1.NetworkPolicy: networkpolicies.networking.k8s.io is forbidden: User "system:serviceaccount:kube-system:kindnet" cannot list resource "networkpolicies" in API group "networking.k8s.io" at the cluster scope
	I0729 21:03:05.996947       1 main.go:295] Handling node with IPs: map[192.168.76.2:{}]
	I0729 21:03:05.996984       1 main.go:299] handling current node
	
	
	==> kube-apiserver [2b5706f43ae84ffb4c99184b43a6db1890019aa8c76fdb92fdf6129a64fe28fb] <==
	I0729 21:06:14.288735       1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379  <nil> 0 <nil>}] <nil> <nil>}
	I0729 21:06:14.288765       1 clientconn.go:948] ClientConn switching balancer to "pick_first"
	W0729 21:06:54.750262       1 handler_proxy.go:102] no RequestInfo found in the context
	E0729 21:06:54.750340       1 controller.go:116] loading OpenAPI spec for "v1beta1.metrics.k8s.io" failed with: failed to retrieve openAPI spec, http error: ResponseCode: 503, Body: service unavailable
	, Header: map[Content-Type:[text/plain; charset=utf-8] X-Content-Type-Options:[nosniff]]
	I0729 21:06:54.750358       1 controller.go:129] OpenAPI AggregationController: action for item v1beta1.metrics.k8s.io: Rate Limited Requeue.
	I0729 21:06:55.283166       1 client.go:360] parsed scheme: "passthrough"
	I0729 21:06:55.283209       1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379  <nil> 0 <nil>}] <nil> <nil>}
	I0729 21:06:55.283358       1 clientconn.go:948] ClientConn switching balancer to "pick_first"
	I0729 21:07:27.717790       1 client.go:360] parsed scheme: "passthrough"
	I0729 21:07:27.717831       1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379  <nil> 0 <nil>}] <nil> <nil>}
	I0729 21:07:27.717839       1 clientconn.go:948] ClientConn switching balancer to "pick_first"
	I0729 21:08:03.262227       1 client.go:360] parsed scheme: "passthrough"
	I0729 21:08:03.262272       1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379  <nil> 0 <nil>}] <nil> <nil>}
	I0729 21:08:03.262280       1 clientconn.go:948] ClientConn switching balancer to "pick_first"
	I0729 21:08:40.062244       1 client.go:360] parsed scheme: "passthrough"
	I0729 21:08:40.062738       1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379  <nil> 0 <nil>}] <nil> <nil>}
	I0729 21:08:40.063357       1 clientconn.go:948] ClientConn switching balancer to "pick_first"
	W0729 21:08:51.637042       1 handler_proxy.go:102] no RequestInfo found in the context
	E0729 21:08:51.637153       1 controller.go:116] loading OpenAPI spec for "v1beta1.metrics.k8s.io" failed with: failed to retrieve openAPI spec, http error: ResponseCode: 503, Body: service unavailable
	, Header: map[Content-Type:[text/plain; charset=utf-8] X-Content-Type-Options:[nosniff]]
	I0729 21:08:51.637169       1 controller.go:129] OpenAPI AggregationController: action for item v1beta1.metrics.k8s.io: Rate Limited Requeue.
	I0729 21:09:17.244186       1 client.go:360] parsed scheme: "passthrough"
	I0729 21:09:17.244227       1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379  <nil> 0 <nil>}] <nil> <nil>}
	I0729 21:09:17.244238       1 clientconn.go:948] ClientConn switching balancer to "pick_first"
	
	
	==> kube-apiserver [75e8e58f6b60c620418997e5255b74f9697a29827f81dff4f9dbf920bab06deb] <==
	I0729 21:01:23.482542       1 shared_informer.go:247] Caches are synced for node_authorizer 
	I0729 21:01:23.482657       1 cache.go:39] Caches are synced for APIServiceRegistrationController controller
	I0729 21:01:24.161028       1 controller.go:132] OpenAPI AggregationController: action for item : Nothing (removed from the queue).
	I0729 21:01:24.161057       1 controller.go:132] OpenAPI AggregationController: action for item k8s_internal_local_delegation_chain_0000000000: Nothing (removed from the queue).
	I0729 21:01:24.168509       1 storage_scheduling.go:132] created PriorityClass system-node-critical with value 2000001000
	I0729 21:01:24.173728       1 storage_scheduling.go:132] created PriorityClass system-cluster-critical with value 2000000000
	I0729 21:01:24.173756       1 storage_scheduling.go:148] all system priority classes are created successfully or already exist.
	I0729 21:01:24.675692       1 controller.go:606] quota admission added evaluator for: roles.rbac.authorization.k8s.io
	I0729 21:01:24.716229       1 controller.go:606] quota admission added evaluator for: rolebindings.rbac.authorization.k8s.io
	W0729 21:01:24.891176       1 lease.go:233] Resetting endpoints for master service "kubernetes" to [192.168.76.2]
	I0729 21:01:24.892321       1 controller.go:606] quota admission added evaluator for: endpoints
	I0729 21:01:24.898477       1 controller.go:606] quota admission added evaluator for: endpointslices.discovery.k8s.io
	I0729 21:01:25.806316       1 controller.go:606] quota admission added evaluator for: serviceaccounts
	I0729 21:01:26.276117       1 controller.go:606] quota admission added evaluator for: deployments.apps
	I0729 21:01:26.367400       1 controller.go:606] quota admission added evaluator for: daemonsets.apps
	I0729 21:01:34.804665       1 controller.go:606] quota admission added evaluator for: leases.coordination.k8s.io
	I0729 21:01:42.377724       1 controller.go:606] quota admission added evaluator for: replicasets.apps
	I0729 21:01:42.377832       1 controller.go:606] quota admission added evaluator for: controllerrevisions.apps
	I0729 21:01:50.697832       1 client.go:360] parsed scheme: "passthrough"
	I0729 21:01:50.698183       1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379  <nil> 0 <nil>}] <nil> <nil>}
	I0729 21:01:50.698320       1 clientconn.go:948] ClientConn switching balancer to "pick_first"
	I0729 21:02:33.113412       1 client.go:360] parsed scheme: "passthrough"
	I0729 21:02:33.113522       1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379  <nil> 0 <nil>}] <nil> <nil>}
	I0729 21:02:33.113536       1 clientconn.go:948] ClientConn switching balancer to "pick_first"
	E0729 21:03:08.356807       1 upgradeaware.go:373] Error proxying data from client to backend: read tcp 192.168.76.2:8443->192.168.76.1:39242: read: connection reset by peer
	
	
	==> kube-controller-manager [6c3b9526f1351901cc60d713178c281355d6b3994267e1a6de1bf5f38054b4aa] <==
	I0729 21:01:42.366320       1 shared_informer.go:247] Caches are synced for ReplicationController 
	I0729 21:01:42.366341       1 shared_informer.go:247] Caches are synced for HPA 
	I0729 21:01:42.401891       1 event.go:291] "Event occurred" object="kube-system/kindnet" kind="DaemonSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: kindnet-dr2zz"
	I0729 21:01:42.412125       1 shared_informer.go:247] Caches are synced for resource quota 
	I0729 21:01:42.495157       1 event.go:291] "Event occurred" object="kube-system/coredns" kind="Deployment" apiVersion="apps/v1" type="Normal" reason="ScalingReplicaSet" message="Scaled up replica set coredns-74ff55c5b to 2"
	I0729 21:01:42.580523       1 event.go:291] "Event occurred" object="kube-system/coredns-74ff55c5b" kind="ReplicaSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: coredns-74ff55c5b-k6pth"
	I0729 21:01:42.580551       1 event.go:291] "Event occurred" object="kube-system/kube-apiserver-old-k8s-version-884192" kind="Pod" apiVersion="v1" type="Warning" reason="NodeNotReady" message="Node is not ready"
	E0729 21:01:42.580728       1 clusterroleaggregation_controller.go:181] admin failed with : Operation cannot be fulfilled on clusterroles.rbac.authorization.k8s.io "admin": the object has been modified; please apply your changes to the latest version and try again
	I0729 21:01:42.604496       1 event.go:291] "Event occurred" object="kube-system/kube-proxy" kind="DaemonSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: kube-proxy-kp9qr"
	I0729 21:01:42.632091       1 shared_informer.go:240] Waiting for caches to sync for garbage collector
	I0729 21:01:42.725599       1 event.go:291] "Event occurred" object="kube-system/coredns-74ff55c5b" kind="ReplicaSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: coredns-74ff55c5b-xgldr"
	I0729 21:01:42.832317       1 shared_informer.go:247] Caches are synced for garbage collector 
	I0729 21:01:42.866766       1 shared_informer.go:247] Caches are synced for garbage collector 
	I0729 21:01:42.866814       1 garbagecollector.go:151] Garbage collector: all resource monitors have synced. Proceeding to collect garbage
	I0729 21:01:43.258946       1 request.go:655] Throttling request took 1.026204508s, request: GET:https://192.168.76.2:8443/apis/networking.k8s.io/v1beta1?timeout=32s
	I0729 21:01:43.835404       1 event.go:291] "Event occurred" object="kube-system/coredns" kind="Deployment" apiVersion="apps/v1" type="Normal" reason="ScalingReplicaSet" message="Scaled down replica set coredns-74ff55c5b to 1"
	I0729 21:01:43.893322       1 event.go:291] "Event occurred" object="kube-system/coredns-74ff55c5b" kind="ReplicaSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulDelete" message="Deleted pod: coredns-74ff55c5b-k6pth"
	I0729 21:01:44.061189       1 shared_informer.go:240] Waiting for caches to sync for resource quota
	I0729 21:01:44.061252       1 shared_informer.go:247] Caches are synced for resource quota 
	I0729 21:01:47.326757       1 node_lifecycle_controller.go:1222] Controller detected that some Nodes are Ready. Exiting master disruption mode.
	I0729 21:03:09.359445       1 event.go:291] "Event occurred" object="kube-system/metrics-server" kind="Deployment" apiVersion="apps/v1" type="Normal" reason="ScalingReplicaSet" message="Scaled up replica set metrics-server-9975d5f86 to 1"
	I0729 21:03:09.388528       1 event.go:291] "Event occurred" object="kube-system/metrics-server-9975d5f86" kind="ReplicaSet" apiVersion="apps/v1" type="Warning" reason="FailedCreate" message="Error creating: pods \"metrics-server-9975d5f86-\" is forbidden: error looking up service account kube-system/metrics-server: serviceaccount \"metrics-server\" not found"
	E0729 21:03:09.418035       1 replica_set.go:532] sync "kube-system/metrics-server-9975d5f86" failed with pods "metrics-server-9975d5f86-" is forbidden: error looking up service account kube-system/metrics-server: serviceaccount "metrics-server" not found
	E0729 21:03:09.517884       1 clusterroleaggregation_controller.go:181] admin failed with : Operation cannot be fulfilled on clusterroles.rbac.authorization.k8s.io "admin": the object has been modified; please apply your changes to the latest version and try again
	E0729 21:03:09.518352       1 clusterroleaggregation_controller.go:181] view failed with : Operation cannot be fulfilled on clusterroles.rbac.authorization.k8s.io "view": the object has been modified; please apply your changes to the latest version and try again
	
	
	==> kube-controller-manager [7e3ce8149fba57740e3a1eea6ee7778346b641b6e57850a9cad477449b277d98] <==
	E0729 21:05:11.872351       1 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
	I0729 21:05:16.632566       1 request.go:655] Throttling request took 1.048378413s, request: GET:https://192.168.76.2:8443/apis/apiextensions.k8s.io/v1beta1?timeout=32s
	W0729 21:05:17.484928       1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
	E0729 21:05:42.374220       1 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
	I0729 21:05:49.135422       1 request.go:655] Throttling request took 1.048375704s, request: GET:https://192.168.76.2:8443/apis/networking.k8s.io/v1beta1?timeout=32s
	W0729 21:05:49.987331       1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
	E0729 21:06:12.876141       1 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
	I0729 21:06:21.638943       1 request.go:655] Throttling request took 1.048191228s, request: GET:https://192.168.76.2:8443/apis/extensions/v1beta1?timeout=32s
	W0729 21:06:22.490263       1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
	E0729 21:06:43.377936       1 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
	I0729 21:06:54.140864       1 request.go:655] Throttling request took 1.048371149s, request: GET:https://192.168.76.2:8443/apis/extensions/v1beta1?timeout=32s
	W0729 21:06:54.992297       1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
	E0729 21:07:13.880119       1 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
	I0729 21:07:26.642847       1 request.go:655] Throttling request took 1.0481934s, request: GET:https://192.168.76.2:8443/apis/apiextensions.k8s.io/v1?timeout=32s
	W0729 21:07:27.494111       1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
	E0729 21:07:44.382111       1 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
	I0729 21:07:59.144528       1 request.go:655] Throttling request took 1.0480669s, request: GET:https://192.168.76.2:8443/apis/extensions/v1beta1?timeout=32s
	W0729 21:07:59.995939       1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
	E0729 21:08:14.885275       1 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
	I0729 21:08:31.646570       1 request.go:655] Throttling request took 1.047511731s, request: GET:https://192.168.76.2:8443/apis/authentication.k8s.io/v1beta1?timeout=32s
	W0729 21:08:32.497941       1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
	E0729 21:08:45.387285       1 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
	I0729 21:09:04.148421       1 request.go:655] Throttling request took 1.048596427s, request: GET:https://192.168.76.2:8443/apis/extensions/v1beta1?timeout=32s
	W0729 21:09:04.999810       1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
	E0729 21:09:15.889224       1 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
	
	
	==> kube-proxy [75750dba9bde8fdbcbdd8ebef671cf28647195630a985ee55cf6cd358325a7b2] <==
	I0729 21:03:55.325631       1 node.go:172] Successfully retrieved node IP: 192.168.76.2
	I0729 21:03:55.325780       1 server_others.go:142] kube-proxy node IP is an IPv4 address (192.168.76.2), assume IPv4 operation
	W0729 21:03:55.365731       1 server_others.go:578] Unknown proxy mode "", assuming iptables proxy
	I0729 21:03:55.365916       1 server_others.go:185] Using iptables Proxier.
	I0729 21:03:55.366211       1 server.go:650] Version: v1.20.0
	I0729 21:03:55.366816       1 config.go:224] Starting endpoint slice config controller
	I0729 21:03:55.366942       1 shared_informer.go:240] Waiting for caches to sync for endpoint slice config
	I0729 21:03:55.367218       1 config.go:315] Starting service config controller
	I0729 21:03:55.367311       1 shared_informer.go:240] Waiting for caches to sync for service config
	I0729 21:03:55.467090       1 shared_informer.go:247] Caches are synced for endpoint slice config 
	I0729 21:03:55.467493       1 shared_informer.go:247] Caches are synced for service config 
	
	
	==> kube-proxy [cc4846179f2a5f6f93c7bdb1f437618106e1a00f39b10534afcbbee12f518c4e] <==
	I0729 21:01:43.715071       1 node.go:172] Successfully retrieved node IP: 192.168.76.2
	I0729 21:01:43.715352       1 server_others.go:142] kube-proxy node IP is an IPv4 address (192.168.76.2), assume IPv4 operation
	W0729 21:01:43.747190       1 server_others.go:578] Unknown proxy mode "", assuming iptables proxy
	I0729 21:01:43.747303       1 server_others.go:185] Using iptables Proxier.
	I0729 21:01:43.747553       1 server.go:650] Version: v1.20.0
	I0729 21:01:43.748131       1 config.go:224] Starting endpoint slice config controller
	I0729 21:01:43.748152       1 shared_informer.go:240] Waiting for caches to sync for endpoint slice config
	I0729 21:01:43.748203       1 config.go:315] Starting service config controller
	I0729 21:01:43.748208       1 shared_informer.go:240] Waiting for caches to sync for service config
	I0729 21:01:43.848276       1 shared_informer.go:247] Caches are synced for service config 
	I0729 21:01:43.848385       1 shared_informer.go:247] Caches are synced for endpoint slice config 
	
	
	==> kube-scheduler [9abfa4fc0bdf34111d54edc320059e70f6aee2b65f28100e1019cce30562b30a] <==
	I0729 21:03:44.549757       1 serving.go:331] Generated self-signed cert in-memory
	W0729 21:03:50.423002       1 requestheader_controller.go:193] Unable to get configmap/extension-apiserver-authentication in kube-system.  Usually fixed by 'kubectl create rolebinding -n kube-system ROLEBINDING_NAME --role=extension-apiserver-authentication-reader --serviceaccount=YOUR_NS:YOUR_SA'
	W0729 21:03:50.423040       1 authentication.go:332] Error looking up in-cluster authentication configuration: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot get resource "configmaps" in API group "" in the namespace "kube-system"
	W0729 21:03:50.423053       1 authentication.go:333] Continuing without authentication configuration. This may treat all requests as anonymous.
	W0729 21:03:50.423059       1 authentication.go:334] To require authentication configuration lookup to succeed, set --authentication-tolerate-lookup-failure=false
	I0729 21:03:50.759430       1 secure_serving.go:197] Serving securely on 127.0.0.1:10259
	I0729 21:03:50.788061       1 configmap_cafile_content.go:202] Starting client-ca::kube-system::extension-apiserver-authentication::client-ca-file
	I0729 21:03:50.788091       1 shared_informer.go:240] Waiting for caches to sync for client-ca::kube-system::extension-apiserver-authentication::client-ca-file
	I0729 21:03:50.788118       1 tlsconfig.go:240] Starting DynamicServingCertificateController
	I0729 21:03:50.988297       1 shared_informer.go:247] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file 
	
	
	==> kube-scheduler [efa095c66551bd38c9deb191b3739441869b00874c7d3365c559609dcbd601c1] <==
	I0729 21:01:18.394745       1 serving.go:331] Generated self-signed cert in-memory
	W0729 21:01:23.329328       1 requestheader_controller.go:193] Unable to get configmap/extension-apiserver-authentication in kube-system.  Usually fixed by 'kubectl create rolebinding -n kube-system ROLEBINDING_NAME --role=extension-apiserver-authentication-reader --serviceaccount=YOUR_NS:YOUR_SA'
	W0729 21:01:23.329457       1 authentication.go:332] Error looking up in-cluster authentication configuration: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot get resource "configmaps" in API group "" in the namespace "kube-system"
	W0729 21:01:23.329501       1 authentication.go:333] Continuing without authentication configuration. This may treat all requests as anonymous.
	W0729 21:01:23.329576       1 authentication.go:334] To require authentication configuration lookup to succeed, set --authentication-tolerate-lookup-failure=false
	I0729 21:01:23.414354       1 secure_serving.go:197] Serving securely on 127.0.0.1:10259
	I0729 21:01:23.420169       1 tlsconfig.go:240] Starting DynamicServingCertificateController
	I0729 21:01:23.420249       1 configmap_cafile_content.go:202] Starting client-ca::kube-system::extension-apiserver-authentication::client-ca-file
	I0729 21:01:23.420258       1 shared_informer.go:240] Waiting for caches to sync for client-ca::kube-system::extension-apiserver-authentication::client-ca-file
	E0729 21:01:23.440072       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Node: failed to list *v1.Node: nodes is forbidden: User "system:kube-scheduler" cannot list resource "nodes" in API group "" at the cluster scope
	E0729 21:01:23.440161       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.PersistentVolume: failed to list *v1.PersistentVolume: persistentvolumes is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumes" in API group "" at the cluster scope
	E0729 21:01:23.440263       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.PersistentVolumeClaim: failed to list *v1.PersistentVolumeClaim: persistentvolumeclaims is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumeclaims" in API group "" at the cluster scope
	E0729 21:01:23.440415       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.StorageClass: failed to list *v1.StorageClass: storageclasses.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "storageclasses" in API group "storage.k8s.io" at the cluster scope
	E0729 21:01:23.440640       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.StatefulSet: failed to list *v1.StatefulSet: statefulsets.apps is forbidden: User "system:kube-scheduler" cannot list resource "statefulsets" in API group "apps" at the cluster scope
	E0729 21:01:23.440959       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1beta1.PodDisruptionBudget: failed to list *v1beta1.PodDisruptionBudget: poddisruptionbudgets.policy is forbidden: User "system:kube-scheduler" cannot list resource "poddisruptionbudgets" in API group "policy" at the cluster scope
	E0729 21:01:23.441317       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.CSINode: failed to list *v1.CSINode: csinodes.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csinodes" in API group "storage.k8s.io" at the cluster scope
	E0729 21:01:23.441656       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Service: failed to list *v1.Service: services is forbidden: User "system:kube-scheduler" cannot list resource "services" in API group "" at the cluster scope
	E0729 21:01:23.441938       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.ReplicaSet: failed to list *v1.ReplicaSet: replicasets.apps is forbidden: User "system:kube-scheduler" cannot list resource "replicasets" in API group "apps" at the cluster scope
	E0729 21:01:23.442106       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.ReplicationController: failed to list *v1.ReplicationController: replicationcontrollers is forbidden: User "system:kube-scheduler" cannot list resource "replicationcontrollers" in API group "" at the cluster scope
	E0729 21:01:23.442082       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Pod: failed to list *v1.Pod: pods is forbidden: User "system:kube-scheduler" cannot list resource "pods" in API group "" at the cluster scope
	E0729 21:01:23.458738       1 reflector.go:138] k8s.io/apiserver/pkg/server/dynamiccertificates/configmap_cafile_content.go:206: Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot list resource "configmaps" in API group "" in the namespace "kube-system"
	E0729 21:01:24.343570       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.StatefulSet: failed to list *v1.StatefulSet: statefulsets.apps is forbidden: User "system:kube-scheduler" cannot list resource "statefulsets" in API group "apps" at the cluster scope
	E0729 21:01:24.360211       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.ReplicaSet: failed to list *v1.ReplicaSet: replicasets.apps is forbidden: User "system:kube-scheduler" cannot list resource "replicasets" in API group "apps" at the cluster scope
	E0729 21:01:24.393949       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.PersistentVolumeClaim: failed to list *v1.PersistentVolumeClaim: persistentvolumeclaims is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumeclaims" in API group "" at the cluster scope
	I0729 21:01:25.120454       1 shared_informer.go:247] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file 
	
	
	==> kubelet <==
	Jul 29 21:08:00 old-k8s-version-884192 kubelet[665]: E0729 21:08:00.878649     665 pod_workers.go:191] Error syncing pod 27408590-ef02-4a20-bae0-3fb7ec51405b ("dashboard-metrics-scraper-8d5bb5db8-fgznv_kubernetes-dashboard(27408590-ef02-4a20-bae0-3fb7ec51405b)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-fgznv_kubernetes-dashboard(27408590-ef02-4a20-bae0-3fb7ec51405b)"
	Jul 29 21:08:09 old-k8s-version-884192 kubelet[665]: E0729 21:08:09.879004     665 pod_workers.go:191] Error syncing pod 0ffc056a-4cb7-448c-b912-bdc28b63e564 ("metrics-server-9975d5f86-b5bqk_kube-system(0ffc056a-4cb7-448c-b912-bdc28b63e564)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	Jul 29 21:08:15 old-k8s-version-884192 kubelet[665]: I0729 21:08:15.878210     665 scope.go:95] [topologymanager] RemoveContainer - Container ID: 551715fdc9241acf5a697db07991c198b35d4e3db030df08bada74c01ad4d18e
	Jul 29 21:08:15 old-k8s-version-884192 kubelet[665]: E0729 21:08:15.878557     665 pod_workers.go:191] Error syncing pod 27408590-ef02-4a20-bae0-3fb7ec51405b ("dashboard-metrics-scraper-8d5bb5db8-fgznv_kubernetes-dashboard(27408590-ef02-4a20-bae0-3fb7ec51405b)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-fgznv_kubernetes-dashboard(27408590-ef02-4a20-bae0-3fb7ec51405b)"
	Jul 29 21:08:24 old-k8s-version-884192 kubelet[665]: E0729 21:08:24.879141     665 pod_workers.go:191] Error syncing pod 0ffc056a-4cb7-448c-b912-bdc28b63e564 ("metrics-server-9975d5f86-b5bqk_kube-system(0ffc056a-4cb7-448c-b912-bdc28b63e564)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	Jul 29 21:08:29 old-k8s-version-884192 kubelet[665]: I0729 21:08:29.878207     665 scope.go:95] [topologymanager] RemoveContainer - Container ID: 551715fdc9241acf5a697db07991c198b35d4e3db030df08bada74c01ad4d18e
	Jul 29 21:08:29 old-k8s-version-884192 kubelet[665]: E0729 21:08:29.878560     665 pod_workers.go:191] Error syncing pod 27408590-ef02-4a20-bae0-3fb7ec51405b ("dashboard-metrics-scraper-8d5bb5db8-fgznv_kubernetes-dashboard(27408590-ef02-4a20-bae0-3fb7ec51405b)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-fgznv_kubernetes-dashboard(27408590-ef02-4a20-bae0-3fb7ec51405b)"
	Jul 29 21:08:39 old-k8s-version-884192 kubelet[665]: E0729 21:08:39.879359     665 pod_workers.go:191] Error syncing pod 0ffc056a-4cb7-448c-b912-bdc28b63e564 ("metrics-server-9975d5f86-b5bqk_kube-system(0ffc056a-4cb7-448c-b912-bdc28b63e564)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	Jul 29 21:08:41 old-k8s-version-884192 kubelet[665]: I0729 21:08:41.878267     665 scope.go:95] [topologymanager] RemoveContainer - Container ID: 551715fdc9241acf5a697db07991c198b35d4e3db030df08bada74c01ad4d18e
	Jul 29 21:08:41 old-k8s-version-884192 kubelet[665]: E0729 21:08:41.878632     665 pod_workers.go:191] Error syncing pod 27408590-ef02-4a20-bae0-3fb7ec51405b ("dashboard-metrics-scraper-8d5bb5db8-fgznv_kubernetes-dashboard(27408590-ef02-4a20-bae0-3fb7ec51405b)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-fgznv_kubernetes-dashboard(27408590-ef02-4a20-bae0-3fb7ec51405b)"
	Jul 29 21:08:52 old-k8s-version-884192 kubelet[665]: I0729 21:08:52.878298     665 scope.go:95] [topologymanager] RemoveContainer - Container ID: 551715fdc9241acf5a697db07991c198b35d4e3db030df08bada74c01ad4d18e
	Jul 29 21:08:52 old-k8s-version-884192 kubelet[665]: E0729 21:08:52.878623     665 pod_workers.go:191] Error syncing pod 27408590-ef02-4a20-bae0-3fb7ec51405b ("dashboard-metrics-scraper-8d5bb5db8-fgznv_kubernetes-dashboard(27408590-ef02-4a20-bae0-3fb7ec51405b)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-fgznv_kubernetes-dashboard(27408590-ef02-4a20-bae0-3fb7ec51405b)"
	Jul 29 21:08:54 old-k8s-version-884192 kubelet[665]: E0729 21:08:54.878991     665 pod_workers.go:191] Error syncing pod 0ffc056a-4cb7-448c-b912-bdc28b63e564 ("metrics-server-9975d5f86-b5bqk_kube-system(0ffc056a-4cb7-448c-b912-bdc28b63e564)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	Jul 29 21:09:05 old-k8s-version-884192 kubelet[665]: E0729 21:09:05.879120     665 pod_workers.go:191] Error syncing pod 0ffc056a-4cb7-448c-b912-bdc28b63e564 ("metrics-server-9975d5f86-b5bqk_kube-system(0ffc056a-4cb7-448c-b912-bdc28b63e564)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	Jul 29 21:09:07 old-k8s-version-884192 kubelet[665]: I0729 21:09:07.878224     665 scope.go:95] [topologymanager] RemoveContainer - Container ID: 551715fdc9241acf5a697db07991c198b35d4e3db030df08bada74c01ad4d18e
	Jul 29 21:09:07 old-k8s-version-884192 kubelet[665]: E0729 21:09:07.878565     665 pod_workers.go:191] Error syncing pod 27408590-ef02-4a20-bae0-3fb7ec51405b ("dashboard-metrics-scraper-8d5bb5db8-fgznv_kubernetes-dashboard(27408590-ef02-4a20-bae0-3fb7ec51405b)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-fgznv_kubernetes-dashboard(27408590-ef02-4a20-bae0-3fb7ec51405b)"
	Jul 29 21:09:18 old-k8s-version-884192 kubelet[665]: I0729 21:09:18.878733     665 scope.go:95] [topologymanager] RemoveContainer - Container ID: 551715fdc9241acf5a697db07991c198b35d4e3db030df08bada74c01ad4d18e
	Jul 29 21:09:18 old-k8s-version-884192 kubelet[665]: E0729 21:09:18.879147     665 pod_workers.go:191] Error syncing pod 27408590-ef02-4a20-bae0-3fb7ec51405b ("dashboard-metrics-scraper-8d5bb5db8-fgznv_kubernetes-dashboard(27408590-ef02-4a20-bae0-3fb7ec51405b)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-fgznv_kubernetes-dashboard(27408590-ef02-4a20-bae0-3fb7ec51405b)"
	Jul 29 21:09:19 old-k8s-version-884192 kubelet[665]: E0729 21:09:19.879053     665 pod_workers.go:191] Error syncing pod 0ffc056a-4cb7-448c-b912-bdc28b63e564 ("metrics-server-9975d5f86-b5bqk_kube-system(0ffc056a-4cb7-448c-b912-bdc28b63e564)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	Jul 29 21:09:29 old-k8s-version-884192 kubelet[665]: I0729 21:09:29.878210     665 scope.go:95] [topologymanager] RemoveContainer - Container ID: 551715fdc9241acf5a697db07991c198b35d4e3db030df08bada74c01ad4d18e
	Jul 29 21:09:29 old-k8s-version-884192 kubelet[665]: E0729 21:09:29.878556     665 pod_workers.go:191] Error syncing pod 27408590-ef02-4a20-bae0-3fb7ec51405b ("dashboard-metrics-scraper-8d5bb5db8-fgznv_kubernetes-dashboard(27408590-ef02-4a20-bae0-3fb7ec51405b)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-fgznv_kubernetes-dashboard(27408590-ef02-4a20-bae0-3fb7ec51405b)"
	Jul 29 21:09:30 old-k8s-version-884192 kubelet[665]: E0729 21:09:30.887813     665 remote_image.go:113] PullImage "fake.domain/registry.k8s.io/echoserver:1.4" from image service failed: rpc error: code = Unknown desc = failed to pull and unpack image "fake.domain/registry.k8s.io/echoserver:1.4": failed to resolve reference "fake.domain/registry.k8s.io/echoserver:1.4": failed to do request: Head "https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host
	Jul 29 21:09:30 old-k8s-version-884192 kubelet[665]: E0729 21:09:30.888312     665 kuberuntime_image.go:51] Pull image "fake.domain/registry.k8s.io/echoserver:1.4" failed: rpc error: code = Unknown desc = failed to pull and unpack image "fake.domain/registry.k8s.io/echoserver:1.4": failed to resolve reference "fake.domain/registry.k8s.io/echoserver:1.4": failed to do request: Head "https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host
	Jul 29 21:09:30 old-k8s-version-884192 kubelet[665]: E0729 21:09:30.888544     665 kuberuntime_manager.go:829] container &Container{Name:metrics-server,Image:fake.domain/registry.k8s.io/echoserver:1.4,Command:[],Args:[--cert-dir=/tmp --secure-port=4443 --kubelet-preferred-address-types=InternalIP,ExternalIP,Hostname --kubelet-use-node-status-port --metric-resolution=60s --kubelet-insecure-tls],WorkingDir:,Ports:[]ContainerPort{ContainerPort{Name:https,HostPort:0,ContainerPort:4443,Protocol:TCP,HostIP:,},},Env:[]EnvVar{},Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{cpu: {{100 -3} {<nil>} 100m DecimalSI},memory: {{209715200 0} {<nil>}  BinarySI},},},VolumeMounts:[]VolumeMount{VolumeMount{Name:tmp-dir,ReadOnly:false,MountPath:/tmp,SubPath:,MountPropagation:nil,SubPathExpr:,},VolumeMount{Name:metrics-server-token-2bvqw,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,},},LivenessProbe:&Probe{Handler:Handler{Exec
:nil,HTTPGet:&HTTPGetAction{Path:/livez,Port:{1 0 https},Host:,Scheme:HTTPS,HTTPHeaders:[]HTTPHeader{},},TCPSocket:nil,},InitialDelaySeconds:0,TimeoutSeconds:1,PeriodSeconds:10,SuccessThreshold:1,FailureThreshold:3,},ReadinessProbe:&Probe{Handler:Handler{Exec:nil,HTTPGet:&HTTPGetAction{Path:/readyz,Port:{1 0 https},Host:,Scheme:HTTPS,HTTPHeaders:[]HTTPHeader{},},TCPSocket:nil,},InitialDelaySeconds:0,TimeoutSeconds:1,PeriodSeconds:10,SuccessThreshold:1,FailureThreshold:3,},Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:IfNotPresent,SecurityContext:&SecurityContext{Capabilities:nil,Privileged:nil,SELinuxOptions:nil,RunAsUser:*1000,RunAsNonRoot:*true,ReadOnlyRootFilesystem:*true,AllowPrivilegeEscalation:nil,RunAsGroup:nil,ProcMount:nil,WindowsOptions:nil,SeccompProfile:nil,},Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:File,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,} start failed in pod metrics-server-9975d5f86-b5bqk_kube-system(0ffc056
a-4cb7-448c-b912-bdc28b63e564): ErrImagePull: rpc error: code = Unknown desc = failed to pull and unpack image "fake.domain/registry.k8s.io/echoserver:1.4": failed to resolve reference "fake.domain/registry.k8s.io/echoserver:1.4": failed to do request: Head "https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host
	Jul 29 21:09:30 old-k8s-version-884192 kubelet[665]: E0729 21:09:30.888763     665 pod_workers.go:191] Error syncing pod 0ffc056a-4cb7-448c-b912-bdc28b63e564 ("metrics-server-9975d5f86-b5bqk_kube-system(0ffc056a-4cb7-448c-b912-bdc28b63e564)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host"
	
	
	==> kubernetes-dashboard [34f4a145168f7d8792c43d14323521b0156159cac751496bf394b9275ccc6838] <==
	2024/07/29 21:04:15 Starting overwatch
	2024/07/29 21:04:15 Using namespace: kubernetes-dashboard
	2024/07/29 21:04:15 Using in-cluster config to connect to apiserver
	2024/07/29 21:04:15 Using secret token for csrf signing
	2024/07/29 21:04:15 Initializing csrf token from kubernetes-dashboard-csrf secret
	2024/07/29 21:04:15 Empty token. Generating and storing in a secret kubernetes-dashboard-csrf
	2024/07/29 21:04:15 Successful initial request to the apiserver, version: v1.20.0
	2024/07/29 21:04:15 Generating JWE encryption key
	2024/07/29 21:04:15 New synchronizer has been registered: kubernetes-dashboard-key-holder-kubernetes-dashboard. Starting
	2024/07/29 21:04:15 Starting secret synchronizer for kubernetes-dashboard-key-holder in namespace kubernetes-dashboard
	2024/07/29 21:04:16 Initializing JWE encryption key from synchronized object
	2024/07/29 21:04:16 Creating in-cluster Sidecar client
	2024/07/29 21:04:16 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
	2024/07/29 21:04:16 Serving insecurely on HTTP port: 9090
	2024/07/29 21:04:46 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
	2024/07/29 21:05:16 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
	2024/07/29 21:05:46 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
	2024/07/29 21:06:16 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
	2024/07/29 21:06:46 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
	2024/07/29 21:07:16 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
	2024/07/29 21:07:46 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
	2024/07/29 21:08:16 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
	2024/07/29 21:08:46 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
	2024/07/29 21:09:16 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
	
	
	==> storage-provisioner [4f8799ba1d8a399271f1e0e41066a3adbc2d551c152aa5a3e66f5d0c73490740] <==
	I0729 21:04:40.978982       1 storage_provisioner.go:116] Initializing the minikube storage provisioner...
	I0729 21:04:40.992314       1 storage_provisioner.go:141] Storage provisioner initialized, now starting service!
	I0729 21:04:40.992365       1 leaderelection.go:243] attempting to acquire leader lease kube-system/k8s.io-minikube-hostpath...
	I0729 21:04:58.475458       1 leaderelection.go:253] successfully acquired lease kube-system/k8s.io-minikube-hostpath
	I0729 21:04:58.475842       1 controller.go:835] Starting provisioner controller k8s.io/minikube-hostpath_old-k8s-version-884192_e664b97c-36f0-4656-a44a-b6e067d388f8!
	I0729 21:04:58.483516       1 event.go:282] Event(v1.ObjectReference{Kind:"Endpoints", Namespace:"kube-system", Name:"k8s.io-minikube-hostpath", UID:"1bc35c1a-7c07-4c92-bcc6-ef13df2b2869", APIVersion:"v1", ResourceVersion:"853", FieldPath:""}): type: 'Normal' reason: 'LeaderElection' old-k8s-version-884192_e664b97c-36f0-4656-a44a-b6e067d388f8 became leader
	I0729 21:04:58.576675       1 controller.go:884] Started provisioner controller k8s.io/minikube-hostpath_old-k8s-version-884192_e664b97c-36f0-4656-a44a-b6e067d388f8!
	
	
	==> storage-provisioner [e688afd0f49445f228b8c750a4ab27a91e60c9078c51532fdfb7ba6584baee4d] <==
	I0729 21:03:55.333712       1 storage_provisioner.go:116] Initializing the minikube storage provisioner...
	F0729 21:04:25.335333       1 main.go:39] error getting server version: Get "https://10.96.0.1:443/version?timeout=32s": dial tcp 10.96.0.1:443: i/o timeout
	

                                                
                                                
-- /stdout --
helpers_test.go:254: (dbg) Run:  out/minikube-linux-arm64 status --format={{.APIServer}} -p old-k8s-version-884192 -n old-k8s-version-884192
helpers_test.go:261: (dbg) Run:  kubectl --context old-k8s-version-884192 get po -o=jsonpath={.items[*].metadata.name} -A --field-selector=status.phase!=Running
helpers_test.go:272: non-running pods: metrics-server-9975d5f86-b5bqk
helpers_test.go:274: ======> post-mortem[TestStartStop/group/old-k8s-version/serial/SecondStart]: describe non-running pods <======
helpers_test.go:277: (dbg) Run:  kubectl --context old-k8s-version-884192 describe pod metrics-server-9975d5f86-b5bqk
helpers_test.go:277: (dbg) Non-zero exit: kubectl --context old-k8s-version-884192 describe pod metrics-server-9975d5f86-b5bqk: exit status 1 (148.941588ms)

                                                
                                                
** stderr ** 
	Error from server (NotFound): pods "metrics-server-9975d5f86-b5bqk" not found

                                                
                                                
** /stderr **
helpers_test.go:279: kubectl --context old-k8s-version-884192 describe pod metrics-server-9975d5f86-b5bqk: exit status 1
--- FAIL: TestStartStop/group/old-k8s-version/serial/SecondStart (374.58s)

                                                
                                    

Test pass (303/336)

Order passed test Duration
3 TestDownloadOnly/v1.20.0/json-events 7.15
4 TestDownloadOnly/v1.20.0/preload-exists 0
8 TestDownloadOnly/v1.20.0/LogsDuration 0.07
9 TestDownloadOnly/v1.20.0/DeleteAll 0.21
10 TestDownloadOnly/v1.20.0/DeleteAlwaysSucceeds 0.13
12 TestDownloadOnly/v1.30.3/json-events 6.07
13 TestDownloadOnly/v1.30.3/preload-exists 0
17 TestDownloadOnly/v1.30.3/LogsDuration 0.07
18 TestDownloadOnly/v1.30.3/DeleteAll 0.2
19 TestDownloadOnly/v1.30.3/DeleteAlwaysSucceeds 0.15
21 TestDownloadOnly/v1.31.0-beta.0/json-events 6.25
22 TestDownloadOnly/v1.31.0-beta.0/preload-exists 0
26 TestDownloadOnly/v1.31.0-beta.0/LogsDuration 0.08
27 TestDownloadOnly/v1.31.0-beta.0/DeleteAll 0.21
28 TestDownloadOnly/v1.31.0-beta.0/DeleteAlwaysSucceeds 0.13
30 TestBinaryMirror 0.55
34 TestAddons/PreSetup/EnablingAddonOnNonExistingCluster 0.06
35 TestAddons/PreSetup/DisablingAddonOnNonExistingCluster 0.07
36 TestAddons/Setup 222.08
40 TestAddons/serial/GCPAuth/Namespaces 0.18
42 TestAddons/parallel/Registry 17.06
43 TestAddons/parallel/Ingress 18.78
44 TestAddons/parallel/InspektorGadget 11.83
45 TestAddons/parallel/MetricsServer 5.8
48 TestAddons/parallel/CSI 37.98
49 TestAddons/parallel/Headlamp 16.97
50 TestAddons/parallel/CloudSpanner 5.59
51 TestAddons/parallel/LocalPath 10.75
52 TestAddons/parallel/NvidiaDevicePlugin 5.66
53 TestAddons/parallel/Yakd 11.91
54 TestAddons/StoppedEnableDisable 12.22
55 TestCertOptions 34.58
56 TestCertExpiration 231.63
58 TestForceSystemdFlag 38.43
59 TestForceSystemdEnv 46.9
60 TestDockerEnvContainerd 44.84
65 TestErrorSpam/setup 29.24
66 TestErrorSpam/start 0.7
67 TestErrorSpam/status 0.96
68 TestErrorSpam/pause 1.65
69 TestErrorSpam/unpause 1.79
70 TestErrorSpam/stop 1.45
73 TestFunctional/serial/CopySyncFile 0
74 TestFunctional/serial/StartWithProxy 57.82
75 TestFunctional/serial/AuditLog 0
76 TestFunctional/serial/SoftStart 6.44
77 TestFunctional/serial/KubeContext 0.07
78 TestFunctional/serial/KubectlGetPods 0.09
81 TestFunctional/serial/CacheCmd/cache/add_remote 4.56
82 TestFunctional/serial/CacheCmd/cache/add_local 1.46
83 TestFunctional/serial/CacheCmd/cache/CacheDelete 0.06
84 TestFunctional/serial/CacheCmd/cache/list 0.06
85 TestFunctional/serial/CacheCmd/cache/verify_cache_inside_node 0.29
86 TestFunctional/serial/CacheCmd/cache/cache_reload 2.21
87 TestFunctional/serial/CacheCmd/cache/delete 0.13
88 TestFunctional/serial/MinikubeKubectlCmd 0.14
89 TestFunctional/serial/MinikubeKubectlCmdDirectly 0.13
90 TestFunctional/serial/ExtraConfig 47.28
91 TestFunctional/serial/ComponentHealth 0.1
92 TestFunctional/serial/LogsCmd 1.72
93 TestFunctional/serial/LogsFileCmd 1.8
94 TestFunctional/serial/InvalidService 4.43
96 TestFunctional/parallel/ConfigCmd 0.47
97 TestFunctional/parallel/DashboardCmd 11.36
98 TestFunctional/parallel/DryRun 0.51
99 TestFunctional/parallel/InternationalLanguage 0.3
100 TestFunctional/parallel/StatusCmd 1.18
104 TestFunctional/parallel/ServiceCmdConnect 10.64
105 TestFunctional/parallel/AddonsCmd 0.15
106 TestFunctional/parallel/PersistentVolumeClaim 24.77
108 TestFunctional/parallel/SSHCmd 0.73
109 TestFunctional/parallel/CpCmd 1.95
111 TestFunctional/parallel/FileSync 0.37
112 TestFunctional/parallel/CertSync 2.07
116 TestFunctional/parallel/NodeLabels 0.09
118 TestFunctional/parallel/NonActiveRuntimeDisabled 0.7
120 TestFunctional/parallel/License 0.26
121 TestFunctional/parallel/Version/short 0.06
122 TestFunctional/parallel/Version/components 1.15
123 TestFunctional/parallel/ImageCommands/ImageListShort 0.25
124 TestFunctional/parallel/ImageCommands/ImageListTable 0.29
125 TestFunctional/parallel/ImageCommands/ImageListJson 0.27
126 TestFunctional/parallel/ImageCommands/ImageListYaml 0.28
127 TestFunctional/parallel/ImageCommands/ImageBuild 3.01
128 TestFunctional/parallel/ImageCommands/Setup 0.76
129 TestFunctional/parallel/UpdateContextCmd/no_changes 0.16
130 TestFunctional/parallel/UpdateContextCmd/no_minikube_cluster 0.15
131 TestFunctional/parallel/UpdateContextCmd/no_clusters 0.15
132 TestFunctional/parallel/ImageCommands/ImageLoadDaemon 1.63
133 TestFunctional/parallel/ImageCommands/ImageReloadDaemon 1.37
134 TestFunctional/parallel/ImageCommands/ImageTagAndLoadDaemon 1.73
136 TestFunctional/parallel/TunnelCmd/serial/RunSecondTunnel 0.58
137 TestFunctional/parallel/TunnelCmd/serial/StartTunnel 0
139 TestFunctional/parallel/TunnelCmd/serial/WaitService/Setup 8.39
140 TestFunctional/parallel/ImageCommands/ImageSaveToFile 0.7
141 TestFunctional/parallel/ImageCommands/ImageRemove 0.57
142 TestFunctional/parallel/ImageCommands/ImageLoadFromFile 0.83
143 TestFunctional/parallel/ImageCommands/ImageSaveDaemon 0.67
144 TestFunctional/parallel/TunnelCmd/serial/WaitService/IngressIP 0.08
145 TestFunctional/parallel/TunnelCmd/serial/AccessDirect 0
149 TestFunctional/parallel/TunnelCmd/serial/DeleteTunnel 0.11
150 TestFunctional/parallel/ServiceCmd/DeployApp 6.22
151 TestFunctional/parallel/ServiceCmd/List 0.5
152 TestFunctional/parallel/ServiceCmd/JSONOutput 0.51
153 TestFunctional/parallel/ServiceCmd/HTTPS 0.38
154 TestFunctional/parallel/ServiceCmd/Format 0.38
155 TestFunctional/parallel/ServiceCmd/URL 0.39
156 TestFunctional/parallel/ProfileCmd/profile_not_create 0.4
157 TestFunctional/parallel/ProfileCmd/profile_list 0.41
158 TestFunctional/parallel/ProfileCmd/profile_json_output 0.62
159 TestFunctional/parallel/MountCmd/any-port 7.51
160 TestFunctional/parallel/MountCmd/specific-port 2.37
161 TestFunctional/parallel/MountCmd/VerifyCleanup 2.03
162 TestFunctional/delete_echo-server_images 0.04
163 TestFunctional/delete_my-image_image 0.02
164 TestFunctional/delete_minikube_cached_images 0.02
168 TestMultiControlPlane/serial/StartCluster 124.29
169 TestMultiControlPlane/serial/DeployApp 40.93
170 TestMultiControlPlane/serial/PingHostFromPods 1.55
171 TestMultiControlPlane/serial/AddWorkerNode 24.77
172 TestMultiControlPlane/serial/NodeLabels 0.11
173 TestMultiControlPlane/serial/HAppyAfterClusterStart 0.78
174 TestMultiControlPlane/serial/CopyFile 19.91
175 TestMultiControlPlane/serial/StopSecondaryNode 12.91
176 TestMultiControlPlane/serial/DegradedAfterControlPlaneNodeStop 0.55
177 TestMultiControlPlane/serial/RestartSecondaryNode 18.91
178 TestMultiControlPlane/serial/HAppyAfterSecondaryNodeRestart 0.78
179 TestMultiControlPlane/serial/RestartClusterKeepsNodes 143.72
180 TestMultiControlPlane/serial/DeleteSecondaryNode 10.6
181 TestMultiControlPlane/serial/DegradedAfterSecondaryNodeDelete 0.52
182 TestMultiControlPlane/serial/StopCluster 36.01
183 TestMultiControlPlane/serial/RestartCluster 78.17
184 TestMultiControlPlane/serial/DegradedAfterClusterRestart 0.54
185 TestMultiControlPlane/serial/AddSecondaryNode 46.61
186 TestMultiControlPlane/serial/HAppyAfterSecondaryNodeAdd 0.76
190 TestJSONOutput/start/Command 68.76
191 TestJSONOutput/start/Audit 0
193 TestJSONOutput/start/parallel/DistinctCurrentSteps 0
194 TestJSONOutput/start/parallel/IncreasingCurrentSteps 0
196 TestJSONOutput/pause/Command 0.74
197 TestJSONOutput/pause/Audit 0
199 TestJSONOutput/pause/parallel/DistinctCurrentSteps 0
200 TestJSONOutput/pause/parallel/IncreasingCurrentSteps 0
202 TestJSONOutput/unpause/Command 0.64
203 TestJSONOutput/unpause/Audit 0
205 TestJSONOutput/unpause/parallel/DistinctCurrentSteps 0
206 TestJSONOutput/unpause/parallel/IncreasingCurrentSteps 0
208 TestJSONOutput/stop/Command 5.77
209 TestJSONOutput/stop/Audit 0
211 TestJSONOutput/stop/parallel/DistinctCurrentSteps 0
212 TestJSONOutput/stop/parallel/IncreasingCurrentSteps 0
213 TestErrorJSONOutput 0.21
215 TestKicCustomNetwork/create_custom_network 38.52
216 TestKicCustomNetwork/use_default_bridge_network 34.97
217 TestKicExistingNetwork 34.63
218 TestKicCustomSubnet 33.79
219 TestKicStaticIP 36.57
220 TestMainNoArgs 0.05
221 TestMinikubeProfile 68.49
224 TestMountStart/serial/StartWithMountFirst 6.43
225 TestMountStart/serial/VerifyMountFirst 0.27
226 TestMountStart/serial/StartWithMountSecond 6.53
227 TestMountStart/serial/VerifyMountSecond 0.27
228 TestMountStart/serial/DeleteFirst 1.62
229 TestMountStart/serial/VerifyMountPostDelete 0.26
230 TestMountStart/serial/Stop 1.22
231 TestMountStart/serial/RestartStopped 7.78
232 TestMountStart/serial/VerifyMountPostStop 0.25
235 TestMultiNode/serial/FreshStart2Nodes 77.97
236 TestMultiNode/serial/DeployApp2Nodes 18.01
237 TestMultiNode/serial/PingHostFrom2Pods 1.01
238 TestMultiNode/serial/AddNode 17.65
239 TestMultiNode/serial/MultiNodeLabels 0.09
240 TestMultiNode/serial/ProfileList 0.33
241 TestMultiNode/serial/CopyFile 10.12
242 TestMultiNode/serial/StopNode 2.26
243 TestMultiNode/serial/StartAfterStop 9.79
244 TestMultiNode/serial/RestartKeepsNodes 87.17
245 TestMultiNode/serial/DeleteNode 5.54
246 TestMultiNode/serial/StopMultiNode 24.01
247 TestMultiNode/serial/RestartMultiNode 56.43
248 TestMultiNode/serial/ValidateNameConflict 31.92
253 TestPreload 108.18
255 TestScheduledStopUnix 104.83
258 TestInsufficientStorage 11.24
259 TestRunningBinaryUpgrade 82.58
261 TestKubernetesUpgrade 346.41
262 TestMissingContainerUpgrade 172.25
264 TestNoKubernetes/serial/StartNoK8sWithVersion 0.07
265 TestNoKubernetes/serial/StartWithK8s 41.86
266 TestNoKubernetes/serial/StartWithStopK8s 17.59
267 TestNoKubernetes/serial/Start 8.89
268 TestNoKubernetes/serial/VerifyK8sNotRunning 0.33
269 TestNoKubernetes/serial/ProfileList 1.16
270 TestNoKubernetes/serial/Stop 1.28
271 TestNoKubernetes/serial/StartNoArgs 7.7
272 TestNoKubernetes/serial/VerifyK8sNotRunningSecond 0.3
273 TestStoppedBinaryUpgrade/Setup 1.19
274 TestStoppedBinaryUpgrade/Upgrade 106.07
275 TestStoppedBinaryUpgrade/MinikubeLogs 1.22
284 TestPause/serial/Start 71.89
285 TestPause/serial/SecondStartNoReconfiguration 7.33
286 TestPause/serial/Pause 0.91
287 TestPause/serial/VerifyStatus 0.4
288 TestPause/serial/Unpause 0.82
289 TestPause/serial/PauseAgain 1.11
290 TestPause/serial/DeletePaused 2.81
291 TestPause/serial/VerifyDeletedResources 0.45
299 TestNetworkPlugins/group/false 4.64
304 TestStartStop/group/old-k8s-version/serial/FirstStart 134.99
305 TestStartStop/group/old-k8s-version/serial/DeployApp 9.67
306 TestStartStop/group/old-k8s-version/serial/EnableAddonWhileActive 1.49
307 TestStartStop/group/old-k8s-version/serial/Stop 12.71
309 TestStartStop/group/no-preload/serial/FirstStart 68.74
310 TestStartStop/group/old-k8s-version/serial/EnableAddonAfterStop 0.24
312 TestStartStop/group/no-preload/serial/DeployApp 10.34
313 TestStartStop/group/no-preload/serial/EnableAddonWhileActive 1.13
314 TestStartStop/group/no-preload/serial/Stop 12.07
315 TestStartStop/group/no-preload/serial/EnableAddonAfterStop 0.18
316 TestStartStop/group/no-preload/serial/SecondStart 267.51
317 TestStartStop/group/no-preload/serial/UserAppExistsAfterStop 6.01
318 TestStartStop/group/no-preload/serial/AddonExistsAfterStop 5.11
319 TestStartStop/group/no-preload/serial/VerifyKubernetesImages 0.23
320 TestStartStop/group/no-preload/serial/Pause 3.04
322 TestStartStop/group/embed-certs/serial/FirstStart 78.17
323 TestStartStop/group/old-k8s-version/serial/UserAppExistsAfterStop 6.01
324 TestStartStop/group/old-k8s-version/serial/AddonExistsAfterStop 6.12
325 TestStartStop/group/old-k8s-version/serial/VerifyKubernetesImages 0.28
326 TestStartStop/group/old-k8s-version/serial/Pause 3.62
328 TestStartStop/group/default-k8s-diff-port/serial/FirstStart 78.55
329 TestStartStop/group/embed-certs/serial/DeployApp 8.34
330 TestStartStop/group/embed-certs/serial/EnableAddonWhileActive 1.13
331 TestStartStop/group/embed-certs/serial/Stop 12.03
332 TestStartStop/group/embed-certs/serial/EnableAddonAfterStop 0.19
333 TestStartStop/group/embed-certs/serial/SecondStart 289.46
334 TestStartStop/group/default-k8s-diff-port/serial/DeployApp 10.49
335 TestStartStop/group/default-k8s-diff-port/serial/EnableAddonWhileActive 1.67
336 TestStartStop/group/default-k8s-diff-port/serial/Stop 12.21
337 TestStartStop/group/default-k8s-diff-port/serial/EnableAddonAfterStop 0.19
338 TestStartStop/group/default-k8s-diff-port/serial/SecondStart 270.18
339 TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop 6.01
340 TestStartStop/group/embed-certs/serial/AddonExistsAfterStop 5.11
341 TestStartStop/group/default-k8s-diff-port/serial/UserAppExistsAfterStop 6.01
342 TestStartStop/group/embed-certs/serial/VerifyKubernetesImages 0.26
343 TestStartStop/group/embed-certs/serial/Pause 3.15
344 TestStartStop/group/default-k8s-diff-port/serial/AddonExistsAfterStop 6.12
346 TestStartStop/group/newest-cni/serial/FirstStart 47.43
347 TestStartStop/group/default-k8s-diff-port/serial/VerifyKubernetesImages 0.26
348 TestStartStop/group/default-k8s-diff-port/serial/Pause 4.02
349 TestNetworkPlugins/group/auto/Start 69.33
350 TestStartStop/group/newest-cni/serial/DeployApp 0
351 TestStartStop/group/newest-cni/serial/EnableAddonWhileActive 2.17
352 TestStartStop/group/newest-cni/serial/Stop 1.3
353 TestStartStop/group/newest-cni/serial/EnableAddonAfterStop 0.22
354 TestStartStop/group/newest-cni/serial/SecondStart 19.62
355 TestStartStop/group/newest-cni/serial/UserAppExistsAfterStop 0
356 TestStartStop/group/newest-cni/serial/AddonExistsAfterStop 0
357 TestStartStop/group/newest-cni/serial/VerifyKubernetesImages 0.25
358 TestStartStop/group/newest-cni/serial/Pause 3.11
359 TestNetworkPlugins/group/kindnet/Start 65.73
360 TestNetworkPlugins/group/auto/KubeletFlags 0.38
361 TestNetworkPlugins/group/auto/NetCatPod 11.45
362 TestNetworkPlugins/group/auto/DNS 0.27
363 TestNetworkPlugins/group/auto/Localhost 0.24
364 TestNetworkPlugins/group/auto/HairPin 0.18
365 TestNetworkPlugins/group/calico/Start 78.01
366 TestNetworkPlugins/group/kindnet/ControllerPod 6.01
367 TestNetworkPlugins/group/kindnet/KubeletFlags 0.34
368 TestNetworkPlugins/group/kindnet/NetCatPod 10.29
369 TestNetworkPlugins/group/kindnet/DNS 0.17
370 TestNetworkPlugins/group/kindnet/Localhost 0.18
371 TestNetworkPlugins/group/kindnet/HairPin 0.17
372 TestNetworkPlugins/group/custom-flannel/Start 62.08
373 TestNetworkPlugins/group/calico/ControllerPod 6.02
374 TestNetworkPlugins/group/calico/KubeletFlags 0.38
375 TestNetworkPlugins/group/calico/NetCatPod 11.32
376 TestNetworkPlugins/group/calico/DNS 0.26
377 TestNetworkPlugins/group/calico/Localhost 0.33
378 TestNetworkPlugins/group/calico/HairPin 0.28
379 TestNetworkPlugins/group/enable-default-cni/Start 52.6
380 TestNetworkPlugins/group/custom-flannel/KubeletFlags 0.58
381 TestNetworkPlugins/group/custom-flannel/NetCatPod 10.46
382 TestNetworkPlugins/group/custom-flannel/DNS 0.3
383 TestNetworkPlugins/group/custom-flannel/Localhost 0.19
384 TestNetworkPlugins/group/custom-flannel/HairPin 0.23
385 TestNetworkPlugins/group/flannel/Start 69.86
386 TestNetworkPlugins/group/enable-default-cni/KubeletFlags 0.3
387 TestNetworkPlugins/group/enable-default-cni/NetCatPod 11.28
388 TestNetworkPlugins/group/enable-default-cni/DNS 0.22
389 TestNetworkPlugins/group/enable-default-cni/Localhost 0.22
390 TestNetworkPlugins/group/enable-default-cni/HairPin 0.26
391 TestNetworkPlugins/group/bridge/Start 87.48
392 TestNetworkPlugins/group/flannel/ControllerPod 6.01
393 TestNetworkPlugins/group/flannel/KubeletFlags 0.35
394 TestNetworkPlugins/group/flannel/NetCatPod 9.51
395 TestNetworkPlugins/group/flannel/DNS 0.2
396 TestNetworkPlugins/group/flannel/Localhost 0.15
397 TestNetworkPlugins/group/flannel/HairPin 0.18
398 TestNetworkPlugins/group/bridge/KubeletFlags 0.27
399 TestNetworkPlugins/group/bridge/NetCatPod 9.26
400 TestNetworkPlugins/group/bridge/DNS 0.17
401 TestNetworkPlugins/group/bridge/Localhost 0.15
402 TestNetworkPlugins/group/bridge/HairPin 0.15
x
+
TestDownloadOnly/v1.20.0/json-events (7.15s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.20.0/json-events
aaa_download_only_test.go:81: (dbg) Run:  out/minikube-linux-arm64 start -o=json --download-only -p download-only-651312 --force --alsologtostderr --kubernetes-version=v1.20.0 --container-runtime=containerd --driver=docker  --container-runtime=containerd
aaa_download_only_test.go:81: (dbg) Done: out/minikube-linux-arm64 start -o=json --download-only -p download-only-651312 --force --alsologtostderr --kubernetes-version=v1.20.0 --container-runtime=containerd --driver=docker  --container-runtime=containerd: (7.1484218s)
--- PASS: TestDownloadOnly/v1.20.0/json-events (7.15s)

                                                
                                    
x
+
TestDownloadOnly/v1.20.0/preload-exists (0s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.20.0/preload-exists
--- PASS: TestDownloadOnly/v1.20.0/preload-exists (0.00s)

                                                
                                    
x
+
TestDownloadOnly/v1.20.0/LogsDuration (0.07s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.20.0/LogsDuration
aaa_download_only_test.go:184: (dbg) Run:  out/minikube-linux-arm64 logs -p download-only-651312
aaa_download_only_test.go:184: (dbg) Non-zero exit: out/minikube-linux-arm64 logs -p download-only-651312: exit status 85 (71.33276ms)

                                                
                                                
-- stdout --
	
	==> Audit <==
	|---------|--------------------------------|----------------------|---------|---------|---------------------|----------|
	| Command |              Args              |       Profile        |  User   | Version |     Start Time      | End Time |
	|---------|--------------------------------|----------------------|---------|---------|---------------------|----------|
	| start   | -o=json --download-only        | download-only-651312 | jenkins | v1.33.1 | 29 Jul 24 20:12 UTC |          |
	|         | -p download-only-651312        |                      |         |         |                     |          |
	|         | --force --alsologtostderr      |                      |         |         |                     |          |
	|         | --kubernetes-version=v1.20.0   |                      |         |         |                     |          |
	|         | --container-runtime=containerd |                      |         |         |                     |          |
	|         | --driver=docker                |                      |         |         |                     |          |
	|         | --container-runtime=containerd |                      |         |         |                     |          |
	|---------|--------------------------------|----------------------|---------|---------|---------------------|----------|
	
	
	==> Last Start <==
	Log file created at: 2024/07/29 20:12:52
	Running on machine: ip-172-31-29-130
	Binary: Built with gc go1.22.5 for linux/arm64
	Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg
	I0729 20:12:52.455620  139734 out.go:291] Setting OutFile to fd 1 ...
	I0729 20:12:52.455757  139734 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0729 20:12:52.455767  139734 out.go:304] Setting ErrFile to fd 2...
	I0729 20:12:52.455773  139734 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0729 20:12:52.456031  139734 root.go:338] Updating PATH: /home/jenkins/minikube-integration/19339-134334/.minikube/bin
	W0729 20:12:52.456161  139734 root.go:314] Error reading config file at /home/jenkins/minikube-integration/19339-134334/.minikube/config/config.json: open /home/jenkins/minikube-integration/19339-134334/.minikube/config/config.json: no such file or directory
	I0729 20:12:52.456557  139734 out.go:298] Setting JSON to true
	I0729 20:12:52.457463  139734 start.go:129] hostinfo: {"hostname":"ip-172-31-29-130","uptime":64518,"bootTime":1722219454,"procs":173,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1065-aws","kernelArch":"aarch64","virtualizationSystem":"","virtualizationRole":"","hostId":"36adf542-ef4f-4e2d-a0c8-6868d1383ff9"}
	I0729 20:12:52.457533  139734 start.go:139] virtualization:  
	I0729 20:12:52.461089  139734 out.go:97] [download-only-651312] minikube v1.33.1 on Ubuntu 20.04 (arm64)
	W0729 20:12:52.461213  139734 preload.go:293] Failed to list preload files: open /home/jenkins/minikube-integration/19339-134334/.minikube/cache/preloaded-tarball: no such file or directory
	I0729 20:12:52.461253  139734 notify.go:220] Checking for updates...
	I0729 20:12:52.463763  139734 out.go:169] MINIKUBE_LOCATION=19339
	I0729 20:12:52.465534  139734 out.go:169] MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I0729 20:12:52.467389  139734 out.go:169] KUBECONFIG=/home/jenkins/minikube-integration/19339-134334/kubeconfig
	I0729 20:12:52.470953  139734 out.go:169] MINIKUBE_HOME=/home/jenkins/minikube-integration/19339-134334/.minikube
	I0729 20:12:52.473346  139734 out.go:169] MINIKUBE_BIN=out/minikube-linux-arm64
	W0729 20:12:52.477083  139734 out.go:267] minikube skips various validations when --force is supplied; this may lead to unexpected behavior
	I0729 20:12:52.477407  139734 driver.go:392] Setting default libvirt URI to qemu:///system
	I0729 20:12:52.505582  139734 docker.go:123] docker version: linux-27.1.1:Docker Engine - Community
	I0729 20:12:52.505678  139734 cli_runner.go:164] Run: docker system info --format "{{json .}}"
	I0729 20:12:52.564788  139734 info.go:266] docker info: {ID:U5VK:ZNT5:35M3:FHLW:Q7TL:ELFX:BNAG:AV4T:UD2H:SK5L:SEJV:SJJL Containers:0 ContainersRunning:0 ContainersPaused:0 ContainersStopped:0 Images:1 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:29 OomKillDisable:true NGoroutines:51 SystemTime:2024-07-29 20:12:52.555799055 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1065-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Architecture:aar
ch64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8214900736 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-29-130 Labels:[] ExperimentalBuild:false ServerVersion:27.1.1 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:2bf793ef6dc9a18e00cb12efb64355c2c9d5eb41 Expected:2bf793ef6dc9a18e00cb12efb64355c2c9d5eb41} RuncCommit:{ID:v1.1.13-0-g58aa920 Expected:v1.1.13-0-g58aa920} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:<nil> ServerErro
rs:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.16.1] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.29.1]] Warnings:<nil>}}
	I0729 20:12:52.564910  139734 docker.go:307] overlay module found
	I0729 20:12:52.566893  139734 out.go:97] Using the docker driver based on user configuration
	I0729 20:12:52.566928  139734 start.go:297] selected driver: docker
	I0729 20:12:52.566938  139734 start.go:901] validating driver "docker" against <nil>
	I0729 20:12:52.567056  139734 cli_runner.go:164] Run: docker system info --format "{{json .}}"
	I0729 20:12:52.620004  139734 info.go:266] docker info: {ID:U5VK:ZNT5:35M3:FHLW:Q7TL:ELFX:BNAG:AV4T:UD2H:SK5L:SEJV:SJJL Containers:0 ContainersRunning:0 ContainersPaused:0 ContainersStopped:0 Images:1 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:29 OomKillDisable:true NGoroutines:51 SystemTime:2024-07-29 20:12:52.610500613 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1065-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Architecture:aar
ch64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8214900736 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-29-130 Labels:[] ExperimentalBuild:false ServerVersion:27.1.1 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:2bf793ef6dc9a18e00cb12efb64355c2c9d5eb41 Expected:2bf793ef6dc9a18e00cb12efb64355c2c9d5eb41} RuncCommit:{ID:v1.1.13-0-g58aa920 Expected:v1.1.13-0-g58aa920} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:<nil> ServerErro
rs:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.16.1] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.29.1]] Warnings:<nil>}}
	I0729 20:12:52.620170  139734 start_flags.go:310] no existing cluster config was found, will generate one from the flags 
	I0729 20:12:52.620448  139734 start_flags.go:393] Using suggested 2200MB memory alloc based on sys=7834MB, container=7834MB
	I0729 20:12:52.620609  139734 start_flags.go:929] Wait components to verify : map[apiserver:true system_pods:true]
	I0729 20:12:52.622997  139734 out.go:169] Using Docker driver with root privileges
	I0729 20:12:52.624963  139734 cni.go:84] Creating CNI manager for ""
	I0729 20:12:52.624986  139734 cni.go:143] "docker" driver + "containerd" runtime found, recommending kindnet
	I0729 20:12:52.625005  139734 start_flags.go:319] Found "CNI" CNI - setting NetworkPlugin=cni
	I0729 20:12:52.625098  139734 start.go:340] cluster config:
	{Name:download-only-651312 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721902582-19326@sha256:540fb5dc7f38be17ff5276a38dfe6c8a4b1d9ba1c27c62244e6eebd7e37696e7 Memory:2200 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:download-only-651312 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local Co
ntainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I0729 20:12:52.627002  139734 out.go:97] Starting "download-only-651312" primary control-plane node in "download-only-651312" cluster
	I0729 20:12:52.627029  139734 cache.go:121] Beginning downloading kic base image for docker with containerd
	I0729 20:12:52.628541  139734 out.go:97] Pulling base image v0.0.44-1721902582-19326 ...
	I0729 20:12:52.628565  139734 preload.go:131] Checking if preload exists for k8s version v1.20.0 and runtime containerd
	I0729 20:12:52.628625  139734 image.go:79] Checking for gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721902582-19326@sha256:540fb5dc7f38be17ff5276a38dfe6c8a4b1d9ba1c27c62244e6eebd7e37696e7 in local docker daemon
	I0729 20:12:52.644149  139734 cache.go:149] Downloading gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721902582-19326@sha256:540fb5dc7f38be17ff5276a38dfe6c8a4b1d9ba1c27c62244e6eebd7e37696e7 to local cache
	I0729 20:12:52.645248  139734 image.go:63] Checking for gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721902582-19326@sha256:540fb5dc7f38be17ff5276a38dfe6c8a4b1d9ba1c27c62244e6eebd7e37696e7 in local cache directory
	I0729 20:12:52.645357  139734 image.go:148] Writing gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721902582-19326@sha256:540fb5dc7f38be17ff5276a38dfe6c8a4b1d9ba1c27c62244e6eebd7e37696e7 to local cache
	I0729 20:12:52.700326  139734 preload.go:118] Found remote preload: https://storage.googleapis.com/minikube-preloaded-volume-tarballs/v18/v1.20.0/preloaded-images-k8s-v18-v1.20.0-containerd-overlay2-arm64.tar.lz4
	I0729 20:12:52.700350  139734 cache.go:56] Caching tarball of preloaded images
	I0729 20:12:52.700526  139734 preload.go:131] Checking if preload exists for k8s version v1.20.0 and runtime containerd
	I0729 20:12:52.702484  139734 out.go:97] Downloading Kubernetes v1.20.0 preload ...
	I0729 20:12:52.702506  139734 preload.go:236] getting checksum for preloaded-images-k8s-v18-v1.20.0-containerd-overlay2-arm64.tar.lz4 ...
	I0729 20:12:52.790441  139734 download.go:107] Downloading: https://storage.googleapis.com/minikube-preloaded-volume-tarballs/v18/v1.20.0/preloaded-images-k8s-v18-v1.20.0-containerd-overlay2-arm64.tar.lz4?checksum=md5:7e3d48ccb9f143791669d02e14ce1643 -> /home/jenkins/minikube-integration/19339-134334/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-containerd-overlay2-arm64.tar.lz4
	I0729 20:12:56.823919  139734 cache.go:152] successfully saved gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721902582-19326@sha256:540fb5dc7f38be17ff5276a38dfe6c8a4b1d9ba1c27c62244e6eebd7e37696e7 as a tarball
	
	
	* The control-plane node download-only-651312 host does not exist
	  To start a cluster, run: "minikube start -p download-only-651312"

                                                
                                                
-- /stdout --
aaa_download_only_test.go:185: minikube logs failed with error: exit status 85
--- PASS: TestDownloadOnly/v1.20.0/LogsDuration (0.07s)

                                                
                                    
x
+
TestDownloadOnly/v1.20.0/DeleteAll (0.21s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.20.0/DeleteAll
aaa_download_only_test.go:197: (dbg) Run:  out/minikube-linux-arm64 delete --all
--- PASS: TestDownloadOnly/v1.20.0/DeleteAll (0.21s)

                                                
                                    
x
+
TestDownloadOnly/v1.20.0/DeleteAlwaysSucceeds (0.13s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.20.0/DeleteAlwaysSucceeds
aaa_download_only_test.go:208: (dbg) Run:  out/minikube-linux-arm64 delete -p download-only-651312
--- PASS: TestDownloadOnly/v1.20.0/DeleteAlwaysSucceeds (0.13s)

                                                
                                    
x
+
TestDownloadOnly/v1.30.3/json-events (6.07s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.30.3/json-events
aaa_download_only_test.go:81: (dbg) Run:  out/minikube-linux-arm64 start -o=json --download-only -p download-only-877691 --force --alsologtostderr --kubernetes-version=v1.30.3 --container-runtime=containerd --driver=docker  --container-runtime=containerd
aaa_download_only_test.go:81: (dbg) Done: out/minikube-linux-arm64 start -o=json --download-only -p download-only-877691 --force --alsologtostderr --kubernetes-version=v1.30.3 --container-runtime=containerd --driver=docker  --container-runtime=containerd: (6.073663225s)
--- PASS: TestDownloadOnly/v1.30.3/json-events (6.07s)

                                                
                                    
x
+
TestDownloadOnly/v1.30.3/preload-exists (0s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.30.3/preload-exists
--- PASS: TestDownloadOnly/v1.30.3/preload-exists (0.00s)

                                                
                                    
x
+
TestDownloadOnly/v1.30.3/LogsDuration (0.07s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.30.3/LogsDuration
aaa_download_only_test.go:184: (dbg) Run:  out/minikube-linux-arm64 logs -p download-only-877691
aaa_download_only_test.go:184: (dbg) Non-zero exit: out/minikube-linux-arm64 logs -p download-only-877691: exit status 85 (73.761251ms)

                                                
                                                
-- stdout --
	
	==> Audit <==
	|---------|--------------------------------|----------------------|---------|---------|---------------------|---------------------|
	| Command |              Args              |       Profile        |  User   | Version |     Start Time      |      End Time       |
	|---------|--------------------------------|----------------------|---------|---------|---------------------|---------------------|
	| start   | -o=json --download-only        | download-only-651312 | jenkins | v1.33.1 | 29 Jul 24 20:12 UTC |                     |
	|         | -p download-only-651312        |                      |         |         |                     |                     |
	|         | --force --alsologtostderr      |                      |         |         |                     |                     |
	|         | --kubernetes-version=v1.20.0   |                      |         |         |                     |                     |
	|         | --container-runtime=containerd |                      |         |         |                     |                     |
	|         | --driver=docker                |                      |         |         |                     |                     |
	|         | --container-runtime=containerd |                      |         |         |                     |                     |
	| delete  | --all                          | minikube             | jenkins | v1.33.1 | 29 Jul 24 20:12 UTC | 29 Jul 24 20:12 UTC |
	| delete  | -p download-only-651312        | download-only-651312 | jenkins | v1.33.1 | 29 Jul 24 20:12 UTC | 29 Jul 24 20:12 UTC |
	| start   | -o=json --download-only        | download-only-877691 | jenkins | v1.33.1 | 29 Jul 24 20:13 UTC |                     |
	|         | -p download-only-877691        |                      |         |         |                     |                     |
	|         | --force --alsologtostderr      |                      |         |         |                     |                     |
	|         | --kubernetes-version=v1.30.3   |                      |         |         |                     |                     |
	|         | --container-runtime=containerd |                      |         |         |                     |                     |
	|         | --driver=docker                |                      |         |         |                     |                     |
	|         | --container-runtime=containerd |                      |         |         |                     |                     |
	|---------|--------------------------------|----------------------|---------|---------|---------------------|---------------------|
	
	
	==> Last Start <==
	Log file created at: 2024/07/29 20:13:00
	Running on machine: ip-172-31-29-130
	Binary: Built with gc go1.22.5 for linux/arm64
	Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg
	I0729 20:13:00.017912  139939 out.go:291] Setting OutFile to fd 1 ...
	I0729 20:13:00.018223  139939 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0729 20:13:00.018255  139939 out.go:304] Setting ErrFile to fd 2...
	I0729 20:13:00.018274  139939 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0729 20:13:00.018605  139939 root.go:338] Updating PATH: /home/jenkins/minikube-integration/19339-134334/.minikube/bin
	I0729 20:13:00.019484  139939 out.go:298] Setting JSON to true
	I0729 20:13:00.021419  139939 start.go:129] hostinfo: {"hostname":"ip-172-31-29-130","uptime":64526,"bootTime":1722219454,"procs":171,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1065-aws","kernelArch":"aarch64","virtualizationSystem":"","virtualizationRole":"","hostId":"36adf542-ef4f-4e2d-a0c8-6868d1383ff9"}
	I0729 20:13:00.021573  139939 start.go:139] virtualization:  
	I0729 20:13:00.025895  139939 out.go:97] [download-only-877691] minikube v1.33.1 on Ubuntu 20.04 (arm64)
	I0729 20:13:00.026250  139939 notify.go:220] Checking for updates...
	I0729 20:13:00.028468  139939 out.go:169] MINIKUBE_LOCATION=19339
	I0729 20:13:00.030959  139939 out.go:169] MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I0729 20:13:00.033271  139939 out.go:169] KUBECONFIG=/home/jenkins/minikube-integration/19339-134334/kubeconfig
	I0729 20:13:00.036386  139939 out.go:169] MINIKUBE_HOME=/home/jenkins/minikube-integration/19339-134334/.minikube
	I0729 20:13:00.039164  139939 out.go:169] MINIKUBE_BIN=out/minikube-linux-arm64
	W0729 20:13:00.043032  139939 out.go:267] minikube skips various validations when --force is supplied; this may lead to unexpected behavior
	I0729 20:13:00.043429  139939 driver.go:392] Setting default libvirt URI to qemu:///system
	I0729 20:13:00.115079  139939 docker.go:123] docker version: linux-27.1.1:Docker Engine - Community
	I0729 20:13:00.115200  139939 cli_runner.go:164] Run: docker system info --format "{{json .}}"
	I0729 20:13:00.237553  139939 info.go:266] docker info: {ID:U5VK:ZNT5:35M3:FHLW:Q7TL:ELFX:BNAG:AV4T:UD2H:SK5L:SEJV:SJJL Containers:0 ContainersRunning:0 ContainersPaused:0 ContainersStopped:0 Images:1 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:29 OomKillDisable:true NGoroutines:45 SystemTime:2024-07-29 20:13:00.222598674 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1065-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Architecture:aar
ch64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8214900736 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-29-130 Labels:[] ExperimentalBuild:false ServerVersion:27.1.1 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:2bf793ef6dc9a18e00cb12efb64355c2c9d5eb41 Expected:2bf793ef6dc9a18e00cb12efb64355c2c9d5eb41} RuncCommit:{ID:v1.1.13-0-g58aa920 Expected:v1.1.13-0-g58aa920} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:<nil> ServerErro
rs:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.16.1] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.29.1]] Warnings:<nil>}}
	I0729 20:13:00.237704  139939 docker.go:307] overlay module found
	I0729 20:13:00.239626  139939 out.go:97] Using the docker driver based on user configuration
	I0729 20:13:00.239671  139939 start.go:297] selected driver: docker
	I0729 20:13:00.239680  139939 start.go:901] validating driver "docker" against <nil>
	I0729 20:13:00.239840  139939 cli_runner.go:164] Run: docker system info --format "{{json .}}"
	I0729 20:13:00.301539  139939 info.go:266] docker info: {ID:U5VK:ZNT5:35M3:FHLW:Q7TL:ELFX:BNAG:AV4T:UD2H:SK5L:SEJV:SJJL Containers:0 ContainersRunning:0 ContainersPaused:0 ContainersStopped:0 Images:1 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:29 OomKillDisable:true NGoroutines:45 SystemTime:2024-07-29 20:13:00.290855703 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1065-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Architecture:aar
ch64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8214900736 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-29-130 Labels:[] ExperimentalBuild:false ServerVersion:27.1.1 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:2bf793ef6dc9a18e00cb12efb64355c2c9d5eb41 Expected:2bf793ef6dc9a18e00cb12efb64355c2c9d5eb41} RuncCommit:{ID:v1.1.13-0-g58aa920 Expected:v1.1.13-0-g58aa920} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:<nil> ServerErro
rs:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.16.1] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.29.1]] Warnings:<nil>}}
	I0729 20:13:00.301749  139939 start_flags.go:310] no existing cluster config was found, will generate one from the flags 
	I0729 20:13:00.302035  139939 start_flags.go:393] Using suggested 2200MB memory alloc based on sys=7834MB, container=7834MB
	I0729 20:13:00.302199  139939 start_flags.go:929] Wait components to verify : map[apiserver:true system_pods:true]
	I0729 20:13:00.304194  139939 out.go:169] Using Docker driver with root privileges
	I0729 20:13:00.305789  139939 cni.go:84] Creating CNI manager for ""
	I0729 20:13:00.305823  139939 cni.go:143] "docker" driver + "containerd" runtime found, recommending kindnet
	I0729 20:13:00.305837  139939 start_flags.go:319] Found "CNI" CNI - setting NetworkPlugin=cni
	I0729 20:13:00.305935  139939 start.go:340] cluster config:
	{Name:download-only-877691 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721902582-19326@sha256:540fb5dc7f38be17ff5276a38dfe6c8a4b1d9ba1c27c62244e6eebd7e37696e7 Memory:2200 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.30.3 ClusterName:download-only-877691 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local Co
ntainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.30.3 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I0729 20:13:00.307721  139939 out.go:97] Starting "download-only-877691" primary control-plane node in "download-only-877691" cluster
	I0729 20:13:00.307761  139939 cache.go:121] Beginning downloading kic base image for docker with containerd
	I0729 20:13:00.309438  139939 out.go:97] Pulling base image v0.0.44-1721902582-19326 ...
	I0729 20:13:00.309495  139939 preload.go:131] Checking if preload exists for k8s version v1.30.3 and runtime containerd
	I0729 20:13:00.309584  139939 image.go:79] Checking for gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721902582-19326@sha256:540fb5dc7f38be17ff5276a38dfe6c8a4b1d9ba1c27c62244e6eebd7e37696e7 in local docker daemon
	I0729 20:13:00.327162  139939 cache.go:149] Downloading gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721902582-19326@sha256:540fb5dc7f38be17ff5276a38dfe6c8a4b1d9ba1c27c62244e6eebd7e37696e7 to local cache
	I0729 20:13:00.327328  139939 image.go:63] Checking for gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721902582-19326@sha256:540fb5dc7f38be17ff5276a38dfe6c8a4b1d9ba1c27c62244e6eebd7e37696e7 in local cache directory
	I0729 20:13:00.327355  139939 image.go:66] Found gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721902582-19326@sha256:540fb5dc7f38be17ff5276a38dfe6c8a4b1d9ba1c27c62244e6eebd7e37696e7 in local cache directory, skipping pull
	I0729 20:13:00.327361  139939 image.go:135] gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721902582-19326@sha256:540fb5dc7f38be17ff5276a38dfe6c8a4b1d9ba1c27c62244e6eebd7e37696e7 exists in cache, skipping pull
	I0729 20:13:00.327370  139939 cache.go:152] successfully saved gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721902582-19326@sha256:540fb5dc7f38be17ff5276a38dfe6c8a4b1d9ba1c27c62244e6eebd7e37696e7 as a tarball
	I0729 20:13:00.371742  139939 preload.go:118] Found remote preload: https://storage.googleapis.com/minikube-preloaded-volume-tarballs/v18/v1.30.3/preloaded-images-k8s-v18-v1.30.3-containerd-overlay2-arm64.tar.lz4
	I0729 20:13:00.371811  139939 cache.go:56] Caching tarball of preloaded images
	I0729 20:13:00.372284  139939 preload.go:131] Checking if preload exists for k8s version v1.30.3 and runtime containerd
	I0729 20:13:00.374200  139939 out.go:97] Downloading Kubernetes v1.30.3 preload ...
	I0729 20:13:00.374225  139939 preload.go:236] getting checksum for preloaded-images-k8s-v18-v1.30.3-containerd-overlay2-arm64.tar.lz4 ...
	I0729 20:13:00.464717  139939 download.go:107] Downloading: https://storage.googleapis.com/minikube-preloaded-volume-tarballs/v18/v1.30.3/preloaded-images-k8s-v18-v1.30.3-containerd-overlay2-arm64.tar.lz4?checksum=md5:2969442dcdf6412905c6484ccc8dd1ed -> /home/jenkins/minikube-integration/19339-134334/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.30.3-containerd-overlay2-arm64.tar.lz4
	I0729 20:13:04.486625  139939 preload.go:247] saving checksum for preloaded-images-k8s-v18-v1.30.3-containerd-overlay2-arm64.tar.lz4 ...
	I0729 20:13:04.486729  139939 preload.go:254] verifying checksum of /home/jenkins/minikube-integration/19339-134334/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.30.3-containerd-overlay2-arm64.tar.lz4 ...
	
	
	* The control-plane node download-only-877691 host does not exist
	  To start a cluster, run: "minikube start -p download-only-877691"

                                                
                                                
-- /stdout --
aaa_download_only_test.go:185: minikube logs failed with error: exit status 85
--- PASS: TestDownloadOnly/v1.30.3/LogsDuration (0.07s)

                                                
                                    
x
+
TestDownloadOnly/v1.30.3/DeleteAll (0.2s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.30.3/DeleteAll
aaa_download_only_test.go:197: (dbg) Run:  out/minikube-linux-arm64 delete --all
--- PASS: TestDownloadOnly/v1.30.3/DeleteAll (0.20s)

                                                
                                    
x
+
TestDownloadOnly/v1.30.3/DeleteAlwaysSucceeds (0.15s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.30.3/DeleteAlwaysSucceeds
aaa_download_only_test.go:208: (dbg) Run:  out/minikube-linux-arm64 delete -p download-only-877691
--- PASS: TestDownloadOnly/v1.30.3/DeleteAlwaysSucceeds (0.15s)

                                                
                                    
x
+
TestDownloadOnly/v1.31.0-beta.0/json-events (6.25s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.31.0-beta.0/json-events
aaa_download_only_test.go:81: (dbg) Run:  out/minikube-linux-arm64 start -o=json --download-only -p download-only-926923 --force --alsologtostderr --kubernetes-version=v1.31.0-beta.0 --container-runtime=containerd --driver=docker  --container-runtime=containerd
aaa_download_only_test.go:81: (dbg) Done: out/minikube-linux-arm64 start -o=json --download-only -p download-only-926923 --force --alsologtostderr --kubernetes-version=v1.31.0-beta.0 --container-runtime=containerd --driver=docker  --container-runtime=containerd: (6.248962869s)
--- PASS: TestDownloadOnly/v1.31.0-beta.0/json-events (6.25s)

                                                
                                    
x
+
TestDownloadOnly/v1.31.0-beta.0/preload-exists (0s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.31.0-beta.0/preload-exists
--- PASS: TestDownloadOnly/v1.31.0-beta.0/preload-exists (0.00s)

                                                
                                    
x
+
TestDownloadOnly/v1.31.0-beta.0/LogsDuration (0.08s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.31.0-beta.0/LogsDuration
aaa_download_only_test.go:184: (dbg) Run:  out/minikube-linux-arm64 logs -p download-only-926923
aaa_download_only_test.go:184: (dbg) Non-zero exit: out/minikube-linux-arm64 logs -p download-only-926923: exit status 85 (76.28976ms)

                                                
                                                
-- stdout --
	
	==> Audit <==
	|---------|-------------------------------------|----------------------|---------|---------|---------------------|---------------------|
	| Command |                Args                 |       Profile        |  User   | Version |     Start Time      |      End Time       |
	|---------|-------------------------------------|----------------------|---------|---------|---------------------|---------------------|
	| start   | -o=json --download-only             | download-only-651312 | jenkins | v1.33.1 | 29 Jul 24 20:12 UTC |                     |
	|         | -p download-only-651312             |                      |         |         |                     |                     |
	|         | --force --alsologtostderr           |                      |         |         |                     |                     |
	|         | --kubernetes-version=v1.20.0        |                      |         |         |                     |                     |
	|         | --container-runtime=containerd      |                      |         |         |                     |                     |
	|         | --driver=docker                     |                      |         |         |                     |                     |
	|         | --container-runtime=containerd      |                      |         |         |                     |                     |
	| delete  | --all                               | minikube             | jenkins | v1.33.1 | 29 Jul 24 20:12 UTC | 29 Jul 24 20:12 UTC |
	| delete  | -p download-only-651312             | download-only-651312 | jenkins | v1.33.1 | 29 Jul 24 20:12 UTC | 29 Jul 24 20:12 UTC |
	| start   | -o=json --download-only             | download-only-877691 | jenkins | v1.33.1 | 29 Jul 24 20:13 UTC |                     |
	|         | -p download-only-877691             |                      |         |         |                     |                     |
	|         | --force --alsologtostderr           |                      |         |         |                     |                     |
	|         | --kubernetes-version=v1.30.3        |                      |         |         |                     |                     |
	|         | --container-runtime=containerd      |                      |         |         |                     |                     |
	|         | --driver=docker                     |                      |         |         |                     |                     |
	|         | --container-runtime=containerd      |                      |         |         |                     |                     |
	| delete  | --all                               | minikube             | jenkins | v1.33.1 | 29 Jul 24 20:13 UTC | 29 Jul 24 20:13 UTC |
	| delete  | -p download-only-877691             | download-only-877691 | jenkins | v1.33.1 | 29 Jul 24 20:13 UTC | 29 Jul 24 20:13 UTC |
	| start   | -o=json --download-only             | download-only-926923 | jenkins | v1.33.1 | 29 Jul 24 20:13 UTC |                     |
	|         | -p download-only-926923             |                      |         |         |                     |                     |
	|         | --force --alsologtostderr           |                      |         |         |                     |                     |
	|         | --kubernetes-version=v1.31.0-beta.0 |                      |         |         |                     |                     |
	|         | --container-runtime=containerd      |                      |         |         |                     |                     |
	|         | --driver=docker                     |                      |         |         |                     |                     |
	|         | --container-runtime=containerd      |                      |         |         |                     |                     |
	|---------|-------------------------------------|----------------------|---------|---------|---------------------|---------------------|
	
	
	==> Last Start <==
	Log file created at: 2024/07/29 20:13:06
	Running on machine: ip-172-31-29-130
	Binary: Built with gc go1.22.5 for linux/arm64
	Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg
	I0729 20:13:06.511696  140144 out.go:291] Setting OutFile to fd 1 ...
	I0729 20:13:06.511832  140144 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0729 20:13:06.511844  140144 out.go:304] Setting ErrFile to fd 2...
	I0729 20:13:06.511849  140144 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0729 20:13:06.512119  140144 root.go:338] Updating PATH: /home/jenkins/minikube-integration/19339-134334/.minikube/bin
	I0729 20:13:06.512534  140144 out.go:298] Setting JSON to true
	I0729 20:13:06.513434  140144 start.go:129] hostinfo: {"hostname":"ip-172-31-29-130","uptime":64532,"bootTime":1722219454,"procs":171,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1065-aws","kernelArch":"aarch64","virtualizationSystem":"","virtualizationRole":"","hostId":"36adf542-ef4f-4e2d-a0c8-6868d1383ff9"}
	I0729 20:13:06.513512  140144 start.go:139] virtualization:  
	I0729 20:13:06.516237  140144 out.go:97] [download-only-926923] minikube v1.33.1 on Ubuntu 20.04 (arm64)
	I0729 20:13:06.516447  140144 notify.go:220] Checking for updates...
	I0729 20:13:06.518349  140144 out.go:169] MINIKUBE_LOCATION=19339
	I0729 20:13:06.520275  140144 out.go:169] MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I0729 20:13:06.522075  140144 out.go:169] KUBECONFIG=/home/jenkins/minikube-integration/19339-134334/kubeconfig
	I0729 20:13:06.524098  140144 out.go:169] MINIKUBE_HOME=/home/jenkins/minikube-integration/19339-134334/.minikube
	I0729 20:13:06.525637  140144 out.go:169] MINIKUBE_BIN=out/minikube-linux-arm64
	W0729 20:13:06.528877  140144 out.go:267] minikube skips various validations when --force is supplied; this may lead to unexpected behavior
	I0729 20:13:06.529241  140144 driver.go:392] Setting default libvirt URI to qemu:///system
	I0729 20:13:06.557199  140144 docker.go:123] docker version: linux-27.1.1:Docker Engine - Community
	I0729 20:13:06.557300  140144 cli_runner.go:164] Run: docker system info --format "{{json .}}"
	I0729 20:13:06.610944  140144 info.go:266] docker info: {ID:U5VK:ZNT5:35M3:FHLW:Q7TL:ELFX:BNAG:AV4T:UD2H:SK5L:SEJV:SJJL Containers:0 ContainersRunning:0 ContainersPaused:0 ContainersStopped:0 Images:1 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:29 OomKillDisable:true NGoroutines:44 SystemTime:2024-07-29 20:13:06.601400558 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1065-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Architecture:aar
ch64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8214900736 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-29-130 Labels:[] ExperimentalBuild:false ServerVersion:27.1.1 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:2bf793ef6dc9a18e00cb12efb64355c2c9d5eb41 Expected:2bf793ef6dc9a18e00cb12efb64355c2c9d5eb41} RuncCommit:{ID:v1.1.13-0-g58aa920 Expected:v1.1.13-0-g58aa920} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:<nil> ServerErro
rs:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.16.1] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.29.1]] Warnings:<nil>}}
	I0729 20:13:06.611051  140144 docker.go:307] overlay module found
	I0729 20:13:06.612965  140144 out.go:97] Using the docker driver based on user configuration
	I0729 20:13:06.612988  140144 start.go:297] selected driver: docker
	I0729 20:13:06.612994  140144 start.go:901] validating driver "docker" against <nil>
	I0729 20:13:06.613092  140144 cli_runner.go:164] Run: docker system info --format "{{json .}}"
	I0729 20:13:06.677075  140144 info.go:266] docker info: {ID:U5VK:ZNT5:35M3:FHLW:Q7TL:ELFX:BNAG:AV4T:UD2H:SK5L:SEJV:SJJL Containers:0 ContainersRunning:0 ContainersPaused:0 ContainersStopped:0 Images:1 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:29 OomKillDisable:true NGoroutines:44 SystemTime:2024-07-29 20:13:06.667869647 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1065-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Architecture:aar
ch64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8214900736 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-29-130 Labels:[] ExperimentalBuild:false ServerVersion:27.1.1 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:2bf793ef6dc9a18e00cb12efb64355c2c9d5eb41 Expected:2bf793ef6dc9a18e00cb12efb64355c2c9d5eb41} RuncCommit:{ID:v1.1.13-0-g58aa920 Expected:v1.1.13-0-g58aa920} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:<nil> ServerErro
rs:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.16.1] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.29.1]] Warnings:<nil>}}
	I0729 20:13:06.677253  140144 start_flags.go:310] no existing cluster config was found, will generate one from the flags 
	I0729 20:13:06.677575  140144 start_flags.go:393] Using suggested 2200MB memory alloc based on sys=7834MB, container=7834MB
	I0729 20:13:06.677740  140144 start_flags.go:929] Wait components to verify : map[apiserver:true system_pods:true]
	I0729 20:13:06.679567  140144 out.go:169] Using Docker driver with root privileges
	I0729 20:13:06.681077  140144 cni.go:84] Creating CNI manager for ""
	I0729 20:13:06.681097  140144 cni.go:143] "docker" driver + "containerd" runtime found, recommending kindnet
	I0729 20:13:06.681108  140144 start_flags.go:319] Found "CNI" CNI - setting NetworkPlugin=cni
	I0729 20:13:06.681200  140144 start.go:340] cluster config:
	{Name:download-only-926923 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721902582-19326@sha256:540fb5dc7f38be17ff5276a38dfe6c8a4b1d9ba1c27c62244e6eebd7e37696e7 Memory:2200 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.31.0-beta.0 ClusterName:download-only-926923 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.l
ocal ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.31.0-beta.0 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval
:1m0s}
	I0729 20:13:06.682929  140144 out.go:97] Starting "download-only-926923" primary control-plane node in "download-only-926923" cluster
	I0729 20:13:06.682952  140144 cache.go:121] Beginning downloading kic base image for docker with containerd
	I0729 20:13:06.684578  140144 out.go:97] Pulling base image v0.0.44-1721902582-19326 ...
	I0729 20:13:06.684604  140144 preload.go:131] Checking if preload exists for k8s version v1.31.0-beta.0 and runtime containerd
	I0729 20:13:06.684710  140144 image.go:79] Checking for gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721902582-19326@sha256:540fb5dc7f38be17ff5276a38dfe6c8a4b1d9ba1c27c62244e6eebd7e37696e7 in local docker daemon
	I0729 20:13:06.701072  140144 cache.go:149] Downloading gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721902582-19326@sha256:540fb5dc7f38be17ff5276a38dfe6c8a4b1d9ba1c27c62244e6eebd7e37696e7 to local cache
	I0729 20:13:06.701205  140144 image.go:63] Checking for gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721902582-19326@sha256:540fb5dc7f38be17ff5276a38dfe6c8a4b1d9ba1c27c62244e6eebd7e37696e7 in local cache directory
	I0729 20:13:06.701244  140144 image.go:66] Found gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721902582-19326@sha256:540fb5dc7f38be17ff5276a38dfe6c8a4b1d9ba1c27c62244e6eebd7e37696e7 in local cache directory, skipping pull
	I0729 20:13:06.701259  140144 image.go:135] gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721902582-19326@sha256:540fb5dc7f38be17ff5276a38dfe6c8a4b1d9ba1c27c62244e6eebd7e37696e7 exists in cache, skipping pull
	I0729 20:13:06.701268  140144 cache.go:152] successfully saved gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721902582-19326@sha256:540fb5dc7f38be17ff5276a38dfe6c8a4b1d9ba1c27c62244e6eebd7e37696e7 as a tarball
	I0729 20:13:06.747878  140144 preload.go:118] Found remote preload: https://storage.googleapis.com/minikube-preloaded-volume-tarballs/v18/v1.31.0-beta.0/preloaded-images-k8s-v18-v1.31.0-beta.0-containerd-overlay2-arm64.tar.lz4
	I0729 20:13:06.747900  140144 cache.go:56] Caching tarball of preloaded images
	I0729 20:13:06.748063  140144 preload.go:131] Checking if preload exists for k8s version v1.31.0-beta.0 and runtime containerd
	I0729 20:13:06.750163  140144 out.go:97] Downloading Kubernetes v1.31.0-beta.0 preload ...
	I0729 20:13:06.750189  140144 preload.go:236] getting checksum for preloaded-images-k8s-v18-v1.31.0-beta.0-containerd-overlay2-arm64.tar.lz4 ...
	I0729 20:13:06.845633  140144 download.go:107] Downloading: https://storage.googleapis.com/minikube-preloaded-volume-tarballs/v18/v1.31.0-beta.0/preloaded-images-k8s-v18-v1.31.0-beta.0-containerd-overlay2-arm64.tar.lz4?checksum=md5:e1550e32e6115d92010b4a739f5f0833 -> /home/jenkins/minikube-integration/19339-134334/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.0-beta.0-containerd-overlay2-arm64.tar.lz4
	I0729 20:13:11.144364  140144 preload.go:247] saving checksum for preloaded-images-k8s-v18-v1.31.0-beta.0-containerd-overlay2-arm64.tar.lz4 ...
	I0729 20:13:11.144484  140144 preload.go:254] verifying checksum of /home/jenkins/minikube-integration/19339-134334/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.0-beta.0-containerd-overlay2-arm64.tar.lz4 ...
	
	
	* The control-plane node download-only-926923 host does not exist
	  To start a cluster, run: "minikube start -p download-only-926923"

                                                
                                                
-- /stdout --
aaa_download_only_test.go:185: minikube logs failed with error: exit status 85
--- PASS: TestDownloadOnly/v1.31.0-beta.0/LogsDuration (0.08s)

                                                
                                    
x
+
TestDownloadOnly/v1.31.0-beta.0/DeleteAll (0.21s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.31.0-beta.0/DeleteAll
aaa_download_only_test.go:197: (dbg) Run:  out/minikube-linux-arm64 delete --all
--- PASS: TestDownloadOnly/v1.31.0-beta.0/DeleteAll (0.21s)

                                                
                                    
x
+
TestDownloadOnly/v1.31.0-beta.0/DeleteAlwaysSucceeds (0.13s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.31.0-beta.0/DeleteAlwaysSucceeds
aaa_download_only_test.go:208: (dbg) Run:  out/minikube-linux-arm64 delete -p download-only-926923
--- PASS: TestDownloadOnly/v1.31.0-beta.0/DeleteAlwaysSucceeds (0.13s)

                                                
                                    
x
+
TestBinaryMirror (0.55s)

                                                
                                                
=== RUN   TestBinaryMirror
aaa_download_only_test.go:314: (dbg) Run:  out/minikube-linux-arm64 start --download-only -p binary-mirror-229872 --alsologtostderr --binary-mirror http://127.0.0.1:37529 --driver=docker  --container-runtime=containerd
helpers_test.go:175: Cleaning up "binary-mirror-229872" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-arm64 delete -p binary-mirror-229872
--- PASS: TestBinaryMirror (0.55s)

                                                
                                    
x
+
TestAddons/PreSetup/EnablingAddonOnNonExistingCluster (0.06s)

                                                
                                                
=== RUN   TestAddons/PreSetup/EnablingAddonOnNonExistingCluster
=== PAUSE TestAddons/PreSetup/EnablingAddonOnNonExistingCluster

                                                
                                                

                                                
                                                
=== CONT  TestAddons/PreSetup/EnablingAddonOnNonExistingCluster
addons_test.go:1037: (dbg) Run:  out/minikube-linux-arm64 addons enable dashboard -p addons-675434
addons_test.go:1037: (dbg) Non-zero exit: out/minikube-linux-arm64 addons enable dashboard -p addons-675434: exit status 85 (59.628979ms)

                                                
                                                
-- stdout --
	* Profile "addons-675434" not found. Run "minikube profile list" to view all profiles.
	  To start a cluster, run: "minikube start -p addons-675434"

                                                
                                                
-- /stdout --
--- PASS: TestAddons/PreSetup/EnablingAddonOnNonExistingCluster (0.06s)

                                                
                                    
x
+
TestAddons/PreSetup/DisablingAddonOnNonExistingCluster (0.07s)

                                                
                                                
=== RUN   TestAddons/PreSetup/DisablingAddonOnNonExistingCluster
=== PAUSE TestAddons/PreSetup/DisablingAddonOnNonExistingCluster

                                                
                                                

                                                
                                                
=== CONT  TestAddons/PreSetup/DisablingAddonOnNonExistingCluster
addons_test.go:1048: (dbg) Run:  out/minikube-linux-arm64 addons disable dashboard -p addons-675434
addons_test.go:1048: (dbg) Non-zero exit: out/minikube-linux-arm64 addons disable dashboard -p addons-675434: exit status 85 (66.596027ms)

                                                
                                                
-- stdout --
	* Profile "addons-675434" not found. Run "minikube profile list" to view all profiles.
	  To start a cluster, run: "minikube start -p addons-675434"

                                                
                                                
-- /stdout --
--- PASS: TestAddons/PreSetup/DisablingAddonOnNonExistingCluster (0.07s)

                                                
                                    
x
+
TestAddons/Setup (222.08s)

                                                
                                                
=== RUN   TestAddons/Setup
addons_test.go:110: (dbg) Run:  out/minikube-linux-arm64 start -p addons-675434 --wait=true --memory=4000 --alsologtostderr --addons=registry --addons=metrics-server --addons=volumesnapshots --addons=csi-hostpath-driver --addons=gcp-auth --addons=cloud-spanner --addons=inspektor-gadget --addons=storage-provisioner-rancher --addons=nvidia-device-plugin --addons=yakd --addons=volcano --driver=docker  --container-runtime=containerd --addons=ingress --addons=ingress-dns
addons_test.go:110: (dbg) Done: out/minikube-linux-arm64 start -p addons-675434 --wait=true --memory=4000 --alsologtostderr --addons=registry --addons=metrics-server --addons=volumesnapshots --addons=csi-hostpath-driver --addons=gcp-auth --addons=cloud-spanner --addons=inspektor-gadget --addons=storage-provisioner-rancher --addons=nvidia-device-plugin --addons=yakd --addons=volcano --driver=docker  --container-runtime=containerd --addons=ingress --addons=ingress-dns: (3m42.076419479s)
--- PASS: TestAddons/Setup (222.08s)

                                                
                                    
x
+
TestAddons/serial/GCPAuth/Namespaces (0.18s)

                                                
                                                
=== RUN   TestAddons/serial/GCPAuth/Namespaces
addons_test.go:656: (dbg) Run:  kubectl --context addons-675434 create ns new-namespace
addons_test.go:670: (dbg) Run:  kubectl --context addons-675434 get secret gcp-auth -n new-namespace
--- PASS: TestAddons/serial/GCPAuth/Namespaces (0.18s)

                                                
                                    
x
+
TestAddons/parallel/Registry (17.06s)

                                                
                                                
=== RUN   TestAddons/parallel/Registry
=== PAUSE TestAddons/parallel/Registry

                                                
                                                

                                                
                                                
=== CONT  TestAddons/parallel/Registry
addons_test.go:332: registry stabilized in 3.145439ms
addons_test.go:334: (dbg) TestAddons/parallel/Registry: waiting 6m0s for pods matching "actual-registry=true" in namespace "kube-system" ...
helpers_test.go:344: "registry-698f998955-n5fxq" [ddd3ed00-254f-4d67-bfa5-adb9d6cd97e0] Running
addons_test.go:334: (dbg) TestAddons/parallel/Registry: actual-registry=true healthy within 6.004893832s
addons_test.go:337: (dbg) TestAddons/parallel/Registry: waiting 10m0s for pods matching "registry-proxy=true" in namespace "kube-system" ...
helpers_test.go:344: "registry-proxy-dhzfq" [0fbb00ba-0628-4de1-abac-af3a3c6ac389] Running
addons_test.go:337: (dbg) TestAddons/parallel/Registry: registry-proxy=true healthy within 6.004927957s
addons_test.go:342: (dbg) Run:  kubectl --context addons-675434 delete po -l run=registry-test --now
addons_test.go:347: (dbg) Run:  kubectl --context addons-675434 run --rm registry-test --restart=Never --image=gcr.io/k8s-minikube/busybox -it -- sh -c "wget --spider -S http://registry.kube-system.svc.cluster.local"
addons_test.go:347: (dbg) Done: kubectl --context addons-675434 run --rm registry-test --restart=Never --image=gcr.io/k8s-minikube/busybox -it -- sh -c "wget --spider -S http://registry.kube-system.svc.cluster.local": (3.961483045s)
addons_test.go:361: (dbg) Run:  out/minikube-linux-arm64 -p addons-675434 ip
2024/07/29 20:20:52 [DEBUG] GET http://192.168.49.2:5000
addons_test.go:390: (dbg) Run:  out/minikube-linux-arm64 -p addons-675434 addons disable registry --alsologtostderr -v=1
--- PASS: TestAddons/parallel/Registry (17.06s)

                                                
                                    
x
+
TestAddons/parallel/Ingress (18.78s)

                                                
                                                
=== RUN   TestAddons/parallel/Ingress
=== PAUSE TestAddons/parallel/Ingress

                                                
                                                

                                                
                                                
=== CONT  TestAddons/parallel/Ingress
addons_test.go:209: (dbg) Run:  kubectl --context addons-675434 wait --for=condition=ready --namespace=ingress-nginx pod --selector=app.kubernetes.io/component=controller --timeout=90s
addons_test.go:234: (dbg) Run:  kubectl --context addons-675434 replace --force -f testdata/nginx-ingress-v1.yaml
addons_test.go:247: (dbg) Run:  kubectl --context addons-675434 replace --force -f testdata/nginx-pod-svc.yaml
addons_test.go:252: (dbg) TestAddons/parallel/Ingress: waiting 8m0s for pods matching "run=nginx" in namespace "default" ...
helpers_test.go:344: "nginx" [9a1089ec-9a15-4422-990e-066f327a9462] Pending / Ready:ContainersNotReady (containers with unready status: [nginx]) / ContainersReady:ContainersNotReady (containers with unready status: [nginx])
helpers_test.go:344: "nginx" [9a1089ec-9a15-4422-990e-066f327a9462] Running
addons_test.go:252: (dbg) TestAddons/parallel/Ingress: run=nginx healthy within 8.004070227s
addons_test.go:264: (dbg) Run:  out/minikube-linux-arm64 -p addons-675434 ssh "curl -s http://127.0.0.1/ -H 'Host: nginx.example.com'"
addons_test.go:288: (dbg) Run:  kubectl --context addons-675434 replace --force -f testdata/ingress-dns-example-v1.yaml
addons_test.go:293: (dbg) Run:  out/minikube-linux-arm64 -p addons-675434 ip
addons_test.go:299: (dbg) Run:  nslookup hello-john.test 192.168.49.2
addons_test.go:308: (dbg) Run:  out/minikube-linux-arm64 -p addons-675434 addons disable ingress-dns --alsologtostderr -v=1
addons_test.go:308: (dbg) Done: out/minikube-linux-arm64 -p addons-675434 addons disable ingress-dns --alsologtostderr -v=1: (1.14321108s)
addons_test.go:313: (dbg) Run:  out/minikube-linux-arm64 -p addons-675434 addons disable ingress --alsologtostderr -v=1
addons_test.go:313: (dbg) Done: out/minikube-linux-arm64 -p addons-675434 addons disable ingress --alsologtostderr -v=1: (7.798587477s)
--- PASS: TestAddons/parallel/Ingress (18.78s)

                                                
                                    
x
+
TestAddons/parallel/InspektorGadget (11.83s)

                                                
                                                
=== RUN   TestAddons/parallel/InspektorGadget
=== PAUSE TestAddons/parallel/InspektorGadget

                                                
                                                

                                                
                                                
=== CONT  TestAddons/parallel/InspektorGadget
addons_test.go:848: (dbg) TestAddons/parallel/InspektorGadget: waiting 8m0s for pods matching "k8s-app=gadget" in namespace "gadget" ...
helpers_test.go:344: "gadget-p7qgn" [37add603-1500-4066-a0f1-21a3afed4ec9] Running / Ready:ContainersNotReady (containers with unready status: [gadget]) / ContainersReady:ContainersNotReady (containers with unready status: [gadget])
addons_test.go:848: (dbg) TestAddons/parallel/InspektorGadget: k8s-app=gadget healthy within 6.0046378s
addons_test.go:851: (dbg) Run:  out/minikube-linux-arm64 addons disable inspektor-gadget -p addons-675434
addons_test.go:851: (dbg) Done: out/minikube-linux-arm64 addons disable inspektor-gadget -p addons-675434: (5.827455541s)
--- PASS: TestAddons/parallel/InspektorGadget (11.83s)

                                                
                                    
x
+
TestAddons/parallel/MetricsServer (5.8s)

                                                
                                                
=== RUN   TestAddons/parallel/MetricsServer
=== PAUSE TestAddons/parallel/MetricsServer

                                                
                                                

                                                
                                                
=== CONT  TestAddons/parallel/MetricsServer
addons_test.go:409: metrics-server stabilized in 3.339692ms
addons_test.go:411: (dbg) TestAddons/parallel/MetricsServer: waiting 6m0s for pods matching "k8s-app=metrics-server" in namespace "kube-system" ...
helpers_test.go:344: "metrics-server-c59844bb4-s7q62" [841ddb7c-acf0-4fc5-abf4-3effec07c7b8] Running
addons_test.go:411: (dbg) TestAddons/parallel/MetricsServer: k8s-app=metrics-server healthy within 5.00417619s
addons_test.go:417: (dbg) Run:  kubectl --context addons-675434 top pods -n kube-system
addons_test.go:434: (dbg) Run:  out/minikube-linux-arm64 -p addons-675434 addons disable metrics-server --alsologtostderr -v=1
--- PASS: TestAddons/parallel/MetricsServer (5.80s)

                                                
                                    
x
+
TestAddons/parallel/CSI (37.98s)

                                                
                                                
=== RUN   TestAddons/parallel/CSI
=== PAUSE TestAddons/parallel/CSI

                                                
                                                

                                                
                                                
=== CONT  TestAddons/parallel/CSI
addons_test.go:567: csi-hostpath-driver pods stabilized in 8.794453ms
addons_test.go:570: (dbg) Run:  kubectl --context addons-675434 create -f testdata/csi-hostpath-driver/pvc.yaml
addons_test.go:575: (dbg) TestAddons/parallel/CSI: waiting 6m0s for pvc "hpvc" in namespace "default" ...
helpers_test.go:394: (dbg) Run:  kubectl --context addons-675434 get pvc hpvc -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-675434 get pvc hpvc -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-675434 get pvc hpvc -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-675434 get pvc hpvc -o jsonpath={.status.phase} -n default
addons_test.go:580: (dbg) Run:  kubectl --context addons-675434 create -f testdata/csi-hostpath-driver/pv-pod.yaml
addons_test.go:585: (dbg) TestAddons/parallel/CSI: waiting 6m0s for pods matching "app=task-pv-pod" in namespace "default" ...
helpers_test.go:344: "task-pv-pod" [5c2c2f68-4474-43b5-815a-5b74d33b5b33] Pending
helpers_test.go:344: "task-pv-pod" [5c2c2f68-4474-43b5-815a-5b74d33b5b33] Pending / Ready:ContainersNotReady (containers with unready status: [task-pv-container]) / ContainersReady:ContainersNotReady (containers with unready status: [task-pv-container])
helpers_test.go:344: "task-pv-pod" [5c2c2f68-4474-43b5-815a-5b74d33b5b33] Running
addons_test.go:585: (dbg) TestAddons/parallel/CSI: app=task-pv-pod healthy within 11.003236655s
addons_test.go:590: (dbg) Run:  kubectl --context addons-675434 create -f testdata/csi-hostpath-driver/snapshot.yaml
addons_test.go:595: (dbg) TestAddons/parallel/CSI: waiting 6m0s for volume snapshot "new-snapshot-demo" in namespace "default" ...
helpers_test.go:419: (dbg) Run:  kubectl --context addons-675434 get volumesnapshot new-snapshot-demo -o jsonpath={.status.readyToUse} -n default
helpers_test.go:419: (dbg) Run:  kubectl --context addons-675434 get volumesnapshot new-snapshot-demo -o jsonpath={.status.readyToUse} -n default
addons_test.go:600: (dbg) Run:  kubectl --context addons-675434 delete pod task-pv-pod
addons_test.go:600: (dbg) Done: kubectl --context addons-675434 delete pod task-pv-pod: (1.34704297s)
addons_test.go:606: (dbg) Run:  kubectl --context addons-675434 delete pvc hpvc
addons_test.go:612: (dbg) Run:  kubectl --context addons-675434 create -f testdata/csi-hostpath-driver/pvc-restore.yaml
addons_test.go:617: (dbg) TestAddons/parallel/CSI: waiting 6m0s for pvc "hpvc-restore" in namespace "default" ...
helpers_test.go:394: (dbg) Run:  kubectl --context addons-675434 get pvc hpvc-restore -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-675434 get pvc hpvc-restore -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-675434 get pvc hpvc-restore -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-675434 get pvc hpvc-restore -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-675434 get pvc hpvc-restore -o jsonpath={.status.phase} -n default
addons_test.go:622: (dbg) Run:  kubectl --context addons-675434 create -f testdata/csi-hostpath-driver/pv-pod-restore.yaml
addons_test.go:627: (dbg) TestAddons/parallel/CSI: waiting 6m0s for pods matching "app=task-pv-pod-restore" in namespace "default" ...
helpers_test.go:344: "task-pv-pod-restore" [6613f524-bba3-449d-b12d-c3d4bb4cb221] Pending
helpers_test.go:344: "task-pv-pod-restore" [6613f524-bba3-449d-b12d-c3d4bb4cb221] Pending / Ready:ContainersNotReady (containers with unready status: [task-pv-container]) / ContainersReady:ContainersNotReady (containers with unready status: [task-pv-container])
helpers_test.go:344: "task-pv-pod-restore" [6613f524-bba3-449d-b12d-c3d4bb4cb221] Running
addons_test.go:627: (dbg) TestAddons/parallel/CSI: app=task-pv-pod-restore healthy within 7.004970165s
addons_test.go:632: (dbg) Run:  kubectl --context addons-675434 delete pod task-pv-pod-restore
addons_test.go:632: (dbg) Done: kubectl --context addons-675434 delete pod task-pv-pod-restore: (1.354529216s)
addons_test.go:636: (dbg) Run:  kubectl --context addons-675434 delete pvc hpvc-restore
addons_test.go:640: (dbg) Run:  kubectl --context addons-675434 delete volumesnapshot new-snapshot-demo
addons_test.go:644: (dbg) Run:  out/minikube-linux-arm64 -p addons-675434 addons disable csi-hostpath-driver --alsologtostderr -v=1
addons_test.go:644: (dbg) Done: out/minikube-linux-arm64 -p addons-675434 addons disable csi-hostpath-driver --alsologtostderr -v=1: (6.783057121s)
addons_test.go:648: (dbg) Run:  out/minikube-linux-arm64 -p addons-675434 addons disable volumesnapshots --alsologtostderr -v=1
--- PASS: TestAddons/parallel/CSI (37.98s)

                                                
                                    
x
+
TestAddons/parallel/Headlamp (16.97s)

                                                
                                                
=== RUN   TestAddons/parallel/Headlamp
=== PAUSE TestAddons/parallel/Headlamp

                                                
                                                

                                                
                                                
=== CONT  TestAddons/parallel/Headlamp
addons_test.go:830: (dbg) Run:  out/minikube-linux-arm64 addons enable headlamp -p addons-675434 --alsologtostderr -v=1
addons_test.go:830: (dbg) Done: out/minikube-linux-arm64 addons enable headlamp -p addons-675434 --alsologtostderr -v=1: (1.228301646s)
addons_test.go:835: (dbg) TestAddons/parallel/Headlamp: waiting 8m0s for pods matching "app.kubernetes.io/name=headlamp" in namespace "headlamp" ...
helpers_test.go:344: "headlamp-7867546754-jvt7d" [ae0d3812-c8eb-4ff2-92d8-bd9159ea03d9] Pending / Ready:ContainersNotReady (containers with unready status: [headlamp]) / ContainersReady:ContainersNotReady (containers with unready status: [headlamp])
helpers_test.go:344: "headlamp-7867546754-jvt7d" [ae0d3812-c8eb-4ff2-92d8-bd9159ea03d9] Running
addons_test.go:835: (dbg) TestAddons/parallel/Headlamp: app.kubernetes.io/name=headlamp healthy within 10.004263231s
addons_test.go:839: (dbg) Run:  out/minikube-linux-arm64 -p addons-675434 addons disable headlamp --alsologtostderr -v=1
addons_test.go:839: (dbg) Done: out/minikube-linux-arm64 -p addons-675434 addons disable headlamp --alsologtostderr -v=1: (5.732396689s)
--- PASS: TestAddons/parallel/Headlamp (16.97s)

                                                
                                    
x
+
TestAddons/parallel/CloudSpanner (5.59s)

                                                
                                                
=== RUN   TestAddons/parallel/CloudSpanner
=== PAUSE TestAddons/parallel/CloudSpanner

                                                
                                                

                                                
                                                
=== CONT  TestAddons/parallel/CloudSpanner
addons_test.go:867: (dbg) TestAddons/parallel/CloudSpanner: waiting 6m0s for pods matching "app=cloud-spanner-emulator" in namespace "default" ...
helpers_test.go:344: "cloud-spanner-emulator-5455fb9b69-kjpzj" [75c42922-c7b0-4a61-ae68-f1ac69ef70ab] Running
addons_test.go:867: (dbg) TestAddons/parallel/CloudSpanner: app=cloud-spanner-emulator healthy within 5.004311177s
addons_test.go:870: (dbg) Run:  out/minikube-linux-arm64 addons disable cloud-spanner -p addons-675434
--- PASS: TestAddons/parallel/CloudSpanner (5.59s)

                                                
                                    
x
+
TestAddons/parallel/LocalPath (10.75s)

                                                
                                                
=== RUN   TestAddons/parallel/LocalPath
=== PAUSE TestAddons/parallel/LocalPath

                                                
                                                

                                                
                                                
=== CONT  TestAddons/parallel/LocalPath
addons_test.go:982: (dbg) Run:  kubectl --context addons-675434 apply -f testdata/storage-provisioner-rancher/pvc.yaml
addons_test.go:988: (dbg) Run:  kubectl --context addons-675434 apply -f testdata/storage-provisioner-rancher/pod.yaml
addons_test.go:992: (dbg) TestAddons/parallel/LocalPath: waiting 5m0s for pvc "test-pvc" in namespace "default" ...
helpers_test.go:394: (dbg) Run:  kubectl --context addons-675434 get pvc test-pvc -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-675434 get pvc test-pvc -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-675434 get pvc test-pvc -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-675434 get pvc test-pvc -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-675434 get pvc test-pvc -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-675434 get pvc test-pvc -o jsonpath={.status.phase} -n default
addons_test.go:995: (dbg) TestAddons/parallel/LocalPath: waiting 3m0s for pods matching "run=test-local-path" in namespace "default" ...
helpers_test.go:344: "test-local-path" [43929ba1-1589-41d6-8422-abb6b53e0de6] Pending / Ready:ContainersNotReady (containers with unready status: [busybox]) / ContainersReady:ContainersNotReady (containers with unready status: [busybox])
helpers_test.go:344: "test-local-path" [43929ba1-1589-41d6-8422-abb6b53e0de6] Pending / Initialized:PodCompleted / Ready:PodCompleted / ContainersReady:PodCompleted
helpers_test.go:344: "test-local-path" [43929ba1-1589-41d6-8422-abb6b53e0de6] Succeeded / Initialized:PodCompleted / Ready:PodCompleted / ContainersReady:PodCompleted
addons_test.go:995: (dbg) TestAddons/parallel/LocalPath: run=test-local-path healthy within 4.004523446s
addons_test.go:1000: (dbg) Run:  kubectl --context addons-675434 get pvc test-pvc -o=json
addons_test.go:1009: (dbg) Run:  out/minikube-linux-arm64 -p addons-675434 ssh "cat /opt/local-path-provisioner/pvc-99a34fa4-62c8-414b-97be-775467b8db93_default_test-pvc/file1"
addons_test.go:1021: (dbg) Run:  kubectl --context addons-675434 delete pod test-local-path
addons_test.go:1025: (dbg) Run:  kubectl --context addons-675434 delete pvc test-pvc
addons_test.go:1029: (dbg) Run:  out/minikube-linux-arm64 -p addons-675434 addons disable storage-provisioner-rancher --alsologtostderr -v=1
--- PASS: TestAddons/parallel/LocalPath (10.75s)

                                                
                                    
x
+
TestAddons/parallel/NvidiaDevicePlugin (5.66s)

                                                
                                                
=== RUN   TestAddons/parallel/NvidiaDevicePlugin
=== PAUSE TestAddons/parallel/NvidiaDevicePlugin

                                                
                                                

                                                
                                                
=== CONT  TestAddons/parallel/NvidiaDevicePlugin
addons_test.go:1061: (dbg) TestAddons/parallel/NvidiaDevicePlugin: waiting 6m0s for pods matching "name=nvidia-device-plugin-ds" in namespace "kube-system" ...
helpers_test.go:344: "nvidia-device-plugin-daemonset-zlp6c" [f89a77f0-18bd-4f03-acf1-71808e39670a] Running
addons_test.go:1061: (dbg) TestAddons/parallel/NvidiaDevicePlugin: name=nvidia-device-plugin-ds healthy within 5.004555667s
addons_test.go:1064: (dbg) Run:  out/minikube-linux-arm64 addons disable nvidia-device-plugin -p addons-675434
--- PASS: TestAddons/parallel/NvidiaDevicePlugin (5.66s)

                                                
                                    
x
+
TestAddons/parallel/Yakd (11.91s)

                                                
                                                
=== RUN   TestAddons/parallel/Yakd
=== PAUSE TestAddons/parallel/Yakd

                                                
                                                

                                                
                                                
=== CONT  TestAddons/parallel/Yakd
addons_test.go:1072: (dbg) TestAddons/parallel/Yakd: waiting 2m0s for pods matching "app.kubernetes.io/name=yakd-dashboard" in namespace "yakd-dashboard" ...
helpers_test.go:344: "yakd-dashboard-799879c74f-bhl8b" [64a7433d-00ba-46a4-b125-5ad97ba7fbd0] Running
addons_test.go:1072: (dbg) TestAddons/parallel/Yakd: app.kubernetes.io/name=yakd-dashboard healthy within 6.003643725s
addons_test.go:1076: (dbg) Run:  out/minikube-linux-arm64 -p addons-675434 addons disable yakd --alsologtostderr -v=1
addons_test.go:1076: (dbg) Done: out/minikube-linux-arm64 -p addons-675434 addons disable yakd --alsologtostderr -v=1: (5.900836057s)
--- PASS: TestAddons/parallel/Yakd (11.91s)

                                                
                                    
x
+
TestAddons/StoppedEnableDisable (12.22s)

                                                
                                                
=== RUN   TestAddons/StoppedEnableDisable
addons_test.go:174: (dbg) Run:  out/minikube-linux-arm64 stop -p addons-675434
addons_test.go:174: (dbg) Done: out/minikube-linux-arm64 stop -p addons-675434: (11.954187187s)
addons_test.go:178: (dbg) Run:  out/minikube-linux-arm64 addons enable dashboard -p addons-675434
addons_test.go:182: (dbg) Run:  out/minikube-linux-arm64 addons disable dashboard -p addons-675434
addons_test.go:187: (dbg) Run:  out/minikube-linux-arm64 addons disable gvisor -p addons-675434
--- PASS: TestAddons/StoppedEnableDisable (12.22s)

                                                
                                    
x
+
TestCertOptions (34.58s)

                                                
                                                
=== RUN   TestCertOptions
=== PAUSE TestCertOptions

                                                
                                                

                                                
                                                
=== CONT  TestCertOptions
cert_options_test.go:49: (dbg) Run:  out/minikube-linux-arm64 start -p cert-options-291015 --memory=2048 --apiserver-ips=127.0.0.1 --apiserver-ips=192.168.15.15 --apiserver-names=localhost --apiserver-names=www.google.com --apiserver-port=8555 --driver=docker  --container-runtime=containerd
cert_options_test.go:49: (dbg) Done: out/minikube-linux-arm64 start -p cert-options-291015 --memory=2048 --apiserver-ips=127.0.0.1 --apiserver-ips=192.168.15.15 --apiserver-names=localhost --apiserver-names=www.google.com --apiserver-port=8555 --driver=docker  --container-runtime=containerd: (31.769991474s)
cert_options_test.go:60: (dbg) Run:  out/minikube-linux-arm64 -p cert-options-291015 ssh "openssl x509 -text -noout -in /var/lib/minikube/certs/apiserver.crt"
cert_options_test.go:88: (dbg) Run:  kubectl --context cert-options-291015 config view
cert_options_test.go:100: (dbg) Run:  out/minikube-linux-arm64 ssh -p cert-options-291015 -- "sudo cat /etc/kubernetes/admin.conf"
helpers_test.go:175: Cleaning up "cert-options-291015" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-arm64 delete -p cert-options-291015
helpers_test.go:178: (dbg) Done: out/minikube-linux-arm64 delete -p cert-options-291015: (2.063134051s)
--- PASS: TestCertOptions (34.58s)

                                                
                                    
x
+
TestCertExpiration (231.63s)

                                                
                                                
=== RUN   TestCertExpiration
=== PAUSE TestCertExpiration

                                                
                                                

                                                
                                                
=== CONT  TestCertExpiration
cert_options_test.go:123: (dbg) Run:  out/minikube-linux-arm64 start -p cert-expiration-457758 --memory=2048 --cert-expiration=3m --driver=docker  --container-runtime=containerd
E0729 20:59:59.830482  139728 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19339-134334/.minikube/profiles/addons-675434/client.crt: no such file or directory
cert_options_test.go:123: (dbg) Done: out/minikube-linux-arm64 start -p cert-expiration-457758 --memory=2048 --cert-expiration=3m --driver=docker  --container-runtime=containerd: (40.622974617s)
cert_options_test.go:131: (dbg) Run:  out/minikube-linux-arm64 start -p cert-expiration-457758 --memory=2048 --cert-expiration=8760h --driver=docker  --container-runtime=containerd
cert_options_test.go:131: (dbg) Done: out/minikube-linux-arm64 start -p cert-expiration-457758 --memory=2048 --cert-expiration=8760h --driver=docker  --container-runtime=containerd: (8.697184556s)
helpers_test.go:175: Cleaning up "cert-expiration-457758" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-arm64 delete -p cert-expiration-457758
helpers_test.go:178: (dbg) Done: out/minikube-linux-arm64 delete -p cert-expiration-457758: (2.307817186s)
--- PASS: TestCertExpiration (231.63s)

                                                
                                    
x
+
TestForceSystemdFlag (38.43s)

                                                
                                                
=== RUN   TestForceSystemdFlag
=== PAUSE TestForceSystemdFlag

                                                
                                                

                                                
                                                
=== CONT  TestForceSystemdFlag
docker_test.go:91: (dbg) Run:  out/minikube-linux-arm64 start -p force-systemd-flag-730900 --memory=2048 --force-systemd --alsologtostderr -v=5 --driver=docker  --container-runtime=containerd
docker_test.go:91: (dbg) Done: out/minikube-linux-arm64 start -p force-systemd-flag-730900 --memory=2048 --force-systemd --alsologtostderr -v=5 --driver=docker  --container-runtime=containerd: (35.890755237s)
docker_test.go:121: (dbg) Run:  out/minikube-linux-arm64 -p force-systemd-flag-730900 ssh "cat /etc/containerd/config.toml"
helpers_test.go:175: Cleaning up "force-systemd-flag-730900" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-arm64 delete -p force-systemd-flag-730900
helpers_test.go:178: (dbg) Done: out/minikube-linux-arm64 delete -p force-systemd-flag-730900: (2.134322091s)
--- PASS: TestForceSystemdFlag (38.43s)

                                                
                                    
x
+
TestForceSystemdEnv (46.9s)

                                                
                                                
=== RUN   TestForceSystemdEnv
=== PAUSE TestForceSystemdEnv

                                                
                                                

                                                
                                                
=== CONT  TestForceSystemdEnv
docker_test.go:155: (dbg) Run:  out/minikube-linux-arm64 start -p force-systemd-env-888896 --memory=2048 --alsologtostderr -v=5 --driver=docker  --container-runtime=containerd
docker_test.go:155: (dbg) Done: out/minikube-linux-arm64 start -p force-systemd-env-888896 --memory=2048 --alsologtostderr -v=5 --driver=docker  --container-runtime=containerd: (44.58061722s)
docker_test.go:121: (dbg) Run:  out/minikube-linux-arm64 -p force-systemd-env-888896 ssh "cat /etc/containerd/config.toml"
helpers_test.go:175: Cleaning up "force-systemd-env-888896" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-arm64 delete -p force-systemd-env-888896
helpers_test.go:178: (dbg) Done: out/minikube-linux-arm64 delete -p force-systemd-env-888896: (2.010273568s)
--- PASS: TestForceSystemdEnv (46.90s)

                                                
                                    
x
+
TestDockerEnvContainerd (44.84s)

                                                
                                                
=== RUN   TestDockerEnvContainerd
docker_test.go:170: running with containerd true linux arm64
docker_test.go:181: (dbg) Run:  out/minikube-linux-arm64 start -p dockerenv-229927 --driver=docker  --container-runtime=containerd
docker_test.go:181: (dbg) Done: out/minikube-linux-arm64 start -p dockerenv-229927 --driver=docker  --container-runtime=containerd: (28.790688294s)
docker_test.go:189: (dbg) Run:  /bin/bash -c "out/minikube-linux-arm64 docker-env --ssh-host --ssh-add -p dockerenv-229927"
docker_test.go:189: (dbg) Done: /bin/bash -c "out/minikube-linux-arm64 docker-env --ssh-host --ssh-add -p dockerenv-229927": (1.063367594s)
docker_test.go:220: (dbg) Run:  /bin/bash -c "SSH_AUTH_SOCK="/tmp/ssh-mJwWyVZAljZc/agent.158231" SSH_AGENT_PID="158232" DOCKER_HOST=ssh://docker@127.0.0.1:37040 docker version"
docker_test.go:243: (dbg) Run:  /bin/bash -c "SSH_AUTH_SOCK="/tmp/ssh-mJwWyVZAljZc/agent.158231" SSH_AGENT_PID="158232" DOCKER_HOST=ssh://docker@127.0.0.1:37040 DOCKER_BUILDKIT=0 docker build -t local/minikube-dockerenv-containerd-test:latest testdata/docker-env"
docker_test.go:243: (dbg) Done: /bin/bash -c "SSH_AUTH_SOCK="/tmp/ssh-mJwWyVZAljZc/agent.158231" SSH_AGENT_PID="158232" DOCKER_HOST=ssh://docker@127.0.0.1:37040 DOCKER_BUILDKIT=0 docker build -t local/minikube-dockerenv-containerd-test:latest testdata/docker-env": (1.163675347s)
docker_test.go:250: (dbg) Run:  /bin/bash -c "SSH_AUTH_SOCK="/tmp/ssh-mJwWyVZAljZc/agent.158231" SSH_AGENT_PID="158232" DOCKER_HOST=ssh://docker@127.0.0.1:37040 docker image ls"
docker_test.go:250: (dbg) Done: /bin/bash -c "SSH_AUTH_SOCK="/tmp/ssh-mJwWyVZAljZc/agent.158231" SSH_AGENT_PID="158232" DOCKER_HOST=ssh://docker@127.0.0.1:37040 docker image ls": (1.188482297s)
helpers_test.go:175: Cleaning up "dockerenv-229927" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-arm64 delete -p dockerenv-229927
helpers_test.go:178: (dbg) Done: out/minikube-linux-arm64 delete -p dockerenv-229927: (2.05819267s)
--- PASS: TestDockerEnvContainerd (44.84s)

                                                
                                    
x
+
TestErrorSpam/setup (29.24s)

                                                
                                                
=== RUN   TestErrorSpam/setup
error_spam_test.go:81: (dbg) Run:  out/minikube-linux-arm64 start -p nospam-024563 -n=1 --memory=2250 --wait=false --log_dir=/tmp/nospam-024563 --driver=docker  --container-runtime=containerd
error_spam_test.go:81: (dbg) Done: out/minikube-linux-arm64 start -p nospam-024563 -n=1 --memory=2250 --wait=false --log_dir=/tmp/nospam-024563 --driver=docker  --container-runtime=containerd: (29.242028321s)
--- PASS: TestErrorSpam/setup (29.24s)

                                                
                                    
x
+
TestErrorSpam/start (0.7s)

                                                
                                                
=== RUN   TestErrorSpam/start
error_spam_test.go:216: Cleaning up 1 logfile(s) ...
error_spam_test.go:159: (dbg) Run:  out/minikube-linux-arm64 -p nospam-024563 --log_dir /tmp/nospam-024563 start --dry-run
error_spam_test.go:159: (dbg) Run:  out/minikube-linux-arm64 -p nospam-024563 --log_dir /tmp/nospam-024563 start --dry-run
error_spam_test.go:182: (dbg) Run:  out/minikube-linux-arm64 -p nospam-024563 --log_dir /tmp/nospam-024563 start --dry-run
--- PASS: TestErrorSpam/start (0.70s)

                                                
                                    
x
+
TestErrorSpam/status (0.96s)

                                                
                                                
=== RUN   TestErrorSpam/status
error_spam_test.go:216: Cleaning up 0 logfile(s) ...
error_spam_test.go:159: (dbg) Run:  out/minikube-linux-arm64 -p nospam-024563 --log_dir /tmp/nospam-024563 status
error_spam_test.go:159: (dbg) Run:  out/minikube-linux-arm64 -p nospam-024563 --log_dir /tmp/nospam-024563 status
error_spam_test.go:182: (dbg) Run:  out/minikube-linux-arm64 -p nospam-024563 --log_dir /tmp/nospam-024563 status
--- PASS: TestErrorSpam/status (0.96s)

                                                
                                    
x
+
TestErrorSpam/pause (1.65s)

                                                
                                                
=== RUN   TestErrorSpam/pause
error_spam_test.go:216: Cleaning up 0 logfile(s) ...
error_spam_test.go:159: (dbg) Run:  out/minikube-linux-arm64 -p nospam-024563 --log_dir /tmp/nospam-024563 pause
error_spam_test.go:159: (dbg) Run:  out/minikube-linux-arm64 -p nospam-024563 --log_dir /tmp/nospam-024563 pause
error_spam_test.go:182: (dbg) Run:  out/minikube-linux-arm64 -p nospam-024563 --log_dir /tmp/nospam-024563 pause
--- PASS: TestErrorSpam/pause (1.65s)

                                                
                                    
x
+
TestErrorSpam/unpause (1.79s)

                                                
                                                
=== RUN   TestErrorSpam/unpause
error_spam_test.go:216: Cleaning up 0 logfile(s) ...
error_spam_test.go:159: (dbg) Run:  out/minikube-linux-arm64 -p nospam-024563 --log_dir /tmp/nospam-024563 unpause
error_spam_test.go:159: (dbg) Run:  out/minikube-linux-arm64 -p nospam-024563 --log_dir /tmp/nospam-024563 unpause
error_spam_test.go:182: (dbg) Run:  out/minikube-linux-arm64 -p nospam-024563 --log_dir /tmp/nospam-024563 unpause
--- PASS: TestErrorSpam/unpause (1.79s)

                                                
                                    
x
+
TestErrorSpam/stop (1.45s)

                                                
                                                
=== RUN   TestErrorSpam/stop
error_spam_test.go:216: Cleaning up 0 logfile(s) ...
error_spam_test.go:159: (dbg) Run:  out/minikube-linux-arm64 -p nospam-024563 --log_dir /tmp/nospam-024563 stop
error_spam_test.go:159: (dbg) Done: out/minikube-linux-arm64 -p nospam-024563 --log_dir /tmp/nospam-024563 stop: (1.249345867s)
error_spam_test.go:159: (dbg) Run:  out/minikube-linux-arm64 -p nospam-024563 --log_dir /tmp/nospam-024563 stop
error_spam_test.go:182: (dbg) Run:  out/minikube-linux-arm64 -p nospam-024563 --log_dir /tmp/nospam-024563 stop
--- PASS: TestErrorSpam/stop (1.45s)

                                                
                                    
x
+
TestFunctional/serial/CopySyncFile (0s)

                                                
                                                
=== RUN   TestFunctional/serial/CopySyncFile
functional_test.go:1851: local sync path: /home/jenkins/minikube-integration/19339-134334/.minikube/files/etc/test/nested/copy/139728/hosts
--- PASS: TestFunctional/serial/CopySyncFile (0.00s)

                                                
                                    
x
+
TestFunctional/serial/StartWithProxy (57.82s)

                                                
                                                
=== RUN   TestFunctional/serial/StartWithProxy
functional_test.go:2230: (dbg) Run:  out/minikube-linux-arm64 start -p functional-479263 --memory=4000 --apiserver-port=8441 --wait=all --driver=docker  --container-runtime=containerd
functional_test.go:2230: (dbg) Done: out/minikube-linux-arm64 start -p functional-479263 --memory=4000 --apiserver-port=8441 --wait=all --driver=docker  --container-runtime=containerd: (57.816949253s)
--- PASS: TestFunctional/serial/StartWithProxy (57.82s)

                                                
                                    
x
+
TestFunctional/serial/AuditLog (0s)

                                                
                                                
=== RUN   TestFunctional/serial/AuditLog
--- PASS: TestFunctional/serial/AuditLog (0.00s)

                                                
                                    
x
+
TestFunctional/serial/SoftStart (6.44s)

                                                
                                                
=== RUN   TestFunctional/serial/SoftStart
functional_test.go:655: (dbg) Run:  out/minikube-linux-arm64 start -p functional-479263 --alsologtostderr -v=8
functional_test.go:655: (dbg) Done: out/minikube-linux-arm64 start -p functional-479263 --alsologtostderr -v=8: (6.430690246s)
functional_test.go:659: soft start took 6.436191103s for "functional-479263" cluster.
--- PASS: TestFunctional/serial/SoftStart (6.44s)

                                                
                                    
x
+
TestFunctional/serial/KubeContext (0.07s)

                                                
                                                
=== RUN   TestFunctional/serial/KubeContext
functional_test.go:677: (dbg) Run:  kubectl config current-context
--- PASS: TestFunctional/serial/KubeContext (0.07s)

                                                
                                    
x
+
TestFunctional/serial/KubectlGetPods (0.09s)

                                                
                                                
=== RUN   TestFunctional/serial/KubectlGetPods
functional_test.go:692: (dbg) Run:  kubectl --context functional-479263 get po -A
--- PASS: TestFunctional/serial/KubectlGetPods (0.09s)

                                                
                                    
x
+
TestFunctional/serial/CacheCmd/cache/add_remote (4.56s)

                                                
                                                
=== RUN   TestFunctional/serial/CacheCmd/cache/add_remote
functional_test.go:1045: (dbg) Run:  out/minikube-linux-arm64 -p functional-479263 cache add registry.k8s.io/pause:3.1
functional_test.go:1045: (dbg) Done: out/minikube-linux-arm64 -p functional-479263 cache add registry.k8s.io/pause:3.1: (1.655792146s)
functional_test.go:1045: (dbg) Run:  out/minikube-linux-arm64 -p functional-479263 cache add registry.k8s.io/pause:3.3
functional_test.go:1045: (dbg) Done: out/minikube-linux-arm64 -p functional-479263 cache add registry.k8s.io/pause:3.3: (1.53226236s)
functional_test.go:1045: (dbg) Run:  out/minikube-linux-arm64 -p functional-479263 cache add registry.k8s.io/pause:latest
functional_test.go:1045: (dbg) Done: out/minikube-linux-arm64 -p functional-479263 cache add registry.k8s.io/pause:latest: (1.371136628s)
--- PASS: TestFunctional/serial/CacheCmd/cache/add_remote (4.56s)

                                                
                                    
x
+
TestFunctional/serial/CacheCmd/cache/add_local (1.46s)

                                                
                                                
=== RUN   TestFunctional/serial/CacheCmd/cache/add_local
functional_test.go:1073: (dbg) Run:  docker build -t minikube-local-cache-test:functional-479263 /tmp/TestFunctionalserialCacheCmdcacheadd_local2422147017/001
functional_test.go:1085: (dbg) Run:  out/minikube-linux-arm64 -p functional-479263 cache add minikube-local-cache-test:functional-479263
functional_test.go:1090: (dbg) Run:  out/minikube-linux-arm64 -p functional-479263 cache delete minikube-local-cache-test:functional-479263
functional_test.go:1079: (dbg) Run:  docker rmi minikube-local-cache-test:functional-479263
--- PASS: TestFunctional/serial/CacheCmd/cache/add_local (1.46s)

                                                
                                    
x
+
TestFunctional/serial/CacheCmd/cache/CacheDelete (0.06s)

                                                
                                                
=== RUN   TestFunctional/serial/CacheCmd/cache/CacheDelete
functional_test.go:1098: (dbg) Run:  out/minikube-linux-arm64 cache delete registry.k8s.io/pause:3.3
--- PASS: TestFunctional/serial/CacheCmd/cache/CacheDelete (0.06s)

                                                
                                    
x
+
TestFunctional/serial/CacheCmd/cache/list (0.06s)

                                                
                                                
=== RUN   TestFunctional/serial/CacheCmd/cache/list
functional_test.go:1106: (dbg) Run:  out/minikube-linux-arm64 cache list
--- PASS: TestFunctional/serial/CacheCmd/cache/list (0.06s)

                                                
                                    
x
+
TestFunctional/serial/CacheCmd/cache/verify_cache_inside_node (0.29s)

                                                
                                                
=== RUN   TestFunctional/serial/CacheCmd/cache/verify_cache_inside_node
functional_test.go:1120: (dbg) Run:  out/minikube-linux-arm64 -p functional-479263 ssh sudo crictl images
--- PASS: TestFunctional/serial/CacheCmd/cache/verify_cache_inside_node (0.29s)

                                                
                                    
x
+
TestFunctional/serial/CacheCmd/cache/cache_reload (2.21s)

                                                
                                                
=== RUN   TestFunctional/serial/CacheCmd/cache/cache_reload
functional_test.go:1143: (dbg) Run:  out/minikube-linux-arm64 -p functional-479263 ssh sudo crictl rmi registry.k8s.io/pause:latest
functional_test.go:1149: (dbg) Run:  out/minikube-linux-arm64 -p functional-479263 ssh sudo crictl inspecti registry.k8s.io/pause:latest
functional_test.go:1149: (dbg) Non-zero exit: out/minikube-linux-arm64 -p functional-479263 ssh sudo crictl inspecti registry.k8s.io/pause:latest: exit status 1 (287.885935ms)

                                                
                                                
-- stdout --
	FATA[0000] no such image "registry.k8s.io/pause:latest" present 

                                                
                                                
-- /stdout --
** stderr ** 
	ssh: Process exited with status 1

                                                
                                                
** /stderr **
functional_test.go:1154: (dbg) Run:  out/minikube-linux-arm64 -p functional-479263 cache reload
functional_test.go:1154: (dbg) Done: out/minikube-linux-arm64 -p functional-479263 cache reload: (1.294756264s)
functional_test.go:1159: (dbg) Run:  out/minikube-linux-arm64 -p functional-479263 ssh sudo crictl inspecti registry.k8s.io/pause:latest
--- PASS: TestFunctional/serial/CacheCmd/cache/cache_reload (2.21s)

                                                
                                    
x
+
TestFunctional/serial/CacheCmd/cache/delete (0.13s)

                                                
                                                
=== RUN   TestFunctional/serial/CacheCmd/cache/delete
functional_test.go:1168: (dbg) Run:  out/minikube-linux-arm64 cache delete registry.k8s.io/pause:3.1
functional_test.go:1168: (dbg) Run:  out/minikube-linux-arm64 cache delete registry.k8s.io/pause:latest
--- PASS: TestFunctional/serial/CacheCmd/cache/delete (0.13s)

                                                
                                    
x
+
TestFunctional/serial/MinikubeKubectlCmd (0.14s)

                                                
                                                
=== RUN   TestFunctional/serial/MinikubeKubectlCmd
functional_test.go:712: (dbg) Run:  out/minikube-linux-arm64 -p functional-479263 kubectl -- --context functional-479263 get pods
--- PASS: TestFunctional/serial/MinikubeKubectlCmd (0.14s)

                                                
                                    
x
+
TestFunctional/serial/MinikubeKubectlCmdDirectly (0.13s)

                                                
                                                
=== RUN   TestFunctional/serial/MinikubeKubectlCmdDirectly
functional_test.go:737: (dbg) Run:  out/kubectl --context functional-479263 get pods
--- PASS: TestFunctional/serial/MinikubeKubectlCmdDirectly (0.13s)

                                                
                                    
x
+
TestFunctional/serial/ExtraConfig (47.28s)

                                                
                                                
=== RUN   TestFunctional/serial/ExtraConfig
functional_test.go:753: (dbg) Run:  out/minikube-linux-arm64 start -p functional-479263 --extra-config=apiserver.enable-admission-plugins=NamespaceAutoProvision --wait=all
functional_test.go:753: (dbg) Done: out/minikube-linux-arm64 start -p functional-479263 --extra-config=apiserver.enable-admission-plugins=NamespaceAutoProvision --wait=all: (47.279539941s)
functional_test.go:757: restart took 47.279650413s for "functional-479263" cluster.
--- PASS: TestFunctional/serial/ExtraConfig (47.28s)

                                                
                                    
x
+
TestFunctional/serial/ComponentHealth (0.1s)

                                                
                                                
=== RUN   TestFunctional/serial/ComponentHealth
functional_test.go:806: (dbg) Run:  kubectl --context functional-479263 get po -l tier=control-plane -n kube-system -o=json
functional_test.go:821: etcd phase: Running
functional_test.go:831: etcd status: Ready
functional_test.go:821: kube-apiserver phase: Running
functional_test.go:831: kube-apiserver status: Ready
functional_test.go:821: kube-controller-manager phase: Running
functional_test.go:831: kube-controller-manager status: Ready
functional_test.go:821: kube-scheduler phase: Running
functional_test.go:831: kube-scheduler status: Ready
--- PASS: TestFunctional/serial/ComponentHealth (0.10s)

                                                
                                    
x
+
TestFunctional/serial/LogsCmd (1.72s)

                                                
                                                
=== RUN   TestFunctional/serial/LogsCmd
functional_test.go:1232: (dbg) Run:  out/minikube-linux-arm64 -p functional-479263 logs
functional_test.go:1232: (dbg) Done: out/minikube-linux-arm64 -p functional-479263 logs: (1.719877448s)
--- PASS: TestFunctional/serial/LogsCmd (1.72s)

                                                
                                    
x
+
TestFunctional/serial/LogsFileCmd (1.8s)

                                                
                                                
=== RUN   TestFunctional/serial/LogsFileCmd
functional_test.go:1246: (dbg) Run:  out/minikube-linux-arm64 -p functional-479263 logs --file /tmp/TestFunctionalserialLogsFileCmd124159211/001/logs.txt
functional_test.go:1246: (dbg) Done: out/minikube-linux-arm64 -p functional-479263 logs --file /tmp/TestFunctionalserialLogsFileCmd124159211/001/logs.txt: (1.800946533s)
--- PASS: TestFunctional/serial/LogsFileCmd (1.80s)

                                                
                                    
x
+
TestFunctional/serial/InvalidService (4.43s)

                                                
                                                
=== RUN   TestFunctional/serial/InvalidService
functional_test.go:2317: (dbg) Run:  kubectl --context functional-479263 apply -f testdata/invalidsvc.yaml
functional_test.go:2331: (dbg) Run:  out/minikube-linux-arm64 service invalid-svc -p functional-479263
functional_test.go:2331: (dbg) Non-zero exit: out/minikube-linux-arm64 service invalid-svc -p functional-479263: exit status 115 (699.0077ms)

                                                
                                                
-- stdout --
	|-----------|-------------|-------------|---------------------------|
	| NAMESPACE |    NAME     | TARGET PORT |            URL            |
	|-----------|-------------|-------------|---------------------------|
	| default   | invalid-svc |          80 | http://192.168.49.2:30977 |
	|-----------|-------------|-------------|---------------------------|
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	X Exiting due to SVC_UNREACHABLE: service not available: no running pod for service invalid-svc found
	* 
	╭─────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                             │
	│    * If the above advice does not help, please let us know:                                 │
	│      https://github.com/kubernetes/minikube/issues/new/choose                               │
	│                                                                                             │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │
	│    * Please also attach the following file to the GitHub issue:                             │
	│    * - /tmp/minikube_service_96b204199e3191fa1740d4430b018a3c8028d52d_0.log                 │
	│                                                                                             │
	╰─────────────────────────────────────────────────────────────────────────────────────────────╯

                                                
                                                
** /stderr **
functional_test.go:2323: (dbg) Run:  kubectl --context functional-479263 delete -f testdata/invalidsvc.yaml
--- PASS: TestFunctional/serial/InvalidService (4.43s)

                                                
                                    
x
+
TestFunctional/parallel/ConfigCmd (0.47s)

                                                
                                                
=== RUN   TestFunctional/parallel/ConfigCmd
=== PAUSE TestFunctional/parallel/ConfigCmd

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/ConfigCmd
functional_test.go:1195: (dbg) Run:  out/minikube-linux-arm64 -p functional-479263 config unset cpus
functional_test.go:1195: (dbg) Run:  out/minikube-linux-arm64 -p functional-479263 config get cpus
functional_test.go:1195: (dbg) Non-zero exit: out/minikube-linux-arm64 -p functional-479263 config get cpus: exit status 14 (78.491798ms)

                                                
                                                
** stderr ** 
	Error: specified key could not be found in config

                                                
                                                
** /stderr **
functional_test.go:1195: (dbg) Run:  out/minikube-linux-arm64 -p functional-479263 config set cpus 2
functional_test.go:1195: (dbg) Run:  out/minikube-linux-arm64 -p functional-479263 config get cpus
functional_test.go:1195: (dbg) Run:  out/minikube-linux-arm64 -p functional-479263 config unset cpus
functional_test.go:1195: (dbg) Run:  out/minikube-linux-arm64 -p functional-479263 config get cpus
functional_test.go:1195: (dbg) Non-zero exit: out/minikube-linux-arm64 -p functional-479263 config get cpus: exit status 14 (92.457211ms)

                                                
                                                
** stderr ** 
	Error: specified key could not be found in config

                                                
                                                
** /stderr **
--- PASS: TestFunctional/parallel/ConfigCmd (0.47s)

                                                
                                    
x
+
TestFunctional/parallel/DashboardCmd (11.36s)

                                                
                                                
=== RUN   TestFunctional/parallel/DashboardCmd
=== PAUSE TestFunctional/parallel/DashboardCmd

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/DashboardCmd
functional_test.go:901: (dbg) daemon: [out/minikube-linux-arm64 dashboard --url --port 36195 -p functional-479263 --alsologtostderr -v=1]
functional_test.go:906: (dbg) stopping [out/minikube-linux-arm64 dashboard --url --port 36195 -p functional-479263 --alsologtostderr -v=1] ...
helpers_test.go:508: unable to kill pid 174444: os: process already finished
--- PASS: TestFunctional/parallel/DashboardCmd (11.36s)

                                                
                                    
x
+
TestFunctional/parallel/DryRun (0.51s)

                                                
                                                
=== RUN   TestFunctional/parallel/DryRun
=== PAUSE TestFunctional/parallel/DryRun

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/DryRun
functional_test.go:970: (dbg) Run:  out/minikube-linux-arm64 start -p functional-479263 --dry-run --memory 250MB --alsologtostderr --driver=docker  --container-runtime=containerd
functional_test.go:970: (dbg) Non-zero exit: out/minikube-linux-arm64 start -p functional-479263 --dry-run --memory 250MB --alsologtostderr --driver=docker  --container-runtime=containerd: exit status 23 (219.47783ms)

                                                
                                                
-- stdout --
	* [functional-479263] minikube v1.33.1 on Ubuntu 20.04 (arm64)
	  - MINIKUBE_LOCATION=19339
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - KUBECONFIG=/home/jenkins/minikube-integration/19339-134334/kubeconfig
	  - MINIKUBE_HOME=/home/jenkins/minikube-integration/19339-134334/.minikube
	  - MINIKUBE_BIN=out/minikube-linux-arm64
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the docker driver based on existing profile
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0729 20:26:24.216143  174128 out.go:291] Setting OutFile to fd 1 ...
	I0729 20:26:24.216343  174128 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0729 20:26:24.216358  174128 out.go:304] Setting ErrFile to fd 2...
	I0729 20:26:24.216364  174128 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0729 20:26:24.216702  174128 root.go:338] Updating PATH: /home/jenkins/minikube-integration/19339-134334/.minikube/bin
	I0729 20:26:24.217152  174128 out.go:298] Setting JSON to false
	I0729 20:26:24.218311  174128 start.go:129] hostinfo: {"hostname":"ip-172-31-29-130","uptime":65330,"bootTime":1722219454,"procs":213,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1065-aws","kernelArch":"aarch64","virtualizationSystem":"","virtualizationRole":"","hostId":"36adf542-ef4f-4e2d-a0c8-6868d1383ff9"}
	I0729 20:26:24.218396  174128 start.go:139] virtualization:  
	I0729 20:26:24.220994  174128 out.go:177] * [functional-479263] minikube v1.33.1 on Ubuntu 20.04 (arm64)
	I0729 20:26:24.223329  174128 out.go:177]   - MINIKUBE_LOCATION=19339
	I0729 20:26:24.223458  174128 notify.go:220] Checking for updates...
	I0729 20:26:24.227493  174128 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I0729 20:26:24.229499  174128 out.go:177]   - KUBECONFIG=/home/jenkins/minikube-integration/19339-134334/kubeconfig
	I0729 20:26:24.231306  174128 out.go:177]   - MINIKUBE_HOME=/home/jenkins/minikube-integration/19339-134334/.minikube
	I0729 20:26:24.232970  174128 out.go:177]   - MINIKUBE_BIN=out/minikube-linux-arm64
	I0729 20:26:24.234647  174128 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=
	I0729 20:26:24.238352  174128 config.go:182] Loaded profile config "functional-479263": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.30.3
	I0729 20:26:24.238913  174128 driver.go:392] Setting default libvirt URI to qemu:///system
	I0729 20:26:24.275101  174128 docker.go:123] docker version: linux-27.1.1:Docker Engine - Community
	I0729 20:26:24.275226  174128 cli_runner.go:164] Run: docker system info --format "{{json .}}"
	I0729 20:26:24.360973  174128 info.go:266] docker info: {ID:U5VK:ZNT5:35M3:FHLW:Q7TL:ELFX:BNAG:AV4T:UD2H:SK5L:SEJV:SJJL Containers:1 ContainersRunning:1 ContainersPaused:0 ContainersStopped:0 Images:3 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:32 OomKillDisable:true NGoroutines:52 SystemTime:2024-07-29 20:26:24.350530346 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1065-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Architecture:aar
ch64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8214900736 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-29-130 Labels:[] ExperimentalBuild:false ServerVersion:27.1.1 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:2bf793ef6dc9a18e00cb12efb64355c2c9d5eb41 Expected:2bf793ef6dc9a18e00cb12efb64355c2c9d5eb41} RuncCommit:{ID:v1.1.13-0-g58aa920 Expected:v1.1.13-0-g58aa920} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:<nil> ServerErro
rs:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.16.1] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.29.1]] Warnings:<nil>}}
	I0729 20:26:24.361092  174128 docker.go:307] overlay module found
	I0729 20:26:24.363115  174128 out.go:177] * Using the docker driver based on existing profile
	I0729 20:26:24.365178  174128 start.go:297] selected driver: docker
	I0729 20:26:24.365196  174128 start.go:901] validating driver "docker" against &{Name:functional-479263 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721902582-19326@sha256:540fb5dc7f38be17ff5276a38dfe6c8a4b1d9ba1c27c62244e6eebd7e37696e7 Memory:4000 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8441 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.30.3 ClusterName:functional-479263 Namespace:default APIServerHAVIP: APIServerNa
me:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[{Component:apiserver Key:enable-admission-plugins Value:NamespaceAutoProvision}] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.49.2 Port:8441 KubernetesVersion:v1.30.3 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[default-storageclass:true storage-provisioner:true] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:do
cker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I0729 20:26:24.365310  174128 start.go:912] status for docker: {Installed:true Healthy:true Running:false NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I0729 20:26:24.369097  174128 out.go:177] 
	W0729 20:26:24.371315  174128 out.go:239] X Exiting due to RSRC_INSUFFICIENT_REQ_MEMORY: Requested memory allocation 250MiB is less than the usable minimum of 1800MB
	X Exiting due to RSRC_INSUFFICIENT_REQ_MEMORY: Requested memory allocation 250MiB is less than the usable minimum of 1800MB
	I0729 20:26:24.373458  174128 out.go:177] 

                                                
                                                
** /stderr **
functional_test.go:987: (dbg) Run:  out/minikube-linux-arm64 start -p functional-479263 --dry-run --alsologtostderr -v=1 --driver=docker  --container-runtime=containerd
--- PASS: TestFunctional/parallel/DryRun (0.51s)

                                                
                                    
x
+
TestFunctional/parallel/InternationalLanguage (0.3s)

                                                
                                                
=== RUN   TestFunctional/parallel/InternationalLanguage
=== PAUSE TestFunctional/parallel/InternationalLanguage

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/InternationalLanguage
functional_test.go:1016: (dbg) Run:  out/minikube-linux-arm64 start -p functional-479263 --dry-run --memory 250MB --alsologtostderr --driver=docker  --container-runtime=containerd
functional_test.go:1016: (dbg) Non-zero exit: out/minikube-linux-arm64 start -p functional-479263 --dry-run --memory 250MB --alsologtostderr --driver=docker  --container-runtime=containerd: exit status 23 (299.100917ms)

                                                
                                                
-- stdout --
	* [functional-479263] minikube v1.33.1 sur Ubuntu 20.04 (arm64)
	  - MINIKUBE_LOCATION=19339
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - KUBECONFIG=/home/jenkins/minikube-integration/19339-134334/kubeconfig
	  - MINIKUBE_HOME=/home/jenkins/minikube-integration/19339-134334/.minikube
	  - MINIKUBE_BIN=out/minikube-linux-arm64
	  - MINIKUBE_FORCE_SYSTEMD=
	* Utilisation du pilote docker basé sur le profil existant
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0729 20:26:23.946100  174021 out.go:291] Setting OutFile to fd 1 ...
	I0729 20:26:23.946306  174021 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0729 20:26:23.946320  174021 out.go:304] Setting ErrFile to fd 2...
	I0729 20:26:23.946327  174021 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0729 20:26:23.947144  174021 root.go:338] Updating PATH: /home/jenkins/minikube-integration/19339-134334/.minikube/bin
	I0729 20:26:23.947604  174021 out.go:298] Setting JSON to false
	I0729 20:26:23.948827  174021 start.go:129] hostinfo: {"hostname":"ip-172-31-29-130","uptime":65330,"bootTime":1722219454,"procs":211,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1065-aws","kernelArch":"aarch64","virtualizationSystem":"","virtualizationRole":"","hostId":"36adf542-ef4f-4e2d-a0c8-6868d1383ff9"}
	I0729 20:26:23.948938  174021 start.go:139] virtualization:  
	I0729 20:26:23.954122  174021 out.go:177] * [functional-479263] minikube v1.33.1 sur Ubuntu 20.04 (arm64)
	I0729 20:26:23.956144  174021 out.go:177]   - MINIKUBE_LOCATION=19339
	I0729 20:26:23.956324  174021 notify.go:220] Checking for updates...
	I0729 20:26:23.959949  174021 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I0729 20:26:23.961835  174021 out.go:177]   - KUBECONFIG=/home/jenkins/minikube-integration/19339-134334/kubeconfig
	I0729 20:26:23.963615  174021 out.go:177]   - MINIKUBE_HOME=/home/jenkins/minikube-integration/19339-134334/.minikube
	I0729 20:26:23.965501  174021 out.go:177]   - MINIKUBE_BIN=out/minikube-linux-arm64
	I0729 20:26:23.967307  174021 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=
	I0729 20:26:23.969684  174021 config.go:182] Loaded profile config "functional-479263": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.30.3
	I0729 20:26:23.970295  174021 driver.go:392] Setting default libvirt URI to qemu:///system
	I0729 20:26:24.022643  174021 docker.go:123] docker version: linux-27.1.1:Docker Engine - Community
	I0729 20:26:24.022929  174021 cli_runner.go:164] Run: docker system info --format "{{json .}}"
	I0729 20:26:24.142887  174021 info.go:266] docker info: {ID:U5VK:ZNT5:35M3:FHLW:Q7TL:ELFX:BNAG:AV4T:UD2H:SK5L:SEJV:SJJL Containers:1 ContainersRunning:1 ContainersPaused:0 ContainersStopped:0 Images:3 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:32 OomKillDisable:true NGoroutines:52 SystemTime:2024-07-29 20:26:24.130418094 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1065-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Architecture:aar
ch64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8214900736 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-29-130 Labels:[] ExperimentalBuild:false ServerVersion:27.1.1 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:2bf793ef6dc9a18e00cb12efb64355c2c9d5eb41 Expected:2bf793ef6dc9a18e00cb12efb64355c2c9d5eb41} RuncCommit:{ID:v1.1.13-0-g58aa920 Expected:v1.1.13-0-g58aa920} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:<nil> ServerErro
rs:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.16.1] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.29.1]] Warnings:<nil>}}
	I0729 20:26:24.143009  174021 docker.go:307] overlay module found
	I0729 20:26:24.147212  174021 out.go:177] * Utilisation du pilote docker basé sur le profil existant
	I0729 20:26:24.149212  174021 start.go:297] selected driver: docker
	I0729 20:26:24.149238  174021 start.go:901] validating driver "docker" against &{Name:functional-479263 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721902582-19326@sha256:540fb5dc7f38be17ff5276a38dfe6c8a4b1d9ba1c27c62244e6eebd7e37696e7 Memory:4000 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8441 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.30.3 ClusterName:functional-479263 Namespace:default APIServerHAVIP: APIServerNa
me:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[{Component:apiserver Key:enable-admission-plugins Value:NamespaceAutoProvision}] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.49.2 Port:8441 KubernetesVersion:v1.30.3 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[default-storageclass:true storage-provisioner:true] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:do
cker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I0729 20:26:24.149428  174021 start.go:912] status for docker: {Installed:true Healthy:true Running:false NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I0729 20:26:24.152222  174021 out.go:177] 
	W0729 20:26:24.155578  174021 out.go:239] X Fermeture en raison de RSRC_INSUFFICIENT_REQ_MEMORY : L'allocation de mémoire demandée 250 Mio est inférieure au minimum utilisable de 1800 Mo
	X Fermeture en raison de RSRC_INSUFFICIENT_REQ_MEMORY : L'allocation de mémoire demandée 250 Mio est inférieure au minimum utilisable de 1800 Mo
	I0729 20:26:24.158214  174021 out.go:177] 

                                                
                                                
** /stderr **
--- PASS: TestFunctional/parallel/InternationalLanguage (0.30s)

                                                
                                    
x
+
TestFunctional/parallel/StatusCmd (1.18s)

                                                
                                                
=== RUN   TestFunctional/parallel/StatusCmd
=== PAUSE TestFunctional/parallel/StatusCmd

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/StatusCmd
functional_test.go:850: (dbg) Run:  out/minikube-linux-arm64 -p functional-479263 status
functional_test.go:856: (dbg) Run:  out/minikube-linux-arm64 -p functional-479263 status -f host:{{.Host}},kublet:{{.Kubelet}},apiserver:{{.APIServer}},kubeconfig:{{.Kubeconfig}}
functional_test.go:868: (dbg) Run:  out/minikube-linux-arm64 -p functional-479263 status -o json
--- PASS: TestFunctional/parallel/StatusCmd (1.18s)

                                                
                                    
x
+
TestFunctional/parallel/ServiceCmdConnect (10.64s)

                                                
                                                
=== RUN   TestFunctional/parallel/ServiceCmdConnect
=== PAUSE TestFunctional/parallel/ServiceCmdConnect

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/ServiceCmdConnect
functional_test.go:1623: (dbg) Run:  kubectl --context functional-479263 create deployment hello-node-connect --image=registry.k8s.io/echoserver-arm:1.8
functional_test.go:1631: (dbg) Run:  kubectl --context functional-479263 expose deployment hello-node-connect --type=NodePort --port=8080
functional_test.go:1636: (dbg) TestFunctional/parallel/ServiceCmdConnect: waiting 10m0s for pods matching "app=hello-node-connect" in namespace "default" ...
helpers_test.go:344: "hello-node-connect-6f49f58cd5-prllm" [2604f0be-ee70-4552-a1fe-14091b3e868e] Pending / Ready:ContainersNotReady (containers with unready status: [echoserver-arm]) / ContainersReady:ContainersNotReady (containers with unready status: [echoserver-arm])
helpers_test.go:344: "hello-node-connect-6f49f58cd5-prllm" [2604f0be-ee70-4552-a1fe-14091b3e868e] Running
functional_test.go:1636: (dbg) TestFunctional/parallel/ServiceCmdConnect: app=hello-node-connect healthy within 10.003764947s
functional_test.go:1645: (dbg) Run:  out/minikube-linux-arm64 -p functional-479263 service hello-node-connect --url
functional_test.go:1651: found endpoint for hello-node-connect: http://192.168.49.2:31233
functional_test.go:1671: http://192.168.49.2:31233: success! body:

                                                
                                                

                                                
                                                
Hostname: hello-node-connect-6f49f58cd5-prllm

                                                
                                                
Pod Information:
	-no pod information available-

                                                
                                                
Server values:
	server_version=nginx: 1.13.3 - lua: 10008

                                                
                                                
Request Information:
	client_address=10.244.0.1
	method=GET
	real path=/
	query=
	request_version=1.1
	request_uri=http://192.168.49.2:8080/

                                                
                                                
Request Headers:
	accept-encoding=gzip
	host=192.168.49.2:31233
	user-agent=Go-http-client/1.1

                                                
                                                
Request Body:
	-no body in request-

                                                
                                                
--- PASS: TestFunctional/parallel/ServiceCmdConnect (10.64s)

                                                
                                    
x
+
TestFunctional/parallel/AddonsCmd (0.15s)

                                                
                                                
=== RUN   TestFunctional/parallel/AddonsCmd
=== PAUSE TestFunctional/parallel/AddonsCmd

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/AddonsCmd
functional_test.go:1686: (dbg) Run:  out/minikube-linux-arm64 -p functional-479263 addons list
functional_test.go:1698: (dbg) Run:  out/minikube-linux-arm64 -p functional-479263 addons list -o json
--- PASS: TestFunctional/parallel/AddonsCmd (0.15s)

                                                
                                    
x
+
TestFunctional/parallel/PersistentVolumeClaim (24.77s)

                                                
                                                
=== RUN   TestFunctional/parallel/PersistentVolumeClaim
=== PAUSE TestFunctional/parallel/PersistentVolumeClaim

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/PersistentVolumeClaim
functional_test_pvc_test.go:44: (dbg) TestFunctional/parallel/PersistentVolumeClaim: waiting 4m0s for pods matching "integration-test=storage-provisioner" in namespace "kube-system" ...
helpers_test.go:344: "storage-provisioner" [25e7a2c4-b740-4b09-a2f9-54381893b0e6] Running
functional_test_pvc_test.go:44: (dbg) TestFunctional/parallel/PersistentVolumeClaim: integration-test=storage-provisioner healthy within 5.013159803s
functional_test_pvc_test.go:49: (dbg) Run:  kubectl --context functional-479263 get storageclass -o=json
functional_test_pvc_test.go:69: (dbg) Run:  kubectl --context functional-479263 apply -f testdata/storage-provisioner/pvc.yaml
functional_test_pvc_test.go:76: (dbg) Run:  kubectl --context functional-479263 get pvc myclaim -o=json
functional_test_pvc_test.go:76: (dbg) Run:  kubectl --context functional-479263 get pvc myclaim -o=json
functional_test_pvc_test.go:125: (dbg) Run:  kubectl --context functional-479263 apply -f testdata/storage-provisioner/pod.yaml
functional_test_pvc_test.go:130: (dbg) TestFunctional/parallel/PersistentVolumeClaim: waiting 3m0s for pods matching "test=storage-provisioner" in namespace "default" ...
helpers_test.go:344: "sp-pod" [ed866ad0-b922-45f2-b12d-dbb19de391c9] Pending
helpers_test.go:344: "sp-pod" [ed866ad0-b922-45f2-b12d-dbb19de391c9] Pending / Ready:ContainersNotReady (containers with unready status: [myfrontend]) / ContainersReady:ContainersNotReady (containers with unready status: [myfrontend])
helpers_test.go:344: "sp-pod" [ed866ad0-b922-45f2-b12d-dbb19de391c9] Running
functional_test_pvc_test.go:130: (dbg) TestFunctional/parallel/PersistentVolumeClaim: test=storage-provisioner healthy within 9.004009843s
functional_test_pvc_test.go:100: (dbg) Run:  kubectl --context functional-479263 exec sp-pod -- touch /tmp/mount/foo
functional_test_pvc_test.go:106: (dbg) Run:  kubectl --context functional-479263 delete -f testdata/storage-provisioner/pod.yaml
functional_test_pvc_test.go:106: (dbg) Done: kubectl --context functional-479263 delete -f testdata/storage-provisioner/pod.yaml: (1.625679814s)
functional_test_pvc_test.go:125: (dbg) Run:  kubectl --context functional-479263 apply -f testdata/storage-provisioner/pod.yaml
functional_test_pvc_test.go:130: (dbg) TestFunctional/parallel/PersistentVolumeClaim: waiting 3m0s for pods matching "test=storage-provisioner" in namespace "default" ...
helpers_test.go:344: "sp-pod" [e7da07ee-8d00-4cdf-a798-e1f957c65054] Pending
helpers_test.go:344: "sp-pod" [e7da07ee-8d00-4cdf-a798-e1f957c65054] Running
functional_test_pvc_test.go:130: (dbg) TestFunctional/parallel/PersistentVolumeClaim: test=storage-provisioner healthy within 6.004883025s
functional_test_pvc_test.go:114: (dbg) Run:  kubectl --context functional-479263 exec sp-pod -- ls /tmp/mount
--- PASS: TestFunctional/parallel/PersistentVolumeClaim (24.77s)

                                                
                                    
x
+
TestFunctional/parallel/SSHCmd (0.73s)

                                                
                                                
=== RUN   TestFunctional/parallel/SSHCmd
=== PAUSE TestFunctional/parallel/SSHCmd

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/SSHCmd
functional_test.go:1721: (dbg) Run:  out/minikube-linux-arm64 -p functional-479263 ssh "echo hello"
functional_test.go:1738: (dbg) Run:  out/minikube-linux-arm64 -p functional-479263 ssh "cat /etc/hostname"
--- PASS: TestFunctional/parallel/SSHCmd (0.73s)

                                                
                                    
x
+
TestFunctional/parallel/CpCmd (1.95s)

                                                
                                                
=== RUN   TestFunctional/parallel/CpCmd
=== PAUSE TestFunctional/parallel/CpCmd

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/CpCmd
helpers_test.go:556: (dbg) Run:  out/minikube-linux-arm64 -p functional-479263 cp testdata/cp-test.txt /home/docker/cp-test.txt
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p functional-479263 ssh -n functional-479263 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:556: (dbg) Run:  out/minikube-linux-arm64 -p functional-479263 cp functional-479263:/home/docker/cp-test.txt /tmp/TestFunctionalparallelCpCmd1537707646/001/cp-test.txt
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p functional-479263 ssh -n functional-479263 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:556: (dbg) Run:  out/minikube-linux-arm64 -p functional-479263 cp testdata/cp-test.txt /tmp/does/not/exist/cp-test.txt
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p functional-479263 ssh -n functional-479263 "sudo cat /tmp/does/not/exist/cp-test.txt"
--- PASS: TestFunctional/parallel/CpCmd (1.95s)

                                                
                                    
x
+
TestFunctional/parallel/FileSync (0.37s)

                                                
                                                
=== RUN   TestFunctional/parallel/FileSync
=== PAUSE TestFunctional/parallel/FileSync

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/FileSync
functional_test.go:1925: Checking for existence of /etc/test/nested/copy/139728/hosts within VM
functional_test.go:1927: (dbg) Run:  out/minikube-linux-arm64 -p functional-479263 ssh "sudo cat /etc/test/nested/copy/139728/hosts"
functional_test.go:1932: file sync test content: Test file for checking file sync process
--- PASS: TestFunctional/parallel/FileSync (0.37s)

                                                
                                    
x
+
TestFunctional/parallel/CertSync (2.07s)

                                                
                                                
=== RUN   TestFunctional/parallel/CertSync
=== PAUSE TestFunctional/parallel/CertSync

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/CertSync
functional_test.go:1968: Checking for existence of /etc/ssl/certs/139728.pem within VM
functional_test.go:1969: (dbg) Run:  out/minikube-linux-arm64 -p functional-479263 ssh "sudo cat /etc/ssl/certs/139728.pem"
functional_test.go:1968: Checking for existence of /usr/share/ca-certificates/139728.pem within VM
functional_test.go:1969: (dbg) Run:  out/minikube-linux-arm64 -p functional-479263 ssh "sudo cat /usr/share/ca-certificates/139728.pem"
functional_test.go:1968: Checking for existence of /etc/ssl/certs/51391683.0 within VM
functional_test.go:1969: (dbg) Run:  out/minikube-linux-arm64 -p functional-479263 ssh "sudo cat /etc/ssl/certs/51391683.0"
functional_test.go:1995: Checking for existence of /etc/ssl/certs/1397282.pem within VM
functional_test.go:1996: (dbg) Run:  out/minikube-linux-arm64 -p functional-479263 ssh "sudo cat /etc/ssl/certs/1397282.pem"
functional_test.go:1995: Checking for existence of /usr/share/ca-certificates/1397282.pem within VM
functional_test.go:1996: (dbg) Run:  out/minikube-linux-arm64 -p functional-479263 ssh "sudo cat /usr/share/ca-certificates/1397282.pem"
functional_test.go:1995: Checking for existence of /etc/ssl/certs/3ec20f2e.0 within VM
functional_test.go:1996: (dbg) Run:  out/minikube-linux-arm64 -p functional-479263 ssh "sudo cat /etc/ssl/certs/3ec20f2e.0"
--- PASS: TestFunctional/parallel/CertSync (2.07s)

                                                
                                    
x
+
TestFunctional/parallel/NodeLabels (0.09s)

                                                
                                                
=== RUN   TestFunctional/parallel/NodeLabels
=== PAUSE TestFunctional/parallel/NodeLabels

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/NodeLabels
functional_test.go:218: (dbg) Run:  kubectl --context functional-479263 get nodes --output=go-template "--template='{{range $k, $v := (index .items 0).metadata.labels}}{{$k}} {{end}}'"
--- PASS: TestFunctional/parallel/NodeLabels (0.09s)

                                                
                                    
x
+
TestFunctional/parallel/NonActiveRuntimeDisabled (0.7s)

                                                
                                                
=== RUN   TestFunctional/parallel/NonActiveRuntimeDisabled
=== PAUSE TestFunctional/parallel/NonActiveRuntimeDisabled

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/NonActiveRuntimeDisabled
functional_test.go:2023: (dbg) Run:  out/minikube-linux-arm64 -p functional-479263 ssh "sudo systemctl is-active docker"
functional_test.go:2023: (dbg) Non-zero exit: out/minikube-linux-arm64 -p functional-479263 ssh "sudo systemctl is-active docker": exit status 1 (349.005715ms)

                                                
                                                
-- stdout --
	inactive

                                                
                                                
-- /stdout --
** stderr ** 
	ssh: Process exited with status 3

                                                
                                                
** /stderr **
functional_test.go:2023: (dbg) Run:  out/minikube-linux-arm64 -p functional-479263 ssh "sudo systemctl is-active crio"
functional_test.go:2023: (dbg) Non-zero exit: out/minikube-linux-arm64 -p functional-479263 ssh "sudo systemctl is-active crio": exit status 1 (348.940371ms)

                                                
                                                
-- stdout --
	inactive

                                                
                                                
-- /stdout --
** stderr ** 
	ssh: Process exited with status 3

                                                
                                                
** /stderr **
--- PASS: TestFunctional/parallel/NonActiveRuntimeDisabled (0.70s)

                                                
                                    
x
+
TestFunctional/parallel/License (0.26s)

                                                
                                                
=== RUN   TestFunctional/parallel/License
=== PAUSE TestFunctional/parallel/License

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/License
functional_test.go:2284: (dbg) Run:  out/minikube-linux-arm64 license
--- PASS: TestFunctional/parallel/License (0.26s)

                                                
                                    
x
+
TestFunctional/parallel/Version/short (0.06s)

                                                
                                                
=== RUN   TestFunctional/parallel/Version/short
=== PAUSE TestFunctional/parallel/Version/short

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/Version/short
functional_test.go:2252: (dbg) Run:  out/minikube-linux-arm64 -p functional-479263 version --short
--- PASS: TestFunctional/parallel/Version/short (0.06s)

                                                
                                    
x
+
TestFunctional/parallel/Version/components (1.15s)

                                                
                                                
=== RUN   TestFunctional/parallel/Version/components
=== PAUSE TestFunctional/parallel/Version/components

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/Version/components
functional_test.go:2266: (dbg) Run:  out/minikube-linux-arm64 -p functional-479263 version -o=json --components
functional_test.go:2266: (dbg) Done: out/minikube-linux-arm64 -p functional-479263 version -o=json --components: (1.14638719s)
--- PASS: TestFunctional/parallel/Version/components (1.15s)

                                                
                                    
x
+
TestFunctional/parallel/ImageCommands/ImageListShort (0.25s)

                                                
                                                
=== RUN   TestFunctional/parallel/ImageCommands/ImageListShort
=== PAUSE TestFunctional/parallel/ImageCommands/ImageListShort

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/ImageCommands/ImageListShort
functional_test.go:260: (dbg) Run:  out/minikube-linux-arm64 -p functional-479263 image ls --format short --alsologtostderr
2024/07/29 20:26:35 [DEBUG] GET http://127.0.0.1:36195/api/v1/namespaces/kubernetes-dashboard/services/http:kubernetes-dashboard:/proxy/
functional_test.go:265: (dbg) Stdout: out/minikube-linux-arm64 -p functional-479263 image ls --format short --alsologtostderr:
registry.k8s.io/pause:latest
registry.k8s.io/pause:3.9
registry.k8s.io/pause:3.3
registry.k8s.io/pause:3.1
registry.k8s.io/kube-scheduler:v1.30.3
registry.k8s.io/kube-proxy:v1.30.3
registry.k8s.io/kube-controller-manager:v1.30.3
registry.k8s.io/kube-apiserver:v1.30.3
registry.k8s.io/etcd:3.5.12-0
registry.k8s.io/echoserver-arm:1.8
registry.k8s.io/coredns/coredns:v1.11.1
gcr.io/k8s-minikube/storage-provisioner:v5
gcr.io/k8s-minikube/busybox:1.28.4-glibc
docker.io/library/nginx:latest
docker.io/library/nginx:alpine
docker.io/library/minikube-local-cache-test:functional-479263
docker.io/kindest/kindnetd:v20240719-e7903573
docker.io/kindest/kindnetd:v20240715-585640e9
docker.io/kicbase/echo-server:functional-479263
functional_test.go:268: (dbg) Stderr: out/minikube-linux-arm64 -p functional-479263 image ls --format short --alsologtostderr:
I0729 20:26:35.781965  175965 out.go:291] Setting OutFile to fd 1 ...
I0729 20:26:35.782109  175965 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0729 20:26:35.782118  175965 out.go:304] Setting ErrFile to fd 2...
I0729 20:26:35.782124  175965 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0729 20:26:35.782425  175965 root.go:338] Updating PATH: /home/jenkins/minikube-integration/19339-134334/.minikube/bin
I0729 20:26:35.783074  175965 config.go:182] Loaded profile config "functional-479263": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.30.3
I0729 20:26:35.783202  175965 config.go:182] Loaded profile config "functional-479263": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.30.3
I0729 20:26:35.783741  175965 cli_runner.go:164] Run: docker container inspect functional-479263 --format={{.State.Status}}
I0729 20:26:35.801329  175965 ssh_runner.go:195] Run: systemctl --version
I0729 20:26:35.801404  175965 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" functional-479263
I0729 20:26:35.854634  175965 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:37050 SSHKeyPath:/home/jenkins/minikube-integration/19339-134334/.minikube/machines/functional-479263/id_rsa Username:docker}
I0729 20:26:35.948351  175965 ssh_runner.go:195] Run: sudo crictl images --output json
--- PASS: TestFunctional/parallel/ImageCommands/ImageListShort (0.25s)

                                                
                                    
x
+
TestFunctional/parallel/ImageCommands/ImageListTable (0.29s)

                                                
                                                
=== RUN   TestFunctional/parallel/ImageCommands/ImageListTable
=== PAUSE TestFunctional/parallel/ImageCommands/ImageListTable

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/ImageCommands/ImageListTable
functional_test.go:260: (dbg) Run:  out/minikube-linux-arm64 -p functional-479263 image ls --format table --alsologtostderr
functional_test.go:265: (dbg) Stdout: out/minikube-linux-arm64 -p functional-479263 image ls --format table --alsologtostderr:
|---------------------------------------------|--------------------|---------------|--------|
|                    Image                    |        Tag         |   Image ID    |  Size  |
|---------------------------------------------|--------------------|---------------|--------|
| docker.io/kicbase/echo-server               | functional-479263  | sha256:ce2d2c | 2.17MB |
| gcr.io/k8s-minikube/busybox                 | 1.28.4-glibc       | sha256:1611cd | 1.94MB |
| registry.k8s.io/kube-controller-manager     | v1.30.3            | sha256:8e97cd | 28.4MB |
| registry.k8s.io/pause                       | 3.3                | sha256:3d1873 | 249kB  |
| docker.io/kindest/kindnetd                  | v20240715-585640e9 | sha256:5e3296 | 33.3MB |
| docker.io/kindest/kindnetd                  | v20240719-e7903573 | sha256:f42786 | 33.3MB |
| registry.k8s.io/pause                       | latest             | sha256:8cb209 | 71.3kB |
| registry.k8s.io/pause                       | 3.1                | sha256:8057e0 | 262kB  |
| registry.k8s.io/pause                       | 3.9                | sha256:829e9d | 268kB  |
| registry.k8s.io/etcd                        | 3.5.12-0           | sha256:014faa | 66.2MB |
| registry.k8s.io/kube-scheduler              | v1.30.3            | sha256:d48f99 | 17.6MB |
| registry.k8s.io/echoserver-arm              | 1.8                | sha256:72565b | 45.3MB |
| docker.io/library/nginx                     | latest             | sha256:43b17f | 67.6MB |
| gcr.io/k8s-minikube/storage-provisioner     | v5                 | sha256:ba04bb | 8.03MB |
| registry.k8s.io/coredns/coredns             | v1.11.1            | sha256:2437cf | 16.5MB |
| registry.k8s.io/kube-apiserver              | v1.30.3            | sha256:617731 | 29.9MB |
| registry.k8s.io/kube-proxy                  | v1.30.3            | sha256:2351f5 | 25.6MB |
| docker.io/library/minikube-local-cache-test | functional-479263  | sha256:9c14b5 | 992B   |
| docker.io/library/nginx                     | alpine             | sha256:d7cd33 | 18.3MB |
|---------------------------------------------|--------------------|---------------|--------|
functional_test.go:268: (dbg) Stderr: out/minikube-linux-arm64 -p functional-479263 image ls --format table --alsologtostderr:
I0729 20:26:36.608446  176143 out.go:291] Setting OutFile to fd 1 ...
I0729 20:26:36.608587  176143 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0729 20:26:36.608613  176143 out.go:304] Setting ErrFile to fd 2...
I0729 20:26:36.608618  176143 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0729 20:26:36.609100  176143 root.go:338] Updating PATH: /home/jenkins/minikube-integration/19339-134334/.minikube/bin
I0729 20:26:36.610947  176143 config.go:182] Loaded profile config "functional-479263": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.30.3
I0729 20:26:36.612064  176143 config.go:182] Loaded profile config "functional-479263": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.30.3
I0729 20:26:36.612800  176143 cli_runner.go:164] Run: docker container inspect functional-479263 --format={{.State.Status}}
I0729 20:26:36.639592  176143 ssh_runner.go:195] Run: systemctl --version
I0729 20:26:36.639734  176143 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" functional-479263
I0729 20:26:36.665719  176143 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:37050 SSHKeyPath:/home/jenkins/minikube-integration/19339-134334/.minikube/machines/functional-479263/id_rsa Username:docker}
I0729 20:26:36.772865  176143 ssh_runner.go:195] Run: sudo crictl images --output json
--- PASS: TestFunctional/parallel/ImageCommands/ImageListTable (0.29s)

                                                
                                    
x
+
TestFunctional/parallel/ImageCommands/ImageListJson (0.27s)

                                                
                                                
=== RUN   TestFunctional/parallel/ImageCommands/ImageListJson
=== PAUSE TestFunctional/parallel/ImageCommands/ImageListJson

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/ImageCommands/ImageListJson
functional_test.go:260: (dbg) Run:  out/minikube-linux-arm64 -p functional-479263 image ls --format json --alsologtostderr
functional_test.go:265: (dbg) Stdout: out/minikube-linux-arm64 -p functional-479263 image ls --format json --alsologtostderr:
[{"id":"sha256:d48f992a22722fc0290769b8fab1186db239bbad4cff837fbb641c55faef9355","repoDigests":["registry.k8s.io/kube-scheduler@sha256:2147ab5d2c73dd84e28332fcbee6826d1648eed30a531a52a96501b37d7ee4e4"],"repoTags":["registry.k8s.io/kube-scheduler:v1.30.3"],"size":"17641143"},{"id":"sha256:9c14b541f1e4d3bd89bc0b5b84e0c44b153383fb884c861b4a82129b7e2d71df","repoDigests":[],"repoTags":["docker.io/library/minikube-local-cache-test:functional-479263"],"size":"992"},{"id":"sha256:d7cd33d7d4ed1cdef69594adc36fcc03a0aa45ba930d39a9286024d9b2322660","repoDigests":["docker.io/library/nginx@sha256:208b70eefac13ee9be00e486f79c695b15cef861c680527171a27d253d834be9"],"repoTags":["docker.io/library/nginx:alpine"],"size":"18253575"},{"id":"sha256:8e97cdb19e7cc420af7c71de8b5c9ab536bd278758c8c0878c464b833d91b31a","repoDigests":["registry.k8s.io/kube-controller-manager@sha256:eff43da55a29a5e66ec9480f28233d733a6a8433b7a46f6e8c07086fa4ef69b7"],"repoTags":["registry.k8s.io/kube-controller-manager:v1.30.3"],"size":"28374500"},{"
id":"sha256:8057e0500773a37cde2cff041eb13ebd68c748419a2fbfd1dfb5bf38696cc8e5","repoDigests":[],"repoTags":["registry.k8s.io/pause:3.1"],"size":"262191"},{"id":"sha256:a422e0e982356f6c1cf0e5bb7b733363caae3992a07c99951fbcc73e58ed656a","repoDigests":["docker.io/kubernetesui/metrics-scraper@sha256:76049887f07a0476dc93efc2d3569b9529bf982b22d29f356092ce206e98765c"],"repoTags":[],"size":"18306114"},{"id":"sha256:8cb2091f603e75187e2f6226c5901d12e00b1d1f778c6471ae4578e8a1c4724a","repoDigests":[],"repoTags":["registry.k8s.io/pause:latest"],"size":"71300"},{"id":"sha256:5e32961ddcea3ade65511b2e27f675bbda25305639279f8b708014019e8cebb2","repoDigests":["docker.io/kindest/kindnetd@sha256:88ed2adbc140254762f98fad7f4b16d279117356ebaf95aebf191713c828a493"],"repoTags":["docker.io/kindest/kindnetd:v20240715-585640e9"],"size":"33290438"},{"id":"sha256:43b17fe33c4b4cf8de762123d33e02f2ed0c5e1178002f533d4fb5df1e05fb76","repoDigests":["docker.io/library/nginx@sha256:6af79ae5de407283dcea8b00d5c37ace95441fd58a8b1d2aa1ed93f5511bb18c"],"
repoTags":["docker.io/library/nginx:latest"],"size":"67647629"},{"id":"sha256:2437cf762177702dec2dfe99a09c37427a15af6d9a57c456b65352667c223d93","repoDigests":["registry.k8s.io/coredns/coredns@sha256:1eeb4c7316bacb1d4c8ead65571cd92dd21e27359f0d4917f1a5822a73b75db1"],"repoTags":["registry.k8s.io/coredns/coredns:v1.11.1"],"size":"16482581"},{"id":"sha256:72565bf5bbedfb62e9d21afa2b1221b2c7a5e05b746dae33430bc550d3f87beb","repoDigests":["registry.k8s.io/echoserver-arm@sha256:b33d4cdf6ed097f4e9b77b135d83a596ab73c6268b0342648818eb85f5edfdb5"],"repoTags":["registry.k8s.io/echoserver-arm:1.8"],"size":"45324675"},{"id":"sha256:61773190d42ff0792f3bab2658e80b1c07519170955bb350b153b564ef28f4ca","repoDigests":["registry.k8s.io/kube-apiserver@sha256:a36d558835e48950f6d13b1edbe20605b8dfbc81e088f58221796631e107966c"],"repoTags":["registry.k8s.io/kube-apiserver:v1.30.3"],"size":"29942692"},{"id":"sha256:2351f570ed0eac5533e538280d73c6aa5d6b6f6379f5f3fac08f51378621e6be","repoDigests":["registry.k8s.io/kube-proxy@sha256:b26e535e8e
e1cbd7dc5642fb61bd36e9d23f32e9242ae0010b2905656e664f65"],"repoTags":["registry.k8s.io/kube-proxy:v1.30.3"],"size":"25645955"},{"id":"sha256:3d18732f8686cc3c878055d99a05fa80289502fa496b36b6a0fe0f77206a7300","repoDigests":[],"repoTags":["registry.k8s.io/pause:3.3"],"size":"249461"},{"id":"sha256:f42786f8afd2214fc59fbf9a26531806f562488d4a7d7a31e8b5e9ff6289b800","repoDigests":["docker.io/kindest/kindnetd@sha256:da8ad203ec15a72c313015e5609db44bfad7c95d8ce63e87ff97c66363b5680a"],"repoTags":["docker.io/kindest/kindnetd:v20240719-e7903573"],"size":"33296266"},{"id":"sha256:1611cd07b61d57dbbfebe6db242513fd51e1c02d20ba08af17a45837d86a8a8c","repoDigests":["gcr.io/k8s-minikube/busybox@sha256:2d03e6ceeb99250061dd110530b0ece7998cd84121f952adef120ea7c5a6f00e"],"repoTags":["gcr.io/k8s-minikube/busybox:1.28.4-glibc"],"size":"1935750"},{"id":"sha256:ba04bb24b95753201135cbc420b233c1b0b9fa2e1fd21d28319c348c33fbcde6","repoDigests":["gcr.io/k8s-minikube/storage-provisioner@sha256:18eb69d1418e854ad5a19e399310e52808a8321e4c441c1ddda
d8977a0d7a944"],"repoTags":["gcr.io/k8s-minikube/storage-provisioner:v5"],"size":"8034419"},{"id":"sha256:829e9de338bd5fdd3f16f68f83a9fb288fbc8453e881e5d5cfd0f6f2ff72b43e","repoDigests":["registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097"],"repoTags":["registry.k8s.io/pause:3.9"],"size":"268051"},{"id":"sha256:ce2d2cda2d858fdaea84129deb86d18e5dbf1c548f230b79fdca74cc91729d17","repoDigests":[],"repoTags":["docker.io/kicbase/echo-server:functional-479263"],"size":"2173567"},{"id":"sha256:20b332c9a70d8516d849d1ac23eff5800cbb2f263d379f0ec11ee908db6b25a8","repoDigests":["docker.io/kubernetesui/dashboard@sha256:2e500d29e9d5f4a086b908eb8dfe7ecac57d2ab09d65b24f588b1d449841ef93"],"repoTags":[],"size":"74084559"},{"id":"sha256:014faa467e29798aeef733fe6d1a3b5e382688217b053ad23410e6cccd5d22fd","repoDigests":["registry.k8s.io/etcd@sha256:44a8e24dcbba3470ee1fee21d5e88d128c936e9b55d4bc51fbef8086f8ed123b"],"repoTags":["registry.k8s.io/etcd:3.5.12-0"],"size":"66189079"}]
functional_test.go:268: (dbg) Stderr: out/minikube-linux-arm64 -p functional-479263 image ls --format json --alsologtostderr:
I0729 20:26:36.333676  176085 out.go:291] Setting OutFile to fd 1 ...
I0729 20:26:36.333876  176085 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0729 20:26:36.333906  176085 out.go:304] Setting ErrFile to fd 2...
I0729 20:26:36.333926  176085 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0729 20:26:36.334175  176085 root.go:338] Updating PATH: /home/jenkins/minikube-integration/19339-134334/.minikube/bin
I0729 20:26:36.334870  176085 config.go:182] Loaded profile config "functional-479263": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.30.3
I0729 20:26:36.335048  176085 config.go:182] Loaded profile config "functional-479263": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.30.3
I0729 20:26:36.335633  176085 cli_runner.go:164] Run: docker container inspect functional-479263 --format={{.State.Status}}
I0729 20:26:36.353748  176085 ssh_runner.go:195] Run: systemctl --version
I0729 20:26:36.353817  176085 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" functional-479263
I0729 20:26:36.381882  176085 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:37050 SSHKeyPath:/home/jenkins/minikube-integration/19339-134334/.minikube/machines/functional-479263/id_rsa Username:docker}
I0729 20:26:36.477366  176085 ssh_runner.go:195] Run: sudo crictl images --output json
--- PASS: TestFunctional/parallel/ImageCommands/ImageListJson (0.27s)

                                                
                                    
x
+
TestFunctional/parallel/ImageCommands/ImageListYaml (0.28s)

                                                
                                                
=== RUN   TestFunctional/parallel/ImageCommands/ImageListYaml
=== PAUSE TestFunctional/parallel/ImageCommands/ImageListYaml

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/ImageCommands/ImageListYaml
functional_test.go:260: (dbg) Run:  out/minikube-linux-arm64 -p functional-479263 image ls --format yaml --alsologtostderr
functional_test.go:265: (dbg) Stdout: out/minikube-linux-arm64 -p functional-479263 image ls --format yaml --alsologtostderr:
- id: sha256:8e97cdb19e7cc420af7c71de8b5c9ab536bd278758c8c0878c464b833d91b31a
repoDigests:
- registry.k8s.io/kube-controller-manager@sha256:eff43da55a29a5e66ec9480f28233d733a6a8433b7a46f6e8c07086fa4ef69b7
repoTags:
- registry.k8s.io/kube-controller-manager:v1.30.3
size: "28374500"
- id: sha256:d48f992a22722fc0290769b8fab1186db239bbad4cff837fbb641c55faef9355
repoDigests:
- registry.k8s.io/kube-scheduler@sha256:2147ab5d2c73dd84e28332fcbee6826d1648eed30a531a52a96501b37d7ee4e4
repoTags:
- registry.k8s.io/kube-scheduler:v1.30.3
size: "17641143"
- id: sha256:8cb2091f603e75187e2f6226c5901d12e00b1d1f778c6471ae4578e8a1c4724a
repoDigests: []
repoTags:
- registry.k8s.io/pause:latest
size: "71300"
- id: sha256:ba04bb24b95753201135cbc420b233c1b0b9fa2e1fd21d28319c348c33fbcde6
repoDigests:
- gcr.io/k8s-minikube/storage-provisioner@sha256:18eb69d1418e854ad5a19e399310e52808a8321e4c441c1dddad8977a0d7a944
repoTags:
- gcr.io/k8s-minikube/storage-provisioner:v5
size: "8034419"
- id: sha256:72565bf5bbedfb62e9d21afa2b1221b2c7a5e05b746dae33430bc550d3f87beb
repoDigests:
- registry.k8s.io/echoserver-arm@sha256:b33d4cdf6ed097f4e9b77b135d83a596ab73c6268b0342648818eb85f5edfdb5
repoTags:
- registry.k8s.io/echoserver-arm:1.8
size: "45324675"
- id: sha256:014faa467e29798aeef733fe6d1a3b5e382688217b053ad23410e6cccd5d22fd
repoDigests:
- registry.k8s.io/etcd@sha256:44a8e24dcbba3470ee1fee21d5e88d128c936e9b55d4bc51fbef8086f8ed123b
repoTags:
- registry.k8s.io/etcd:3.5.12-0
size: "66189079"
- id: sha256:2351f570ed0eac5533e538280d73c6aa5d6b6f6379f5f3fac08f51378621e6be
repoDigests:
- registry.k8s.io/kube-proxy@sha256:b26e535e8ee1cbd7dc5642fb61bd36e9d23f32e9242ae0010b2905656e664f65
repoTags:
- registry.k8s.io/kube-proxy:v1.30.3
size: "25645955"
- id: sha256:a422e0e982356f6c1cf0e5bb7b733363caae3992a07c99951fbcc73e58ed656a
repoDigests:
- docker.io/kubernetesui/metrics-scraper@sha256:76049887f07a0476dc93efc2d3569b9529bf982b22d29f356092ce206e98765c
repoTags: []
size: "18306114"
- id: sha256:ce2d2cda2d858fdaea84129deb86d18e5dbf1c548f230b79fdca74cc91729d17
repoDigests: []
repoTags:
- docker.io/kicbase/echo-server:functional-479263
size: "2173567"
- id: sha256:5e32961ddcea3ade65511b2e27f675bbda25305639279f8b708014019e8cebb2
repoDigests:
- docker.io/kindest/kindnetd@sha256:88ed2adbc140254762f98fad7f4b16d279117356ebaf95aebf191713c828a493
repoTags:
- docker.io/kindest/kindnetd:v20240715-585640e9
size: "33290438"
- id: sha256:f42786f8afd2214fc59fbf9a26531806f562488d4a7d7a31e8b5e9ff6289b800
repoDigests:
- docker.io/kindest/kindnetd@sha256:da8ad203ec15a72c313015e5609db44bfad7c95d8ce63e87ff97c66363b5680a
repoTags:
- docker.io/kindest/kindnetd:v20240719-e7903573
size: "33296266"
- id: sha256:8057e0500773a37cde2cff041eb13ebd68c748419a2fbfd1dfb5bf38696cc8e5
repoDigests: []
repoTags:
- registry.k8s.io/pause:3.1
size: "262191"
- id: sha256:43b17fe33c4b4cf8de762123d33e02f2ed0c5e1178002f533d4fb5df1e05fb76
repoDigests:
- docker.io/library/nginx@sha256:6af79ae5de407283dcea8b00d5c37ace95441fd58a8b1d2aa1ed93f5511bb18c
repoTags:
- docker.io/library/nginx:latest
size: "67647629"
- id: sha256:1611cd07b61d57dbbfebe6db242513fd51e1c02d20ba08af17a45837d86a8a8c
repoDigests:
- gcr.io/k8s-minikube/busybox@sha256:2d03e6ceeb99250061dd110530b0ece7998cd84121f952adef120ea7c5a6f00e
repoTags:
- gcr.io/k8s-minikube/busybox:1.28.4-glibc
size: "1935750"
- id: sha256:2437cf762177702dec2dfe99a09c37427a15af6d9a57c456b65352667c223d93
repoDigests:
- registry.k8s.io/coredns/coredns@sha256:1eeb4c7316bacb1d4c8ead65571cd92dd21e27359f0d4917f1a5822a73b75db1
repoTags:
- registry.k8s.io/coredns/coredns:v1.11.1
size: "16482581"
- id: sha256:3d18732f8686cc3c878055d99a05fa80289502fa496b36b6a0fe0f77206a7300
repoDigests: []
repoTags:
- registry.k8s.io/pause:3.3
size: "249461"
- id: sha256:829e9de338bd5fdd3f16f68f83a9fb288fbc8453e881e5d5cfd0f6f2ff72b43e
repoDigests:
- registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097
repoTags:
- registry.k8s.io/pause:3.9
size: "268051"
- id: sha256:20b332c9a70d8516d849d1ac23eff5800cbb2f263d379f0ec11ee908db6b25a8
repoDigests:
- docker.io/kubernetesui/dashboard@sha256:2e500d29e9d5f4a086b908eb8dfe7ecac57d2ab09d65b24f588b1d449841ef93
repoTags: []
size: "74084559"
- id: sha256:9c14b541f1e4d3bd89bc0b5b84e0c44b153383fb884c861b4a82129b7e2d71df
repoDigests: []
repoTags:
- docker.io/library/minikube-local-cache-test:functional-479263
size: "992"
- id: sha256:d7cd33d7d4ed1cdef69594adc36fcc03a0aa45ba930d39a9286024d9b2322660
repoDigests:
- docker.io/library/nginx@sha256:208b70eefac13ee9be00e486f79c695b15cef861c680527171a27d253d834be9
repoTags:
- docker.io/library/nginx:alpine
size: "18253575"
- id: sha256:61773190d42ff0792f3bab2658e80b1c07519170955bb350b153b564ef28f4ca
repoDigests:
- registry.k8s.io/kube-apiserver@sha256:a36d558835e48950f6d13b1edbe20605b8dfbc81e088f58221796631e107966c
repoTags:
- registry.k8s.io/kube-apiserver:v1.30.3
size: "29942692"

                                                
                                                
functional_test.go:268: (dbg) Stderr: out/minikube-linux-arm64 -p functional-479263 image ls --format yaml --alsologtostderr:
I0729 20:26:36.052552  175997 out.go:291] Setting OutFile to fd 1 ...
I0729 20:26:36.053169  175997 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0729 20:26:36.053214  175997 out.go:304] Setting ErrFile to fd 2...
I0729 20:26:36.053233  175997 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0729 20:26:36.053525  175997 root.go:338] Updating PATH: /home/jenkins/minikube-integration/19339-134334/.minikube/bin
I0729 20:26:36.054270  175997 config.go:182] Loaded profile config "functional-479263": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.30.3
I0729 20:26:36.054455  175997 config.go:182] Loaded profile config "functional-479263": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.30.3
I0729 20:26:36.055302  175997 cli_runner.go:164] Run: docker container inspect functional-479263 --format={{.State.Status}}
I0729 20:26:36.082189  175997 ssh_runner.go:195] Run: systemctl --version
I0729 20:26:36.082387  175997 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" functional-479263
I0729 20:26:36.106484  175997 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:37050 SSHKeyPath:/home/jenkins/minikube-integration/19339-134334/.minikube/machines/functional-479263/id_rsa Username:docker}
I0729 20:26:36.201734  175997 ssh_runner.go:195] Run: sudo crictl images --output json
--- PASS: TestFunctional/parallel/ImageCommands/ImageListYaml (0.28s)

                                                
                                    
x
+
TestFunctional/parallel/ImageCommands/ImageBuild (3.01s)

                                                
                                                
=== RUN   TestFunctional/parallel/ImageCommands/ImageBuild
=== PAUSE TestFunctional/parallel/ImageCommands/ImageBuild

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/ImageCommands/ImageBuild
functional_test.go:307: (dbg) Run:  out/minikube-linux-arm64 -p functional-479263 ssh pgrep buildkitd
functional_test.go:307: (dbg) Non-zero exit: out/minikube-linux-arm64 -p functional-479263 ssh pgrep buildkitd: exit status 1 (337.23299ms)

                                                
                                                
** stderr ** 
	ssh: Process exited with status 1

                                                
                                                
** /stderr **
functional_test.go:314: (dbg) Run:  out/minikube-linux-arm64 -p functional-479263 image build -t localhost/my-image:functional-479263 testdata/build --alsologtostderr
functional_test.go:314: (dbg) Done: out/minikube-linux-arm64 -p functional-479263 image build -t localhost/my-image:functional-479263 testdata/build --alsologtostderr: (2.432637957s)
functional_test.go:322: (dbg) Stderr: out/minikube-linux-arm64 -p functional-479263 image build -t localhost/my-image:functional-479263 testdata/build --alsologtostderr:
I0729 20:26:36.442267  176108 out.go:291] Setting OutFile to fd 1 ...
I0729 20:26:36.443572  176108 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0729 20:26:36.443615  176108 out.go:304] Setting ErrFile to fd 2...
I0729 20:26:36.443639  176108 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0729 20:26:36.443939  176108 root.go:338] Updating PATH: /home/jenkins/minikube-integration/19339-134334/.minikube/bin
I0729 20:26:36.444695  176108 config.go:182] Loaded profile config "functional-479263": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.30.3
I0729 20:26:36.446131  176108 config.go:182] Loaded profile config "functional-479263": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.30.3
I0729 20:26:36.446858  176108 cli_runner.go:164] Run: docker container inspect functional-479263 --format={{.State.Status}}
I0729 20:26:36.464944  176108 ssh_runner.go:195] Run: systemctl --version
I0729 20:26:36.465019  176108 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" functional-479263
I0729 20:26:36.493014  176108 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:37050 SSHKeyPath:/home/jenkins/minikube-integration/19339-134334/.minikube/machines/functional-479263/id_rsa Username:docker}
I0729 20:26:36.597023  176108 build_images.go:161] Building image from path: /tmp/build.3789938841.tar
I0729 20:26:36.597089  176108 ssh_runner.go:195] Run: sudo mkdir -p /var/lib/minikube/build
I0729 20:26:36.610410  176108 ssh_runner.go:195] Run: stat -c "%s %y" /var/lib/minikube/build/build.3789938841.tar
I0729 20:26:36.615018  176108 ssh_runner.go:352] existence check for /var/lib/minikube/build/build.3789938841.tar: stat -c "%s %y" /var/lib/minikube/build/build.3789938841.tar: Process exited with status 1
stdout:

                                                
                                                
stderr:
stat: cannot statx '/var/lib/minikube/build/build.3789938841.tar': No such file or directory
I0729 20:26:36.615046  176108 ssh_runner.go:362] scp /tmp/build.3789938841.tar --> /var/lib/minikube/build/build.3789938841.tar (3072 bytes)
I0729 20:26:36.645704  176108 ssh_runner.go:195] Run: sudo mkdir -p /var/lib/minikube/build/build.3789938841
I0729 20:26:36.657037  176108 ssh_runner.go:195] Run: sudo tar -C /var/lib/minikube/build/build.3789938841 -xf /var/lib/minikube/build/build.3789938841.tar
I0729 20:26:36.671392  176108 containerd.go:394] Building image: /var/lib/minikube/build/build.3789938841
I0729 20:26:36.671479  176108 ssh_runner.go:195] Run: sudo buildctl build --frontend dockerfile.v0 --local context=/var/lib/minikube/build/build.3789938841 --local dockerfile=/var/lib/minikube/build/build.3789938841 --output type=image,name=localhost/my-image:functional-479263
#1 [internal] load build definition from Dockerfile
#1 transferring dockerfile: 97B done
#1 DONE 0.0s

                                                
                                                
#2 [internal] load metadata for gcr.io/k8s-minikube/busybox:latest
#2 DONE 0.7s

                                                
                                                
#3 [internal] load .dockerignore
#3 transferring context: 2B done
#3 DONE 0.0s

                                                
                                                
#4 [internal] load build context
#4 transferring context: 62B done
#4 DONE 0.0s

                                                
                                                
#5 [1/3] FROM gcr.io/k8s-minikube/busybox:latest@sha256:ca5ae90100d50772da31f3b5016209e25ad61972404e2ccd83d44f10dee7e79b
#5 resolve gcr.io/k8s-minikube/busybox:latest@sha256:ca5ae90100d50772da31f3b5016209e25ad61972404e2ccd83d44f10dee7e79b 0.0s done
#5 sha256:a01966dde7f8d5ba10b6d87e776c7c8fb5a5f6bfa678874bd28b33b1fc6dba34 828.50kB / 828.50kB 0.1s done
#5 extracting sha256:a01966dde7f8d5ba10b6d87e776c7c8fb5a5f6bfa678874bd28b33b1fc6dba34 0.1s done
#5 DONE 0.3s

                                                
                                                
#6 [2/3] RUN true
#6 DONE 0.7s

                                                
                                                
#7 [3/3] ADD content.txt /
#7 DONE 0.0s

                                                
                                                
#8 exporting to image
#8 exporting layers 0.1s done
#8 exporting manifest sha256:bce121bda045e4e5727a2220a668f31c3e9900fb47a7694934bbd714f89b3b46 0.0s done
#8 exporting config sha256:5004dd846210664b8dc4d4092ac8945a11f4b58eec6cb899e88411f6263c7997 0.0s done
#8 naming to localhost/my-image:functional-479263 done
#8 DONE 0.1s
I0729 20:26:38.773841  176108 ssh_runner.go:235] Completed: sudo buildctl build --frontend dockerfile.v0 --local context=/var/lib/minikube/build/build.3789938841 --local dockerfile=/var/lib/minikube/build/build.3789938841 --output type=image,name=localhost/my-image:functional-479263: (2.102328776s)
I0729 20:26:38.773905  176108 ssh_runner.go:195] Run: sudo rm -rf /var/lib/minikube/build/build.3789938841
I0729 20:26:38.784137  176108 ssh_runner.go:195] Run: sudo rm -f /var/lib/minikube/build/build.3789938841.tar
I0729 20:26:38.793423  176108 build_images.go:217] Built localhost/my-image:functional-479263 from /tmp/build.3789938841.tar
I0729 20:26:38.793452  176108 build_images.go:133] succeeded building to: functional-479263
I0729 20:26:38.793458  176108 build_images.go:134] failed building to: 
functional_test.go:447: (dbg) Run:  out/minikube-linux-arm64 -p functional-479263 image ls
--- PASS: TestFunctional/parallel/ImageCommands/ImageBuild (3.01s)

                                                
                                    
x
+
TestFunctional/parallel/ImageCommands/Setup (0.76s)

                                                
                                                
=== RUN   TestFunctional/parallel/ImageCommands/Setup
functional_test.go:341: (dbg) Run:  docker pull docker.io/kicbase/echo-server:1.0
functional_test.go:346: (dbg) Run:  docker tag docker.io/kicbase/echo-server:1.0 docker.io/kicbase/echo-server:functional-479263
--- PASS: TestFunctional/parallel/ImageCommands/Setup (0.76s)

                                                
                                    
x
+
TestFunctional/parallel/UpdateContextCmd/no_changes (0.16s)

                                                
                                                
=== RUN   TestFunctional/parallel/UpdateContextCmd/no_changes
=== PAUSE TestFunctional/parallel/UpdateContextCmd/no_changes

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/UpdateContextCmd/no_changes
functional_test.go:2115: (dbg) Run:  out/minikube-linux-arm64 -p functional-479263 update-context --alsologtostderr -v=2
--- PASS: TestFunctional/parallel/UpdateContextCmd/no_changes (0.16s)

                                                
                                    
x
+
TestFunctional/parallel/UpdateContextCmd/no_minikube_cluster (0.15s)

                                                
                                                
=== RUN   TestFunctional/parallel/UpdateContextCmd/no_minikube_cluster
=== PAUSE TestFunctional/parallel/UpdateContextCmd/no_minikube_cluster

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/UpdateContextCmd/no_minikube_cluster
functional_test.go:2115: (dbg) Run:  out/minikube-linux-arm64 -p functional-479263 update-context --alsologtostderr -v=2
--- PASS: TestFunctional/parallel/UpdateContextCmd/no_minikube_cluster (0.15s)

                                                
                                    
x
+
TestFunctional/parallel/UpdateContextCmd/no_clusters (0.15s)

                                                
                                                
=== RUN   TestFunctional/parallel/UpdateContextCmd/no_clusters
=== PAUSE TestFunctional/parallel/UpdateContextCmd/no_clusters

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/UpdateContextCmd/no_clusters
functional_test.go:2115: (dbg) Run:  out/minikube-linux-arm64 -p functional-479263 update-context --alsologtostderr -v=2
--- PASS: TestFunctional/parallel/UpdateContextCmd/no_clusters (0.15s)

                                                
                                    
x
+
TestFunctional/parallel/ImageCommands/ImageLoadDaemon (1.63s)

                                                
                                                
=== RUN   TestFunctional/parallel/ImageCommands/ImageLoadDaemon
functional_test.go:354: (dbg) Run:  out/minikube-linux-arm64 -p functional-479263 image load --daemon docker.io/kicbase/echo-server:functional-479263 --alsologtostderr
functional_test.go:354: (dbg) Done: out/minikube-linux-arm64 -p functional-479263 image load --daemon docker.io/kicbase/echo-server:functional-479263 --alsologtostderr: (1.338439771s)
functional_test.go:447: (dbg) Run:  out/minikube-linux-arm64 -p functional-479263 image ls
--- PASS: TestFunctional/parallel/ImageCommands/ImageLoadDaemon (1.63s)

                                                
                                    
x
+
TestFunctional/parallel/ImageCommands/ImageReloadDaemon (1.37s)

                                                
                                                
=== RUN   TestFunctional/parallel/ImageCommands/ImageReloadDaemon
functional_test.go:364: (dbg) Run:  out/minikube-linux-arm64 -p functional-479263 image load --daemon docker.io/kicbase/echo-server:functional-479263 --alsologtostderr
functional_test.go:364: (dbg) Done: out/minikube-linux-arm64 -p functional-479263 image load --daemon docker.io/kicbase/echo-server:functional-479263 --alsologtostderr: (1.063101182s)
functional_test.go:447: (dbg) Run:  out/minikube-linux-arm64 -p functional-479263 image ls
--- PASS: TestFunctional/parallel/ImageCommands/ImageReloadDaemon (1.37s)

                                                
                                    
x
+
TestFunctional/parallel/ImageCommands/ImageTagAndLoadDaemon (1.73s)

                                                
                                                
=== RUN   TestFunctional/parallel/ImageCommands/ImageTagAndLoadDaemon
functional_test.go:234: (dbg) Run:  docker pull docker.io/kicbase/echo-server:latest
functional_test.go:239: (dbg) Run:  docker tag docker.io/kicbase/echo-server:latest docker.io/kicbase/echo-server:functional-479263
functional_test.go:244: (dbg) Run:  out/minikube-linux-arm64 -p functional-479263 image load --daemon docker.io/kicbase/echo-server:functional-479263 --alsologtostderr
functional_test.go:244: (dbg) Done: out/minikube-linux-arm64 -p functional-479263 image load --daemon docker.io/kicbase/echo-server:functional-479263 --alsologtostderr: (1.175815537s)
functional_test.go:447: (dbg) Run:  out/minikube-linux-arm64 -p functional-479263 image ls
--- PASS: TestFunctional/parallel/ImageCommands/ImageTagAndLoadDaemon (1.73s)

                                                
                                    
x
+
TestFunctional/parallel/TunnelCmd/serial/RunSecondTunnel (0.58s)

                                                
                                                
=== RUN   TestFunctional/parallel/TunnelCmd/serial/RunSecondTunnel
functional_test_tunnel_test.go:154: (dbg) daemon: [out/minikube-linux-arm64 -p functional-479263 tunnel --alsologtostderr]
functional_test_tunnel_test.go:154: (dbg) daemon: [out/minikube-linux-arm64 -p functional-479263 tunnel --alsologtostderr]
functional_test_tunnel_test.go:194: (dbg) stopping [out/minikube-linux-arm64 -p functional-479263 tunnel --alsologtostderr] ...
helpers_test.go:508: unable to kill pid 171573: os: process already finished
helpers_test.go:502: unable to terminate pid 171449: os: process already finished
functional_test_tunnel_test.go:194: (dbg) stopping [out/minikube-linux-arm64 -p functional-479263 tunnel --alsologtostderr] ...
helpers_test.go:490: unable to find parent, assuming dead: process does not exist
--- PASS: TestFunctional/parallel/TunnelCmd/serial/RunSecondTunnel (0.58s)

                                                
                                    
x
+
TestFunctional/parallel/TunnelCmd/serial/StartTunnel (0s)

                                                
                                                
=== RUN   TestFunctional/parallel/TunnelCmd/serial/StartTunnel
functional_test_tunnel_test.go:129: (dbg) daemon: [out/minikube-linux-arm64 -p functional-479263 tunnel --alsologtostderr]
--- PASS: TestFunctional/parallel/TunnelCmd/serial/StartTunnel (0.00s)

                                                
                                    
x
+
TestFunctional/parallel/TunnelCmd/serial/WaitService/Setup (8.39s)

                                                
                                                
=== RUN   TestFunctional/parallel/TunnelCmd/serial/WaitService/Setup
functional_test_tunnel_test.go:212: (dbg) Run:  kubectl --context functional-479263 apply -f testdata/testsvc.yaml
functional_test_tunnel_test.go:216: (dbg) TestFunctional/parallel/TunnelCmd/serial/WaitService/Setup: waiting 4m0s for pods matching "run=nginx-svc" in namespace "default" ...
helpers_test.go:344: "nginx-svc" [d4af619b-1f4b-4232-b0d5-16234f797dec] Pending / Ready:ContainersNotReady (containers with unready status: [nginx]) / ContainersReady:ContainersNotReady (containers with unready status: [nginx])
helpers_test.go:344: "nginx-svc" [d4af619b-1f4b-4232-b0d5-16234f797dec] Running
functional_test_tunnel_test.go:216: (dbg) TestFunctional/parallel/TunnelCmd/serial/WaitService/Setup: run=nginx-svc healthy within 8.003992825s
--- PASS: TestFunctional/parallel/TunnelCmd/serial/WaitService/Setup (8.39s)

                                                
                                    
x
+
TestFunctional/parallel/ImageCommands/ImageSaveToFile (0.7s)

                                                
                                                
=== RUN   TestFunctional/parallel/ImageCommands/ImageSaveToFile
functional_test.go:379: (dbg) Run:  out/minikube-linux-arm64 -p functional-479263 image save docker.io/kicbase/echo-server:functional-479263 /home/jenkins/workspace/Docker_Linux_containerd_arm64/echo-server-save.tar --alsologtostderr
--- PASS: TestFunctional/parallel/ImageCommands/ImageSaveToFile (0.70s)

                                                
                                    
x
+
TestFunctional/parallel/ImageCommands/ImageRemove (0.57s)

                                                
                                                
=== RUN   TestFunctional/parallel/ImageCommands/ImageRemove
functional_test.go:391: (dbg) Run:  out/minikube-linux-arm64 -p functional-479263 image rm docker.io/kicbase/echo-server:functional-479263 --alsologtostderr
functional_test.go:447: (dbg) Run:  out/minikube-linux-arm64 -p functional-479263 image ls
--- PASS: TestFunctional/parallel/ImageCommands/ImageRemove (0.57s)

                                                
                                    
x
+
TestFunctional/parallel/ImageCommands/ImageLoadFromFile (0.83s)

                                                
                                                
=== RUN   TestFunctional/parallel/ImageCommands/ImageLoadFromFile
functional_test.go:408: (dbg) Run:  out/minikube-linux-arm64 -p functional-479263 image load /home/jenkins/workspace/Docker_Linux_containerd_arm64/echo-server-save.tar --alsologtostderr
functional_test.go:447: (dbg) Run:  out/minikube-linux-arm64 -p functional-479263 image ls
--- PASS: TestFunctional/parallel/ImageCommands/ImageLoadFromFile (0.83s)

                                                
                                    
x
+
TestFunctional/parallel/ImageCommands/ImageSaveDaemon (0.67s)

                                                
                                                
=== RUN   TestFunctional/parallel/ImageCommands/ImageSaveDaemon
functional_test.go:418: (dbg) Run:  docker rmi docker.io/kicbase/echo-server:functional-479263
functional_test.go:423: (dbg) Run:  out/minikube-linux-arm64 -p functional-479263 image save --daemon docker.io/kicbase/echo-server:functional-479263 --alsologtostderr
functional_test.go:428: (dbg) Run:  docker image inspect docker.io/kicbase/echo-server:functional-479263
--- PASS: TestFunctional/parallel/ImageCommands/ImageSaveDaemon (0.67s)

                                                
                                    
x
+
TestFunctional/parallel/TunnelCmd/serial/WaitService/IngressIP (0.08s)

                                                
                                                
=== RUN   TestFunctional/parallel/TunnelCmd/serial/WaitService/IngressIP
functional_test_tunnel_test.go:234: (dbg) Run:  kubectl --context functional-479263 get svc nginx-svc -o jsonpath={.status.loadBalancer.ingress[0].ip}
--- PASS: TestFunctional/parallel/TunnelCmd/serial/WaitService/IngressIP (0.08s)

                                                
                                    
x
+
TestFunctional/parallel/TunnelCmd/serial/AccessDirect (0s)

                                                
                                                
=== RUN   TestFunctional/parallel/TunnelCmd/serial/AccessDirect
functional_test_tunnel_test.go:299: tunnel at http://10.101.42.164 is working!
--- PASS: TestFunctional/parallel/TunnelCmd/serial/AccessDirect (0.00s)

                                                
                                    
x
+
TestFunctional/parallel/TunnelCmd/serial/DeleteTunnel (0.11s)

                                                
                                                
=== RUN   TestFunctional/parallel/TunnelCmd/serial/DeleteTunnel
functional_test_tunnel_test.go:434: (dbg) stopping [out/minikube-linux-arm64 -p functional-479263 tunnel --alsologtostderr] ...
--- PASS: TestFunctional/parallel/TunnelCmd/serial/DeleteTunnel (0.11s)

                                                
                                    
x
+
TestFunctional/parallel/ServiceCmd/DeployApp (6.22s)

                                                
                                                
=== RUN   TestFunctional/parallel/ServiceCmd/DeployApp
functional_test.go:1433: (dbg) Run:  kubectl --context functional-479263 create deployment hello-node --image=registry.k8s.io/echoserver-arm:1.8
functional_test.go:1441: (dbg) Run:  kubectl --context functional-479263 expose deployment hello-node --type=NodePort --port=8080
functional_test.go:1446: (dbg) TestFunctional/parallel/ServiceCmd/DeployApp: waiting 10m0s for pods matching "app=hello-node" in namespace "default" ...
helpers_test.go:344: "hello-node-65f5d5cc78-fvcfw" [775de8fd-4f4c-40e8-8366-9f5c26c02fea] Pending / Ready:ContainersNotReady (containers with unready status: [echoserver-arm]) / ContainersReady:ContainersNotReady (containers with unready status: [echoserver-arm])
helpers_test.go:344: "hello-node-65f5d5cc78-fvcfw" [775de8fd-4f4c-40e8-8366-9f5c26c02fea] Running
functional_test.go:1446: (dbg) TestFunctional/parallel/ServiceCmd/DeployApp: app=hello-node healthy within 6.003978555s
--- PASS: TestFunctional/parallel/ServiceCmd/DeployApp (6.22s)

                                                
                                    
x
+
TestFunctional/parallel/ServiceCmd/List (0.5s)

                                                
                                                
=== RUN   TestFunctional/parallel/ServiceCmd/List
functional_test.go:1455: (dbg) Run:  out/minikube-linux-arm64 -p functional-479263 service list
--- PASS: TestFunctional/parallel/ServiceCmd/List (0.50s)

                                                
                                    
x
+
TestFunctional/parallel/ServiceCmd/JSONOutput (0.51s)

                                                
                                                
=== RUN   TestFunctional/parallel/ServiceCmd/JSONOutput
functional_test.go:1485: (dbg) Run:  out/minikube-linux-arm64 -p functional-479263 service list -o json
functional_test.go:1490: Took "511.687134ms" to run "out/minikube-linux-arm64 -p functional-479263 service list -o json"
--- PASS: TestFunctional/parallel/ServiceCmd/JSONOutput (0.51s)

                                                
                                    
x
+
TestFunctional/parallel/ServiceCmd/HTTPS (0.38s)

                                                
                                                
=== RUN   TestFunctional/parallel/ServiceCmd/HTTPS
functional_test.go:1505: (dbg) Run:  out/minikube-linux-arm64 -p functional-479263 service --namespace=default --https --url hello-node
functional_test.go:1518: found endpoint: https://192.168.49.2:31469
--- PASS: TestFunctional/parallel/ServiceCmd/HTTPS (0.38s)

                                                
                                    
x
+
TestFunctional/parallel/ServiceCmd/Format (0.38s)

                                                
                                                
=== RUN   TestFunctional/parallel/ServiceCmd/Format
functional_test.go:1536: (dbg) Run:  out/minikube-linux-arm64 -p functional-479263 service hello-node --url --format={{.IP}}
--- PASS: TestFunctional/parallel/ServiceCmd/Format (0.38s)

                                                
                                    
x
+
TestFunctional/parallel/ServiceCmd/URL (0.39s)

                                                
                                                
=== RUN   TestFunctional/parallel/ServiceCmd/URL
functional_test.go:1555: (dbg) Run:  out/minikube-linux-arm64 -p functional-479263 service hello-node --url
functional_test.go:1561: found endpoint for hello-node: http://192.168.49.2:31469
--- PASS: TestFunctional/parallel/ServiceCmd/URL (0.39s)

                                                
                                    
x
+
TestFunctional/parallel/ProfileCmd/profile_not_create (0.4s)

                                                
                                                
=== RUN   TestFunctional/parallel/ProfileCmd/profile_not_create
functional_test.go:1266: (dbg) Run:  out/minikube-linux-arm64 profile lis
functional_test.go:1271: (dbg) Run:  out/minikube-linux-arm64 profile list --output json
--- PASS: TestFunctional/parallel/ProfileCmd/profile_not_create (0.40s)

                                                
                                    
x
+
TestFunctional/parallel/ProfileCmd/profile_list (0.41s)

                                                
                                                
=== RUN   TestFunctional/parallel/ProfileCmd/profile_list
functional_test.go:1306: (dbg) Run:  out/minikube-linux-arm64 profile list
functional_test.go:1311: Took "337.575465ms" to run "out/minikube-linux-arm64 profile list"
functional_test.go:1320: (dbg) Run:  out/minikube-linux-arm64 profile list -l
functional_test.go:1325: Took "73.114146ms" to run "out/minikube-linux-arm64 profile list -l"
--- PASS: TestFunctional/parallel/ProfileCmd/profile_list (0.41s)

                                                
                                    
x
+
TestFunctional/parallel/ProfileCmd/profile_json_output (0.62s)

                                                
                                                
=== RUN   TestFunctional/parallel/ProfileCmd/profile_json_output
functional_test.go:1357: (dbg) Run:  out/minikube-linux-arm64 profile list -o json
functional_test.go:1362: Took "551.292529ms" to run "out/minikube-linux-arm64 profile list -o json"
functional_test.go:1370: (dbg) Run:  out/minikube-linux-arm64 profile list -o json --light
functional_test.go:1375: Took "66.034839ms" to run "out/minikube-linux-arm64 profile list -o json --light"
--- PASS: TestFunctional/parallel/ProfileCmd/profile_json_output (0.62s)

                                                
                                    
x
+
TestFunctional/parallel/MountCmd/any-port (7.51s)

                                                
                                                
=== RUN   TestFunctional/parallel/MountCmd/any-port
functional_test_mount_test.go:73: (dbg) daemon: [out/minikube-linux-arm64 mount -p functional-479263 /tmp/TestFunctionalparallelMountCmdany-port2770725767/001:/mount-9p --alsologtostderr -v=1]
functional_test_mount_test.go:107: wrote "test-1722284782178092803" to /tmp/TestFunctionalparallelMountCmdany-port2770725767/001/created-by-test
functional_test_mount_test.go:107: wrote "test-1722284782178092803" to /tmp/TestFunctionalparallelMountCmdany-port2770725767/001/created-by-test-removed-by-pod
functional_test_mount_test.go:107: wrote "test-1722284782178092803" to /tmp/TestFunctionalparallelMountCmdany-port2770725767/001/test-1722284782178092803
functional_test_mount_test.go:115: (dbg) Run:  out/minikube-linux-arm64 -p functional-479263 ssh "findmnt -T /mount-9p | grep 9p"
functional_test_mount_test.go:115: (dbg) Non-zero exit: out/minikube-linux-arm64 -p functional-479263 ssh "findmnt -T /mount-9p | grep 9p": exit status 1 (439.374964ms)

                                                
                                                
** stderr ** 
	ssh: Process exited with status 1

                                                
                                                
** /stderr **
functional_test_mount_test.go:115: (dbg) Run:  out/minikube-linux-arm64 -p functional-479263 ssh "findmnt -T /mount-9p | grep 9p"
functional_test_mount_test.go:129: (dbg) Run:  out/minikube-linux-arm64 -p functional-479263 ssh -- ls -la /mount-9p
functional_test_mount_test.go:133: guest mount directory contents
total 2
-rw-r--r-- 1 docker docker 24 Jul 29 20:26 created-by-test
-rw-r--r-- 1 docker docker 24 Jul 29 20:26 created-by-test-removed-by-pod
-rw-r--r-- 1 docker docker 24 Jul 29 20:26 test-1722284782178092803
functional_test_mount_test.go:137: (dbg) Run:  out/minikube-linux-arm64 -p functional-479263 ssh cat /mount-9p/test-1722284782178092803
functional_test_mount_test.go:148: (dbg) Run:  kubectl --context functional-479263 replace --force -f testdata/busybox-mount-test.yaml
functional_test_mount_test.go:153: (dbg) TestFunctional/parallel/MountCmd/any-port: waiting 4m0s for pods matching "integration-test=busybox-mount" in namespace "default" ...
helpers_test.go:344: "busybox-mount" [5a03af6a-2a46-4a30-a7c2-e9d419633e25] Pending
helpers_test.go:344: "busybox-mount" [5a03af6a-2a46-4a30-a7c2-e9d419633e25] Pending / Ready:ContainersNotReady (containers with unready status: [mount-munger]) / ContainersReady:ContainersNotReady (containers with unready status: [mount-munger])
helpers_test.go:344: "busybox-mount" [5a03af6a-2a46-4a30-a7c2-e9d419633e25] Pending / Initialized:PodCompleted / Ready:PodCompleted / ContainersReady:PodCompleted
helpers_test.go:344: "busybox-mount" [5a03af6a-2a46-4a30-a7c2-e9d419633e25] Succeeded / Initialized:PodCompleted / Ready:PodCompleted / ContainersReady:PodCompleted
functional_test_mount_test.go:153: (dbg) TestFunctional/parallel/MountCmd/any-port: integration-test=busybox-mount healthy within 4.005090646s
functional_test_mount_test.go:169: (dbg) Run:  kubectl --context functional-479263 logs busybox-mount
functional_test_mount_test.go:181: (dbg) Run:  out/minikube-linux-arm64 -p functional-479263 ssh stat /mount-9p/created-by-test
functional_test_mount_test.go:181: (dbg) Run:  out/minikube-linux-arm64 -p functional-479263 ssh stat /mount-9p/created-by-pod
functional_test_mount_test.go:90: (dbg) Run:  out/minikube-linux-arm64 -p functional-479263 ssh "sudo umount -f /mount-9p"
functional_test_mount_test.go:94: (dbg) stopping [out/minikube-linux-arm64 mount -p functional-479263 /tmp/TestFunctionalparallelMountCmdany-port2770725767/001:/mount-9p --alsologtostderr -v=1] ...
--- PASS: TestFunctional/parallel/MountCmd/any-port (7.51s)

                                                
                                    
x
+
TestFunctional/parallel/MountCmd/specific-port (2.37s)

                                                
                                                
=== RUN   TestFunctional/parallel/MountCmd/specific-port
functional_test_mount_test.go:213: (dbg) daemon: [out/minikube-linux-arm64 mount -p functional-479263 /tmp/TestFunctionalparallelMountCmdspecific-port1082477147/001:/mount-9p --alsologtostderr -v=1 --port 46464]
functional_test_mount_test.go:243: (dbg) Run:  out/minikube-linux-arm64 -p functional-479263 ssh "findmnt -T /mount-9p | grep 9p"
functional_test_mount_test.go:243: (dbg) Non-zero exit: out/minikube-linux-arm64 -p functional-479263 ssh "findmnt -T /mount-9p | grep 9p": exit status 1 (549.120418ms)

                                                
                                                
** stderr ** 
	ssh: Process exited with status 1

                                                
                                                
** /stderr **
functional_test_mount_test.go:243: (dbg) Run:  out/minikube-linux-arm64 -p functional-479263 ssh "findmnt -T /mount-9p | grep 9p"
functional_test_mount_test.go:257: (dbg) Run:  out/minikube-linux-arm64 -p functional-479263 ssh -- ls -la /mount-9p
functional_test_mount_test.go:261: guest mount directory contents
total 0
functional_test_mount_test.go:263: (dbg) stopping [out/minikube-linux-arm64 mount -p functional-479263 /tmp/TestFunctionalparallelMountCmdspecific-port1082477147/001:/mount-9p --alsologtostderr -v=1 --port 46464] ...
functional_test_mount_test.go:264: reading mount text
functional_test_mount_test.go:278: done reading mount text
functional_test_mount_test.go:230: (dbg) Run:  out/minikube-linux-arm64 -p functional-479263 ssh "sudo umount -f /mount-9p"
functional_test_mount_test.go:230: (dbg) Non-zero exit: out/minikube-linux-arm64 -p functional-479263 ssh "sudo umount -f /mount-9p": exit status 1 (354.043951ms)

                                                
                                                
-- stdout --
	umount: /mount-9p: not mounted.

                                                
                                                
-- /stdout --
** stderr ** 
	ssh: Process exited with status 32

                                                
                                                
** /stderr **
functional_test_mount_test.go:232: "out/minikube-linux-arm64 -p functional-479263 ssh \"sudo umount -f /mount-9p\"": exit status 1
functional_test_mount_test.go:234: (dbg) stopping [out/minikube-linux-arm64 mount -p functional-479263 /tmp/TestFunctionalparallelMountCmdspecific-port1082477147/001:/mount-9p --alsologtostderr -v=1 --port 46464] ...
--- PASS: TestFunctional/parallel/MountCmd/specific-port (2.37s)

                                                
                                    
x
+
TestFunctional/parallel/MountCmd/VerifyCleanup (2.03s)

                                                
                                                
=== RUN   TestFunctional/parallel/MountCmd/VerifyCleanup
functional_test_mount_test.go:298: (dbg) daemon: [out/minikube-linux-arm64 mount -p functional-479263 /tmp/TestFunctionalparallelMountCmdVerifyCleanup1605580123/001:/mount1 --alsologtostderr -v=1]
functional_test_mount_test.go:298: (dbg) daemon: [out/minikube-linux-arm64 mount -p functional-479263 /tmp/TestFunctionalparallelMountCmdVerifyCleanup1605580123/001:/mount2 --alsologtostderr -v=1]
functional_test_mount_test.go:298: (dbg) daemon: [out/minikube-linux-arm64 mount -p functional-479263 /tmp/TestFunctionalparallelMountCmdVerifyCleanup1605580123/001:/mount3 --alsologtostderr -v=1]
functional_test_mount_test.go:325: (dbg) Run:  out/minikube-linux-arm64 -p functional-479263 ssh "findmnt -T" /mount1
functional_test_mount_test.go:325: (dbg) Non-zero exit: out/minikube-linux-arm64 -p functional-479263 ssh "findmnt -T" /mount1: exit status 1 (860.304779ms)

                                                
                                                
** stderr ** 
	ssh: Process exited with status 1

                                                
                                                
** /stderr **
functional_test_mount_test.go:325: (dbg) Run:  out/minikube-linux-arm64 -p functional-479263 ssh "findmnt -T" /mount1
functional_test_mount_test.go:325: (dbg) Run:  out/minikube-linux-arm64 -p functional-479263 ssh "findmnt -T" /mount2
functional_test_mount_test.go:325: (dbg) Run:  out/minikube-linux-arm64 -p functional-479263 ssh "findmnt -T" /mount3
functional_test_mount_test.go:370: (dbg) Run:  out/minikube-linux-arm64 mount -p functional-479263 --kill=true
functional_test_mount_test.go:313: (dbg) stopping [out/minikube-linux-arm64 mount -p functional-479263 /tmp/TestFunctionalparallelMountCmdVerifyCleanup1605580123/001:/mount1 --alsologtostderr -v=1] ...
helpers_test.go:490: unable to find parent, assuming dead: process does not exist
functional_test_mount_test.go:313: (dbg) stopping [out/minikube-linux-arm64 mount -p functional-479263 /tmp/TestFunctionalparallelMountCmdVerifyCleanup1605580123/001:/mount2 --alsologtostderr -v=1] ...
helpers_test.go:490: unable to find parent, assuming dead: process does not exist
functional_test_mount_test.go:313: (dbg) stopping [out/minikube-linux-arm64 mount -p functional-479263 /tmp/TestFunctionalparallelMountCmdVerifyCleanup1605580123/001:/mount3 --alsologtostderr -v=1] ...
helpers_test.go:490: unable to find parent, assuming dead: process does not exist
--- PASS: TestFunctional/parallel/MountCmd/VerifyCleanup (2.03s)

                                                
                                    
x
+
TestFunctional/delete_echo-server_images (0.04s)

                                                
                                                
=== RUN   TestFunctional/delete_echo-server_images
functional_test.go:189: (dbg) Run:  docker rmi -f docker.io/kicbase/echo-server:1.0
functional_test.go:189: (dbg) Run:  docker rmi -f docker.io/kicbase/echo-server:functional-479263
--- PASS: TestFunctional/delete_echo-server_images (0.04s)

                                                
                                    
x
+
TestFunctional/delete_my-image_image (0.02s)

                                                
                                                
=== RUN   TestFunctional/delete_my-image_image
functional_test.go:197: (dbg) Run:  docker rmi -f localhost/my-image:functional-479263
--- PASS: TestFunctional/delete_my-image_image (0.02s)

                                                
                                    
x
+
TestFunctional/delete_minikube_cached_images (0.02s)

                                                
                                                
=== RUN   TestFunctional/delete_minikube_cached_images
functional_test.go:205: (dbg) Run:  docker rmi -f minikube-local-cache-test:functional-479263
--- PASS: TestFunctional/delete_minikube_cached_images (0.02s)

                                                
                                    
x
+
TestMultiControlPlane/serial/StartCluster (124.29s)

                                                
                                                
=== RUN   TestMultiControlPlane/serial/StartCluster
ha_test.go:101: (dbg) Run:  out/minikube-linux-arm64 start -p ha-629318 --wait=true --memory=2200 --ha -v=7 --alsologtostderr --driver=docker  --container-runtime=containerd
E0729 20:26:56.783288  139728 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19339-134334/.minikube/profiles/addons-675434/client.crt: no such file or directory
E0729 20:26:56.788861  139728 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19339-134334/.minikube/profiles/addons-675434/client.crt: no such file or directory
E0729 20:26:56.799090  139728 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19339-134334/.minikube/profiles/addons-675434/client.crt: no such file or directory
E0729 20:26:56.819322  139728 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19339-134334/.minikube/profiles/addons-675434/client.crt: no such file or directory
E0729 20:26:56.859569  139728 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19339-134334/.minikube/profiles/addons-675434/client.crt: no such file or directory
E0729 20:26:56.940052  139728 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19339-134334/.minikube/profiles/addons-675434/client.crt: no such file or directory
E0729 20:26:57.100291  139728 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19339-134334/.minikube/profiles/addons-675434/client.crt: no such file or directory
E0729 20:26:57.421416  139728 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19339-134334/.minikube/profiles/addons-675434/client.crt: no such file or directory
E0729 20:26:58.061613  139728 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19339-134334/.minikube/profiles/addons-675434/client.crt: no such file or directory
E0729 20:26:59.342630  139728 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19339-134334/.minikube/profiles/addons-675434/client.crt: no such file or directory
E0729 20:27:01.903307  139728 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19339-134334/.minikube/profiles/addons-675434/client.crt: no such file or directory
E0729 20:27:07.023846  139728 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19339-134334/.minikube/profiles/addons-675434/client.crt: no such file or directory
E0729 20:27:17.264482  139728 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19339-134334/.minikube/profiles/addons-675434/client.crt: no such file or directory
E0729 20:27:37.745665  139728 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19339-134334/.minikube/profiles/addons-675434/client.crt: no such file or directory
E0729 20:28:18.706752  139728 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19339-134334/.minikube/profiles/addons-675434/client.crt: no such file or directory
ha_test.go:101: (dbg) Done: out/minikube-linux-arm64 start -p ha-629318 --wait=true --memory=2200 --ha -v=7 --alsologtostderr --driver=docker  --container-runtime=containerd: (2m3.324065457s)
ha_test.go:107: (dbg) Run:  out/minikube-linux-arm64 -p ha-629318 status -v=7 --alsologtostderr
--- PASS: TestMultiControlPlane/serial/StartCluster (124.29s)

                                                
                                    
x
+
TestMultiControlPlane/serial/DeployApp (40.93s)

                                                
                                                
=== RUN   TestMultiControlPlane/serial/DeployApp
ha_test.go:128: (dbg) Run:  out/minikube-linux-arm64 kubectl -p ha-629318 -- apply -f ./testdata/ha/ha-pod-dns-test.yaml
ha_test.go:133: (dbg) Run:  out/minikube-linux-arm64 kubectl -p ha-629318 -- rollout status deployment/busybox
ha_test.go:133: (dbg) Done: out/minikube-linux-arm64 kubectl -p ha-629318 -- rollout status deployment/busybox: (37.998178748s)
ha_test.go:140: (dbg) Run:  out/minikube-linux-arm64 kubectl -p ha-629318 -- get pods -o jsonpath='{.items[*].status.podIP}'
ha_test.go:163: (dbg) Run:  out/minikube-linux-arm64 kubectl -p ha-629318 -- get pods -o jsonpath='{.items[*].metadata.name}'
ha_test.go:171: (dbg) Run:  out/minikube-linux-arm64 kubectl -p ha-629318 -- exec busybox-fc5497c4f-2r7tx -- nslookup kubernetes.io
ha_test.go:171: (dbg) Run:  out/minikube-linux-arm64 kubectl -p ha-629318 -- exec busybox-fc5497c4f-jm66t -- nslookup kubernetes.io
ha_test.go:171: (dbg) Run:  out/minikube-linux-arm64 kubectl -p ha-629318 -- exec busybox-fc5497c4f-lx4lg -- nslookup kubernetes.io
ha_test.go:181: (dbg) Run:  out/minikube-linux-arm64 kubectl -p ha-629318 -- exec busybox-fc5497c4f-2r7tx -- nslookup kubernetes.default
ha_test.go:181: (dbg) Run:  out/minikube-linux-arm64 kubectl -p ha-629318 -- exec busybox-fc5497c4f-jm66t -- nslookup kubernetes.default
ha_test.go:181: (dbg) Run:  out/minikube-linux-arm64 kubectl -p ha-629318 -- exec busybox-fc5497c4f-lx4lg -- nslookup kubernetes.default
ha_test.go:189: (dbg) Run:  out/minikube-linux-arm64 kubectl -p ha-629318 -- exec busybox-fc5497c4f-2r7tx -- nslookup kubernetes.default.svc.cluster.local
ha_test.go:189: (dbg) Run:  out/minikube-linux-arm64 kubectl -p ha-629318 -- exec busybox-fc5497c4f-jm66t -- nslookup kubernetes.default.svc.cluster.local
ha_test.go:189: (dbg) Run:  out/minikube-linux-arm64 kubectl -p ha-629318 -- exec busybox-fc5497c4f-lx4lg -- nslookup kubernetes.default.svc.cluster.local
--- PASS: TestMultiControlPlane/serial/DeployApp (40.93s)

                                                
                                    
x
+
TestMultiControlPlane/serial/PingHostFromPods (1.55s)

                                                
                                                
=== RUN   TestMultiControlPlane/serial/PingHostFromPods
ha_test.go:199: (dbg) Run:  out/minikube-linux-arm64 kubectl -p ha-629318 -- get pods -o jsonpath='{.items[*].metadata.name}'
ha_test.go:207: (dbg) Run:  out/minikube-linux-arm64 kubectl -p ha-629318 -- exec busybox-fc5497c4f-2r7tx -- sh -c "nslookup host.minikube.internal | awk 'NR==5' | cut -d' ' -f3"
ha_test.go:218: (dbg) Run:  out/minikube-linux-arm64 kubectl -p ha-629318 -- exec busybox-fc5497c4f-2r7tx -- sh -c "ping -c 1 192.168.49.1"
ha_test.go:207: (dbg) Run:  out/minikube-linux-arm64 kubectl -p ha-629318 -- exec busybox-fc5497c4f-jm66t -- sh -c "nslookup host.minikube.internal | awk 'NR==5' | cut -d' ' -f3"
ha_test.go:218: (dbg) Run:  out/minikube-linux-arm64 kubectl -p ha-629318 -- exec busybox-fc5497c4f-jm66t -- sh -c "ping -c 1 192.168.49.1"
ha_test.go:207: (dbg) Run:  out/minikube-linux-arm64 kubectl -p ha-629318 -- exec busybox-fc5497c4f-lx4lg -- sh -c "nslookup host.minikube.internal | awk 'NR==5' | cut -d' ' -f3"
ha_test.go:218: (dbg) Run:  out/minikube-linux-arm64 kubectl -p ha-629318 -- exec busybox-fc5497c4f-lx4lg -- sh -c "ping -c 1 192.168.49.1"
--- PASS: TestMultiControlPlane/serial/PingHostFromPods (1.55s)

                                                
                                    
x
+
TestMultiControlPlane/serial/AddWorkerNode (24.77s)

                                                
                                                
=== RUN   TestMultiControlPlane/serial/AddWorkerNode
ha_test.go:228: (dbg) Run:  out/minikube-linux-arm64 node add -p ha-629318 -v=7 --alsologtostderr
E0729 20:29:40.627794  139728 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19339-134334/.minikube/profiles/addons-675434/client.crt: no such file or directory
ha_test.go:228: (dbg) Done: out/minikube-linux-arm64 node add -p ha-629318 -v=7 --alsologtostderr: (23.774300127s)
ha_test.go:234: (dbg) Run:  out/minikube-linux-arm64 -p ha-629318 status -v=7 --alsologtostderr
ha_test.go:234: (dbg) Done: out/minikube-linux-arm64 -p ha-629318 status -v=7 --alsologtostderr: (1.000375304s)
--- PASS: TestMultiControlPlane/serial/AddWorkerNode (24.77s)

                                                
                                    
x
+
TestMultiControlPlane/serial/NodeLabels (0.11s)

                                                
                                                
=== RUN   TestMultiControlPlane/serial/NodeLabels
ha_test.go:255: (dbg) Run:  kubectl --context ha-629318 get nodes -o "jsonpath=[{range .items[*]}{.metadata.labels},{end}]"
--- PASS: TestMultiControlPlane/serial/NodeLabels (0.11s)

                                                
                                    
x
+
TestMultiControlPlane/serial/HAppyAfterClusterStart (0.78s)

                                                
                                                
=== RUN   TestMultiControlPlane/serial/HAppyAfterClusterStart
ha_test.go:281: (dbg) Run:  out/minikube-linux-arm64 profile list --output json
--- PASS: TestMultiControlPlane/serial/HAppyAfterClusterStart (0.78s)

                                                
                                    
x
+
TestMultiControlPlane/serial/CopyFile (19.91s)

                                                
                                                
=== RUN   TestMultiControlPlane/serial/CopyFile
ha_test.go:326: (dbg) Run:  out/minikube-linux-arm64 -p ha-629318 status --output json -v=7 --alsologtostderr
ha_test.go:326: (dbg) Done: out/minikube-linux-arm64 -p ha-629318 status --output json -v=7 --alsologtostderr: (1.100007556s)
helpers_test.go:556: (dbg) Run:  out/minikube-linux-arm64 -p ha-629318 cp testdata/cp-test.txt ha-629318:/home/docker/cp-test.txt
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p ha-629318 ssh -n ha-629318 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:556: (dbg) Run:  out/minikube-linux-arm64 -p ha-629318 cp ha-629318:/home/docker/cp-test.txt /tmp/TestMultiControlPlaneserialCopyFile3840634769/001/cp-test_ha-629318.txt
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p ha-629318 ssh -n ha-629318 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:556: (dbg) Run:  out/minikube-linux-arm64 -p ha-629318 cp ha-629318:/home/docker/cp-test.txt ha-629318-m02:/home/docker/cp-test_ha-629318_ha-629318-m02.txt
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p ha-629318 ssh -n ha-629318 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p ha-629318 ssh -n ha-629318-m02 "sudo cat /home/docker/cp-test_ha-629318_ha-629318-m02.txt"
helpers_test.go:556: (dbg) Run:  out/minikube-linux-arm64 -p ha-629318 cp ha-629318:/home/docker/cp-test.txt ha-629318-m03:/home/docker/cp-test_ha-629318_ha-629318-m03.txt
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p ha-629318 ssh -n ha-629318 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p ha-629318 ssh -n ha-629318-m03 "sudo cat /home/docker/cp-test_ha-629318_ha-629318-m03.txt"
helpers_test.go:556: (dbg) Run:  out/minikube-linux-arm64 -p ha-629318 cp ha-629318:/home/docker/cp-test.txt ha-629318-m04:/home/docker/cp-test_ha-629318_ha-629318-m04.txt
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p ha-629318 ssh -n ha-629318 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p ha-629318 ssh -n ha-629318-m04 "sudo cat /home/docker/cp-test_ha-629318_ha-629318-m04.txt"
helpers_test.go:556: (dbg) Run:  out/minikube-linux-arm64 -p ha-629318 cp testdata/cp-test.txt ha-629318-m02:/home/docker/cp-test.txt
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p ha-629318 ssh -n ha-629318-m02 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:556: (dbg) Run:  out/minikube-linux-arm64 -p ha-629318 cp ha-629318-m02:/home/docker/cp-test.txt /tmp/TestMultiControlPlaneserialCopyFile3840634769/001/cp-test_ha-629318-m02.txt
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p ha-629318 ssh -n ha-629318-m02 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:556: (dbg) Run:  out/minikube-linux-arm64 -p ha-629318 cp ha-629318-m02:/home/docker/cp-test.txt ha-629318:/home/docker/cp-test_ha-629318-m02_ha-629318.txt
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p ha-629318 ssh -n ha-629318-m02 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p ha-629318 ssh -n ha-629318 "sudo cat /home/docker/cp-test_ha-629318-m02_ha-629318.txt"
helpers_test.go:556: (dbg) Run:  out/minikube-linux-arm64 -p ha-629318 cp ha-629318-m02:/home/docker/cp-test.txt ha-629318-m03:/home/docker/cp-test_ha-629318-m02_ha-629318-m03.txt
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p ha-629318 ssh -n ha-629318-m02 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p ha-629318 ssh -n ha-629318-m03 "sudo cat /home/docker/cp-test_ha-629318-m02_ha-629318-m03.txt"
helpers_test.go:556: (dbg) Run:  out/minikube-linux-arm64 -p ha-629318 cp ha-629318-m02:/home/docker/cp-test.txt ha-629318-m04:/home/docker/cp-test_ha-629318-m02_ha-629318-m04.txt
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p ha-629318 ssh -n ha-629318-m02 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p ha-629318 ssh -n ha-629318-m04 "sudo cat /home/docker/cp-test_ha-629318-m02_ha-629318-m04.txt"
helpers_test.go:556: (dbg) Run:  out/minikube-linux-arm64 -p ha-629318 cp testdata/cp-test.txt ha-629318-m03:/home/docker/cp-test.txt
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p ha-629318 ssh -n ha-629318-m03 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:556: (dbg) Run:  out/minikube-linux-arm64 -p ha-629318 cp ha-629318-m03:/home/docker/cp-test.txt /tmp/TestMultiControlPlaneserialCopyFile3840634769/001/cp-test_ha-629318-m03.txt
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p ha-629318 ssh -n ha-629318-m03 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:556: (dbg) Run:  out/minikube-linux-arm64 -p ha-629318 cp ha-629318-m03:/home/docker/cp-test.txt ha-629318:/home/docker/cp-test_ha-629318-m03_ha-629318.txt
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p ha-629318 ssh -n ha-629318-m03 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p ha-629318 ssh -n ha-629318 "sudo cat /home/docker/cp-test_ha-629318-m03_ha-629318.txt"
helpers_test.go:556: (dbg) Run:  out/minikube-linux-arm64 -p ha-629318 cp ha-629318-m03:/home/docker/cp-test.txt ha-629318-m02:/home/docker/cp-test_ha-629318-m03_ha-629318-m02.txt
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p ha-629318 ssh -n ha-629318-m03 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p ha-629318 ssh -n ha-629318-m02 "sudo cat /home/docker/cp-test_ha-629318-m03_ha-629318-m02.txt"
helpers_test.go:556: (dbg) Run:  out/minikube-linux-arm64 -p ha-629318 cp ha-629318-m03:/home/docker/cp-test.txt ha-629318-m04:/home/docker/cp-test_ha-629318-m03_ha-629318-m04.txt
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p ha-629318 ssh -n ha-629318-m03 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p ha-629318 ssh -n ha-629318-m04 "sudo cat /home/docker/cp-test_ha-629318-m03_ha-629318-m04.txt"
helpers_test.go:556: (dbg) Run:  out/minikube-linux-arm64 -p ha-629318 cp testdata/cp-test.txt ha-629318-m04:/home/docker/cp-test.txt
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p ha-629318 ssh -n ha-629318-m04 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:556: (dbg) Run:  out/minikube-linux-arm64 -p ha-629318 cp ha-629318-m04:/home/docker/cp-test.txt /tmp/TestMultiControlPlaneserialCopyFile3840634769/001/cp-test_ha-629318-m04.txt
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p ha-629318 ssh -n ha-629318-m04 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:556: (dbg) Run:  out/minikube-linux-arm64 -p ha-629318 cp ha-629318-m04:/home/docker/cp-test.txt ha-629318:/home/docker/cp-test_ha-629318-m04_ha-629318.txt
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p ha-629318 ssh -n ha-629318-m04 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p ha-629318 ssh -n ha-629318 "sudo cat /home/docker/cp-test_ha-629318-m04_ha-629318.txt"
helpers_test.go:556: (dbg) Run:  out/minikube-linux-arm64 -p ha-629318 cp ha-629318-m04:/home/docker/cp-test.txt ha-629318-m02:/home/docker/cp-test_ha-629318-m04_ha-629318-m02.txt
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p ha-629318 ssh -n ha-629318-m04 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p ha-629318 ssh -n ha-629318-m02 "sudo cat /home/docker/cp-test_ha-629318-m04_ha-629318-m02.txt"
helpers_test.go:556: (dbg) Run:  out/minikube-linux-arm64 -p ha-629318 cp ha-629318-m04:/home/docker/cp-test.txt ha-629318-m03:/home/docker/cp-test_ha-629318-m04_ha-629318-m03.txt
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p ha-629318 ssh -n ha-629318-m04 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p ha-629318 ssh -n ha-629318-m03 "sudo cat /home/docker/cp-test_ha-629318-m04_ha-629318-m03.txt"
--- PASS: TestMultiControlPlane/serial/CopyFile (19.91s)

                                                
                                    
x
+
TestMultiControlPlane/serial/StopSecondaryNode (12.91s)

                                                
                                                
=== RUN   TestMultiControlPlane/serial/StopSecondaryNode
ha_test.go:363: (dbg) Run:  out/minikube-linux-arm64 -p ha-629318 node stop m02 -v=7 --alsologtostderr
ha_test.go:363: (dbg) Done: out/minikube-linux-arm64 -p ha-629318 node stop m02 -v=7 --alsologtostderr: (12.172129697s)
ha_test.go:369: (dbg) Run:  out/minikube-linux-arm64 -p ha-629318 status -v=7 --alsologtostderr
ha_test.go:369: (dbg) Non-zero exit: out/minikube-linux-arm64 -p ha-629318 status -v=7 --alsologtostderr: exit status 7 (740.314283ms)

                                                
                                                
-- stdout --
	ha-629318
	type: Control Plane
	host: Running
	kubelet: Running
	apiserver: Running
	kubeconfig: Configured
	
	ha-629318-m02
	type: Control Plane
	host: Stopped
	kubelet: Stopped
	apiserver: Stopped
	kubeconfig: Stopped
	
	ha-629318-m03
	type: Control Plane
	host: Running
	kubelet: Running
	apiserver: Running
	kubeconfig: Configured
	
	ha-629318-m04
	type: Worker
	host: Running
	kubelet: Running
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0729 20:30:26.491879  192645 out.go:291] Setting OutFile to fd 1 ...
	I0729 20:30:26.492209  192645 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0729 20:30:26.492245  192645 out.go:304] Setting ErrFile to fd 2...
	I0729 20:30:26.492280  192645 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0729 20:30:26.492633  192645 root.go:338] Updating PATH: /home/jenkins/minikube-integration/19339-134334/.minikube/bin
	I0729 20:30:26.492981  192645 out.go:298] Setting JSON to false
	I0729 20:30:26.493075  192645 mustload.go:65] Loading cluster: ha-629318
	I0729 20:30:26.493176  192645 notify.go:220] Checking for updates...
	I0729 20:30:26.494777  192645 config.go:182] Loaded profile config "ha-629318": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.30.3
	I0729 20:30:26.494830  192645 status.go:255] checking status of ha-629318 ...
	I0729 20:30:26.495597  192645 cli_runner.go:164] Run: docker container inspect ha-629318 --format={{.State.Status}}
	I0729 20:30:26.518498  192645 status.go:330] ha-629318 host status = "Running" (err=<nil>)
	I0729 20:30:26.518524  192645 host.go:66] Checking if "ha-629318" exists ...
	I0729 20:30:26.518841  192645 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" ha-629318
	I0729 20:30:26.539102  192645 host.go:66] Checking if "ha-629318" exists ...
	I0729 20:30:26.539601  192645 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
	I0729 20:30:26.539666  192645 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-629318
	I0729 20:30:26.562287  192645 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:37055 SSHKeyPath:/home/jenkins/minikube-integration/19339-134334/.minikube/machines/ha-629318/id_rsa Username:docker}
	I0729 20:30:26.656002  192645 ssh_runner.go:195] Run: systemctl --version
	I0729 20:30:26.660896  192645 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
	I0729 20:30:26.675535  192645 cli_runner.go:164] Run: docker system info --format "{{json .}}"
	I0729 20:30:26.739500  192645 info.go:266] docker info: {ID:U5VK:ZNT5:35M3:FHLW:Q7TL:ELFX:BNAG:AV4T:UD2H:SK5L:SEJV:SJJL Containers:4 ContainersRunning:3 ContainersPaused:0 ContainersStopped:1 Images:3 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:55 OomKillDisable:true NGoroutines:71 SystemTime:2024-07-29 20:30:26.729751029 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1065-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Architecture:aar
ch64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8214900736 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-29-130 Labels:[] ExperimentalBuild:false ServerVersion:27.1.1 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:2bf793ef6dc9a18e00cb12efb64355c2c9d5eb41 Expected:2bf793ef6dc9a18e00cb12efb64355c2c9d5eb41} RuncCommit:{ID:v1.1.13-0-g58aa920 Expected:v1.1.13-0-g58aa920} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:<nil> ServerErro
rs:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.16.1] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.29.1]] Warnings:<nil>}}
	I0729 20:30:26.740498  192645 kubeconfig.go:125] found "ha-629318" server: "https://192.168.49.254:8443"
	I0729 20:30:26.740547  192645 api_server.go:166] Checking apiserver status ...
	I0729 20:30:26.740640  192645 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0729 20:30:26.753957  192645 ssh_runner.go:195] Run: sudo egrep ^[0-9]+:freezer: /proc/1548/cgroup
	I0729 20:30:26.763461  192645 api_server.go:182] apiserver freezer: "2:freezer:/docker/5245ceb9d701c0b3c1247a7163c813dac95a81c40ba00d0c0f2b3c7871c6ed56/kubepods/burstable/pod602f3dbcfaf7e95ed4b9a494fe47ba5b/6ae86bc876c71dfcef00ed2a6851e54c1c07fea9bc496b7faab3a1cab9e114e1"
	I0729 20:30:26.763537  192645 ssh_runner.go:195] Run: sudo cat /sys/fs/cgroup/freezer/docker/5245ceb9d701c0b3c1247a7163c813dac95a81c40ba00d0c0f2b3c7871c6ed56/kubepods/burstable/pod602f3dbcfaf7e95ed4b9a494fe47ba5b/6ae86bc876c71dfcef00ed2a6851e54c1c07fea9bc496b7faab3a1cab9e114e1/freezer.state
	I0729 20:30:26.772518  192645 api_server.go:204] freezer state: "THAWED"
	I0729 20:30:26.772567  192645 api_server.go:253] Checking apiserver healthz at https://192.168.49.254:8443/healthz ...
	I0729 20:30:26.782414  192645 api_server.go:279] https://192.168.49.254:8443/healthz returned 200:
	ok
	I0729 20:30:26.782448  192645 status.go:422] ha-629318 apiserver status = Running (err=<nil>)
	I0729 20:30:26.782462  192645 status.go:257] ha-629318 status: &{Name:ha-629318 Host:Running Kubelet:Running APIServer:Running Kubeconfig:Configured Worker:false TimeToStop: DockerEnv: PodManEnv:}
	I0729 20:30:26.782481  192645 status.go:255] checking status of ha-629318-m02 ...
	I0729 20:30:26.782804  192645 cli_runner.go:164] Run: docker container inspect ha-629318-m02 --format={{.State.Status}}
	I0729 20:30:26.800174  192645 status.go:330] ha-629318-m02 host status = "Stopped" (err=<nil>)
	I0729 20:30:26.800216  192645 status.go:343] host is not running, skipping remaining checks
	I0729 20:30:26.800231  192645 status.go:257] ha-629318-m02 status: &{Name:ha-629318-m02 Host:Stopped Kubelet:Stopped APIServer:Stopped Kubeconfig:Stopped Worker:false TimeToStop: DockerEnv: PodManEnv:}
	I0729 20:30:26.800266  192645 status.go:255] checking status of ha-629318-m03 ...
	I0729 20:30:26.800751  192645 cli_runner.go:164] Run: docker container inspect ha-629318-m03 --format={{.State.Status}}
	I0729 20:30:26.818800  192645 status.go:330] ha-629318-m03 host status = "Running" (err=<nil>)
	I0729 20:30:26.818826  192645 host.go:66] Checking if "ha-629318-m03" exists ...
	I0729 20:30:26.819191  192645 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" ha-629318-m03
	I0729 20:30:26.837860  192645 host.go:66] Checking if "ha-629318-m03" exists ...
	I0729 20:30:26.838176  192645 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
	I0729 20:30:26.838223  192645 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-629318-m03
	I0729 20:30:26.855948  192645 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:37065 SSHKeyPath:/home/jenkins/minikube-integration/19339-134334/.minikube/machines/ha-629318-m03/id_rsa Username:docker}
	I0729 20:30:26.950180  192645 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
	I0729 20:30:26.962557  192645 kubeconfig.go:125] found "ha-629318" server: "https://192.168.49.254:8443"
	I0729 20:30:26.962589  192645 api_server.go:166] Checking apiserver status ...
	I0729 20:30:26.962697  192645 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0729 20:30:26.974247  192645 ssh_runner.go:195] Run: sudo egrep ^[0-9]+:freezer: /proc/1519/cgroup
	I0729 20:30:26.984664  192645 api_server.go:182] apiserver freezer: "2:freezer:/docker/0649536b9280bdec14600b948c7983f4e79f1d5f875d555e1cafd233168f6560/kubepods/burstable/pod12335c83168832ec9b5bd2724fb85c40/38f5cc526becc359244f5007b39456847a574f6aa7f82b43f113b86915823970"
	I0729 20:30:26.984801  192645 ssh_runner.go:195] Run: sudo cat /sys/fs/cgroup/freezer/docker/0649536b9280bdec14600b948c7983f4e79f1d5f875d555e1cafd233168f6560/kubepods/burstable/pod12335c83168832ec9b5bd2724fb85c40/38f5cc526becc359244f5007b39456847a574f6aa7f82b43f113b86915823970/freezer.state
	I0729 20:30:26.994307  192645 api_server.go:204] freezer state: "THAWED"
	I0729 20:30:26.994340  192645 api_server.go:253] Checking apiserver healthz at https://192.168.49.254:8443/healthz ...
	I0729 20:30:27.002934  192645 api_server.go:279] https://192.168.49.254:8443/healthz returned 200:
	ok
	I0729 20:30:27.002976  192645 status.go:422] ha-629318-m03 apiserver status = Running (err=<nil>)
	I0729 20:30:27.003020  192645 status.go:257] ha-629318-m03 status: &{Name:ha-629318-m03 Host:Running Kubelet:Running APIServer:Running Kubeconfig:Configured Worker:false TimeToStop: DockerEnv: PodManEnv:}
	I0729 20:30:27.003044  192645 status.go:255] checking status of ha-629318-m04 ...
	I0729 20:30:27.003474  192645 cli_runner.go:164] Run: docker container inspect ha-629318-m04 --format={{.State.Status}}
	I0729 20:30:27.024436  192645 status.go:330] ha-629318-m04 host status = "Running" (err=<nil>)
	I0729 20:30:27.024464  192645 host.go:66] Checking if "ha-629318-m04" exists ...
	I0729 20:30:27.024760  192645 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" ha-629318-m04
	I0729 20:30:27.042062  192645 host.go:66] Checking if "ha-629318-m04" exists ...
	I0729 20:30:27.042371  192645 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
	I0729 20:30:27.042419  192645 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-629318-m04
	I0729 20:30:27.061995  192645 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:37070 SSHKeyPath:/home/jenkins/minikube-integration/19339-134334/.minikube/machines/ha-629318-m04/id_rsa Username:docker}
	I0729 20:30:27.157197  192645 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
	I0729 20:30:27.170640  192645 status.go:257] ha-629318-m04 status: &{Name:ha-629318-m04 Host:Running Kubelet:Running APIServer:Irrelevant Kubeconfig:Irrelevant Worker:true TimeToStop: DockerEnv: PodManEnv:}

                                                
                                                
** /stderr **
--- PASS: TestMultiControlPlane/serial/StopSecondaryNode (12.91s)

                                                
                                    
x
+
TestMultiControlPlane/serial/DegradedAfterControlPlaneNodeStop (0.55s)

                                                
                                                
=== RUN   TestMultiControlPlane/serial/DegradedAfterControlPlaneNodeStop
ha_test.go:390: (dbg) Run:  out/minikube-linux-arm64 profile list --output json
--- PASS: TestMultiControlPlane/serial/DegradedAfterControlPlaneNodeStop (0.55s)

                                                
                                    
x
+
TestMultiControlPlane/serial/RestartSecondaryNode (18.91s)

                                                
                                                
=== RUN   TestMultiControlPlane/serial/RestartSecondaryNode
ha_test.go:420: (dbg) Run:  out/minikube-linux-arm64 -p ha-629318 node start m02 -v=7 --alsologtostderr
ha_test.go:420: (dbg) Done: out/minikube-linux-arm64 -p ha-629318 node start m02 -v=7 --alsologtostderr: (17.506412779s)
ha_test.go:428: (dbg) Run:  out/minikube-linux-arm64 -p ha-629318 status -v=7 --alsologtostderr
ha_test.go:428: (dbg) Done: out/minikube-linux-arm64 -p ha-629318 status -v=7 --alsologtostderr: (1.292251251s)
ha_test.go:448: (dbg) Run:  kubectl get nodes
--- PASS: TestMultiControlPlane/serial/RestartSecondaryNode (18.91s)

                                                
                                    
x
+
TestMultiControlPlane/serial/HAppyAfterSecondaryNodeRestart (0.78s)

                                                
                                                
=== RUN   TestMultiControlPlane/serial/HAppyAfterSecondaryNodeRestart
ha_test.go:281: (dbg) Run:  out/minikube-linux-arm64 profile list --output json
--- PASS: TestMultiControlPlane/serial/HAppyAfterSecondaryNodeRestart (0.78s)

                                                
                                    
x
+
TestMultiControlPlane/serial/RestartClusterKeepsNodes (143.72s)

                                                
                                                
=== RUN   TestMultiControlPlane/serial/RestartClusterKeepsNodes
ha_test.go:456: (dbg) Run:  out/minikube-linux-arm64 node list -p ha-629318 -v=7 --alsologtostderr
ha_test.go:462: (dbg) Run:  out/minikube-linux-arm64 stop -p ha-629318 -v=7 --alsologtostderr
E0729 20:30:53.505171  139728 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19339-134334/.minikube/profiles/functional-479263/client.crt: no such file or directory
E0729 20:30:53.510440  139728 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19339-134334/.minikube/profiles/functional-479263/client.crt: no such file or directory
E0729 20:30:53.520636  139728 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19339-134334/.minikube/profiles/functional-479263/client.crt: no such file or directory
E0729 20:30:53.540915  139728 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19339-134334/.minikube/profiles/functional-479263/client.crt: no such file or directory
E0729 20:30:53.581228  139728 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19339-134334/.minikube/profiles/functional-479263/client.crt: no such file or directory
E0729 20:30:53.661522  139728 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19339-134334/.minikube/profiles/functional-479263/client.crt: no such file or directory
E0729 20:30:53.821756  139728 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19339-134334/.minikube/profiles/functional-479263/client.crt: no such file or directory
E0729 20:30:54.142254  139728 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19339-134334/.minikube/profiles/functional-479263/client.crt: no such file or directory
E0729 20:30:54.783037  139728 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19339-134334/.minikube/profiles/functional-479263/client.crt: no such file or directory
E0729 20:30:56.063314  139728 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19339-134334/.minikube/profiles/functional-479263/client.crt: no such file or directory
E0729 20:30:58.624516  139728 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19339-134334/.minikube/profiles/functional-479263/client.crt: no such file or directory
E0729 20:31:03.745406  139728 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19339-134334/.minikube/profiles/functional-479263/client.crt: no such file or directory
E0729 20:31:13.986422  139728 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19339-134334/.minikube/profiles/functional-479263/client.crt: no such file or directory
ha_test.go:462: (dbg) Done: out/minikube-linux-arm64 stop -p ha-629318 -v=7 --alsologtostderr: (37.272291736s)
ha_test.go:467: (dbg) Run:  out/minikube-linux-arm64 start -p ha-629318 --wait=true -v=7 --alsologtostderr
E0729 20:31:34.466656  139728 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19339-134334/.minikube/profiles/functional-479263/client.crt: no such file or directory
E0729 20:31:56.781146  139728 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19339-134334/.minikube/profiles/addons-675434/client.crt: no such file or directory
E0729 20:32:15.427076  139728 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19339-134334/.minikube/profiles/functional-479263/client.crt: no such file or directory
E0729 20:32:24.468506  139728 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19339-134334/.minikube/profiles/addons-675434/client.crt: no such file or directory
ha_test.go:467: (dbg) Done: out/minikube-linux-arm64 start -p ha-629318 --wait=true -v=7 --alsologtostderr: (1m46.283840592s)
ha_test.go:472: (dbg) Run:  out/minikube-linux-arm64 node list -p ha-629318
--- PASS: TestMultiControlPlane/serial/RestartClusterKeepsNodes (143.72s)

                                                
                                    
x
+
TestMultiControlPlane/serial/DeleteSecondaryNode (10.6s)

                                                
                                                
=== RUN   TestMultiControlPlane/serial/DeleteSecondaryNode
ha_test.go:487: (dbg) Run:  out/minikube-linux-arm64 -p ha-629318 node delete m03 -v=7 --alsologtostderr
ha_test.go:487: (dbg) Done: out/minikube-linux-arm64 -p ha-629318 node delete m03 -v=7 --alsologtostderr: (9.657841805s)
ha_test.go:493: (dbg) Run:  out/minikube-linux-arm64 -p ha-629318 status -v=7 --alsologtostderr
ha_test.go:511: (dbg) Run:  kubectl get nodes
ha_test.go:519: (dbg) Run:  kubectl get nodes -o "go-template='{{range .items}}{{range .status.conditions}}{{if eq .type "Ready"}} {{.status}}{{"\n"}}{{end}}{{end}}{{end}}'"
--- PASS: TestMultiControlPlane/serial/DeleteSecondaryNode (10.60s)

                                                
                                    
x
+
TestMultiControlPlane/serial/DegradedAfterSecondaryNodeDelete (0.52s)

                                                
                                                
=== RUN   TestMultiControlPlane/serial/DegradedAfterSecondaryNodeDelete
ha_test.go:390: (dbg) Run:  out/minikube-linux-arm64 profile list --output json
--- PASS: TestMultiControlPlane/serial/DegradedAfterSecondaryNodeDelete (0.52s)

                                                
                                    
x
+
TestMultiControlPlane/serial/StopCluster (36.01s)

                                                
                                                
=== RUN   TestMultiControlPlane/serial/StopCluster
ha_test.go:531: (dbg) Run:  out/minikube-linux-arm64 -p ha-629318 stop -v=7 --alsologtostderr
E0729 20:33:37.348074  139728 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19339-134334/.minikube/profiles/functional-479263/client.crt: no such file or directory
ha_test.go:531: (dbg) Done: out/minikube-linux-arm64 -p ha-629318 stop -v=7 --alsologtostderr: (35.904547667s)
ha_test.go:537: (dbg) Run:  out/minikube-linux-arm64 -p ha-629318 status -v=7 --alsologtostderr
ha_test.go:537: (dbg) Non-zero exit: out/minikube-linux-arm64 -p ha-629318 status -v=7 --alsologtostderr: exit status 7 (100.213416ms)

                                                
                                                
-- stdout --
	ha-629318
	type: Control Plane
	host: Stopped
	kubelet: Stopped
	apiserver: Stopped
	kubeconfig: Stopped
	
	ha-629318-m02
	type: Control Plane
	host: Stopped
	kubelet: Stopped
	apiserver: Stopped
	kubeconfig: Stopped
	
	ha-629318-m04
	type: Worker
	host: Stopped
	kubelet: Stopped
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0729 20:33:58.202977  206921 out.go:291] Setting OutFile to fd 1 ...
	I0729 20:33:58.203137  206921 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0729 20:33:58.203148  206921 out.go:304] Setting ErrFile to fd 2...
	I0729 20:33:58.203154  206921 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0729 20:33:58.203378  206921 root.go:338] Updating PATH: /home/jenkins/minikube-integration/19339-134334/.minikube/bin
	I0729 20:33:58.203586  206921 out.go:298] Setting JSON to false
	I0729 20:33:58.203631  206921 mustload.go:65] Loading cluster: ha-629318
	I0729 20:33:58.203746  206921 notify.go:220] Checking for updates...
	I0729 20:33:58.204084  206921 config.go:182] Loaded profile config "ha-629318": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.30.3
	I0729 20:33:58.204099  206921 status.go:255] checking status of ha-629318 ...
	I0729 20:33:58.204918  206921 cli_runner.go:164] Run: docker container inspect ha-629318 --format={{.State.Status}}
	I0729 20:33:58.221372  206921 status.go:330] ha-629318 host status = "Stopped" (err=<nil>)
	I0729 20:33:58.221397  206921 status.go:343] host is not running, skipping remaining checks
	I0729 20:33:58.221405  206921 status.go:257] ha-629318 status: &{Name:ha-629318 Host:Stopped Kubelet:Stopped APIServer:Stopped Kubeconfig:Stopped Worker:false TimeToStop: DockerEnv: PodManEnv:}
	I0729 20:33:58.221430  206921 status.go:255] checking status of ha-629318-m02 ...
	I0729 20:33:58.221734  206921 cli_runner.go:164] Run: docker container inspect ha-629318-m02 --format={{.State.Status}}
	I0729 20:33:58.238116  206921 status.go:330] ha-629318-m02 host status = "Stopped" (err=<nil>)
	I0729 20:33:58.238140  206921 status.go:343] host is not running, skipping remaining checks
	I0729 20:33:58.238148  206921 status.go:257] ha-629318-m02 status: &{Name:ha-629318-m02 Host:Stopped Kubelet:Stopped APIServer:Stopped Kubeconfig:Stopped Worker:false TimeToStop: DockerEnv: PodManEnv:}
	I0729 20:33:58.238169  206921 status.go:255] checking status of ha-629318-m04 ...
	I0729 20:33:58.238477  206921 cli_runner.go:164] Run: docker container inspect ha-629318-m04 --format={{.State.Status}}
	I0729 20:33:58.256482  206921 status.go:330] ha-629318-m04 host status = "Stopped" (err=<nil>)
	I0729 20:33:58.256503  206921 status.go:343] host is not running, skipping remaining checks
	I0729 20:33:58.256511  206921 status.go:257] ha-629318-m04 status: &{Name:ha-629318-m04 Host:Stopped Kubelet:Stopped APIServer:Stopped Kubeconfig:Stopped Worker:true TimeToStop: DockerEnv: PodManEnv:}

                                                
                                                
** /stderr **
--- PASS: TestMultiControlPlane/serial/StopCluster (36.01s)

                                                
                                    
x
+
TestMultiControlPlane/serial/RestartCluster (78.17s)

                                                
                                                
=== RUN   TestMultiControlPlane/serial/RestartCluster
ha_test.go:560: (dbg) Run:  out/minikube-linux-arm64 start -p ha-629318 --wait=true -v=7 --alsologtostderr --driver=docker  --container-runtime=containerd
ha_test.go:560: (dbg) Done: out/minikube-linux-arm64 start -p ha-629318 --wait=true -v=7 --alsologtostderr --driver=docker  --container-runtime=containerd: (1m17.182899575s)
ha_test.go:566: (dbg) Run:  out/minikube-linux-arm64 -p ha-629318 status -v=7 --alsologtostderr
ha_test.go:584: (dbg) Run:  kubectl get nodes
ha_test.go:592: (dbg) Run:  kubectl get nodes -o "go-template='{{range .items}}{{range .status.conditions}}{{if eq .type "Ready"}} {{.status}}{{"\n"}}{{end}}{{end}}{{end}}'"
--- PASS: TestMultiControlPlane/serial/RestartCluster (78.17s)

                                                
                                    
x
+
TestMultiControlPlane/serial/DegradedAfterClusterRestart (0.54s)

                                                
                                                
=== RUN   TestMultiControlPlane/serial/DegradedAfterClusterRestart
ha_test.go:390: (dbg) Run:  out/minikube-linux-arm64 profile list --output json
--- PASS: TestMultiControlPlane/serial/DegradedAfterClusterRestart (0.54s)

                                                
                                    
x
+
TestMultiControlPlane/serial/AddSecondaryNode (46.61s)

                                                
                                                
=== RUN   TestMultiControlPlane/serial/AddSecondaryNode
ha_test.go:605: (dbg) Run:  out/minikube-linux-arm64 node add -p ha-629318 --control-plane -v=7 --alsologtostderr
E0729 20:35:53.505625  139728 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19339-134334/.minikube/profiles/functional-479263/client.crt: no such file or directory
ha_test.go:605: (dbg) Done: out/minikube-linux-arm64 node add -p ha-629318 --control-plane -v=7 --alsologtostderr: (45.575129242s)
ha_test.go:611: (dbg) Run:  out/minikube-linux-arm64 -p ha-629318 status -v=7 --alsologtostderr
ha_test.go:611: (dbg) Done: out/minikube-linux-arm64 -p ha-629318 status -v=7 --alsologtostderr: (1.034028949s)
--- PASS: TestMultiControlPlane/serial/AddSecondaryNode (46.61s)

                                                
                                    
x
+
TestMultiControlPlane/serial/HAppyAfterSecondaryNodeAdd (0.76s)

                                                
                                                
=== RUN   TestMultiControlPlane/serial/HAppyAfterSecondaryNodeAdd
ha_test.go:281: (dbg) Run:  out/minikube-linux-arm64 profile list --output json
--- PASS: TestMultiControlPlane/serial/HAppyAfterSecondaryNodeAdd (0.76s)

                                                
                                    
x
+
TestJSONOutput/start/Command (68.76s)

                                                
                                                
=== RUN   TestJSONOutput/start/Command
json_output_test.go:63: (dbg) Run:  out/minikube-linux-arm64 start -p json-output-722640 --output=json --user=testUser --memory=2200 --wait=true --driver=docker  --container-runtime=containerd
E0729 20:36:21.189185  139728 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19339-134334/.minikube/profiles/functional-479263/client.crt: no such file or directory
E0729 20:36:56.781175  139728 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19339-134334/.minikube/profiles/addons-675434/client.crt: no such file or directory
json_output_test.go:63: (dbg) Done: out/minikube-linux-arm64 start -p json-output-722640 --output=json --user=testUser --memory=2200 --wait=true --driver=docker  --container-runtime=containerd: (1m8.752803784s)
--- PASS: TestJSONOutput/start/Command (68.76s)

                                                
                                    
x
+
TestJSONOutput/start/Audit (0s)

                                                
                                                
=== RUN   TestJSONOutput/start/Audit
--- PASS: TestJSONOutput/start/Audit (0.00s)

                                                
                                    
x
+
TestJSONOutput/start/parallel/DistinctCurrentSteps (0s)

                                                
                                                
=== RUN   TestJSONOutput/start/parallel/DistinctCurrentSteps
=== PAUSE TestJSONOutput/start/parallel/DistinctCurrentSteps

                                                
                                                

                                                
                                                
=== CONT  TestJSONOutput/start/parallel/DistinctCurrentSteps
--- PASS: TestJSONOutput/start/parallel/DistinctCurrentSteps (0.00s)

                                                
                                    
x
+
TestJSONOutput/start/parallel/IncreasingCurrentSteps (0s)

                                                
                                                
=== RUN   TestJSONOutput/start/parallel/IncreasingCurrentSteps
=== PAUSE TestJSONOutput/start/parallel/IncreasingCurrentSteps

                                                
                                                

                                                
                                                
=== CONT  TestJSONOutput/start/parallel/IncreasingCurrentSteps
--- PASS: TestJSONOutput/start/parallel/IncreasingCurrentSteps (0.00s)

                                                
                                    
x
+
TestJSONOutput/pause/Command (0.74s)

                                                
                                                
=== RUN   TestJSONOutput/pause/Command
json_output_test.go:63: (dbg) Run:  out/minikube-linux-arm64 pause -p json-output-722640 --output=json --user=testUser
--- PASS: TestJSONOutput/pause/Command (0.74s)

                                                
                                    
x
+
TestJSONOutput/pause/Audit (0s)

                                                
                                                
=== RUN   TestJSONOutput/pause/Audit
--- PASS: TestJSONOutput/pause/Audit (0.00s)

                                                
                                    
x
+
TestJSONOutput/pause/parallel/DistinctCurrentSteps (0s)

                                                
                                                
=== RUN   TestJSONOutput/pause/parallel/DistinctCurrentSteps
=== PAUSE TestJSONOutput/pause/parallel/DistinctCurrentSteps

                                                
                                                

                                                
                                                
=== CONT  TestJSONOutput/pause/parallel/DistinctCurrentSteps
--- PASS: TestJSONOutput/pause/parallel/DistinctCurrentSteps (0.00s)

                                                
                                    
x
+
TestJSONOutput/pause/parallel/IncreasingCurrentSteps (0s)

                                                
                                                
=== RUN   TestJSONOutput/pause/parallel/IncreasingCurrentSteps
=== PAUSE TestJSONOutput/pause/parallel/IncreasingCurrentSteps

                                                
                                                

                                                
                                                
=== CONT  TestJSONOutput/pause/parallel/IncreasingCurrentSteps
--- PASS: TestJSONOutput/pause/parallel/IncreasingCurrentSteps (0.00s)

                                                
                                    
x
+
TestJSONOutput/unpause/Command (0.64s)

                                                
                                                
=== RUN   TestJSONOutput/unpause/Command
json_output_test.go:63: (dbg) Run:  out/minikube-linux-arm64 unpause -p json-output-722640 --output=json --user=testUser
--- PASS: TestJSONOutput/unpause/Command (0.64s)

                                                
                                    
x
+
TestJSONOutput/unpause/Audit (0s)

                                                
                                                
=== RUN   TestJSONOutput/unpause/Audit
--- PASS: TestJSONOutput/unpause/Audit (0.00s)

                                                
                                    
x
+
TestJSONOutput/unpause/parallel/DistinctCurrentSteps (0s)

                                                
                                                
=== RUN   TestJSONOutput/unpause/parallel/DistinctCurrentSteps
=== PAUSE TestJSONOutput/unpause/parallel/DistinctCurrentSteps

                                                
                                                

                                                
                                                
=== CONT  TestJSONOutput/unpause/parallel/DistinctCurrentSteps
--- PASS: TestJSONOutput/unpause/parallel/DistinctCurrentSteps (0.00s)

                                                
                                    
x
+
TestJSONOutput/unpause/parallel/IncreasingCurrentSteps (0s)

                                                
                                                
=== RUN   TestJSONOutput/unpause/parallel/IncreasingCurrentSteps
=== PAUSE TestJSONOutput/unpause/parallel/IncreasingCurrentSteps

                                                
                                                

                                                
                                                
=== CONT  TestJSONOutput/unpause/parallel/IncreasingCurrentSteps
--- PASS: TestJSONOutput/unpause/parallel/IncreasingCurrentSteps (0.00s)

                                                
                                    
x
+
TestJSONOutput/stop/Command (5.77s)

                                                
                                                
=== RUN   TestJSONOutput/stop/Command
json_output_test.go:63: (dbg) Run:  out/minikube-linux-arm64 stop -p json-output-722640 --output=json --user=testUser
json_output_test.go:63: (dbg) Done: out/minikube-linux-arm64 stop -p json-output-722640 --output=json --user=testUser: (5.768640148s)
--- PASS: TestJSONOutput/stop/Command (5.77s)

                                                
                                    
x
+
TestJSONOutput/stop/Audit (0s)

                                                
                                                
=== RUN   TestJSONOutput/stop/Audit
--- PASS: TestJSONOutput/stop/Audit (0.00s)

                                                
                                    
x
+
TestJSONOutput/stop/parallel/DistinctCurrentSteps (0s)

                                                
                                                
=== RUN   TestJSONOutput/stop/parallel/DistinctCurrentSteps
=== PAUSE TestJSONOutput/stop/parallel/DistinctCurrentSteps

                                                
                                                

                                                
                                                
=== CONT  TestJSONOutput/stop/parallel/DistinctCurrentSteps
--- PASS: TestJSONOutput/stop/parallel/DistinctCurrentSteps (0.00s)

                                                
                                    
x
+
TestJSONOutput/stop/parallel/IncreasingCurrentSteps (0s)

                                                
                                                
=== RUN   TestJSONOutput/stop/parallel/IncreasingCurrentSteps
=== PAUSE TestJSONOutput/stop/parallel/IncreasingCurrentSteps

                                                
                                                

                                                
                                                
=== CONT  TestJSONOutput/stop/parallel/IncreasingCurrentSteps
--- PASS: TestJSONOutput/stop/parallel/IncreasingCurrentSteps (0.00s)

                                                
                                    
x
+
TestErrorJSONOutput (0.21s)

                                                
                                                
=== RUN   TestErrorJSONOutput
json_output_test.go:160: (dbg) Run:  out/minikube-linux-arm64 start -p json-output-error-711860 --memory=2200 --output=json --wait=true --driver=fail
json_output_test.go:160: (dbg) Non-zero exit: out/minikube-linux-arm64 start -p json-output-error-711860 --memory=2200 --output=json --wait=true --driver=fail: exit status 56 (71.088049ms)

                                                
                                                
-- stdout --
	{"specversion":"1.0","id":"7aaf5766-bf4b-432c-8e77-2e38a1434587","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.step","datacontenttype":"application/json","data":{"currentstep":"0","message":"[json-output-error-711860] minikube v1.33.1 on Ubuntu 20.04 (arm64)","name":"Initial Minikube Setup","totalsteps":"19"}}
	{"specversion":"1.0","id":"47120b4c-3256-4309-a4e6-ab4fa9c71781","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_LOCATION=19339"}}
	{"specversion":"1.0","id":"ce363e82-8aad-437b-8293-ce80a69506b9","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true"}}
	{"specversion":"1.0","id":"51888404-a3c7-47a1-8dab-f64b4a95b6c5","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"KUBECONFIG=/home/jenkins/minikube-integration/19339-134334/kubeconfig"}}
	{"specversion":"1.0","id":"3111ad10-889f-482d-911b-91bcc8dd5597","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_HOME=/home/jenkins/minikube-integration/19339-134334/.minikube"}}
	{"specversion":"1.0","id":"4cb9db92-0cf1-4711-b5c4-371097cadedf","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_BIN=out/minikube-linux-arm64"}}
	{"specversion":"1.0","id":"09bc1695-22fc-4516-b96a-aef5bbab2c13","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_FORCE_SYSTEMD="}}
	{"specversion":"1.0","id":"7ffce93c-1b60-43c0-8105-11e15348c411","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.error","datacontenttype":"application/json","data":{"advice":"","exitcode":"56","issues":"","message":"The driver 'fail' is not supported on linux/arm64","name":"DRV_UNSUPPORTED_OS","url":""}}

                                                
                                                
-- /stdout --
helpers_test.go:175: Cleaning up "json-output-error-711860" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-arm64 delete -p json-output-error-711860
--- PASS: TestErrorJSONOutput (0.21s)

                                                
                                    
x
+
TestKicCustomNetwork/create_custom_network (38.52s)

                                                
                                                
=== RUN   TestKicCustomNetwork/create_custom_network
kic_custom_network_test.go:57: (dbg) Run:  out/minikube-linux-arm64 start -p docker-network-297967 --network=
kic_custom_network_test.go:57: (dbg) Done: out/minikube-linux-arm64 start -p docker-network-297967 --network=: (36.478818626s)
kic_custom_network_test.go:150: (dbg) Run:  docker network ls --format {{.Name}}
helpers_test.go:175: Cleaning up "docker-network-297967" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-arm64 delete -p docker-network-297967
helpers_test.go:178: (dbg) Done: out/minikube-linux-arm64 delete -p docker-network-297967: (2.016003242s)
--- PASS: TestKicCustomNetwork/create_custom_network (38.52s)

                                                
                                    
x
+
TestKicCustomNetwork/use_default_bridge_network (34.97s)

                                                
                                                
=== RUN   TestKicCustomNetwork/use_default_bridge_network
kic_custom_network_test.go:57: (dbg) Run:  out/minikube-linux-arm64 start -p docker-network-234057 --network=bridge
kic_custom_network_test.go:57: (dbg) Done: out/minikube-linux-arm64 start -p docker-network-234057 --network=bridge: (33.014190929s)
kic_custom_network_test.go:150: (dbg) Run:  docker network ls --format {{.Name}}
helpers_test.go:175: Cleaning up "docker-network-234057" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-arm64 delete -p docker-network-234057
helpers_test.go:178: (dbg) Done: out/minikube-linux-arm64 delete -p docker-network-234057: (1.933542538s)
--- PASS: TestKicCustomNetwork/use_default_bridge_network (34.97s)

                                                
                                    
x
+
TestKicExistingNetwork (34.63s)

                                                
                                                
=== RUN   TestKicExistingNetwork
kic_custom_network_test.go:150: (dbg) Run:  docker network ls --format {{.Name}}
kic_custom_network_test.go:93: (dbg) Run:  out/minikube-linux-arm64 start -p existing-network-633531 --network=existing-network
kic_custom_network_test.go:93: (dbg) Done: out/minikube-linux-arm64 start -p existing-network-633531 --network=existing-network: (32.433056078s)
helpers_test.go:175: Cleaning up "existing-network-633531" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-arm64 delete -p existing-network-633531
helpers_test.go:178: (dbg) Done: out/minikube-linux-arm64 delete -p existing-network-633531: (2.031038725s)
--- PASS: TestKicExistingNetwork (34.63s)

                                                
                                    
x
+
TestKicCustomSubnet (33.79s)

                                                
                                                
=== RUN   TestKicCustomSubnet
kic_custom_network_test.go:112: (dbg) Run:  out/minikube-linux-arm64 start -p custom-subnet-073528 --subnet=192.168.60.0/24
kic_custom_network_test.go:112: (dbg) Done: out/minikube-linux-arm64 start -p custom-subnet-073528 --subnet=192.168.60.0/24: (31.636452325s)
kic_custom_network_test.go:161: (dbg) Run:  docker network inspect custom-subnet-073528 --format "{{(index .IPAM.Config 0).Subnet}}"
helpers_test.go:175: Cleaning up "custom-subnet-073528" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-arm64 delete -p custom-subnet-073528
helpers_test.go:178: (dbg) Done: out/minikube-linux-arm64 delete -p custom-subnet-073528: (2.13203933s)
--- PASS: TestKicCustomSubnet (33.79s)

                                                
                                    
x
+
TestKicStaticIP (36.57s)

                                                
                                                
=== RUN   TestKicStaticIP
kic_custom_network_test.go:132: (dbg) Run:  out/minikube-linux-arm64 start -p static-ip-416841 --static-ip=192.168.200.200
kic_custom_network_test.go:132: (dbg) Done: out/minikube-linux-arm64 start -p static-ip-416841 --static-ip=192.168.200.200: (34.277710887s)
kic_custom_network_test.go:138: (dbg) Run:  out/minikube-linux-arm64 -p static-ip-416841 ip
helpers_test.go:175: Cleaning up "static-ip-416841" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-arm64 delete -p static-ip-416841
helpers_test.go:178: (dbg) Done: out/minikube-linux-arm64 delete -p static-ip-416841: (2.144273592s)
--- PASS: TestKicStaticIP (36.57s)

                                                
                                    
x
+
TestMainNoArgs (0.05s)

                                                
                                                
=== RUN   TestMainNoArgs
main_test.go:68: (dbg) Run:  out/minikube-linux-arm64
--- PASS: TestMainNoArgs (0.05s)

                                                
                                    
x
+
TestMinikubeProfile (68.49s)

                                                
                                                
=== RUN   TestMinikubeProfile
minikube_profile_test.go:44: (dbg) Run:  out/minikube-linux-arm64 start -p first-835496 --driver=docker  --container-runtime=containerd
E0729 20:40:53.505326  139728 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19339-134334/.minikube/profiles/functional-479263/client.crt: no such file or directory
minikube_profile_test.go:44: (dbg) Done: out/minikube-linux-arm64 start -p first-835496 --driver=docker  --container-runtime=containerd: (30.04420051s)
minikube_profile_test.go:44: (dbg) Run:  out/minikube-linux-arm64 start -p second-838229 --driver=docker  --container-runtime=containerd
minikube_profile_test.go:44: (dbg) Done: out/minikube-linux-arm64 start -p second-838229 --driver=docker  --container-runtime=containerd: (33.041618688s)
minikube_profile_test.go:51: (dbg) Run:  out/minikube-linux-arm64 profile first-835496
minikube_profile_test.go:55: (dbg) Run:  out/minikube-linux-arm64 profile list -ojson
minikube_profile_test.go:51: (dbg) Run:  out/minikube-linux-arm64 profile second-838229
minikube_profile_test.go:55: (dbg) Run:  out/minikube-linux-arm64 profile list -ojson
helpers_test.go:175: Cleaning up "second-838229" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-arm64 delete -p second-838229
helpers_test.go:178: (dbg) Done: out/minikube-linux-arm64 delete -p second-838229: (1.951315395s)
helpers_test.go:175: Cleaning up "first-835496" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-arm64 delete -p first-835496
helpers_test.go:178: (dbg) Done: out/minikube-linux-arm64 delete -p first-835496: (2.228670676s)
--- PASS: TestMinikubeProfile (68.49s)

                                                
                                    
x
+
TestMountStart/serial/StartWithMountFirst (6.43s)

                                                
                                                
=== RUN   TestMountStart/serial/StartWithMountFirst
mount_start_test.go:98: (dbg) Run:  out/minikube-linux-arm64 start -p mount-start-1-599489 --memory=2048 --mount --mount-gid 0 --mount-msize 6543 --mount-port 46464 --mount-uid 0 --no-kubernetes --driver=docker  --container-runtime=containerd
mount_start_test.go:98: (dbg) Done: out/minikube-linux-arm64 start -p mount-start-1-599489 --memory=2048 --mount --mount-gid 0 --mount-msize 6543 --mount-port 46464 --mount-uid 0 --no-kubernetes --driver=docker  --container-runtime=containerd: (5.429961694s)
--- PASS: TestMountStart/serial/StartWithMountFirst (6.43s)

                                                
                                    
x
+
TestMountStart/serial/VerifyMountFirst (0.27s)

                                                
                                                
=== RUN   TestMountStart/serial/VerifyMountFirst
mount_start_test.go:114: (dbg) Run:  out/minikube-linux-arm64 -p mount-start-1-599489 ssh -- ls /minikube-host
--- PASS: TestMountStart/serial/VerifyMountFirst (0.27s)

                                                
                                    
x
+
TestMountStart/serial/StartWithMountSecond (6.53s)

                                                
                                                
=== RUN   TestMountStart/serial/StartWithMountSecond
mount_start_test.go:98: (dbg) Run:  out/minikube-linux-arm64 start -p mount-start-2-612724 --memory=2048 --mount --mount-gid 0 --mount-msize 6543 --mount-port 46465 --mount-uid 0 --no-kubernetes --driver=docker  --container-runtime=containerd
mount_start_test.go:98: (dbg) Done: out/minikube-linux-arm64 start -p mount-start-2-612724 --memory=2048 --mount --mount-gid 0 --mount-msize 6543 --mount-port 46465 --mount-uid 0 --no-kubernetes --driver=docker  --container-runtime=containerd: (5.526767655s)
--- PASS: TestMountStart/serial/StartWithMountSecond (6.53s)

                                                
                                    
x
+
TestMountStart/serial/VerifyMountSecond (0.27s)

                                                
                                                
=== RUN   TestMountStart/serial/VerifyMountSecond
mount_start_test.go:114: (dbg) Run:  out/minikube-linux-arm64 -p mount-start-2-612724 ssh -- ls /minikube-host
--- PASS: TestMountStart/serial/VerifyMountSecond (0.27s)

                                                
                                    
x
+
TestMountStart/serial/DeleteFirst (1.62s)

                                                
                                                
=== RUN   TestMountStart/serial/DeleteFirst
pause_test.go:132: (dbg) Run:  out/minikube-linux-arm64 delete -p mount-start-1-599489 --alsologtostderr -v=5
pause_test.go:132: (dbg) Done: out/minikube-linux-arm64 delete -p mount-start-1-599489 --alsologtostderr -v=5: (1.622977042s)
--- PASS: TestMountStart/serial/DeleteFirst (1.62s)

                                                
                                    
x
+
TestMountStart/serial/VerifyMountPostDelete (0.26s)

                                                
                                                
=== RUN   TestMountStart/serial/VerifyMountPostDelete
mount_start_test.go:114: (dbg) Run:  out/minikube-linux-arm64 -p mount-start-2-612724 ssh -- ls /minikube-host
--- PASS: TestMountStart/serial/VerifyMountPostDelete (0.26s)

                                                
                                    
x
+
TestMountStart/serial/Stop (1.22s)

                                                
                                                
=== RUN   TestMountStart/serial/Stop
mount_start_test.go:155: (dbg) Run:  out/minikube-linux-arm64 stop -p mount-start-2-612724
mount_start_test.go:155: (dbg) Done: out/minikube-linux-arm64 stop -p mount-start-2-612724: (1.220485138s)
--- PASS: TestMountStart/serial/Stop (1.22s)

                                                
                                    
x
+
TestMountStart/serial/RestartStopped (7.78s)

                                                
                                                
=== RUN   TestMountStart/serial/RestartStopped
mount_start_test.go:166: (dbg) Run:  out/minikube-linux-arm64 start -p mount-start-2-612724
E0729 20:41:56.781560  139728 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19339-134334/.minikube/profiles/addons-675434/client.crt: no such file or directory
mount_start_test.go:166: (dbg) Done: out/minikube-linux-arm64 start -p mount-start-2-612724: (6.780237583s)
--- PASS: TestMountStart/serial/RestartStopped (7.78s)

                                                
                                    
x
+
TestMountStart/serial/VerifyMountPostStop (0.25s)

                                                
                                                
=== RUN   TestMountStart/serial/VerifyMountPostStop
mount_start_test.go:114: (dbg) Run:  out/minikube-linux-arm64 -p mount-start-2-612724 ssh -- ls /minikube-host
--- PASS: TestMountStart/serial/VerifyMountPostStop (0.25s)

                                                
                                    
x
+
TestMultiNode/serial/FreshStart2Nodes (77.97s)

                                                
                                                
=== RUN   TestMultiNode/serial/FreshStart2Nodes
multinode_test.go:96: (dbg) Run:  out/minikube-linux-arm64 start -p multinode-157572 --wait=true --memory=2200 --nodes=2 -v=8 --alsologtostderr --driver=docker  --container-runtime=containerd
E0729 20:43:19.829554  139728 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19339-134334/.minikube/profiles/addons-675434/client.crt: no such file or directory
multinode_test.go:96: (dbg) Done: out/minikube-linux-arm64 start -p multinode-157572 --wait=true --memory=2200 --nodes=2 -v=8 --alsologtostderr --driver=docker  --container-runtime=containerd: (1m17.451498433s)
multinode_test.go:102: (dbg) Run:  out/minikube-linux-arm64 -p multinode-157572 status --alsologtostderr
--- PASS: TestMultiNode/serial/FreshStart2Nodes (77.97s)

                                                
                                    
x
+
TestMultiNode/serial/DeployApp2Nodes (18.01s)

                                                
                                                
=== RUN   TestMultiNode/serial/DeployApp2Nodes
multinode_test.go:493: (dbg) Run:  out/minikube-linux-arm64 kubectl -p multinode-157572 -- apply -f ./testdata/multinodes/multinode-pod-dns-test.yaml
multinode_test.go:498: (dbg) Run:  out/minikube-linux-arm64 kubectl -p multinode-157572 -- rollout status deployment/busybox
multinode_test.go:498: (dbg) Done: out/minikube-linux-arm64 kubectl -p multinode-157572 -- rollout status deployment/busybox: (16.191435721s)
multinode_test.go:505: (dbg) Run:  out/minikube-linux-arm64 kubectl -p multinode-157572 -- get pods -o jsonpath='{.items[*].status.podIP}'
multinode_test.go:528: (dbg) Run:  out/minikube-linux-arm64 kubectl -p multinode-157572 -- get pods -o jsonpath='{.items[*].metadata.name}'
multinode_test.go:536: (dbg) Run:  out/minikube-linux-arm64 kubectl -p multinode-157572 -- exec busybox-fc5497c4f-7s5cv -- nslookup kubernetes.io
multinode_test.go:536: (dbg) Run:  out/minikube-linux-arm64 kubectl -p multinode-157572 -- exec busybox-fc5497c4f-cpjjw -- nslookup kubernetes.io
multinode_test.go:546: (dbg) Run:  out/minikube-linux-arm64 kubectl -p multinode-157572 -- exec busybox-fc5497c4f-7s5cv -- nslookup kubernetes.default
multinode_test.go:546: (dbg) Run:  out/minikube-linux-arm64 kubectl -p multinode-157572 -- exec busybox-fc5497c4f-cpjjw -- nslookup kubernetes.default
multinode_test.go:554: (dbg) Run:  out/minikube-linux-arm64 kubectl -p multinode-157572 -- exec busybox-fc5497c4f-7s5cv -- nslookup kubernetes.default.svc.cluster.local
multinode_test.go:554: (dbg) Run:  out/minikube-linux-arm64 kubectl -p multinode-157572 -- exec busybox-fc5497c4f-cpjjw -- nslookup kubernetes.default.svc.cluster.local
--- PASS: TestMultiNode/serial/DeployApp2Nodes (18.01s)

                                                
                                    
x
+
TestMultiNode/serial/PingHostFrom2Pods (1.01s)

                                                
                                                
=== RUN   TestMultiNode/serial/PingHostFrom2Pods
multinode_test.go:564: (dbg) Run:  out/minikube-linux-arm64 kubectl -p multinode-157572 -- get pods -o jsonpath='{.items[*].metadata.name}'
multinode_test.go:572: (dbg) Run:  out/minikube-linux-arm64 kubectl -p multinode-157572 -- exec busybox-fc5497c4f-7s5cv -- sh -c "nslookup host.minikube.internal | awk 'NR==5' | cut -d' ' -f3"
multinode_test.go:583: (dbg) Run:  out/minikube-linux-arm64 kubectl -p multinode-157572 -- exec busybox-fc5497c4f-7s5cv -- sh -c "ping -c 1 192.168.58.1"
multinode_test.go:572: (dbg) Run:  out/minikube-linux-arm64 kubectl -p multinode-157572 -- exec busybox-fc5497c4f-cpjjw -- sh -c "nslookup host.minikube.internal | awk 'NR==5' | cut -d' ' -f3"
multinode_test.go:583: (dbg) Run:  out/minikube-linux-arm64 kubectl -p multinode-157572 -- exec busybox-fc5497c4f-cpjjw -- sh -c "ping -c 1 192.168.58.1"
--- PASS: TestMultiNode/serial/PingHostFrom2Pods (1.01s)

                                                
                                    
x
+
TestMultiNode/serial/AddNode (17.65s)

                                                
                                                
=== RUN   TestMultiNode/serial/AddNode
multinode_test.go:121: (dbg) Run:  out/minikube-linux-arm64 node add -p multinode-157572 -v 3 --alsologtostderr
multinode_test.go:121: (dbg) Done: out/minikube-linux-arm64 node add -p multinode-157572 -v 3 --alsologtostderr: (16.802227274s)
multinode_test.go:127: (dbg) Run:  out/minikube-linux-arm64 -p multinode-157572 status --alsologtostderr
--- PASS: TestMultiNode/serial/AddNode (17.65s)

                                                
                                    
x
+
TestMultiNode/serial/MultiNodeLabels (0.09s)

                                                
                                                
=== RUN   TestMultiNode/serial/MultiNodeLabels
multinode_test.go:221: (dbg) Run:  kubectl --context multinode-157572 get nodes -o "jsonpath=[{range .items[*]}{.metadata.labels},{end}]"
--- PASS: TestMultiNode/serial/MultiNodeLabels (0.09s)

                                                
                                    
x
+
TestMultiNode/serial/ProfileList (0.33s)

                                                
                                                
=== RUN   TestMultiNode/serial/ProfileList
multinode_test.go:143: (dbg) Run:  out/minikube-linux-arm64 profile list --output json
--- PASS: TestMultiNode/serial/ProfileList (0.33s)

                                                
                                    
x
+
TestMultiNode/serial/CopyFile (10.12s)

                                                
                                                
=== RUN   TestMultiNode/serial/CopyFile
multinode_test.go:184: (dbg) Run:  out/minikube-linux-arm64 -p multinode-157572 status --output json --alsologtostderr
helpers_test.go:556: (dbg) Run:  out/minikube-linux-arm64 -p multinode-157572 cp testdata/cp-test.txt multinode-157572:/home/docker/cp-test.txt
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p multinode-157572 ssh -n multinode-157572 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:556: (dbg) Run:  out/minikube-linux-arm64 -p multinode-157572 cp multinode-157572:/home/docker/cp-test.txt /tmp/TestMultiNodeserialCopyFile1232515027/001/cp-test_multinode-157572.txt
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p multinode-157572 ssh -n multinode-157572 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:556: (dbg) Run:  out/minikube-linux-arm64 -p multinode-157572 cp multinode-157572:/home/docker/cp-test.txt multinode-157572-m02:/home/docker/cp-test_multinode-157572_multinode-157572-m02.txt
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p multinode-157572 ssh -n multinode-157572 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p multinode-157572 ssh -n multinode-157572-m02 "sudo cat /home/docker/cp-test_multinode-157572_multinode-157572-m02.txt"
helpers_test.go:556: (dbg) Run:  out/minikube-linux-arm64 -p multinode-157572 cp multinode-157572:/home/docker/cp-test.txt multinode-157572-m03:/home/docker/cp-test_multinode-157572_multinode-157572-m03.txt
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p multinode-157572 ssh -n multinode-157572 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p multinode-157572 ssh -n multinode-157572-m03 "sudo cat /home/docker/cp-test_multinode-157572_multinode-157572-m03.txt"
helpers_test.go:556: (dbg) Run:  out/minikube-linux-arm64 -p multinode-157572 cp testdata/cp-test.txt multinode-157572-m02:/home/docker/cp-test.txt
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p multinode-157572 ssh -n multinode-157572-m02 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:556: (dbg) Run:  out/minikube-linux-arm64 -p multinode-157572 cp multinode-157572-m02:/home/docker/cp-test.txt /tmp/TestMultiNodeserialCopyFile1232515027/001/cp-test_multinode-157572-m02.txt
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p multinode-157572 ssh -n multinode-157572-m02 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:556: (dbg) Run:  out/minikube-linux-arm64 -p multinode-157572 cp multinode-157572-m02:/home/docker/cp-test.txt multinode-157572:/home/docker/cp-test_multinode-157572-m02_multinode-157572.txt
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p multinode-157572 ssh -n multinode-157572-m02 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p multinode-157572 ssh -n multinode-157572 "sudo cat /home/docker/cp-test_multinode-157572-m02_multinode-157572.txt"
helpers_test.go:556: (dbg) Run:  out/minikube-linux-arm64 -p multinode-157572 cp multinode-157572-m02:/home/docker/cp-test.txt multinode-157572-m03:/home/docker/cp-test_multinode-157572-m02_multinode-157572-m03.txt
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p multinode-157572 ssh -n multinode-157572-m02 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p multinode-157572 ssh -n multinode-157572-m03 "sudo cat /home/docker/cp-test_multinode-157572-m02_multinode-157572-m03.txt"
helpers_test.go:556: (dbg) Run:  out/minikube-linux-arm64 -p multinode-157572 cp testdata/cp-test.txt multinode-157572-m03:/home/docker/cp-test.txt
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p multinode-157572 ssh -n multinode-157572-m03 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:556: (dbg) Run:  out/minikube-linux-arm64 -p multinode-157572 cp multinode-157572-m03:/home/docker/cp-test.txt /tmp/TestMultiNodeserialCopyFile1232515027/001/cp-test_multinode-157572-m03.txt
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p multinode-157572 ssh -n multinode-157572-m03 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:556: (dbg) Run:  out/minikube-linux-arm64 -p multinode-157572 cp multinode-157572-m03:/home/docker/cp-test.txt multinode-157572:/home/docker/cp-test_multinode-157572-m03_multinode-157572.txt
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p multinode-157572 ssh -n multinode-157572-m03 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p multinode-157572 ssh -n multinode-157572 "sudo cat /home/docker/cp-test_multinode-157572-m03_multinode-157572.txt"
helpers_test.go:556: (dbg) Run:  out/minikube-linux-arm64 -p multinode-157572 cp multinode-157572-m03:/home/docker/cp-test.txt multinode-157572-m02:/home/docker/cp-test_multinode-157572-m03_multinode-157572-m02.txt
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p multinode-157572 ssh -n multinode-157572-m03 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p multinode-157572 ssh -n multinode-157572-m02 "sudo cat /home/docker/cp-test_multinode-157572-m03_multinode-157572-m02.txt"
--- PASS: TestMultiNode/serial/CopyFile (10.12s)

                                                
                                    
x
+
TestMultiNode/serial/StopNode (2.26s)

                                                
                                                
=== RUN   TestMultiNode/serial/StopNode
multinode_test.go:248: (dbg) Run:  out/minikube-linux-arm64 -p multinode-157572 node stop m03
multinode_test.go:248: (dbg) Done: out/minikube-linux-arm64 -p multinode-157572 node stop m03: (1.223164672s)
multinode_test.go:254: (dbg) Run:  out/minikube-linux-arm64 -p multinode-157572 status
multinode_test.go:254: (dbg) Non-zero exit: out/minikube-linux-arm64 -p multinode-157572 status: exit status 7 (510.140048ms)

                                                
                                                
-- stdout --
	multinode-157572
	type: Control Plane
	host: Running
	kubelet: Running
	apiserver: Running
	kubeconfig: Configured
	
	multinode-157572-m02
	type: Worker
	host: Running
	kubelet: Running
	
	multinode-157572-m03
	type: Worker
	host: Stopped
	kubelet: Stopped
	

                                                
                                                
-- /stdout --
multinode_test.go:261: (dbg) Run:  out/minikube-linux-arm64 -p multinode-157572 status --alsologtostderr
multinode_test.go:261: (dbg) Non-zero exit: out/minikube-linux-arm64 -p multinode-157572 status --alsologtostderr: exit status 7 (521.171163ms)

                                                
                                                
-- stdout --
	multinode-157572
	type: Control Plane
	host: Running
	kubelet: Running
	apiserver: Running
	kubeconfig: Configured
	
	multinode-157572-m02
	type: Worker
	host: Running
	kubelet: Running
	
	multinode-157572-m03
	type: Worker
	host: Stopped
	kubelet: Stopped
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0729 20:44:12.782818  261205 out.go:291] Setting OutFile to fd 1 ...
	I0729 20:44:12.783823  261205 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0729 20:44:12.783838  261205 out.go:304] Setting ErrFile to fd 2...
	I0729 20:44:12.783845  261205 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0729 20:44:12.784196  261205 root.go:338] Updating PATH: /home/jenkins/minikube-integration/19339-134334/.minikube/bin
	I0729 20:44:12.784431  261205 out.go:298] Setting JSON to false
	I0729 20:44:12.784481  261205 mustload.go:65] Loading cluster: multinode-157572
	I0729 20:44:12.784540  261205 notify.go:220] Checking for updates...
	I0729 20:44:12.784915  261205 config.go:182] Loaded profile config "multinode-157572": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.30.3
	I0729 20:44:12.784935  261205 status.go:255] checking status of multinode-157572 ...
	I0729 20:44:12.785813  261205 cli_runner.go:164] Run: docker container inspect multinode-157572 --format={{.State.Status}}
	I0729 20:44:12.807660  261205 status.go:330] multinode-157572 host status = "Running" (err=<nil>)
	I0729 20:44:12.807693  261205 host.go:66] Checking if "multinode-157572" exists ...
	I0729 20:44:12.808007  261205 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" multinode-157572
	I0729 20:44:12.834293  261205 host.go:66] Checking if "multinode-157572" exists ...
	I0729 20:44:12.834590  261205 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
	I0729 20:44:12.834651  261205 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" multinode-157572
	I0729 20:44:12.860666  261205 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:37175 SSHKeyPath:/home/jenkins/minikube-integration/19339-134334/.minikube/machines/multinode-157572/id_rsa Username:docker}
	I0729 20:44:12.953147  261205 ssh_runner.go:195] Run: systemctl --version
	I0729 20:44:12.957139  261205 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
	I0729 20:44:12.968815  261205 cli_runner.go:164] Run: docker system info --format "{{json .}}"
	I0729 20:44:13.033543  261205 info.go:266] docker info: {ID:U5VK:ZNT5:35M3:FHLW:Q7TL:ELFX:BNAG:AV4T:UD2H:SK5L:SEJV:SJJL Containers:3 ContainersRunning:2 ContainersPaused:0 ContainersStopped:1 Images:3 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:41 OomKillDisable:true NGoroutines:61 SystemTime:2024-07-29 20:44:13.023210178 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1065-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Architecture:aar
ch64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8214900736 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-29-130 Labels:[] ExperimentalBuild:false ServerVersion:27.1.1 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:2bf793ef6dc9a18e00cb12efb64355c2c9d5eb41 Expected:2bf793ef6dc9a18e00cb12efb64355c2c9d5eb41} RuncCommit:{ID:v1.1.13-0-g58aa920 Expected:v1.1.13-0-g58aa920} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:<nil> ServerErro
rs:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.16.1] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.29.1]] Warnings:<nil>}}
	I0729 20:44:13.034131  261205 kubeconfig.go:125] found "multinode-157572" server: "https://192.168.58.2:8443"
	I0729 20:44:13.034164  261205 api_server.go:166] Checking apiserver status ...
	I0729 20:44:13.034218  261205 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0729 20:44:13.046125  261205 ssh_runner.go:195] Run: sudo egrep ^[0-9]+:freezer: /proc/1495/cgroup
	I0729 20:44:13.055349  261205 api_server.go:182] apiserver freezer: "2:freezer:/docker/4898bfa7d32646f8827040ac5142ce46cb73fc9b999b9dc1b1bb8b32cdf306ad/kubepods/burstable/pode81f2e070f3de94ec731bf05908084b4/68553805c7d5c324027826112bb206f8412158167be0b81c0dbb30906b12b65b"
	I0729 20:44:13.055420  261205 ssh_runner.go:195] Run: sudo cat /sys/fs/cgroup/freezer/docker/4898bfa7d32646f8827040ac5142ce46cb73fc9b999b9dc1b1bb8b32cdf306ad/kubepods/burstable/pode81f2e070f3de94ec731bf05908084b4/68553805c7d5c324027826112bb206f8412158167be0b81c0dbb30906b12b65b/freezer.state
	I0729 20:44:13.063909  261205 api_server.go:204] freezer state: "THAWED"
	I0729 20:44:13.063947  261205 api_server.go:253] Checking apiserver healthz at https://192.168.58.2:8443/healthz ...
	I0729 20:44:13.071913  261205 api_server.go:279] https://192.168.58.2:8443/healthz returned 200:
	ok
	I0729 20:44:13.071943  261205 status.go:422] multinode-157572 apiserver status = Running (err=<nil>)
	I0729 20:44:13.072038  261205 status.go:257] multinode-157572 status: &{Name:multinode-157572 Host:Running Kubelet:Running APIServer:Running Kubeconfig:Configured Worker:false TimeToStop: DockerEnv: PodManEnv:}
	I0729 20:44:13.072064  261205 status.go:255] checking status of multinode-157572-m02 ...
	I0729 20:44:13.072379  261205 cli_runner.go:164] Run: docker container inspect multinode-157572-m02 --format={{.State.Status}}
	I0729 20:44:13.088943  261205 status.go:330] multinode-157572-m02 host status = "Running" (err=<nil>)
	I0729 20:44:13.088967  261205 host.go:66] Checking if "multinode-157572-m02" exists ...
	I0729 20:44:13.089256  261205 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" multinode-157572-m02
	I0729 20:44:13.105960  261205 host.go:66] Checking if "multinode-157572-m02" exists ...
	I0729 20:44:13.106266  261205 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
	I0729 20:44:13.106357  261205 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" multinode-157572-m02
	I0729 20:44:13.122882  261205 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:37180 SSHKeyPath:/home/jenkins/minikube-integration/19339-134334/.minikube/machines/multinode-157572-m02/id_rsa Username:docker}
	I0729 20:44:13.213567  261205 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
	I0729 20:44:13.225727  261205 status.go:257] multinode-157572-m02 status: &{Name:multinode-157572-m02 Host:Running Kubelet:Running APIServer:Irrelevant Kubeconfig:Irrelevant Worker:true TimeToStop: DockerEnv: PodManEnv:}
	I0729 20:44:13.225762  261205 status.go:255] checking status of multinode-157572-m03 ...
	I0729 20:44:13.226097  261205 cli_runner.go:164] Run: docker container inspect multinode-157572-m03 --format={{.State.Status}}
	I0729 20:44:13.242933  261205 status.go:330] multinode-157572-m03 host status = "Stopped" (err=<nil>)
	I0729 20:44:13.242965  261205 status.go:343] host is not running, skipping remaining checks
	I0729 20:44:13.242973  261205 status.go:257] multinode-157572-m03 status: &{Name:multinode-157572-m03 Host:Stopped Kubelet:Stopped APIServer:Stopped Kubeconfig:Stopped Worker:true TimeToStop: DockerEnv: PodManEnv:}

                                                
                                                
** /stderr **
--- PASS: TestMultiNode/serial/StopNode (2.26s)

                                                
                                    
x
+
TestMultiNode/serial/StartAfterStop (9.79s)

                                                
                                                
=== RUN   TestMultiNode/serial/StartAfterStop
multinode_test.go:282: (dbg) Run:  out/minikube-linux-arm64 -p multinode-157572 node start m03 -v=7 --alsologtostderr
multinode_test.go:282: (dbg) Done: out/minikube-linux-arm64 -p multinode-157572 node start m03 -v=7 --alsologtostderr: (9.020151115s)
multinode_test.go:290: (dbg) Run:  out/minikube-linux-arm64 -p multinode-157572 status -v=7 --alsologtostderr
multinode_test.go:306: (dbg) Run:  kubectl get nodes
--- PASS: TestMultiNode/serial/StartAfterStop (9.79s)

                                                
                                    
x
+
TestMultiNode/serial/RestartKeepsNodes (87.17s)

                                                
                                                
=== RUN   TestMultiNode/serial/RestartKeepsNodes
multinode_test.go:314: (dbg) Run:  out/minikube-linux-arm64 node list -p multinode-157572
multinode_test.go:321: (dbg) Run:  out/minikube-linux-arm64 stop -p multinode-157572
multinode_test.go:321: (dbg) Done: out/minikube-linux-arm64 stop -p multinode-157572: (24.957019607s)
multinode_test.go:326: (dbg) Run:  out/minikube-linux-arm64 start -p multinode-157572 --wait=true -v=8 --alsologtostderr
multinode_test.go:326: (dbg) Done: out/minikube-linux-arm64 start -p multinode-157572 --wait=true -v=8 --alsologtostderr: (1m2.080831141s)
multinode_test.go:331: (dbg) Run:  out/minikube-linux-arm64 node list -p multinode-157572
--- PASS: TestMultiNode/serial/RestartKeepsNodes (87.17s)

                                                
                                    
x
+
TestMultiNode/serial/DeleteNode (5.54s)

                                                
                                                
=== RUN   TestMultiNode/serial/DeleteNode
multinode_test.go:416: (dbg) Run:  out/minikube-linux-arm64 -p multinode-157572 node delete m03
E0729 20:45:53.505353  139728 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19339-134334/.minikube/profiles/functional-479263/client.crt: no such file or directory
multinode_test.go:416: (dbg) Done: out/minikube-linux-arm64 -p multinode-157572 node delete m03: (4.783236237s)
multinode_test.go:422: (dbg) Run:  out/minikube-linux-arm64 -p multinode-157572 status --alsologtostderr
multinode_test.go:436: (dbg) Run:  kubectl get nodes
multinode_test.go:444: (dbg) Run:  kubectl get nodes -o "go-template='{{range .items}}{{range .status.conditions}}{{if eq .type "Ready"}} {{.status}}{{"\n"}}{{end}}{{end}}{{end}}'"
--- PASS: TestMultiNode/serial/DeleteNode (5.54s)

                                                
                                    
x
+
TestMultiNode/serial/StopMultiNode (24.01s)

                                                
                                                
=== RUN   TestMultiNode/serial/StopMultiNode
multinode_test.go:345: (dbg) Run:  out/minikube-linux-arm64 -p multinode-157572 stop
multinode_test.go:345: (dbg) Done: out/minikube-linux-arm64 -p multinode-157572 stop: (23.811570953s)
multinode_test.go:351: (dbg) Run:  out/minikube-linux-arm64 -p multinode-157572 status
multinode_test.go:351: (dbg) Non-zero exit: out/minikube-linux-arm64 -p multinode-157572 status: exit status 7 (102.352114ms)

                                                
                                                
-- stdout --
	multinode-157572
	type: Control Plane
	host: Stopped
	kubelet: Stopped
	apiserver: Stopped
	kubeconfig: Stopped
	
	multinode-157572-m02
	type: Worker
	host: Stopped
	kubelet: Stopped
	

                                                
                                                
-- /stdout --
multinode_test.go:358: (dbg) Run:  out/minikube-linux-arm64 -p multinode-157572 status --alsologtostderr
multinode_test.go:358: (dbg) Non-zero exit: out/minikube-linux-arm64 -p multinode-157572 status --alsologtostderr: exit status 7 (100.334188ms)

                                                
                                                
-- stdout --
	multinode-157572
	type: Control Plane
	host: Stopped
	kubelet: Stopped
	apiserver: Stopped
	kubeconfig: Stopped
	
	multinode-157572-m02
	type: Worker
	host: Stopped
	kubelet: Stopped
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0729 20:46:19.711151  269220 out.go:291] Setting OutFile to fd 1 ...
	I0729 20:46:19.711450  269220 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0729 20:46:19.711464  269220 out.go:304] Setting ErrFile to fd 2...
	I0729 20:46:19.711473  269220 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0729 20:46:19.711720  269220 root.go:338] Updating PATH: /home/jenkins/minikube-integration/19339-134334/.minikube/bin
	I0729 20:46:19.711917  269220 out.go:298] Setting JSON to false
	I0729 20:46:19.711990  269220 mustload.go:65] Loading cluster: multinode-157572
	I0729 20:46:19.712027  269220 notify.go:220] Checking for updates...
	I0729 20:46:19.712423  269220 config.go:182] Loaded profile config "multinode-157572": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.30.3
	I0729 20:46:19.712435  269220 status.go:255] checking status of multinode-157572 ...
	I0729 20:46:19.712974  269220 cli_runner.go:164] Run: docker container inspect multinode-157572 --format={{.State.Status}}
	I0729 20:46:19.731748  269220 status.go:330] multinode-157572 host status = "Stopped" (err=<nil>)
	I0729 20:46:19.731771  269220 status.go:343] host is not running, skipping remaining checks
	I0729 20:46:19.731779  269220 status.go:257] multinode-157572 status: &{Name:multinode-157572 Host:Stopped Kubelet:Stopped APIServer:Stopped Kubeconfig:Stopped Worker:false TimeToStop: DockerEnv: PodManEnv:}
	I0729 20:46:19.731816  269220 status.go:255] checking status of multinode-157572-m02 ...
	I0729 20:46:19.732164  269220 cli_runner.go:164] Run: docker container inspect multinode-157572-m02 --format={{.State.Status}}
	I0729 20:46:19.762013  269220 status.go:330] multinode-157572-m02 host status = "Stopped" (err=<nil>)
	I0729 20:46:19.762048  269220 status.go:343] host is not running, skipping remaining checks
	I0729 20:46:19.762057  269220 status.go:257] multinode-157572-m02 status: &{Name:multinode-157572-m02 Host:Stopped Kubelet:Stopped APIServer:Stopped Kubeconfig:Stopped Worker:true TimeToStop: DockerEnv: PodManEnv:}

                                                
                                                
** /stderr **
--- PASS: TestMultiNode/serial/StopMultiNode (24.01s)

                                                
                                    
x
+
TestMultiNode/serial/RestartMultiNode (56.43s)

                                                
                                                
=== RUN   TestMultiNode/serial/RestartMultiNode
multinode_test.go:376: (dbg) Run:  out/minikube-linux-arm64 start -p multinode-157572 --wait=true -v=8 --alsologtostderr --driver=docker  --container-runtime=containerd
E0729 20:46:56.781387  139728 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19339-134334/.minikube/profiles/addons-675434/client.crt: no such file or directory
multinode_test.go:376: (dbg) Done: out/minikube-linux-arm64 start -p multinode-157572 --wait=true -v=8 --alsologtostderr --driver=docker  --container-runtime=containerd: (55.739989497s)
multinode_test.go:382: (dbg) Run:  out/minikube-linux-arm64 -p multinode-157572 status --alsologtostderr
multinode_test.go:396: (dbg) Run:  kubectl get nodes
multinode_test.go:404: (dbg) Run:  kubectl get nodes -o "go-template='{{range .items}}{{range .status.conditions}}{{if eq .type "Ready"}} {{.status}}{{"\n"}}{{end}}{{end}}{{end}}'"
--- PASS: TestMultiNode/serial/RestartMultiNode (56.43s)

                                                
                                    
x
+
TestMultiNode/serial/ValidateNameConflict (31.92s)

                                                
                                                
=== RUN   TestMultiNode/serial/ValidateNameConflict
multinode_test.go:455: (dbg) Run:  out/minikube-linux-arm64 node list -p multinode-157572
multinode_test.go:464: (dbg) Run:  out/minikube-linux-arm64 start -p multinode-157572-m02 --driver=docker  --container-runtime=containerd
multinode_test.go:464: (dbg) Non-zero exit: out/minikube-linux-arm64 start -p multinode-157572-m02 --driver=docker  --container-runtime=containerd: exit status 14 (79.444789ms)

                                                
                                                
-- stdout --
	* [multinode-157572-m02] minikube v1.33.1 on Ubuntu 20.04 (arm64)
	  - MINIKUBE_LOCATION=19339
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - KUBECONFIG=/home/jenkins/minikube-integration/19339-134334/kubeconfig
	  - MINIKUBE_HOME=/home/jenkins/minikube-integration/19339-134334/.minikube
	  - MINIKUBE_BIN=out/minikube-linux-arm64
	  - MINIKUBE_FORCE_SYSTEMD=
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	! Profile name 'multinode-157572-m02' is duplicated with machine name 'multinode-157572-m02' in profile 'multinode-157572'
	X Exiting due to MK_USAGE: Profile name should be unique

                                                
                                                
** /stderr **
multinode_test.go:472: (dbg) Run:  out/minikube-linux-arm64 start -p multinode-157572-m03 --driver=docker  --container-runtime=containerd
E0729 20:47:16.549340  139728 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19339-134334/.minikube/profiles/functional-479263/client.crt: no such file or directory
multinode_test.go:472: (dbg) Done: out/minikube-linux-arm64 start -p multinode-157572-m03 --driver=docker  --container-runtime=containerd: (29.422478747s)
multinode_test.go:479: (dbg) Run:  out/minikube-linux-arm64 node add -p multinode-157572
multinode_test.go:479: (dbg) Non-zero exit: out/minikube-linux-arm64 node add -p multinode-157572: exit status 80 (330.118853ms)

                                                
                                                
-- stdout --
	* Adding node m03 to cluster multinode-157572 as [worker]
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	X Exiting due to GUEST_NODE_ADD: failed to add node: Node multinode-157572-m03 already exists in multinode-157572-m03 profile
	* 
	╭─────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                             │
	│    * If the above advice does not help, please let us know:                                 │
	│      https://github.com/kubernetes/minikube/issues/new/choose                               │
	│                                                                                             │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │
	│    * Please also attach the following file to the GitHub issue:                             │
	│    * - /tmp/minikube_node_040ea7097fd6ed71e65be9a474587f81f0ccd21d_3.log                    │
	│                                                                                             │
	╰─────────────────────────────────────────────────────────────────────────────────────────────╯

                                                
                                                
** /stderr **
multinode_test.go:484: (dbg) Run:  out/minikube-linux-arm64 delete -p multinode-157572-m03
multinode_test.go:484: (dbg) Done: out/minikube-linux-arm64 delete -p multinode-157572-m03: (2.035027919s)
--- PASS: TestMultiNode/serial/ValidateNameConflict (31.92s)

                                                
                                    
x
+
TestPreload (108.18s)

                                                
                                                
=== RUN   TestPreload
preload_test.go:44: (dbg) Run:  out/minikube-linux-arm64 start -p test-preload-449680 --memory=2200 --alsologtostderr --wait=true --preload=false --driver=docker  --container-runtime=containerd --kubernetes-version=v1.24.4
preload_test.go:44: (dbg) Done: out/minikube-linux-arm64 start -p test-preload-449680 --memory=2200 --alsologtostderr --wait=true --preload=false --driver=docker  --container-runtime=containerd --kubernetes-version=v1.24.4: (1m11.932798135s)
preload_test.go:52: (dbg) Run:  out/minikube-linux-arm64 -p test-preload-449680 image pull gcr.io/k8s-minikube/busybox
preload_test.go:52: (dbg) Done: out/minikube-linux-arm64 -p test-preload-449680 image pull gcr.io/k8s-minikube/busybox: (1.223332406s)
preload_test.go:58: (dbg) Run:  out/minikube-linux-arm64 stop -p test-preload-449680
preload_test.go:58: (dbg) Done: out/minikube-linux-arm64 stop -p test-preload-449680: (12.032337159s)
preload_test.go:66: (dbg) Run:  out/minikube-linux-arm64 start -p test-preload-449680 --memory=2200 --alsologtostderr -v=1 --wait=true --driver=docker  --container-runtime=containerd
preload_test.go:66: (dbg) Done: out/minikube-linux-arm64 start -p test-preload-449680 --memory=2200 --alsologtostderr -v=1 --wait=true --driver=docker  --container-runtime=containerd: (20.290485197s)
preload_test.go:71: (dbg) Run:  out/minikube-linux-arm64 -p test-preload-449680 image list
helpers_test.go:175: Cleaning up "test-preload-449680" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-arm64 delete -p test-preload-449680
helpers_test.go:178: (dbg) Done: out/minikube-linux-arm64 delete -p test-preload-449680: (2.432849613s)
--- PASS: TestPreload (108.18s)

                                                
                                    
x
+
TestScheduledStopUnix (104.83s)

                                                
                                                
=== RUN   TestScheduledStopUnix
scheduled_stop_test.go:128: (dbg) Run:  out/minikube-linux-arm64 start -p scheduled-stop-342685 --memory=2048 --driver=docker  --container-runtime=containerd
scheduled_stop_test.go:128: (dbg) Done: out/minikube-linux-arm64 start -p scheduled-stop-342685 --memory=2048 --driver=docker  --container-runtime=containerd: (28.694133584s)
scheduled_stop_test.go:137: (dbg) Run:  out/minikube-linux-arm64 stop -p scheduled-stop-342685 --schedule 5m
scheduled_stop_test.go:191: (dbg) Run:  out/minikube-linux-arm64 status --format={{.TimeToStop}} -p scheduled-stop-342685 -n scheduled-stop-342685
scheduled_stop_test.go:169: signal error was:  <nil>
scheduled_stop_test.go:137: (dbg) Run:  out/minikube-linux-arm64 stop -p scheduled-stop-342685 --schedule 15s
scheduled_stop_test.go:169: signal error was:  os: process already finished
scheduled_stop_test.go:137: (dbg) Run:  out/minikube-linux-arm64 stop -p scheduled-stop-342685 --cancel-scheduled
scheduled_stop_test.go:176: (dbg) Run:  out/minikube-linux-arm64 status --format={{.Host}} -p scheduled-stop-342685 -n scheduled-stop-342685
scheduled_stop_test.go:205: (dbg) Run:  out/minikube-linux-arm64 status -p scheduled-stop-342685
scheduled_stop_test.go:137: (dbg) Run:  out/minikube-linux-arm64 stop -p scheduled-stop-342685 --schedule 15s
scheduled_stop_test.go:169: signal error was:  os: process already finished
E0729 20:50:53.505911  139728 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19339-134334/.minikube/profiles/functional-479263/client.crt: no such file or directory
scheduled_stop_test.go:205: (dbg) Run:  out/minikube-linux-arm64 status -p scheduled-stop-342685
scheduled_stop_test.go:205: (dbg) Non-zero exit: out/minikube-linux-arm64 status -p scheduled-stop-342685: exit status 7 (63.07235ms)

                                                
                                                
-- stdout --
	scheduled-stop-342685
	type: Control Plane
	host: Stopped
	kubelet: Stopped
	apiserver: Stopped
	kubeconfig: Stopped
	

                                                
                                                
-- /stdout --
scheduled_stop_test.go:176: (dbg) Run:  out/minikube-linux-arm64 status --format={{.Host}} -p scheduled-stop-342685 -n scheduled-stop-342685
scheduled_stop_test.go:176: (dbg) Non-zero exit: out/minikube-linux-arm64 status --format={{.Host}} -p scheduled-stop-342685 -n scheduled-stop-342685: exit status 7 (65.639613ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
scheduled_stop_test.go:176: status error: exit status 7 (may be ok)
helpers_test.go:175: Cleaning up "scheduled-stop-342685" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-arm64 delete -p scheduled-stop-342685
helpers_test.go:178: (dbg) Done: out/minikube-linux-arm64 delete -p scheduled-stop-342685: (4.60197117s)
--- PASS: TestScheduledStopUnix (104.83s)

                                                
                                    
x
+
TestInsufficientStorage (11.24s)

                                                
                                                
=== RUN   TestInsufficientStorage
status_test.go:50: (dbg) Run:  out/minikube-linux-arm64 start -p insufficient-storage-123251 --memory=2048 --output=json --wait=true --driver=docker  --container-runtime=containerd
status_test.go:50: (dbg) Non-zero exit: out/minikube-linux-arm64 start -p insufficient-storage-123251 --memory=2048 --output=json --wait=true --driver=docker  --container-runtime=containerd: exit status 26 (8.74094166s)

                                                
                                                
-- stdout --
	{"specversion":"1.0","id":"29e13374-ebc2-46ea-98db-c65c3441fb83","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.step","datacontenttype":"application/json","data":{"currentstep":"0","message":"[insufficient-storage-123251] minikube v1.33.1 on Ubuntu 20.04 (arm64)","name":"Initial Minikube Setup","totalsteps":"19"}}
	{"specversion":"1.0","id":"ce8f3ef2-3c2e-4409-8a0b-fda345ddba63","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_LOCATION=19339"}}
	{"specversion":"1.0","id":"aac2d587-1191-4669-8462-ea827963fe73","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true"}}
	{"specversion":"1.0","id":"aa2e075b-61e2-4e10-a727-9856ea6f32c9","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"KUBECONFIG=/home/jenkins/minikube-integration/19339-134334/kubeconfig"}}
	{"specversion":"1.0","id":"dd1fbc53-0480-4ab1-8865-6e5d162f13d5","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_HOME=/home/jenkins/minikube-integration/19339-134334/.minikube"}}
	{"specversion":"1.0","id":"15a47b9d-ad28-4897-83c5-eeae1459d271","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_BIN=out/minikube-linux-arm64"}}
	{"specversion":"1.0","id":"0bbb992b-525f-4006-b1a8-887486012bee","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_FORCE_SYSTEMD="}}
	{"specversion":"1.0","id":"4743f561-1acd-4394-a5d2-eb8b8b614922","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_TEST_STORAGE_CAPACITY=100"}}
	{"specversion":"1.0","id":"3f4a9389-544b-476f-be01-cdf4774cba87","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_TEST_AVAILABLE_STORAGE=19"}}
	{"specversion":"1.0","id":"ab295d36-ba50-4cd3-b2ec-bb29d32da3aa","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.step","datacontenttype":"application/json","data":{"currentstep":"1","message":"Using the docker driver based on user configuration","name":"Selecting Driver","totalsteps":"19"}}
	{"specversion":"1.0","id":"3990ff22-2c63-46ca-9008-b9d96adc31be","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"Using Docker driver with root privileges"}}
	{"specversion":"1.0","id":"57bd491e-c5a1-456a-bfcc-e6823161f7fd","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.step","datacontenttype":"application/json","data":{"currentstep":"3","message":"Starting \"insufficient-storage-123251\" primary control-plane node in \"insufficient-storage-123251\" cluster","name":"Starting Node","totalsteps":"19"}}
	{"specversion":"1.0","id":"b63bf70a-7739-4083-ac6d-f645972f0aa1","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.step","datacontenttype":"application/json","data":{"currentstep":"5","message":"Pulling base image v0.0.44-1721902582-19326 ...","name":"Pulling Base Image","totalsteps":"19"}}
	{"specversion":"1.0","id":"e15af5be-8b79-4426-b962-d3c0228ed7e5","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.step","datacontenttype":"application/json","data":{"currentstep":"8","message":"Creating docker container (CPUs=2, Memory=2048MB) ...","name":"Creating Container","totalsteps":"19"}}
	{"specversion":"1.0","id":"4a206281-1982-4ac9-87fb-535bfaddb589","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.error","datacontenttype":"application/json","data":{"advice":"Try one or more of the following to free up space on the device:\n\t\n\t\t\t1. Run \"docker system prune\" to remove unused Docker data (optionally with \"-a\")\n\t\t\t2. Increase the storage allocated to Docker for Desktop by clicking on:\n\t\t\t\tDocker icon \u003e Preferences \u003e Resources \u003e Disk Image Size\n\t\t\t3. Run \"minikube ssh -- docker system prune\" if using the Docker container runtime","exitcode":"26","issues":"https://github.com/kubernetes/minikube/issues/9024","message":"Docker is out of disk space! (/var is at 100%% of capacity). You can pass '--force' to skip this check.","name":"RSRC_DOCKER_STORAGE","url":""}}

                                                
                                                
-- /stdout --
status_test.go:76: (dbg) Run:  out/minikube-linux-arm64 status -p insufficient-storage-123251 --output=json --layout=cluster
status_test.go:76: (dbg) Non-zero exit: out/minikube-linux-arm64 status -p insufficient-storage-123251 --output=json --layout=cluster: exit status 7 (291.581236ms)

                                                
                                                
-- stdout --
	{"Name":"insufficient-storage-123251","StatusCode":507,"StatusName":"InsufficientStorage","StatusDetail":"/var is almost out of disk space","Step":"Creating Container","StepDetail":"Creating docker container (CPUs=2, Memory=2048MB) ...","BinaryVersion":"v1.33.1","Components":{"kubeconfig":{"Name":"kubeconfig","StatusCode":500,"StatusName":"Error"}},"Nodes":[{"Name":"insufficient-storage-123251","StatusCode":507,"StatusName":"InsufficientStorage","Components":{"apiserver":{"Name":"apiserver","StatusCode":405,"StatusName":"Stopped"},"kubelet":{"Name":"kubelet","StatusCode":405,"StatusName":"Stopped"}}}]}

                                                
                                                
-- /stdout --
** stderr ** 
	E0729 20:51:34.154521  287857 status.go:417] kubeconfig endpoint: get endpoint: "insufficient-storage-123251" does not appear in /home/jenkins/minikube-integration/19339-134334/kubeconfig

                                                
                                                
** /stderr **
status_test.go:76: (dbg) Run:  out/minikube-linux-arm64 status -p insufficient-storage-123251 --output=json --layout=cluster
status_test.go:76: (dbg) Non-zero exit: out/minikube-linux-arm64 status -p insufficient-storage-123251 --output=json --layout=cluster: exit status 7 (271.353615ms)

                                                
                                                
-- stdout --
	{"Name":"insufficient-storage-123251","StatusCode":507,"StatusName":"InsufficientStorage","StatusDetail":"/var is almost out of disk space","BinaryVersion":"v1.33.1","Components":{"kubeconfig":{"Name":"kubeconfig","StatusCode":500,"StatusName":"Error"}},"Nodes":[{"Name":"insufficient-storage-123251","StatusCode":507,"StatusName":"InsufficientStorage","Components":{"apiserver":{"Name":"apiserver","StatusCode":405,"StatusName":"Stopped"},"kubelet":{"Name":"kubelet","StatusCode":405,"StatusName":"Stopped"}}}]}

                                                
                                                
-- /stdout --
** stderr ** 
	E0729 20:51:34.426638  287919 status.go:417] kubeconfig endpoint: get endpoint: "insufficient-storage-123251" does not appear in /home/jenkins/minikube-integration/19339-134334/kubeconfig
	E0729 20:51:34.436599  287919 status.go:560] unable to read event log: stat: stat /home/jenkins/minikube-integration/19339-134334/.minikube/profiles/insufficient-storage-123251/events.json: no such file or directory

                                                
                                                
** /stderr **
helpers_test.go:175: Cleaning up "insufficient-storage-123251" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-arm64 delete -p insufficient-storage-123251
helpers_test.go:178: (dbg) Done: out/minikube-linux-arm64 delete -p insufficient-storage-123251: (1.933757549s)
--- PASS: TestInsufficientStorage (11.24s)

                                                
                                    
x
+
TestRunningBinaryUpgrade (82.58s)

                                                
                                                
=== RUN   TestRunningBinaryUpgrade
=== PAUSE TestRunningBinaryUpgrade

                                                
                                                

                                                
                                                
=== CONT  TestRunningBinaryUpgrade
version_upgrade_test.go:120: (dbg) Run:  /tmp/minikube-v1.26.0.1617606289 start -p running-upgrade-050656 --memory=2200 --vm-driver=docker  --container-runtime=containerd
E0729 20:56:56.781153  139728 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19339-134334/.minikube/profiles/addons-675434/client.crt: no such file or directory
version_upgrade_test.go:120: (dbg) Done: /tmp/minikube-v1.26.0.1617606289 start -p running-upgrade-050656 --memory=2200 --vm-driver=docker  --container-runtime=containerd: (43.381633439s)
version_upgrade_test.go:130: (dbg) Run:  out/minikube-linux-arm64 start -p running-upgrade-050656 --memory=2200 --alsologtostderr -v=1 --driver=docker  --container-runtime=containerd
version_upgrade_test.go:130: (dbg) Done: out/minikube-linux-arm64 start -p running-upgrade-050656 --memory=2200 --alsologtostderr -v=1 --driver=docker  --container-runtime=containerd: (35.392438316s)
helpers_test.go:175: Cleaning up "running-upgrade-050656" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-arm64 delete -p running-upgrade-050656
helpers_test.go:178: (dbg) Done: out/minikube-linux-arm64 delete -p running-upgrade-050656: (2.732928103s)
--- PASS: TestRunningBinaryUpgrade (82.58s)

                                                
                                    
x
+
TestKubernetesUpgrade (346.41s)

                                                
                                                
=== RUN   TestKubernetesUpgrade
=== PAUSE TestKubernetesUpgrade

                                                
                                                

                                                
                                                
=== CONT  TestKubernetesUpgrade
version_upgrade_test.go:222: (dbg) Run:  out/minikube-linux-arm64 start -p kubernetes-upgrade-655083 --memory=2200 --kubernetes-version=v1.20.0 --alsologtostderr -v=1 --driver=docker  --container-runtime=containerd
version_upgrade_test.go:222: (dbg) Done: out/minikube-linux-arm64 start -p kubernetes-upgrade-655083 --memory=2200 --kubernetes-version=v1.20.0 --alsologtostderr -v=1 --driver=docker  --container-runtime=containerd: (56.588958562s)
version_upgrade_test.go:227: (dbg) Run:  out/minikube-linux-arm64 stop -p kubernetes-upgrade-655083
version_upgrade_test.go:227: (dbg) Done: out/minikube-linux-arm64 stop -p kubernetes-upgrade-655083: (1.311499846s)
version_upgrade_test.go:232: (dbg) Run:  out/minikube-linux-arm64 -p kubernetes-upgrade-655083 status --format={{.Host}}
version_upgrade_test.go:232: (dbg) Non-zero exit: out/minikube-linux-arm64 -p kubernetes-upgrade-655083 status --format={{.Host}}: exit status 7 (133.163813ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
version_upgrade_test.go:234: status error: exit status 7 (may be ok)
version_upgrade_test.go:243: (dbg) Run:  out/minikube-linux-arm64 start -p kubernetes-upgrade-655083 --memory=2200 --kubernetes-version=v1.31.0-beta.0 --alsologtostderr -v=1 --driver=docker  --container-runtime=containerd
version_upgrade_test.go:243: (dbg) Done: out/minikube-linux-arm64 start -p kubernetes-upgrade-655083 --memory=2200 --kubernetes-version=v1.31.0-beta.0 --alsologtostderr -v=1 --driver=docker  --container-runtime=containerd: (4m39.305021354s)
version_upgrade_test.go:248: (dbg) Run:  kubectl --context kubernetes-upgrade-655083 version --output=json
version_upgrade_test.go:267: Attempting to downgrade Kubernetes (should fail)
version_upgrade_test.go:269: (dbg) Run:  out/minikube-linux-arm64 start -p kubernetes-upgrade-655083 --memory=2200 --kubernetes-version=v1.20.0 --driver=docker  --container-runtime=containerd
version_upgrade_test.go:269: (dbg) Non-zero exit: out/minikube-linux-arm64 start -p kubernetes-upgrade-655083 --memory=2200 --kubernetes-version=v1.20.0 --driver=docker  --container-runtime=containerd: exit status 106 (83.713226ms)

                                                
                                                
-- stdout --
	* [kubernetes-upgrade-655083] minikube v1.33.1 on Ubuntu 20.04 (arm64)
	  - MINIKUBE_LOCATION=19339
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - KUBECONFIG=/home/jenkins/minikube-integration/19339-134334/kubeconfig
	  - MINIKUBE_HOME=/home/jenkins/minikube-integration/19339-134334/.minikube
	  - MINIKUBE_BIN=out/minikube-linux-arm64
	  - MINIKUBE_FORCE_SYSTEMD=
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	X Exiting due to K8S_DOWNGRADE_UNSUPPORTED: Unable to safely downgrade existing Kubernetes v1.31.0-beta.0 cluster to v1.20.0
	* Suggestion: 
	
	    1) Recreate the cluster with Kubernetes 1.20.0, by running:
	    
	    minikube delete -p kubernetes-upgrade-655083
	    minikube start -p kubernetes-upgrade-655083 --kubernetes-version=v1.20.0
	    
	    2) Create a second cluster with Kubernetes 1.20.0, by running:
	    
	    minikube start -p kubernetes-upgrade-6550832 --kubernetes-version=v1.20.0
	    
	    3) Use the existing cluster at version Kubernetes 1.31.0-beta.0, by running:
	    
	    minikube start -p kubernetes-upgrade-655083 --kubernetes-version=v1.31.0-beta.0
	    

                                                
                                                
** /stderr **
version_upgrade_test.go:273: Attempting restart after unsuccessful downgrade
version_upgrade_test.go:275: (dbg) Run:  out/minikube-linux-arm64 start -p kubernetes-upgrade-655083 --memory=2200 --kubernetes-version=v1.31.0-beta.0 --alsologtostderr -v=1 --driver=docker  --container-runtime=containerd
version_upgrade_test.go:275: (dbg) Done: out/minikube-linux-arm64 start -p kubernetes-upgrade-655083 --memory=2200 --kubernetes-version=v1.31.0-beta.0 --alsologtostderr -v=1 --driver=docker  --container-runtime=containerd: (6.642094312s)
helpers_test.go:175: Cleaning up "kubernetes-upgrade-655083" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-arm64 delete -p kubernetes-upgrade-655083
helpers_test.go:178: (dbg) Done: out/minikube-linux-arm64 delete -p kubernetes-upgrade-655083: (2.191862778s)
--- PASS: TestKubernetesUpgrade (346.41s)

                                                
                                    
x
+
TestMissingContainerUpgrade (172.25s)

                                                
                                                
=== RUN   TestMissingContainerUpgrade
=== PAUSE TestMissingContainerUpgrade

                                                
                                                

                                                
                                                
=== CONT  TestMissingContainerUpgrade
version_upgrade_test.go:309: (dbg) Run:  /tmp/minikube-v1.26.0.3182414906 start -p missing-upgrade-682352 --memory=2200 --driver=docker  --container-runtime=containerd
E0729 20:51:56.781690  139728 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19339-134334/.minikube/profiles/addons-675434/client.crt: no such file or directory
version_upgrade_test.go:309: (dbg) Done: /tmp/minikube-v1.26.0.3182414906 start -p missing-upgrade-682352 --memory=2200 --driver=docker  --container-runtime=containerd: (1m23.149332328s)
version_upgrade_test.go:318: (dbg) Run:  docker stop missing-upgrade-682352
version_upgrade_test.go:318: (dbg) Done: docker stop missing-upgrade-682352: (10.319169791s)
version_upgrade_test.go:323: (dbg) Run:  docker rm missing-upgrade-682352
version_upgrade_test.go:329: (dbg) Run:  out/minikube-linux-arm64 start -p missing-upgrade-682352 --memory=2200 --alsologtostderr -v=1 --driver=docker  --container-runtime=containerd
version_upgrade_test.go:329: (dbg) Done: out/minikube-linux-arm64 start -p missing-upgrade-682352 --memory=2200 --alsologtostderr -v=1 --driver=docker  --container-runtime=containerd: (1m15.462495824s)
helpers_test.go:175: Cleaning up "missing-upgrade-682352" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-arm64 delete -p missing-upgrade-682352
helpers_test.go:178: (dbg) Done: out/minikube-linux-arm64 delete -p missing-upgrade-682352: (2.205372307s)
--- PASS: TestMissingContainerUpgrade (172.25s)

                                                
                                    
x
+
TestNoKubernetes/serial/StartNoK8sWithVersion (0.07s)

                                                
                                                
=== RUN   TestNoKubernetes/serial/StartNoK8sWithVersion
no_kubernetes_test.go:83: (dbg) Run:  out/minikube-linux-arm64 start -p NoKubernetes-879131 --no-kubernetes --kubernetes-version=1.20 --driver=docker  --container-runtime=containerd
no_kubernetes_test.go:83: (dbg) Non-zero exit: out/minikube-linux-arm64 start -p NoKubernetes-879131 --no-kubernetes --kubernetes-version=1.20 --driver=docker  --container-runtime=containerd: exit status 14 (72.648559ms)

                                                
                                                
-- stdout --
	* [NoKubernetes-879131] minikube v1.33.1 on Ubuntu 20.04 (arm64)
	  - MINIKUBE_LOCATION=19339
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - KUBECONFIG=/home/jenkins/minikube-integration/19339-134334/kubeconfig
	  - MINIKUBE_HOME=/home/jenkins/minikube-integration/19339-134334/.minikube
	  - MINIKUBE_BIN=out/minikube-linux-arm64
	  - MINIKUBE_FORCE_SYSTEMD=
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	X Exiting due to MK_USAGE: cannot specify --kubernetes-version with --no-kubernetes,
	to unset a global config run:
	
	$ minikube config unset kubernetes-version

                                                
                                                
** /stderr **
--- PASS: TestNoKubernetes/serial/StartNoK8sWithVersion (0.07s)

                                                
                                    
x
+
TestNoKubernetes/serial/StartWithK8s (41.86s)

                                                
                                                
=== RUN   TestNoKubernetes/serial/StartWithK8s
no_kubernetes_test.go:95: (dbg) Run:  out/minikube-linux-arm64 start -p NoKubernetes-879131 --driver=docker  --container-runtime=containerd
no_kubernetes_test.go:95: (dbg) Done: out/minikube-linux-arm64 start -p NoKubernetes-879131 --driver=docker  --container-runtime=containerd: (41.391863087s)
no_kubernetes_test.go:200: (dbg) Run:  out/minikube-linux-arm64 -p NoKubernetes-879131 status -o json
--- PASS: TestNoKubernetes/serial/StartWithK8s (41.86s)

                                                
                                    
x
+
TestNoKubernetes/serial/StartWithStopK8s (17.59s)

                                                
                                                
=== RUN   TestNoKubernetes/serial/StartWithStopK8s
no_kubernetes_test.go:112: (dbg) Run:  out/minikube-linux-arm64 start -p NoKubernetes-879131 --no-kubernetes --driver=docker  --container-runtime=containerd
no_kubernetes_test.go:112: (dbg) Done: out/minikube-linux-arm64 start -p NoKubernetes-879131 --no-kubernetes --driver=docker  --container-runtime=containerd: (15.334557157s)
no_kubernetes_test.go:200: (dbg) Run:  out/minikube-linux-arm64 -p NoKubernetes-879131 status -o json
no_kubernetes_test.go:200: (dbg) Non-zero exit: out/minikube-linux-arm64 -p NoKubernetes-879131 status -o json: exit status 2 (289.599364ms)

                                                
                                                
-- stdout --
	{"Name":"NoKubernetes-879131","Host":"Running","Kubelet":"Stopped","APIServer":"Stopped","Kubeconfig":"Configured","Worker":false}

                                                
                                                
-- /stdout --
no_kubernetes_test.go:124: (dbg) Run:  out/minikube-linux-arm64 delete -p NoKubernetes-879131
no_kubernetes_test.go:124: (dbg) Done: out/minikube-linux-arm64 delete -p NoKubernetes-879131: (1.962183619s)
--- PASS: TestNoKubernetes/serial/StartWithStopK8s (17.59s)

                                                
                                    
x
+
TestNoKubernetes/serial/Start (8.89s)

                                                
                                                
=== RUN   TestNoKubernetes/serial/Start
no_kubernetes_test.go:136: (dbg) Run:  out/minikube-linux-arm64 start -p NoKubernetes-879131 --no-kubernetes --driver=docker  --container-runtime=containerd
no_kubernetes_test.go:136: (dbg) Done: out/minikube-linux-arm64 start -p NoKubernetes-879131 --no-kubernetes --driver=docker  --container-runtime=containerd: (8.892585662s)
--- PASS: TestNoKubernetes/serial/Start (8.89s)

                                                
                                    
x
+
TestNoKubernetes/serial/VerifyK8sNotRunning (0.33s)

                                                
                                                
=== RUN   TestNoKubernetes/serial/VerifyK8sNotRunning
no_kubernetes_test.go:147: (dbg) Run:  out/minikube-linux-arm64 ssh -p NoKubernetes-879131 "sudo systemctl is-active --quiet service kubelet"
no_kubernetes_test.go:147: (dbg) Non-zero exit: out/minikube-linux-arm64 ssh -p NoKubernetes-879131 "sudo systemctl is-active --quiet service kubelet": exit status 1 (332.235552ms)

                                                
                                                
** stderr ** 
	ssh: Process exited with status 3

                                                
                                                
** /stderr **
--- PASS: TestNoKubernetes/serial/VerifyK8sNotRunning (0.33s)

                                                
                                    
x
+
TestNoKubernetes/serial/ProfileList (1.16s)

                                                
                                                
=== RUN   TestNoKubernetes/serial/ProfileList
no_kubernetes_test.go:169: (dbg) Run:  out/minikube-linux-arm64 profile list
no_kubernetes_test.go:179: (dbg) Run:  out/minikube-linux-arm64 profile list --output=json
--- PASS: TestNoKubernetes/serial/ProfileList (1.16s)

                                                
                                    
x
+
TestNoKubernetes/serial/Stop (1.28s)

                                                
                                                
=== RUN   TestNoKubernetes/serial/Stop
no_kubernetes_test.go:158: (dbg) Run:  out/minikube-linux-arm64 stop -p NoKubernetes-879131
no_kubernetes_test.go:158: (dbg) Done: out/minikube-linux-arm64 stop -p NoKubernetes-879131: (1.276617859s)
--- PASS: TestNoKubernetes/serial/Stop (1.28s)

                                                
                                    
x
+
TestNoKubernetes/serial/StartNoArgs (7.7s)

                                                
                                                
=== RUN   TestNoKubernetes/serial/StartNoArgs
no_kubernetes_test.go:191: (dbg) Run:  out/minikube-linux-arm64 start -p NoKubernetes-879131 --driver=docker  --container-runtime=containerd
no_kubernetes_test.go:191: (dbg) Done: out/minikube-linux-arm64 start -p NoKubernetes-879131 --driver=docker  --container-runtime=containerd: (7.70247787s)
--- PASS: TestNoKubernetes/serial/StartNoArgs (7.70s)

                                                
                                    
x
+
TestNoKubernetes/serial/VerifyK8sNotRunningSecond (0.3s)

                                                
                                                
=== RUN   TestNoKubernetes/serial/VerifyK8sNotRunningSecond
no_kubernetes_test.go:147: (dbg) Run:  out/minikube-linux-arm64 ssh -p NoKubernetes-879131 "sudo systemctl is-active --quiet service kubelet"
no_kubernetes_test.go:147: (dbg) Non-zero exit: out/minikube-linux-arm64 ssh -p NoKubernetes-879131 "sudo systemctl is-active --quiet service kubelet": exit status 1 (298.451287ms)

                                                
                                                
** stderr ** 
	ssh: Process exited with status 3

                                                
                                                
** /stderr **
--- PASS: TestNoKubernetes/serial/VerifyK8sNotRunningSecond (0.30s)

                                                
                                    
x
+
TestStoppedBinaryUpgrade/Setup (1.19s)

                                                
                                                
=== RUN   TestStoppedBinaryUpgrade/Setup
--- PASS: TestStoppedBinaryUpgrade/Setup (1.19s)

                                                
                                    
x
+
TestStoppedBinaryUpgrade/Upgrade (106.07s)

                                                
                                                
=== RUN   TestStoppedBinaryUpgrade/Upgrade
version_upgrade_test.go:183: (dbg) Run:  /tmp/minikube-v1.26.0.3020586950 start -p stopped-upgrade-503641 --memory=2200 --vm-driver=docker  --container-runtime=containerd
version_upgrade_test.go:183: (dbg) Done: /tmp/minikube-v1.26.0.3020586950 start -p stopped-upgrade-503641 --memory=2200 --vm-driver=docker  --container-runtime=containerd: (33.505802364s)
version_upgrade_test.go:192: (dbg) Run:  /tmp/minikube-v1.26.0.3020586950 -p stopped-upgrade-503641 stop
version_upgrade_test.go:192: (dbg) Done: /tmp/minikube-v1.26.0.3020586950 -p stopped-upgrade-503641 stop: (19.942541839s)
version_upgrade_test.go:198: (dbg) Run:  out/minikube-linux-arm64 start -p stopped-upgrade-503641 --memory=2200 --alsologtostderr -v=1 --driver=docker  --container-runtime=containerd
E0729 20:55:53.505185  139728 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19339-134334/.minikube/profiles/functional-479263/client.crt: no such file or directory
version_upgrade_test.go:198: (dbg) Done: out/minikube-linux-arm64 start -p stopped-upgrade-503641 --memory=2200 --alsologtostderr -v=1 --driver=docker  --container-runtime=containerd: (52.61682583s)
--- PASS: TestStoppedBinaryUpgrade/Upgrade (106.07s)

                                                
                                    
x
+
TestStoppedBinaryUpgrade/MinikubeLogs (1.22s)

                                                
                                                
=== RUN   TestStoppedBinaryUpgrade/MinikubeLogs
version_upgrade_test.go:206: (dbg) Run:  out/minikube-linux-arm64 logs -p stopped-upgrade-503641
version_upgrade_test.go:206: (dbg) Done: out/minikube-linux-arm64 logs -p stopped-upgrade-503641: (1.22003304s)
--- PASS: TestStoppedBinaryUpgrade/MinikubeLogs (1.22s)

                                                
                                    
x
+
TestPause/serial/Start (71.89s)

                                                
                                                
=== RUN   TestPause/serial/Start
pause_test.go:80: (dbg) Run:  out/minikube-linux-arm64 start -p pause-655171 --memory=2048 --install-addons=false --wait=all --driver=docker  --container-runtime=containerd
pause_test.go:80: (dbg) Done: out/minikube-linux-arm64 start -p pause-655171 --memory=2048 --install-addons=false --wait=all --driver=docker  --container-runtime=containerd: (1m11.890632299s)
--- PASS: TestPause/serial/Start (71.89s)

                                                
                                    
x
+
TestPause/serial/SecondStartNoReconfiguration (7.33s)

                                                
                                                
=== RUN   TestPause/serial/SecondStartNoReconfiguration
pause_test.go:92: (dbg) Run:  out/minikube-linux-arm64 start -p pause-655171 --alsologtostderr -v=1 --driver=docker  --container-runtime=containerd
pause_test.go:92: (dbg) Done: out/minikube-linux-arm64 start -p pause-655171 --alsologtostderr -v=1 --driver=docker  --container-runtime=containerd: (7.314304515s)
--- PASS: TestPause/serial/SecondStartNoReconfiguration (7.33s)

                                                
                                    
x
+
TestPause/serial/Pause (0.91s)

                                                
                                                
=== RUN   TestPause/serial/Pause
pause_test.go:110: (dbg) Run:  out/minikube-linux-arm64 pause -p pause-655171 --alsologtostderr -v=5
--- PASS: TestPause/serial/Pause (0.91s)

                                                
                                    
x
+
TestPause/serial/VerifyStatus (0.4s)

                                                
                                                
=== RUN   TestPause/serial/VerifyStatus
status_test.go:76: (dbg) Run:  out/minikube-linux-arm64 status -p pause-655171 --output=json --layout=cluster
status_test.go:76: (dbg) Non-zero exit: out/minikube-linux-arm64 status -p pause-655171 --output=json --layout=cluster: exit status 2 (398.696861ms)

                                                
                                                
-- stdout --
	{"Name":"pause-655171","StatusCode":418,"StatusName":"Paused","Step":"Done","StepDetail":"* Paused 7 containers in: kube-system, kubernetes-dashboard, storage-gluster, istio-operator","BinaryVersion":"v1.33.1","Components":{"kubeconfig":{"Name":"kubeconfig","StatusCode":200,"StatusName":"OK"}},"Nodes":[{"Name":"pause-655171","StatusCode":200,"StatusName":"OK","Components":{"apiserver":{"Name":"apiserver","StatusCode":418,"StatusName":"Paused"},"kubelet":{"Name":"kubelet","StatusCode":405,"StatusName":"Stopped"}}}]}

                                                
                                                
-- /stdout --
--- PASS: TestPause/serial/VerifyStatus (0.40s)

                                                
                                    
x
+
TestPause/serial/Unpause (0.82s)

                                                
                                                
=== RUN   TestPause/serial/Unpause
pause_test.go:121: (dbg) Run:  out/minikube-linux-arm64 unpause -p pause-655171 --alsologtostderr -v=5
--- PASS: TestPause/serial/Unpause (0.82s)

                                                
                                    
x
+
TestPause/serial/PauseAgain (1.11s)

                                                
                                                
=== RUN   TestPause/serial/PauseAgain
pause_test.go:110: (dbg) Run:  out/minikube-linux-arm64 pause -p pause-655171 --alsologtostderr -v=5
pause_test.go:110: (dbg) Done: out/minikube-linux-arm64 pause -p pause-655171 --alsologtostderr -v=5: (1.111701951s)
--- PASS: TestPause/serial/PauseAgain (1.11s)

                                                
                                    
x
+
TestPause/serial/DeletePaused (2.81s)

                                                
                                                
=== RUN   TestPause/serial/DeletePaused
pause_test.go:132: (dbg) Run:  out/minikube-linux-arm64 delete -p pause-655171 --alsologtostderr -v=5
pause_test.go:132: (dbg) Done: out/minikube-linux-arm64 delete -p pause-655171 --alsologtostderr -v=5: (2.806231809s)
--- PASS: TestPause/serial/DeletePaused (2.81s)

                                                
                                    
x
+
TestPause/serial/VerifyDeletedResources (0.45s)

                                                
                                                
=== RUN   TestPause/serial/VerifyDeletedResources
pause_test.go:142: (dbg) Run:  out/minikube-linux-arm64 profile list --output json
pause_test.go:168: (dbg) Run:  docker ps -a
pause_test.go:173: (dbg) Run:  docker volume inspect pause-655171
pause_test.go:173: (dbg) Non-zero exit: docker volume inspect pause-655171: exit status 1 (13.442126ms)

                                                
                                                
-- stdout --
	[]

                                                
                                                
-- /stdout --
** stderr ** 
	Error response from daemon: get pause-655171: no such volume

                                                
                                                
** /stderr **
pause_test.go:178: (dbg) Run:  docker network ls
--- PASS: TestPause/serial/VerifyDeletedResources (0.45s)

                                                
                                    
x
+
TestNetworkPlugins/group/false (4.64s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/false
net_test.go:246: (dbg) Run:  out/minikube-linux-arm64 start -p false-341440 --memory=2048 --alsologtostderr --cni=false --driver=docker  --container-runtime=containerd
net_test.go:246: (dbg) Non-zero exit: out/minikube-linux-arm64 start -p false-341440 --memory=2048 --alsologtostderr --cni=false --driver=docker  --container-runtime=containerd: exit status 14 (266.20095ms)

                                                
                                                
-- stdout --
	* [false-341440] minikube v1.33.1 on Ubuntu 20.04 (arm64)
	  - MINIKUBE_LOCATION=19339
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - KUBECONFIG=/home/jenkins/minikube-integration/19339-134334/kubeconfig
	  - MINIKUBE_HOME=/home/jenkins/minikube-integration/19339-134334/.minikube
	  - MINIKUBE_BIN=out/minikube-linux-arm64
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the docker driver based on user configuration
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0729 20:59:12.882155  328517 out.go:291] Setting OutFile to fd 1 ...
	I0729 20:59:12.882409  328517 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0729 20:59:12.882437  328517 out.go:304] Setting ErrFile to fd 2...
	I0729 20:59:12.882457  328517 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0729 20:59:12.882712  328517 root.go:338] Updating PATH: /home/jenkins/minikube-integration/19339-134334/.minikube/bin
	I0729 20:59:12.883162  328517 out.go:298] Setting JSON to false
	I0729 20:59:12.884198  328517 start.go:129] hostinfo: {"hostname":"ip-172-31-29-130","uptime":67299,"bootTime":1722219454,"procs":203,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1065-aws","kernelArch":"aarch64","virtualizationSystem":"","virtualizationRole":"","hostId":"36adf542-ef4f-4e2d-a0c8-6868d1383ff9"}
	I0729 20:59:12.884294  328517 start.go:139] virtualization:  
	I0729 20:59:12.888168  328517 out.go:177] * [false-341440] minikube v1.33.1 on Ubuntu 20.04 (arm64)
	I0729 20:59:12.890437  328517 out.go:177]   - MINIKUBE_LOCATION=19339
	I0729 20:59:12.890498  328517 notify.go:220] Checking for updates...
	I0729 20:59:12.895357  328517 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I0729 20:59:12.897052  328517 out.go:177]   - KUBECONFIG=/home/jenkins/minikube-integration/19339-134334/kubeconfig
	I0729 20:59:12.899312  328517 out.go:177]   - MINIKUBE_HOME=/home/jenkins/minikube-integration/19339-134334/.minikube
	I0729 20:59:12.901307  328517 out.go:177]   - MINIKUBE_BIN=out/minikube-linux-arm64
	I0729 20:59:12.903120  328517 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=
	I0729 20:59:12.905382  328517 config.go:182] Loaded profile config "force-systemd-flag-730900": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.30.3
	I0729 20:59:12.905546  328517 driver.go:392] Setting default libvirt URI to qemu:///system
	I0729 20:59:12.933775  328517 docker.go:123] docker version: linux-27.1.1:Docker Engine - Community
	I0729 20:59:12.933911  328517 cli_runner.go:164] Run: docker system info --format "{{json .}}"
	I0729 20:59:13.044143  328517 info.go:266] docker info: {ID:U5VK:ZNT5:35M3:FHLW:Q7TL:ELFX:BNAG:AV4T:UD2H:SK5L:SEJV:SJJL Containers:1 ContainersRunning:1 ContainersPaused:0 ContainersStopped:0 Images:4 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:35 OomKillDisable:true NGoroutines:53 SystemTime:2024-07-29 20:59:13.034831402 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1065-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Architecture:aar
ch64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8214900736 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-29-130 Labels:[] ExperimentalBuild:false ServerVersion:27.1.1 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:2bf793ef6dc9a18e00cb12efb64355c2c9d5eb41 Expected:2bf793ef6dc9a18e00cb12efb64355c2c9d5eb41} RuncCommit:{ID:v1.1.13-0-g58aa920 Expected:v1.1.13-0-g58aa920} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:<nil> ServerErro
rs:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.16.1] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.29.1]] Warnings:<nil>}}
	I0729 20:59:13.044256  328517 docker.go:307] overlay module found
	I0729 20:59:13.047537  328517 out.go:177] * Using the docker driver based on user configuration
	I0729 20:59:13.050586  328517 start.go:297] selected driver: docker
	I0729 20:59:13.050604  328517 start.go:901] validating driver "docker" against <nil>
	I0729 20:59:13.050618  328517 start.go:912] status for docker: {Installed:true Healthy:true Running:false NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I0729 20:59:13.053392  328517 out.go:177] 
	W0729 20:59:13.055529  328517 out.go:239] X Exiting due to MK_USAGE: The "containerd" container runtime requires CNI
	X Exiting due to MK_USAGE: The "containerd" container runtime requires CNI
	I0729 20:59:13.058290  328517 out.go:177] 

                                                
                                                
** /stderr **
net_test.go:88: 
----------------------- debugLogs start: false-341440 [pass: true] --------------------------------
>>> netcat: nslookup kubernetes.default:
Error in configuration: context was not found for specified context: false-341440

                                                
                                                

                                                
                                                
>>> netcat: nslookup debug kubernetes.default a-records:
Error in configuration: context was not found for specified context: false-341440

                                                
                                                

                                                
                                                
>>> netcat: dig search kubernetes.default:
Error in configuration: context was not found for specified context: false-341440

                                                
                                                

                                                
                                                
>>> netcat: dig @10.96.0.10 kubernetes.default.svc.cluster.local udp/53:
Error in configuration: context was not found for specified context: false-341440

                                                
                                                

                                                
                                                
>>> netcat: dig @10.96.0.10 kubernetes.default.svc.cluster.local tcp/53:
Error in configuration: context was not found for specified context: false-341440

                                                
                                                

                                                
                                                
>>> netcat: nc 10.96.0.10 udp/53:
Error in configuration: context was not found for specified context: false-341440

                                                
                                                

                                                
                                                
>>> netcat: nc 10.96.0.10 tcp/53:
Error in configuration: context was not found for specified context: false-341440

                                                
                                                

                                                
                                                
>>> netcat: /etc/nsswitch.conf:
Error in configuration: context was not found for specified context: false-341440

                                                
                                                

                                                
                                                
>>> netcat: /etc/hosts:
Error in configuration: context was not found for specified context: false-341440

                                                
                                                

                                                
                                                
>>> netcat: /etc/resolv.conf:
Error in configuration: context was not found for specified context: false-341440

                                                
                                                

                                                
                                                
>>> host: /etc/nsswitch.conf:
* Profile "false-341440" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-341440"

                                                
                                                

                                                
                                                
>>> host: /etc/hosts:
* Profile "false-341440" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-341440"

                                                
                                                

                                                
                                                
>>> host: /etc/resolv.conf:
* Profile "false-341440" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-341440"

                                                
                                                

                                                
                                                
>>> k8s: nodes, services, endpoints, daemon sets, deployments and pods, :
Error in configuration: context was not found for specified context: false-341440

                                                
                                                

                                                
                                                
>>> host: crictl pods:
* Profile "false-341440" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-341440"

                                                
                                                

                                                
                                                
>>> host: crictl containers:
* Profile "false-341440" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-341440"

                                                
                                                

                                                
                                                
>>> k8s: describe netcat deployment:
error: context "false-341440" does not exist

                                                
                                                

                                                
                                                
>>> k8s: describe netcat pod(s):
error: context "false-341440" does not exist

                                                
                                                

                                                
                                                
>>> k8s: netcat logs:
error: context "false-341440" does not exist

                                                
                                                

                                                
                                                
>>> k8s: describe coredns deployment:
error: context "false-341440" does not exist

                                                
                                                

                                                
                                                
>>> k8s: describe coredns pods:
error: context "false-341440" does not exist

                                                
                                                

                                                
                                                
>>> k8s: coredns logs:
error: context "false-341440" does not exist

                                                
                                                

                                                
                                                
>>> k8s: describe api server pod(s):
error: context "false-341440" does not exist

                                                
                                                

                                                
                                                
>>> k8s: api server logs:
error: context "false-341440" does not exist

                                                
                                                

                                                
                                                
>>> host: /etc/cni:
* Profile "false-341440" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-341440"

                                                
                                                

                                                
                                                
>>> host: ip a s:
* Profile "false-341440" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-341440"

                                                
                                                

                                                
                                                
>>> host: ip r s:
* Profile "false-341440" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-341440"

                                                
                                                

                                                
                                                
>>> host: iptables-save:
* Profile "false-341440" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-341440"

                                                
                                                

                                                
                                                
>>> host: iptables table nat:
* Profile "false-341440" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-341440"

                                                
                                                

                                                
                                                
>>> k8s: describe kube-proxy daemon set:
error: context "false-341440" does not exist

                                                
                                                

                                                
                                                
>>> k8s: describe kube-proxy pod(s):
error: context "false-341440" does not exist

                                                
                                                

                                                
                                                
>>> k8s: kube-proxy logs:
error: context "false-341440" does not exist

                                                
                                                

                                                
                                                
>>> host: kubelet daemon status:
* Profile "false-341440" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-341440"

                                                
                                                

                                                
                                                
>>> host: kubelet daemon config:
* Profile "false-341440" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-341440"

                                                
                                                

                                                
                                                
>>> k8s: kubelet logs:
* Profile "false-341440" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-341440"

                                                
                                                

                                                
                                                
>>> host: /etc/kubernetes/kubelet.conf:
* Profile "false-341440" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-341440"

                                                
                                                

                                                
                                                
>>> host: /var/lib/kubelet/config.yaml:
* Profile "false-341440" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-341440"

                                                
                                                

                                                
                                                
>>> k8s: kubectl config:
apiVersion: v1
clusters: null
contexts: null
current-context: ""
kind: Config
preferences: {}
users: null

                                                
                                                

                                                
                                                
>>> k8s: cms:
Error in configuration: context was not found for specified context: false-341440

                                                
                                                

                                                
                                                
>>> host: docker daemon status:
* Profile "false-341440" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-341440"

                                                
                                                

                                                
                                                
>>> host: docker daemon config:
* Profile "false-341440" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-341440"

                                                
                                                

                                                
                                                
>>> host: /etc/docker/daemon.json:
* Profile "false-341440" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-341440"

                                                
                                                

                                                
                                                
>>> host: docker system info:
* Profile "false-341440" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-341440"

                                                
                                                

                                                
                                                
>>> host: cri-docker daemon status:
* Profile "false-341440" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-341440"

                                                
                                                

                                                
                                                
>>> host: cri-docker daemon config:
* Profile "false-341440" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-341440"

                                                
                                                

                                                
                                                
>>> host: /etc/systemd/system/cri-docker.service.d/10-cni.conf:
* Profile "false-341440" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-341440"

                                                
                                                

                                                
                                                
>>> host: /usr/lib/systemd/system/cri-docker.service:
* Profile "false-341440" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-341440"

                                                
                                                

                                                
                                                
>>> host: cri-dockerd version:
* Profile "false-341440" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-341440"

                                                
                                                

                                                
                                                
>>> host: containerd daemon status:
* Profile "false-341440" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-341440"

                                                
                                                

                                                
                                                
>>> host: containerd daemon config:
* Profile "false-341440" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-341440"

                                                
                                                

                                                
                                                
>>> host: /lib/systemd/system/containerd.service:
* Profile "false-341440" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-341440"

                                                
                                                

                                                
                                                
>>> host: /etc/containerd/config.toml:
* Profile "false-341440" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-341440"

                                                
                                                

                                                
                                                
>>> host: containerd config dump:
* Profile "false-341440" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-341440"

                                                
                                                

                                                
                                                
>>> host: crio daemon status:
* Profile "false-341440" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-341440"

                                                
                                                

                                                
                                                
>>> host: crio daemon config:
* Profile "false-341440" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-341440"

                                                
                                                

                                                
                                                
>>> host: /etc/crio:
* Profile "false-341440" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-341440"

                                                
                                                

                                                
                                                
>>> host: crio config:
* Profile "false-341440" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-341440"

                                                
                                                
----------------------- debugLogs end: false-341440 [took: 4.196044555s] --------------------------------
helpers_test.go:175: Cleaning up "false-341440" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-arm64 delete -p false-341440
--- PASS: TestNetworkPlugins/group/false (4.64s)

                                                
                                    
x
+
TestStartStop/group/old-k8s-version/serial/FirstStart (134.99s)

                                                
                                                
=== RUN   TestStartStop/group/old-k8s-version/serial/FirstStart
start_stop_delete_test.go:186: (dbg) Run:  out/minikube-linux-arm64 start -p old-k8s-version-884192 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=docker  --container-runtime=containerd --kubernetes-version=v1.20.0
E0729 21:00:53.505640  139728 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19339-134334/.minikube/profiles/functional-479263/client.crt: no such file or directory
E0729 21:01:56.781600  139728 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19339-134334/.minikube/profiles/addons-675434/client.crt: no such file or directory
start_stop_delete_test.go:186: (dbg) Done: out/minikube-linux-arm64 start -p old-k8s-version-884192 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=docker  --container-runtime=containerd --kubernetes-version=v1.20.0: (2m14.989263906s)
--- PASS: TestStartStop/group/old-k8s-version/serial/FirstStart (134.99s)

                                                
                                    
x
+
TestStartStop/group/old-k8s-version/serial/DeployApp (9.67s)

                                                
                                                
=== RUN   TestStartStop/group/old-k8s-version/serial/DeployApp
start_stop_delete_test.go:196: (dbg) Run:  kubectl --context old-k8s-version-884192 create -f testdata/busybox.yaml
start_stop_delete_test.go:196: (dbg) TestStartStop/group/old-k8s-version/serial/DeployApp: waiting 8m0s for pods matching "integration-test=busybox" in namespace "default" ...
helpers_test.go:344: "busybox" [a691097e-dfee-4f73-ad05-229e6beda023] Pending / Ready:ContainersNotReady (containers with unready status: [busybox]) / ContainersReady:ContainersNotReady (containers with unready status: [busybox])
helpers_test.go:344: "busybox" [a691097e-dfee-4f73-ad05-229e6beda023] Running
start_stop_delete_test.go:196: (dbg) TestStartStop/group/old-k8s-version/serial/DeployApp: integration-test=busybox healthy within 9.007839836s
start_stop_delete_test.go:196: (dbg) Run:  kubectl --context old-k8s-version-884192 exec busybox -- /bin/sh -c "ulimit -n"
--- PASS: TestStartStop/group/old-k8s-version/serial/DeployApp (9.67s)

                                                
                                    
x
+
TestStartStop/group/old-k8s-version/serial/EnableAddonWhileActive (1.49s)

                                                
                                                
=== RUN   TestStartStop/group/old-k8s-version/serial/EnableAddonWhileActive
start_stop_delete_test.go:205: (dbg) Run:  out/minikube-linux-arm64 addons enable metrics-server -p old-k8s-version-884192 --images=MetricsServer=registry.k8s.io/echoserver:1.4 --registries=MetricsServer=fake.domain
start_stop_delete_test.go:205: (dbg) Done: out/minikube-linux-arm64 addons enable metrics-server -p old-k8s-version-884192 --images=MetricsServer=registry.k8s.io/echoserver:1.4 --registries=MetricsServer=fake.domain: (1.324499428s)
start_stop_delete_test.go:215: (dbg) Run:  kubectl --context old-k8s-version-884192 describe deploy/metrics-server -n kube-system
--- PASS: TestStartStop/group/old-k8s-version/serial/EnableAddonWhileActive (1.49s)

                                                
                                    
x
+
TestStartStop/group/old-k8s-version/serial/Stop (12.71s)

                                                
                                                
=== RUN   TestStartStop/group/old-k8s-version/serial/Stop
start_stop_delete_test.go:228: (dbg) Run:  out/minikube-linux-arm64 stop -p old-k8s-version-884192 --alsologtostderr -v=3
start_stop_delete_test.go:228: (dbg) Done: out/minikube-linux-arm64 stop -p old-k8s-version-884192 --alsologtostderr -v=3: (12.706534242s)
--- PASS: TestStartStop/group/old-k8s-version/serial/Stop (12.71s)

                                                
                                    
x
+
TestStartStop/group/no-preload/serial/FirstStart (68.74s)

                                                
                                                
=== RUN   TestStartStop/group/no-preload/serial/FirstStart
start_stop_delete_test.go:186: (dbg) Run:  out/minikube-linux-arm64 start -p no-preload-992167 --memory=2200 --alsologtostderr --wait=true --preload=false --driver=docker  --container-runtime=containerd --kubernetes-version=v1.31.0-beta.0
start_stop_delete_test.go:186: (dbg) Done: out/minikube-linux-arm64 start -p no-preload-992167 --memory=2200 --alsologtostderr --wait=true --preload=false --driver=docker  --container-runtime=containerd --kubernetes-version=v1.31.0-beta.0: (1m8.742593825s)
--- PASS: TestStartStop/group/no-preload/serial/FirstStart (68.74s)

                                                
                                    
x
+
TestStartStop/group/old-k8s-version/serial/EnableAddonAfterStop (0.24s)

                                                
                                                
=== RUN   TestStartStop/group/old-k8s-version/serial/EnableAddonAfterStop
start_stop_delete_test.go:239: (dbg) Run:  out/minikube-linux-arm64 status --format={{.Host}} -p old-k8s-version-884192 -n old-k8s-version-884192
start_stop_delete_test.go:239: (dbg) Non-zero exit: out/minikube-linux-arm64 status --format={{.Host}} -p old-k8s-version-884192 -n old-k8s-version-884192: exit status 7 (100.490233ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
start_stop_delete_test.go:239: status error: exit status 7 (may be ok)
start_stop_delete_test.go:246: (dbg) Run:  out/minikube-linux-arm64 addons enable dashboard -p old-k8s-version-884192 --images=MetricsScraper=registry.k8s.io/echoserver:1.4
--- PASS: TestStartStop/group/old-k8s-version/serial/EnableAddonAfterStop (0.24s)

                                                
                                    
x
+
TestStartStop/group/no-preload/serial/DeployApp (10.34s)

                                                
                                                
=== RUN   TestStartStop/group/no-preload/serial/DeployApp
start_stop_delete_test.go:196: (dbg) Run:  kubectl --context no-preload-992167 create -f testdata/busybox.yaml
start_stop_delete_test.go:196: (dbg) TestStartStop/group/no-preload/serial/DeployApp: waiting 8m0s for pods matching "integration-test=busybox" in namespace "default" ...
helpers_test.go:344: "busybox" [ae9b80b5-a67b-471b-8f8a-c6837d2aef8f] Pending / Ready:ContainersNotReady (containers with unready status: [busybox]) / ContainersReady:ContainersNotReady (containers with unready status: [busybox])
helpers_test.go:344: "busybox" [ae9b80b5-a67b-471b-8f8a-c6837d2aef8f] Running
start_stop_delete_test.go:196: (dbg) TestStartStop/group/no-preload/serial/DeployApp: integration-test=busybox healthy within 10.003939865s
start_stop_delete_test.go:196: (dbg) Run:  kubectl --context no-preload-992167 exec busybox -- /bin/sh -c "ulimit -n"
--- PASS: TestStartStop/group/no-preload/serial/DeployApp (10.34s)

                                                
                                    
x
+
TestStartStop/group/no-preload/serial/EnableAddonWhileActive (1.13s)

                                                
                                                
=== RUN   TestStartStop/group/no-preload/serial/EnableAddonWhileActive
start_stop_delete_test.go:205: (dbg) Run:  out/minikube-linux-arm64 addons enable metrics-server -p no-preload-992167 --images=MetricsServer=registry.k8s.io/echoserver:1.4 --registries=MetricsServer=fake.domain
start_stop_delete_test.go:205: (dbg) Done: out/minikube-linux-arm64 addons enable metrics-server -p no-preload-992167 --images=MetricsServer=registry.k8s.io/echoserver:1.4 --registries=MetricsServer=fake.domain: (1.02289855s)
start_stop_delete_test.go:215: (dbg) Run:  kubectl --context no-preload-992167 describe deploy/metrics-server -n kube-system
--- PASS: TestStartStop/group/no-preload/serial/EnableAddonWhileActive (1.13s)

                                                
                                    
x
+
TestStartStop/group/no-preload/serial/Stop (12.07s)

                                                
                                                
=== RUN   TestStartStop/group/no-preload/serial/Stop
start_stop_delete_test.go:228: (dbg) Run:  out/minikube-linux-arm64 stop -p no-preload-992167 --alsologtostderr -v=3
start_stop_delete_test.go:228: (dbg) Done: out/minikube-linux-arm64 stop -p no-preload-992167 --alsologtostderr -v=3: (12.069051398s)
--- PASS: TestStartStop/group/no-preload/serial/Stop (12.07s)

                                                
                                    
x
+
TestStartStop/group/no-preload/serial/EnableAddonAfterStop (0.18s)

                                                
                                                
=== RUN   TestStartStop/group/no-preload/serial/EnableAddonAfterStop
start_stop_delete_test.go:239: (dbg) Run:  out/minikube-linux-arm64 status --format={{.Host}} -p no-preload-992167 -n no-preload-992167
start_stop_delete_test.go:239: (dbg) Non-zero exit: out/minikube-linux-arm64 status --format={{.Host}} -p no-preload-992167 -n no-preload-992167: exit status 7 (70.790453ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
start_stop_delete_test.go:239: status error: exit status 7 (may be ok)
start_stop_delete_test.go:246: (dbg) Run:  out/minikube-linux-arm64 addons enable dashboard -p no-preload-992167 --images=MetricsScraper=registry.k8s.io/echoserver:1.4
--- PASS: TestStartStop/group/no-preload/serial/EnableAddonAfterStop (0.18s)

                                                
                                    
x
+
TestStartStop/group/no-preload/serial/SecondStart (267.51s)

                                                
                                                
=== RUN   TestStartStop/group/no-preload/serial/SecondStart
start_stop_delete_test.go:256: (dbg) Run:  out/minikube-linux-arm64 start -p no-preload-992167 --memory=2200 --alsologtostderr --wait=true --preload=false --driver=docker  --container-runtime=containerd --kubernetes-version=v1.31.0-beta.0
E0729 21:05:53.506166  139728 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19339-134334/.minikube/profiles/functional-479263/client.crt: no such file or directory
E0729 21:06:56.780963  139728 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19339-134334/.minikube/profiles/addons-675434/client.crt: no such file or directory
start_stop_delete_test.go:256: (dbg) Done: out/minikube-linux-arm64 start -p no-preload-992167 --memory=2200 --alsologtostderr --wait=true --preload=false --driver=docker  --container-runtime=containerd --kubernetes-version=v1.31.0-beta.0: (4m27.15738586s)
start_stop_delete_test.go:262: (dbg) Run:  out/minikube-linux-arm64 status --format={{.Host}} -p no-preload-992167 -n no-preload-992167
--- PASS: TestStartStop/group/no-preload/serial/SecondStart (267.51s)

                                                
                                    
x
+
TestStartStop/group/no-preload/serial/UserAppExistsAfterStop (6.01s)

                                                
                                                
=== RUN   TestStartStop/group/no-preload/serial/UserAppExistsAfterStop
start_stop_delete_test.go:274: (dbg) TestStartStop/group/no-preload/serial/UserAppExistsAfterStop: waiting 9m0s for pods matching "k8s-app=kubernetes-dashboard" in namespace "kubernetes-dashboard" ...
helpers_test.go:344: "kubernetes-dashboard-5cc9f66cf4-z4g89" [242b7072-8a6e-4d74-b4ca-b094e81929c8] Running
start_stop_delete_test.go:274: (dbg) TestStartStop/group/no-preload/serial/UserAppExistsAfterStop: k8s-app=kubernetes-dashboard healthy within 6.004495515s
--- PASS: TestStartStop/group/no-preload/serial/UserAppExistsAfterStop (6.01s)

                                                
                                    
x
+
TestStartStop/group/no-preload/serial/AddonExistsAfterStop (5.11s)

                                                
                                                
=== RUN   TestStartStop/group/no-preload/serial/AddonExistsAfterStop
start_stop_delete_test.go:287: (dbg) TestStartStop/group/no-preload/serial/AddonExistsAfterStop: waiting 9m0s for pods matching "k8s-app=kubernetes-dashboard" in namespace "kubernetes-dashboard" ...
helpers_test.go:344: "kubernetes-dashboard-5cc9f66cf4-z4g89" [242b7072-8a6e-4d74-b4ca-b094e81929c8] Running
start_stop_delete_test.go:287: (dbg) TestStartStop/group/no-preload/serial/AddonExistsAfterStop: k8s-app=kubernetes-dashboard healthy within 5.004119397s
start_stop_delete_test.go:291: (dbg) Run:  kubectl --context no-preload-992167 describe deploy/dashboard-metrics-scraper -n kubernetes-dashboard
--- PASS: TestStartStop/group/no-preload/serial/AddonExistsAfterStop (5.11s)

                                                
                                    
x
+
TestStartStop/group/no-preload/serial/VerifyKubernetesImages (0.23s)

                                                
                                                
=== RUN   TestStartStop/group/no-preload/serial/VerifyKubernetesImages
start_stop_delete_test.go:304: (dbg) Run:  out/minikube-linux-arm64 -p no-preload-992167 image list --format=json
start_stop_delete_test.go:304: Found non-minikube image: gcr.io/k8s-minikube/busybox:1.28.4-glibc
start_stop_delete_test.go:304: Found non-minikube image: kindest/kindnetd:v20240719-e7903573
--- PASS: TestStartStop/group/no-preload/serial/VerifyKubernetesImages (0.23s)

                                                
                                    
x
+
TestStartStop/group/no-preload/serial/Pause (3.04s)

                                                
                                                
=== RUN   TestStartStop/group/no-preload/serial/Pause
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 pause -p no-preload-992167 --alsologtostderr -v=1
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 status --format={{.APIServer}} -p no-preload-992167 -n no-preload-992167
start_stop_delete_test.go:311: (dbg) Non-zero exit: out/minikube-linux-arm64 status --format={{.APIServer}} -p no-preload-992167 -n no-preload-992167: exit status 2 (324.883588ms)

                                                
                                                
-- stdout --
	Paused

                                                
                                                
-- /stdout --
start_stop_delete_test.go:311: status error: exit status 2 (may be ok)
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 status --format={{.Kubelet}} -p no-preload-992167 -n no-preload-992167
start_stop_delete_test.go:311: (dbg) Non-zero exit: out/minikube-linux-arm64 status --format={{.Kubelet}} -p no-preload-992167 -n no-preload-992167: exit status 2 (320.407618ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
start_stop_delete_test.go:311: status error: exit status 2 (may be ok)
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 unpause -p no-preload-992167 --alsologtostderr -v=1
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 status --format={{.APIServer}} -p no-preload-992167 -n no-preload-992167
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 status --format={{.Kubelet}} -p no-preload-992167 -n no-preload-992167
--- PASS: TestStartStop/group/no-preload/serial/Pause (3.04s)

                                                
                                    
x
+
TestStartStop/group/embed-certs/serial/FirstStart (78.17s)

                                                
                                                
=== RUN   TestStartStop/group/embed-certs/serial/FirstStart
start_stop_delete_test.go:186: (dbg) Run:  out/minikube-linux-arm64 start -p embed-certs-159530 --memory=2200 --alsologtostderr --wait=true --embed-certs --driver=docker  --container-runtime=containerd --kubernetes-version=v1.30.3
start_stop_delete_test.go:186: (dbg) Done: out/minikube-linux-arm64 start -p embed-certs-159530 --memory=2200 --alsologtostderr --wait=true --embed-certs --driver=docker  --container-runtime=containerd --kubernetes-version=v1.30.3: (1m18.169187038s)
--- PASS: TestStartStop/group/embed-certs/serial/FirstStart (78.17s)

                                                
                                    
x
+
TestStartStop/group/old-k8s-version/serial/UserAppExistsAfterStop (6.01s)

                                                
                                                
=== RUN   TestStartStop/group/old-k8s-version/serial/UserAppExistsAfterStop
start_stop_delete_test.go:274: (dbg) TestStartStop/group/old-k8s-version/serial/UserAppExistsAfterStop: waiting 9m0s for pods matching "k8s-app=kubernetes-dashboard" in namespace "kubernetes-dashboard" ...
helpers_test.go:344: "kubernetes-dashboard-cd95d586-c7zlw" [49212a1e-41f8-4a05-851b-75b2d5b48278] Running
start_stop_delete_test.go:274: (dbg) TestStartStop/group/old-k8s-version/serial/UserAppExistsAfterStop: k8s-app=kubernetes-dashboard healthy within 6.004328104s
--- PASS: TestStartStop/group/old-k8s-version/serial/UserAppExistsAfterStop (6.01s)

                                                
                                    
x
+
TestStartStop/group/old-k8s-version/serial/AddonExistsAfterStop (6.12s)

                                                
                                                
=== RUN   TestStartStop/group/old-k8s-version/serial/AddonExistsAfterStop
start_stop_delete_test.go:287: (dbg) TestStartStop/group/old-k8s-version/serial/AddonExistsAfterStop: waiting 9m0s for pods matching "k8s-app=kubernetes-dashboard" in namespace "kubernetes-dashboard" ...
helpers_test.go:344: "kubernetes-dashboard-cd95d586-c7zlw" [49212a1e-41f8-4a05-851b-75b2d5b48278] Running
start_stop_delete_test.go:287: (dbg) TestStartStop/group/old-k8s-version/serial/AddonExistsAfterStop: k8s-app=kubernetes-dashboard healthy within 6.003708302s
start_stop_delete_test.go:291: (dbg) Run:  kubectl --context old-k8s-version-884192 describe deploy/dashboard-metrics-scraper -n kubernetes-dashboard
--- PASS: TestStartStop/group/old-k8s-version/serial/AddonExistsAfterStop (6.12s)

                                                
                                    
x
+
TestStartStop/group/old-k8s-version/serial/VerifyKubernetesImages (0.28s)

                                                
                                                
=== RUN   TestStartStop/group/old-k8s-version/serial/VerifyKubernetesImages
start_stop_delete_test.go:304: (dbg) Run:  out/minikube-linux-arm64 -p old-k8s-version-884192 image list --format=json
start_stop_delete_test.go:304: Found non-minikube image: kindest/kindnetd:v20240719-e7903573
start_stop_delete_test.go:304: Found non-minikube image: gcr.io/k8s-minikube/busybox:1.28.4-glibc
start_stop_delete_test.go:304: Found non-minikube image: kindest/kindnetd:v20240202-8f1494ea
--- PASS: TestStartStop/group/old-k8s-version/serial/VerifyKubernetesImages (0.28s)

                                                
                                    
x
+
TestStartStop/group/old-k8s-version/serial/Pause (3.62s)

                                                
                                                
=== RUN   TestStartStop/group/old-k8s-version/serial/Pause
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 pause -p old-k8s-version-884192 --alsologtostderr -v=1
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 status --format={{.APIServer}} -p old-k8s-version-884192 -n old-k8s-version-884192
start_stop_delete_test.go:311: (dbg) Non-zero exit: out/minikube-linux-arm64 status --format={{.APIServer}} -p old-k8s-version-884192 -n old-k8s-version-884192: exit status 2 (406.07591ms)

                                                
                                                
-- stdout --
	Paused

                                                
                                                
-- /stdout --
start_stop_delete_test.go:311: status error: exit status 2 (may be ok)
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 status --format={{.Kubelet}} -p old-k8s-version-884192 -n old-k8s-version-884192
start_stop_delete_test.go:311: (dbg) Non-zero exit: out/minikube-linux-arm64 status --format={{.Kubelet}} -p old-k8s-version-884192 -n old-k8s-version-884192: exit status 2 (403.282713ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
start_stop_delete_test.go:311: status error: exit status 2 (may be ok)
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 unpause -p old-k8s-version-884192 --alsologtostderr -v=1
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 status --format={{.APIServer}} -p old-k8s-version-884192 -n old-k8s-version-884192
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 status --format={{.Kubelet}} -p old-k8s-version-884192 -n old-k8s-version-884192
--- PASS: TestStartStop/group/old-k8s-version/serial/Pause (3.62s)

                                                
                                    
x
+
TestStartStop/group/default-k8s-diff-port/serial/FirstStart (78.55s)

                                                
                                                
=== RUN   TestStartStop/group/default-k8s-diff-port/serial/FirstStart
start_stop_delete_test.go:186: (dbg) Run:  out/minikube-linux-arm64 start -p default-k8s-diff-port-491659 --memory=2200 --alsologtostderr --wait=true --apiserver-port=8444 --driver=docker  --container-runtime=containerd --kubernetes-version=v1.30.3
start_stop_delete_test.go:186: (dbg) Done: out/minikube-linux-arm64 start -p default-k8s-diff-port-491659 --memory=2200 --alsologtostderr --wait=true --apiserver-port=8444 --driver=docker  --container-runtime=containerd --kubernetes-version=v1.30.3: (1m18.545055855s)
--- PASS: TestStartStop/group/default-k8s-diff-port/serial/FirstStart (78.55s)

                                                
                                    
x
+
TestStartStop/group/embed-certs/serial/DeployApp (8.34s)

                                                
                                                
=== RUN   TestStartStop/group/embed-certs/serial/DeployApp
start_stop_delete_test.go:196: (dbg) Run:  kubectl --context embed-certs-159530 create -f testdata/busybox.yaml
start_stop_delete_test.go:196: (dbg) TestStartStop/group/embed-certs/serial/DeployApp: waiting 8m0s for pods matching "integration-test=busybox" in namespace "default" ...
helpers_test.go:344: "busybox" [2b27ee89-67cb-41d4-909d-ce4b45b44f6b] Pending
helpers_test.go:344: "busybox" [2b27ee89-67cb-41d4-909d-ce4b45b44f6b] Pending / Ready:ContainersNotReady (containers with unready status: [busybox]) / ContainersReady:ContainersNotReady (containers with unready status: [busybox])
helpers_test.go:344: "busybox" [2b27ee89-67cb-41d4-909d-ce4b45b44f6b] Running
E0729 21:10:53.505567  139728 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19339-134334/.minikube/profiles/functional-479263/client.crt: no such file or directory
start_stop_delete_test.go:196: (dbg) TestStartStop/group/embed-certs/serial/DeployApp: integration-test=busybox healthy within 8.004243133s
start_stop_delete_test.go:196: (dbg) Run:  kubectl --context embed-certs-159530 exec busybox -- /bin/sh -c "ulimit -n"
--- PASS: TestStartStop/group/embed-certs/serial/DeployApp (8.34s)

                                                
                                    
x
+
TestStartStop/group/embed-certs/serial/EnableAddonWhileActive (1.13s)

                                                
                                                
=== RUN   TestStartStop/group/embed-certs/serial/EnableAddonWhileActive
start_stop_delete_test.go:205: (dbg) Run:  out/minikube-linux-arm64 addons enable metrics-server -p embed-certs-159530 --images=MetricsServer=registry.k8s.io/echoserver:1.4 --registries=MetricsServer=fake.domain
start_stop_delete_test.go:205: (dbg) Done: out/minikube-linux-arm64 addons enable metrics-server -p embed-certs-159530 --images=MetricsServer=registry.k8s.io/echoserver:1.4 --registries=MetricsServer=fake.domain: (1.000362862s)
start_stop_delete_test.go:215: (dbg) Run:  kubectl --context embed-certs-159530 describe deploy/metrics-server -n kube-system
--- PASS: TestStartStop/group/embed-certs/serial/EnableAddonWhileActive (1.13s)

                                                
                                    
x
+
TestStartStop/group/embed-certs/serial/Stop (12.03s)

                                                
                                                
=== RUN   TestStartStop/group/embed-certs/serial/Stop
start_stop_delete_test.go:228: (dbg) Run:  out/minikube-linux-arm64 stop -p embed-certs-159530 --alsologtostderr -v=3
start_stop_delete_test.go:228: (dbg) Done: out/minikube-linux-arm64 stop -p embed-certs-159530 --alsologtostderr -v=3: (12.032577944s)
--- PASS: TestStartStop/group/embed-certs/serial/Stop (12.03s)

                                                
                                    
x
+
TestStartStop/group/embed-certs/serial/EnableAddonAfterStop (0.19s)

                                                
                                                
=== RUN   TestStartStop/group/embed-certs/serial/EnableAddonAfterStop
start_stop_delete_test.go:239: (dbg) Run:  out/minikube-linux-arm64 status --format={{.Host}} -p embed-certs-159530 -n embed-certs-159530
start_stop_delete_test.go:239: (dbg) Non-zero exit: out/minikube-linux-arm64 status --format={{.Host}} -p embed-certs-159530 -n embed-certs-159530: exit status 7 (65.523491ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
start_stop_delete_test.go:239: status error: exit status 7 (may be ok)
start_stop_delete_test.go:246: (dbg) Run:  out/minikube-linux-arm64 addons enable dashboard -p embed-certs-159530 --images=MetricsScraper=registry.k8s.io/echoserver:1.4
--- PASS: TestStartStop/group/embed-certs/serial/EnableAddonAfterStop (0.19s)

                                                
                                    
x
+
TestStartStop/group/embed-certs/serial/SecondStart (289.46s)

                                                
                                                
=== RUN   TestStartStop/group/embed-certs/serial/SecondStart
start_stop_delete_test.go:256: (dbg) Run:  out/minikube-linux-arm64 start -p embed-certs-159530 --memory=2200 --alsologtostderr --wait=true --embed-certs --driver=docker  --container-runtime=containerd --kubernetes-version=v1.30.3
start_stop_delete_test.go:256: (dbg) Done: out/minikube-linux-arm64 start -p embed-certs-159530 --memory=2200 --alsologtostderr --wait=true --embed-certs --driver=docker  --container-runtime=containerd --kubernetes-version=v1.30.3: (4m49.077922334s)
start_stop_delete_test.go:262: (dbg) Run:  out/minikube-linux-arm64 status --format={{.Host}} -p embed-certs-159530 -n embed-certs-159530
--- PASS: TestStartStop/group/embed-certs/serial/SecondStart (289.46s)

                                                
                                    
x
+
TestStartStop/group/default-k8s-diff-port/serial/DeployApp (10.49s)

                                                
                                                
=== RUN   TestStartStop/group/default-k8s-diff-port/serial/DeployApp
start_stop_delete_test.go:196: (dbg) Run:  kubectl --context default-k8s-diff-port-491659 create -f testdata/busybox.yaml
start_stop_delete_test.go:196: (dbg) TestStartStop/group/default-k8s-diff-port/serial/DeployApp: waiting 8m0s for pods matching "integration-test=busybox" in namespace "default" ...
helpers_test.go:344: "busybox" [27666350-2851-4a58-bf31-7fbd2aac06ae] Pending / Ready:ContainersNotReady (containers with unready status: [busybox]) / ContainersReady:ContainersNotReady (containers with unready status: [busybox])
helpers_test.go:344: "busybox" [27666350-2851-4a58-bf31-7fbd2aac06ae] Running
start_stop_delete_test.go:196: (dbg) TestStartStop/group/default-k8s-diff-port/serial/DeployApp: integration-test=busybox healthy within 10.003857859s
start_stop_delete_test.go:196: (dbg) Run:  kubectl --context default-k8s-diff-port-491659 exec busybox -- /bin/sh -c "ulimit -n"
--- PASS: TestStartStop/group/default-k8s-diff-port/serial/DeployApp (10.49s)

                                                
                                    
x
+
TestStartStop/group/default-k8s-diff-port/serial/EnableAddonWhileActive (1.67s)

                                                
                                                
=== RUN   TestStartStop/group/default-k8s-diff-port/serial/EnableAddonWhileActive
start_stop_delete_test.go:205: (dbg) Run:  out/minikube-linux-arm64 addons enable metrics-server -p default-k8s-diff-port-491659 --images=MetricsServer=registry.k8s.io/echoserver:1.4 --registries=MetricsServer=fake.domain
start_stop_delete_test.go:205: (dbg) Done: out/minikube-linux-arm64 addons enable metrics-server -p default-k8s-diff-port-491659 --images=MetricsServer=registry.k8s.io/echoserver:1.4 --registries=MetricsServer=fake.domain: (1.513167512s)
start_stop_delete_test.go:215: (dbg) Run:  kubectl --context default-k8s-diff-port-491659 describe deploy/metrics-server -n kube-system
--- PASS: TestStartStop/group/default-k8s-diff-port/serial/EnableAddonWhileActive (1.67s)

                                                
                                    
x
+
TestStartStop/group/default-k8s-diff-port/serial/Stop (12.21s)

                                                
                                                
=== RUN   TestStartStop/group/default-k8s-diff-port/serial/Stop
start_stop_delete_test.go:228: (dbg) Run:  out/minikube-linux-arm64 stop -p default-k8s-diff-port-491659 --alsologtostderr -v=3
start_stop_delete_test.go:228: (dbg) Done: out/minikube-linux-arm64 stop -p default-k8s-diff-port-491659 --alsologtostderr -v=3: (12.21477931s)
--- PASS: TestStartStop/group/default-k8s-diff-port/serial/Stop (12.21s)

                                                
                                    
x
+
TestStartStop/group/default-k8s-diff-port/serial/EnableAddonAfterStop (0.19s)

                                                
                                                
=== RUN   TestStartStop/group/default-k8s-diff-port/serial/EnableAddonAfterStop
start_stop_delete_test.go:239: (dbg) Run:  out/minikube-linux-arm64 status --format={{.Host}} -p default-k8s-diff-port-491659 -n default-k8s-diff-port-491659
start_stop_delete_test.go:239: (dbg) Non-zero exit: out/minikube-linux-arm64 status --format={{.Host}} -p default-k8s-diff-port-491659 -n default-k8s-diff-port-491659: exit status 7 (73.601591ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
start_stop_delete_test.go:239: status error: exit status 7 (may be ok)
start_stop_delete_test.go:246: (dbg) Run:  out/minikube-linux-arm64 addons enable dashboard -p default-k8s-diff-port-491659 --images=MetricsScraper=registry.k8s.io/echoserver:1.4
--- PASS: TestStartStop/group/default-k8s-diff-port/serial/EnableAddonAfterStop (0.19s)

                                                
                                    
x
+
TestStartStop/group/default-k8s-diff-port/serial/SecondStart (270.18s)

                                                
                                                
=== RUN   TestStartStop/group/default-k8s-diff-port/serial/SecondStart
start_stop_delete_test.go:256: (dbg) Run:  out/minikube-linux-arm64 start -p default-k8s-diff-port-491659 --memory=2200 --alsologtostderr --wait=true --apiserver-port=8444 --driver=docker  --container-runtime=containerd --kubernetes-version=v1.30.3
E0729 21:11:56.780884  139728 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19339-134334/.minikube/profiles/addons-675434/client.crt: no such file or directory
E0729 21:12:58.997430  139728 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19339-134334/.minikube/profiles/old-k8s-version-884192/client.crt: no such file or directory
E0729 21:12:59.002988  139728 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19339-134334/.minikube/profiles/old-k8s-version-884192/client.crt: no such file or directory
E0729 21:12:59.013219  139728 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19339-134334/.minikube/profiles/old-k8s-version-884192/client.crt: no such file or directory
E0729 21:12:59.033463  139728 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19339-134334/.minikube/profiles/old-k8s-version-884192/client.crt: no such file or directory
E0729 21:12:59.073783  139728 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19339-134334/.minikube/profiles/old-k8s-version-884192/client.crt: no such file or directory
E0729 21:12:59.154064  139728 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19339-134334/.minikube/profiles/old-k8s-version-884192/client.crt: no such file or directory
E0729 21:12:59.314537  139728 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19339-134334/.minikube/profiles/old-k8s-version-884192/client.crt: no such file or directory
E0729 21:12:59.635089  139728 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19339-134334/.minikube/profiles/old-k8s-version-884192/client.crt: no such file or directory
E0729 21:13:00.275315  139728 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19339-134334/.minikube/profiles/old-k8s-version-884192/client.crt: no such file or directory
E0729 21:13:01.555607  139728 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19339-134334/.minikube/profiles/old-k8s-version-884192/client.crt: no such file or directory
E0729 21:13:04.116302  139728 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19339-134334/.minikube/profiles/old-k8s-version-884192/client.crt: no such file or directory
E0729 21:13:09.237212  139728 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19339-134334/.minikube/profiles/old-k8s-version-884192/client.crt: no such file or directory
E0729 21:13:19.477753  139728 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19339-134334/.minikube/profiles/old-k8s-version-884192/client.crt: no such file or directory
E0729 21:13:39.957989  139728 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19339-134334/.minikube/profiles/old-k8s-version-884192/client.crt: no such file or directory
E0729 21:14:20.919015  139728 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19339-134334/.minikube/profiles/old-k8s-version-884192/client.crt: no such file or directory
E0729 21:14:23.314533  139728 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19339-134334/.minikube/profiles/no-preload-992167/client.crt: no such file or directory
E0729 21:14:23.319781  139728 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19339-134334/.minikube/profiles/no-preload-992167/client.crt: no such file or directory
E0729 21:14:23.330123  139728 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19339-134334/.minikube/profiles/no-preload-992167/client.crt: no such file or directory
E0729 21:14:23.350462  139728 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19339-134334/.minikube/profiles/no-preload-992167/client.crt: no such file or directory
E0729 21:14:23.390702  139728 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19339-134334/.minikube/profiles/no-preload-992167/client.crt: no such file or directory
E0729 21:14:23.471021  139728 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19339-134334/.minikube/profiles/no-preload-992167/client.crt: no such file or directory
E0729 21:14:23.631674  139728 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19339-134334/.minikube/profiles/no-preload-992167/client.crt: no such file or directory
E0729 21:14:23.952161  139728 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19339-134334/.minikube/profiles/no-preload-992167/client.crt: no such file or directory
E0729 21:14:24.592606  139728 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19339-134334/.minikube/profiles/no-preload-992167/client.crt: no such file or directory
E0729 21:14:25.872836  139728 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19339-134334/.minikube/profiles/no-preload-992167/client.crt: no such file or directory
E0729 21:14:28.433428  139728 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19339-134334/.minikube/profiles/no-preload-992167/client.crt: no such file or directory
E0729 21:14:33.554334  139728 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19339-134334/.minikube/profiles/no-preload-992167/client.crt: no such file or directory
E0729 21:14:43.794920  139728 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19339-134334/.minikube/profiles/no-preload-992167/client.crt: no such file or directory
E0729 21:15:04.275299  139728 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19339-134334/.minikube/profiles/no-preload-992167/client.crt: no such file or directory
E0729 21:15:42.839820  139728 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19339-134334/.minikube/profiles/old-k8s-version-884192/client.crt: no such file or directory
E0729 21:15:45.235562  139728 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19339-134334/.minikube/profiles/no-preload-992167/client.crt: no such file or directory
E0729 21:15:53.505851  139728 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19339-134334/.minikube/profiles/functional-479263/client.crt: no such file or directory
start_stop_delete_test.go:256: (dbg) Done: out/minikube-linux-arm64 start -p default-k8s-diff-port-491659 --memory=2200 --alsologtostderr --wait=true --apiserver-port=8444 --driver=docker  --container-runtime=containerd --kubernetes-version=v1.30.3: (4m29.79490419s)
start_stop_delete_test.go:262: (dbg) Run:  out/minikube-linux-arm64 status --format={{.Host}} -p default-k8s-diff-port-491659 -n default-k8s-diff-port-491659
--- PASS: TestStartStop/group/default-k8s-diff-port/serial/SecondStart (270.18s)

                                                
                                    
x
+
TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop (6.01s)

                                                
                                                
=== RUN   TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop
start_stop_delete_test.go:274: (dbg) TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: waiting 9m0s for pods matching "k8s-app=kubernetes-dashboard" in namespace "kubernetes-dashboard" ...
helpers_test.go:344: "kubernetes-dashboard-779776cb65-vtmzd" [47494c20-2a1f-4f81-963b-264001e7a170] Running
start_stop_delete_test.go:274: (dbg) TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: k8s-app=kubernetes-dashboard healthy within 6.003926748s
--- PASS: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop (6.01s)

                                                
                                    
x
+
TestStartStop/group/embed-certs/serial/AddonExistsAfterStop (5.11s)

                                                
                                                
=== RUN   TestStartStop/group/embed-certs/serial/AddonExistsAfterStop
start_stop_delete_test.go:287: (dbg) TestStartStop/group/embed-certs/serial/AddonExistsAfterStop: waiting 9m0s for pods matching "k8s-app=kubernetes-dashboard" in namespace "kubernetes-dashboard" ...
helpers_test.go:344: "kubernetes-dashboard-779776cb65-vtmzd" [47494c20-2a1f-4f81-963b-264001e7a170] Running
start_stop_delete_test.go:287: (dbg) TestStartStop/group/embed-certs/serial/AddonExistsAfterStop: k8s-app=kubernetes-dashboard healthy within 5.003812448s
start_stop_delete_test.go:291: (dbg) Run:  kubectl --context embed-certs-159530 describe deploy/dashboard-metrics-scraper -n kubernetes-dashboard
--- PASS: TestStartStop/group/embed-certs/serial/AddonExistsAfterStop (5.11s)

                                                
                                    
x
+
TestStartStop/group/default-k8s-diff-port/serial/UserAppExistsAfterStop (6.01s)

                                                
                                                
=== RUN   TestStartStop/group/default-k8s-diff-port/serial/UserAppExistsAfterStop
start_stop_delete_test.go:274: (dbg) TestStartStop/group/default-k8s-diff-port/serial/UserAppExistsAfterStop: waiting 9m0s for pods matching "k8s-app=kubernetes-dashboard" in namespace "kubernetes-dashboard" ...
helpers_test.go:344: "kubernetes-dashboard-779776cb65-w8kkf" [b45ac309-6228-4655-9cce-8084896477b9] Running
start_stop_delete_test.go:274: (dbg) TestStartStop/group/default-k8s-diff-port/serial/UserAppExistsAfterStop: k8s-app=kubernetes-dashboard healthy within 6.00442606s
--- PASS: TestStartStop/group/default-k8s-diff-port/serial/UserAppExistsAfterStop (6.01s)

                                                
                                    
x
+
TestStartStop/group/embed-certs/serial/VerifyKubernetesImages (0.26s)

                                                
                                                
=== RUN   TestStartStop/group/embed-certs/serial/VerifyKubernetesImages
start_stop_delete_test.go:304: (dbg) Run:  out/minikube-linux-arm64 -p embed-certs-159530 image list --format=json
start_stop_delete_test.go:304: Found non-minikube image: kindest/kindnetd:v20240715-585640e9
start_stop_delete_test.go:304: Found non-minikube image: kindest/kindnetd:v20240719-e7903573
start_stop_delete_test.go:304: Found non-minikube image: gcr.io/k8s-minikube/busybox:1.28.4-glibc
--- PASS: TestStartStop/group/embed-certs/serial/VerifyKubernetesImages (0.26s)

                                                
                                    
x
+
TestStartStop/group/embed-certs/serial/Pause (3.15s)

                                                
                                                
=== RUN   TestStartStop/group/embed-certs/serial/Pause
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 pause -p embed-certs-159530 --alsologtostderr -v=1
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 status --format={{.APIServer}} -p embed-certs-159530 -n embed-certs-159530
start_stop_delete_test.go:311: (dbg) Non-zero exit: out/minikube-linux-arm64 status --format={{.APIServer}} -p embed-certs-159530 -n embed-certs-159530: exit status 2 (350.51468ms)

                                                
                                                
-- stdout --
	Paused

                                                
                                                
-- /stdout --
start_stop_delete_test.go:311: status error: exit status 2 (may be ok)
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 status --format={{.Kubelet}} -p embed-certs-159530 -n embed-certs-159530
start_stop_delete_test.go:311: (dbg) Non-zero exit: out/minikube-linux-arm64 status --format={{.Kubelet}} -p embed-certs-159530 -n embed-certs-159530: exit status 2 (333.679236ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
start_stop_delete_test.go:311: status error: exit status 2 (may be ok)
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 unpause -p embed-certs-159530 --alsologtostderr -v=1
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 status --format={{.APIServer}} -p embed-certs-159530 -n embed-certs-159530
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 status --format={{.Kubelet}} -p embed-certs-159530 -n embed-certs-159530
--- PASS: TestStartStop/group/embed-certs/serial/Pause (3.15s)

                                                
                                    
x
+
TestStartStop/group/default-k8s-diff-port/serial/AddonExistsAfterStop (6.12s)

                                                
                                                
=== RUN   TestStartStop/group/default-k8s-diff-port/serial/AddonExistsAfterStop
start_stop_delete_test.go:287: (dbg) TestStartStop/group/default-k8s-diff-port/serial/AddonExistsAfterStop: waiting 9m0s for pods matching "k8s-app=kubernetes-dashboard" in namespace "kubernetes-dashboard" ...
helpers_test.go:344: "kubernetes-dashboard-779776cb65-w8kkf" [b45ac309-6228-4655-9cce-8084896477b9] Running
start_stop_delete_test.go:287: (dbg) TestStartStop/group/default-k8s-diff-port/serial/AddonExistsAfterStop: k8s-app=kubernetes-dashboard healthy within 6.004118013s
start_stop_delete_test.go:291: (dbg) Run:  kubectl --context default-k8s-diff-port-491659 describe deploy/dashboard-metrics-scraper -n kubernetes-dashboard
--- PASS: TestStartStop/group/default-k8s-diff-port/serial/AddonExistsAfterStop (6.12s)

                                                
                                    
x
+
TestStartStop/group/newest-cni/serial/FirstStart (47.43s)

                                                
                                                
=== RUN   TestStartStop/group/newest-cni/serial/FirstStart
start_stop_delete_test.go:186: (dbg) Run:  out/minikube-linux-arm64 start -p newest-cni-654211 --memory=2200 --alsologtostderr --wait=apiserver,system_pods,default_sa --feature-gates ServerSideApply=true --network-plugin=cni --extra-config=kubeadm.pod-network-cidr=10.42.0.0/16 --driver=docker  --container-runtime=containerd --kubernetes-version=v1.31.0-beta.0
start_stop_delete_test.go:186: (dbg) Done: out/minikube-linux-arm64 start -p newest-cni-654211 --memory=2200 --alsologtostderr --wait=apiserver,system_pods,default_sa --feature-gates ServerSideApply=true --network-plugin=cni --extra-config=kubeadm.pod-network-cidr=10.42.0.0/16 --driver=docker  --container-runtime=containerd --kubernetes-version=v1.31.0-beta.0: (47.430460995s)
--- PASS: TestStartStop/group/newest-cni/serial/FirstStart (47.43s)

                                                
                                    
x
+
TestStartStop/group/default-k8s-diff-port/serial/VerifyKubernetesImages (0.26s)

                                                
                                                
=== RUN   TestStartStop/group/default-k8s-diff-port/serial/VerifyKubernetesImages
start_stop_delete_test.go:304: (dbg) Run:  out/minikube-linux-arm64 -p default-k8s-diff-port-491659 image list --format=json
start_stop_delete_test.go:304: Found non-minikube image: kindest/kindnetd:v20240719-e7903573
start_stop_delete_test.go:304: Found non-minikube image: gcr.io/k8s-minikube/busybox:1.28.4-glibc
start_stop_delete_test.go:304: Found non-minikube image: kindest/kindnetd:v20240715-585640e9
--- PASS: TestStartStop/group/default-k8s-diff-port/serial/VerifyKubernetesImages (0.26s)

                                                
                                    
x
+
TestStartStop/group/default-k8s-diff-port/serial/Pause (4.02s)

                                                
                                                
=== RUN   TestStartStop/group/default-k8s-diff-port/serial/Pause
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 pause -p default-k8s-diff-port-491659 --alsologtostderr -v=1
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 status --format={{.APIServer}} -p default-k8s-diff-port-491659 -n default-k8s-diff-port-491659
start_stop_delete_test.go:311: (dbg) Non-zero exit: out/minikube-linux-arm64 status --format={{.APIServer}} -p default-k8s-diff-port-491659 -n default-k8s-diff-port-491659: exit status 2 (386.093181ms)

                                                
                                                
-- stdout --
	Paused

                                                
                                                
-- /stdout --
start_stop_delete_test.go:311: status error: exit status 2 (may be ok)
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 status --format={{.Kubelet}} -p default-k8s-diff-port-491659 -n default-k8s-diff-port-491659
start_stop_delete_test.go:311: (dbg) Non-zero exit: out/minikube-linux-arm64 status --format={{.Kubelet}} -p default-k8s-diff-port-491659 -n default-k8s-diff-port-491659: exit status 2 (442.004525ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
start_stop_delete_test.go:311: status error: exit status 2 (may be ok)
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 unpause -p default-k8s-diff-port-491659 --alsologtostderr -v=1
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 status --format={{.APIServer}} -p default-k8s-diff-port-491659 -n default-k8s-diff-port-491659
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 status --format={{.Kubelet}} -p default-k8s-diff-port-491659 -n default-k8s-diff-port-491659
--- PASS: TestStartStop/group/default-k8s-diff-port/serial/Pause (4.02s)

                                                
                                    
x
+
TestNetworkPlugins/group/auto/Start (69.33s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/auto/Start
net_test.go:112: (dbg) Run:  out/minikube-linux-arm64 start -p auto-341440 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --driver=docker  --container-runtime=containerd
E0729 21:16:39.831406  139728 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19339-134334/.minikube/profiles/addons-675434/client.crt: no such file or directory
E0729 21:16:56.780820  139728 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19339-134334/.minikube/profiles/addons-675434/client.crt: no such file or directory
net_test.go:112: (dbg) Done: out/minikube-linux-arm64 start -p auto-341440 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --driver=docker  --container-runtime=containerd: (1m9.32795072s)
--- PASS: TestNetworkPlugins/group/auto/Start (69.33s)

                                                
                                    
x
+
TestStartStop/group/newest-cni/serial/DeployApp (0s)

                                                
                                                
=== RUN   TestStartStop/group/newest-cni/serial/DeployApp
--- PASS: TestStartStop/group/newest-cni/serial/DeployApp (0.00s)

                                                
                                    
x
+
TestStartStop/group/newest-cni/serial/EnableAddonWhileActive (2.17s)

                                                
                                                
=== RUN   TestStartStop/group/newest-cni/serial/EnableAddonWhileActive
start_stop_delete_test.go:205: (dbg) Run:  out/minikube-linux-arm64 addons enable metrics-server -p newest-cni-654211 --images=MetricsServer=registry.k8s.io/echoserver:1.4 --registries=MetricsServer=fake.domain
E0729 21:17:07.156338  139728 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19339-134334/.minikube/profiles/no-preload-992167/client.crt: no such file or directory
start_stop_delete_test.go:205: (dbg) Done: out/minikube-linux-arm64 addons enable metrics-server -p newest-cni-654211 --images=MetricsServer=registry.k8s.io/echoserver:1.4 --registries=MetricsServer=fake.domain: (2.170182195s)
start_stop_delete_test.go:211: WARNING: cni mode requires additional setup before pods can schedule :(
--- PASS: TestStartStop/group/newest-cni/serial/EnableAddonWhileActive (2.17s)

                                                
                                    
x
+
TestStartStop/group/newest-cni/serial/Stop (1.3s)

                                                
                                                
=== RUN   TestStartStop/group/newest-cni/serial/Stop
start_stop_delete_test.go:228: (dbg) Run:  out/minikube-linux-arm64 stop -p newest-cni-654211 --alsologtostderr -v=3
start_stop_delete_test.go:228: (dbg) Done: out/minikube-linux-arm64 stop -p newest-cni-654211 --alsologtostderr -v=3: (1.304441388s)
--- PASS: TestStartStop/group/newest-cni/serial/Stop (1.30s)

                                                
                                    
x
+
TestStartStop/group/newest-cni/serial/EnableAddonAfterStop (0.22s)

                                                
                                                
=== RUN   TestStartStop/group/newest-cni/serial/EnableAddonAfterStop
start_stop_delete_test.go:239: (dbg) Run:  out/minikube-linux-arm64 status --format={{.Host}} -p newest-cni-654211 -n newest-cni-654211
start_stop_delete_test.go:239: (dbg) Non-zero exit: out/minikube-linux-arm64 status --format={{.Host}} -p newest-cni-654211 -n newest-cni-654211: exit status 7 (82.988527ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
start_stop_delete_test.go:239: status error: exit status 7 (may be ok)
start_stop_delete_test.go:246: (dbg) Run:  out/minikube-linux-arm64 addons enable dashboard -p newest-cni-654211 --images=MetricsScraper=registry.k8s.io/echoserver:1.4
--- PASS: TestStartStop/group/newest-cni/serial/EnableAddonAfterStop (0.22s)

                                                
                                    
x
+
TestStartStop/group/newest-cni/serial/SecondStart (19.62s)

                                                
                                                
=== RUN   TestStartStop/group/newest-cni/serial/SecondStart
start_stop_delete_test.go:256: (dbg) Run:  out/minikube-linux-arm64 start -p newest-cni-654211 --memory=2200 --alsologtostderr --wait=apiserver,system_pods,default_sa --feature-gates ServerSideApply=true --network-plugin=cni --extra-config=kubeadm.pod-network-cidr=10.42.0.0/16 --driver=docker  --container-runtime=containerd --kubernetes-version=v1.31.0-beta.0
start_stop_delete_test.go:256: (dbg) Done: out/minikube-linux-arm64 start -p newest-cni-654211 --memory=2200 --alsologtostderr --wait=apiserver,system_pods,default_sa --feature-gates ServerSideApply=true --network-plugin=cni --extra-config=kubeadm.pod-network-cidr=10.42.0.0/16 --driver=docker  --container-runtime=containerd --kubernetes-version=v1.31.0-beta.0: (19.224469615s)
start_stop_delete_test.go:262: (dbg) Run:  out/minikube-linux-arm64 status --format={{.Host}} -p newest-cni-654211 -n newest-cni-654211
--- PASS: TestStartStop/group/newest-cni/serial/SecondStart (19.62s)

                                                
                                    
x
+
TestStartStop/group/newest-cni/serial/UserAppExistsAfterStop (0s)

                                                
                                                
=== RUN   TestStartStop/group/newest-cni/serial/UserAppExistsAfterStop
start_stop_delete_test.go:273: WARNING: cni mode requires additional setup before pods can schedule :(
--- PASS: TestStartStop/group/newest-cni/serial/UserAppExistsAfterStop (0.00s)

                                                
                                    
x
+
TestStartStop/group/newest-cni/serial/AddonExistsAfterStop (0s)

                                                
                                                
=== RUN   TestStartStop/group/newest-cni/serial/AddonExistsAfterStop
start_stop_delete_test.go:284: WARNING: cni mode requires additional setup before pods can schedule :(
--- PASS: TestStartStop/group/newest-cni/serial/AddonExistsAfterStop (0.00s)

                                                
                                    
x
+
TestStartStop/group/newest-cni/serial/VerifyKubernetesImages (0.25s)

                                                
                                                
=== RUN   TestStartStop/group/newest-cni/serial/VerifyKubernetesImages
start_stop_delete_test.go:304: (dbg) Run:  out/minikube-linux-arm64 -p newest-cni-654211 image list --format=json
start_stop_delete_test.go:304: Found non-minikube image: kindest/kindnetd:v20240715-f6ad1f6e
start_stop_delete_test.go:304: Found non-minikube image: kindest/kindnetd:v20240719-e7903573
--- PASS: TestStartStop/group/newest-cni/serial/VerifyKubernetesImages (0.25s)

                                                
                                    
x
+
TestStartStop/group/newest-cni/serial/Pause (3.11s)

                                                
                                                
=== RUN   TestStartStop/group/newest-cni/serial/Pause
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 pause -p newest-cni-654211 --alsologtostderr -v=1
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 status --format={{.APIServer}} -p newest-cni-654211 -n newest-cni-654211
start_stop_delete_test.go:311: (dbg) Non-zero exit: out/minikube-linux-arm64 status --format={{.APIServer}} -p newest-cni-654211 -n newest-cni-654211: exit status 2 (323.177201ms)

                                                
                                                
-- stdout --
	Paused

                                                
                                                
-- /stdout --
start_stop_delete_test.go:311: status error: exit status 2 (may be ok)
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 status --format={{.Kubelet}} -p newest-cni-654211 -n newest-cni-654211
start_stop_delete_test.go:311: (dbg) Non-zero exit: out/minikube-linux-arm64 status --format={{.Kubelet}} -p newest-cni-654211 -n newest-cni-654211: exit status 2 (336.405295ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
start_stop_delete_test.go:311: status error: exit status 2 (may be ok)
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 unpause -p newest-cni-654211 --alsologtostderr -v=1
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 status --format={{.APIServer}} -p newest-cni-654211 -n newest-cni-654211
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 status --format={{.Kubelet}} -p newest-cni-654211 -n newest-cni-654211
--- PASS: TestStartStop/group/newest-cni/serial/Pause (3.11s)
E0729 21:22:50.121136  139728 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19339-134334/.minikube/profiles/auto-341440/client.crt: no such file or directory
E0729 21:22:58.997447  139728 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19339-134334/.minikube/profiles/old-k8s-version-884192/client.crt: no such file or directory
E0729 21:23:00.361320  139728 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19339-134334/.minikube/profiles/auto-341440/client.crt: no such file or directory

                                                
                                    
x
+
TestNetworkPlugins/group/kindnet/Start (65.73s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/kindnet/Start
net_test.go:112: (dbg) Run:  out/minikube-linux-arm64 start -p kindnet-341440 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --cni=kindnet --driver=docker  --container-runtime=containerd
net_test.go:112: (dbg) Done: out/minikube-linux-arm64 start -p kindnet-341440 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --cni=kindnet --driver=docker  --container-runtime=containerd: (1m5.72587439s)
--- PASS: TestNetworkPlugins/group/kindnet/Start (65.73s)

                                                
                                    
x
+
TestNetworkPlugins/group/auto/KubeletFlags (0.38s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/auto/KubeletFlags
net_test.go:133: (dbg) Run:  out/minikube-linux-arm64 ssh -p auto-341440 "pgrep -a kubelet"
--- PASS: TestNetworkPlugins/group/auto/KubeletFlags (0.38s)

                                                
                                    
x
+
TestNetworkPlugins/group/auto/NetCatPod (11.45s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/auto/NetCatPod
net_test.go:149: (dbg) Run:  kubectl --context auto-341440 replace --force -f testdata/netcat-deployment.yaml
net_test.go:163: (dbg) TestNetworkPlugins/group/auto/NetCatPod: waiting 15m0s for pods matching "app=netcat" in namespace "default" ...
helpers_test.go:344: "netcat-6bc787d567-p4k4g" [4fe154fc-98d4-4f21-9196-18836443c663] Pending / Ready:ContainersNotReady (containers with unready status: [dnsutils]) / ContainersReady:ContainersNotReady (containers with unready status: [dnsutils])
helpers_test.go:344: "netcat-6bc787d567-p4k4g" [4fe154fc-98d4-4f21-9196-18836443c663] Running
net_test.go:163: (dbg) TestNetworkPlugins/group/auto/NetCatPod: app=netcat healthy within 11.004274256s
--- PASS: TestNetworkPlugins/group/auto/NetCatPod (11.45s)

                                                
                                    
x
+
TestNetworkPlugins/group/auto/DNS (0.27s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/auto/DNS
net_test.go:175: (dbg) Run:  kubectl --context auto-341440 exec deployment/netcat -- nslookup kubernetes.default
--- PASS: TestNetworkPlugins/group/auto/DNS (0.27s)

                                                
                                    
x
+
TestNetworkPlugins/group/auto/Localhost (0.24s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/auto/Localhost
net_test.go:194: (dbg) Run:  kubectl --context auto-341440 exec deployment/netcat -- /bin/sh -c "nc -w 5 -i 5 -z localhost 8080"
--- PASS: TestNetworkPlugins/group/auto/Localhost (0.24s)

                                                
                                    
x
+
TestNetworkPlugins/group/auto/HairPin (0.18s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/auto/HairPin
net_test.go:264: (dbg) Run:  kubectl --context auto-341440 exec deployment/netcat -- /bin/sh -c "nc -w 5 -i 5 -z netcat 8080"
--- PASS: TestNetworkPlugins/group/auto/HairPin (0.18s)

                                                
                                    
x
+
TestNetworkPlugins/group/calico/Start (78.01s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/calico/Start
net_test.go:112: (dbg) Run:  out/minikube-linux-arm64 start -p calico-341440 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --cni=calico --driver=docker  --container-runtime=containerd
E0729 21:18:26.680817  139728 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19339-134334/.minikube/profiles/old-k8s-version-884192/client.crt: no such file or directory
net_test.go:112: (dbg) Done: out/minikube-linux-arm64 start -p calico-341440 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --cni=calico --driver=docker  --container-runtime=containerd: (1m18.012648491s)
--- PASS: TestNetworkPlugins/group/calico/Start (78.01s)

                                                
                                    
x
+
TestNetworkPlugins/group/kindnet/ControllerPod (6.01s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/kindnet/ControllerPod
net_test.go:120: (dbg) TestNetworkPlugins/group/kindnet/ControllerPod: waiting 10m0s for pods matching "app=kindnet" in namespace "kube-system" ...
helpers_test.go:344: "kindnet-gkvkz" [285b8a94-4a17-4770-b385-aab8efeec833] Running
net_test.go:120: (dbg) TestNetworkPlugins/group/kindnet/ControllerPod: app=kindnet healthy within 6.004269539s
--- PASS: TestNetworkPlugins/group/kindnet/ControllerPod (6.01s)

                                                
                                    
x
+
TestNetworkPlugins/group/kindnet/KubeletFlags (0.34s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/kindnet/KubeletFlags
net_test.go:133: (dbg) Run:  out/minikube-linux-arm64 ssh -p kindnet-341440 "pgrep -a kubelet"
--- PASS: TestNetworkPlugins/group/kindnet/KubeletFlags (0.34s)

                                                
                                    
x
+
TestNetworkPlugins/group/kindnet/NetCatPod (10.29s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/kindnet/NetCatPod
net_test.go:149: (dbg) Run:  kubectl --context kindnet-341440 replace --force -f testdata/netcat-deployment.yaml
net_test.go:163: (dbg) TestNetworkPlugins/group/kindnet/NetCatPod: waiting 15m0s for pods matching "app=netcat" in namespace "default" ...
helpers_test.go:344: "netcat-6bc787d567-8w6pc" [e29caba1-0108-4afa-9a9a-c672ceabc46e] Pending / Ready:ContainersNotReady (containers with unready status: [dnsutils]) / ContainersReady:ContainersNotReady (containers with unready status: [dnsutils])
helpers_test.go:344: "netcat-6bc787d567-8w6pc" [e29caba1-0108-4afa-9a9a-c672ceabc46e] Running
net_test.go:163: (dbg) TestNetworkPlugins/group/kindnet/NetCatPod: app=netcat healthy within 10.003388934s
--- PASS: TestNetworkPlugins/group/kindnet/NetCatPod (10.29s)

                                                
                                    
x
+
TestNetworkPlugins/group/kindnet/DNS (0.17s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/kindnet/DNS
net_test.go:175: (dbg) Run:  kubectl --context kindnet-341440 exec deployment/netcat -- nslookup kubernetes.default
--- PASS: TestNetworkPlugins/group/kindnet/DNS (0.17s)

                                                
                                    
x
+
TestNetworkPlugins/group/kindnet/Localhost (0.18s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/kindnet/Localhost
net_test.go:194: (dbg) Run:  kubectl --context kindnet-341440 exec deployment/netcat -- /bin/sh -c "nc -w 5 -i 5 -z localhost 8080"
--- PASS: TestNetworkPlugins/group/kindnet/Localhost (0.18s)

                                                
                                    
x
+
TestNetworkPlugins/group/kindnet/HairPin (0.17s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/kindnet/HairPin
net_test.go:264: (dbg) Run:  kubectl --context kindnet-341440 exec deployment/netcat -- /bin/sh -c "nc -w 5 -i 5 -z netcat 8080"
--- PASS: TestNetworkPlugins/group/kindnet/HairPin (0.17s)

                                                
                                    
x
+
TestNetworkPlugins/group/custom-flannel/Start (62.08s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/custom-flannel/Start
net_test.go:112: (dbg) Run:  out/minikube-linux-arm64 start -p custom-flannel-341440 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --cni=testdata/kube-flannel.yaml --driver=docker  --container-runtime=containerd
E0729 21:19:23.314519  139728 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19339-134334/.minikube/profiles/no-preload-992167/client.crt: no such file or directory
net_test.go:112: (dbg) Done: out/minikube-linux-arm64 start -p custom-flannel-341440 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --cni=testdata/kube-flannel.yaml --driver=docker  --container-runtime=containerd: (1m2.076287649s)
--- PASS: TestNetworkPlugins/group/custom-flannel/Start (62.08s)

                                                
                                    
x
+
TestNetworkPlugins/group/calico/ControllerPod (6.02s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/calico/ControllerPod
net_test.go:120: (dbg) TestNetworkPlugins/group/calico/ControllerPod: waiting 10m0s for pods matching "k8s-app=calico-node" in namespace "kube-system" ...
helpers_test.go:344: "calico-node-gqfl5" [18a2c9c3-09bc-4236-948a-1cc1eee8f485] Running
net_test.go:120: (dbg) TestNetworkPlugins/group/calico/ControllerPod: k8s-app=calico-node healthy within 6.017755979s
--- PASS: TestNetworkPlugins/group/calico/ControllerPod (6.02s)

                                                
                                    
x
+
TestNetworkPlugins/group/calico/KubeletFlags (0.38s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/calico/KubeletFlags
net_test.go:133: (dbg) Run:  out/minikube-linux-arm64 ssh -p calico-341440 "pgrep -a kubelet"
--- PASS: TestNetworkPlugins/group/calico/KubeletFlags (0.38s)

                                                
                                    
x
+
TestNetworkPlugins/group/calico/NetCatPod (11.32s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/calico/NetCatPod
net_test.go:149: (dbg) Run:  kubectl --context calico-341440 replace --force -f testdata/netcat-deployment.yaml
net_test.go:163: (dbg) TestNetworkPlugins/group/calico/NetCatPod: waiting 15m0s for pods matching "app=netcat" in namespace "default" ...
helpers_test.go:344: "netcat-6bc787d567-w8bkw" [4c2409c3-4253-4aa5-86ba-2ca25b515a38] Pending / Ready:ContainersNotReady (containers with unready status: [dnsutils]) / ContainersReady:ContainersNotReady (containers with unready status: [dnsutils])
helpers_test.go:344: "netcat-6bc787d567-w8bkw" [4c2409c3-4253-4aa5-86ba-2ca25b515a38] Running
E0729 21:19:50.997125  139728 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19339-134334/.minikube/profiles/no-preload-992167/client.crt: no such file or directory
net_test.go:163: (dbg) TestNetworkPlugins/group/calico/NetCatPod: app=netcat healthy within 11.00368279s
--- PASS: TestNetworkPlugins/group/calico/NetCatPod (11.32s)

                                                
                                    
x
+
TestNetworkPlugins/group/calico/DNS (0.26s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/calico/DNS
net_test.go:175: (dbg) Run:  kubectl --context calico-341440 exec deployment/netcat -- nslookup kubernetes.default
--- PASS: TestNetworkPlugins/group/calico/DNS (0.26s)

                                                
                                    
x
+
TestNetworkPlugins/group/calico/Localhost (0.33s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/calico/Localhost
net_test.go:194: (dbg) Run:  kubectl --context calico-341440 exec deployment/netcat -- /bin/sh -c "nc -w 5 -i 5 -z localhost 8080"
--- PASS: TestNetworkPlugins/group/calico/Localhost (0.33s)

                                                
                                    
x
+
TestNetworkPlugins/group/calico/HairPin (0.28s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/calico/HairPin
net_test.go:264: (dbg) Run:  kubectl --context calico-341440 exec deployment/netcat -- /bin/sh -c "nc -w 5 -i 5 -z netcat 8080"
--- PASS: TestNetworkPlugins/group/calico/HairPin (0.28s)

                                                
                                    
x
+
TestNetworkPlugins/group/enable-default-cni/Start (52.6s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/enable-default-cni/Start
net_test.go:112: (dbg) Run:  out/minikube-linux-arm64 start -p enable-default-cni-341440 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --enable-default-cni=true --driver=docker  --container-runtime=containerd
net_test.go:112: (dbg) Done: out/minikube-linux-arm64 start -p enable-default-cni-341440 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --enable-default-cni=true --driver=docker  --container-runtime=containerd: (52.59730632s)
--- PASS: TestNetworkPlugins/group/enable-default-cni/Start (52.60s)

                                                
                                    
x
+
TestNetworkPlugins/group/custom-flannel/KubeletFlags (0.58s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/custom-flannel/KubeletFlags
net_test.go:133: (dbg) Run:  out/minikube-linux-arm64 ssh -p custom-flannel-341440 "pgrep -a kubelet"
--- PASS: TestNetworkPlugins/group/custom-flannel/KubeletFlags (0.58s)

                                                
                                    
x
+
TestNetworkPlugins/group/custom-flannel/NetCatPod (10.46s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/custom-flannel/NetCatPod
net_test.go:149: (dbg) Run:  kubectl --context custom-flannel-341440 replace --force -f testdata/netcat-deployment.yaml
net_test.go:163: (dbg) TestNetworkPlugins/group/custom-flannel/NetCatPod: waiting 15m0s for pods matching "app=netcat" in namespace "default" ...
helpers_test.go:344: "netcat-6bc787d567-m9mlw" [c2be3b1b-27a2-48bd-874d-faf77b20be4b] Pending / Ready:ContainersNotReady (containers with unready status: [dnsutils]) / ContainersReady:ContainersNotReady (containers with unready status: [dnsutils])
helpers_test.go:344: "netcat-6bc787d567-m9mlw" [c2be3b1b-27a2-48bd-874d-faf77b20be4b] Running
net_test.go:163: (dbg) TestNetworkPlugins/group/custom-flannel/NetCatPod: app=netcat healthy within 10.004270134s
--- PASS: TestNetworkPlugins/group/custom-flannel/NetCatPod (10.46s)

                                                
                                    
x
+
TestNetworkPlugins/group/custom-flannel/DNS (0.3s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/custom-flannel/DNS
net_test.go:175: (dbg) Run:  kubectl --context custom-flannel-341440 exec deployment/netcat -- nslookup kubernetes.default
--- PASS: TestNetworkPlugins/group/custom-flannel/DNS (0.30s)

                                                
                                    
x
+
TestNetworkPlugins/group/custom-flannel/Localhost (0.19s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/custom-flannel/Localhost
net_test.go:194: (dbg) Run:  kubectl --context custom-flannel-341440 exec deployment/netcat -- /bin/sh -c "nc -w 5 -i 5 -z localhost 8080"
--- PASS: TestNetworkPlugins/group/custom-flannel/Localhost (0.19s)

                                                
                                    
x
+
TestNetworkPlugins/group/custom-flannel/HairPin (0.23s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/custom-flannel/HairPin
net_test.go:264: (dbg) Run:  kubectl --context custom-flannel-341440 exec deployment/netcat -- /bin/sh -c "nc -w 5 -i 5 -z netcat 8080"
--- PASS: TestNetworkPlugins/group/custom-flannel/HairPin (0.23s)

                                                
                                    
x
+
TestNetworkPlugins/group/flannel/Start (69.86s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/flannel/Start
net_test.go:112: (dbg) Run:  out/minikube-linux-arm64 start -p flannel-341440 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --cni=flannel --driver=docker  --container-runtime=containerd
net_test.go:112: (dbg) Done: out/minikube-linux-arm64 start -p flannel-341440 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --cni=flannel --driver=docker  --container-runtime=containerd: (1m9.860207263s)
--- PASS: TestNetworkPlugins/group/flannel/Start (69.86s)

                                                
                                    
x
+
TestNetworkPlugins/group/enable-default-cni/KubeletFlags (0.3s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/enable-default-cni/KubeletFlags
net_test.go:133: (dbg) Run:  out/minikube-linux-arm64 ssh -p enable-default-cni-341440 "pgrep -a kubelet"
--- PASS: TestNetworkPlugins/group/enable-default-cni/KubeletFlags (0.30s)

                                                
                                    
x
+
TestNetworkPlugins/group/enable-default-cni/NetCatPod (11.28s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/enable-default-cni/NetCatPod
net_test.go:149: (dbg) Run:  kubectl --context enable-default-cni-341440 replace --force -f testdata/netcat-deployment.yaml
net_test.go:163: (dbg) TestNetworkPlugins/group/enable-default-cni/NetCatPod: waiting 15m0s for pods matching "app=netcat" in namespace "default" ...
helpers_test.go:344: "netcat-6bc787d567-84qkj" [05ece245-6efb-436e-a03f-dacd2216cc90] Pending / Ready:ContainersNotReady (containers with unready status: [dnsutils]) / ContainersReady:ContainersNotReady (containers with unready status: [dnsutils])
helpers_test.go:344: "netcat-6bc787d567-84qkj" [05ece245-6efb-436e-a03f-dacd2216cc90] Running
E0729 21:21:15.526271  139728 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19339-134334/.minikube/profiles/default-k8s-diff-port-491659/client.crt: no such file or directory
E0729 21:21:15.531533  139728 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19339-134334/.minikube/profiles/default-k8s-diff-port-491659/client.crt: no such file or directory
E0729 21:21:15.541787  139728 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19339-134334/.minikube/profiles/default-k8s-diff-port-491659/client.crt: no such file or directory
E0729 21:21:15.562052  139728 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19339-134334/.minikube/profiles/default-k8s-diff-port-491659/client.crt: no such file or directory
E0729 21:21:15.602308  139728 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19339-134334/.minikube/profiles/default-k8s-diff-port-491659/client.crt: no such file or directory
E0729 21:21:15.682702  139728 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19339-134334/.minikube/profiles/default-k8s-diff-port-491659/client.crt: no such file or directory
E0729 21:21:15.843051  139728 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19339-134334/.minikube/profiles/default-k8s-diff-port-491659/client.crt: no such file or directory
E0729 21:21:16.163346  139728 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19339-134334/.minikube/profiles/default-k8s-diff-port-491659/client.crt: no such file or directory
E0729 21:21:16.804035  139728 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19339-134334/.minikube/profiles/default-k8s-diff-port-491659/client.crt: no such file or directory
E0729 21:21:18.084925  139728 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19339-134334/.minikube/profiles/default-k8s-diff-port-491659/client.crt: no such file or directory
E0729 21:21:20.645580  139728 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19339-134334/.minikube/profiles/default-k8s-diff-port-491659/client.crt: no such file or directory
net_test.go:163: (dbg) TestNetworkPlugins/group/enable-default-cni/NetCatPod: app=netcat healthy within 11.003699941s
--- PASS: TestNetworkPlugins/group/enable-default-cni/NetCatPod (11.28s)

                                                
                                    
x
+
TestNetworkPlugins/group/enable-default-cni/DNS (0.22s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/enable-default-cni/DNS
net_test.go:175: (dbg) Run:  kubectl --context enable-default-cni-341440 exec deployment/netcat -- nslookup kubernetes.default
--- PASS: TestNetworkPlugins/group/enable-default-cni/DNS (0.22s)

                                                
                                    
x
+
TestNetworkPlugins/group/enable-default-cni/Localhost (0.22s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/enable-default-cni/Localhost
net_test.go:194: (dbg) Run:  kubectl --context enable-default-cni-341440 exec deployment/netcat -- /bin/sh -c "nc -w 5 -i 5 -z localhost 8080"
--- PASS: TestNetworkPlugins/group/enable-default-cni/Localhost (0.22s)

                                                
                                    
x
+
TestNetworkPlugins/group/enable-default-cni/HairPin (0.26s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/enable-default-cni/HairPin
net_test.go:264: (dbg) Run:  kubectl --context enable-default-cni-341440 exec deployment/netcat -- /bin/sh -c "nc -w 5 -i 5 -z netcat 8080"
--- PASS: TestNetworkPlugins/group/enable-default-cni/HairPin (0.26s)

                                                
                                    
x
+
TestNetworkPlugins/group/bridge/Start (87.48s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/bridge/Start
net_test.go:112: (dbg) Run:  out/minikube-linux-arm64 start -p bridge-341440 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --cni=bridge --driver=docker  --container-runtime=containerd
E0729 21:21:56.486683  139728 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19339-134334/.minikube/profiles/default-k8s-diff-port-491659/client.crt: no such file or directory
E0729 21:21:56.781430  139728 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19339-134334/.minikube/profiles/addons-675434/client.crt: no such file or directory
net_test.go:112: (dbg) Done: out/minikube-linux-arm64 start -p bridge-341440 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --cni=bridge --driver=docker  --container-runtime=containerd: (1m27.475918687s)
--- PASS: TestNetworkPlugins/group/bridge/Start (87.48s)

                                                
                                    
x
+
TestNetworkPlugins/group/flannel/ControllerPod (6.01s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/flannel/ControllerPod
net_test.go:120: (dbg) TestNetworkPlugins/group/flannel/ControllerPod: waiting 10m0s for pods matching "app=flannel" in namespace "kube-flannel" ...
helpers_test.go:344: "kube-flannel-ds-qnbzq" [2334efa8-923a-478b-8d61-01d0540135ee] Running
net_test.go:120: (dbg) TestNetworkPlugins/group/flannel/ControllerPod: app=flannel healthy within 6.003991698s
--- PASS: TestNetworkPlugins/group/flannel/ControllerPod (6.01s)

                                                
                                    
x
+
TestNetworkPlugins/group/flannel/KubeletFlags (0.35s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/flannel/KubeletFlags
net_test.go:133: (dbg) Run:  out/minikube-linux-arm64 ssh -p flannel-341440 "pgrep -a kubelet"
--- PASS: TestNetworkPlugins/group/flannel/KubeletFlags (0.35s)

                                                
                                    
x
+
TestNetworkPlugins/group/flannel/NetCatPod (9.51s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/flannel/NetCatPod
net_test.go:149: (dbg) Run:  kubectl --context flannel-341440 replace --force -f testdata/netcat-deployment.yaml
net_test.go:163: (dbg) TestNetworkPlugins/group/flannel/NetCatPod: waiting 15m0s for pods matching "app=netcat" in namespace "default" ...
helpers_test.go:344: "netcat-6bc787d567-qnbjd" [4cc57482-ced0-49c2-9501-651cb88b80fb] Pending / Ready:ContainersNotReady (containers with unready status: [dnsutils]) / ContainersReady:ContainersNotReady (containers with unready status: [dnsutils])
helpers_test.go:344: "netcat-6bc787d567-qnbjd" [4cc57482-ced0-49c2-9501-651cb88b80fb] Running
net_test.go:163: (dbg) TestNetworkPlugins/group/flannel/NetCatPod: app=netcat healthy within 9.004033679s
--- PASS: TestNetworkPlugins/group/flannel/NetCatPod (9.51s)

                                                
                                    
x
+
TestNetworkPlugins/group/flannel/DNS (0.2s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/flannel/DNS
net_test.go:175: (dbg) Run:  kubectl --context flannel-341440 exec deployment/netcat -- nslookup kubernetes.default
--- PASS: TestNetworkPlugins/group/flannel/DNS (0.20s)

                                                
                                    
x
+
TestNetworkPlugins/group/flannel/Localhost (0.15s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/flannel/Localhost
net_test.go:194: (dbg) Run:  kubectl --context flannel-341440 exec deployment/netcat -- /bin/sh -c "nc -w 5 -i 5 -z localhost 8080"
--- PASS: TestNetworkPlugins/group/flannel/Localhost (0.15s)

                                                
                                    
x
+
TestNetworkPlugins/group/flannel/HairPin (0.18s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/flannel/HairPin
net_test.go:264: (dbg) Run:  kubectl --context flannel-341440 exec deployment/netcat -- /bin/sh -c "nc -w 5 -i 5 -z netcat 8080"
--- PASS: TestNetworkPlugins/group/flannel/HairPin (0.18s)

                                                
                                    
x
+
TestNetworkPlugins/group/bridge/KubeletFlags (0.27s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/bridge/KubeletFlags
net_test.go:133: (dbg) Run:  out/minikube-linux-arm64 ssh -p bridge-341440 "pgrep -a kubelet"
--- PASS: TestNetworkPlugins/group/bridge/KubeletFlags (0.27s)

                                                
                                    
x
+
TestNetworkPlugins/group/bridge/NetCatPod (9.26s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/bridge/NetCatPod
net_test.go:149: (dbg) Run:  kubectl --context bridge-341440 replace --force -f testdata/netcat-deployment.yaml
net_test.go:163: (dbg) TestNetworkPlugins/group/bridge/NetCatPod: waiting 15m0s for pods matching "app=netcat" in namespace "default" ...
helpers_test.go:344: "netcat-6bc787d567-p2wk8" [e681b259-49d6-4b49-8807-0e905875d9bf] Pending / Ready:ContainersNotReady (containers with unready status: [dnsutils]) / ContainersReady:ContainersNotReady (containers with unready status: [dnsutils])
helpers_test.go:344: "netcat-6bc787d567-p2wk8" [e681b259-49d6-4b49-8807-0e905875d9bf] Running
E0729 21:23:20.842139  139728 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19339-134334/.minikube/profiles/auto-341440/client.crt: no such file or directory
net_test.go:163: (dbg) TestNetworkPlugins/group/bridge/NetCatPod: app=netcat healthy within 9.00317118s
--- PASS: TestNetworkPlugins/group/bridge/NetCatPod (9.26s)

                                                
                                    
x
+
TestNetworkPlugins/group/bridge/DNS (0.17s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/bridge/DNS
net_test.go:175: (dbg) Run:  kubectl --context bridge-341440 exec deployment/netcat -- nslookup kubernetes.default
--- PASS: TestNetworkPlugins/group/bridge/DNS (0.17s)

                                                
                                    
x
+
TestNetworkPlugins/group/bridge/Localhost (0.15s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/bridge/Localhost
net_test.go:194: (dbg) Run:  kubectl --context bridge-341440 exec deployment/netcat -- /bin/sh -c "nc -w 5 -i 5 -z localhost 8080"
--- PASS: TestNetworkPlugins/group/bridge/Localhost (0.15s)

                                                
                                    
x
+
TestNetworkPlugins/group/bridge/HairPin (0.15s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/bridge/HairPin
net_test.go:264: (dbg) Run:  kubectl --context bridge-341440 exec deployment/netcat -- /bin/sh -c "nc -w 5 -i 5 -z netcat 8080"
--- PASS: TestNetworkPlugins/group/bridge/HairPin (0.15s)

                                                
                                    

Test skip (31/336)

x
+
TestDownloadOnly/v1.20.0/cached-images (0s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.20.0/cached-images
aaa_download_only_test.go:129: Preload exists, images won't be cached
--- SKIP: TestDownloadOnly/v1.20.0/cached-images (0.00s)

                                                
                                    
x
+
TestDownloadOnly/v1.20.0/binaries (0s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.20.0/binaries
aaa_download_only_test.go:151: Preload exists, binaries are present within.
--- SKIP: TestDownloadOnly/v1.20.0/binaries (0.00s)

                                                
                                    
x
+
TestDownloadOnly/v1.20.0/kubectl (0s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.20.0/kubectl
aaa_download_only_test.go:167: Test for darwin and windows
--- SKIP: TestDownloadOnly/v1.20.0/kubectl (0.00s)

                                                
                                    
x
+
TestDownloadOnly/v1.30.3/cached-images (0s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.30.3/cached-images
aaa_download_only_test.go:129: Preload exists, images won't be cached
--- SKIP: TestDownloadOnly/v1.30.3/cached-images (0.00s)

                                                
                                    
x
+
TestDownloadOnly/v1.30.3/binaries (0s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.30.3/binaries
aaa_download_only_test.go:151: Preload exists, binaries are present within.
--- SKIP: TestDownloadOnly/v1.30.3/binaries (0.00s)

                                                
                                    
x
+
TestDownloadOnly/v1.30.3/kubectl (0s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.30.3/kubectl
aaa_download_only_test.go:167: Test for darwin and windows
--- SKIP: TestDownloadOnly/v1.30.3/kubectl (0.00s)

                                                
                                    
x
+
TestDownloadOnly/v1.31.0-beta.0/cached-images (0s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.31.0-beta.0/cached-images
aaa_download_only_test.go:129: Preload exists, images won't be cached
--- SKIP: TestDownloadOnly/v1.31.0-beta.0/cached-images (0.00s)

                                                
                                    
x
+
TestDownloadOnly/v1.31.0-beta.0/binaries (0s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.31.0-beta.0/binaries
aaa_download_only_test.go:151: Preload exists, binaries are present within.
--- SKIP: TestDownloadOnly/v1.31.0-beta.0/binaries (0.00s)

                                                
                                    
x
+
TestDownloadOnly/v1.31.0-beta.0/kubectl (0s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.31.0-beta.0/kubectl
aaa_download_only_test.go:167: Test for darwin and windows
--- SKIP: TestDownloadOnly/v1.31.0-beta.0/kubectl (0.00s)

                                                
                                    
x
+
TestDownloadOnlyKic (0.54s)

                                                
                                                
=== RUN   TestDownloadOnlyKic
aaa_download_only_test.go:232: (dbg) Run:  out/minikube-linux-arm64 start --download-only -p download-docker-477815 --alsologtostderr --driver=docker  --container-runtime=containerd
aaa_download_only_test.go:244: Skip for arm64 platform. See https://github.com/kubernetes/minikube/issues/10144
helpers_test.go:175: Cleaning up "download-docker-477815" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-arm64 delete -p download-docker-477815
--- SKIP: TestDownloadOnlyKic (0.54s)

                                                
                                    
x
+
TestOffline (0s)

                                                
                                                
=== RUN   TestOffline
=== PAUSE TestOffline

                                                
                                                

                                                
                                                
=== CONT  TestOffline
aab_offline_test.go:35: skipping TestOffline - only docker runtime supported on arm64. See https://github.com/kubernetes/minikube/issues/10144
--- SKIP: TestOffline (0.00s)

                                                
                                    
x
+
TestAddons/parallel/HelmTiller (0s)

                                                
                                                
=== RUN   TestAddons/parallel/HelmTiller
=== PAUSE TestAddons/parallel/HelmTiller

                                                
                                                

                                                
                                                
=== CONT  TestAddons/parallel/HelmTiller
addons_test.go:446: skip Helm test on arm64
--- SKIP: TestAddons/parallel/HelmTiller (0.00s)

                                                
                                    
x
+
TestAddons/parallel/Olm (0s)

                                                
                                                
=== RUN   TestAddons/parallel/Olm
=== PAUSE TestAddons/parallel/Olm

                                                
                                                

                                                
                                                
=== CONT  TestAddons/parallel/Olm
addons_test.go:500: Skipping OLM addon test until https://github.com/operator-framework/operator-lifecycle-manager/issues/2534 is resolved
--- SKIP: TestAddons/parallel/Olm (0.00s)

                                                
                                    
x
+
TestDockerFlags (0s)

                                                
                                                
=== RUN   TestDockerFlags
docker_test.go:41: skipping: only runs with docker container runtime, currently testing containerd
--- SKIP: TestDockerFlags (0.00s)

                                                
                                    
x
+
TestKVMDriverInstallOrUpdate (0s)

                                                
                                                
=== RUN   TestKVMDriverInstallOrUpdate
driver_install_or_update_test.go:45: Skip if arm64. See https://github.com/kubernetes/minikube/issues/10144
--- SKIP: TestKVMDriverInstallOrUpdate (0.00s)

                                                
                                    
x
+
TestHyperKitDriverInstallOrUpdate (0s)

                                                
                                                
=== RUN   TestHyperKitDriverInstallOrUpdate
driver_install_or_update_test.go:105: Skip if not darwin.
--- SKIP: TestHyperKitDriverInstallOrUpdate (0.00s)

                                                
                                    
x
+
TestHyperkitDriverSkipUpgrade (0s)

                                                
                                                
=== RUN   TestHyperkitDriverSkipUpgrade
driver_install_or_update_test.go:169: Skip if not darwin.
--- SKIP: TestHyperkitDriverSkipUpgrade (0.00s)

                                                
                                    
x
+
TestFunctional/parallel/MySQL (0s)

                                                
                                                
=== RUN   TestFunctional/parallel/MySQL
=== PAUSE TestFunctional/parallel/MySQL

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/MySQL
functional_test.go:1783: arm64 is not supported by mysql. Skip the test. See https://github.com/kubernetes/minikube/issues/10144
--- SKIP: TestFunctional/parallel/MySQL (0.00s)

                                                
                                    
x
+
TestFunctional/parallel/DockerEnv (0s)

                                                
                                                
=== RUN   TestFunctional/parallel/DockerEnv
=== PAUSE TestFunctional/parallel/DockerEnv

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/DockerEnv
functional_test.go:459: only validate docker env with docker container runtime, currently testing containerd
--- SKIP: TestFunctional/parallel/DockerEnv (0.00s)

                                                
                                    
x
+
TestFunctional/parallel/PodmanEnv (0s)

                                                
                                                
=== RUN   TestFunctional/parallel/PodmanEnv
=== PAUSE TestFunctional/parallel/PodmanEnv

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/PodmanEnv
functional_test.go:546: only validate podman env with docker container runtime, currently testing containerd
--- SKIP: TestFunctional/parallel/PodmanEnv (0.00s)

                                                
                                    
x
+
TestFunctional/parallel/TunnelCmd/serial/DNSResolutionByDig (0s)

                                                
                                                
=== RUN   TestFunctional/parallel/TunnelCmd/serial/DNSResolutionByDig
functional_test_tunnel_test.go:99: DNS forwarding is only supported for Hyperkit on Darwin, skipping test DNS forwarding
--- SKIP: TestFunctional/parallel/TunnelCmd/serial/DNSResolutionByDig (0.00s)

                                                
                                    
x
+
TestFunctional/parallel/TunnelCmd/serial/DNSResolutionByDscacheutil (0s)

                                                
                                                
=== RUN   TestFunctional/parallel/TunnelCmd/serial/DNSResolutionByDscacheutil
functional_test_tunnel_test.go:99: DNS forwarding is only supported for Hyperkit on Darwin, skipping test DNS forwarding
--- SKIP: TestFunctional/parallel/TunnelCmd/serial/DNSResolutionByDscacheutil (0.00s)

                                                
                                    
x
+
TestFunctional/parallel/TunnelCmd/serial/AccessThroughDNS (0s)

                                                
                                                
=== RUN   TestFunctional/parallel/TunnelCmd/serial/AccessThroughDNS
functional_test_tunnel_test.go:99: DNS forwarding is only supported for Hyperkit on Darwin, skipping test DNS forwarding
--- SKIP: TestFunctional/parallel/TunnelCmd/serial/AccessThroughDNS (0.00s)

                                                
                                    
x
+
TestGvisorAddon (0s)

                                                
                                                
=== RUN   TestGvisorAddon
gvisor_addon_test.go:34: skipping test because --gvisor=false
--- SKIP: TestGvisorAddon (0.00s)

                                                
                                    
x
+
TestImageBuild (0s)

                                                
                                                
=== RUN   TestImageBuild
image_test.go:33: 
--- SKIP: TestImageBuild (0.00s)

                                                
                                    
x
+
TestChangeNoneUser (0s)

                                                
                                                
=== RUN   TestChangeNoneUser
none_test.go:38: Test requires none driver and SUDO_USER env to not be empty
--- SKIP: TestChangeNoneUser (0.00s)

                                                
                                    
x
+
TestScheduledStopWindows (0s)

                                                
                                                
=== RUN   TestScheduledStopWindows
scheduled_stop_test.go:42: test only runs on windows
--- SKIP: TestScheduledStopWindows (0.00s)

                                                
                                    
x
+
TestSkaffold (0s)

                                                
                                                
=== RUN   TestSkaffold
skaffold_test.go:45: skaffold requires docker-env, currently testing containerd container runtime
--- SKIP: TestSkaffold (0.00s)

                                                
                                    
x
+
TestStartStop/group/disable-driver-mounts (0.15s)

                                                
                                                
=== RUN   TestStartStop/group/disable-driver-mounts
=== PAUSE TestStartStop/group/disable-driver-mounts

                                                
                                                

                                                
                                                
=== CONT  TestStartStop/group/disable-driver-mounts
start_stop_delete_test.go:103: skipping TestStartStop/group/disable-driver-mounts - only runs on virtualbox
helpers_test.go:175: Cleaning up "disable-driver-mounts-169516" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-arm64 delete -p disable-driver-mounts-169516
--- SKIP: TestStartStop/group/disable-driver-mounts (0.15s)

                                                
                                    
x
+
TestNetworkPlugins/group/kubenet (5.19s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/kubenet
net_test.go:93: Skipping the test as containerd container runtimes requires CNI
panic.go:626: 
----------------------- debugLogs start: kubenet-341440 [pass: true] --------------------------------
>>> netcat: nslookup kubernetes.default:
Error in configuration: context was not found for specified context: kubenet-341440

                                                
                                                

                                                
                                                
>>> netcat: nslookup debug kubernetes.default a-records:
Error in configuration: context was not found for specified context: kubenet-341440

                                                
                                                

                                                
                                                
>>> netcat: dig search kubernetes.default:
Error in configuration: context was not found for specified context: kubenet-341440

                                                
                                                

                                                
                                                
>>> netcat: dig @10.96.0.10 kubernetes.default.svc.cluster.local udp/53:
Error in configuration: context was not found for specified context: kubenet-341440

                                                
                                                

                                                
                                                
>>> netcat: dig @10.96.0.10 kubernetes.default.svc.cluster.local tcp/53:
Error in configuration: context was not found for specified context: kubenet-341440

                                                
                                                

                                                
                                                
>>> netcat: nc 10.96.0.10 udp/53:
Error in configuration: context was not found for specified context: kubenet-341440

                                                
                                                

                                                
                                                
>>> netcat: nc 10.96.0.10 tcp/53:
Error in configuration: context was not found for specified context: kubenet-341440

                                                
                                                

                                                
                                                
>>> netcat: /etc/nsswitch.conf:
Error in configuration: context was not found for specified context: kubenet-341440

                                                
                                                

                                                
                                                
>>> netcat: /etc/hosts:
Error in configuration: context was not found for specified context: kubenet-341440

                                                
                                                

                                                
                                                
>>> netcat: /etc/resolv.conf:
Error in configuration: context was not found for specified context: kubenet-341440

                                                
                                                

                                                
                                                
>>> host: /etc/nsswitch.conf:
* Profile "kubenet-341440" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-341440"

                                                
                                                

                                                
                                                
>>> host: /etc/hosts:
* Profile "kubenet-341440" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-341440"

                                                
                                                

                                                
                                                
>>> host: /etc/resolv.conf:
* Profile "kubenet-341440" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-341440"

                                                
                                                

                                                
                                                
>>> k8s: nodes, services, endpoints, daemon sets, deployments and pods, :
Error in configuration: context was not found for specified context: kubenet-341440

                                                
                                                

                                                
                                                
>>> host: crictl pods:
* Profile "kubenet-341440" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-341440"

                                                
                                                

                                                
                                                
>>> host: crictl containers:
* Profile "kubenet-341440" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-341440"

                                                
                                                

                                                
                                                
>>> k8s: describe netcat deployment:
error: context "kubenet-341440" does not exist

                                                
                                                

                                                
                                                
>>> k8s: describe netcat pod(s):
error: context "kubenet-341440" does not exist

                                                
                                                

                                                
                                                
>>> k8s: netcat logs:
error: context "kubenet-341440" does not exist

                                                
                                                

                                                
                                                
>>> k8s: describe coredns deployment:
error: context "kubenet-341440" does not exist

                                                
                                                

                                                
                                                
>>> k8s: describe coredns pods:
error: context "kubenet-341440" does not exist

                                                
                                                

                                                
                                                
>>> k8s: coredns logs:
error: context "kubenet-341440" does not exist

                                                
                                                

                                                
                                                
>>> k8s: describe api server pod(s):
error: context "kubenet-341440" does not exist

                                                
                                                

                                                
                                                
>>> k8s: api server logs:
error: context "kubenet-341440" does not exist

                                                
                                                

                                                
                                                
>>> host: /etc/cni:
* Profile "kubenet-341440" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-341440"

                                                
                                                

                                                
                                                
>>> host: ip a s:
* Profile "kubenet-341440" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-341440"

                                                
                                                

                                                
                                                
>>> host: ip r s:
* Profile "kubenet-341440" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-341440"

                                                
                                                

                                                
                                                
>>> host: iptables-save:
* Profile "kubenet-341440" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-341440"

                                                
                                                

                                                
                                                
>>> host: iptables table nat:
* Profile "kubenet-341440" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-341440"

                                                
                                                

                                                
                                                
>>> k8s: describe kube-proxy daemon set:
error: context "kubenet-341440" does not exist

                                                
                                                

                                                
                                                
>>> k8s: describe kube-proxy pod(s):
error: context "kubenet-341440" does not exist

                                                
                                                

                                                
                                                
>>> k8s: kube-proxy logs:
error: context "kubenet-341440" does not exist

                                                
                                                

                                                
                                                
>>> host: kubelet daemon status:
* Profile "kubenet-341440" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-341440"

                                                
                                                

                                                
                                                
>>> host: kubelet daemon config:
* Profile "kubenet-341440" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-341440"

                                                
                                                

                                                
                                                
>>> k8s: kubelet logs:
* Profile "kubenet-341440" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-341440"

                                                
                                                

                                                
                                                
>>> host: /etc/kubernetes/kubelet.conf:
* Profile "kubenet-341440" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-341440"

                                                
                                                

                                                
                                                
>>> host: /var/lib/kubelet/config.yaml:
* Profile "kubenet-341440" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-341440"

                                                
                                                

                                                
                                                
>>> k8s: kubectl config:
apiVersion: v1
clusters: null
contexts: null
current-context: ""
kind: Config
preferences: {}
users: null

                                                
                                                

                                                
                                                
>>> k8s: cms:
Error in configuration: context was not found for specified context: kubenet-341440

                                                
                                                

                                                
                                                
>>> host: docker daemon status:
* Profile "kubenet-341440" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-341440"

                                                
                                                

                                                
                                                
>>> host: docker daemon config:
* Profile "kubenet-341440" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-341440"

                                                
                                                

                                                
                                                
>>> host: /etc/docker/daemon.json:
* Profile "kubenet-341440" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-341440"

                                                
                                                

                                                
                                                
>>> host: docker system info:
* Profile "kubenet-341440" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-341440"

                                                
                                                

                                                
                                                
>>> host: cri-docker daemon status:
* Profile "kubenet-341440" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-341440"

                                                
                                                

                                                
                                                
>>> host: cri-docker daemon config:
* Profile "kubenet-341440" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-341440"

                                                
                                                

                                                
                                                
>>> host: /etc/systemd/system/cri-docker.service.d/10-cni.conf:
* Profile "kubenet-341440" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-341440"

                                                
                                                

                                                
                                                
>>> host: /usr/lib/systemd/system/cri-docker.service:
* Profile "kubenet-341440" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-341440"

                                                
                                                

                                                
                                                
>>> host: cri-dockerd version:
* Profile "kubenet-341440" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-341440"

                                                
                                                

                                                
                                                
>>> host: containerd daemon status:
* Profile "kubenet-341440" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-341440"

                                                
                                                

                                                
                                                
>>> host: containerd daemon config:
* Profile "kubenet-341440" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-341440"

                                                
                                                

                                                
                                                
>>> host: /lib/systemd/system/containerd.service:
* Profile "kubenet-341440" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-341440"

                                                
                                                

                                                
                                                
>>> host: /etc/containerd/config.toml:
* Profile "kubenet-341440" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-341440"

                                                
                                                

                                                
                                                
>>> host: containerd config dump:
* Profile "kubenet-341440" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-341440"

                                                
                                                

                                                
                                                
>>> host: crio daemon status:
* Profile "kubenet-341440" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-341440"

                                                
                                                

                                                
                                                
>>> host: crio daemon config:
* Profile "kubenet-341440" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-341440"

                                                
                                                

                                                
                                                
>>> host: /etc/crio:
* Profile "kubenet-341440" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-341440"

                                                
                                                

                                                
                                                
>>> host: crio config:
* Profile "kubenet-341440" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-341440"

                                                
                                                
----------------------- debugLogs end: kubenet-341440 [took: 4.9867442s] --------------------------------
helpers_test.go:175: Cleaning up "kubenet-341440" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-arm64 delete -p kubenet-341440
--- SKIP: TestNetworkPlugins/group/kubenet (5.19s)

                                                
                                    
x
+
TestNetworkPlugins/group/cilium (5.32s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/cilium
net_test.go:102: Skipping the test as it's interfering with other tests and is outdated
panic.go:626: 
----------------------- debugLogs start: cilium-341440 [pass: true] --------------------------------
>>> netcat: nslookup kubernetes.default:
Error in configuration: context was not found for specified context: cilium-341440

                                                
                                                

                                                
                                                
>>> netcat: nslookup debug kubernetes.default a-records:
Error in configuration: context was not found for specified context: cilium-341440

                                                
                                                

                                                
                                                
>>> netcat: dig search kubernetes.default:
Error in configuration: context was not found for specified context: cilium-341440

                                                
                                                

                                                
                                                
>>> netcat: dig @10.96.0.10 kubernetes.default.svc.cluster.local udp/53:
Error in configuration: context was not found for specified context: cilium-341440

                                                
                                                

                                                
                                                
>>> netcat: dig @10.96.0.10 kubernetes.default.svc.cluster.local tcp/53:
Error in configuration: context was not found for specified context: cilium-341440

                                                
                                                

                                                
                                                
>>> netcat: nc 10.96.0.10 udp/53:
Error in configuration: context was not found for specified context: cilium-341440

                                                
                                                

                                                
                                                
>>> netcat: nc 10.96.0.10 tcp/53:
Error in configuration: context was not found for specified context: cilium-341440

                                                
                                                

                                                
                                                
>>> netcat: /etc/nsswitch.conf:
Error in configuration: context was not found for specified context: cilium-341440

                                                
                                                

                                                
                                                
>>> netcat: /etc/hosts:
Error in configuration: context was not found for specified context: cilium-341440

                                                
                                                

                                                
                                                
>>> netcat: /etc/resolv.conf:
Error in configuration: context was not found for specified context: cilium-341440

                                                
                                                

                                                
                                                
>>> host: /etc/nsswitch.conf:
* Profile "cilium-341440" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-341440"

                                                
                                                

                                                
                                                
>>> host: /etc/hosts:
* Profile "cilium-341440" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-341440"

                                                
                                                

                                                
                                                
>>> host: /etc/resolv.conf:
* Profile "cilium-341440" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-341440"

                                                
                                                

                                                
                                                
>>> k8s: nodes, services, endpoints, daemon sets, deployments and pods, :
Error in configuration: context was not found for specified context: cilium-341440

                                                
                                                

                                                
                                                
>>> host: crictl pods:
* Profile "cilium-341440" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-341440"

                                                
                                                

                                                
                                                
>>> host: crictl containers:
* Profile "cilium-341440" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-341440"

                                                
                                                

                                                
                                                
>>> k8s: describe netcat deployment:
error: context "cilium-341440" does not exist

                                                
                                                

                                                
                                                
>>> k8s: describe netcat pod(s):
error: context "cilium-341440" does not exist

                                                
                                                

                                                
                                                
>>> k8s: netcat logs:
error: context "cilium-341440" does not exist

                                                
                                                

                                                
                                                
>>> k8s: describe coredns deployment:
error: context "cilium-341440" does not exist

                                                
                                                

                                                
                                                
>>> k8s: describe coredns pods:
error: context "cilium-341440" does not exist

                                                
                                                

                                                
                                                
>>> k8s: coredns logs:
error: context "cilium-341440" does not exist

                                                
                                                

                                                
                                                
>>> k8s: describe api server pod(s):
error: context "cilium-341440" does not exist

                                                
                                                

                                                
                                                
>>> k8s: api server logs:
error: context "cilium-341440" does not exist

                                                
                                                

                                                
                                                
>>> host: /etc/cni:
* Profile "cilium-341440" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-341440"

                                                
                                                

                                                
                                                
>>> host: ip a s:
* Profile "cilium-341440" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-341440"

                                                
                                                

                                                
                                                
>>> host: ip r s:
* Profile "cilium-341440" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-341440"

                                                
                                                

                                                
                                                
>>> host: iptables-save:
* Profile "cilium-341440" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-341440"

                                                
                                                

                                                
                                                
>>> host: iptables table nat:
* Profile "cilium-341440" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-341440"

                                                
                                                

                                                
                                                
>>> k8s: describe cilium daemon set:
Error in configuration: context was not found for specified context: cilium-341440

                                                
                                                

                                                
                                                
>>> k8s: describe cilium daemon set pod(s):
Error in configuration: context was not found for specified context: cilium-341440

                                                
                                                

                                                
                                                
>>> k8s: cilium daemon set container(s) logs (current):
error: context "cilium-341440" does not exist

                                                
                                                

                                                
                                                
>>> k8s: cilium daemon set container(s) logs (previous):
error: context "cilium-341440" does not exist

                                                
                                                

                                                
                                                
>>> k8s: describe cilium deployment:
Error in configuration: context was not found for specified context: cilium-341440

                                                
                                                

                                                
                                                
>>> k8s: describe cilium deployment pod(s):
Error in configuration: context was not found for specified context: cilium-341440

                                                
                                                

                                                
                                                
>>> k8s: cilium deployment container(s) logs (current):
error: context "cilium-341440" does not exist

                                                
                                                

                                                
                                                
>>> k8s: cilium deployment container(s) logs (previous):
error: context "cilium-341440" does not exist

                                                
                                                

                                                
                                                
>>> k8s: describe kube-proxy daemon set:
error: context "cilium-341440" does not exist

                                                
                                                

                                                
                                                
>>> k8s: describe kube-proxy pod(s):
error: context "cilium-341440" does not exist

                                                
                                                

                                                
                                                
>>> k8s: kube-proxy logs:
error: context "cilium-341440" does not exist

                                                
                                                

                                                
                                                
>>> host: kubelet daemon status:
* Profile "cilium-341440" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-341440"

                                                
                                                

                                                
                                                
>>> host: kubelet daemon config:
* Profile "cilium-341440" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-341440"

                                                
                                                

                                                
                                                
>>> k8s: kubelet logs:
* Profile "cilium-341440" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-341440"

                                                
                                                

                                                
                                                
>>> host: /etc/kubernetes/kubelet.conf:
* Profile "cilium-341440" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-341440"

                                                
                                                

                                                
                                                
>>> host: /var/lib/kubelet/config.yaml:
* Profile "cilium-341440" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-341440"

                                                
                                                

                                                
                                                
>>> k8s: kubectl config:
apiVersion: v1
clusters:
- cluster:
certificate-authority: /home/jenkins/minikube-integration/19339-134334/.minikube/ca.crt
extensions:
- extension:
last-update: Mon, 29 Jul 2024 20:59:18 UTC
provider: minikube.sigs.k8s.io
version: v1.33.1
name: cluster_info
server: https://192.168.76.2:8443
name: force-systemd-flag-730900
contexts:
- context:
cluster: force-systemd-flag-730900
extensions:
- extension:
last-update: Mon, 29 Jul 2024 20:59:18 UTC
provider: minikube.sigs.k8s.io
version: v1.33.1
name: context_info
namespace: default
user: force-systemd-flag-730900
name: force-systemd-flag-730900
current-context: force-systemd-flag-730900
kind: Config
preferences: {}
users:
- name: force-systemd-flag-730900
user:
client-certificate: /home/jenkins/minikube-integration/19339-134334/.minikube/profiles/force-systemd-flag-730900/client.crt
client-key: /home/jenkins/minikube-integration/19339-134334/.minikube/profiles/force-systemd-flag-730900/client.key

                                                
                                                

                                                
                                                
>>> k8s: cms:
Error in configuration: context was not found for specified context: cilium-341440

                                                
                                                

                                                
                                                
>>> host: docker daemon status:
* Profile "cilium-341440" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-341440"

                                                
                                                

                                                
                                                
>>> host: docker daemon config:
* Profile "cilium-341440" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-341440"

                                                
                                                

                                                
                                                
>>> host: /etc/docker/daemon.json:
* Profile "cilium-341440" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-341440"

                                                
                                                

                                                
                                                
>>> host: docker system info:
* Profile "cilium-341440" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-341440"

                                                
                                                

                                                
                                                
>>> host: cri-docker daemon status:
* Profile "cilium-341440" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-341440"

                                                
                                                

                                                
                                                
>>> host: cri-docker daemon config:
* Profile "cilium-341440" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-341440"

                                                
                                                

                                                
                                                
>>> host: /etc/systemd/system/cri-docker.service.d/10-cni.conf:
* Profile "cilium-341440" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-341440"

                                                
                                                

                                                
                                                
>>> host: /usr/lib/systemd/system/cri-docker.service:
* Profile "cilium-341440" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-341440"

                                                
                                                

                                                
                                                
>>> host: cri-dockerd version:
* Profile "cilium-341440" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-341440"

                                                
                                                

                                                
                                                
>>> host: containerd daemon status:
* Profile "cilium-341440" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-341440"

                                                
                                                

                                                
                                                
>>> host: containerd daemon config:
* Profile "cilium-341440" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-341440"

                                                
                                                

                                                
                                                
>>> host: /lib/systemd/system/containerd.service:
* Profile "cilium-341440" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-341440"

                                                
                                                

                                                
                                                
>>> host: /etc/containerd/config.toml:
* Profile "cilium-341440" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-341440"

                                                
                                                

                                                
                                                
>>> host: containerd config dump:
* Profile "cilium-341440" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-341440"

                                                
                                                

                                                
                                                
>>> host: crio daemon status:
* Profile "cilium-341440" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-341440"

                                                
                                                

                                                
                                                
>>> host: crio daemon config:
* Profile "cilium-341440" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-341440"

                                                
                                                

                                                
                                                
>>> host: /etc/crio:
* Profile "cilium-341440" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-341440"

                                                
                                                

                                                
                                                
>>> host: crio config:
* Profile "cilium-341440" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-341440"

                                                
                                                
----------------------- debugLogs end: cilium-341440 [took: 5.151722088s] --------------------------------
helpers_test.go:175: Cleaning up "cilium-341440" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-arm64 delete -p cilium-341440
--- SKIP: TestNetworkPlugins/group/cilium (5.32s)

                                                
                                    
Copied to clipboard