Test Report: Docker_Linux_containerd_arm64 19411

                    
                      4600b9572ee814234a805050dbc754aa211b5034:2024-08-12:35750
                    
                

Test fail (2/336)

Order failed test Duration
38 TestAddons/serial/Volcano 200.56
311 TestStartStop/group/old-k8s-version/serial/SecondStart 379.47
x
+
TestAddons/serial/Volcano (200.56s)

                                                
                                                
=== RUN   TestAddons/serial/Volcano
addons_test.go:897: volcano-scheduler stabilized in 55.909716ms
addons_test.go:905: volcano-admission stabilized in 55.960628ms
addons_test.go:913: volcano-controller stabilized in 56.005443ms
addons_test.go:919: (dbg) TestAddons/serial/Volcano: waiting 6m0s for pods matching "app=volcano-scheduler" in namespace "volcano-system" ...
helpers_test.go:344: "volcano-scheduler-844f6db89b-m47g4" [39f9943e-1a0d-4bed-8f1d-5c9c1d165aae] Running
addons_test.go:919: (dbg) TestAddons/serial/Volcano: app=volcano-scheduler healthy within 6.003879874s
addons_test.go:923: (dbg) TestAddons/serial/Volcano: waiting 6m0s for pods matching "app=volcano-admission" in namespace "volcano-system" ...
helpers_test.go:344: "volcano-admission-5f7844f7bc-mbs4n" [7400e137-6829-43d0-93f0-61fd9496e5dc] Running
addons_test.go:923: (dbg) TestAddons/serial/Volcano: app=volcano-admission healthy within 5.003631054s
addons_test.go:927: (dbg) TestAddons/serial/Volcano: waiting 6m0s for pods matching "app=volcano-controller" in namespace "volcano-system" ...
helpers_test.go:344: "volcano-controllers-59cb4746db-dfflb" [8d5d9ddc-75a3-4e0f-afda-ac54529a3f2d] Running
addons_test.go:927: (dbg) TestAddons/serial/Volcano: app=volcano-controller healthy within 5.00347183s
addons_test.go:932: (dbg) Run:  kubectl --context addons-673965 delete -n volcano-system job volcano-admission-init
addons_test.go:938: (dbg) Run:  kubectl --context addons-673965 create -f testdata/vcjob.yaml
addons_test.go:946: (dbg) Run:  kubectl --context addons-673965 get vcjob -n my-volcano
addons_test.go:964: (dbg) TestAddons/serial/Volcano: waiting 3m0s for pods matching "volcano.sh/job-name=test-job" in namespace "my-volcano" ...
helpers_test.go:344: "test-job-nginx-0" [5a613d8f-9aa6-4773-bda5-2ae69b876e05] Pending
helpers_test.go:344: "test-job-nginx-0" [5a613d8f-9aa6-4773-bda5-2ae69b876e05] Pending: PodScheduled:Unschedulable (0/1 nodes are unavailable: 1 Insufficient cpu.)
helpers_test.go:329: TestAddons/serial/Volcano: WARNING: pod list for "my-volcano" "volcano.sh/job-name=test-job" returned: client rate limiter Wait returned an error: rate: Wait(n=1) would exceed context deadline
addons_test.go:964: ***** TestAddons/serial/Volcano: pod "volcano.sh/job-name=test-job" failed to start within 3m0s: context deadline exceeded ****
addons_test.go:964: (dbg) Run:  out/minikube-linux-arm64 status --format={{.APIServer}} -p addons-673965 -n addons-673965
addons_test.go:964: TestAddons/serial/Volcano: showing logs for failed pods as of 2024-08-12 12:28:01.160950459 +0000 UTC m=+385.771450131
addons_test.go:964: (dbg) Run:  kubectl --context addons-673965 describe po test-job-nginx-0 -n my-volcano
addons_test.go:964: (dbg) kubectl --context addons-673965 describe po test-job-nginx-0 -n my-volcano:
Name:             test-job-nginx-0
Namespace:        my-volcano
Priority:         0
Service Account:  default
Node:             <none>
Labels:           volcano.sh/job-name=test-job
volcano.sh/job-namespace=my-volcano
volcano.sh/queue-name=test
volcano.sh/task-index=0
volcano.sh/task-spec=nginx
Annotations:      scheduling.k8s.io/group-name: test-job-4ad770f2-ace0-4040-964b-3ac8ad5f62d6
volcano.sh/job-name: test-job
volcano.sh/job-version: 0
volcano.sh/queue-name: test
volcano.sh/task-index: 0
volcano.sh/task-spec: nginx
volcano.sh/template-uid: test-job-nginx
Status:           Pending
IP:               
IPs:              <none>
Controlled By:    Job/test-job
Containers:
nginx:
Image:      nginx:latest
Port:       <none>
Host Port:  <none>
Command:
sleep
10m
Limits:
cpu:  1
Requests:
cpu:  1
Environment:
GOOGLE_APPLICATION_CREDENTIALS:  /google-app-creds.json
PROJECT_ID:                      this_is_fake
GCP_PROJECT:                     this_is_fake
GCLOUD_PROJECT:                  this_is_fake
GOOGLE_CLOUD_PROJECT:            this_is_fake
CLOUDSDK_CORE_PROJECT:           this_is_fake
Mounts:
/google-app-creds.json from gcp-creds (ro)
/var/run/secrets/kubernetes.io/serviceaccount from kube-api-access-qc7bq (ro)
Conditions:
Type           Status
PodScheduled   False 
Volumes:
kube-api-access-qc7bq:
Type:                    Projected (a volume that contains injected data from multiple sources)
TokenExpirationSeconds:  3607
ConfigMapName:           kube-root-ca.crt
ConfigMapOptional:       <nil>
DownwardAPI:             true
gcp-creds:
Type:          HostPath (bare host directory volume)
Path:          /var/lib/minikube/google_application_credentials.json
HostPathType:  File
QoS Class:         Burstable
Node-Selectors:    <none>
Tolerations:       node.kubernetes.io/not-ready:NoExecute op=Exists for 300s
node.kubernetes.io/unreachable:NoExecute op=Exists for 300s
Events:
Type     Reason            Age   From     Message
----     ------            ----  ----     -------
Warning  FailedScheduling  3m    volcano  0/1 nodes are unavailable: 1 Insufficient cpu.
addons_test.go:964: (dbg) Run:  kubectl --context addons-673965 logs test-job-nginx-0 -n my-volcano
addons_test.go:964: (dbg) kubectl --context addons-673965 logs test-job-nginx-0 -n my-volcano:
addons_test.go:965: failed waiting for test-local-path pod: volcano.sh/job-name=test-job within 3m0s: context deadline exceeded
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:230: ======>  post-mortem[TestAddons/serial/Volcano]: docker inspect <======
helpers_test.go:231: (dbg) Run:  docker inspect addons-673965
helpers_test.go:235: (dbg) docker inspect addons-673965:

                                                
                                                
-- stdout --
	[
	    {
	        "Id": "594a94c5fccda47ee033f750b3c17730696e578998840f90b9a2ba25801987bc",
	        "Created": "2024-08-12T12:22:26.838916451Z",
	        "Path": "/usr/local/bin/entrypoint",
	        "Args": [
	            "/sbin/init"
	        ],
	        "State": {
	            "Status": "running",
	            "Running": true,
	            "Paused": false,
	            "Restarting": false,
	            "OOMKilled": false,
	            "Dead": false,
	            "Pid": 1005887,
	            "ExitCode": 0,
	            "Error": "",
	            "StartedAt": "2024-08-12T12:22:26.986238697Z",
	            "FinishedAt": "0001-01-01T00:00:00Z"
	        },
	        "Image": "sha256:3c2a9878c3c4bba39f30158565171acf4131a22446ec76f61f10b90a1f2f9e07",
	        "ResolvConfPath": "/var/lib/docker/containers/594a94c5fccda47ee033f750b3c17730696e578998840f90b9a2ba25801987bc/resolv.conf",
	        "HostnamePath": "/var/lib/docker/containers/594a94c5fccda47ee033f750b3c17730696e578998840f90b9a2ba25801987bc/hostname",
	        "HostsPath": "/var/lib/docker/containers/594a94c5fccda47ee033f750b3c17730696e578998840f90b9a2ba25801987bc/hosts",
	        "LogPath": "/var/lib/docker/containers/594a94c5fccda47ee033f750b3c17730696e578998840f90b9a2ba25801987bc/594a94c5fccda47ee033f750b3c17730696e578998840f90b9a2ba25801987bc-json.log",
	        "Name": "/addons-673965",
	        "RestartCount": 0,
	        "Driver": "overlay2",
	        "Platform": "linux",
	        "MountLabel": "",
	        "ProcessLabel": "",
	        "AppArmorProfile": "unconfined",
	        "ExecIDs": null,
	        "HostConfig": {
	            "Binds": [
	                "/lib/modules:/lib/modules:ro",
	                "addons-673965:/var"
	            ],
	            "ContainerIDFile": "",
	            "LogConfig": {
	                "Type": "json-file",
	                "Config": {}
	            },
	            "NetworkMode": "addons-673965",
	            "PortBindings": {
	                "22/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": ""
	                    }
	                ],
	                "2376/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": ""
	                    }
	                ],
	                "32443/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": ""
	                    }
	                ],
	                "5000/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": ""
	                    }
	                ],
	                "8443/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": ""
	                    }
	                ]
	            },
	            "RestartPolicy": {
	                "Name": "no",
	                "MaximumRetryCount": 0
	            },
	            "AutoRemove": false,
	            "VolumeDriver": "",
	            "VolumesFrom": null,
	            "ConsoleSize": [
	                0,
	                0
	            ],
	            "CapAdd": null,
	            "CapDrop": null,
	            "CgroupnsMode": "host",
	            "Dns": [],
	            "DnsOptions": [],
	            "DnsSearch": [],
	            "ExtraHosts": null,
	            "GroupAdd": null,
	            "IpcMode": "private",
	            "Cgroup": "",
	            "Links": null,
	            "OomScoreAdj": 0,
	            "PidMode": "",
	            "Privileged": true,
	            "PublishAllPorts": false,
	            "ReadonlyRootfs": false,
	            "SecurityOpt": [
	                "seccomp=unconfined",
	                "apparmor=unconfined",
	                "label=disable"
	            ],
	            "Tmpfs": {
	                "/run": "",
	                "/tmp": ""
	            },
	            "UTSMode": "",
	            "UsernsMode": "",
	            "ShmSize": 67108864,
	            "Runtime": "runc",
	            "Isolation": "",
	            "CpuShares": 0,
	            "Memory": 4194304000,
	            "NanoCpus": 2000000000,
	            "CgroupParent": "",
	            "BlkioWeight": 0,
	            "BlkioWeightDevice": [],
	            "BlkioDeviceReadBps": [],
	            "BlkioDeviceWriteBps": [],
	            "BlkioDeviceReadIOps": [],
	            "BlkioDeviceWriteIOps": [],
	            "CpuPeriod": 0,
	            "CpuQuota": 0,
	            "CpuRealtimePeriod": 0,
	            "CpuRealtimeRuntime": 0,
	            "CpusetCpus": "",
	            "CpusetMems": "",
	            "Devices": [],
	            "DeviceCgroupRules": null,
	            "DeviceRequests": null,
	            "MemoryReservation": 0,
	            "MemorySwap": 8388608000,
	            "MemorySwappiness": null,
	            "OomKillDisable": false,
	            "PidsLimit": null,
	            "Ulimits": [],
	            "CpuCount": 0,
	            "CpuPercent": 0,
	            "IOMaximumIOps": 0,
	            "IOMaximumBandwidth": 0,
	            "MaskedPaths": null,
	            "ReadonlyPaths": null
	        },
	        "GraphDriver": {
	            "Data": {
	                "LowerDir": "/var/lib/docker/overlay2/cf01dc3941696f6af4207ef6b6f0f87cb7bbe0ac0317fd90aa77f98a78d45ae5-init/diff:/var/lib/docker/overlay2/1f2e4529443bfeb33feb3238889864713c36cb4ab004f88ab476ba0ee1a2cd6b/diff",
	                "MergedDir": "/var/lib/docker/overlay2/cf01dc3941696f6af4207ef6b6f0f87cb7bbe0ac0317fd90aa77f98a78d45ae5/merged",
	                "UpperDir": "/var/lib/docker/overlay2/cf01dc3941696f6af4207ef6b6f0f87cb7bbe0ac0317fd90aa77f98a78d45ae5/diff",
	                "WorkDir": "/var/lib/docker/overlay2/cf01dc3941696f6af4207ef6b6f0f87cb7bbe0ac0317fd90aa77f98a78d45ae5/work"
	            },
	            "Name": "overlay2"
	        },
	        "Mounts": [
	            {
	                "Type": "bind",
	                "Source": "/lib/modules",
	                "Destination": "/lib/modules",
	                "Mode": "ro",
	                "RW": false,
	                "Propagation": "rprivate"
	            },
	            {
	                "Type": "volume",
	                "Name": "addons-673965",
	                "Source": "/var/lib/docker/volumes/addons-673965/_data",
	                "Destination": "/var",
	                "Driver": "local",
	                "Mode": "z",
	                "RW": true,
	                "Propagation": ""
	            }
	        ],
	        "Config": {
	            "Hostname": "addons-673965",
	            "Domainname": "",
	            "User": "",
	            "AttachStdin": false,
	            "AttachStdout": false,
	            "AttachStderr": false,
	            "ExposedPorts": {
	                "22/tcp": {},
	                "2376/tcp": {},
	                "32443/tcp": {},
	                "5000/tcp": {},
	                "8443/tcp": {}
	            },
	            "Tty": true,
	            "OpenStdin": false,
	            "StdinOnce": false,
	            "Env": [
	                "container=docker",
	                "PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin"
	            ],
	            "Cmd": null,
	            "Image": "gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1723026928-19389@sha256:7715fe0c5dce35b4eb757765cbbe02d40cd8b5effa0639735e42ad89f4f51ef0",
	            "Volumes": null,
	            "WorkingDir": "/",
	            "Entrypoint": [
	                "/usr/local/bin/entrypoint",
	                "/sbin/init"
	            ],
	            "OnBuild": null,
	            "Labels": {
	                "created_by.minikube.sigs.k8s.io": "true",
	                "mode.minikube.sigs.k8s.io": "addons-673965",
	                "name.minikube.sigs.k8s.io": "addons-673965",
	                "role.minikube.sigs.k8s.io": ""
	            },
	            "StopSignal": "SIGRTMIN+3"
	        },
	        "NetworkSettings": {
	            "Bridge": "",
	            "SandboxID": "ea51dc643677e06f601fbd79edd503e2587e13db8ac79dff8214444e1bbec887",
	            "SandboxKey": "/var/run/docker/netns/ea51dc643677",
	            "Ports": {
	                "22/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": "33894"
	                    }
	                ],
	                "2376/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": "33895"
	                    }
	                ],
	                "32443/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": "33898"
	                    }
	                ],
	                "5000/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": "33896"
	                    }
	                ],
	                "8443/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": "33897"
	                    }
	                ]
	            },
	            "HairpinMode": false,
	            "LinkLocalIPv6Address": "",
	            "LinkLocalIPv6PrefixLen": 0,
	            "SecondaryIPAddresses": null,
	            "SecondaryIPv6Addresses": null,
	            "EndpointID": "",
	            "Gateway": "",
	            "GlobalIPv6Address": "",
	            "GlobalIPv6PrefixLen": 0,
	            "IPAddress": "",
	            "IPPrefixLen": 0,
	            "IPv6Gateway": "",
	            "MacAddress": "",
	            "Networks": {
	                "addons-673965": {
	                    "IPAMConfig": {
	                        "IPv4Address": "192.168.49.2"
	                    },
	                    "Links": null,
	                    "Aliases": null,
	                    "MacAddress": "02:42:c0:a8:31:02",
	                    "DriverOpts": null,
	                    "NetworkID": "1604ecf891e70402de8f81c086fd58a4ebdae377a21a411130d0afa606f5ad05",
	                    "EndpointID": "3df2284f69c7c25e9aef9e17ce40513c7d96fadbded81fed63ec6bd95097d3ec",
	                    "Gateway": "192.168.49.1",
	                    "IPAddress": "192.168.49.2",
	                    "IPPrefixLen": 24,
	                    "IPv6Gateway": "",
	                    "GlobalIPv6Address": "",
	                    "GlobalIPv6PrefixLen": 0,
	                    "DNSNames": [
	                        "addons-673965",
	                        "594a94c5fccd"
	                    ]
	                }
	            }
	        }
	    }
	]

                                                
                                                
-- /stdout --
helpers_test.go:239: (dbg) Run:  out/minikube-linux-arm64 status --format={{.Host}} -p addons-673965 -n addons-673965
helpers_test.go:244: <<< TestAddons/serial/Volcano FAILED: start of post-mortem logs <<<
helpers_test.go:245: ======>  post-mortem[TestAddons/serial/Volcano]: minikube logs <======
helpers_test.go:247: (dbg) Run:  out/minikube-linux-arm64 -p addons-673965 logs -n 25
helpers_test.go:247: (dbg) Done: out/minikube-linux-arm64 -p addons-673965 logs -n 25: (1.555791778s)
helpers_test.go:252: TestAddons/serial/Volcano logs: 
-- stdout --
	
	==> Audit <==
	|---------|--------------------------------------|------------------------|---------|---------|---------------------|---------------------|
	| Command |                 Args                 |        Profile         |  User   | Version |     Start Time      |      End Time       |
	|---------|--------------------------------------|------------------------|---------|---------|---------------------|---------------------|
	| start   | -o=json --download-only              | download-only-752214   | jenkins | v1.33.1 | 12 Aug 24 12:21 UTC |                     |
	|         | -p download-only-752214              |                        |         |         |                     |                     |
	|         | --force --alsologtostderr            |                        |         |         |                     |                     |
	|         | --kubernetes-version=v1.20.0         |                        |         |         |                     |                     |
	|         | --container-runtime=containerd       |                        |         |         |                     |                     |
	|         | --driver=docker                      |                        |         |         |                     |                     |
	|         | --container-runtime=containerd       |                        |         |         |                     |                     |
	| delete  | --all                                | minikube               | jenkins | v1.33.1 | 12 Aug 24 12:21 UTC | 12 Aug 24 12:21 UTC |
	| delete  | -p download-only-752214              | download-only-752214   | jenkins | v1.33.1 | 12 Aug 24 12:21 UTC | 12 Aug 24 12:21 UTC |
	| start   | -o=json --download-only              | download-only-767584   | jenkins | v1.33.1 | 12 Aug 24 12:21 UTC |                     |
	|         | -p download-only-767584              |                        |         |         |                     |                     |
	|         | --force --alsologtostderr            |                        |         |         |                     |                     |
	|         | --kubernetes-version=v1.30.3         |                        |         |         |                     |                     |
	|         | --container-runtime=containerd       |                        |         |         |                     |                     |
	|         | --driver=docker                      |                        |         |         |                     |                     |
	|         | --container-runtime=containerd       |                        |         |         |                     |                     |
	| delete  | --all                                | minikube               | jenkins | v1.33.1 | 12 Aug 24 12:21 UTC | 12 Aug 24 12:21 UTC |
	| delete  | -p download-only-767584              | download-only-767584   | jenkins | v1.33.1 | 12 Aug 24 12:21 UTC | 12 Aug 24 12:21 UTC |
	| start   | -o=json --download-only              | download-only-005875   | jenkins | v1.33.1 | 12 Aug 24 12:21 UTC |                     |
	|         | -p download-only-005875              |                        |         |         |                     |                     |
	|         | --force --alsologtostderr            |                        |         |         |                     |                     |
	|         | --kubernetes-version=v1.31.0-rc.0    |                        |         |         |                     |                     |
	|         | --container-runtime=containerd       |                        |         |         |                     |                     |
	|         | --driver=docker                      |                        |         |         |                     |                     |
	|         | --container-runtime=containerd       |                        |         |         |                     |                     |
	| delete  | --all                                | minikube               | jenkins | v1.33.1 | 12 Aug 24 12:21 UTC | 12 Aug 24 12:21 UTC |
	| delete  | -p download-only-005875              | download-only-005875   | jenkins | v1.33.1 | 12 Aug 24 12:21 UTC | 12 Aug 24 12:22 UTC |
	| delete  | -p download-only-752214              | download-only-752214   | jenkins | v1.33.1 | 12 Aug 24 12:22 UTC | 12 Aug 24 12:22 UTC |
	| delete  | -p download-only-767584              | download-only-767584   | jenkins | v1.33.1 | 12 Aug 24 12:22 UTC | 12 Aug 24 12:22 UTC |
	| delete  | -p download-only-005875              | download-only-005875   | jenkins | v1.33.1 | 12 Aug 24 12:22 UTC | 12 Aug 24 12:22 UTC |
	| start   | --download-only -p                   | download-docker-202455 | jenkins | v1.33.1 | 12 Aug 24 12:22 UTC |                     |
	|         | download-docker-202455               |                        |         |         |                     |                     |
	|         | --alsologtostderr                    |                        |         |         |                     |                     |
	|         | --driver=docker                      |                        |         |         |                     |                     |
	|         | --container-runtime=containerd       |                        |         |         |                     |                     |
	| delete  | -p download-docker-202455            | download-docker-202455 | jenkins | v1.33.1 | 12 Aug 24 12:22 UTC | 12 Aug 24 12:22 UTC |
	| start   | --download-only -p                   | binary-mirror-202284   | jenkins | v1.33.1 | 12 Aug 24 12:22 UTC |                     |
	|         | binary-mirror-202284                 |                        |         |         |                     |                     |
	|         | --alsologtostderr                    |                        |         |         |                     |                     |
	|         | --binary-mirror                      |                        |         |         |                     |                     |
	|         | http://127.0.0.1:46139               |                        |         |         |                     |                     |
	|         | --driver=docker                      |                        |         |         |                     |                     |
	|         | --container-runtime=containerd       |                        |         |         |                     |                     |
	| delete  | -p binary-mirror-202284              | binary-mirror-202284   | jenkins | v1.33.1 | 12 Aug 24 12:22 UTC | 12 Aug 24 12:22 UTC |
	| addons  | enable dashboard -p                  | addons-673965          | jenkins | v1.33.1 | 12 Aug 24 12:22 UTC |                     |
	|         | addons-673965                        |                        |         |         |                     |                     |
	| addons  | disable dashboard -p                 | addons-673965          | jenkins | v1.33.1 | 12 Aug 24 12:22 UTC |                     |
	|         | addons-673965                        |                        |         |         |                     |                     |
	| start   | -p addons-673965 --wait=true         | addons-673965          | jenkins | v1.33.1 | 12 Aug 24 12:22 UTC | 12 Aug 24 12:24 UTC |
	|         | --memory=4000 --alsologtostderr      |                        |         |         |                     |                     |
	|         | --addons=registry                    |                        |         |         |                     |                     |
	|         | --addons=metrics-server              |                        |         |         |                     |                     |
	|         | --addons=volumesnapshots             |                        |         |         |                     |                     |
	|         | --addons=csi-hostpath-driver         |                        |         |         |                     |                     |
	|         | --addons=gcp-auth                    |                        |         |         |                     |                     |
	|         | --addons=cloud-spanner               |                        |         |         |                     |                     |
	|         | --addons=inspektor-gadget            |                        |         |         |                     |                     |
	|         | --addons=storage-provisioner-rancher |                        |         |         |                     |                     |
	|         | --addons=nvidia-device-plugin        |                        |         |         |                     |                     |
	|         | --addons=yakd --addons=volcano       |                        |         |         |                     |                     |
	|         | --driver=docker                      |                        |         |         |                     |                     |
	|         | --container-runtime=containerd       |                        |         |         |                     |                     |
	|         | --addons=ingress                     |                        |         |         |                     |                     |
	|         | --addons=ingress-dns                 |                        |         |         |                     |                     |
	|---------|--------------------------------------|------------------------|---------|---------|---------------------|---------------------|
	
	
	==> Last Start <==
	Log file created at: 2024/08/12 12:22:02
	Running on machine: ip-172-31-30-239
	Binary: Built with gc go1.22.5 for linux/arm64
	Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg
	I0812 12:22:02.078030 1005383 out.go:291] Setting OutFile to fd 1 ...
	I0812 12:22:02.078205 1005383 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0812 12:22:02.078215 1005383 out.go:304] Setting ErrFile to fd 2...
	I0812 12:22:02.078220 1005383 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0812 12:22:02.078463 1005383 root.go:338] Updating PATH: /home/jenkins/minikube-integration/19411-998978/.minikube/bin
	I0812 12:22:02.078952 1005383 out.go:298] Setting JSON to false
	I0812 12:22:02.079912 1005383 start.go:129] hostinfo: {"hostname":"ip-172-31-30-239","uptime":14671,"bootTime":1723450651,"procs":184,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1066-aws","kernelArch":"aarch64","virtualizationSystem":"","virtualizationRole":"","hostId":"92f46a7d-c249-4c12-924a-77f64874c910"}
	I0812 12:22:02.079993 1005383 start.go:139] virtualization:  
	I0812 12:22:02.083326 1005383 out.go:177] * [addons-673965] minikube v1.33.1 on Ubuntu 20.04 (arm64)
	I0812 12:22:02.086900 1005383 out.go:177]   - MINIKUBE_LOCATION=19411
	I0812 12:22:02.087177 1005383 notify.go:220] Checking for updates...
	I0812 12:22:02.092359 1005383 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I0812 12:22:02.095025 1005383 out.go:177]   - KUBECONFIG=/home/jenkins/minikube-integration/19411-998978/kubeconfig
	I0812 12:22:02.097644 1005383 out.go:177]   - MINIKUBE_HOME=/home/jenkins/minikube-integration/19411-998978/.minikube
	I0812 12:22:02.100230 1005383 out.go:177]   - MINIKUBE_BIN=out/minikube-linux-arm64
	I0812 12:22:02.103156 1005383 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=
	I0812 12:22:02.106154 1005383 driver.go:392] Setting default libvirt URI to qemu:///system
	I0812 12:22:02.131401 1005383 docker.go:123] docker version: linux-27.1.1:Docker Engine - Community
	I0812 12:22:02.131547 1005383 cli_runner.go:164] Run: docker system info --format "{{json .}}"
	I0812 12:22:02.203827 1005383 info.go:266] docker info: {ID:6ZPO:QZND:VNGE:LUKL:4Y3K:XELL:AAX4:2GTK:E6LM:MPRN:3ZXR:TTMR Containers:0 ContainersRunning:0 ContainersPaused:0 ContainersStopped:0 Images:1 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:25 OomKillDisable:true NGoroutines:44 SystemTime:2024-08-12 12:22:02.192661783 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1066-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Architecture:aar
ch64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8214896640 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-30-239 Labels:[] ExperimentalBuild:false ServerVersion:27.1.1 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:2bf793ef6dc9a18e00cb12efb64355c2c9d5eb41 Expected:2bf793ef6dc9a18e00cb12efb64355c2c9d5eb41} RuncCommit:{ID:v1.1.13-0-g58aa920 Expected:v1.1.13-0-g58aa920} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:<nil> ServerErro
rs:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.16.1] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.29.1]] Warnings:<nil>}}
	I0812 12:22:02.203947 1005383 docker.go:307] overlay module found
	I0812 12:22:02.208727 1005383 out.go:177] * Using the docker driver based on user configuration
	I0812 12:22:02.211366 1005383 start.go:297] selected driver: docker
	I0812 12:22:02.211392 1005383 start.go:901] validating driver "docker" against <nil>
	I0812 12:22:02.211407 1005383 start.go:912] status for docker: {Installed:true Healthy:true Running:false NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I0812 12:22:02.212060 1005383 cli_runner.go:164] Run: docker system info --format "{{json .}}"
	I0812 12:22:02.262975 1005383 info.go:266] docker info: {ID:6ZPO:QZND:VNGE:LUKL:4Y3K:XELL:AAX4:2GTK:E6LM:MPRN:3ZXR:TTMR Containers:0 ContainersRunning:0 ContainersPaused:0 ContainersStopped:0 Images:1 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:25 OomKillDisable:true NGoroutines:44 SystemTime:2024-08-12 12:22:02.25424163 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1066-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Architecture:aarc
h64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8214896640 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-30-239 Labels:[] ExperimentalBuild:false ServerVersion:27.1.1 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:2bf793ef6dc9a18e00cb12efb64355c2c9d5eb41 Expected:2bf793ef6dc9a18e00cb12efb64355c2c9d5eb41} RuncCommit:{ID:v1.1.13-0-g58aa920 Expected:v1.1.13-0-g58aa920} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:<nil> ServerError
s:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.16.1] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.29.1]] Warnings:<nil>}}
	I0812 12:22:02.263134 1005383 start_flags.go:310] no existing cluster config was found, will generate one from the flags 
	I0812 12:22:02.263371 1005383 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
	I0812 12:22:02.266089 1005383 out.go:177] * Using Docker driver with root privileges
	I0812 12:22:02.268679 1005383 cni.go:84] Creating CNI manager for ""
	I0812 12:22:02.268706 1005383 cni.go:143] "docker" driver + "containerd" runtime found, recommending kindnet
	I0812 12:22:02.268725 1005383 start_flags.go:319] Found "CNI" CNI - setting NetworkPlugin=cni
	I0812 12:22:02.268823 1005383 start.go:340] cluster config:
	{Name:addons-673965 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1723026928-19389@sha256:7715fe0c5dce35b4eb757765cbbe02d40cd8b5effa0639735e42ad89f4f51ef0 Memory:4000 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.30.3 ClusterName:addons-673965 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime
:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.30.3 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHA
uthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I0812 12:22:02.271743 1005383 out.go:177] * Starting "addons-673965" primary control-plane node in "addons-673965" cluster
	I0812 12:22:02.274415 1005383 cache.go:121] Beginning downloading kic base image for docker with containerd
	I0812 12:22:02.277105 1005383 out.go:177] * Pulling base image v0.0.44-1723026928-19389 ...
	I0812 12:22:02.279640 1005383 preload.go:131] Checking if preload exists for k8s version v1.30.3 and runtime containerd
	I0812 12:22:02.279674 1005383 image.go:79] Checking for gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1723026928-19389@sha256:7715fe0c5dce35b4eb757765cbbe02d40cd8b5effa0639735e42ad89f4f51ef0 in local docker daemon
	I0812 12:22:02.279719 1005383 preload.go:146] Found local preload: /home/jenkins/minikube-integration/19411-998978/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.30.3-containerd-overlay2-arm64.tar.lz4
	I0812 12:22:02.279729 1005383 cache.go:56] Caching tarball of preloaded images
	I0812 12:22:02.279807 1005383 preload.go:172] Found /home/jenkins/minikube-integration/19411-998978/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.30.3-containerd-overlay2-arm64.tar.lz4 in cache, skipping download
	I0812 12:22:02.279817 1005383 cache.go:59] Finished verifying existence of preloaded tar for v1.30.3 on containerd
	I0812 12:22:02.280139 1005383 profile.go:143] Saving config to /home/jenkins/minikube-integration/19411-998978/.minikube/profiles/addons-673965/config.json ...
	I0812 12:22:02.280159 1005383 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19411-998978/.minikube/profiles/addons-673965/config.json: {Name:mke0179d9f7301437eab36bfbb423808c2eccf4d Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0812 12:22:02.294705 1005383 cache.go:149] Downloading gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1723026928-19389@sha256:7715fe0c5dce35b4eb757765cbbe02d40cd8b5effa0639735e42ad89f4f51ef0 to local cache
	I0812 12:22:02.294846 1005383 image.go:63] Checking for gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1723026928-19389@sha256:7715fe0c5dce35b4eb757765cbbe02d40cd8b5effa0639735e42ad89f4f51ef0 in local cache directory
	I0812 12:22:02.294870 1005383 image.go:66] Found gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1723026928-19389@sha256:7715fe0c5dce35b4eb757765cbbe02d40cd8b5effa0639735e42ad89f4f51ef0 in local cache directory, skipping pull
	I0812 12:22:02.294883 1005383 image.go:135] gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1723026928-19389@sha256:7715fe0c5dce35b4eb757765cbbe02d40cd8b5effa0639735e42ad89f4f51ef0 exists in cache, skipping pull
	I0812 12:22:02.294897 1005383 cache.go:152] successfully saved gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1723026928-19389@sha256:7715fe0c5dce35b4eb757765cbbe02d40cd8b5effa0639735e42ad89f4f51ef0 as a tarball
	I0812 12:22:02.294903 1005383 cache.go:162] Loading gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1723026928-19389@sha256:7715fe0c5dce35b4eb757765cbbe02d40cd8b5effa0639735e42ad89f4f51ef0 from local cache
	I0812 12:22:19.316124 1005383 cache.go:164] successfully loaded and using gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1723026928-19389@sha256:7715fe0c5dce35b4eb757765cbbe02d40cd8b5effa0639735e42ad89f4f51ef0 from cached tarball
	I0812 12:22:19.316162 1005383 cache.go:194] Successfully downloaded all kic artifacts
	I0812 12:22:19.316193 1005383 start.go:360] acquireMachinesLock for addons-673965: {Name:mk751d0b0d5f916f75ce4954d89b96bd7a1d72a0 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0812 12:22:19.317001 1005383 start.go:364] duration metric: took 782.381µs to acquireMachinesLock for "addons-673965"
	I0812 12:22:19.317039 1005383 start.go:93] Provisioning new machine with config: &{Name:addons-673965 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1723026928-19389@sha256:7715fe0c5dce35b4eb757765cbbe02d40cd8b5effa0639735e42ad89f4f51ef0 Memory:4000 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.30.3 ClusterName:addons-673965 Namespace:default APIServerHAVIP: APIServerName:min
ikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.30.3 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:fa
lse CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.30.3 ContainerRuntime:containerd ControlPlane:true Worker:true}
	I0812 12:22:19.317182 1005383 start.go:125] createHost starting for "" (driver="docker")
	I0812 12:22:19.319181 1005383 out.go:204] * Creating docker container (CPUs=2, Memory=4000MB) ...
	I0812 12:22:19.319425 1005383 start.go:159] libmachine.API.Create for "addons-673965" (driver="docker")
	I0812 12:22:19.319458 1005383 client.go:168] LocalClient.Create starting
	I0812 12:22:19.319605 1005383 main.go:141] libmachine: Creating CA: /home/jenkins/minikube-integration/19411-998978/.minikube/certs/ca.pem
	I0812 12:22:19.912147 1005383 main.go:141] libmachine: Creating client certificate: /home/jenkins/minikube-integration/19411-998978/.minikube/certs/cert.pem
	I0812 12:22:20.255053 1005383 cli_runner.go:164] Run: docker network inspect addons-673965 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
	W0812 12:22:20.269925 1005383 cli_runner.go:211] docker network inspect addons-673965 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}" returned with exit code 1
	I0812 12:22:20.270018 1005383 network_create.go:284] running [docker network inspect addons-673965] to gather additional debugging logs...
	I0812 12:22:20.270039 1005383 cli_runner.go:164] Run: docker network inspect addons-673965
	W0812 12:22:20.284789 1005383 cli_runner.go:211] docker network inspect addons-673965 returned with exit code 1
	I0812 12:22:20.284820 1005383 network_create.go:287] error running [docker network inspect addons-673965]: docker network inspect addons-673965: exit status 1
	stdout:
	[]
	
	stderr:
	Error response from daemon: network addons-673965 not found
	I0812 12:22:20.284834 1005383 network_create.go:289] output of [docker network inspect addons-673965]: -- stdout --
	[]
	
	-- /stdout --
	** stderr ** 
	Error response from daemon: network addons-673965 not found
	
	** /stderr **
	I0812 12:22:20.284938 1005383 cli_runner.go:164] Run: docker network inspect bridge --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
	I0812 12:22:20.302104 1005383 network.go:206] using free private subnet 192.168.49.0/24: &{IP:192.168.49.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.49.0/24 Gateway:192.168.49.1 ClientMin:192.168.49.2 ClientMax:192.168.49.254 Broadcast:192.168.49.255 IsPrivate:true Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:} reservation:0x4001bc0740}
	I0812 12:22:20.302152 1005383 network_create.go:124] attempt to create docker network addons-673965 192.168.49.0/24 with gateway 192.168.49.1 and MTU of 1500 ...
	I0812 12:22:20.302215 1005383 cli_runner.go:164] Run: docker network create --driver=bridge --subnet=192.168.49.0/24 --gateway=192.168.49.1 -o --ip-masq -o --icc -o com.docker.network.driver.mtu=1500 --label=created_by.minikube.sigs.k8s.io=true --label=name.minikube.sigs.k8s.io=addons-673965 addons-673965
	I0812 12:22:20.373912 1005383 network_create.go:108] docker network addons-673965 192.168.49.0/24 created
	I0812 12:22:20.373946 1005383 kic.go:121] calculated static IP "192.168.49.2" for the "addons-673965" container
	I0812 12:22:20.374036 1005383 cli_runner.go:164] Run: docker ps -a --format {{.Names}}
	I0812 12:22:20.394516 1005383 cli_runner.go:164] Run: docker volume create addons-673965 --label name.minikube.sigs.k8s.io=addons-673965 --label created_by.minikube.sigs.k8s.io=true
	I0812 12:22:20.411120 1005383 oci.go:103] Successfully created a docker volume addons-673965
	I0812 12:22:20.411223 1005383 cli_runner.go:164] Run: docker run --rm --name addons-673965-preload-sidecar --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=addons-673965 --entrypoint /usr/bin/test -v addons-673965:/var gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1723026928-19389@sha256:7715fe0c5dce35b4eb757765cbbe02d40cd8b5effa0639735e42ad89f4f51ef0 -d /var/lib
	I0812 12:22:22.529979 1005383 cli_runner.go:217] Completed: docker run --rm --name addons-673965-preload-sidecar --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=addons-673965 --entrypoint /usr/bin/test -v addons-673965:/var gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1723026928-19389@sha256:7715fe0c5dce35b4eb757765cbbe02d40cd8b5effa0639735e42ad89f4f51ef0 -d /var/lib: (2.118713441s)
	I0812 12:22:22.530011 1005383 oci.go:107] Successfully prepared a docker volume addons-673965
	I0812 12:22:22.530025 1005383 preload.go:131] Checking if preload exists for k8s version v1.30.3 and runtime containerd
	I0812 12:22:22.530045 1005383 kic.go:194] Starting extracting preloaded images to volume ...
	I0812 12:22:22.530143 1005383 cli_runner.go:164] Run: docker run --rm --entrypoint /usr/bin/tar -v /home/jenkins/minikube-integration/19411-998978/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.30.3-containerd-overlay2-arm64.tar.lz4:/preloaded.tar:ro -v addons-673965:/extractDir gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1723026928-19389@sha256:7715fe0c5dce35b4eb757765cbbe02d40cd8b5effa0639735e42ad89f4f51ef0 -I lz4 -xf /preloaded.tar -C /extractDir
	I0812 12:22:26.762538 1005383 cli_runner.go:217] Completed: docker run --rm --entrypoint /usr/bin/tar -v /home/jenkins/minikube-integration/19411-998978/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.30.3-containerd-overlay2-arm64.tar.lz4:/preloaded.tar:ro -v addons-673965:/extractDir gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1723026928-19389@sha256:7715fe0c5dce35b4eb757765cbbe02d40cd8b5effa0639735e42ad89f4f51ef0 -I lz4 -xf /preloaded.tar -C /extractDir: (4.232350533s)
	I0812 12:22:26.762573 1005383 kic.go:203] duration metric: took 4.232524183s to extract preloaded images to volume ...
	W0812 12:22:26.762712 1005383 cgroups_linux.go:77] Your kernel does not support swap limit capabilities or the cgroup is not mounted.
	I0812 12:22:26.762833 1005383 cli_runner.go:164] Run: docker info --format "'{{json .SecurityOptions}}'"
	I0812 12:22:26.825910 1005383 cli_runner.go:164] Run: docker run -d -t --privileged --security-opt seccomp=unconfined --tmpfs /tmp --tmpfs /run -v /lib/modules:/lib/modules:ro --hostname addons-673965 --name addons-673965 --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=addons-673965 --label role.minikube.sigs.k8s.io= --label mode.minikube.sigs.k8s.io=addons-673965 --network addons-673965 --ip 192.168.49.2 --volume addons-673965:/var --security-opt apparmor=unconfined --memory=4000mb --cpus=2 -e container=docker --expose 8443 --publish=127.0.0.1::8443 --publish=127.0.0.1::22 --publish=127.0.0.1::2376 --publish=127.0.0.1::5000 --publish=127.0.0.1::32443 gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1723026928-19389@sha256:7715fe0c5dce35b4eb757765cbbe02d40cd8b5effa0639735e42ad89f4f51ef0
	I0812 12:22:27.178094 1005383 cli_runner.go:164] Run: docker container inspect addons-673965 --format={{.State.Running}}
	I0812 12:22:27.196560 1005383 cli_runner.go:164] Run: docker container inspect addons-673965 --format={{.State.Status}}
	I0812 12:22:27.225213 1005383 cli_runner.go:164] Run: docker exec addons-673965 stat /var/lib/dpkg/alternatives/iptables
	I0812 12:22:27.292647 1005383 oci.go:144] the created container "addons-673965" has a running status.
	I0812 12:22:27.292673 1005383 kic.go:225] Creating ssh key for kic: /home/jenkins/minikube-integration/19411-998978/.minikube/machines/addons-673965/id_rsa...
	I0812 12:22:27.751480 1005383 kic_runner.go:191] docker (temp): /home/jenkins/minikube-integration/19411-998978/.minikube/machines/addons-673965/id_rsa.pub --> /home/docker/.ssh/authorized_keys (381 bytes)
	I0812 12:22:27.794933 1005383 cli_runner.go:164] Run: docker container inspect addons-673965 --format={{.State.Status}}
	I0812 12:22:27.828998 1005383 kic_runner.go:93] Run: chown docker:docker /home/docker/.ssh/authorized_keys
	I0812 12:22:27.829021 1005383 kic_runner.go:114] Args: [docker exec --privileged addons-673965 chown docker:docker /home/docker/.ssh/authorized_keys]
	I0812 12:22:27.907094 1005383 cli_runner.go:164] Run: docker container inspect addons-673965 --format={{.State.Status}}
	I0812 12:22:27.928098 1005383 machine.go:94] provisionDockerMachine start ...
	I0812 12:22:27.928185 1005383 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-673965
	I0812 12:22:27.951641 1005383 main.go:141] libmachine: Using SSH client type: native
	I0812 12:22:27.951904 1005383 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x3e2cd0] 0x3e5530 <nil>  [] 0s} 127.0.0.1 33894 <nil> <nil>}
	I0812 12:22:27.951913 1005383 main.go:141] libmachine: About to run SSH command:
	hostname
	I0812 12:22:28.116979 1005383 main.go:141] libmachine: SSH cmd err, output: <nil>: addons-673965
	
	I0812 12:22:28.117065 1005383 ubuntu.go:169] provisioning hostname "addons-673965"
	I0812 12:22:28.117161 1005383 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-673965
	I0812 12:22:28.135265 1005383 main.go:141] libmachine: Using SSH client type: native
	I0812 12:22:28.135527 1005383 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x3e2cd0] 0x3e5530 <nil>  [] 0s} 127.0.0.1 33894 <nil> <nil>}
	I0812 12:22:28.135540 1005383 main.go:141] libmachine: About to run SSH command:
	sudo hostname addons-673965 && echo "addons-673965" | sudo tee /etc/hostname
	I0812 12:22:28.300002 1005383 main.go:141] libmachine: SSH cmd err, output: <nil>: addons-673965
	
	I0812 12:22:28.300162 1005383 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-673965
	I0812 12:22:28.319635 1005383 main.go:141] libmachine: Using SSH client type: native
	I0812 12:22:28.319954 1005383 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x3e2cd0] 0x3e5530 <nil>  [] 0s} 127.0.0.1 33894 <nil> <nil>}
	I0812 12:22:28.319978 1005383 main.go:141] libmachine: About to run SSH command:
	
			if ! grep -xq '.*\saddons-673965' /etc/hosts; then
				if grep -xq '127.0.1.1\s.*' /etc/hosts; then
					sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 addons-673965/g' /etc/hosts;
				else 
					echo '127.0.1.1 addons-673965' | sudo tee -a /etc/hosts; 
				fi
			fi
	I0812 12:22:28.465335 1005383 main.go:141] libmachine: SSH cmd err, output: <nil>: 
	I0812 12:22:28.465361 1005383 ubuntu.go:175] set auth options {CertDir:/home/jenkins/minikube-integration/19411-998978/.minikube CaCertPath:/home/jenkins/minikube-integration/19411-998978/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/19411-998978/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/19411-998978/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/19411-998978/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/19411-998978/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/19411-998978/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/19411-998978/.minikube}
	I0812 12:22:28.465386 1005383 ubuntu.go:177] setting up certificates
	I0812 12:22:28.465397 1005383 provision.go:84] configureAuth start
	I0812 12:22:28.465462 1005383 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" addons-673965
	I0812 12:22:28.482339 1005383 provision.go:143] copyHostCerts
	I0812 12:22:28.482441 1005383 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19411-998978/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/19411-998978/.minikube/ca.pem (1082 bytes)
	I0812 12:22:28.482565 1005383 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19411-998978/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/19411-998978/.minikube/cert.pem (1123 bytes)
	I0812 12:22:28.482628 1005383 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19411-998978/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/19411-998978/.minikube/key.pem (1679 bytes)
	I0812 12:22:28.482680 1005383 provision.go:117] generating server cert: /home/jenkins/minikube-integration/19411-998978/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/19411-998978/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/19411-998978/.minikube/certs/ca-key.pem org=jenkins.addons-673965 san=[127.0.0.1 192.168.49.2 addons-673965 localhost minikube]
	I0812 12:22:28.819909 1005383 provision.go:177] copyRemoteCerts
	I0812 12:22:28.819982 1005383 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
	I0812 12:22:28.820029 1005383 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-673965
	I0812 12:22:28.836702 1005383 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33894 SSHKeyPath:/home/jenkins/minikube-integration/19411-998978/.minikube/machines/addons-673965/id_rsa Username:docker}
	I0812 12:22:28.934185 1005383 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19411-998978/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1082 bytes)
	I0812 12:22:28.959263 1005383 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19411-998978/.minikube/machines/server.pem --> /etc/docker/server.pem (1208 bytes)
	I0812 12:22:28.983660 1005383 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19411-998978/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1679 bytes)
	I0812 12:22:29.008806 1005383 provision.go:87] duration metric: took 543.389859ms to configureAuth
	I0812 12:22:29.008836 1005383 ubuntu.go:193] setting minikube options for container-runtime
	I0812 12:22:29.009072 1005383 config.go:182] Loaded profile config "addons-673965": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.30.3
	I0812 12:22:29.009089 1005383 machine.go:97] duration metric: took 1.080972728s to provisionDockerMachine
	I0812 12:22:29.009097 1005383 client.go:171] duration metric: took 9.689629262s to LocalClient.Create
	I0812 12:22:29.009111 1005383 start.go:167] duration metric: took 9.689686524s to libmachine.API.Create "addons-673965"
	I0812 12:22:29.009124 1005383 start.go:293] postStartSetup for "addons-673965" (driver="docker")
	I0812 12:22:29.009135 1005383 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
	I0812 12:22:29.009192 1005383 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
	I0812 12:22:29.009318 1005383 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-673965
	I0812 12:22:29.025672 1005383 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33894 SSHKeyPath:/home/jenkins/minikube-integration/19411-998978/.minikube/machines/addons-673965/id_rsa Username:docker}
	I0812 12:22:29.126896 1005383 ssh_runner.go:195] Run: cat /etc/os-release
	I0812 12:22:29.130023 1005383 main.go:141] libmachine: Couldn't set key VERSION_CODENAME, no corresponding struct field found
	I0812 12:22:29.130141 1005383 main.go:141] libmachine: Couldn't set key PRIVACY_POLICY_URL, no corresponding struct field found
	I0812 12:22:29.130164 1005383 main.go:141] libmachine: Couldn't set key UBUNTU_CODENAME, no corresponding struct field found
	I0812 12:22:29.130172 1005383 info.go:137] Remote host: Ubuntu 22.04.4 LTS
	I0812 12:22:29.130183 1005383 filesync.go:126] Scanning /home/jenkins/minikube-integration/19411-998978/.minikube/addons for local assets ...
	I0812 12:22:29.130285 1005383 filesync.go:126] Scanning /home/jenkins/minikube-integration/19411-998978/.minikube/files for local assets ...
	I0812 12:22:29.130320 1005383 start.go:296] duration metric: took 121.187402ms for postStartSetup
	I0812 12:22:29.130632 1005383 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" addons-673965
	I0812 12:22:29.146863 1005383 profile.go:143] Saving config to /home/jenkins/minikube-integration/19411-998978/.minikube/profiles/addons-673965/config.json ...
	I0812 12:22:29.147153 1005383 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
	I0812 12:22:29.147206 1005383 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-673965
	I0812 12:22:29.163182 1005383 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33894 SSHKeyPath:/home/jenkins/minikube-integration/19411-998978/.minikube/machines/addons-673965/id_rsa Username:docker}
	I0812 12:22:29.258079 1005383 ssh_runner.go:195] Run: sh -c "df -BG /var | awk 'NR==2{print $4}'"
	I0812 12:22:29.262690 1005383 start.go:128] duration metric: took 9.945487885s to createHost
	I0812 12:22:29.262715 1005383 start.go:83] releasing machines lock for "addons-673965", held for 9.945697332s
	I0812 12:22:29.262786 1005383 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" addons-673965
	I0812 12:22:29.279564 1005383 ssh_runner.go:195] Run: cat /version.json
	I0812 12:22:29.279624 1005383 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-673965
	I0812 12:22:29.279877 1005383 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/
	I0812 12:22:29.279943 1005383 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-673965
	I0812 12:22:29.299668 1005383 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33894 SSHKeyPath:/home/jenkins/minikube-integration/19411-998978/.minikube/machines/addons-673965/id_rsa Username:docker}
	I0812 12:22:29.320293 1005383 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33894 SSHKeyPath:/home/jenkins/minikube-integration/19411-998978/.minikube/machines/addons-673965/id_rsa Username:docker}
	I0812 12:22:29.400705 1005383 ssh_runner.go:195] Run: systemctl --version
	I0812 12:22:29.533091 1005383 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"
	I0812 12:22:29.537481 1005383 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f -name *loopback.conf* -not -name *.mk_disabled -exec sh -c "grep -q loopback {} && ( grep -q name {} || sudo sed -i '/"type": "loopback"/i \ \ \ \ "name": "loopback",' {} ) && sudo sed -i 's|"cniVersion": ".*"|"cniVersion": "1.0.0"|g' {}" ;
	I0812 12:22:29.563041 1005383 cni.go:230] loopback cni configuration patched: "/etc/cni/net.d/*loopback.conf*" found
	I0812 12:22:29.563127 1005383 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%!p(MISSING), " -exec sh -c "sudo mv {} {}.mk_disabled" ;
	I0812 12:22:29.591610 1005383 cni.go:262] disabled [/etc/cni/net.d/87-podman-bridge.conflist, /etc/cni/net.d/100-crio-bridge.conf] bridge cni config(s)
	I0812 12:22:29.591682 1005383 start.go:495] detecting cgroup driver to use...
	I0812 12:22:29.591743 1005383 detect.go:187] detected "cgroupfs" cgroup driver on host os
	I0812 12:22:29.591827 1005383 ssh_runner.go:195] Run: sudo systemctl stop -f crio
	I0812 12:22:29.604634 1005383 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service crio
	I0812 12:22:29.616293 1005383 docker.go:217] disabling cri-docker service (if available) ...
	I0812 12:22:29.616358 1005383 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.socket
	I0812 12:22:29.630567 1005383 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.service
	I0812 12:22:29.644886 1005383 ssh_runner.go:195] Run: sudo systemctl disable cri-docker.socket
	I0812 12:22:29.749844 1005383 ssh_runner.go:195] Run: sudo systemctl mask cri-docker.service
	I0812 12:22:29.853117 1005383 docker.go:233] disabling docker service ...
	I0812 12:22:29.853185 1005383 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket
	I0812 12:22:29.873360 1005383 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service
	I0812 12:22:29.885204 1005383 ssh_runner.go:195] Run: sudo systemctl disable docker.socket
	I0812 12:22:29.967824 1005383 ssh_runner.go:195] Run: sudo systemctl mask docker.service
	I0812 12:22:30.071778 1005383 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker
	I0812 12:22:30.086479 1005383 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %!s(MISSING) "runtime-endpoint: unix:///run/containerd/containerd.sock
	" | sudo tee /etc/crictl.yaml"
	I0812 12:22:30.107562 1005383 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)sandbox_image = .*$|\1sandbox_image = "registry.k8s.io/pause:3.9"|' /etc/containerd/config.toml"
	I0812 12:22:30.121656 1005383 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)restrict_oom_score_adj = .*$|\1restrict_oom_score_adj = false|' /etc/containerd/config.toml"
	I0812 12:22:30.134726 1005383 containerd.go:146] configuring containerd to use "cgroupfs" as cgroup driver...
	I0812 12:22:30.134911 1005383 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)SystemdCgroup = .*$|\1SystemdCgroup = false|g' /etc/containerd/config.toml"
	I0812 12:22:30.147576 1005383 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runtime.v1.linux"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"
	I0812 12:22:30.159479 1005383 ssh_runner.go:195] Run: sh -c "sudo sed -i '/systemd_cgroup/d' /etc/containerd/config.toml"
	I0812 12:22:30.170839 1005383 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runc.v1"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"
	I0812 12:22:30.183621 1005383 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"
	I0812 12:22:30.196927 1005383 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)conf_dir = .*$|\1conf_dir = "/etc/cni/net.d"|g' /etc/containerd/config.toml"
	I0812 12:22:30.208527 1005383 ssh_runner.go:195] Run: sh -c "sudo sed -i '/^ *enable_unprivileged_ports = .*/d' /etc/containerd/config.toml"
	I0812 12:22:30.219985 1005383 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)\[plugins."io.containerd.grpc.v1.cri"\]|&\n\1  enable_unprivileged_ports = true|' /etc/containerd/config.toml"
	I0812 12:22:30.231934 1005383 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
	I0812 12:22:30.241658 1005383 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
	I0812 12:22:30.250314 1005383 ssh_runner.go:195] Run: sudo systemctl daemon-reload
	I0812 12:22:30.335001 1005383 ssh_runner.go:195] Run: sudo systemctl restart containerd
	I0812 12:22:30.463874 1005383 start.go:542] Will wait 60s for socket path /run/containerd/containerd.sock
	I0812 12:22:30.464054 1005383 ssh_runner.go:195] Run: stat /run/containerd/containerd.sock
	I0812 12:22:30.467770 1005383 start.go:563] Will wait 60s for crictl version
	I0812 12:22:30.467896 1005383 ssh_runner.go:195] Run: which crictl
	I0812 12:22:30.471357 1005383 ssh_runner.go:195] Run: sudo /usr/bin/crictl version
	I0812 12:22:30.514329 1005383 start.go:579] Version:  0.1.0
	RuntimeName:  containerd
	RuntimeVersion:  1.7.19
	RuntimeApiVersion:  v1
	I0812 12:22:30.514482 1005383 ssh_runner.go:195] Run: containerd --version
	I0812 12:22:30.537517 1005383 ssh_runner.go:195] Run: containerd --version
	I0812 12:22:30.561983 1005383 out.go:177] * Preparing Kubernetes v1.30.3 on containerd 1.7.19 ...
	I0812 12:22:30.563890 1005383 cli_runner.go:164] Run: docker network inspect addons-673965 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
	I0812 12:22:30.579370 1005383 ssh_runner.go:195] Run: grep 192.168.49.1	host.minikube.internal$ /etc/hosts
	I0812 12:22:30.583048 1005383 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.49.1	host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
	I0812 12:22:30.593973 1005383 kubeadm.go:883] updating cluster {Name:addons-673965 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1723026928-19389@sha256:7715fe0c5dce35b4eb757765cbbe02d40cd8b5effa0639735e42ad89f4f51ef0 Memory:4000 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.30.3 ClusterName:addons-673965 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNa
mes:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.49.2 Port:8443 KubernetesVersion:v1.30.3 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false Cus
tomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} ...
	I0812 12:22:30.594097 1005383 preload.go:131] Checking if preload exists for k8s version v1.30.3 and runtime containerd
	I0812 12:22:30.594170 1005383 ssh_runner.go:195] Run: sudo crictl images --output json
	I0812 12:22:30.632115 1005383 containerd.go:627] all images are preloaded for containerd runtime.
	I0812 12:22:30.632136 1005383 containerd.go:534] Images already preloaded, skipping extraction
	I0812 12:22:30.632199 1005383 ssh_runner.go:195] Run: sudo crictl images --output json
	I0812 12:22:30.668689 1005383 containerd.go:627] all images are preloaded for containerd runtime.
	I0812 12:22:30.668770 1005383 cache_images.go:84] Images are preloaded, skipping loading
	I0812 12:22:30.668794 1005383 kubeadm.go:934] updating node { 192.168.49.2 8443 v1.30.3 containerd true true} ...
	I0812 12:22:30.668938 1005383 kubeadm.go:946] kubelet [Unit]
	Wants=containerd.service
	
	[Service]
	ExecStart=
	ExecStart=/var/lib/minikube/binaries/v1.30.3/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --hostname-override=addons-673965 --kubeconfig=/etc/kubernetes/kubelet.conf --node-ip=192.168.49.2
	
	[Install]
	 config:
	{KubernetesVersion:v1.30.3 ClusterName:addons-673965 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:}
	I0812 12:22:30.669040 1005383 ssh_runner.go:195] Run: sudo crictl info
	I0812 12:22:30.707663 1005383 cni.go:84] Creating CNI manager for ""
	I0812 12:22:30.707691 1005383 cni.go:143] "docker" driver + "containerd" runtime found, recommending kindnet
	I0812 12:22:30.707703 1005383 kubeadm.go:84] Using pod CIDR: 10.244.0.0/16
	I0812 12:22:30.707756 1005383 kubeadm.go:181] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.49.2 APIServerPort:8443 KubernetesVersion:v1.30.3 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:addons-673965 NodeName:addons-673965 DNSDomain:cluster.local CRISocket:/run/containerd/containerd.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.49.2"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.49.2 CgroupDriver:cgroupfs ClientCAFile:/var/lib/minikube/certs/ca.crt StaticPodPath:/etc
/kubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[containerRuntimeEndpoint:unix:///run/containerd/containerd.sock hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:true}
	I0812 12:22:30.707926 1005383 kubeadm.go:187] kubeadm config:
	apiVersion: kubeadm.k8s.io/v1beta3
	kind: InitConfiguration
	localAPIEndpoint:
	  advertiseAddress: 192.168.49.2
	  bindPort: 8443
	bootstrapTokens:
	  - groups:
	      - system:bootstrappers:kubeadm:default-node-token
	    ttl: 24h0m0s
	    usages:
	      - signing
	      - authentication
	nodeRegistration:
	  criSocket: unix:///run/containerd/containerd.sock
	  name: "addons-673965"
	  kubeletExtraArgs:
	    node-ip: 192.168.49.2
	  taints: []
	---
	apiVersion: kubeadm.k8s.io/v1beta3
	kind: ClusterConfiguration
	apiServer:
	  certSANs: ["127.0.0.1", "localhost", "192.168.49.2"]
	  extraArgs:
	    enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"
	controllerManager:
	  extraArgs:
	    allocate-node-cidrs: "true"
	    leader-elect: "false"
	scheduler:
	  extraArgs:
	    leader-elect: "false"
	certificatesDir: /var/lib/minikube/certs
	clusterName: mk
	controlPlaneEndpoint: control-plane.minikube.internal:8443
	etcd:
	  local:
	    dataDir: /var/lib/minikube/etcd
	    extraArgs:
	      proxy-refresh-interval: "70000"
	kubernetesVersion: v1.30.3
	networking:
	  dnsDomain: cluster.local
	  podSubnet: "10.244.0.0/16"
	  serviceSubnet: 10.96.0.0/12
	---
	apiVersion: kubelet.config.k8s.io/v1beta1
	kind: KubeletConfiguration
	authentication:
	  x509:
	    clientCAFile: /var/lib/minikube/certs/ca.crt
	cgroupDriver: cgroupfs
	containerRuntimeEndpoint: unix:///run/containerd/containerd.sock
	hairpinMode: hairpin-veth
	runtimeRequestTimeout: 15m
	clusterDomain: "cluster.local"
	# disable disk resource management by default
	imageGCHighThresholdPercent: 100
	evictionHard:
	  nodefs.available: "0%!"(MISSING)
	  nodefs.inodesFree: "0%!"(MISSING)
	  imagefs.available: "0%!"(MISSING)
	failSwapOn: false
	staticPodPath: /etc/kubernetes/manifests
	---
	apiVersion: kubeproxy.config.k8s.io/v1alpha1
	kind: KubeProxyConfiguration
	clusterCIDR: "10.244.0.0/16"
	metricsBindAddress: 0.0.0.0:10249
	conntrack:
	  maxPerCore: 0
	# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"
	  tcpEstablishedTimeout: 0s
	# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"
	  tcpCloseWaitTimeout: 0s
	
	I0812 12:22:30.708015 1005383 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.30.3
	I0812 12:22:30.717363 1005383 binaries.go:44] Found k8s binaries, skipping transfer
	I0812 12:22:30.717438 1005383 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube
	I0812 12:22:30.726588 1005383 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (317 bytes)
	I0812 12:22:30.745373 1005383 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)
	I0812 12:22:30.764575 1005383 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2167 bytes)
	I0812 12:22:30.782913 1005383 ssh_runner.go:195] Run: grep 192.168.49.2	control-plane.minikube.internal$ /etc/hosts
	I0812 12:22:30.786293 1005383 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.49.2	control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
	I0812 12:22:30.797198 1005383 ssh_runner.go:195] Run: sudo systemctl daemon-reload
	I0812 12:22:30.887940 1005383 ssh_runner.go:195] Run: sudo systemctl start kubelet
	I0812 12:22:30.903702 1005383 certs.go:68] Setting up /home/jenkins/minikube-integration/19411-998978/.minikube/profiles/addons-673965 for IP: 192.168.49.2
	I0812 12:22:30.903726 1005383 certs.go:194] generating shared ca certs ...
	I0812 12:22:30.903744 1005383 certs.go:226] acquiring lock for ca certs: {Name:mk16a6b77f049380624bf1b67dc2a8c038f8d58a Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0812 12:22:30.903876 1005383 certs.go:240] generating "minikubeCA" ca cert: /home/jenkins/minikube-integration/19411-998978/.minikube/ca.key
	I0812 12:22:31.100367 1005383 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19411-998978/.minikube/ca.crt ...
	I0812 12:22:31.100405 1005383 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19411-998978/.minikube/ca.crt: {Name:mk40844f0adcb6ca48ae5cb322aa51fb21bdb026 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0812 12:22:31.100607 1005383 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19411-998978/.minikube/ca.key ...
	I0812 12:22:31.100624 1005383 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19411-998978/.minikube/ca.key: {Name:mk9653c30db0678397dc57152cd9e3a7711ce266 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0812 12:22:31.100724 1005383 certs.go:240] generating "proxyClientCA" ca cert: /home/jenkins/minikube-integration/19411-998978/.minikube/proxy-client-ca.key
	I0812 12:22:31.515859 1005383 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19411-998978/.minikube/proxy-client-ca.crt ...
	I0812 12:22:31.515893 1005383 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19411-998978/.minikube/proxy-client-ca.crt: {Name:mk1bcb68dbbb1a0843a47b4a26e12de8e139569d Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0812 12:22:31.516767 1005383 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19411-998978/.minikube/proxy-client-ca.key ...
	I0812 12:22:31.516784 1005383 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19411-998978/.minikube/proxy-client-ca.key: {Name:mkc96edd460b71e817a027aa124c208f708fd5cb Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0812 12:22:31.516881 1005383 certs.go:256] generating profile certs ...
	I0812 12:22:31.516945 1005383 certs.go:363] generating signed profile cert for "minikube-user": /home/jenkins/minikube-integration/19411-998978/.minikube/profiles/addons-673965/client.key
	I0812 12:22:31.516964 1005383 crypto.go:68] Generating cert /home/jenkins/minikube-integration/19411-998978/.minikube/profiles/addons-673965/client.crt with IP's: []
	I0812 12:22:32.062440 1005383 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19411-998978/.minikube/profiles/addons-673965/client.crt ...
	I0812 12:22:32.062482 1005383 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19411-998978/.minikube/profiles/addons-673965/client.crt: {Name:mk823a3dbe98e038a5aa04cf4b13a17d7f1cdb5b Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0812 12:22:32.063228 1005383 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19411-998978/.minikube/profiles/addons-673965/client.key ...
	I0812 12:22:32.063244 1005383 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19411-998978/.minikube/profiles/addons-673965/client.key: {Name:mkd3c1845756b85a4068b65f18606d935f9fd437 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0812 12:22:32.063337 1005383 certs.go:363] generating signed profile cert for "minikube": /home/jenkins/minikube-integration/19411-998978/.minikube/profiles/addons-673965/apiserver.key.a5f08d08
	I0812 12:22:32.063359 1005383 crypto.go:68] Generating cert /home/jenkins/minikube-integration/19411-998978/.minikube/profiles/addons-673965/apiserver.crt.a5f08d08 with IP's: [10.96.0.1 127.0.0.1 10.0.0.1 192.168.49.2]
	I0812 12:22:32.778435 1005383 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19411-998978/.minikube/profiles/addons-673965/apiserver.crt.a5f08d08 ...
	I0812 12:22:32.778471 1005383 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19411-998978/.minikube/profiles/addons-673965/apiserver.crt.a5f08d08: {Name:mke78dabccf15b678a75f8b9e6d855b03fb010a1 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0812 12:22:32.779220 1005383 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19411-998978/.minikube/profiles/addons-673965/apiserver.key.a5f08d08 ...
	I0812 12:22:32.779238 1005383 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19411-998978/.minikube/profiles/addons-673965/apiserver.key.a5f08d08: {Name:mk859e4620717f990f870ccec88261da253fb9c1 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0812 12:22:32.779323 1005383 certs.go:381] copying /home/jenkins/minikube-integration/19411-998978/.minikube/profiles/addons-673965/apiserver.crt.a5f08d08 -> /home/jenkins/minikube-integration/19411-998978/.minikube/profiles/addons-673965/apiserver.crt
	I0812 12:22:32.779406 1005383 certs.go:385] copying /home/jenkins/minikube-integration/19411-998978/.minikube/profiles/addons-673965/apiserver.key.a5f08d08 -> /home/jenkins/minikube-integration/19411-998978/.minikube/profiles/addons-673965/apiserver.key
	I0812 12:22:32.779454 1005383 certs.go:363] generating signed profile cert for "aggregator": /home/jenkins/minikube-integration/19411-998978/.minikube/profiles/addons-673965/proxy-client.key
	I0812 12:22:32.779471 1005383 crypto.go:68] Generating cert /home/jenkins/minikube-integration/19411-998978/.minikube/profiles/addons-673965/proxy-client.crt with IP's: []
	I0812 12:22:33.035503 1005383 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19411-998978/.minikube/profiles/addons-673965/proxy-client.crt ...
	I0812 12:22:33.035542 1005383 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19411-998978/.minikube/profiles/addons-673965/proxy-client.crt: {Name:mk14abb7c36ad00cde1c52ad99dd8e3b29e69cdd Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0812 12:22:33.035746 1005383 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19411-998978/.minikube/profiles/addons-673965/proxy-client.key ...
	I0812 12:22:33.035762 1005383 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19411-998978/.minikube/profiles/addons-673965/proxy-client.key: {Name:mk2b00228edc589ff816986682aea70d99b03936 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0812 12:22:33.035991 1005383 certs.go:484] found cert: /home/jenkins/minikube-integration/19411-998978/.minikube/certs/ca-key.pem (1675 bytes)
	I0812 12:22:33.036038 1005383 certs.go:484] found cert: /home/jenkins/minikube-integration/19411-998978/.minikube/certs/ca.pem (1082 bytes)
	I0812 12:22:33.036069 1005383 certs.go:484] found cert: /home/jenkins/minikube-integration/19411-998978/.minikube/certs/cert.pem (1123 bytes)
	I0812 12:22:33.036099 1005383 certs.go:484] found cert: /home/jenkins/minikube-integration/19411-998978/.minikube/certs/key.pem (1679 bytes)
	I0812 12:22:33.036815 1005383 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19411-998978/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
	I0812 12:22:33.064116 1005383 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19411-998978/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1675 bytes)
	I0812 12:22:33.094780 1005383 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19411-998978/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
	I0812 12:22:33.125606 1005383 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19411-998978/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1679 bytes)
	I0812 12:22:33.155598 1005383 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19411-998978/.minikube/profiles/addons-673965/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1419 bytes)
	I0812 12:22:33.181634 1005383 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19411-998978/.minikube/profiles/addons-673965/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1675 bytes)
	I0812 12:22:33.205455 1005383 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19411-998978/.minikube/profiles/addons-673965/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
	I0812 12:22:33.230583 1005383 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19411-998978/.minikube/profiles/addons-673965/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1675 bytes)
	I0812 12:22:33.259250 1005383 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19411-998978/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
	I0812 12:22:33.285440 1005383 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)
	I0812 12:22:33.303701 1005383 ssh_runner.go:195] Run: openssl version
	I0812 12:22:33.309004 1005383 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
	I0812 12:22:33.318469 1005383 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
	I0812 12:22:33.322026 1005383 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 Aug 12 12:22 /usr/share/ca-certificates/minikubeCA.pem
	I0812 12:22:33.322093 1005383 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
	I0812 12:22:33.328957 1005383 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
	I0812 12:22:33.338546 1005383 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt
	I0812 12:22:33.342932 1005383 certs.go:399] 'apiserver-kubelet-client' cert doesn't exist, likely first start: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt: Process exited with status 1
	stdout:
	
	stderr:
	stat: cannot statx '/var/lib/minikube/certs/apiserver-kubelet-client.crt': No such file or directory
	I0812 12:22:33.342989 1005383 kubeadm.go:392] StartCluster: {Name:addons-673965 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1723026928-19389@sha256:7715fe0c5dce35b4eb757765cbbe02d40cd8b5effa0639735e42ad89f4f51ef0 Memory:4000 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.30.3 ClusterName:addons-673965 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames
:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.49.2 Port:8443 KubernetesVersion:v1.30.3 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false Custom
QemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I0812 12:22:33.343085 1005383 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:paused Name: Namespaces:[kube-system]}
	I0812 12:22:33.343183 1005383 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"
	I0812 12:22:33.380516 1005383 cri.go:89] found id: ""
	I0812 12:22:33.380604 1005383 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd
	I0812 12:22:33.389318 1005383 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml
	I0812 12:22:33.398130 1005383 kubeadm.go:214] ignoring SystemVerification for kubeadm because of docker driver
	I0812 12:22:33.398225 1005383 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
	I0812 12:22:33.406848 1005383 kubeadm.go:155] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
	stdout:
	
	stderr:
	ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
	ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
	ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
	ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
	I0812 12:22:33.406879 1005383 kubeadm.go:157] found existing configuration files:
	
	I0812 12:22:33.406932 1005383 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf
	I0812 12:22:33.415911 1005383 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/admin.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf: Process exited with status 2
	stdout:
	
	stderr:
	grep: /etc/kubernetes/admin.conf: No such file or directory
	I0812 12:22:33.415995 1005383 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/admin.conf
	I0812 12:22:33.424615 1005383 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf
	I0812 12:22:33.433851 1005383 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/kubelet.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf: Process exited with status 2
	stdout:
	
	stderr:
	grep: /etc/kubernetes/kubelet.conf: No such file or directory
	I0812 12:22:33.433940 1005383 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/kubelet.conf
	I0812 12:22:33.443029 1005383 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf
	I0812 12:22:33.452166 1005383 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/controller-manager.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf: Process exited with status 2
	stdout:
	
	stderr:
	grep: /etc/kubernetes/controller-manager.conf: No such file or directory
	I0812 12:22:33.452236 1005383 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/controller-manager.conf
	I0812 12:22:33.462135 1005383 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf
	I0812 12:22:33.473805 1005383 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/scheduler.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf: Process exited with status 2
	stdout:
	
	stderr:
	grep: /etc/kubernetes/scheduler.conf: No such file or directory
	I0812 12:22:33.473900 1005383 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/scheduler.conf
	I0812 12:22:33.483844 1005383 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.30.3:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml  --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem,SystemVerification,FileContent--proc-sys-net-bridge-bridge-nf-call-iptables"
	I0812 12:22:33.579576 1005383 kubeadm.go:310] 	[WARNING SystemVerification]: failed to parse kernel config: unable to load kernel module: "configs", output: "modprobe: FATAL: Module configs not found in directory /lib/modules/5.15.0-1066-aws\n", err: exit status 1
	I0812 12:22:33.656088 1005383 kubeadm.go:310] 	[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
	I0812 12:22:49.580292 1005383 kubeadm.go:310] [init] Using Kubernetes version: v1.30.3
	I0812 12:22:49.580351 1005383 kubeadm.go:310] [preflight] Running pre-flight checks
	I0812 12:22:49.580436 1005383 kubeadm.go:310] [preflight] The system verification failed. Printing the output from the verification:
	I0812 12:22:49.580493 1005383 kubeadm.go:310] KERNEL_VERSION: 5.15.0-1066-aws
	I0812 12:22:49.580533 1005383 kubeadm.go:310] OS: Linux
	I0812 12:22:49.580580 1005383 kubeadm.go:310] CGROUPS_CPU: enabled
	I0812 12:22:49.580637 1005383 kubeadm.go:310] CGROUPS_CPUACCT: enabled
	I0812 12:22:49.580686 1005383 kubeadm.go:310] CGROUPS_CPUSET: enabled
	I0812 12:22:49.580736 1005383 kubeadm.go:310] CGROUPS_DEVICES: enabled
	I0812 12:22:49.580787 1005383 kubeadm.go:310] CGROUPS_FREEZER: enabled
	I0812 12:22:49.580838 1005383 kubeadm.go:310] CGROUPS_MEMORY: enabled
	I0812 12:22:49.580882 1005383 kubeadm.go:310] CGROUPS_PIDS: enabled
	I0812 12:22:49.580932 1005383 kubeadm.go:310] CGROUPS_HUGETLB: enabled
	I0812 12:22:49.580979 1005383 kubeadm.go:310] CGROUPS_BLKIO: enabled
	I0812 12:22:49.581052 1005383 kubeadm.go:310] [preflight] Pulling images required for setting up a Kubernetes cluster
	I0812 12:22:49.581146 1005383 kubeadm.go:310] [preflight] This might take a minute or two, depending on the speed of your internet connection
	I0812 12:22:49.581250 1005383 kubeadm.go:310] [preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
	I0812 12:22:49.581313 1005383 kubeadm.go:310] [certs] Using certificateDir folder "/var/lib/minikube/certs"
	I0812 12:22:49.583183 1005383 out.go:204]   - Generating certificates and keys ...
	I0812 12:22:49.583290 1005383 kubeadm.go:310] [certs] Using existing ca certificate authority
	I0812 12:22:49.583380 1005383 kubeadm.go:310] [certs] Using existing apiserver certificate and key on disk
	I0812 12:22:49.583464 1005383 kubeadm.go:310] [certs] Generating "apiserver-kubelet-client" certificate and key
	I0812 12:22:49.583531 1005383 kubeadm.go:310] [certs] Generating "front-proxy-ca" certificate and key
	I0812 12:22:49.583594 1005383 kubeadm.go:310] [certs] Generating "front-proxy-client" certificate and key
	I0812 12:22:49.583646 1005383 kubeadm.go:310] [certs] Generating "etcd/ca" certificate and key
	I0812 12:22:49.583702 1005383 kubeadm.go:310] [certs] Generating "etcd/server" certificate and key
	I0812 12:22:49.583818 1005383 kubeadm.go:310] [certs] etcd/server serving cert is signed for DNS names [addons-673965 localhost] and IPs [192.168.49.2 127.0.0.1 ::1]
	I0812 12:22:49.583873 1005383 kubeadm.go:310] [certs] Generating "etcd/peer" certificate and key
	I0812 12:22:49.583988 1005383 kubeadm.go:310] [certs] etcd/peer serving cert is signed for DNS names [addons-673965 localhost] and IPs [192.168.49.2 127.0.0.1 ::1]
	I0812 12:22:49.584054 1005383 kubeadm.go:310] [certs] Generating "etcd/healthcheck-client" certificate and key
	I0812 12:22:49.584121 1005383 kubeadm.go:310] [certs] Generating "apiserver-etcd-client" certificate and key
	I0812 12:22:49.584169 1005383 kubeadm.go:310] [certs] Generating "sa" key and public key
	I0812 12:22:49.584227 1005383 kubeadm.go:310] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"
	I0812 12:22:49.584281 1005383 kubeadm.go:310] [kubeconfig] Writing "admin.conf" kubeconfig file
	I0812 12:22:49.584339 1005383 kubeadm.go:310] [kubeconfig] Writing "super-admin.conf" kubeconfig file
	I0812 12:22:49.584397 1005383 kubeadm.go:310] [kubeconfig] Writing "kubelet.conf" kubeconfig file
	I0812 12:22:49.584463 1005383 kubeadm.go:310] [kubeconfig] Writing "controller-manager.conf" kubeconfig file
	I0812 12:22:49.584521 1005383 kubeadm.go:310] [kubeconfig] Writing "scheduler.conf" kubeconfig file
	I0812 12:22:49.584603 1005383 kubeadm.go:310] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
	I0812 12:22:49.584670 1005383 kubeadm.go:310] [control-plane] Using manifest folder "/etc/kubernetes/manifests"
	I0812 12:22:49.586442 1005383 out.go:204]   - Booting up control plane ...
	I0812 12:22:49.586558 1005383 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-apiserver"
	I0812 12:22:49.586640 1005383 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-controller-manager"
	I0812 12:22:49.586710 1005383 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-scheduler"
	I0812 12:22:49.586856 1005383 kubeadm.go:310] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
	I0812 12:22:49.586947 1005383 kubeadm.go:310] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
	I0812 12:22:49.586986 1005383 kubeadm.go:310] [kubelet-start] Starting the kubelet
	I0812 12:22:49.587111 1005383 kubeadm.go:310] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests"
	I0812 12:22:49.587222 1005383 kubeadm.go:310] [kubelet-check] Waiting for a healthy kubelet. This can take up to 4m0s
	I0812 12:22:49.587348 1005383 kubeadm.go:310] [kubelet-check] The kubelet is healthy after 1.001910291s
	I0812 12:22:49.587461 1005383 kubeadm.go:310] [api-check] Waiting for a healthy API server. This can take up to 4m0s
	I0812 12:22:49.587557 1005383 kubeadm.go:310] [api-check] The API server is healthy after 6.501510521s
	I0812 12:22:49.587692 1005383 kubeadm.go:310] [upload-config] Storing the configuration used in ConfigMap "kubeadm-config" in the "kube-system" Namespace
	I0812 12:22:49.587829 1005383 kubeadm.go:310] [kubelet] Creating a ConfigMap "kubelet-config" in namespace kube-system with the configuration for the kubelets in the cluster
	I0812 12:22:49.587889 1005383 kubeadm.go:310] [upload-certs] Skipping phase. Please see --upload-certs
	I0812 12:22:49.588070 1005383 kubeadm.go:310] [mark-control-plane] Marking the node addons-673965 as control-plane by adding the labels: [node-role.kubernetes.io/control-plane node.kubernetes.io/exclude-from-external-load-balancers]
	I0812 12:22:49.588127 1005383 kubeadm.go:310] [bootstrap-token] Using token: j0b1jx.57kgnvae0ag179ij
	I0812 12:22:49.590856 1005383 out.go:204]   - Configuring RBAC rules ...
	I0812 12:22:49.590989 1005383 kubeadm.go:310] [bootstrap-token] Configuring bootstrap tokens, cluster-info ConfigMap, RBAC Roles
	I0812 12:22:49.591077 1005383 kubeadm.go:310] [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to get nodes
	I0812 12:22:49.591217 1005383 kubeadm.go:310] [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to post CSRs in order for nodes to get long term certificate credentials
	I0812 12:22:49.591584 1005383 kubeadm.go:310] [bootstrap-token] Configured RBAC rules to allow the csrapprover controller automatically approve CSRs from a Node Bootstrap Token
	I0812 12:22:49.591914 1005383 kubeadm.go:310] [bootstrap-token] Configured RBAC rules to allow certificate rotation for all node client certificates in the cluster
	I0812 12:22:49.592106 1005383 kubeadm.go:310] [bootstrap-token] Creating the "cluster-info" ConfigMap in the "kube-public" namespace
	I0812 12:22:49.592381 1005383 kubeadm.go:310] [kubelet-finalize] Updating "/etc/kubernetes/kubelet.conf" to point to a rotatable kubelet client certificate and key
	I0812 12:22:49.592674 1005383 kubeadm.go:310] [addons] Applied essential addon: CoreDNS
	I0812 12:22:49.592759 1005383 kubeadm.go:310] [addons] Applied essential addon: kube-proxy
	I0812 12:22:49.592767 1005383 kubeadm.go:310] 
	I0812 12:22:49.592871 1005383 kubeadm.go:310] Your Kubernetes control-plane has initialized successfully!
	I0812 12:22:49.592878 1005383 kubeadm.go:310] 
	I0812 12:22:49.593014 1005383 kubeadm.go:310] To start using your cluster, you need to run the following as a regular user:
	I0812 12:22:49.593019 1005383 kubeadm.go:310] 
	I0812 12:22:49.593064 1005383 kubeadm.go:310]   mkdir -p $HOME/.kube
	I0812 12:22:49.593412 1005383 kubeadm.go:310]   sudo cp -i /etc/kubernetes/admin.conf $HOME/.kube/config
	I0812 12:22:49.593541 1005383 kubeadm.go:310]   sudo chown $(id -u):$(id -g) $HOME/.kube/config
	I0812 12:22:49.593567 1005383 kubeadm.go:310] 
	I0812 12:22:49.593690 1005383 kubeadm.go:310] Alternatively, if you are the root user, you can run:
	I0812 12:22:49.593719 1005383 kubeadm.go:310] 
	I0812 12:22:49.593832 1005383 kubeadm.go:310]   export KUBECONFIG=/etc/kubernetes/admin.conf
	I0812 12:22:49.593859 1005383 kubeadm.go:310] 
	I0812 12:22:49.593982 1005383 kubeadm.go:310] You should now deploy a pod network to the cluster.
	I0812 12:22:49.594426 1005383 kubeadm.go:310] Run "kubectl apply -f [podnetwork].yaml" with one of the options listed at:
	I0812 12:22:49.594598 1005383 kubeadm.go:310]   https://kubernetes.io/docs/concepts/cluster-administration/addons/
	I0812 12:22:49.594626 1005383 kubeadm.go:310] 
	I0812 12:22:49.594805 1005383 kubeadm.go:310] You can now join any number of control-plane nodes by copying certificate authorities
	I0812 12:22:49.594972 1005383 kubeadm.go:310] and service account keys on each node and then running the following as root:
	I0812 12:22:49.595002 1005383 kubeadm.go:310] 
	I0812 12:22:49.595182 1005383 kubeadm.go:310]   kubeadm join control-plane.minikube.internal:8443 --token j0b1jx.57kgnvae0ag179ij \
	I0812 12:22:49.595840 1005383 kubeadm.go:310] 	--discovery-token-ca-cert-hash sha256:654b2e995724981a8f91895484ba394ad646bb9c47455572117a74510adf21af \
	I0812 12:22:49.595927 1005383 kubeadm.go:310] 	--control-plane 
	I0812 12:22:49.595948 1005383 kubeadm.go:310] 
	I0812 12:22:49.596130 1005383 kubeadm.go:310] Then you can join any number of worker nodes by running the following on each as root:
	I0812 12:22:49.596160 1005383 kubeadm.go:310] 
	I0812 12:22:49.596334 1005383 kubeadm.go:310] kubeadm join control-plane.minikube.internal:8443 --token j0b1jx.57kgnvae0ag179ij \
	I0812 12:22:49.596563 1005383 kubeadm.go:310] 	--discovery-token-ca-cert-hash sha256:654b2e995724981a8f91895484ba394ad646bb9c47455572117a74510adf21af 
	I0812 12:22:49.596591 1005383 cni.go:84] Creating CNI manager for ""
	I0812 12:22:49.596616 1005383 cni.go:143] "docker" driver + "containerd" runtime found, recommending kindnet
	I0812 12:22:49.598779 1005383 out.go:177] * Configuring CNI (Container Networking Interface) ...
	I0812 12:22:49.600390 1005383 ssh_runner.go:195] Run: stat /opt/cni/bin/portmap
	I0812 12:22:49.604622 1005383 cni.go:182] applying CNI manifest using /var/lib/minikube/binaries/v1.30.3/kubectl ...
	I0812 12:22:49.604642 1005383 ssh_runner.go:362] scp memory --> /var/tmp/minikube/cni.yaml (2438 bytes)
	I0812 12:22:49.624197 1005383 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.3/kubectl apply --kubeconfig=/var/lib/minikube/kubeconfig -f /var/tmp/minikube/cni.yaml
	I0812 12:22:49.903308 1005383 ssh_runner.go:195] Run: /bin/bash -c "cat /proc/$(pgrep kube-apiserver)/oom_adj"
	I0812 12:22:49.903414 1005383 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.3/kubectl create clusterrolebinding minikube-rbac --clusterrole=cluster-admin --serviceaccount=kube-system:default --kubeconfig=/var/lib/minikube/kubeconfig
	I0812 12:22:49.903434 1005383 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.3/kubectl --kubeconfig=/var/lib/minikube/kubeconfig label --overwrite nodes addons-673965 minikube.k8s.io/updated_at=2024_08_12T12_22_49_0700 minikube.k8s.io/version=v1.33.1 minikube.k8s.io/commit=799e8a7dafc4266c6fcf08e799ac850effb94bc5 minikube.k8s.io/name=addons-673965 minikube.k8s.io/primary=true
	I0812 12:22:49.912311 1005383 ops.go:34] apiserver oom_adj: -16
	I0812 12:22:50.054829 1005383 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0812 12:22:50.554899 1005383 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0812 12:22:51.055565 1005383 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0812 12:22:51.555591 1005383 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0812 12:22:52.055042 1005383 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0812 12:22:52.555112 1005383 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0812 12:22:53.055782 1005383 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0812 12:22:53.555582 1005383 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0812 12:22:54.055030 1005383 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0812 12:22:54.555678 1005383 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0812 12:22:55.055865 1005383 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0812 12:22:55.555519 1005383 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0812 12:22:56.055193 1005383 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0812 12:22:56.555995 1005383 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0812 12:22:57.055503 1005383 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0812 12:22:57.555286 1005383 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0812 12:22:58.055599 1005383 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0812 12:22:58.554963 1005383 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0812 12:22:59.055709 1005383 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0812 12:22:59.555490 1005383 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0812 12:23:00.063583 1005383 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0812 12:23:00.554984 1005383 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0812 12:23:01.055735 1005383 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0812 12:23:01.555916 1005383 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0812 12:23:02.055255 1005383 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0812 12:23:02.555046 1005383 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0812 12:23:03.054887 1005383 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0812 12:23:03.555623 1005383 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0812 12:23:03.659181 1005383 kubeadm.go:1113] duration metric: took 13.755832337s to wait for elevateKubeSystemPrivileges
	I0812 12:23:03.659222 1005383 kubeadm.go:394] duration metric: took 30.31623628s to StartCluster
	I0812 12:23:03.659240 1005383 settings.go:142] acquiring lock: {Name:mk658f1fe8b144393e435c8af021f2e0f3b1e6c6 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0812 12:23:03.659372 1005383 settings.go:150] Updating kubeconfig:  /home/jenkins/minikube-integration/19411-998978/kubeconfig
	I0812 12:23:03.659765 1005383 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19411-998978/kubeconfig: {Name:mk5cff3a2472180f06252810f10ea42538787fa2 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0812 12:23:03.659971 1005383 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.30.3/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml"
	I0812 12:23:03.659999 1005383 start.go:235] Will wait 6m0s for node &{Name: IP:192.168.49.2 Port:8443 KubernetesVersion:v1.30.3 ContainerRuntime:containerd ControlPlane:true Worker:true}
	I0812 12:23:03.660244 1005383 config.go:182] Loaded profile config "addons-673965": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.30.3
	I0812 12:23:03.660274 1005383 addons.go:507] enable addons start: toEnable=map[ambassador:false auto-pause:false cloud-spanner:true csi-hostpath-driver:true dashboard:false default-storageclass:true efk:false freshpod:false gcp-auth:true gvisor:false headlamp:false helm-tiller:false inaccel:false ingress:true ingress-dns:true inspektor-gadget:true istio:false istio-provisioner:false kong:false kubeflow:false kubevirt:false logviewer:false metallb:false metrics-server:true nvidia-device-plugin:true nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:true registry-aliases:false registry-creds:false storage-provisioner:true storage-provisioner-gluster:false storage-provisioner-rancher:true volcano:true volumesnapshots:true yakd:true]
	I0812 12:23:03.660364 1005383 addons.go:69] Setting yakd=true in profile "addons-673965"
	I0812 12:23:03.660390 1005383 addons.go:234] Setting addon yakd=true in "addons-673965"
	I0812 12:23:03.660418 1005383 host.go:66] Checking if "addons-673965" exists ...
	I0812 12:23:03.660852 1005383 cli_runner.go:164] Run: docker container inspect addons-673965 --format={{.State.Status}}
	I0812 12:23:03.661455 1005383 addons.go:69] Setting metrics-server=true in profile "addons-673965"
	I0812 12:23:03.661481 1005383 addons.go:234] Setting addon metrics-server=true in "addons-673965"
	I0812 12:23:03.661505 1005383 host.go:66] Checking if "addons-673965" exists ...
	I0812 12:23:03.661889 1005383 cli_runner.go:164] Run: docker container inspect addons-673965 --format={{.State.Status}}
	I0812 12:23:03.664505 1005383 addons.go:69] Setting nvidia-device-plugin=true in profile "addons-673965"
	I0812 12:23:03.664552 1005383 addons.go:234] Setting addon nvidia-device-plugin=true in "addons-673965"
	I0812 12:23:03.664585 1005383 host.go:66] Checking if "addons-673965" exists ...
	I0812 12:23:03.665011 1005383 cli_runner.go:164] Run: docker container inspect addons-673965 --format={{.State.Status}}
	I0812 12:23:03.666698 1005383 addons.go:69] Setting cloud-spanner=true in profile "addons-673965"
	I0812 12:23:03.666762 1005383 addons.go:69] Setting registry=true in profile "addons-673965"
	I0812 12:23:03.666786 1005383 addons.go:234] Setting addon registry=true in "addons-673965"
	I0812 12:23:03.666845 1005383 host.go:66] Checking if "addons-673965" exists ...
	I0812 12:23:03.667269 1005383 cli_runner.go:164] Run: docker container inspect addons-673965 --format={{.State.Status}}
	I0812 12:23:03.666739 1005383 addons.go:234] Setting addon cloud-spanner=true in "addons-673965"
	I0812 12:23:03.667534 1005383 host.go:66] Checking if "addons-673965" exists ...
	I0812 12:23:03.667666 1005383 addons.go:69] Setting csi-hostpath-driver=true in profile "addons-673965"
	I0812 12:23:03.667717 1005383 addons.go:234] Setting addon csi-hostpath-driver=true in "addons-673965"
	I0812 12:23:03.667746 1005383 host.go:66] Checking if "addons-673965" exists ...
	I0812 12:23:03.668126 1005383 cli_runner.go:164] Run: docker container inspect addons-673965 --format={{.State.Status}}
	I0812 12:23:03.669507 1005383 addons.go:69] Setting storage-provisioner=true in profile "addons-673965"
	I0812 12:23:03.670276 1005383 addons.go:234] Setting addon storage-provisioner=true in "addons-673965"
	I0812 12:23:03.670357 1005383 host.go:66] Checking if "addons-673965" exists ...
	I0812 12:23:03.670918 1005383 cli_runner.go:164] Run: docker container inspect addons-673965 --format={{.State.Status}}
	I0812 12:23:03.671881 1005383 addons.go:69] Setting default-storageclass=true in profile "addons-673965"
	I0812 12:23:03.673450 1005383 addons_storage_classes.go:33] enableOrDisableStorageClasses default-storageclass=true on "addons-673965"
	I0812 12:23:03.673722 1005383 cli_runner.go:164] Run: docker container inspect addons-673965 --format={{.State.Status}}
	I0812 12:23:03.672190 1005383 addons.go:69] Setting storage-provisioner-rancher=true in profile "addons-673965"
	I0812 12:23:03.689799 1005383 addons_storage_classes.go:33] enableOrDisableStorageClasses storage-provisioner-rancher=true on "addons-673965"
	I0812 12:23:03.672202 1005383 addons.go:69] Setting volcano=true in profile "addons-673965"
	I0812 12:23:03.695703 1005383 addons.go:234] Setting addon volcano=true in "addons-673965"
	I0812 12:23:03.695778 1005383 host.go:66] Checking if "addons-673965" exists ...
	I0812 12:23:03.672214 1005383 addons.go:69] Setting volumesnapshots=true in profile "addons-673965"
	I0812 12:23:03.696151 1005383 addons.go:234] Setting addon volumesnapshots=true in "addons-673965"
	I0812 12:23:03.696208 1005383 host.go:66] Checking if "addons-673965" exists ...
	I0812 12:23:03.696876 1005383 cli_runner.go:164] Run: docker container inspect addons-673965 --format={{.State.Status}}
	I0812 12:23:03.697168 1005383 cli_runner.go:164] Run: docker container inspect addons-673965 --format={{.State.Status}}
	I0812 12:23:03.722888 1005383 cli_runner.go:164] Run: docker container inspect addons-673965 --format={{.State.Status}}
	I0812 12:23:03.672968 1005383 addons.go:69] Setting gcp-auth=true in profile "addons-673965"
	I0812 12:23:03.727519 1005383 mustload.go:65] Loading cluster: addons-673965
	I0812 12:23:03.727718 1005383 config.go:182] Loaded profile config "addons-673965": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.30.3
	I0812 12:23:03.727976 1005383 cli_runner.go:164] Run: docker container inspect addons-673965 --format={{.State.Status}}
	I0812 12:23:03.672979 1005383 addons.go:69] Setting ingress=true in profile "addons-673965"
	I0812 12:23:03.754473 1005383 addons.go:234] Setting addon ingress=true in "addons-673965"
	I0812 12:23:03.754526 1005383 host.go:66] Checking if "addons-673965" exists ...
	I0812 12:23:03.754990 1005383 cli_runner.go:164] Run: docker container inspect addons-673965 --format={{.State.Status}}
	I0812 12:23:03.771256 1005383 out.go:177]   - Using image registry.k8s.io/metrics-server/metrics-server:v0.7.1
	I0812 12:23:03.771391 1005383 out.go:177]   - Using image docker.io/marcnuri/yakd:0.0.5
	I0812 12:23:03.776332 1005383 addons.go:431] installing /etc/kubernetes/addons/metrics-apiservice.yaml
	I0812 12:23:03.776358 1005383 ssh_runner.go:362] scp metrics-server/metrics-apiservice.yaml --> /etc/kubernetes/addons/metrics-apiservice.yaml (424 bytes)
	I0812 12:23:03.776440 1005383 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-673965
	I0812 12:23:03.672984 1005383 addons.go:69] Setting ingress-dns=true in profile "addons-673965"
	I0812 12:23:03.778825 1005383 addons.go:234] Setting addon ingress-dns=true in "addons-673965"
	I0812 12:23:03.672988 1005383 addons.go:69] Setting inspektor-gadget=true in profile "addons-673965"
	I0812 12:23:03.778881 1005383 addons.go:234] Setting addon inspektor-gadget=true in "addons-673965"
	I0812 12:23:03.778914 1005383 host.go:66] Checking if "addons-673965" exists ...
	I0812 12:23:03.779342 1005383 cli_runner.go:164] Run: docker container inspect addons-673965 --format={{.State.Status}}
	I0812 12:23:03.689770 1005383 cli_runner.go:164] Run: docker container inspect addons-673965 --format={{.State.Status}}
	I0812 12:23:03.672367 1005383 out.go:177] * Verifying Kubernetes components...
	I0812 12:23:03.795996 1005383 ssh_runner.go:195] Run: sudo systemctl daemon-reload
	I0812 12:23:03.796209 1005383 addons.go:431] installing /etc/kubernetes/addons/yakd-ns.yaml
	I0812 12:23:03.796224 1005383 ssh_runner.go:362] scp yakd/yakd-ns.yaml --> /etc/kubernetes/addons/yakd-ns.yaml (171 bytes)
	I0812 12:23:03.796273 1005383 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-673965
	I0812 12:23:03.796994 1005383 host.go:66] Checking if "addons-673965" exists ...
	I0812 12:23:03.797488 1005383 cli_runner.go:164] Run: docker container inspect addons-673965 --format={{.State.Status}}
	I0812 12:23:03.797687 1005383 out.go:177]   - Using image nvcr.io/nvidia/k8s-device-plugin:v0.16.1
	I0812 12:23:03.796273 1005383 out.go:177]   - Using image gcr.io/k8s-minikube/storage-provisioner:v5
	I0812 12:23:03.808140 1005383 addons.go:431] installing /etc/kubernetes/addons/nvidia-device-plugin.yaml
	I0812 12:23:03.808196 1005383 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/nvidia-device-plugin.yaml (1966 bytes)
	I0812 12:23:03.812869 1005383 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-673965
	I0812 12:23:03.811702 1005383 addons.go:431] installing /etc/kubernetes/addons/storage-provisioner.yaml
	I0812 12:23:03.826652 1005383 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storage-provisioner.yaml (2676 bytes)
	I0812 12:23:03.826734 1005383 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-673965
	I0812 12:23:03.852886 1005383 out.go:177]   - Using image registry.k8s.io/sig-storage/livenessprobe:v2.8.0
	I0812 12:23:03.857373 1005383 out.go:177]   - Using image registry.k8s.io/sig-storage/csi-resizer:v1.6.0
	I0812 12:23:03.857711 1005383 out.go:177]   - Using image docker.io/registry:2.8.3
	I0812 12:23:03.859429 1005383 out.go:177]   - Using image gcr.io/k8s-minikube/kube-registry-proxy:0.0.6
	I0812 12:23:03.861208 1005383 out.go:177]   - Using image registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0
	I0812 12:23:03.861405 1005383 addons.go:431] installing /etc/kubernetes/addons/registry-rc.yaml
	I0812 12:23:03.861416 1005383 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/registry-rc.yaml (860 bytes)
	I0812 12:23:03.861482 1005383 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-673965
	I0812 12:23:03.864859 1005383 out.go:177]   - Using image registry.k8s.io/sig-storage/csi-provisioner:v3.3.0
	I0812 12:23:03.866610 1005383 out.go:177]   - Using image registry.k8s.io/sig-storage/csi-attacher:v4.0.0
	I0812 12:23:03.870754 1005383 out.go:177]   - Using image registry.k8s.io/sig-storage/csi-external-health-monitor-controller:v0.7.0
	I0812 12:23:03.872676 1005383 out.go:177]   - Using image registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.6.0
	I0812 12:23:03.875538 1005383 out.go:177]   - Using image registry.k8s.io/sig-storage/hostpathplugin:v1.9.0
	I0812 12:23:03.877117 1005383 addons.go:431] installing /etc/kubernetes/addons/rbac-external-attacher.yaml
	I0812 12:23:03.877141 1005383 ssh_runner.go:362] scp csi-hostpath-driver/rbac/rbac-external-attacher.yaml --> /etc/kubernetes/addons/rbac-external-attacher.yaml (3073 bytes)
	I0812 12:23:03.877211 1005383 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-673965
	I0812 12:23:03.929186 1005383 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.30.3/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml | sed -e '/^        forward . \/etc\/resolv.conf.*/i \        hosts {\n           192.168.49.1 host.minikube.internal\n           fallthrough\n        }' -e '/^        errors *$/i \        log' | sudo /var/lib/minikube/binaries/v1.30.3/kubectl --kubeconfig=/var/lib/minikube/kubeconfig replace -f -"
	I0812 12:23:03.935115 1005383 addons.go:234] Setting addon default-storageclass=true in "addons-673965"
	I0812 12:23:03.935156 1005383 host.go:66] Checking if "addons-673965" exists ...
	I0812 12:23:03.935599 1005383 cli_runner.go:164] Run: docker container inspect addons-673965 --format={{.State.Status}}
	I0812 12:23:03.958834 1005383 out.go:177]   - Using image gcr.io/k8s-minikube/minikube-ingress-dns:0.0.3
	I0812 12:23:03.960642 1005383 addons.go:431] installing /etc/kubernetes/addons/ingress-dns-pod.yaml
	I0812 12:23:03.960673 1005383 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/ingress-dns-pod.yaml (2442 bytes)
	I0812 12:23:03.960749 1005383 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-673965
	I0812 12:23:03.985491 1005383 out.go:177]   - Using image docker.io/volcanosh/vc-webhook-manager:v1.9.0
	I0812 12:23:03.989355 1005383 out.go:177]   - Using image docker.io/volcanosh/vc-controller-manager:v1.9.0
	I0812 12:23:03.993462 1005383 out.go:177]   - Using image docker.io/volcanosh/vc-scheduler:v1.9.0
	I0812 12:23:03.995976 1005383 out.go:177]   - Using image registry.k8s.io/sig-storage/snapshot-controller:v6.1.0
	I0812 12:23:03.997512 1005383 addons.go:431] installing /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml
	I0812 12:23:03.997536 1005383 ssh_runner.go:362] scp volumesnapshots/csi-hostpath-snapshotclass.yaml --> /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml (934 bytes)
	I0812 12:23:03.997650 1005383 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-673965
	I0812 12:23:04.001465 1005383 addons.go:431] installing /etc/kubernetes/addons/volcano-deployment.yaml
	I0812 12:23:04.001500 1005383 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/volcano-deployment.yaml (434001 bytes)
	I0812 12:23:04.001584 1005383 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-673965
	I0812 12:23:04.041971 1005383 addons.go:234] Setting addon storage-provisioner-rancher=true in "addons-673965"
	I0812 12:23:04.042015 1005383 host.go:66] Checking if "addons-673965" exists ...
	I0812 12:23:04.042421 1005383 cli_runner.go:164] Run: docker container inspect addons-673965 --format={{.State.Status}}
	I0812 12:23:04.068166 1005383 out.go:177]   - Using image registry.k8s.io/ingress-nginx/controller:v1.11.1
	I0812 12:23:04.074713 1005383 out.go:177]   - Using image registry.k8s.io/ingress-nginx/kube-webhook-certgen:v1.4.1
	I0812 12:23:04.076995 1005383 out.go:177]   - Using image ghcr.io/inspektor-gadget/inspektor-gadget:v0.31.0
	I0812 12:23:04.080977 1005383 out.go:177]   - Using image registry.k8s.io/ingress-nginx/kube-webhook-certgen:v1.4.1
	I0812 12:23:04.081127 1005383 addons.go:431] installing /etc/kubernetes/addons/ig-namespace.yaml
	I0812 12:23:04.081140 1005383 ssh_runner.go:362] scp inspektor-gadget/ig-namespace.yaml --> /etc/kubernetes/addons/ig-namespace.yaml (55 bytes)
	I0812 12:23:04.081308 1005383 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-673965
	I0812 12:23:04.090551 1005383 addons.go:431] installing /etc/kubernetes/addons/ingress-deploy.yaml
	I0812 12:23:04.090583 1005383 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/ingress-deploy.yaml (16078 bytes)
	I0812 12:23:04.090647 1005383 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-673965
	I0812 12:23:04.115483 1005383 host.go:66] Checking if "addons-673965" exists ...
	I0812 12:23:04.115791 1005383 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33894 SSHKeyPath:/home/jenkins/minikube-integration/19411-998978/.minikube/machines/addons-673965/id_rsa Username:docker}
	I0812 12:23:04.117345 1005383 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33894 SSHKeyPath:/home/jenkins/minikube-integration/19411-998978/.minikube/machines/addons-673965/id_rsa Username:docker}
	I0812 12:23:04.119575 1005383 out.go:177]   - Using image gcr.io/cloud-spanner-emulator/emulator:1.5.22
	I0812 12:23:04.121393 1005383 addons.go:431] installing /etc/kubernetes/addons/deployment.yaml
	I0812 12:23:04.121414 1005383 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/deployment.yaml (1004 bytes)
	I0812 12:23:04.121480 1005383 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-673965
	I0812 12:23:04.147890 1005383 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33894 SSHKeyPath:/home/jenkins/minikube-integration/19411-998978/.minikube/machines/addons-673965/id_rsa Username:docker}
	I0812 12:23:04.183245 1005383 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33894 SSHKeyPath:/home/jenkins/minikube-integration/19411-998978/.minikube/machines/addons-673965/id_rsa Username:docker}
	I0812 12:23:04.199744 1005383 addons.go:431] installing /etc/kubernetes/addons/storageclass.yaml
	I0812 12:23:04.199819 1005383 ssh_runner.go:362] scp storageclass/storageclass.yaml --> /etc/kubernetes/addons/storageclass.yaml (271 bytes)
	I0812 12:23:04.199916 1005383 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-673965
	I0812 12:23:04.205350 1005383 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33894 SSHKeyPath:/home/jenkins/minikube-integration/19411-998978/.minikube/machines/addons-673965/id_rsa Username:docker}
	I0812 12:23:04.205852 1005383 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33894 SSHKeyPath:/home/jenkins/minikube-integration/19411-998978/.minikube/machines/addons-673965/id_rsa Username:docker}
	I0812 12:23:04.244951 1005383 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33894 SSHKeyPath:/home/jenkins/minikube-integration/19411-998978/.minikube/machines/addons-673965/id_rsa Username:docker}
	I0812 12:23:04.268037 1005383 ssh_runner.go:195] Run: sudo systemctl start kubelet
	I0812 12:23:04.278250 1005383 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33894 SSHKeyPath:/home/jenkins/minikube-integration/19411-998978/.minikube/machines/addons-673965/id_rsa Username:docker}
	I0812 12:23:04.283299 1005383 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33894 SSHKeyPath:/home/jenkins/minikube-integration/19411-998978/.minikube/machines/addons-673965/id_rsa Username:docker}
	I0812 12:23:04.291765 1005383 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33894 SSHKeyPath:/home/jenkins/minikube-integration/19411-998978/.minikube/machines/addons-673965/id_rsa Username:docker}
	I0812 12:23:04.298115 1005383 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33894 SSHKeyPath:/home/jenkins/minikube-integration/19411-998978/.minikube/machines/addons-673965/id_rsa Username:docker}
	I0812 12:23:04.318395 1005383 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33894 SSHKeyPath:/home/jenkins/minikube-integration/19411-998978/.minikube/machines/addons-673965/id_rsa Username:docker}
	W0812 12:23:04.320114 1005383 sshutil.go:64] dial failure (will retry): ssh: handshake failed: EOF
	I0812 12:23:04.320139 1005383 retry.go:31] will retry after 304.503862ms: ssh: handshake failed: EOF
	I0812 12:23:04.321716 1005383 out.go:177]   - Using image docker.io/rancher/local-path-provisioner:v0.0.22
	I0812 12:23:04.323378 1005383 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33894 SSHKeyPath:/home/jenkins/minikube-integration/19411-998978/.minikube/machines/addons-673965/id_rsa Username:docker}
	I0812 12:23:04.326397 1005383 out.go:177]   - Using image docker.io/busybox:stable
	I0812 12:23:04.328406 1005383 addons.go:431] installing /etc/kubernetes/addons/storage-provisioner-rancher.yaml
	I0812 12:23:04.328432 1005383 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storage-provisioner-rancher.yaml (3113 bytes)
	I0812 12:23:04.328495 1005383 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-673965
	I0812 12:23:04.351052 1005383 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33894 SSHKeyPath:/home/jenkins/minikube-integration/19411-998978/.minikube/machines/addons-673965/id_rsa Username:docker}
	I0812 12:23:04.704407 1005383 addons.go:431] installing /etc/kubernetes/addons/ig-serviceaccount.yaml
	I0812 12:23:04.704498 1005383 ssh_runner.go:362] scp inspektor-gadget/ig-serviceaccount.yaml --> /etc/kubernetes/addons/ig-serviceaccount.yaml (80 bytes)
	I0812 12:23:04.708421 1005383 addons.go:431] installing /etc/kubernetes/addons/yakd-sa.yaml
	I0812 12:23:04.708495 1005383 ssh_runner.go:362] scp yakd/yakd-sa.yaml --> /etc/kubernetes/addons/yakd-sa.yaml (247 bytes)
	I0812 12:23:04.835145 1005383 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.3/kubectl apply -f /etc/kubernetes/addons/ingress-dns-pod.yaml
	I0812 12:23:04.870954 1005383 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.3/kubectl apply -f /etc/kubernetes/addons/deployment.yaml
	I0812 12:23:04.896558 1005383 addons.go:431] installing /etc/kubernetes/addons/ig-role.yaml
	I0812 12:23:04.896633 1005383 ssh_runner.go:362] scp inspektor-gadget/ig-role.yaml --> /etc/kubernetes/addons/ig-role.yaml (210 bytes)
	I0812 12:23:04.931221 1005383 addons.go:431] installing /etc/kubernetes/addons/rbac-hostpath.yaml
	I0812 12:23:04.931251 1005383 ssh_runner.go:362] scp csi-hostpath-driver/rbac/rbac-hostpath.yaml --> /etc/kubernetes/addons/rbac-hostpath.yaml (4266 bytes)
	I0812 12:23:04.935887 1005383 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.3/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml
	I0812 12:23:04.959784 1005383 addons.go:431] installing /etc/kubernetes/addons/metrics-server-deployment.yaml
	I0812 12:23:04.959805 1005383 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-server-deployment.yaml (1907 bytes)
	I0812 12:23:04.966748 1005383 addons.go:431] installing /etc/kubernetes/addons/yakd-crb.yaml
	I0812 12:23:04.966768 1005383 ssh_runner.go:362] scp yakd/yakd-crb.yaml --> /etc/kubernetes/addons/yakd-crb.yaml (422 bytes)
	I0812 12:23:05.100025 1005383 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.3/kubectl apply -f /etc/kubernetes/addons/nvidia-device-plugin.yaml
	I0812 12:23:05.118051 1005383 addons.go:431] installing /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml
	I0812 12:23:05.118119 1005383 ssh_runner.go:362] scp volumesnapshots/snapshot.storage.k8s.io_volumesnapshotclasses.yaml --> /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml (6471 bytes)
	I0812 12:23:05.185035 1005383 addons.go:431] installing /etc/kubernetes/addons/ig-rolebinding.yaml
	I0812 12:23:05.185101 1005383 ssh_runner.go:362] scp inspektor-gadget/ig-rolebinding.yaml --> /etc/kubernetes/addons/ig-rolebinding.yaml (244 bytes)
	I0812 12:23:05.196853 1005383 addons.go:431] installing /etc/kubernetes/addons/registry-svc.yaml
	I0812 12:23:05.196931 1005383 ssh_runner.go:362] scp registry/registry-svc.yaml --> /etc/kubernetes/addons/registry-svc.yaml (398 bytes)
	I0812 12:23:05.242916 1005383 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.3/kubectl apply -f /etc/kubernetes/addons/ingress-deploy.yaml
	I0812 12:23:05.257046 1005383 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.3/kubectl apply -f /etc/kubernetes/addons/storage-provisioner-rancher.yaml
	I0812 12:23:05.263872 1005383 addons.go:431] installing /etc/kubernetes/addons/metrics-server-rbac.yaml
	I0812 12:23:05.264195 1005383 ssh_runner.go:362] scp metrics-server/metrics-server-rbac.yaml --> /etc/kubernetes/addons/metrics-server-rbac.yaml (2175 bytes)
	I0812 12:23:05.327986 1005383 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.3/kubectl apply -f /etc/kubernetes/addons/volcano-deployment.yaml
	I0812 12:23:05.363311 1005383 addons.go:431] installing /etc/kubernetes/addons/rbac-external-health-monitor-controller.yaml
	I0812 12:23:05.363423 1005383 ssh_runner.go:362] scp csi-hostpath-driver/rbac/rbac-external-health-monitor-controller.yaml --> /etc/kubernetes/addons/rbac-external-health-monitor-controller.yaml (3038 bytes)
	I0812 12:23:05.374685 1005383 addons.go:431] installing /etc/kubernetes/addons/yakd-svc.yaml
	I0812 12:23:05.374783 1005383 ssh_runner.go:362] scp yakd/yakd-svc.yaml --> /etc/kubernetes/addons/yakd-svc.yaml (412 bytes)
	I0812 12:23:05.422471 1005383 addons.go:431] installing /etc/kubernetes/addons/registry-proxy.yaml
	I0812 12:23:05.422497 1005383 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/registry-proxy.yaml (947 bytes)
	I0812 12:23:05.434455 1005383 addons.go:431] installing /etc/kubernetes/addons/metrics-server-service.yaml
	I0812 12:23:05.434491 1005383 ssh_runner.go:362] scp metrics-server/metrics-server-service.yaml --> /etc/kubernetes/addons/metrics-server-service.yaml (446 bytes)
	I0812 12:23:05.440472 1005383 addons.go:431] installing /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml
	I0812 12:23:05.440502 1005383 ssh_runner.go:362] scp volumesnapshots/snapshot.storage.k8s.io_volumesnapshotcontents.yaml --> /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml (23126 bytes)
	I0812 12:23:05.625518 1005383 addons.go:431] installing /etc/kubernetes/addons/ig-clusterrole.yaml
	I0812 12:23:05.625545 1005383 ssh_runner.go:362] scp inspektor-gadget/ig-clusterrole.yaml --> /etc/kubernetes/addons/ig-clusterrole.yaml (1485 bytes)
	I0812 12:23:05.625615 1005383 addons.go:431] installing /etc/kubernetes/addons/rbac-external-provisioner.yaml
	I0812 12:23:05.625629 1005383 ssh_runner.go:362] scp csi-hostpath-driver/rbac/rbac-external-provisioner.yaml --> /etc/kubernetes/addons/rbac-external-provisioner.yaml (4442 bytes)
	I0812 12:23:05.706816 1005383 addons.go:431] installing /etc/kubernetes/addons/yakd-dp.yaml
	I0812 12:23:05.706840 1005383 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/yakd-dp.yaml (2017 bytes)
	I0812 12:23:05.712135 1005383 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.3/kubectl apply -f /etc/kubernetes/addons/registry-rc.yaml -f /etc/kubernetes/addons/registry-svc.yaml -f /etc/kubernetes/addons/registry-proxy.yaml
	I0812 12:23:05.831715 1005383 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.3/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
	I0812 12:23:05.849665 1005383 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.3/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml
	I0812 12:23:05.994916 1005383 addons.go:431] installing /etc/kubernetes/addons/rbac-external-resizer.yaml
	I0812 12:23:05.994946 1005383 ssh_runner.go:362] scp csi-hostpath-driver/rbac/rbac-external-resizer.yaml --> /etc/kubernetes/addons/rbac-external-resizer.yaml (2943 bytes)
	I0812 12:23:06.106887 1005383 addons.go:431] installing /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml
	I0812 12:23:06.106914 1005383 ssh_runner.go:362] scp volumesnapshots/snapshot.storage.k8s.io_volumesnapshots.yaml --> /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml (19582 bytes)
	I0812 12:23:06.210010 1005383 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.3/kubectl apply -f /etc/kubernetes/addons/yakd-ns.yaml -f /etc/kubernetes/addons/yakd-sa.yaml -f /etc/kubernetes/addons/yakd-crb.yaml -f /etc/kubernetes/addons/yakd-svc.yaml -f /etc/kubernetes/addons/yakd-dp.yaml
	I0812 12:23:06.266793 1005383 addons.go:431] installing /etc/kubernetes/addons/ig-clusterrolebinding.yaml
	I0812 12:23:06.266819 1005383 ssh_runner.go:362] scp inspektor-gadget/ig-clusterrolebinding.yaml --> /etc/kubernetes/addons/ig-clusterrolebinding.yaml (274 bytes)
	I0812 12:23:06.284443 1005383 addons.go:431] installing /etc/kubernetes/addons/rbac-external-snapshotter.yaml
	I0812 12:23:06.284518 1005383 ssh_runner.go:362] scp csi-hostpath-driver/rbac/rbac-external-snapshotter.yaml --> /etc/kubernetes/addons/rbac-external-snapshotter.yaml (3149 bytes)
	I0812 12:23:06.411609 1005383 addons.go:431] installing /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml
	I0812 12:23:06.411633 1005383 ssh_runner.go:362] scp volumesnapshots/rbac-volume-snapshot-controller.yaml --> /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml (3545 bytes)
	I0812 12:23:06.440089 1005383 addons.go:431] installing /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml
	I0812 12:23:06.440117 1005383 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml (1475 bytes)
	I0812 12:23:06.544011 1005383 ssh_runner.go:235] Completed: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.30.3/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml | sed -e '/^        forward . \/etc\/resolv.conf.*/i \        hosts {\n           192.168.49.1 host.minikube.internal\n           fallthrough\n        }' -e '/^        errors *$/i \        log' | sudo /var/lib/minikube/binaries/v1.30.3/kubectl --kubeconfig=/var/lib/minikube/kubeconfig replace -f -": (2.614790778s)
	I0812 12:23:06.544041 1005383 start.go:971] {"host.minikube.internal": 192.168.49.1} host record injected into CoreDNS's ConfigMap
	I0812 12:23:06.546030 1005383 ssh_runner.go:235] Completed: sudo systemctl start kubelet: (2.277968505s)
	I0812 12:23:06.546730 1005383 node_ready.go:35] waiting up to 6m0s for node "addons-673965" to be "Ready" ...
	I0812 12:23:06.554690 1005383 node_ready.go:49] node "addons-673965" has status "Ready":"True"
	I0812 12:23:06.554717 1005383 node_ready.go:38] duration metric: took 7.956953ms for node "addons-673965" to be "Ready" ...
	I0812 12:23:06.554729 1005383 pod_ready.go:35] extra waiting up to 6m0s for all system-critical pods including labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
	I0812 12:23:06.577146 1005383 pod_ready.go:78] waiting up to 6m0s for pod "coredns-7db6d8ff4d-2q4f7" in "kube-system" namespace to be "Ready" ...
	I0812 12:23:06.585755 1005383 addons.go:431] installing /etc/kubernetes/addons/ig-crd.yaml
	I0812 12:23:06.585778 1005383 ssh_runner.go:362] scp inspektor-gadget/ig-crd.yaml --> /etc/kubernetes/addons/ig-crd.yaml (5216 bytes)
	I0812 12:23:06.650493 1005383 addons.go:431] installing /etc/kubernetes/addons/csi-hostpath-attacher.yaml
	I0812 12:23:06.650518 1005383 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/csi-hostpath-attacher.yaml (2143 bytes)
	I0812 12:23:06.675084 1005383 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.3/kubectl apply -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml
	I0812 12:23:07.063386 1005383 kapi.go:214] "coredns" deployment in "kube-system" namespace and "addons-673965" context rescaled to 1 replicas
	I0812 12:23:07.080485 1005383 pod_ready.go:97] error getting pod "coredns-7db6d8ff4d-2q4f7" in "kube-system" namespace (skipping!): pods "coredns-7db6d8ff4d-2q4f7" not found
	I0812 12:23:07.080516 1005383 pod_ready.go:81] duration metric: took 503.332767ms for pod "coredns-7db6d8ff4d-2q4f7" in "kube-system" namespace to be "Ready" ...
	E0812 12:23:07.080529 1005383 pod_ready.go:66] WaitExtra: waitPodCondition: error getting pod "coredns-7db6d8ff4d-2q4f7" in "kube-system" namespace (skipping!): pods "coredns-7db6d8ff4d-2q4f7" not found
	I0812 12:23:07.080536 1005383 pod_ready.go:78] waiting up to 6m0s for pod "coredns-7db6d8ff4d-jwvvn" in "kube-system" namespace to be "Ready" ...
	I0812 12:23:07.138256 1005383 addons.go:431] installing /etc/kubernetes/addons/ig-daemonset.yaml
	I0812 12:23:07.138283 1005383 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/ig-daemonset.yaml (7735 bytes)
	I0812 12:23:07.265498 1005383 addons.go:431] installing /etc/kubernetes/addons/csi-hostpath-driverinfo.yaml
	I0812 12:23:07.265526 1005383 ssh_runner.go:362] scp csi-hostpath-driver/deploy/csi-hostpath-driverinfo.yaml --> /etc/kubernetes/addons/csi-hostpath-driverinfo.yaml (1274 bytes)
	I0812 12:23:07.416277 1005383 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.3/kubectl apply -f /etc/kubernetes/addons/ig-namespace.yaml -f /etc/kubernetes/addons/ig-serviceaccount.yaml -f /etc/kubernetes/addons/ig-role.yaml -f /etc/kubernetes/addons/ig-rolebinding.yaml -f /etc/kubernetes/addons/ig-clusterrole.yaml -f /etc/kubernetes/addons/ig-clusterrolebinding.yaml -f /etc/kubernetes/addons/ig-crd.yaml -f /etc/kubernetes/addons/ig-daemonset.yaml
	I0812 12:23:07.507281 1005383 addons.go:431] installing /etc/kubernetes/addons/csi-hostpath-plugin.yaml
	I0812 12:23:07.507316 1005383 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/csi-hostpath-plugin.yaml (8201 bytes)
	I0812 12:23:07.791292 1005383 addons.go:431] installing /etc/kubernetes/addons/csi-hostpath-resizer.yaml
	I0812 12:23:07.791370 1005383 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/csi-hostpath-resizer.yaml (2191 bytes)
	I0812 12:23:08.112243 1005383 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.3/kubectl apply -f /etc/kubernetes/addons/ingress-dns-pod.yaml: (3.277012585s)
	I0812 12:23:08.112339 1005383 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.3/kubectl apply -f /etc/kubernetes/addons/deployment.yaml: (3.241307232s)
	I0812 12:23:08.207376 1005383 addons.go:431] installing /etc/kubernetes/addons/csi-hostpath-storageclass.yaml
	I0812 12:23:08.207399 1005383 ssh_runner.go:362] scp csi-hostpath-driver/deploy/csi-hostpath-storageclass.yaml --> /etc/kubernetes/addons/csi-hostpath-storageclass.yaml (846 bytes)
	I0812 12:23:08.331482 1005383 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.3/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml: (3.395557606s)
	I0812 12:23:08.331629 1005383 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.3/kubectl apply -f /etc/kubernetes/addons/nvidia-device-plugin.yaml: (3.231519791s)
	I0812 12:23:08.490032 1005383 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.3/kubectl apply -f /etc/kubernetes/addons/rbac-external-attacher.yaml -f /etc/kubernetes/addons/rbac-hostpath.yaml -f /etc/kubernetes/addons/rbac-external-health-monitor-controller.yaml -f /etc/kubernetes/addons/rbac-external-provisioner.yaml -f /etc/kubernetes/addons/rbac-external-resizer.yaml -f /etc/kubernetes/addons/rbac-external-snapshotter.yaml -f /etc/kubernetes/addons/csi-hostpath-attacher.yaml -f /etc/kubernetes/addons/csi-hostpath-driverinfo.yaml -f /etc/kubernetes/addons/csi-hostpath-plugin.yaml -f /etc/kubernetes/addons/csi-hostpath-resizer.yaml -f /etc/kubernetes/addons/csi-hostpath-storageclass.yaml
	I0812 12:23:09.088120 1005383 pod_ready.go:102] pod "coredns-7db6d8ff4d-jwvvn" in "kube-system" namespace has status "Ready":"False"
	I0812 12:23:11.102625 1005383 pod_ready.go:102] pod "coredns-7db6d8ff4d-jwvvn" in "kube-system" namespace has status "Ready":"False"
	I0812 12:23:11.333637 1005383 ssh_runner.go:362] scp memory --> /var/lib/minikube/google_application_credentials.json (162 bytes)
	I0812 12:23:11.333788 1005383 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-673965
	I0812 12:23:11.358932 1005383 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33894 SSHKeyPath:/home/jenkins/minikube-integration/19411-998978/.minikube/machines/addons-673965/id_rsa Username:docker}
	I0812 12:23:12.125552 1005383 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.3/kubectl apply -f /etc/kubernetes/addons/ingress-deploy.yaml: (6.882592414s)
	I0812 12:23:12.125621 1005383 addons.go:475] Verifying addon ingress=true in "addons-673965"
	I0812 12:23:12.125834 1005383 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.3/kubectl apply -f /etc/kubernetes/addons/storage-provisioner-rancher.yaml: (6.868756293s)
	I0812 12:23:12.127925 1005383 out.go:177] * Verifying ingress addon...
	I0812 12:23:12.129544 1005383 ssh_runner.go:362] scp memory --> /var/lib/minikube/google_cloud_project (12 bytes)
	I0812 12:23:12.130575 1005383 kapi.go:75] Waiting for pod with label "app.kubernetes.io/name=ingress-nginx" in ns "ingress-nginx" ...
	I0812 12:23:12.135758 1005383 kapi.go:86] Found 3 Pods for label selector app.kubernetes.io/name=ingress-nginx
	I0812 12:23:12.135836 1005383 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0812 12:23:12.235206 1005383 addons.go:234] Setting addon gcp-auth=true in "addons-673965"
	I0812 12:23:12.235298 1005383 host.go:66] Checking if "addons-673965" exists ...
	I0812 12:23:12.235777 1005383 cli_runner.go:164] Run: docker container inspect addons-673965 --format={{.State.Status}}
	I0812 12:23:12.269189 1005383 ssh_runner.go:195] Run: cat /var/lib/minikube/google_application_credentials.json
	I0812 12:23:12.269343 1005383 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-673965
	I0812 12:23:12.298190 1005383 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33894 SSHKeyPath:/home/jenkins/minikube-integration/19411-998978/.minikube/machines/addons-673965/id_rsa Username:docker}
	I0812 12:23:12.635161 1005383 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0812 12:23:13.136692 1005383 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0812 12:23:13.649535 1005383 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0812 12:23:13.649746 1005383 pod_ready.go:102] pod "coredns-7db6d8ff4d-jwvvn" in "kube-system" namespace has status "Ready":"False"
	I0812 12:23:14.153167 1005383 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0812 12:23:14.560814 1005383 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.3/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: (8.729061571s)
	I0812 12:23:14.560852 1005383 addons.go:475] Verifying addon metrics-server=true in "addons-673965"
	I0812 12:23:14.560883 1005383 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.3/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml: (8.711194621s)
	I0812 12:23:14.561094 1005383 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.3/kubectl apply -f /etc/kubernetes/addons/yakd-ns.yaml -f /etc/kubernetes/addons/yakd-sa.yaml -f /etc/kubernetes/addons/yakd-crb.yaml -f /etc/kubernetes/addons/yakd-svc.yaml -f /etc/kubernetes/addons/yakd-dp.yaml: (8.351050318s)
	I0812 12:23:14.560702 1005383 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.3/kubectl apply -f /etc/kubernetes/addons/registry-rc.yaml -f /etc/kubernetes/addons/registry-svc.yaml -f /etc/kubernetes/addons/registry-proxy.yaml: (8.848527135s)
	I0812 12:23:14.561329 1005383 addons.go:475] Verifying addon registry=true in "addons-673965"
	I0812 12:23:14.561506 1005383 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.3/kubectl apply -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml: (7.886384139s)
	W0812 12:23:14.561541 1005383 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.3/kubectl apply -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml: Process exited with status 1
	stdout:
	customresourcedefinition.apiextensions.k8s.io/volumesnapshotclasses.snapshot.storage.k8s.io created
	customresourcedefinition.apiextensions.k8s.io/volumesnapshotcontents.snapshot.storage.k8s.io created
	customresourcedefinition.apiextensions.k8s.io/volumesnapshots.snapshot.storage.k8s.io created
	serviceaccount/snapshot-controller created
	clusterrole.rbac.authorization.k8s.io/snapshot-controller-runner created
	clusterrolebinding.rbac.authorization.k8s.io/snapshot-controller-role created
	role.rbac.authorization.k8s.io/snapshot-controller-leaderelection created
	rolebinding.rbac.authorization.k8s.io/snapshot-controller-leaderelection created
	deployment.apps/snapshot-controller created
	
	stderr:
	error: resource mapping not found for name: "csi-hostpath-snapclass" namespace: "" from "/etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml": no matches for kind "VolumeSnapshotClass" in version "snapshot.storage.k8s.io/v1"
	ensure CRDs are installed first
	I0812 12:23:14.561567 1005383 retry.go:31] will retry after 333.216672ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.3/kubectl apply -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml: Process exited with status 1
	stdout:
	customresourcedefinition.apiextensions.k8s.io/volumesnapshotclasses.snapshot.storage.k8s.io created
	customresourcedefinition.apiextensions.k8s.io/volumesnapshotcontents.snapshot.storage.k8s.io created
	customresourcedefinition.apiextensions.k8s.io/volumesnapshots.snapshot.storage.k8s.io created
	serviceaccount/snapshot-controller created
	clusterrole.rbac.authorization.k8s.io/snapshot-controller-runner created
	clusterrolebinding.rbac.authorization.k8s.io/snapshot-controller-role created
	role.rbac.authorization.k8s.io/snapshot-controller-leaderelection created
	rolebinding.rbac.authorization.k8s.io/snapshot-controller-leaderelection created
	deployment.apps/snapshot-controller created
	
	stderr:
	error: resource mapping not found for name: "csi-hostpath-snapclass" namespace: "" from "/etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml": no matches for kind "VolumeSnapshotClass" in version "snapshot.storage.k8s.io/v1"
	ensure CRDs are installed first
	I0812 12:23:14.561635 1005383 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.3/kubectl apply -f /etc/kubernetes/addons/ig-namespace.yaml -f /etc/kubernetes/addons/ig-serviceaccount.yaml -f /etc/kubernetes/addons/ig-role.yaml -f /etc/kubernetes/addons/ig-rolebinding.yaml -f /etc/kubernetes/addons/ig-clusterrole.yaml -f /etc/kubernetes/addons/ig-clusterrolebinding.yaml -f /etc/kubernetes/addons/ig-crd.yaml -f /etc/kubernetes/addons/ig-daemonset.yaml: (7.145326982s)
	I0812 12:23:14.561746 1005383 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.3/kubectl apply -f /etc/kubernetes/addons/volcano-deployment.yaml: (9.233676005s)
	I0812 12:23:14.563861 1005383 out.go:177] * To access YAKD - Kubernetes Dashboard, wait for Pod to be ready and run the following command:
	
		minikube -p addons-673965 service yakd-dashboard -n yakd-dashboard
	
	I0812 12:23:14.564002 1005383 out.go:177] * Verifying registry addon...
	I0812 12:23:14.570158 1005383 kapi.go:75] Waiting for pod with label "kubernetes.io/minikube-addons=registry" in ns "kube-system" ...
	I0812 12:23:14.589407 1005383 kapi.go:86] Found 2 Pods for label selector kubernetes.io/minikube-addons=registry
	I0812 12:23:14.589438 1005383 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0812 12:23:14.655352 1005383 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0812 12:23:14.895598 1005383 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.3/kubectl apply --force -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml
	I0812 12:23:15.090862 1005383 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0812 12:23:15.160659 1005383 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0812 12:23:15.463230 1005383 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.3/kubectl apply -f /etc/kubernetes/addons/rbac-external-attacher.yaml -f /etc/kubernetes/addons/rbac-hostpath.yaml -f /etc/kubernetes/addons/rbac-external-health-monitor-controller.yaml -f /etc/kubernetes/addons/rbac-external-provisioner.yaml -f /etc/kubernetes/addons/rbac-external-resizer.yaml -f /etc/kubernetes/addons/rbac-external-snapshotter.yaml -f /etc/kubernetes/addons/csi-hostpath-attacher.yaml -f /etc/kubernetes/addons/csi-hostpath-driverinfo.yaml -f /etc/kubernetes/addons/csi-hostpath-plugin.yaml -f /etc/kubernetes/addons/csi-hostpath-resizer.yaml -f /etc/kubernetes/addons/csi-hostpath-storageclass.yaml: (6.973093961s)
	I0812 12:23:15.463309 1005383 addons.go:475] Verifying addon csi-hostpath-driver=true in "addons-673965"
	I0812 12:23:15.463591 1005383 ssh_runner.go:235] Completed: cat /var/lib/minikube/google_application_credentials.json: (3.194379198s)
	I0812 12:23:15.467698 1005383 out.go:177] * Verifying csi-hostpath-driver addon...
	I0812 12:23:15.467853 1005383 out.go:177]   - Using image gcr.io/k8s-minikube/gcp-auth-webhook:v0.1.2
	I0812 12:23:15.470073 1005383 out.go:177]   - Using image registry.k8s.io/ingress-nginx/kube-webhook-certgen:v1.4.1
	I0812 12:23:15.470857 1005383 kapi.go:75] Waiting for pod with label "kubernetes.io/minikube-addons=csi-hostpath-driver" in ns "kube-system" ...
	I0812 12:23:15.472876 1005383 addons.go:431] installing /etc/kubernetes/addons/gcp-auth-ns.yaml
	I0812 12:23:15.472940 1005383 ssh_runner.go:362] scp gcp-auth/gcp-auth-ns.yaml --> /etc/kubernetes/addons/gcp-auth-ns.yaml (700 bytes)
	I0812 12:23:15.495251 1005383 kapi.go:86] Found 3 Pods for label selector kubernetes.io/minikube-addons=csi-hostpath-driver
	I0812 12:23:15.495326 1005383 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0812 12:23:15.562584 1005383 addons.go:431] installing /etc/kubernetes/addons/gcp-auth-service.yaml
	I0812 12:23:15.562647 1005383 ssh_runner.go:362] scp gcp-auth/gcp-auth-service.yaml --> /etc/kubernetes/addons/gcp-auth-service.yaml (788 bytes)
	I0812 12:23:15.578046 1005383 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0812 12:23:15.607886 1005383 addons.go:431] installing /etc/kubernetes/addons/gcp-auth-webhook.yaml
	I0812 12:23:15.607959 1005383 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/gcp-auth-webhook.yaml (5421 bytes)
	I0812 12:23:15.628352 1005383 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.3/kubectl apply -f /etc/kubernetes/addons/gcp-auth-ns.yaml -f /etc/kubernetes/addons/gcp-auth-service.yaml -f /etc/kubernetes/addons/gcp-auth-webhook.yaml
	I0812 12:23:15.636397 1005383 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0812 12:23:15.978195 1005383 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0812 12:23:16.076230 1005383 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0812 12:23:16.087461 1005383 pod_ready.go:102] pod "coredns-7db6d8ff4d-jwvvn" in "kube-system" namespace has status "Ready":"False"
	I0812 12:23:16.136118 1005383 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0812 12:23:16.483208 1005383 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0812 12:23:16.553064 1005383 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.3/kubectl apply --force -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml: (1.65741167s)
	I0812 12:23:16.579413 1005383 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0812 12:23:16.607459 1005383 addons.go:475] Verifying addon gcp-auth=true in "addons-673965"
	I0812 12:23:16.612515 1005383 out.go:177] * Verifying gcp-auth addon...
	I0812 12:23:16.617340 1005383 kapi.go:75] Waiting for pod with label "kubernetes.io/minikube-addons=gcp-auth" in ns "gcp-auth" ...
	I0812 12:23:16.619936 1005383 kapi.go:86] Found 0 Pods for label selector kubernetes.io/minikube-addons=gcp-auth
	I0812 12:23:16.635029 1005383 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0812 12:23:16.977163 1005383 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0812 12:23:17.075326 1005383 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0812 12:23:17.136048 1005383 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0812 12:23:17.478659 1005383 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0812 12:23:17.575177 1005383 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0812 12:23:17.635256 1005383 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0812 12:23:17.996866 1005383 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0812 12:23:18.082115 1005383 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0812 12:23:18.089218 1005383 pod_ready.go:102] pod "coredns-7db6d8ff4d-jwvvn" in "kube-system" namespace has status "Ready":"False"
	I0812 12:23:18.135784 1005383 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0812 12:23:18.486580 1005383 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0812 12:23:18.577507 1005383 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0812 12:23:18.635156 1005383 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0812 12:23:18.976975 1005383 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0812 12:23:19.076383 1005383 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0812 12:23:19.136053 1005383 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0812 12:23:19.479991 1005383 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0812 12:23:19.577821 1005383 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0812 12:23:19.588122 1005383 pod_ready.go:92] pod "coredns-7db6d8ff4d-jwvvn" in "kube-system" namespace has status "Ready":"True"
	I0812 12:23:19.588193 1005383 pod_ready.go:81] duration metric: took 12.507648746s for pod "coredns-7db6d8ff4d-jwvvn" in "kube-system" namespace to be "Ready" ...
	I0812 12:23:19.588218 1005383 pod_ready.go:78] waiting up to 6m0s for pod "etcd-addons-673965" in "kube-system" namespace to be "Ready" ...
	I0812 12:23:19.594059 1005383 pod_ready.go:92] pod "etcd-addons-673965" in "kube-system" namespace has status "Ready":"True"
	I0812 12:23:19.594129 1005383 pod_ready.go:81] duration metric: took 5.889589ms for pod "etcd-addons-673965" in "kube-system" namespace to be "Ready" ...
	I0812 12:23:19.594158 1005383 pod_ready.go:78] waiting up to 6m0s for pod "kube-apiserver-addons-673965" in "kube-system" namespace to be "Ready" ...
	I0812 12:23:19.608984 1005383 pod_ready.go:92] pod "kube-apiserver-addons-673965" in "kube-system" namespace has status "Ready":"True"
	I0812 12:23:19.609056 1005383 pod_ready.go:81] duration metric: took 14.876088ms for pod "kube-apiserver-addons-673965" in "kube-system" namespace to be "Ready" ...
	I0812 12:23:19.609083 1005383 pod_ready.go:78] waiting up to 6m0s for pod "kube-controller-manager-addons-673965" in "kube-system" namespace to be "Ready" ...
	I0812 12:23:19.629609 1005383 pod_ready.go:92] pod "kube-controller-manager-addons-673965" in "kube-system" namespace has status "Ready":"True"
	I0812 12:23:19.629685 1005383 pod_ready.go:81] duration metric: took 20.578647ms for pod "kube-controller-manager-addons-673965" in "kube-system" namespace to be "Ready" ...
	I0812 12:23:19.629713 1005383 pod_ready.go:78] waiting up to 6m0s for pod "kube-proxy-5fl7x" in "kube-system" namespace to be "Ready" ...
	I0812 12:23:19.638403 1005383 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0812 12:23:19.644551 1005383 pod_ready.go:92] pod "kube-proxy-5fl7x" in "kube-system" namespace has status "Ready":"True"
	I0812 12:23:19.644620 1005383 pod_ready.go:81] duration metric: took 14.885951ms for pod "kube-proxy-5fl7x" in "kube-system" namespace to be "Ready" ...
	I0812 12:23:19.644647 1005383 pod_ready.go:78] waiting up to 6m0s for pod "kube-scheduler-addons-673965" in "kube-system" namespace to be "Ready" ...
	I0812 12:23:19.977542 1005383 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0812 12:23:19.985380 1005383 pod_ready.go:92] pod "kube-scheduler-addons-673965" in "kube-system" namespace has status "Ready":"True"
	I0812 12:23:19.985410 1005383 pod_ready.go:81] duration metric: took 340.74016ms for pod "kube-scheduler-addons-673965" in "kube-system" namespace to be "Ready" ...
	I0812 12:23:19.985423 1005383 pod_ready.go:78] waiting up to 6m0s for pod "nvidia-device-plugin-daemonset-cnjct" in "kube-system" namespace to be "Ready" ...
	I0812 12:23:20.075685 1005383 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0812 12:23:20.134886 1005383 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0812 12:23:20.477304 1005383 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0812 12:23:20.575214 1005383 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0812 12:23:20.635009 1005383 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0812 12:23:20.976439 1005383 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0812 12:23:21.076456 1005383 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0812 12:23:21.135690 1005383 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0812 12:23:21.477831 1005383 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0812 12:23:21.575809 1005383 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0812 12:23:21.635841 1005383 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0812 12:23:21.976848 1005383 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0812 12:23:21.991350 1005383 pod_ready.go:102] pod "nvidia-device-plugin-daemonset-cnjct" in "kube-system" namespace has status "Ready":"False"
	I0812 12:23:22.075336 1005383 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0812 12:23:22.135660 1005383 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0812 12:23:22.477845 1005383 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0812 12:23:22.575371 1005383 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0812 12:23:22.635841 1005383 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0812 12:23:22.979094 1005383 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0812 12:23:23.075753 1005383 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0812 12:23:23.136547 1005383 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0812 12:23:23.476441 1005383 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0812 12:23:23.575688 1005383 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0812 12:23:23.636665 1005383 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0812 12:23:23.977836 1005383 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0812 12:23:23.992662 1005383 pod_ready.go:102] pod "nvidia-device-plugin-daemonset-cnjct" in "kube-system" namespace has status "Ready":"False"
	I0812 12:23:24.076786 1005383 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0812 12:23:24.135972 1005383 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0812 12:23:24.477492 1005383 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0812 12:23:24.579848 1005383 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0812 12:23:24.634938 1005383 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0812 12:23:24.982134 1005383 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0812 12:23:25.075491 1005383 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0812 12:23:25.135335 1005383 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0812 12:23:25.477106 1005383 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0812 12:23:25.575382 1005383 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0812 12:23:25.635105 1005383 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0812 12:23:25.977492 1005383 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0812 12:23:25.992981 1005383 pod_ready.go:102] pod "nvidia-device-plugin-daemonset-cnjct" in "kube-system" namespace has status "Ready":"False"
	I0812 12:23:26.075737 1005383 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0812 12:23:26.135193 1005383 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0812 12:23:26.476661 1005383 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0812 12:23:26.574453 1005383 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0812 12:23:26.635853 1005383 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0812 12:23:26.978758 1005383 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0812 12:23:27.078248 1005383 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0812 12:23:27.138295 1005383 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0812 12:23:27.477196 1005383 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0812 12:23:27.582258 1005383 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0812 12:23:27.638392 1005383 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0812 12:23:27.977532 1005383 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0812 12:23:28.075689 1005383 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0812 12:23:28.137206 1005383 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0812 12:23:28.477171 1005383 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0812 12:23:28.491952 1005383 pod_ready.go:102] pod "nvidia-device-plugin-daemonset-cnjct" in "kube-system" namespace has status "Ready":"False"
	I0812 12:23:28.575975 1005383 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0812 12:23:28.634637 1005383 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0812 12:23:28.978837 1005383 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0812 12:23:29.082295 1005383 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0812 12:23:29.135910 1005383 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0812 12:23:29.476772 1005383 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0812 12:23:29.575330 1005383 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0812 12:23:29.635612 1005383 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0812 12:23:29.977630 1005383 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0812 12:23:30.077649 1005383 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0812 12:23:30.136067 1005383 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0812 12:23:30.477803 1005383 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0812 12:23:30.492037 1005383 pod_ready.go:102] pod "nvidia-device-plugin-daemonset-cnjct" in "kube-system" namespace has status "Ready":"False"
	I0812 12:23:30.576053 1005383 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0812 12:23:30.635926 1005383 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0812 12:23:30.979837 1005383 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0812 12:23:31.075938 1005383 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0812 12:23:31.135813 1005383 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0812 12:23:31.477100 1005383 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0812 12:23:31.575936 1005383 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0812 12:23:31.635608 1005383 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0812 12:23:31.977472 1005383 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0812 12:23:32.075020 1005383 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0812 12:23:32.135599 1005383 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0812 12:23:32.485538 1005383 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0812 12:23:32.506754 1005383 pod_ready.go:92] pod "nvidia-device-plugin-daemonset-cnjct" in "kube-system" namespace has status "Ready":"True"
	I0812 12:23:32.506775 1005383 pod_ready.go:81] duration metric: took 12.521344551s for pod "nvidia-device-plugin-daemonset-cnjct" in "kube-system" namespace to be "Ready" ...
	I0812 12:23:32.506784 1005383 pod_ready.go:38] duration metric: took 25.952043535s for extra waiting for all system-critical and pods with labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
	I0812 12:23:32.506799 1005383 api_server.go:52] waiting for apiserver process to appear ...
	I0812 12:23:32.506863 1005383 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0812 12:23:32.545704 1005383 api_server.go:72] duration metric: took 28.885676392s to wait for apiserver process to appear ...
	I0812 12:23:32.545774 1005383 api_server.go:88] waiting for apiserver healthz status ...
	I0812 12:23:32.545810 1005383 api_server.go:253] Checking apiserver healthz at https://192.168.49.2:8443/healthz ...
	I0812 12:23:32.569849 1005383 api_server.go:279] https://192.168.49.2:8443/healthz returned 200:
	ok
	I0812 12:23:32.579075 1005383 api_server.go:141] control plane version: v1.30.3
	I0812 12:23:32.579154 1005383 api_server.go:131] duration metric: took 33.359351ms to wait for apiserver health ...
	I0812 12:23:32.579178 1005383 system_pods.go:43] waiting for kube-system pods to appear ...
	I0812 12:23:32.586797 1005383 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0812 12:23:32.600794 1005383 system_pods.go:59] 18 kube-system pods found
	I0812 12:23:32.600884 1005383 system_pods.go:61] "coredns-7db6d8ff4d-jwvvn" [b8b7df59-821d-4d45-8a3e-ef73eaf6adbb] Running
	I0812 12:23:32.600908 1005383 system_pods.go:61] "csi-hostpath-attacher-0" [2f75c225-69be-4f94-a41b-454be2d180bb] Pending / Ready:ContainersNotReady (containers with unready status: [csi-attacher]) / ContainersReady:ContainersNotReady (containers with unready status: [csi-attacher])
	I0812 12:23:32.600933 1005383 system_pods.go:61] "csi-hostpath-resizer-0" [2bfee75e-b9dd-401c-8ab5-59f3e9078f63] Pending / Ready:ContainersNotReady (containers with unready status: [csi-resizer]) / ContainersReady:ContainersNotReady (containers with unready status: [csi-resizer])
	I0812 12:23:32.600971 1005383 system_pods.go:61] "csi-hostpathplugin-7glsf" [9e729621-0d02-4e23-9c36-6e6c41c718ea] Pending / Ready:ContainersNotReady (containers with unready status: [csi-external-health-monitor-controller node-driver-registrar hostpath liveness-probe csi-provisioner csi-snapshotter]) / ContainersReady:ContainersNotReady (containers with unready status: [csi-external-health-monitor-controller node-driver-registrar hostpath liveness-probe csi-provisioner csi-snapshotter])
	I0812 12:23:32.600990 1005383 system_pods.go:61] "etcd-addons-673965" [9c8a0895-b581-4973-8cfb-de05722829d4] Running
	I0812 12:23:32.601010 1005383 system_pods.go:61] "kindnet-k49nh" [32b869ab-a335-42d7-84a7-17696b7b2429] Running
	I0812 12:23:32.601030 1005383 system_pods.go:61] "kube-apiserver-addons-673965" [de9b0f90-f4f1-432d-9102-61c73ce03b68] Running
	I0812 12:23:32.601061 1005383 system_pods.go:61] "kube-controller-manager-addons-673965" [a48981f4-f5a0-48a6-8d02-ec5e553b6e28] Running
	I0812 12:23:32.601086 1005383 system_pods.go:61] "kube-ingress-dns-minikube" [88f55a3d-ab52-408d-b57d-478cf3a45a0e] Running
	I0812 12:23:32.601106 1005383 system_pods.go:61] "kube-proxy-5fl7x" [f5af81d0-f446-456a-89ac-ac747d9dce23] Running
	I0812 12:23:32.601128 1005383 system_pods.go:61] "kube-scheduler-addons-673965" [c037b47b-be2e-4efe-8a2a-e1a7ad400ccc] Running
	I0812 12:23:32.601163 1005383 system_pods.go:61] "metrics-server-c59844bb4-cwgnw" [9297a50d-ec7d-487b-94a5-ed964e17aa28] Pending / Ready:ContainersNotReady (containers with unready status: [metrics-server]) / ContainersReady:ContainersNotReady (containers with unready status: [metrics-server])
	I0812 12:23:32.601186 1005383 system_pods.go:61] "nvidia-device-plugin-daemonset-cnjct" [f02dfcaf-fe6d-447d-a835-87af4cfbf4c6] Running
	I0812 12:23:32.601208 1005383 system_pods.go:61] "registry-698f998955-rp6t5" [6fcd0097-9a1e-431b-a4d6-21fbc0382cee] Pending / Ready:ContainersNotReady (containers with unready status: [registry]) / ContainersReady:ContainersNotReady (containers with unready status: [registry])
	I0812 12:23:32.601401 1005383 system_pods.go:61] "registry-proxy-ffzv5" [8dd51828-4266-477a-bf2c-0d230355a473] Pending / Ready:ContainersNotReady (containers with unready status: [registry-proxy]) / ContainersReady:ContainersNotReady (containers with unready status: [registry-proxy])
	I0812 12:23:32.601433 1005383 system_pods.go:61] "snapshot-controller-745499f584-cb8vt" [a254fd8c-fe84-4f3b-b4c1-5bc02da9496f] Pending / Ready:ContainersNotReady (containers with unready status: [volume-snapshot-controller]) / ContainersReady:ContainersNotReady (containers with unready status: [volume-snapshot-controller])
	I0812 12:23:32.601456 1005383 system_pods.go:61] "snapshot-controller-745499f584-sjdvb" [b2ae03bc-b3eb-4ca2-a115-e9c4466c2442] Pending / Ready:ContainersNotReady (containers with unready status: [volume-snapshot-controller]) / ContainersReady:ContainersNotReady (containers with unready status: [volume-snapshot-controller])
	I0812 12:23:32.601477 1005383 system_pods.go:61] "storage-provisioner" [1da2da93-a507-4976-8d55-6e616583d114] Running
	I0812 12:23:32.601512 1005383 system_pods.go:74] duration metric: took 22.314777ms to wait for pod list to return data ...
	I0812 12:23:32.601537 1005383 default_sa.go:34] waiting for default service account to be created ...
	I0812 12:23:32.607281 1005383 default_sa.go:45] found service account: "default"
	I0812 12:23:32.607304 1005383 default_sa.go:55] duration metric: took 5.744288ms for default service account to be created ...
	I0812 12:23:32.607315 1005383 system_pods.go:116] waiting for k8s-apps to be running ...
	I0812 12:23:32.618887 1005383 system_pods.go:86] 18 kube-system pods found
	I0812 12:23:32.618967 1005383 system_pods.go:89] "coredns-7db6d8ff4d-jwvvn" [b8b7df59-821d-4d45-8a3e-ef73eaf6adbb] Running
	I0812 12:23:32.618993 1005383 system_pods.go:89] "csi-hostpath-attacher-0" [2f75c225-69be-4f94-a41b-454be2d180bb] Pending / Ready:ContainersNotReady (containers with unready status: [csi-attacher]) / ContainersReady:ContainersNotReady (containers with unready status: [csi-attacher])
	I0812 12:23:32.619018 1005383 system_pods.go:89] "csi-hostpath-resizer-0" [2bfee75e-b9dd-401c-8ab5-59f3e9078f63] Pending / Ready:ContainersNotReady (containers with unready status: [csi-resizer]) / ContainersReady:ContainersNotReady (containers with unready status: [csi-resizer])
	I0812 12:23:32.619058 1005383 system_pods.go:89] "csi-hostpathplugin-7glsf" [9e729621-0d02-4e23-9c36-6e6c41c718ea] Pending / Ready:ContainersNotReady (containers with unready status: [csi-external-health-monitor-controller node-driver-registrar hostpath liveness-probe csi-provisioner csi-snapshotter]) / ContainersReady:ContainersNotReady (containers with unready status: [csi-external-health-monitor-controller node-driver-registrar hostpath liveness-probe csi-provisioner csi-snapshotter])
	I0812 12:23:32.619077 1005383 system_pods.go:89] "etcd-addons-673965" [9c8a0895-b581-4973-8cfb-de05722829d4] Running
	I0812 12:23:32.619099 1005383 system_pods.go:89] "kindnet-k49nh" [32b869ab-a335-42d7-84a7-17696b7b2429] Running
	I0812 12:23:32.619133 1005383 system_pods.go:89] "kube-apiserver-addons-673965" [de9b0f90-f4f1-432d-9102-61c73ce03b68] Running
	I0812 12:23:32.619158 1005383 system_pods.go:89] "kube-controller-manager-addons-673965" [a48981f4-f5a0-48a6-8d02-ec5e553b6e28] Running
	I0812 12:23:32.619178 1005383 system_pods.go:89] "kube-ingress-dns-minikube" [88f55a3d-ab52-408d-b57d-478cf3a45a0e] Running
	I0812 12:23:32.619216 1005383 system_pods.go:89] "kube-proxy-5fl7x" [f5af81d0-f446-456a-89ac-ac747d9dce23] Running
	I0812 12:23:32.619242 1005383 system_pods.go:89] "kube-scheduler-addons-673965" [c037b47b-be2e-4efe-8a2a-e1a7ad400ccc] Running
	I0812 12:23:32.619263 1005383 system_pods.go:89] "metrics-server-c59844bb4-cwgnw" [9297a50d-ec7d-487b-94a5-ed964e17aa28] Pending / Ready:ContainersNotReady (containers with unready status: [metrics-server]) / ContainersReady:ContainersNotReady (containers with unready status: [metrics-server])
	I0812 12:23:32.619299 1005383 system_pods.go:89] "nvidia-device-plugin-daemonset-cnjct" [f02dfcaf-fe6d-447d-a835-87af4cfbf4c6] Running
	I0812 12:23:32.619327 1005383 system_pods.go:89] "registry-698f998955-rp6t5" [6fcd0097-9a1e-431b-a4d6-21fbc0382cee] Pending / Ready:ContainersNotReady (containers with unready status: [registry]) / ContainersReady:ContainersNotReady (containers with unready status: [registry])
	I0812 12:23:32.619349 1005383 system_pods.go:89] "registry-proxy-ffzv5" [8dd51828-4266-477a-bf2c-0d230355a473] Pending / Ready:ContainersNotReady (containers with unready status: [registry-proxy]) / ContainersReady:ContainersNotReady (containers with unready status: [registry-proxy])
	I0812 12:23:32.619388 1005383 system_pods.go:89] "snapshot-controller-745499f584-cb8vt" [a254fd8c-fe84-4f3b-b4c1-5bc02da9496f] Pending / Ready:ContainersNotReady (containers with unready status: [volume-snapshot-controller]) / ContainersReady:ContainersNotReady (containers with unready status: [volume-snapshot-controller])
	I0812 12:23:32.619418 1005383 system_pods.go:89] "snapshot-controller-745499f584-sjdvb" [b2ae03bc-b3eb-4ca2-a115-e9c4466c2442] Pending / Ready:ContainersNotReady (containers with unready status: [volume-snapshot-controller]) / ContainersReady:ContainersNotReady (containers with unready status: [volume-snapshot-controller])
	I0812 12:23:32.619439 1005383 system_pods.go:89] "storage-provisioner" [1da2da93-a507-4976-8d55-6e616583d114] Running
	I0812 12:23:32.619478 1005383 system_pods.go:126] duration metric: took 12.156531ms to wait for k8s-apps to be running ...
	I0812 12:23:32.619504 1005383 system_svc.go:44] waiting for kubelet service to be running ....
	I0812 12:23:32.619602 1005383 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
	I0812 12:23:32.639899 1005383 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0812 12:23:32.645082 1005383 system_svc.go:56] duration metric: took 25.558743ms WaitForService to wait for kubelet
	I0812 12:23:32.645159 1005383 kubeadm.go:582] duration metric: took 28.985126235s to wait for: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
	I0812 12:23:32.645193 1005383 node_conditions.go:102] verifying NodePressure condition ...
	I0812 12:23:32.654362 1005383 node_conditions.go:122] node storage ephemeral capacity is 203034800Ki
	I0812 12:23:32.654398 1005383 node_conditions.go:123] node cpu capacity is 2
	I0812 12:23:32.654412 1005383 node_conditions.go:105] duration metric: took 9.20155ms to run NodePressure ...
	I0812 12:23:32.654425 1005383 start.go:241] waiting for startup goroutines ...
	I0812 12:23:32.977455 1005383 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0812 12:23:33.076720 1005383 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0812 12:23:33.134634 1005383 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0812 12:23:33.476118 1005383 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0812 12:23:33.575716 1005383 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0812 12:23:33.634735 1005383 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0812 12:23:33.979815 1005383 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0812 12:23:34.075786 1005383 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0812 12:23:34.135921 1005383 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0812 12:23:34.476951 1005383 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0812 12:23:34.575686 1005383 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0812 12:23:34.635831 1005383 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0812 12:23:34.976398 1005383 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0812 12:23:35.075510 1005383 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0812 12:23:35.136126 1005383 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0812 12:23:35.476975 1005383 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0812 12:23:35.576084 1005383 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0812 12:23:35.635264 1005383 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0812 12:23:35.976726 1005383 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0812 12:23:36.075774 1005383 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0812 12:23:36.135038 1005383 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0812 12:23:36.476458 1005383 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0812 12:23:36.574861 1005383 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0812 12:23:36.635835 1005383 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0812 12:23:36.977831 1005383 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0812 12:23:37.075595 1005383 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0812 12:23:37.136803 1005383 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0812 12:23:37.476262 1005383 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0812 12:23:37.574991 1005383 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0812 12:23:37.635432 1005383 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0812 12:23:37.978272 1005383 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0812 12:23:38.076690 1005383 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0812 12:23:38.135544 1005383 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0812 12:23:38.481362 1005383 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0812 12:23:38.578289 1005383 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0812 12:23:38.635872 1005383 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0812 12:23:38.976771 1005383 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0812 12:23:39.075959 1005383 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0812 12:23:39.136889 1005383 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0812 12:23:39.477869 1005383 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0812 12:23:39.576884 1005383 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0812 12:23:39.635897 1005383 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0812 12:23:39.976822 1005383 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0812 12:23:40.080926 1005383 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0812 12:23:40.137353 1005383 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0812 12:23:40.477185 1005383 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0812 12:23:40.578301 1005383 kapi.go:107] duration metric: took 26.008146989s to wait for kubernetes.io/minikube-addons=registry ...
	I0812 12:23:40.637991 1005383 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0812 12:23:40.977351 1005383 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0812 12:23:41.138436 1005383 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0812 12:23:41.478262 1005383 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0812 12:23:41.639531 1005383 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0812 12:23:41.976566 1005383 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0812 12:23:42.136761 1005383 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0812 12:23:42.477053 1005383 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0812 12:23:42.635885 1005383 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0812 12:23:42.976988 1005383 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0812 12:23:43.135590 1005383 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0812 12:23:43.476982 1005383 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0812 12:23:43.651039 1005383 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0812 12:23:43.979334 1005383 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0812 12:23:44.136919 1005383 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0812 12:23:44.476411 1005383 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0812 12:23:44.635784 1005383 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0812 12:23:44.980718 1005383 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0812 12:23:45.137275 1005383 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0812 12:23:45.478537 1005383 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0812 12:23:45.635901 1005383 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0812 12:23:45.977147 1005383 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0812 12:23:46.135152 1005383 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0812 12:23:46.477383 1005383 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0812 12:23:46.635349 1005383 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0812 12:23:46.979168 1005383 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0812 12:23:47.140995 1005383 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0812 12:23:47.508384 1005383 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0812 12:23:47.643909 1005383 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0812 12:23:47.979039 1005383 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0812 12:23:48.136049 1005383 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0812 12:23:48.478584 1005383 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0812 12:23:48.646430 1005383 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0812 12:23:48.977132 1005383 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0812 12:23:49.135400 1005383 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0812 12:23:49.478656 1005383 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0812 12:23:49.648657 1005383 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0812 12:23:49.977695 1005383 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0812 12:23:50.135874 1005383 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0812 12:23:50.476685 1005383 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0812 12:23:50.635421 1005383 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0812 12:23:50.977264 1005383 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0812 12:23:51.136322 1005383 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0812 12:23:51.476965 1005383 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0812 12:23:51.635183 1005383 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0812 12:23:51.976549 1005383 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0812 12:23:52.136926 1005383 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0812 12:23:52.477490 1005383 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0812 12:23:52.636026 1005383 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0812 12:23:52.976636 1005383 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0812 12:23:53.135517 1005383 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0812 12:23:53.477442 1005383 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0812 12:23:53.635083 1005383 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0812 12:23:53.980501 1005383 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0812 12:23:54.135915 1005383 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0812 12:23:54.476477 1005383 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0812 12:23:54.636317 1005383 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0812 12:23:54.976587 1005383 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0812 12:23:55.135521 1005383 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0812 12:23:55.477939 1005383 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0812 12:23:55.634907 1005383 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0812 12:23:55.976591 1005383 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0812 12:23:56.136130 1005383 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0812 12:23:56.478025 1005383 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0812 12:23:56.636152 1005383 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0812 12:23:56.980073 1005383 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0812 12:23:57.135391 1005383 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0812 12:23:57.476752 1005383 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0812 12:23:57.635441 1005383 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0812 12:23:57.977385 1005383 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0812 12:23:58.135728 1005383 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0812 12:23:58.476384 1005383 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0812 12:23:58.635681 1005383 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0812 12:23:58.976098 1005383 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0812 12:23:59.136522 1005383 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0812 12:23:59.476614 1005383 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0812 12:23:59.635523 1005383 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0812 12:23:59.977277 1005383 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0812 12:24:00.194815 1005383 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0812 12:24:00.520779 1005383 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0812 12:24:00.638616 1005383 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0812 12:24:00.978126 1005383 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0812 12:24:01.137519 1005383 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0812 12:24:01.478149 1005383 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0812 12:24:01.635565 1005383 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0812 12:24:01.977385 1005383 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0812 12:24:02.136148 1005383 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0812 12:24:02.476814 1005383 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0812 12:24:02.635698 1005383 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0812 12:24:02.976197 1005383 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0812 12:24:03.135394 1005383 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0812 12:24:03.476770 1005383 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0812 12:24:03.637254 1005383 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0812 12:24:03.976293 1005383 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0812 12:24:04.134786 1005383 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0812 12:24:04.476941 1005383 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0812 12:24:04.635779 1005383 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0812 12:24:04.976183 1005383 kapi.go:107] duration metric: took 49.505322883s to wait for kubernetes.io/minikube-addons=csi-hostpath-driver ...
	I0812 12:24:05.135050 1005383 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0812 12:24:05.635062 1005383 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0812 12:24:06.135168 1005383 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0812 12:24:06.635138 1005383 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0812 12:24:07.137334 1005383 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0812 12:24:07.634985 1005383 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0812 12:24:08.135396 1005383 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0812 12:24:08.636013 1005383 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0812 12:24:09.134909 1005383 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0812 12:24:09.635381 1005383 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0812 12:24:10.135846 1005383 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0812 12:24:10.636111 1005383 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0812 12:24:11.135685 1005383 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0812 12:24:11.635621 1005383 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0812 12:24:12.135457 1005383 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0812 12:24:12.635616 1005383 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0812 12:24:13.135630 1005383 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0812 12:24:13.636012 1005383 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0812 12:24:14.135398 1005383 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0812 12:24:14.635832 1005383 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0812 12:24:15.138003 1005383 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0812 12:24:15.635562 1005383 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0812 12:24:16.136543 1005383 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0812 12:24:16.634559 1005383 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0812 12:24:17.134694 1005383 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0812 12:24:17.635169 1005383 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0812 12:24:18.138533 1005383 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0812 12:24:18.636273 1005383 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0812 12:24:19.139021 1005383 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0812 12:24:19.639402 1005383 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0812 12:24:20.136932 1005383 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0812 12:24:20.635733 1005383 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0812 12:24:21.136526 1005383 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0812 12:24:21.636008 1005383 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0812 12:24:22.136281 1005383 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0812 12:24:22.635108 1005383 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0812 12:24:23.135424 1005383 kapi.go:107] duration metric: took 1m11.004847072s to wait for app.kubernetes.io/name=ingress-nginx ...
	I0812 12:24:39.621655 1005383 kapi.go:86] Found 1 Pods for label selector kubernetes.io/minikube-addons=gcp-auth
	I0812 12:24:39.621690 1005383 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0812 12:24:40.126727 1005383 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0812 12:24:40.621725 1005383 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0812 12:24:41.120872 1005383 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0812 12:24:41.621600 1005383 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0812 12:24:42.122518 1005383 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0812 12:24:42.621459 1005383 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0812 12:24:43.120687 1005383 kapi.go:107] duration metric: took 1m26.503454926s to wait for kubernetes.io/minikube-addons=gcp-auth ...
	I0812 12:24:43.122510 1005383 out.go:177] * Your GCP credentials will now be mounted into every pod created in the addons-673965 cluster.
	I0812 12:24:43.124105 1005383 out.go:177] * If you don't want your credentials mounted into a specific pod, add a label with the `gcp-auth-skip-secret` key to your pod configuration.
	I0812 12:24:43.125910 1005383 out.go:177] * If you want existing pods to be mounted with credentials, either recreate them or rerun addons enable with --refresh.
	I0812 12:24:43.127490 1005383 out.go:177] * Enabled addons: ingress-dns, cloud-spanner, storage-provisioner, nvidia-device-plugin, storage-provisioner-rancher, metrics-server, inspektor-gadget, volcano, yakd, default-storageclass, volumesnapshots, registry, csi-hostpath-driver, ingress, gcp-auth
	I0812 12:24:43.129220 1005383 addons.go:510] duration metric: took 1m39.468937614s for enable addons: enabled=[ingress-dns cloud-spanner storage-provisioner nvidia-device-plugin storage-provisioner-rancher metrics-server inspektor-gadget volcano yakd default-storageclass volumesnapshots registry csi-hostpath-driver ingress gcp-auth]
	I0812 12:24:43.129358 1005383 start.go:246] waiting for cluster config update ...
	I0812 12:24:43.129381 1005383 start.go:255] writing updated cluster config ...
	I0812 12:24:43.129717 1005383 ssh_runner.go:195] Run: rm -f paused
	I0812 12:24:43.462071 1005383 start.go:600] kubectl: 1.30.3, cluster: 1.30.3 (minor skew: 0)
	I0812 12:24:43.464170 1005383 out.go:177] * Done! kubectl is now configured to use "addons-673965" cluster and "default" namespace by default
	
	
	==> container status <==
	CONTAINER           IMAGE               CREATED              STATE               NAME                                     ATTEMPT             POD ID              POD
	82d72c1afda3a       e2d3313f65753       About a minute ago   Exited              gadget                                   5                   747389b4786cc       gadget-gdbxz
	57798c5192028       6ef582f3ec844       3 minutes ago        Running             gcp-auth                                 0                   55950902c6f6f       gcp-auth-5db96cd9b4-m27cv
	5cf80ce249eb6       24f8f979639f1       3 minutes ago        Running             controller                               0                   682ab20fd4b1a       ingress-nginx-controller-6d9bd977d4-w8fjj
	fc5e9453ea87b       ee6d597e62dc8       3 minutes ago        Running             csi-snapshotter                          0                   cccebee666b30       csi-hostpathplugin-7glsf
	82d2571273f22       642ded511e141       3 minutes ago        Running             csi-provisioner                          0                   cccebee666b30       csi-hostpathplugin-7glsf
	bfec482b7e2dd       922312104da8a       4 minutes ago        Running             liveness-probe                           0                   cccebee666b30       csi-hostpathplugin-7glsf
	e2b9c3afe4513       08f6b2990811a       4 minutes ago        Running             hostpath                                 0                   cccebee666b30       csi-hostpathplugin-7glsf
	2c401f79914a5       0107d56dbc0be       4 minutes ago        Running             node-driver-registrar                    0                   cccebee666b30       csi-hostpathplugin-7glsf
	36a332bd79e1e       8b46b1cd48760       4 minutes ago        Running             admission                                0                   d8c9de21200e5       volcano-admission-5f7844f7bc-mbs4n
	466c935a2f2a8       d9c7ad4c226bf       4 minutes ago        Running             volcano-scheduler                        0                   0290466b5d7b9       volcano-scheduler-844f6db89b-m47g4
	dde325cf6422e       9a80d518f102c       4 minutes ago        Running             csi-attacher                             0                   4518b1fca1ea1       csi-hostpath-attacher-0
	e38b535dbc7d3       487fa743e1e22       4 minutes ago        Running             csi-resizer                              0                   df9929776a828       csi-hostpath-resizer-0
	8e1325348d120       1461903ec4fe9       4 minutes ago        Running             csi-external-health-monitor-controller   0                   cccebee666b30       csi-hostpathplugin-7glsf
	e565e92ed9a58       296b5f799fcd8       4 minutes ago        Exited              patch                                    0                   fc45bdf730f12       ingress-nginx-admission-patch-72glw
	28db63c6e38ce       296b5f799fcd8       4 minutes ago        Exited              create                                   0                   8d71351a7a21b       ingress-nginx-admission-create-5582v
	d83576df6bf0c       4d1e5c3e97420       4 minutes ago        Running             volume-snapshot-controller               0                   1da9678cfc4d7       snapshot-controller-745499f584-cb8vt
	3fad2cbb7a568       1505f556b3a7b       4 minutes ago        Running             volcano-controllers                      0                   680ffa751e705       volcano-controllers-59cb4746db-dfflb
	0f11be25b978b       95dccb4df54ab       4 minutes ago        Running             metrics-server                           0                   e3972204a489a       metrics-server-c59844bb4-cwgnw
	3fb2bcd0e2f66       4d1e5c3e97420       4 minutes ago        Running             volume-snapshot-controller               0                   64c59b7f5f30a       snapshot-controller-745499f584-sjdvb
	cb7013d80ce8d       7ce2150c8929b       4 minutes ago        Running             local-path-provisioner                   0                   fca04d4209213       local-path-provisioner-8d985888d-cfpf6
	b0a87e50d828a       3410e1561990a       4 minutes ago        Running             registry-proxy                           0                   0d99dc8f0a202       registry-proxy-ffzv5
	82028393e406c       77bdba588b953       4 minutes ago        Running             yakd                                     0                   3ab2283dd663e       yakd-dashboard-799879c74f-zqdcx
	112454474e785       6fed88f43b276       4 minutes ago        Running             registry                                 0                   245aed75f80a9       registry-698f998955-rp6t5
	8153702378a7b       e396bbd29d2f6       4 minutes ago        Running             nvidia-device-plugin-ctr                 0                   a765c3a18d768       nvidia-device-plugin-daemonset-cnjct
	d8223d9527c13       53af6e2c4c343       4 minutes ago        Running             cloud-spanner-emulator                   0                   ecf18d399837b       cloud-spanner-emulator-5455fb9b69-m6p8s
	028adcb1cf59f       35508c2f890c4       4 minutes ago        Running             minikube-ingress-dns                     0                   74c9e276d79d3       kube-ingress-dns-minikube
	107c22ae0fb15       2437cf7621777       4 minutes ago        Running             coredns                                  0                   21f31811a471a       coredns-7db6d8ff4d-jwvvn
	090c787c5707d       ba04bb24b9575       4 minutes ago        Running             storage-provisioner                      0                   960411fe273b0       storage-provisioner
	c98790721f0b7       d5e283bc63d43       4 minutes ago        Running             kindnet-cni                              0                   c2ca338a8a0c7       kindnet-k49nh
	987c946eb8d1f       2351f570ed0ea       4 minutes ago        Running             kube-proxy                               0                   61191c8a6c196       kube-proxy-5fl7x
	8c6aff5a13e17       8e97cdb19e7cc       5 minutes ago        Running             kube-controller-manager                  0                   3df983ed6c2d6       kube-controller-manager-addons-673965
	b98eafc77f9ce       014faa467e297       5 minutes ago        Running             etcd                                     0                   d7cfa156bf388       etcd-addons-673965
	54c2ff5ffd188       d48f992a22722       5 minutes ago        Running             kube-scheduler                           0                   3d14fbc4077c8       kube-scheduler-addons-673965
	23442c5b28f7b       61773190d42ff       5 minutes ago        Running             kube-apiserver                           0                   2ece7cd7ec620       kube-apiserver-addons-673965
	
	
	==> containerd <==
	Aug 12 12:25:49 addons-673965 containerd[812]: time="2024-08-12T12:25:49.049841118Z" level=info msg="TearDown network for sandbox \"ccce7bb23d0e8a3ab77319c08c8a0df4316f2d1566c087e007934801385772b4\" successfully"
	Aug 12 12:25:49 addons-673965 containerd[812]: time="2024-08-12T12:25:49.049889331Z" level=info msg="StopPodSandbox for \"ccce7bb23d0e8a3ab77319c08c8a0df4316f2d1566c087e007934801385772b4\" returns successfully"
	Aug 12 12:25:49 addons-673965 containerd[812]: time="2024-08-12T12:25:49.050413265Z" level=info msg="RemovePodSandbox for \"ccce7bb23d0e8a3ab77319c08c8a0df4316f2d1566c087e007934801385772b4\""
	Aug 12 12:25:49 addons-673965 containerd[812]: time="2024-08-12T12:25:49.050467179Z" level=info msg="Forcibly stopping sandbox \"ccce7bb23d0e8a3ab77319c08c8a0df4316f2d1566c087e007934801385772b4\""
	Aug 12 12:25:49 addons-673965 containerd[812]: time="2024-08-12T12:25:49.065607351Z" level=info msg="TearDown network for sandbox \"ccce7bb23d0e8a3ab77319c08c8a0df4316f2d1566c087e007934801385772b4\" successfully"
	Aug 12 12:25:49 addons-673965 containerd[812]: time="2024-08-12T12:25:49.083423824Z" level=warning msg="Failed to get podSandbox status for container event for sandboxID \"ccce7bb23d0e8a3ab77319c08c8a0df4316f2d1566c087e007934801385772b4\": an error occurred when try to find sandbox: not found. Sending the event with nil podSandboxStatus."
	Aug 12 12:25:49 addons-673965 containerd[812]: time="2024-08-12T12:25:49.083967196Z" level=info msg="RemovePodSandbox \"ccce7bb23d0e8a3ab77319c08c8a0df4316f2d1566c087e007934801385772b4\" returns successfully"
	Aug 12 12:26:37 addons-673965 containerd[812]: time="2024-08-12T12:26:37.873559037Z" level=info msg="PullImage \"ghcr.io/inspektor-gadget/inspektor-gadget:v0.31.0@sha256:6b2f7ac9fe6f547cfa541d9217f03da0d0c4615b561d5455a23d0edbbd607ecc\""
	Aug 12 12:26:38 addons-673965 containerd[812]: time="2024-08-12T12:26:38.007547296Z" level=info msg="ImageUpdate event name:\"ghcr.io/inspektor-gadget/inspektor-gadget@sha256:6b2f7ac9fe6f547cfa541d9217f03da0d0c4615b561d5455a23d0edbbd607ecc\" labels:{key:\"io.cri-containerd.image\" value:\"managed\"}"
	Aug 12 12:26:38 addons-673965 containerd[812]: time="2024-08-12T12:26:38.007645837Z" level=info msg="stop pulling image ghcr.io/inspektor-gadget/inspektor-gadget@sha256:6b2f7ac9fe6f547cfa541d9217f03da0d0c4615b561d5455a23d0edbbd607ecc: active requests=0, bytes read=89"
	Aug 12 12:26:38 addons-673965 containerd[812]: time="2024-08-12T12:26:38.011510318Z" level=info msg="Pulled image \"ghcr.io/inspektor-gadget/inspektor-gadget:v0.31.0@sha256:6b2f7ac9fe6f547cfa541d9217f03da0d0c4615b561d5455a23d0edbbd607ecc\" with image id \"sha256:e2d3313f65753f82428cf312f6e4b9237983de19680bde57ca1c0935cadbe630\", repo tag \"\", repo digest \"ghcr.io/inspektor-gadget/inspektor-gadget@sha256:6b2f7ac9fe6f547cfa541d9217f03da0d0c4615b561d5455a23d0edbbd607ecc\", size \"69907666\" in 137.891016ms"
	Aug 12 12:26:38 addons-673965 containerd[812]: time="2024-08-12T12:26:38.011636420Z" level=info msg="PullImage \"ghcr.io/inspektor-gadget/inspektor-gadget:v0.31.0@sha256:6b2f7ac9fe6f547cfa541d9217f03da0d0c4615b561d5455a23d0edbbd607ecc\" returns image reference \"sha256:e2d3313f65753f82428cf312f6e4b9237983de19680bde57ca1c0935cadbe630\""
	Aug 12 12:26:38 addons-673965 containerd[812]: time="2024-08-12T12:26:38.024818863Z" level=info msg="CreateContainer within sandbox \"747389b4786cc9af36d1f4fc081a953b4cc26fc49f4a5823e3d15b1600ccb874\" for container &ContainerMetadata{Name:gadget,Attempt:5,}"
	Aug 12 12:26:38 addons-673965 containerd[812]: time="2024-08-12T12:26:38.052865760Z" level=info msg="CreateContainer within sandbox \"747389b4786cc9af36d1f4fc081a953b4cc26fc49f4a5823e3d15b1600ccb874\" for &ContainerMetadata{Name:gadget,Attempt:5,} returns container id \"82d72c1afda3a7904e6bc7318eff247cf5e215f2ec63fcee5481018ef3d8afcf\""
	Aug 12 12:26:38 addons-673965 containerd[812]: time="2024-08-12T12:26:38.053650184Z" level=info msg="StartContainer for \"82d72c1afda3a7904e6bc7318eff247cf5e215f2ec63fcee5481018ef3d8afcf\""
	Aug 12 12:26:38 addons-673965 containerd[812]: time="2024-08-12T12:26:38.108531084Z" level=info msg="StartContainer for \"82d72c1afda3a7904e6bc7318eff247cf5e215f2ec63fcee5481018ef3d8afcf\" returns successfully"
	Aug 12 12:26:39 addons-673965 containerd[812]: time="2024-08-12T12:26:39.215074276Z" level=error msg="ExecSync for \"82d72c1afda3a7904e6bc7318eff247cf5e215f2ec63fcee5481018ef3d8afcf\" failed" error="failed to exec in container: failed to start exec \"9a03a48a498173de24062b57b86a76e443b71fac023dac8bbdfd60bcf92ab663\": OCI runtime exec failed: exec failed: cannot exec in a stopped container: unknown"
	Aug 12 12:26:39 addons-673965 containerd[812]: time="2024-08-12T12:26:39.224716620Z" level=error msg="ttrpc: received message on inactive stream" stream=91
	Aug 12 12:26:39 addons-673965 containerd[812]: time="2024-08-12T12:26:39.226017430Z" level=error msg="ExecSync for \"82d72c1afda3a7904e6bc7318eff247cf5e215f2ec63fcee5481018ef3d8afcf\" failed" error="failed to exec in container: failed to start exec \"651ec56684572a26103ded8aa86faacf2b03757eb71ca13b0e1d0b445cb9d034\": OCI runtime exec failed: exec failed: cannot exec in a stopped container: unknown"
	Aug 12 12:26:39 addons-673965 containerd[812]: time="2024-08-12T12:26:39.239050888Z" level=error msg="ExecSync for \"82d72c1afda3a7904e6bc7318eff247cf5e215f2ec63fcee5481018ef3d8afcf\" failed" error="failed to exec in container: failed to start exec \"f50b1105552b17e48740a779a68f2ef3c5a2722c8c5bde401b21f3f40a7d8822\": OCI runtime exec failed: exec failed: cannot exec in a stopped container: unknown"
	Aug 12 12:26:39 addons-673965 containerd[812]: time="2024-08-12T12:26:39.411020507Z" level=info msg="shim disconnected" id=82d72c1afda3a7904e6bc7318eff247cf5e215f2ec63fcee5481018ef3d8afcf namespace=k8s.io
	Aug 12 12:26:39 addons-673965 containerd[812]: time="2024-08-12T12:26:39.411069605Z" level=warning msg="cleaning up after shim disconnected" id=82d72c1afda3a7904e6bc7318eff247cf5e215f2ec63fcee5481018ef3d8afcf namespace=k8s.io
	Aug 12 12:26:39 addons-673965 containerd[812]: time="2024-08-12T12:26:39.411082487Z" level=info msg="cleaning up dead shim" namespace=k8s.io
	Aug 12 12:26:40 addons-673965 containerd[812]: time="2024-08-12T12:26:40.191219129Z" level=info msg="RemoveContainer for \"5d8d5496fc6f015fb2d7faa56f6f788e9a0258b21438083e49f6a9e143e25686\""
	Aug 12 12:26:40 addons-673965 containerd[812]: time="2024-08-12T12:26:40.199125728Z" level=info msg="RemoveContainer for \"5d8d5496fc6f015fb2d7faa56f6f788e9a0258b21438083e49f6a9e143e25686\" returns successfully"
	
	
	==> coredns [107c22ae0fb15894840db44e52f64d43edca2d271d2e70e854151f20f6abf1fb] <==
	[INFO] 10.244.0.7:33447 - 6371 "AAAA IN registry.kube-system.svc.cluster.local.cluster.local. udp 70 false 512" NXDOMAIN qr,aa,rd 163 0.000083288s
	[INFO] 10.244.0.7:34494 - 20046 "A IN registry.kube-system.svc.cluster.local.us-east-2.compute.internal. udp 83 false 512" NXDOMAIN qr,rd,ra 83 0.002600824s
	[INFO] 10.244.0.7:34494 - 2892 "AAAA IN registry.kube-system.svc.cluster.local.us-east-2.compute.internal. udp 83 false 512" NXDOMAIN qr,rd,ra 83 0.002436856s
	[INFO] 10.244.0.7:50128 - 33600 "A IN registry.kube-system.svc.cluster.local. udp 56 false 512" NOERROR qr,aa,rd 110 0.000114803s
	[INFO] 10.244.0.7:50128 - 52802 "AAAA IN registry.kube-system.svc.cluster.local. udp 56 false 512" NOERROR qr,aa,rd 149 0.00007418s
	[INFO] 10.244.0.7:49037 - 38521 "AAAA IN registry.kube-system.svc.cluster.local.kube-system.svc.cluster.local. udp 86 false 512" NXDOMAIN qr,aa,rd 179 0.000153596s
	[INFO] 10.244.0.7:49037 - 7038 "A IN registry.kube-system.svc.cluster.local.kube-system.svc.cluster.local. udp 86 false 512" NXDOMAIN qr,aa,rd 179 0.000239223s
	[INFO] 10.244.0.7:56818 - 46602 "AAAA IN registry.kube-system.svc.cluster.local.svc.cluster.local. udp 74 false 512" NXDOMAIN qr,aa,rd 167 0.000097064s
	[INFO] 10.244.0.7:56818 - 24844 "A IN registry.kube-system.svc.cluster.local.svc.cluster.local. udp 74 false 512" NXDOMAIN qr,aa,rd 167 0.000153325s
	[INFO] 10.244.0.7:39151 - 782 "AAAA IN registry.kube-system.svc.cluster.local.cluster.local. udp 70 false 512" NXDOMAIN qr,aa,rd 163 0.000093815s
	[INFO] 10.244.0.7:39151 - 28428 "A IN registry.kube-system.svc.cluster.local.cluster.local. udp 70 false 512" NXDOMAIN qr,aa,rd 163 0.000060438s
	[INFO] 10.244.0.7:57098 - 36475 "AAAA IN registry.kube-system.svc.cluster.local.us-east-2.compute.internal. udp 83 false 512" NXDOMAIN qr,rd,ra 83 0.001797183s
	[INFO] 10.244.0.7:57098 - 30837 "A IN registry.kube-system.svc.cluster.local.us-east-2.compute.internal. udp 83 false 512" NXDOMAIN qr,rd,ra 83 0.00173133s
	[INFO] 10.244.0.7:56652 - 15945 "AAAA IN registry.kube-system.svc.cluster.local. udp 56 false 512" NOERROR qr,aa,rd 149 0.00011217s
	[INFO] 10.244.0.7:56652 - 47183 "A IN registry.kube-system.svc.cluster.local. udp 56 false 512" NOERROR qr,aa,rd 110 0.000086595s
	[INFO] 10.244.0.24:36797 - 41945 "AAAA IN storage.googleapis.com.gcp-auth.svc.cluster.local. udp 78 false 1232" NXDOMAIN qr,aa,rd 160 0.000172574s
	[INFO] 10.244.0.24:37874 - 1142 "A IN storage.googleapis.com.gcp-auth.svc.cluster.local. udp 78 false 1232" NXDOMAIN qr,aa,rd 160 0.000153744s
	[INFO] 10.244.0.24:48038 - 33251 "AAAA IN storage.googleapis.com.svc.cluster.local. udp 69 false 1232" NXDOMAIN qr,aa,rd 151 0.00010097s
	[INFO] 10.244.0.24:50578 - 48683 "A IN storage.googleapis.com.svc.cluster.local. udp 69 false 1232" NXDOMAIN qr,aa,rd 151 0.000112285s
	[INFO] 10.244.0.24:41830 - 19101 "AAAA IN storage.googleapis.com.cluster.local. udp 65 false 1232" NXDOMAIN qr,aa,rd 147 0.000114295s
	[INFO] 10.244.0.24:52405 - 28587 "A IN storage.googleapis.com.cluster.local. udp 65 false 1232" NXDOMAIN qr,aa,rd 147 0.000094357s
	[INFO] 10.244.0.24:53860 - 11760 "A IN storage.googleapis.com.us-east-2.compute.internal. udp 78 false 1232" NXDOMAIN qr,rd,ra 67 0.003109464s
	[INFO] 10.244.0.24:53328 - 46904 "AAAA IN storage.googleapis.com.us-east-2.compute.internal. udp 78 false 1232" NXDOMAIN qr,rd,ra 67 0.004310756s
	[INFO] 10.244.0.24:41830 - 29125 "A IN storage.googleapis.com. udp 51 false 1232" NOERROR qr,rd,ra 534 0.001102037s
	[INFO] 10.244.0.24:44679 - 64001 "AAAA IN storage.googleapis.com. udp 51 false 1232" NOERROR qr,rd,ra 240 0.000854822s
	
	
	==> describe nodes <==
	Name:               addons-673965
	Roles:              control-plane
	Labels:             beta.kubernetes.io/arch=arm64
	                    beta.kubernetes.io/os=linux
	                    kubernetes.io/arch=arm64
	                    kubernetes.io/hostname=addons-673965
	                    kubernetes.io/os=linux
	                    minikube.k8s.io/commit=799e8a7dafc4266c6fcf08e799ac850effb94bc5
	                    minikube.k8s.io/name=addons-673965
	                    minikube.k8s.io/primary=true
	                    minikube.k8s.io/updated_at=2024_08_12T12_22_49_0700
	                    minikube.k8s.io/version=v1.33.1
	                    node-role.kubernetes.io/control-plane=
	                    node.kubernetes.io/exclude-from-external-load-balancers=
	                    topology.hostpath.csi/node=addons-673965
	Annotations:        csi.volume.kubernetes.io/nodeid: {"hostpath.csi.k8s.io":"addons-673965"}
	                    kubeadm.alpha.kubernetes.io/cri-socket: unix:///run/containerd/containerd.sock
	                    node.alpha.kubernetes.io/ttl: 0
	                    volumes.kubernetes.io/controller-managed-attach-detach: true
	CreationTimestamp:  Mon, 12 Aug 2024 12:22:46 +0000
	Taints:             <none>
	Unschedulable:      false
	Lease:
	  HolderIdentity:  addons-673965
	  AcquireTime:     <unset>
	  RenewTime:       Mon, 12 Aug 2024 12:27:55 +0000
	Conditions:
	  Type             Status  LastHeartbeatTime                 LastTransitionTime                Reason                       Message
	  ----             ------  -----------------                 ------------------                ------                       -------
	  MemoryPressure   False   Mon, 12 Aug 2024 12:24:51 +0000   Mon, 12 Aug 2024 12:22:42 +0000   KubeletHasSufficientMemory   kubelet has sufficient memory available
	  DiskPressure     False   Mon, 12 Aug 2024 12:24:51 +0000   Mon, 12 Aug 2024 12:22:42 +0000   KubeletHasNoDiskPressure     kubelet has no disk pressure
	  PIDPressure      False   Mon, 12 Aug 2024 12:24:51 +0000   Mon, 12 Aug 2024 12:22:42 +0000   KubeletHasSufficientPID      kubelet has sufficient PID available
	  Ready            True    Mon, 12 Aug 2024 12:24:51 +0000   Mon, 12 Aug 2024 12:22:59 +0000   KubeletReady                 kubelet is posting ready status
	Addresses:
	  InternalIP:  192.168.49.2
	  Hostname:    addons-673965
	Capacity:
	  cpu:                2
	  ephemeral-storage:  203034800Ki
	  hugepages-1Gi:      0
	  hugepages-2Mi:      0
	  hugepages-32Mi:     0
	  hugepages-64Ki:     0
	  memory:             8022360Ki
	  pods:               110
	Allocatable:
	  cpu:                2
	  ephemeral-storage:  203034800Ki
	  hugepages-1Gi:      0
	  hugepages-2Mi:      0
	  hugepages-32Mi:     0
	  hugepages-64Ki:     0
	  memory:             8022360Ki
	  pods:               110
	System Info:
	  Machine ID:                 9c1259217e0b4de08f95e8feba2f95b5
	  System UUID:                bea1a0a8-3a9d-4d2e-9707-f2a481945fab
	  Boot ID:                    dd4d5961-e962-479e-810d-640f3b509a00
	  Kernel Version:             5.15.0-1066-aws
	  OS Image:                   Ubuntu 22.04.4 LTS
	  Operating System:           linux
	  Architecture:               arm64
	  Container Runtime Version:  containerd://1.7.19
	  Kubelet Version:            v1.30.3
	  Kube-Proxy Version:         v1.30.3
	PodCIDR:                      10.244.0.0/24
	PodCIDRs:                     10.244.0.0/24
	Non-terminated Pods:          (27 in total)
	  Namespace                   Name                                         CPU Requests  CPU Limits  Memory Requests  Memory Limits  Age
	  ---------                   ----                                         ------------  ----------  ---------------  -------------  ---
	  default                     cloud-spanner-emulator-5455fb9b69-m6p8s      0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         4m56s
	  gadget                      gadget-gdbxz                                 0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         4m51s
	  gcp-auth                    gcp-auth-5db96cd9b4-m27cv                    0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         3m23s
	  ingress-nginx               ingress-nginx-controller-6d9bd977d4-w8fjj    100m (5%!)(MISSING)     0 (0%!)(MISSING)      90Mi (1%!)(MISSING)        0 (0%!)(MISSING)         4m51s
	  kube-system                 coredns-7db6d8ff4d-jwvvn                     100m (5%!)(MISSING)     0 (0%!)(MISSING)      70Mi (0%!)(MISSING)        170Mi (2%!)(MISSING)     4m59s
	  kube-system                 csi-hostpath-attacher-0                      0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         4m47s
	  kube-system                 csi-hostpath-resizer-0                       0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         4m47s
	  kube-system                 csi-hostpathplugin-7glsf                     0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         4m47s
	  kube-system                 etcd-addons-673965                           100m (5%!)(MISSING)     0 (0%!)(MISSING)      100Mi (1%!)(MISSING)       0 (0%!)(MISSING)         5m14s
	  kube-system                 kindnet-k49nh                                100m (5%!)(MISSING)     100m (5%!)(MISSING)   50Mi (0%!)(MISSING)        50Mi (0%!)(MISSING)      5m
	  kube-system                 kube-apiserver-addons-673965                 250m (12%!)(MISSING)    0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         5m13s
	  kube-system                 kube-controller-manager-addons-673965        200m (10%!)(MISSING)    0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         5m15s
	  kube-system                 kube-ingress-dns-minikube                    0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         4m54s
	  kube-system                 kube-proxy-5fl7x                             0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         5m
	  kube-system                 kube-scheduler-addons-673965                 100m (5%!)(MISSING)     0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         5m13s
	  kube-system                 metrics-server-c59844bb4-cwgnw               100m (5%!)(MISSING)     0 (0%!)(MISSING)      200Mi (2%!)(MISSING)       0 (0%!)(MISSING)         4m52s
	  kube-system                 nvidia-device-plugin-daemonset-cnjct         0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         4m56s
	  kube-system                 registry-698f998955-rp6t5                    0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         4m54s
	  kube-system                 registry-proxy-ffzv5                         0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         4m54s
	  kube-system                 snapshot-controller-745499f584-cb8vt         0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         4m51s
	  kube-system                 snapshot-controller-745499f584-sjdvb         0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         4m51s
	  kube-system                 storage-provisioner                          0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         4m54s
	  local-path-storage          local-path-provisioner-8d985888d-cfpf6       0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         4m53s
	  volcano-system              volcano-admission-5f7844f7bc-mbs4n           0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         4m49s
	  volcano-system              volcano-controllers-59cb4746db-dfflb         0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         4m49s
	  volcano-system              volcano-scheduler-844f6db89b-m47g4           0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         4m48s
	  yakd-dashboard              yakd-dashboard-799879c74f-zqdcx              0 (0%!)(MISSING)        0 (0%!)(MISSING)      128Mi (1%!)(MISSING)       256Mi (3%!)(MISSING)     4m53s
	Allocated resources:
	  (Total limits may be over 100 percent, i.e., overcommitted.)
	  Resource           Requests     Limits
	  --------           --------     ------
	  cpu                1050m (52%!)(MISSING)  100m (5%!)(MISSING)
	  memory             638Mi (8%!)(MISSING)   476Mi (6%!)(MISSING)
	  ephemeral-storage  0 (0%!)(MISSING)       0 (0%!)(MISSING)
	  hugepages-1Gi      0 (0%!)(MISSING)       0 (0%!)(MISSING)
	  hugepages-2Mi      0 (0%!)(MISSING)       0 (0%!)(MISSING)
	  hugepages-32Mi     0 (0%!)(MISSING)       0 (0%!)(MISSING)
	  hugepages-64Ki     0 (0%!)(MISSING)       0 (0%!)(MISSING)
	Events:
	  Type    Reason                   Age                    From             Message
	  ----    ------                   ----                   ----             -------
	  Normal  Starting                 4m58s                  kube-proxy       
	  Normal  NodeHasSufficientMemory  5m21s (x8 over 5m21s)  kubelet          Node addons-673965 status is now: NodeHasSufficientMemory
	  Normal  NodeHasNoDiskPressure    5m21s (x8 over 5m21s)  kubelet          Node addons-673965 status is now: NodeHasNoDiskPressure
	  Normal  NodeHasSufficientPID     5m21s (x7 over 5m21s)  kubelet          Node addons-673965 status is now: NodeHasSufficientPID
	  Normal  NodeAllocatableEnforced  5m21s                  kubelet          Updated Node Allocatable limit across pods
	  Normal  NodeHasSufficientMemory  5m14s                  kubelet          Node addons-673965 status is now: NodeHasSufficientMemory
	  Normal  NodeHasNoDiskPressure    5m14s                  kubelet          Node addons-673965 status is now: NodeHasNoDiskPressure
	  Normal  NodeHasSufficientPID     5m14s                  kubelet          Node addons-673965 status is now: NodeHasSufficientPID
	  Normal  NodeNotReady             5m14s                  kubelet          Node addons-673965 status is now: NodeNotReady
	  Normal  Starting                 5m14s                  kubelet          Starting kubelet.
	  Normal  NodeAllocatableEnforced  5m13s                  kubelet          Updated Node Allocatable limit across pods
	  Normal  NodeReady                5m3s                   kubelet          Node addons-673965 status is now: NodeReady
	  Normal  RegisteredNode           5m                     node-controller  Node addons-673965 event: Registered Node addons-673965 in Controller
	
	
	==> dmesg <==
	[  +0.003798] FS-Cache: Duplicate cookie detected
	[  +0.000725] FS-Cache: O-cookie c=0000002a [p=00000027 fl=226 nc=0 na=1]
	[  +0.001009] FS-Cache: O-cookie d=0000000036654dfe{9p.inode} n=000000000c6cc24e
	[  +0.001024] FS-Cache: O-key=[8] 'bf70ed0000000000'
	[  +0.000694] FS-Cache: N-cookie c=00000031 [p=00000027 fl=2 nc=0 na=1]
	[  +0.000912] FS-Cache: N-cookie d=0000000036654dfe{9p.inode} n=000000003708f28c
	[  +0.001022] FS-Cache: N-key=[8] 'bf70ed0000000000'
	[  +2.538085] FS-Cache: Duplicate cookie detected
	[  +0.000679] FS-Cache: O-cookie c=00000029 [p=00000027 fl=226 nc=0 na=1]
	[  +0.000892] FS-Cache: O-cookie d=0000000036654dfe{9p.inode} n=0000000005d14a34
	[  +0.000996] FS-Cache: O-key=[8] 'be70ed0000000000'
	[  +0.000666] FS-Cache: N-cookie c=00000033 [p=00000027 fl=2 nc=0 na=1]
	[  +0.000862] FS-Cache: N-cookie d=0000000036654dfe{9p.inode} n=0000000083a27e5b
	[  +0.000984] FS-Cache: N-key=[8] 'be70ed0000000000'
	[  +0.325835] FS-Cache: Duplicate cookie detected
	[  +0.000656] FS-Cache: O-cookie c=0000002d [p=00000027 fl=226 nc=0 na=1]
	[  +0.000892] FS-Cache: O-cookie d=0000000036654dfe{9p.inode} n=000000005a230564
	[  +0.000981] FS-Cache: O-key=[8] 'c470ed0000000000'
	[  +0.000707] FS-Cache: N-cookie c=00000034 [p=00000027 fl=2 nc=0 na=1]
	[  +0.000873] FS-Cache: N-cookie d=0000000036654dfe{9p.inode} n=000000006fcf5116
	[  +0.000984] FS-Cache: N-key=[8] 'c470ed0000000000'
	[Aug12 11:55] overlayfs: '/var/lib/docker/overlay2/l/WCSESTVH3U25P3IZ5LAJCY2BWZ' not a directory
	[  +0.003698] overlayfs: '/var/lib/docker/overlay2/l/WCSESTVH3U25P3IZ5LAJCY2BWZ' not a directory
	[  +0.011077] overlayfs: '/var/lib/docker/overlay2/l/WCSESTVH3U25P3IZ5LAJCY2BWZ' not a directory
	[  +0.013960] overlayfs: '/var/lib/docker/overlay2/l/WCSESTVH3U25P3IZ5LAJCY2BWZ' not a directory
	
	
	==> etcd [b98eafc77f9ce80696c964b07ffe51f405ab5a01f8f32593c831195059a607f9] <==
	{"level":"info","ts":"2024-08-12T12:22:42.478337Z","caller":"membership/cluster.go:421","msg":"added member","cluster-id":"fa54960ea34d58be","local-member-id":"aec36adc501070cc","added-peer-id":"aec36adc501070cc","added-peer-peer-urls":["https://192.168.49.2:2380"]}
	{"level":"info","ts":"2024-08-12T12:22:42.477489Z","caller":"etcdserver/server.go:744","msg":"started as single-node; fast-forwarding election ticks","local-member-id":"aec36adc501070cc","forward-ticks":9,"forward-duration":"900ms","election-ticks":10,"election-timeout":"1s"}
	{"level":"info","ts":"2024-08-12T12:22:42.490379Z","caller":"embed/etcd.go:726","msg":"starting with client TLS","tls-info":"cert = /var/lib/minikube/certs/etcd/server.crt, key = /var/lib/minikube/certs/etcd/server.key, client-cert=, client-key=, trusted-ca = /var/lib/minikube/certs/etcd/ca.crt, client-cert-auth = true, crl-file = ","cipher-suites":[]}
	{"level":"info","ts":"2024-08-12T12:22:42.490505Z","caller":"embed/etcd.go:597","msg":"serving peer traffic","address":"192.168.49.2:2380"}
	{"level":"info","ts":"2024-08-12T12:22:42.495476Z","caller":"embed/etcd.go:569","msg":"cmux::serve","address":"192.168.49.2:2380"}
	{"level":"info","ts":"2024-08-12T12:22:42.496716Z","caller":"embed/etcd.go:277","msg":"now serving peer/client/metrics","local-member-id":"aec36adc501070cc","initial-advertise-peer-urls":["https://192.168.49.2:2380"],"listen-peer-urls":["https://192.168.49.2:2380"],"advertise-client-urls":["https://192.168.49.2:2379"],"listen-client-urls":["https://127.0.0.1:2379","https://192.168.49.2:2379"],"listen-metrics-urls":["http://127.0.0.1:2381"]}
	{"level":"info","ts":"2024-08-12T12:22:42.496961Z","caller":"embed/etcd.go:857","msg":"serving metrics","address":"http://127.0.0.1:2381"}
	{"level":"info","ts":"2024-08-12T12:22:43.145267Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"aec36adc501070cc is starting a new election at term 1"}
	{"level":"info","ts":"2024-08-12T12:22:43.145471Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"aec36adc501070cc became pre-candidate at term 1"}
	{"level":"info","ts":"2024-08-12T12:22:43.145586Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"aec36adc501070cc received MsgPreVoteResp from aec36adc501070cc at term 1"}
	{"level":"info","ts":"2024-08-12T12:22:43.145683Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"aec36adc501070cc became candidate at term 2"}
	{"level":"info","ts":"2024-08-12T12:22:43.145769Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"aec36adc501070cc received MsgVoteResp from aec36adc501070cc at term 2"}
	{"level":"info","ts":"2024-08-12T12:22:43.145854Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"aec36adc501070cc became leader at term 2"}
	{"level":"info","ts":"2024-08-12T12:22:43.145936Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"raft.node: aec36adc501070cc elected leader aec36adc501070cc at term 2"}
	{"level":"info","ts":"2024-08-12T12:22:43.149438Z","caller":"etcdserver/server.go:2068","msg":"published local member to cluster through raft","local-member-id":"aec36adc501070cc","local-member-attributes":"{Name:addons-673965 ClientURLs:[https://192.168.49.2:2379]}","request-path":"/0/members/aec36adc501070cc/attributes","cluster-id":"fa54960ea34d58be","publish-timeout":"7s"}
	{"level":"info","ts":"2024-08-12T12:22:43.149606Z","caller":"embed/serve.go:103","msg":"ready to serve client requests"}
	{"level":"info","ts":"2024-08-12T12:22:43.149954Z","caller":"etcdserver/server.go:2578","msg":"setting up initial cluster version using v2 API","cluster-version":"3.5"}
	{"level":"info","ts":"2024-08-12T12:22:43.150134Z","caller":"embed/serve.go:103","msg":"ready to serve client requests"}
	{"level":"info","ts":"2024-08-12T12:22:43.1518Z","caller":"embed/serve.go:250","msg":"serving client traffic securely","traffic":"grpc+http","address":"127.0.0.1:2379"}
	{"level":"info","ts":"2024-08-12T12:22:43.152221Z","caller":"etcdmain/main.go:44","msg":"notifying init daemon"}
	{"level":"info","ts":"2024-08-12T12:22:43.165725Z","caller":"etcdmain/main.go:50","msg":"successfully notified init daemon"}
	{"level":"info","ts":"2024-08-12T12:22:43.152287Z","caller":"membership/cluster.go:584","msg":"set initial cluster version","cluster-id":"fa54960ea34d58be","local-member-id":"aec36adc501070cc","cluster-version":"3.5"}
	{"level":"info","ts":"2024-08-12T12:22:43.170609Z","caller":"api/capability.go:75","msg":"enabled capabilities for version","cluster-version":"3.5"}
	{"level":"info","ts":"2024-08-12T12:22:43.293296Z","caller":"etcdserver/server.go:2602","msg":"cluster version is updated","cluster-version":"3.5"}
	{"level":"info","ts":"2024-08-12T12:22:43.171057Z","caller":"embed/serve.go:250","msg":"serving client traffic securely","traffic":"grpc+http","address":"192.168.49.2:2379"}
	
	
	==> gcp-auth [57798c5192028bc7fafc0c32f77adf9a696f34b37baf31d11ea2ef201004a817] <==
	2024/08/12 12:24:41 GCP Auth Webhook started!
	2024/08/12 12:24:59 Ready to marshal response ...
	2024/08/12 12:24:59 Ready to write response ...
	2024/08/12 12:25:00 Ready to marshal response ...
	2024/08/12 12:25:00 Ready to write response ...
	
	
	==> kernel <==
	 12:28:03 up  4:10,  0 users,  load average: 0.25, 1.16, 2.37
	Linux addons-673965 5.15.0-1066-aws #72~20.04.1-Ubuntu SMP Sat Jul 20 07:44:07 UTC 2024 aarch64 aarch64 aarch64 GNU/Linux
	PRETTY_NAME="Ubuntu 22.04.4 LTS"
	
	
	==> kindnet [c98790721f0b72d570b6551d2d2ae12f7a3ce0c51a88191e48bc4976cb3cdb26] <==
	I0812 12:26:36.863655       1 main.go:299] handling current node
	I0812 12:26:46.863733       1 main.go:295] Handling node with IPs: map[192.168.49.2:{}]
	I0812 12:26:46.863769       1 main.go:299] handling current node
	I0812 12:26:56.863341       1 main.go:295] Handling node with IPs: map[192.168.49.2:{}]
	I0812 12:26:56.863380       1 main.go:299] handling current node
	I0812 12:27:06.863798       1 main.go:295] Handling node with IPs: map[192.168.49.2:{}]
	I0812 12:27:06.863833       1 main.go:299] handling current node
	I0812 12:27:16.863500       1 main.go:295] Handling node with IPs: map[192.168.49.2:{}]
	I0812 12:27:16.863537       1 main.go:299] handling current node
	W0812 12:27:18.818503       1 reflector.go:547] pkg/mod/k8s.io/client-go@v0.30.3/tools/cache/reflector.go:232: failed to list *v1.NetworkPolicy: networkpolicies.networking.k8s.io is forbidden: User "system:serviceaccount:kube-system:kindnet" cannot list resource "networkpolicies" in API group "networking.k8s.io" at the cluster scope
	E0812 12:27:18.818556       1 reflector.go:150] pkg/mod/k8s.io/client-go@v0.30.3/tools/cache/reflector.go:232: Failed to watch *v1.NetworkPolicy: failed to list *v1.NetworkPolicy: networkpolicies.networking.k8s.io is forbidden: User "system:serviceaccount:kube-system:kindnet" cannot list resource "networkpolicies" in API group "networking.k8s.io" at the cluster scope
	W0812 12:27:26.498929       1 reflector.go:547] pkg/mod/k8s.io/client-go@v0.30.3/tools/cache/reflector.go:232: failed to list *v1.Pod: pods is forbidden: User "system:serviceaccount:kube-system:kindnet" cannot list resource "pods" in API group "" at the cluster scope
	E0812 12:27:26.498973       1 reflector.go:150] pkg/mod/k8s.io/client-go@v0.30.3/tools/cache/reflector.go:232: Failed to watch *v1.Pod: failed to list *v1.Pod: pods is forbidden: User "system:serviceaccount:kube-system:kindnet" cannot list resource "pods" in API group "" at the cluster scope
	I0812 12:27:26.863048       1 main.go:295] Handling node with IPs: map[192.168.49.2:{}]
	I0812 12:27:26.863093       1 main.go:299] handling current node
	W0812 12:27:28.033532       1 reflector.go:547] pkg/mod/k8s.io/client-go@v0.30.3/tools/cache/reflector.go:232: failed to list *v1.Namespace: namespaces is forbidden: User "system:serviceaccount:kube-system:kindnet" cannot list resource "namespaces" in API group "" at the cluster scope
	E0812 12:27:28.033747       1 reflector.go:150] pkg/mod/k8s.io/client-go@v0.30.3/tools/cache/reflector.go:232: Failed to watch *v1.Namespace: failed to list *v1.Namespace: namespaces is forbidden: User "system:serviceaccount:kube-system:kindnet" cannot list resource "namespaces" in API group "" at the cluster scope
	I0812 12:27:36.862993       1 main.go:295] Handling node with IPs: map[192.168.49.2:{}]
	I0812 12:27:36.863033       1 main.go:299] handling current node
	I0812 12:27:46.863537       1 main.go:295] Handling node with IPs: map[192.168.49.2:{}]
	I0812 12:27:46.863574       1 main.go:299] handling current node
	I0812 12:27:56.863328       1 main.go:295] Handling node with IPs: map[192.168.49.2:{}]
	I0812 12:27:56.863364       1 main.go:299] handling current node
	W0812 12:28:01.930403       1 reflector.go:547] pkg/mod/k8s.io/client-go@v0.30.3/tools/cache/reflector.go:232: failed to list *v1.NetworkPolicy: networkpolicies.networking.k8s.io is forbidden: User "system:serviceaccount:kube-system:kindnet" cannot list resource "networkpolicies" in API group "networking.k8s.io" at the cluster scope
	E0812 12:28:01.930442       1 reflector.go:150] pkg/mod/k8s.io/client-go@v0.30.3/tools/cache/reflector.go:232: Failed to watch *v1.NetworkPolicy: failed to list *v1.NetworkPolicy: networkpolicies.networking.k8s.io is forbidden: User "system:serviceaccount:kube-system:kindnet" cannot list resource "networkpolicies" in API group "networking.k8s.io" at the cluster scope
	
	
	==> kube-apiserver [23442c5b28f7bb5b450b24c3e5eb4e48a1e7cc426791b3ceb05ae3e2dc2bfdb3] <==
	W0812 12:23:47.617922       1 dispatcher.go:225] Failed calling webhook, failing closed mutatepod.volcano.sh: failed calling webhook "mutatepod.volcano.sh": failed to call webhook: Post "https://volcano-admission-service.volcano-system.svc:443/pods/mutate?timeout=10s": dial tcp 10.103.208.164:443: connect: connection refused
	E0812 12:23:49.542233       1 available_controller.go:460] v1beta1.metrics.k8s.io failed with: failing or missing response from https://10.98.41.110:443/apis/metrics.k8s.io/v1beta1: Get "https://10.98.41.110:443/apis/metrics.k8s.io/v1beta1": dial tcp 10.98.41.110:443: connect: connection refused
	W0812 12:23:49.548869       1 handler_proxy.go:93] no RequestInfo found in the context
	E0812 12:23:49.551854       1 controller.go:146] Error updating APIService "v1beta1.metrics.k8s.io" with err: failed to download v1beta1.metrics.k8s.io: failed to retrieve openAPI spec, http error: ResponseCode: 503, Body: service unavailable
	, Header: map[Content-Type:[text/plain; charset=utf-8] X-Content-Type-Options:[nosniff]]
	I0812 12:23:49.665752       1 handler.go:286] Adding GroupVersion metrics.k8s.io v1beta1 to ResourceManager
	W0812 12:23:56.842103       1 dispatcher.go:225] Failed calling webhook, failing closed mutatequeue.volcano.sh: failed calling webhook "mutatequeue.volcano.sh": failed to call webhook: Post "https://volcano-admission-service.volcano-system.svc:443/queues/mutate?timeout=10s": dial tcp 10.103.208.164:443: connect: connection refused
	W0812 12:23:57.869725       1 dispatcher.go:225] Failed calling webhook, failing closed mutatequeue.volcano.sh: failed calling webhook "mutatequeue.volcano.sh": failed to call webhook: Post "https://volcano-admission-service.volcano-system.svc:443/queues/mutate?timeout=10s": dial tcp 10.103.208.164:443: connect: connection refused
	W0812 12:23:58.581199       1 dispatcher.go:210] Failed calling webhook, failing open gcp-auth-mutate.k8s.io: failed calling webhook "gcp-auth-mutate.k8s.io": failed to call webhook: Post "https://gcp-auth.gcp-auth.svc:443/mutate?timeout=10s": dial tcp 10.98.68.43:443: connect: connection refused
	E0812 12:23:58.581280       1 dispatcher.go:214] failed calling webhook "gcp-auth-mutate.k8s.io": failed to call webhook: Post "https://gcp-auth.gcp-auth.svc:443/mutate?timeout=10s": dial tcp 10.98.68.43:443: connect: connection refused
	W0812 12:23:58.581733       1 dispatcher.go:225] Failed calling webhook, failing closed mutatepod.volcano.sh: failed calling webhook "mutatepod.volcano.sh": failed to call webhook: Post "https://volcano-admission-service.volcano-system.svc:443/pods/mutate?timeout=10s": dial tcp 10.103.208.164:443: connect: connection refused
	W0812 12:23:58.916321       1 dispatcher.go:225] Failed calling webhook, failing closed mutatequeue.volcano.sh: failed calling webhook "mutatequeue.volcano.sh": failed to call webhook: Post "https://volcano-admission-service.volcano-system.svc:443/queues/mutate?timeout=10s": dial tcp 10.103.208.164:443: connect: connection refused
	W0812 12:23:59.988226       1 dispatcher.go:225] Failed calling webhook, failing closed mutatequeue.volcano.sh: failed calling webhook "mutatequeue.volcano.sh": failed to call webhook: Post "https://volcano-admission-service.volcano-system.svc:443/queues/mutate?timeout=10s": dial tcp 10.103.208.164:443: connect: connection refused
	W0812 12:24:01.040786       1 dispatcher.go:225] Failed calling webhook, failing closed mutatequeue.volcano.sh: failed calling webhook "mutatequeue.volcano.sh": failed to call webhook: Post "https://volcano-admission-service.volcano-system.svc:443/queues/mutate?timeout=10s": dial tcp 10.103.208.164:443: connect: connection refused
	W0812 12:24:02.124377       1 dispatcher.go:225] Failed calling webhook, failing closed mutatequeue.volcano.sh: failed calling webhook "mutatequeue.volcano.sh": failed to call webhook: Post "https://volcano-admission-service.volcano-system.svc:443/queues/mutate?timeout=10s": dial tcp 10.103.208.164:443: connect: connection refused
	W0812 12:24:03.210337       1 dispatcher.go:225] Failed calling webhook, failing closed mutatequeue.volcano.sh: failed calling webhook "mutatequeue.volcano.sh": failed to call webhook: Post "https://volcano-admission-service.volcano-system.svc:443/queues/mutate?timeout=10s": dial tcp 10.103.208.164:443: connect: connection refused
	W0812 12:24:04.232842       1 dispatcher.go:225] Failed calling webhook, failing closed mutatequeue.volcano.sh: failed calling webhook "mutatequeue.volcano.sh": failed to call webhook: Post "https://volcano-admission-service.volcano-system.svc:443/queues/mutate?timeout=10s": dial tcp 10.103.208.164:443: connect: connection refused
	W0812 12:24:19.567113       1 dispatcher.go:210] Failed calling webhook, failing open gcp-auth-mutate.k8s.io: failed calling webhook "gcp-auth-mutate.k8s.io": failed to call webhook: Post "https://gcp-auth.gcp-auth.svc:443/mutate?timeout=10s": dial tcp 10.98.68.43:443: connect: connection refused
	E0812 12:24:19.567149       1 dispatcher.go:214] failed calling webhook "gcp-auth-mutate.k8s.io": failed to call webhook: Post "https://gcp-auth.gcp-auth.svc:443/mutate?timeout=10s": dial tcp 10.98.68.43:443: connect: connection refused
	W0812 12:24:19.635839       1 dispatcher.go:210] Failed calling webhook, failing open gcp-auth-mutate.k8s.io: failed calling webhook "gcp-auth-mutate.k8s.io": failed to call webhook: Post "https://gcp-auth.gcp-auth.svc:443/mutate?timeout=10s": dial tcp 10.98.68.43:443: connect: connection refused
	E0812 12:24:19.635877       1 dispatcher.go:214] failed calling webhook "gcp-auth-mutate.k8s.io": failed to call webhook: Post "https://gcp-auth.gcp-auth.svc:443/mutate?timeout=10s": dial tcp 10.98.68.43:443: connect: connection refused
	W0812 12:24:39.545662       1 dispatcher.go:210] Failed calling webhook, failing open gcp-auth-mutate.k8s.io: failed calling webhook "gcp-auth-mutate.k8s.io": failed to call webhook: Post "https://gcp-auth.gcp-auth.svc:443/mutate?timeout=10s": dial tcp 10.98.68.43:443: connect: connection refused
	E0812 12:24:39.545702       1 dispatcher.go:214] failed calling webhook "gcp-auth-mutate.k8s.io": failed to call webhook: Post "https://gcp-auth.gcp-auth.svc:443/mutate?timeout=10s": dial tcp 10.98.68.43:443: connect: connection refused
	I0812 12:24:59.966033       1 controller.go:615] quota admission added evaluator for: jobs.batch.volcano.sh
	I0812 12:25:00.076855       1 controller.go:615] quota admission added evaluator for: podgroups.scheduling.volcano.sh
	
	
	==> kube-controller-manager [8c6aff5a13e170a2f8e00caa82a0ff4a17cea602376715805722096ac80f1fe2] <==
	I0812 12:24:21.754842       1 job_controller.go:566] "enqueueing job" logger="job-controller" key="gcp-auth/gcp-auth-certs-patch"
	I0812 12:24:22.050091       1 job_controller.go:566] "enqueueing job" logger="job-controller" key="gcp-auth/gcp-auth-certs-create"
	I0812 12:24:22.770108       1 replica_set.go:676] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="ingress-nginx/ingress-nginx-controller-6d9bd977d4" duration="73.557µs"
	I0812 12:24:22.800737       1 job_controller.go:566] "enqueueing job" logger="job-controller" key="gcp-auth/gcp-auth-certs-create"
	I0812 12:24:22.865264       1 job_controller.go:566] "enqueueing job" logger="job-controller" key="gcp-auth/gcp-auth-certs-patch"
	I0812 12:24:23.057207       1 job_controller.go:566] "enqueueing job" logger="job-controller" key="gcp-auth/gcp-auth-certs-create"
	I0812 12:24:23.065130       1 job_controller.go:566] "enqueueing job" logger="job-controller" key="gcp-auth/gcp-auth-certs-create"
	I0812 12:24:23.072732       1 job_controller.go:566] "enqueueing job" logger="job-controller" key="gcp-auth/gcp-auth-certs-create"
	I0812 12:24:23.762196       1 job_controller.go:566] "enqueueing job" logger="job-controller" key="gcp-auth/gcp-auth-certs-patch"
	I0812 12:24:23.871308       1 job_controller.go:566] "enqueueing job" logger="job-controller" key="gcp-auth/gcp-auth-certs-patch"
	I0812 12:24:23.879159       1 job_controller.go:566] "enqueueing job" logger="job-controller" key="gcp-auth/gcp-auth-certs-patch"
	I0812 12:24:23.886459       1 job_controller.go:566] "enqueueing job" logger="job-controller" key="gcp-auth/gcp-auth-certs-patch"
	I0812 12:24:36.185561       1 replica_set.go:676] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="ingress-nginx/ingress-nginx-controller-6d9bd977d4" duration="15.525296ms"
	I0812 12:24:36.185886       1 replica_set.go:676] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="ingress-nginx/ingress-nginx-controller-6d9bd977d4" duration="90.607µs"
	I0812 12:24:39.562289       1 replica_set.go:676] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="gcp-auth/gcp-auth-5db96cd9b4" duration="19.272962ms"
	I0812 12:24:39.580759       1 replica_set.go:676] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="gcp-auth/gcp-auth-5db96cd9b4" duration="18.416639ms"
	I0812 12:24:39.602804       1 replica_set.go:676] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="gcp-auth/gcp-auth-5db96cd9b4" duration="21.960479ms"
	I0812 12:24:39.603047       1 replica_set.go:676] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="gcp-auth/gcp-auth-5db96cd9b4" duration="111.046µs"
	I0812 12:24:42.841300       1 replica_set.go:676] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="gcp-auth/gcp-auth-5db96cd9b4" duration="12.121332ms"
	I0812 12:24:42.841405       1 replica_set.go:676] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="gcp-auth/gcp-auth-5db96cd9b4" duration="53.382µs"
	I0812 12:24:53.023455       1 job_controller.go:566] "enqueueing job" logger="job-controller" key="gcp-auth/gcp-auth-certs-patch"
	I0812 12:24:53.027329       1 job_controller.go:566] "enqueueing job" logger="job-controller" key="gcp-auth/gcp-auth-certs-create"
	I0812 12:24:53.097734       1 job_controller.go:566] "enqueueing job" logger="job-controller" key="gcp-auth/gcp-auth-certs-create"
	I0812 12:24:53.098920       1 job_controller.go:566] "enqueueing job" logger="job-controller" key="gcp-auth/gcp-auth-certs-patch"
	I0812 12:24:59.714248       1 job_controller.go:566] "enqueueing job" logger="job-controller" key="volcano-system/volcano-admission-init"
	
	
	==> kube-proxy [987c946eb8d1f4877683391b59a34d5e7da2b8daa2661ced74c55204e5013c71] <==
	I0812 12:23:04.682733       1 server_linux.go:69] "Using iptables proxy"
	I0812 12:23:04.702944       1 server.go:1062] "Successfully retrieved node IP(s)" IPs=["192.168.49.2"]
	I0812 12:23:04.762192       1 server.go:659] "kube-proxy running in dual-stack mode" primary ipFamily="IPv4"
	I0812 12:23:04.762244       1 server_linux.go:165] "Using iptables Proxier"
	I0812 12:23:04.773453       1 server_linux.go:511] "Detect-local-mode set to ClusterCIDR, but no cluster CIDR for family" ipFamily="IPv6"
	I0812 12:23:04.773489       1 server_linux.go:528] "Defaulting to no-op detect-local"
	I0812 12:23:04.773518       1 proxier.go:243] "Setting route_localnet=1 to allow node-ports on localhost; to change this either disable iptables.localhostNodePorts (--iptables-localhost-nodeports) or set nodePortAddresses (--nodeport-addresses) to filter loopback addresses"
	I0812 12:23:04.803592       1 server.go:872] "Version info" version="v1.30.3"
	I0812 12:23:04.803628       1 server.go:874] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
	I0812 12:23:04.809575       1 config.go:192] "Starting service config controller"
	I0812 12:23:04.809595       1 shared_informer.go:313] Waiting for caches to sync for service config
	I0812 12:23:04.809615       1 config.go:101] "Starting endpoint slice config controller"
	I0812 12:23:04.809619       1 shared_informer.go:313] Waiting for caches to sync for endpoint slice config
	I0812 12:23:04.810088       1 config.go:319] "Starting node config controller"
	I0812 12:23:04.810096       1 shared_informer.go:313] Waiting for caches to sync for node config
	I0812 12:23:04.910531       1 shared_informer.go:320] Caches are synced for node config
	I0812 12:23:04.910576       1 shared_informer.go:320] Caches are synced for service config
	I0812 12:23:04.910611       1 shared_informer.go:320] Caches are synced for endpoint slice config
	
	
	==> kube-scheduler [54c2ff5ffd18881607de94922d45eb94f4fbd346f0d3aac35b054343bb220cfc] <==
	W0812 12:22:46.611097       1 reflector.go:547] k8s.io/client-go/informers/factory.go:160: failed to list *v1.Namespace: namespaces is forbidden: User "system:kube-scheduler" cannot list resource "namespaces" in API group "" at the cluster scope
	E0812 12:22:46.611123       1 reflector.go:150] k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.Namespace: failed to list *v1.Namespace: namespaces is forbidden: User "system:kube-scheduler" cannot list resource "namespaces" in API group "" at the cluster scope
	W0812 12:22:46.611334       1 reflector.go:547] k8s.io/client-go/informers/factory.go:160: failed to list *v1.ReplicationController: replicationcontrollers is forbidden: User "system:kube-scheduler" cannot list resource "replicationcontrollers" in API group "" at the cluster scope
	E0812 12:22:46.611608       1 reflector.go:150] k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.ReplicationController: failed to list *v1.ReplicationController: replicationcontrollers is forbidden: User "system:kube-scheduler" cannot list resource "replicationcontrollers" in API group "" at the cluster scope
	W0812 12:22:46.611391       1 reflector.go:547] k8s.io/client-go/informers/factory.go:160: failed to list *v1.PersistentVolume: persistentvolumes is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumes" in API group "" at the cluster scope
	E0812 12:22:46.611643       1 reflector.go:150] k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.PersistentVolume: failed to list *v1.PersistentVolume: persistentvolumes is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumes" in API group "" at the cluster scope
	W0812 12:22:46.611464       1 reflector.go:547] k8s.io/client-go/informers/factory.go:160: failed to list *v1.Pod: pods is forbidden: User "system:kube-scheduler" cannot list resource "pods" in API group "" at the cluster scope
	E0812 12:22:46.611662       1 reflector.go:150] k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.Pod: failed to list *v1.Pod: pods is forbidden: User "system:kube-scheduler" cannot list resource "pods" in API group "" at the cluster scope
	W0812 12:22:46.611533       1 reflector.go:547] k8s.io/client-go/informers/factory.go:160: failed to list *v1.Service: services is forbidden: User "system:kube-scheduler" cannot list resource "services" in API group "" at the cluster scope
	E0812 12:22:46.611696       1 reflector.go:150] k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.Service: failed to list *v1.Service: services is forbidden: User "system:kube-scheduler" cannot list resource "services" in API group "" at the cluster scope
	W0812 12:22:46.611570       1 reflector.go:547] k8s.io/client-go/informers/factory.go:160: failed to list *v1.Node: nodes is forbidden: User "system:kube-scheduler" cannot list resource "nodes" in API group "" at the cluster scope
	E0812 12:22:46.611714       1 reflector.go:150] k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.Node: failed to list *v1.Node: nodes is forbidden: User "system:kube-scheduler" cannot list resource "nodes" in API group "" at the cluster scope
	W0812 12:22:46.611791       1 reflector.go:547] k8s.io/client-go/informers/factory.go:160: failed to list *v1.PersistentVolumeClaim: persistentvolumeclaims is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumeclaims" in API group "" at the cluster scope
	E0812 12:22:46.611807       1 reflector.go:150] k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.PersistentVolumeClaim: failed to list *v1.PersistentVolumeClaim: persistentvolumeclaims is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumeclaims" in API group "" at the cluster scope
	W0812 12:22:46.611855       1 reflector.go:547] k8s.io/client-go/informers/factory.go:160: failed to list *v1.ReplicaSet: replicasets.apps is forbidden: User "system:kube-scheduler" cannot list resource "replicasets" in API group "apps" at the cluster scope
	E0812 12:22:46.611871       1 reflector.go:150] k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.ReplicaSet: failed to list *v1.ReplicaSet: replicasets.apps is forbidden: User "system:kube-scheduler" cannot list resource "replicasets" in API group "apps" at the cluster scope
	W0812 12:22:46.612985       1 reflector.go:547] runtime/asm_arm64.s:1222: failed to list *v1.ConfigMap: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot list resource "configmaps" in API group "" in the namespace "kube-system"
	E0812 12:22:46.613020       1 reflector.go:150] runtime/asm_arm64.s:1222: Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot list resource "configmaps" in API group "" in the namespace "kube-system"
	W0812 12:22:46.613072       1 reflector.go:547] k8s.io/client-go/informers/factory.go:160: failed to list *v1.CSINode: csinodes.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csinodes" in API group "storage.k8s.io" at the cluster scope
	E0812 12:22:46.613098       1 reflector.go:150] k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.CSINode: failed to list *v1.CSINode: csinodes.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csinodes" in API group "storage.k8s.io" at the cluster scope
	W0812 12:22:46.613904       1 reflector.go:547] k8s.io/client-go/informers/factory.go:160: failed to list *v1.StatefulSet: statefulsets.apps is forbidden: User "system:kube-scheduler" cannot list resource "statefulsets" in API group "apps" at the cluster scope
	E0812 12:22:46.613939       1 reflector.go:150] k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.StatefulSet: failed to list *v1.StatefulSet: statefulsets.apps is forbidden: User "system:kube-scheduler" cannot list resource "statefulsets" in API group "apps" at the cluster scope
	W0812 12:22:46.614371       1 reflector.go:547] k8s.io/client-go/informers/factory.go:160: failed to list *v1.PodDisruptionBudget: poddisruptionbudgets.policy is forbidden: User "system:kube-scheduler" cannot list resource "poddisruptionbudgets" in API group "policy" at the cluster scope
	E0812 12:22:46.614392       1 reflector.go:150] k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.PodDisruptionBudget: failed to list *v1.PodDisruptionBudget: poddisruptionbudgets.policy is forbidden: User "system:kube-scheduler" cannot list resource "poddisruptionbudgets" in API group "policy" at the cluster scope
	I0812 12:22:48.204522       1 shared_informer.go:320] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file
	
	
	==> kubelet <==
	Aug 12 12:26:11 addons-673965 kubelet[1542]: E0812 12:26:11.872859    1542 pod_workers.go:1298] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"gadget\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=gadget pod=gadget-gdbxz_gadget(e92bb787-a8ce-4879-97ad-a146759eb4a3)\"" pod="gadget/gadget-gdbxz" podUID="e92bb787-a8ce-4879-97ad-a146759eb4a3"
	Aug 12 12:26:26 addons-673965 kubelet[1542]: I0812 12:26:26.872534    1542 scope.go:117] "RemoveContainer" containerID="5d8d5496fc6f015fb2d7faa56f6f788e9a0258b21438083e49f6a9e143e25686"
	Aug 12 12:26:26 addons-673965 kubelet[1542]: E0812 12:26:26.873268    1542 pod_workers.go:1298] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"gadget\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=gadget pod=gadget-gdbxz_gadget(e92bb787-a8ce-4879-97ad-a146759eb4a3)\"" pod="gadget/gadget-gdbxz" podUID="e92bb787-a8ce-4879-97ad-a146759eb4a3"
	Aug 12 12:26:37 addons-673965 kubelet[1542]: I0812 12:26:37.872108    1542 scope.go:117] "RemoveContainer" containerID="5d8d5496fc6f015fb2d7faa56f6f788e9a0258b21438083e49f6a9e143e25686"
	Aug 12 12:26:39 addons-673965 kubelet[1542]: E0812 12:26:39.215318    1542 remote_runtime.go:496] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = failed to exec in container: failed to start exec \"9a03a48a498173de24062b57b86a76e443b71fac023dac8bbdfd60bcf92ab663\": OCI runtime exec failed: exec failed: cannot exec in a stopped container: unknown" containerID="82d72c1afda3a7904e6bc7318eff247cf5e215f2ec63fcee5481018ef3d8afcf" cmd=["/bin/gadgettracermanager","-liveness"]
	Aug 12 12:26:39 addons-673965 kubelet[1542]: E0812 12:26:39.226383    1542 remote_runtime.go:496] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = failed to exec in container: failed to start exec \"651ec56684572a26103ded8aa86faacf2b03757eb71ca13b0e1d0b445cb9d034\": OCI runtime exec failed: exec failed: cannot exec in a stopped container: unknown" containerID="82d72c1afda3a7904e6bc7318eff247cf5e215f2ec63fcee5481018ef3d8afcf" cmd=["/bin/gadgettracermanager","-liveness"]
	Aug 12 12:26:39 addons-673965 kubelet[1542]: E0812 12:26:39.239468    1542 remote_runtime.go:496] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = failed to exec in container: failed to start exec \"f50b1105552b17e48740a779a68f2ef3c5a2722c8c5bde401b21f3f40a7d8822\": OCI runtime exec failed: exec failed: cannot exec in a stopped container: unknown" containerID="82d72c1afda3a7904e6bc7318eff247cf5e215f2ec63fcee5481018ef3d8afcf" cmd=["/bin/gadgettracermanager","-liveness"]
	Aug 12 12:26:40 addons-673965 kubelet[1542]: I0812 12:26:40.186893    1542 scope.go:117] "RemoveContainer" containerID="5d8d5496fc6f015fb2d7faa56f6f788e9a0258b21438083e49f6a9e143e25686"
	Aug 12 12:26:40 addons-673965 kubelet[1542]: I0812 12:26:40.187367    1542 scope.go:117] "RemoveContainer" containerID="82d72c1afda3a7904e6bc7318eff247cf5e215f2ec63fcee5481018ef3d8afcf"
	Aug 12 12:26:40 addons-673965 kubelet[1542]: E0812 12:26:40.187913    1542 pod_workers.go:1298] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"gadget\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=gadget pod=gadget-gdbxz_gadget(e92bb787-a8ce-4879-97ad-a146759eb4a3)\"" pod="gadget/gadget-gdbxz" podUID="e92bb787-a8ce-4879-97ad-a146759eb4a3"
	Aug 12 12:26:42 addons-673965 kubelet[1542]: I0812 12:26:42.119127    1542 scope.go:117] "RemoveContainer" containerID="82d72c1afda3a7904e6bc7318eff247cf5e215f2ec63fcee5481018ef3d8afcf"
	Aug 12 12:26:42 addons-673965 kubelet[1542]: E0812 12:26:42.119851    1542 pod_workers.go:1298] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"gadget\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=gadget pod=gadget-gdbxz_gadget(e92bb787-a8ce-4879-97ad-a146759eb4a3)\"" pod="gadget/gadget-gdbxz" podUID="e92bb787-a8ce-4879-97ad-a146759eb4a3"
	Aug 12 12:26:53 addons-673965 kubelet[1542]: I0812 12:26:53.871744    1542 kubelet_pods.go:988] "Unable to retrieve pull secret, the image pull may not succeed." pod="kube-system/registry-698f998955-rp6t5" secret="" err="secret \"gcp-auth\" not found"
	Aug 12 12:26:56 addons-673965 kubelet[1542]: I0812 12:26:56.872925    1542 scope.go:117] "RemoveContainer" containerID="82d72c1afda3a7904e6bc7318eff247cf5e215f2ec63fcee5481018ef3d8afcf"
	Aug 12 12:26:56 addons-673965 kubelet[1542]: E0812 12:26:56.873476    1542 pod_workers.go:1298] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"gadget\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=gadget pod=gadget-gdbxz_gadget(e92bb787-a8ce-4879-97ad-a146759eb4a3)\"" pod="gadget/gadget-gdbxz" podUID="e92bb787-a8ce-4879-97ad-a146759eb4a3"
	Aug 12 12:27:06 addons-673965 kubelet[1542]: I0812 12:27:06.872254    1542 kubelet_pods.go:988] "Unable to retrieve pull secret, the image pull may not succeed." pod="kube-system/registry-proxy-ffzv5" secret="" err="secret \"gcp-auth\" not found"
	Aug 12 12:27:10 addons-673965 kubelet[1542]: I0812 12:27:10.872078    1542 scope.go:117] "RemoveContainer" containerID="82d72c1afda3a7904e6bc7318eff247cf5e215f2ec63fcee5481018ef3d8afcf"
	Aug 12 12:27:10 addons-673965 kubelet[1542]: E0812 12:27:10.873445    1542 pod_workers.go:1298] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"gadget\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=gadget pod=gadget-gdbxz_gadget(e92bb787-a8ce-4879-97ad-a146759eb4a3)\"" pod="gadget/gadget-gdbxz" podUID="e92bb787-a8ce-4879-97ad-a146759eb4a3"
	Aug 12 12:27:25 addons-673965 kubelet[1542]: I0812 12:27:25.871910    1542 scope.go:117] "RemoveContainer" containerID="82d72c1afda3a7904e6bc7318eff247cf5e215f2ec63fcee5481018ef3d8afcf"
	Aug 12 12:27:25 addons-673965 kubelet[1542]: E0812 12:27:25.872413    1542 pod_workers.go:1298] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"gadget\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=gadget pod=gadget-gdbxz_gadget(e92bb787-a8ce-4879-97ad-a146759eb4a3)\"" pod="gadget/gadget-gdbxz" podUID="e92bb787-a8ce-4879-97ad-a146759eb4a3"
	Aug 12 12:27:32 addons-673965 kubelet[1542]: I0812 12:27:32.872362    1542 kubelet_pods.go:988] "Unable to retrieve pull secret, the image pull may not succeed." pod="kube-system/nvidia-device-plugin-daemonset-cnjct" secret="" err="secret \"gcp-auth\" not found"
	Aug 12 12:27:38 addons-673965 kubelet[1542]: I0812 12:27:38.872961    1542 scope.go:117] "RemoveContainer" containerID="82d72c1afda3a7904e6bc7318eff247cf5e215f2ec63fcee5481018ef3d8afcf"
	Aug 12 12:27:38 addons-673965 kubelet[1542]: E0812 12:27:38.873608    1542 pod_workers.go:1298] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"gadget\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=gadget pod=gadget-gdbxz_gadget(e92bb787-a8ce-4879-97ad-a146759eb4a3)\"" pod="gadget/gadget-gdbxz" podUID="e92bb787-a8ce-4879-97ad-a146759eb4a3"
	Aug 12 12:27:52 addons-673965 kubelet[1542]: I0812 12:27:52.872123    1542 scope.go:117] "RemoveContainer" containerID="82d72c1afda3a7904e6bc7318eff247cf5e215f2ec63fcee5481018ef3d8afcf"
	Aug 12 12:27:52 addons-673965 kubelet[1542]: E0812 12:27:52.873066    1542 pod_workers.go:1298] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"gadget\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=gadget pod=gadget-gdbxz_gadget(e92bb787-a8ce-4879-97ad-a146759eb4a3)\"" pod="gadget/gadget-gdbxz" podUID="e92bb787-a8ce-4879-97ad-a146759eb4a3"
	
	
	==> storage-provisioner [090c787c5707dc6b5707cfd30d60f4a47acfcbe9aa9e00d2c96f305ba270364e] <==
	I0812 12:23:09.263949       1 storage_provisioner.go:116] Initializing the minikube storage provisioner...
	I0812 12:23:09.289652       1 storage_provisioner.go:141] Storage provisioner initialized, now starting service!
	I0812 12:23:09.289704       1 leaderelection.go:243] attempting to acquire leader lease kube-system/k8s.io-minikube-hostpath...
	I0812 12:23:09.309800       1 leaderelection.go:253] successfully acquired lease kube-system/k8s.io-minikube-hostpath
	I0812 12:23:09.310036       1 controller.go:835] Starting provisioner controller k8s.io/minikube-hostpath_addons-673965_5723ff66-075f-4880-8363-f47eeae3cc8c!
	I0812 12:23:09.311801       1 event.go:282] Event(v1.ObjectReference{Kind:"Endpoints", Namespace:"kube-system", Name:"k8s.io-minikube-hostpath", UID:"8481618d-c5af-421c-80c0-f0464adf5977", APIVersion:"v1", ResourceVersion:"538", FieldPath:""}): type: 'Normal' reason: 'LeaderElection' addons-673965_5723ff66-075f-4880-8363-f47eeae3cc8c became leader
	I0812 12:23:09.410986       1 controller.go:884] Started provisioner controller k8s.io/minikube-hostpath_addons-673965_5723ff66-075f-4880-8363-f47eeae3cc8c!
	

                                                
                                                
-- /stdout --
helpers_test.go:254: (dbg) Run:  out/minikube-linux-arm64 status --format={{.APIServer}} -p addons-673965 -n addons-673965
helpers_test.go:261: (dbg) Run:  kubectl --context addons-673965 get po -o=jsonpath={.items[*].metadata.name} -A --field-selector=status.phase!=Running
helpers_test.go:272: non-running pods: ingress-nginx-admission-create-5582v ingress-nginx-admission-patch-72glw test-job-nginx-0
helpers_test.go:274: ======> post-mortem[TestAddons/serial/Volcano]: describe non-running pods <======
helpers_test.go:277: (dbg) Run:  kubectl --context addons-673965 describe pod ingress-nginx-admission-create-5582v ingress-nginx-admission-patch-72glw test-job-nginx-0
helpers_test.go:277: (dbg) Non-zero exit: kubectl --context addons-673965 describe pod ingress-nginx-admission-create-5582v ingress-nginx-admission-patch-72glw test-job-nginx-0: exit status 1 (92.484694ms)

                                                
                                                
** stderr ** 
	Error from server (NotFound): pods "ingress-nginx-admission-create-5582v" not found
	Error from server (NotFound): pods "ingress-nginx-admission-patch-72glw" not found
	Error from server (NotFound): pods "test-job-nginx-0" not found

                                                
                                                
** /stderr **
helpers_test.go:279: kubectl --context addons-673965 describe pod ingress-nginx-admission-create-5582v ingress-nginx-admission-patch-72glw test-job-nginx-0: exit status 1
--- FAIL: TestAddons/serial/Volcano (200.56s)

                                                
                                    
x
+
TestStartStop/group/old-k8s-version/serial/SecondStart (379.47s)

                                                
                                                
=== RUN   TestStartStop/group/old-k8s-version/serial/SecondStart
start_stop_delete_test.go:256: (dbg) Run:  out/minikube-linux-arm64 start -p old-k8s-version-112335 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=docker  --container-runtime=containerd --kubernetes-version=v1.20.0
start_stop_delete_test.go:256: (dbg) Non-zero exit: out/minikube-linux-arm64 start -p old-k8s-version-112335 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=docker  --container-runtime=containerd --kubernetes-version=v1.20.0: exit status 102 (6m15.230506963s)

                                                
                                                
-- stdout --
	* [old-k8s-version-112335] minikube v1.33.1 on Ubuntu 20.04 (arm64)
	  - MINIKUBE_LOCATION=19411
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - KUBECONFIG=/home/jenkins/minikube-integration/19411-998978/kubeconfig
	  - MINIKUBE_HOME=/home/jenkins/minikube-integration/19411-998978/.minikube
	  - MINIKUBE_BIN=out/minikube-linux-arm64
	  - MINIKUBE_FORCE_SYSTEMD=
	* Kubernetes 1.30.3 is now available. If you would like to upgrade, specify: --kubernetes-version=v1.30.3
	* Using the docker driver based on existing profile
	* Starting "old-k8s-version-112335" primary control-plane node in "old-k8s-version-112335" cluster
	* Pulling base image v0.0.44-1723026928-19389 ...
	* Restarting existing docker container for "old-k8s-version-112335" ...
	* Preparing Kubernetes v1.20.0 on containerd 1.7.19 ...
	* Verifying Kubernetes components...
	  - Using image registry.k8s.io/echoserver:1.4
	  - Using image fake.domain/registry.k8s.io/echoserver:1.4
	  - Using image docker.io/kubernetesui/dashboard:v2.7.0
	  - Using image gcr.io/k8s-minikube/storage-provisioner:v5
	* Some dashboard features require the metrics-server addon. To enable all features please run:
	
		minikube -p old-k8s-version-112335 addons enable metrics-server
	
	* Enabled addons: storage-provisioner, default-storageclass, metrics-server, dashboard
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0812 13:13:07.003647 1212353 out.go:291] Setting OutFile to fd 1 ...
	I0812 13:13:07.003928 1212353 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0812 13:13:07.003960 1212353 out.go:304] Setting ErrFile to fd 2...
	I0812 13:13:07.003981 1212353 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0812 13:13:07.004410 1212353 root.go:338] Updating PATH: /home/jenkins/minikube-integration/19411-998978/.minikube/bin
	I0812 13:13:07.004989 1212353 out.go:298] Setting JSON to false
	I0812 13:13:07.006318 1212353 start.go:129] hostinfo: {"hostname":"ip-172-31-30-239","uptime":17736,"bootTime":1723450651,"procs":195,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1066-aws","kernelArch":"aarch64","virtualizationSystem":"","virtualizationRole":"","hostId":"92f46a7d-c249-4c12-924a-77f64874c910"}
	I0812 13:13:07.006444 1212353 start.go:139] virtualization:  
	I0812 13:13:07.011091 1212353 out.go:177] * [old-k8s-version-112335] minikube v1.33.1 on Ubuntu 20.04 (arm64)
	I0812 13:13:07.013776 1212353 out.go:177]   - MINIKUBE_LOCATION=19411
	I0812 13:13:07.013859 1212353 notify.go:220] Checking for updates...
	I0812 13:13:07.018276 1212353 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I0812 13:13:07.020811 1212353 out.go:177]   - KUBECONFIG=/home/jenkins/minikube-integration/19411-998978/kubeconfig
	I0812 13:13:07.023325 1212353 out.go:177]   - MINIKUBE_HOME=/home/jenkins/minikube-integration/19411-998978/.minikube
	I0812 13:13:07.025868 1212353 out.go:177]   - MINIKUBE_BIN=out/minikube-linux-arm64
	I0812 13:13:07.028346 1212353 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=
	I0812 13:13:07.031376 1212353 config.go:182] Loaded profile config "old-k8s-version-112335": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.20.0
	I0812 13:13:07.034553 1212353 out.go:177] * Kubernetes 1.30.3 is now available. If you would like to upgrade, specify: --kubernetes-version=v1.30.3
	I0812 13:13:07.037118 1212353 driver.go:392] Setting default libvirt URI to qemu:///system
	I0812 13:13:07.080604 1212353 docker.go:123] docker version: linux-27.1.1:Docker Engine - Community
	I0812 13:13:07.080721 1212353 cli_runner.go:164] Run: docker system info --format "{{json .}}"
	I0812 13:13:07.140608 1212353 info.go:266] docker info: {ID:6ZPO:QZND:VNGE:LUKL:4Y3K:XELL:AAX4:2GTK:E6LM:MPRN:3ZXR:TTMR Containers:2 ContainersRunning:1 ContainersPaused:0 ContainersStopped:1 Images:4 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:58 OomKillDisable:true NGoroutines:68 SystemTime:2024-08-12 13:13:07.13117289 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1066-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Architecture:aarc
h64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8214896640 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-30-239 Labels:[] ExperimentalBuild:false ServerVersion:27.1.1 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:2bf793ef6dc9a18e00cb12efb64355c2c9d5eb41 Expected:2bf793ef6dc9a18e00cb12efb64355c2c9d5eb41} RuncCommit:{ID:v1.1.13-0-g58aa920 Expected:v1.1.13-0-g58aa920} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:<nil> ServerError
s:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.16.1] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.29.1]] Warnings:<nil>}}
	I0812 13:13:07.140729 1212353 docker.go:307] overlay module found
	I0812 13:13:07.143502 1212353 out.go:177] * Using the docker driver based on existing profile
	I0812 13:13:07.145995 1212353 start.go:297] selected driver: docker
	I0812 13:13:07.146015 1212353 start.go:901] validating driver "docker" against &{Name:old-k8s-version-112335 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1723026928-19389@sha256:7715fe0c5dce35b4eb757765cbbe02d40cd8b5effa0639735e42ad89f4f51ef0 Memory:2200 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-112335 Namespace:default APIServerHAVIP: AP
IServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.85.2 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[dashboard:true default-storageclass:true metrics-server:true storage-provisioner:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4 MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:fa
lse MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I0812 13:13:07.146154 1212353 start.go:912] status for docker: {Installed:true Healthy:true Running:false NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I0812 13:13:07.146857 1212353 cli_runner.go:164] Run: docker system info --format "{{json .}}"
	I0812 13:13:07.233447 1212353 info.go:266] docker info: {ID:6ZPO:QZND:VNGE:LUKL:4Y3K:XELL:AAX4:2GTK:E6LM:MPRN:3ZXR:TTMR Containers:2 ContainersRunning:1 ContainersPaused:0 ContainersStopped:1 Images:4 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:58 OomKillDisable:true NGoroutines:68 SystemTime:2024-08-12 13:13:07.223888463 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1066-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Architecture:aar
ch64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8214896640 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-30-239 Labels:[] ExperimentalBuild:false ServerVersion:27.1.1 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:2bf793ef6dc9a18e00cb12efb64355c2c9d5eb41 Expected:2bf793ef6dc9a18e00cb12efb64355c2c9d5eb41} RuncCommit:{ID:v1.1.13-0-g58aa920 Expected:v1.1.13-0-g58aa920} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:<nil> ServerErro
rs:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.16.1] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.29.1]] Warnings:<nil>}}
	I0812 13:13:07.233856 1212353 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
	I0812 13:13:07.233902 1212353 cni.go:84] Creating CNI manager for ""
	I0812 13:13:07.233910 1212353 cni.go:143] "docker" driver + "containerd" runtime found, recommending kindnet
	I0812 13:13:07.233960 1212353 start.go:340] cluster config:
	{Name:old-k8s-version-112335 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1723026928-19389@sha256:7715fe0c5dce35b4eb757765cbbe02d40cd8b5effa0639735e42ad89f4f51ef0 Memory:2200 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-112335 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local
ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.85.2 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[dashboard:true default-storageclass:true metrics-server:true storage-provisioner:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4 MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:do
cker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I0812 13:13:07.236661 1212353 out.go:177] * Starting "old-k8s-version-112335" primary control-plane node in "old-k8s-version-112335" cluster
	I0812 13:13:07.239146 1212353 cache.go:121] Beginning downloading kic base image for docker with containerd
	I0812 13:13:07.241876 1212353 out.go:177] * Pulling base image v0.0.44-1723026928-19389 ...
	I0812 13:13:07.244449 1212353 preload.go:131] Checking if preload exists for k8s version v1.20.0 and runtime containerd
	I0812 13:13:07.244518 1212353 preload.go:146] Found local preload: /home/jenkins/minikube-integration/19411-998978/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-containerd-overlay2-arm64.tar.lz4
	I0812 13:13:07.244536 1212353 cache.go:56] Caching tarball of preloaded images
	I0812 13:13:07.244633 1212353 preload.go:172] Found /home/jenkins/minikube-integration/19411-998978/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-containerd-overlay2-arm64.tar.lz4 in cache, skipping download
	I0812 13:13:07.244647 1212353 cache.go:59] Finished verifying existence of preloaded tar for v1.20.0 on containerd
	I0812 13:13:07.244797 1212353 profile.go:143] Saving config to /home/jenkins/minikube-integration/19411-998978/.minikube/profiles/old-k8s-version-112335/config.json ...
	I0812 13:13:07.245032 1212353 image.go:79] Checking for gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1723026928-19389@sha256:7715fe0c5dce35b4eb757765cbbe02d40cd8b5effa0639735e42ad89f4f51ef0 in local docker daemon
	W0812 13:13:07.269301 1212353 image.go:95] image gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1723026928-19389@sha256:7715fe0c5dce35b4eb757765cbbe02d40cd8b5effa0639735e42ad89f4f51ef0 is of wrong architecture
	I0812 13:13:07.269325 1212353 cache.go:149] Downloading gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1723026928-19389@sha256:7715fe0c5dce35b4eb757765cbbe02d40cd8b5effa0639735e42ad89f4f51ef0 to local cache
	I0812 13:13:07.269400 1212353 image.go:63] Checking for gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1723026928-19389@sha256:7715fe0c5dce35b4eb757765cbbe02d40cd8b5effa0639735e42ad89f4f51ef0 in local cache directory
	I0812 13:13:07.269423 1212353 image.go:66] Found gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1723026928-19389@sha256:7715fe0c5dce35b4eb757765cbbe02d40cd8b5effa0639735e42ad89f4f51ef0 in local cache directory, skipping pull
	I0812 13:13:07.269432 1212353 image.go:135] gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1723026928-19389@sha256:7715fe0c5dce35b4eb757765cbbe02d40cd8b5effa0639735e42ad89f4f51ef0 exists in cache, skipping pull
	I0812 13:13:07.269441 1212353 cache.go:152] successfully saved gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1723026928-19389@sha256:7715fe0c5dce35b4eb757765cbbe02d40cd8b5effa0639735e42ad89f4f51ef0 as a tarball
	I0812 13:13:07.269447 1212353 cache.go:162] Loading gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1723026928-19389@sha256:7715fe0c5dce35b4eb757765cbbe02d40cd8b5effa0639735e42ad89f4f51ef0 from local cache
	I0812 13:13:07.392752 1212353 cache.go:164] successfully loaded and using gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1723026928-19389@sha256:7715fe0c5dce35b4eb757765cbbe02d40cd8b5effa0639735e42ad89f4f51ef0 from cached tarball
	I0812 13:13:07.392787 1212353 cache.go:194] Successfully downloaded all kic artifacts
	I0812 13:13:07.392822 1212353 start.go:360] acquireMachinesLock for old-k8s-version-112335: {Name:mk2ed0701e8f3310dcade3eec33c9fffdbce8a17 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0812 13:13:07.392886 1212353 start.go:364] duration metric: took 39.605µs to acquireMachinesLock for "old-k8s-version-112335"
	I0812 13:13:07.392912 1212353 start.go:96] Skipping create...Using existing machine configuration
	I0812 13:13:07.392930 1212353 fix.go:54] fixHost starting: 
	I0812 13:13:07.393311 1212353 cli_runner.go:164] Run: docker container inspect old-k8s-version-112335 --format={{.State.Status}}
	I0812 13:13:07.439379 1212353 fix.go:112] recreateIfNeeded on old-k8s-version-112335: state=Stopped err=<nil>
	W0812 13:13:07.439415 1212353 fix.go:138] unexpected machine state, will restart: <nil>
	I0812 13:13:07.442745 1212353 out.go:177] * Restarting existing docker container for "old-k8s-version-112335" ...
	I0812 13:13:07.445438 1212353 cli_runner.go:164] Run: docker start old-k8s-version-112335
	I0812 13:13:07.814877 1212353 cli_runner.go:164] Run: docker container inspect old-k8s-version-112335 --format={{.State.Status}}
	I0812 13:13:07.875253 1212353 kic.go:430] container "old-k8s-version-112335" state is running.
	I0812 13:13:07.876646 1212353 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" old-k8s-version-112335
	I0812 13:13:07.931206 1212353 profile.go:143] Saving config to /home/jenkins/minikube-integration/19411-998978/.minikube/profiles/old-k8s-version-112335/config.json ...
	I0812 13:13:07.931433 1212353 machine.go:94] provisionDockerMachine start ...
	I0812 13:13:07.931499 1212353 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-112335
	I0812 13:13:07.988394 1212353 main.go:141] libmachine: Using SSH client type: native
	I0812 13:13:07.988704 1212353 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x3e2cd0] 0x3e5530 <nil>  [] 0s} 127.0.0.1 34190 <nil> <nil>}
	I0812 13:13:07.988713 1212353 main.go:141] libmachine: About to run SSH command:
	hostname
	I0812 13:13:07.989386 1212353 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: EOF
	I0812 13:13:11.137033 1212353 main.go:141] libmachine: SSH cmd err, output: <nil>: old-k8s-version-112335
	
	I0812 13:13:11.137128 1212353 ubuntu.go:169] provisioning hostname "old-k8s-version-112335"
	I0812 13:13:11.137264 1212353 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-112335
	I0812 13:13:11.179609 1212353 main.go:141] libmachine: Using SSH client type: native
	I0812 13:13:11.179865 1212353 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x3e2cd0] 0x3e5530 <nil>  [] 0s} 127.0.0.1 34190 <nil> <nil>}
	I0812 13:13:11.179878 1212353 main.go:141] libmachine: About to run SSH command:
	sudo hostname old-k8s-version-112335 && echo "old-k8s-version-112335" | sudo tee /etc/hostname
	I0812 13:13:11.347925 1212353 main.go:141] libmachine: SSH cmd err, output: <nil>: old-k8s-version-112335
	
	I0812 13:13:11.348019 1212353 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-112335
	I0812 13:13:11.383101 1212353 main.go:141] libmachine: Using SSH client type: native
	I0812 13:13:11.383369 1212353 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x3e2cd0] 0x3e5530 <nil>  [] 0s} 127.0.0.1 34190 <nil> <nil>}
	I0812 13:13:11.383393 1212353 main.go:141] libmachine: About to run SSH command:
	
			if ! grep -xq '.*\sold-k8s-version-112335' /etc/hosts; then
				if grep -xq '127.0.1.1\s.*' /etc/hosts; then
					sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 old-k8s-version-112335/g' /etc/hosts;
				else 
					echo '127.0.1.1 old-k8s-version-112335' | sudo tee -a /etc/hosts; 
				fi
			fi
	I0812 13:13:11.533599 1212353 main.go:141] libmachine: SSH cmd err, output: <nil>: 
	I0812 13:13:11.533672 1212353 ubuntu.go:175] set auth options {CertDir:/home/jenkins/minikube-integration/19411-998978/.minikube CaCertPath:/home/jenkins/minikube-integration/19411-998978/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/19411-998978/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/19411-998978/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/19411-998978/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/19411-998978/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/19411-998978/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/19411-998978/.minikube}
	I0812 13:13:11.533710 1212353 ubuntu.go:177] setting up certificates
	I0812 13:13:11.533752 1212353 provision.go:84] configureAuth start
	I0812 13:13:11.533833 1212353 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" old-k8s-version-112335
	I0812 13:13:11.560250 1212353 provision.go:143] copyHostCerts
	I0812 13:13:11.560321 1212353 exec_runner.go:144] found /home/jenkins/minikube-integration/19411-998978/.minikube/cert.pem, removing ...
	I0812 13:13:11.560330 1212353 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19411-998978/.minikube/cert.pem
	I0812 13:13:11.560411 1212353 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19411-998978/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/19411-998978/.minikube/cert.pem (1123 bytes)
	I0812 13:13:11.560540 1212353 exec_runner.go:144] found /home/jenkins/minikube-integration/19411-998978/.minikube/key.pem, removing ...
	I0812 13:13:11.560545 1212353 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19411-998978/.minikube/key.pem
	I0812 13:13:11.560572 1212353 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19411-998978/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/19411-998978/.minikube/key.pem (1679 bytes)
	I0812 13:13:11.560621 1212353 exec_runner.go:144] found /home/jenkins/minikube-integration/19411-998978/.minikube/ca.pem, removing ...
	I0812 13:13:11.560625 1212353 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19411-998978/.minikube/ca.pem
	I0812 13:13:11.560648 1212353 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19411-998978/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/19411-998978/.minikube/ca.pem (1082 bytes)
	I0812 13:13:11.560691 1212353 provision.go:117] generating server cert: /home/jenkins/minikube-integration/19411-998978/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/19411-998978/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/19411-998978/.minikube/certs/ca-key.pem org=jenkins.old-k8s-version-112335 san=[127.0.0.1 192.168.85.2 localhost minikube old-k8s-version-112335]
	I0812 13:13:12.143058 1212353 provision.go:177] copyRemoteCerts
	I0812 13:13:12.143187 1212353 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
	I0812 13:13:12.143288 1212353 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-112335
	I0812 13:13:12.167237 1212353 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:34190 SSHKeyPath:/home/jenkins/minikube-integration/19411-998978/.minikube/machines/old-k8s-version-112335/id_rsa Username:docker}
	I0812 13:13:12.271557 1212353 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19411-998978/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1082 bytes)
	I0812 13:13:12.300144 1212353 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19411-998978/.minikube/machines/server.pem --> /etc/docker/server.pem (1233 bytes)
	I0812 13:13:12.327676 1212353 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19411-998978/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1679 bytes)
	I0812 13:13:12.355608 1212353 provision.go:87] duration metric: took 821.823695ms to configureAuth
	I0812 13:13:12.355700 1212353 ubuntu.go:193] setting minikube options for container-runtime
	I0812 13:13:12.355995 1212353 config.go:182] Loaded profile config "old-k8s-version-112335": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.20.0
	I0812 13:13:12.356027 1212353 machine.go:97] duration metric: took 4.424584944s to provisionDockerMachine
	I0812 13:13:12.356049 1212353 start.go:293] postStartSetup for "old-k8s-version-112335" (driver="docker")
	I0812 13:13:12.356074 1212353 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
	I0812 13:13:12.356163 1212353 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
	I0812 13:13:12.356256 1212353 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-112335
	I0812 13:13:12.377124 1212353 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:34190 SSHKeyPath:/home/jenkins/minikube-integration/19411-998978/.minikube/machines/old-k8s-version-112335/id_rsa Username:docker}
	I0812 13:13:12.486071 1212353 ssh_runner.go:195] Run: cat /etc/os-release
	I0812 13:13:12.490935 1212353 main.go:141] libmachine: Couldn't set key VERSION_CODENAME, no corresponding struct field found
	I0812 13:13:12.490974 1212353 main.go:141] libmachine: Couldn't set key PRIVACY_POLICY_URL, no corresponding struct field found
	I0812 13:13:12.490995 1212353 main.go:141] libmachine: Couldn't set key UBUNTU_CODENAME, no corresponding struct field found
	I0812 13:13:12.491007 1212353 info.go:137] Remote host: Ubuntu 22.04.4 LTS
	I0812 13:13:12.491024 1212353 filesync.go:126] Scanning /home/jenkins/minikube-integration/19411-998978/.minikube/addons for local assets ...
	I0812 13:13:12.491100 1212353 filesync.go:126] Scanning /home/jenkins/minikube-integration/19411-998978/.minikube/files for local assets ...
	I0812 13:13:12.491238 1212353 filesync.go:149] local asset: /home/jenkins/minikube-integration/19411-998978/.minikube/files/etc/ssl/certs/10043702.pem -> 10043702.pem in /etc/ssl/certs
	I0812 13:13:12.491358 1212353 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs
	I0812 13:13:12.503414 1212353 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19411-998978/.minikube/files/etc/ssl/certs/10043702.pem --> /etc/ssl/certs/10043702.pem (1708 bytes)
	I0812 13:13:12.541342 1212353 start.go:296] duration metric: took 185.262691ms for postStartSetup
	I0812 13:13:12.541493 1212353 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
	I0812 13:13:12.541568 1212353 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-112335
	I0812 13:13:12.561037 1212353 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:34190 SSHKeyPath:/home/jenkins/minikube-integration/19411-998978/.minikube/machines/old-k8s-version-112335/id_rsa Username:docker}
	I0812 13:13:12.663086 1212353 ssh_runner.go:195] Run: sh -c "df -BG /var | awk 'NR==2{print $4}'"
	I0812 13:13:12.668620 1212353 fix.go:56] duration metric: took 5.275689875s for fixHost
	I0812 13:13:12.668668 1212353 start.go:83] releasing machines lock for "old-k8s-version-112335", held for 5.275768412s
	I0812 13:13:12.668763 1212353 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" old-k8s-version-112335
	I0812 13:13:12.691003 1212353 ssh_runner.go:195] Run: cat /version.json
	I0812 13:13:12.691060 1212353 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-112335
	I0812 13:13:12.691293 1212353 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/
	I0812 13:13:12.691351 1212353 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-112335
	I0812 13:13:12.726471 1212353 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:34190 SSHKeyPath:/home/jenkins/minikube-integration/19411-998978/.minikube/machines/old-k8s-version-112335/id_rsa Username:docker}
	I0812 13:13:12.738988 1212353 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:34190 SSHKeyPath:/home/jenkins/minikube-integration/19411-998978/.minikube/machines/old-k8s-version-112335/id_rsa Username:docker}
	I0812 13:13:12.961675 1212353 ssh_runner.go:195] Run: systemctl --version
	I0812 13:13:12.966990 1212353 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"
	I0812 13:13:12.971518 1212353 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f -name *loopback.conf* -not -name *.mk_disabled -exec sh -c "grep -q loopback {} && ( grep -q name {} || sudo sed -i '/"type": "loopback"/i \ \ \ \ "name": "loopback",' {} ) && sudo sed -i 's|"cniVersion": ".*"|"cniVersion": "1.0.0"|g' {}" ;
	I0812 13:13:12.990318 1212353 cni.go:230] loopback cni configuration patched: "/etc/cni/net.d/*loopback.conf*" found
	I0812 13:13:12.990471 1212353 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%p, " -exec sh -c "sudo mv {} {}.mk_disabled" ;
	I0812 13:13:13.000858 1212353 cni.go:259] no active bridge cni configs found in "/etc/cni/net.d" - nothing to disable
	I0812 13:13:13.000954 1212353 start.go:495] detecting cgroup driver to use...
	I0812 13:13:13.001025 1212353 detect.go:187] detected "cgroupfs" cgroup driver on host os
	I0812 13:13:13.001112 1212353 ssh_runner.go:195] Run: sudo systemctl stop -f crio
	I0812 13:13:13.018544 1212353 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service crio
	I0812 13:13:13.032850 1212353 docker.go:217] disabling cri-docker service (if available) ...
	I0812 13:13:13.032968 1212353 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.socket
	I0812 13:13:13.047655 1212353 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.service
	I0812 13:13:13.062020 1212353 ssh_runner.go:195] Run: sudo systemctl disable cri-docker.socket
	I0812 13:13:13.173958 1212353 ssh_runner.go:195] Run: sudo systemctl mask cri-docker.service
	I0812 13:13:13.290273 1212353 docker.go:233] disabling docker service ...
	I0812 13:13:13.290416 1212353 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket
	I0812 13:13:13.305540 1212353 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service
	I0812 13:13:13.318361 1212353 ssh_runner.go:195] Run: sudo systemctl disable docker.socket
	I0812 13:13:13.437369 1212353 ssh_runner.go:195] Run: sudo systemctl mask docker.service
	I0812 13:13:13.555024 1212353 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker
	I0812 13:13:13.569270 1212353 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///run/containerd/containerd.sock
	" | sudo tee /etc/crictl.yaml"
	I0812 13:13:13.587922 1212353 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)sandbox_image = .*$|\1sandbox_image = "registry.k8s.io/pause:3.2"|' /etc/containerd/config.toml"
	I0812 13:13:13.598832 1212353 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)restrict_oom_score_adj = .*$|\1restrict_oom_score_adj = false|' /etc/containerd/config.toml"
	I0812 13:13:13.615105 1212353 containerd.go:146] configuring containerd to use "cgroupfs" as cgroup driver...
	I0812 13:13:13.615226 1212353 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)SystemdCgroup = .*$|\1SystemdCgroup = false|g' /etc/containerd/config.toml"
	I0812 13:13:13.628436 1212353 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runtime.v1.linux"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"
	I0812 13:13:13.640630 1212353 ssh_runner.go:195] Run: sh -c "sudo sed -i '/systemd_cgroup/d' /etc/containerd/config.toml"
	I0812 13:13:13.663736 1212353 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runc.v1"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"
	I0812 13:13:13.674444 1212353 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"
	I0812 13:13:13.685143 1212353 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)conf_dir = .*$|\1conf_dir = "/etc/cni/net.d"|g' /etc/containerd/config.toml"
	I0812 13:13:13.703301 1212353 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
	I0812 13:13:13.722286 1212353 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
	I0812 13:13:13.733013 1212353 ssh_runner.go:195] Run: sudo systemctl daemon-reload
	I0812 13:13:13.848005 1212353 ssh_runner.go:195] Run: sudo systemctl restart containerd
	I0812 13:13:14.061789 1212353 start.go:542] Will wait 60s for socket path /run/containerd/containerd.sock
	I0812 13:13:14.061860 1212353 ssh_runner.go:195] Run: stat /run/containerd/containerd.sock
	I0812 13:13:14.067031 1212353 start.go:563] Will wait 60s for crictl version
	I0812 13:13:14.067099 1212353 ssh_runner.go:195] Run: which crictl
	I0812 13:13:14.072263 1212353 ssh_runner.go:195] Run: sudo /usr/bin/crictl version
	I0812 13:13:14.131679 1212353 start.go:579] Version:  0.1.0
	RuntimeName:  containerd
	RuntimeVersion:  1.7.19
	RuntimeApiVersion:  v1
	I0812 13:13:14.131748 1212353 ssh_runner.go:195] Run: containerd --version
	I0812 13:13:14.155099 1212353 ssh_runner.go:195] Run: containerd --version
	I0812 13:13:14.184821 1212353 out.go:177] * Preparing Kubernetes v1.20.0 on containerd 1.7.19 ...
	I0812 13:13:14.187260 1212353 cli_runner.go:164] Run: docker network inspect old-k8s-version-112335 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
	I0812 13:13:14.206850 1212353 ssh_runner.go:195] Run: grep 192.168.85.1	host.minikube.internal$ /etc/hosts
	I0812 13:13:14.210891 1212353 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.85.1	host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
	I0812 13:13:14.221904 1212353 kubeadm.go:883] updating cluster {Name:old-k8s-version-112335 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1723026928-19389@sha256:7715fe0c5dce35b4eb757765cbbe02d40cd8b5effa0639735e42ad89f4f51ef0 Memory:2200 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-112335 Namespace:default APIServerHAVIP: APIServerName:minik
ubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.85.2 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[dashboard:true default-storageclass:true metrics-server:true storage-provisioner:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4 MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/
home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} ...
	I0812 13:13:14.222037 1212353 preload.go:131] Checking if preload exists for k8s version v1.20.0 and runtime containerd
	I0812 13:13:14.222102 1212353 ssh_runner.go:195] Run: sudo crictl images --output json
	I0812 13:13:14.267493 1212353 containerd.go:627] all images are preloaded for containerd runtime.
	I0812 13:13:14.267519 1212353 containerd.go:534] Images already preloaded, skipping extraction
	I0812 13:13:14.267583 1212353 ssh_runner.go:195] Run: sudo crictl images --output json
	I0812 13:13:14.315358 1212353 containerd.go:627] all images are preloaded for containerd runtime.
	I0812 13:13:14.315390 1212353 cache_images.go:84] Images are preloaded, skipping loading
	I0812 13:13:14.315399 1212353 kubeadm.go:934] updating node { 192.168.85.2 8443 v1.20.0 containerd true true} ...
	I0812 13:13:14.315527 1212353 kubeadm.go:946] kubelet [Unit]
	Wants=containerd.service
	
	[Service]
	ExecStart=
	ExecStart=/var/lib/minikube/binaries/v1.20.0/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --container-runtime=remote --container-runtime-endpoint=unix:///run/containerd/containerd.sock --hostname-override=old-k8s-version-112335 --kubeconfig=/etc/kubernetes/kubelet.conf --network-plugin=cni --node-ip=192.168.85.2
	
	[Install]
	 config:
	{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-112335 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:}
	I0812 13:13:14.315616 1212353 ssh_runner.go:195] Run: sudo crictl info
	I0812 13:13:14.364915 1212353 cni.go:84] Creating CNI manager for ""
	I0812 13:13:14.364942 1212353 cni.go:143] "docker" driver + "containerd" runtime found, recommending kindnet
	I0812 13:13:14.364952 1212353 kubeadm.go:84] Using pod CIDR: 10.244.0.0/16
	I0812 13:13:14.364972 1212353 kubeadm.go:181] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.85.2 APIServerPort:8443 KubernetesVersion:v1.20.0 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:old-k8s-version-112335 NodeName:old-k8s-version-112335 DNSDomain:cluster.local CRISocket:/run/containerd/containerd.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.85.2"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.85.2 CgroupDriver:cgroupfs ClientCAFile:/var/lib/minikube/certs/ca.crt
StaticPodPath:/etc/kubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:false}
	I0812 13:13:14.365112 1212353 kubeadm.go:187] kubeadm config:
	apiVersion: kubeadm.k8s.io/v1beta2
	kind: InitConfiguration
	localAPIEndpoint:
	  advertiseAddress: 192.168.85.2
	  bindPort: 8443
	bootstrapTokens:
	  - groups:
	      - system:bootstrappers:kubeadm:default-node-token
	    ttl: 24h0m0s
	    usages:
	      - signing
	      - authentication
	nodeRegistration:
	  criSocket: /run/containerd/containerd.sock
	  name: "old-k8s-version-112335"
	  kubeletExtraArgs:
	    node-ip: 192.168.85.2
	  taints: []
	---
	apiVersion: kubeadm.k8s.io/v1beta2
	kind: ClusterConfiguration
	apiServer:
	  certSANs: ["127.0.0.1", "localhost", "192.168.85.2"]
	  extraArgs:
	    enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"
	controllerManager:
	  extraArgs:
	    allocate-node-cidrs: "true"
	    leader-elect: "false"
	scheduler:
	  extraArgs:
	    leader-elect: "false"
	certificatesDir: /var/lib/minikube/certs
	clusterName: mk
	controlPlaneEndpoint: control-plane.minikube.internal:8443
	dns:
	  type: CoreDNS
	etcd:
	  local:
	    dataDir: /var/lib/minikube/etcd
	    extraArgs:
	      proxy-refresh-interval: "70000"
	kubernetesVersion: v1.20.0
	networking:
	  dnsDomain: cluster.local
	  podSubnet: "10.244.0.0/16"
	  serviceSubnet: 10.96.0.0/12
	---
	apiVersion: kubelet.config.k8s.io/v1beta1
	kind: KubeletConfiguration
	authentication:
	  x509:
	    clientCAFile: /var/lib/minikube/certs/ca.crt
	cgroupDriver: cgroupfs
	hairpinMode: hairpin-veth
	runtimeRequestTimeout: 15m
	clusterDomain: "cluster.local"
	# disable disk resource management by default
	imageGCHighThresholdPercent: 100
	evictionHard:
	  nodefs.available: "0%"
	  nodefs.inodesFree: "0%"
	  imagefs.available: "0%"
	failSwapOn: false
	staticPodPath: /etc/kubernetes/manifests
	---
	apiVersion: kubeproxy.config.k8s.io/v1alpha1
	kind: KubeProxyConfiguration
	clusterCIDR: "10.244.0.0/16"
	metricsBindAddress: 0.0.0.0:10249
	conntrack:
	  maxPerCore: 0
	# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"
	  tcpEstablishedTimeout: 0s
	# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"
	  tcpCloseWaitTimeout: 0s
	
	I0812 13:13:14.365182 1212353 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.20.0
	I0812 13:13:14.376310 1212353 binaries.go:44] Found k8s binaries, skipping transfer
	I0812 13:13:14.376404 1212353 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube
	I0812 13:13:14.395171 1212353 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (442 bytes)
	I0812 13:13:14.421784 1212353 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)
	I0812 13:13:14.441031 1212353 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2125 bytes)
	I0812 13:13:14.460569 1212353 ssh_runner.go:195] Run: grep 192.168.85.2	control-plane.minikube.internal$ /etc/hosts
	I0812 13:13:14.464043 1212353 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.85.2	control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
	I0812 13:13:14.475193 1212353 ssh_runner.go:195] Run: sudo systemctl daemon-reload
	I0812 13:13:14.592659 1212353 ssh_runner.go:195] Run: sudo systemctl start kubelet
	I0812 13:13:14.611937 1212353 certs.go:68] Setting up /home/jenkins/minikube-integration/19411-998978/.minikube/profiles/old-k8s-version-112335 for IP: 192.168.85.2
	I0812 13:13:14.611971 1212353 certs.go:194] generating shared ca certs ...
	I0812 13:13:14.611988 1212353 certs.go:226] acquiring lock for ca certs: {Name:mk16a6b77f049380624bf1b67dc2a8c038f8d58a Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0812 13:13:14.612161 1212353 certs.go:235] skipping valid "minikubeCA" ca cert: /home/jenkins/minikube-integration/19411-998978/.minikube/ca.key
	I0812 13:13:14.612249 1212353 certs.go:235] skipping valid "proxyClientCA" ca cert: /home/jenkins/minikube-integration/19411-998978/.minikube/proxy-client-ca.key
	I0812 13:13:14.612261 1212353 certs.go:256] generating profile certs ...
	I0812 13:13:14.612377 1212353 certs.go:359] skipping valid signed profile cert regeneration for "minikube-user": /home/jenkins/minikube-integration/19411-998978/.minikube/profiles/old-k8s-version-112335/client.key
	I0812 13:13:14.612464 1212353 certs.go:359] skipping valid signed profile cert regeneration for "minikube": /home/jenkins/minikube-integration/19411-998978/.minikube/profiles/old-k8s-version-112335/apiserver.key.846be31a
	I0812 13:13:14.612518 1212353 certs.go:359] skipping valid signed profile cert regeneration for "aggregator": /home/jenkins/minikube-integration/19411-998978/.minikube/profiles/old-k8s-version-112335/proxy-client.key
	I0812 13:13:14.612657 1212353 certs.go:484] found cert: /home/jenkins/minikube-integration/19411-998978/.minikube/certs/1004370.pem (1338 bytes)
	W0812 13:13:14.612698 1212353 certs.go:480] ignoring /home/jenkins/minikube-integration/19411-998978/.minikube/certs/1004370_empty.pem, impossibly tiny 0 bytes
	I0812 13:13:14.612711 1212353 certs.go:484] found cert: /home/jenkins/minikube-integration/19411-998978/.minikube/certs/ca-key.pem (1675 bytes)
	I0812 13:13:14.612763 1212353 certs.go:484] found cert: /home/jenkins/minikube-integration/19411-998978/.minikube/certs/ca.pem (1082 bytes)
	I0812 13:13:14.612795 1212353 certs.go:484] found cert: /home/jenkins/minikube-integration/19411-998978/.minikube/certs/cert.pem (1123 bytes)
	I0812 13:13:14.612829 1212353 certs.go:484] found cert: /home/jenkins/minikube-integration/19411-998978/.minikube/certs/key.pem (1679 bytes)
	I0812 13:13:14.612888 1212353 certs.go:484] found cert: /home/jenkins/minikube-integration/19411-998978/.minikube/files/etc/ssl/certs/10043702.pem (1708 bytes)
	I0812 13:13:14.613580 1212353 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19411-998978/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
	I0812 13:13:14.679129 1212353 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19411-998978/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1675 bytes)
	I0812 13:13:14.766665 1212353 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19411-998978/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
	I0812 13:13:14.806149 1212353 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19411-998978/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1679 bytes)
	I0812 13:13:14.832710 1212353 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19411-998978/.minikube/profiles/old-k8s-version-112335/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1432 bytes)
	I0812 13:13:14.867521 1212353 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19411-998978/.minikube/profiles/old-k8s-version-112335/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1675 bytes)
	I0812 13:13:14.894245 1212353 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19411-998978/.minikube/profiles/old-k8s-version-112335/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
	I0812 13:13:14.920299 1212353 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19411-998978/.minikube/profiles/old-k8s-version-112335/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1679 bytes)
	I0812 13:13:14.946759 1212353 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19411-998978/.minikube/certs/1004370.pem --> /usr/share/ca-certificates/1004370.pem (1338 bytes)
	I0812 13:13:14.972607 1212353 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19411-998978/.minikube/files/etc/ssl/certs/10043702.pem --> /usr/share/ca-certificates/10043702.pem (1708 bytes)
	I0812 13:13:14.998366 1212353 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19411-998978/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
	I0812 13:13:15.030727 1212353 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)
	I0812 13:13:15.054900 1212353 ssh_runner.go:195] Run: openssl version
	I0812 13:13:15.062449 1212353 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
	I0812 13:13:15.074977 1212353 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
	I0812 13:13:15.079849 1212353 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 Aug 12 12:22 /usr/share/ca-certificates/minikubeCA.pem
	I0812 13:13:15.080009 1212353 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
	I0812 13:13:15.088915 1212353 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
	I0812 13:13:15.101184 1212353 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/1004370.pem && ln -fs /usr/share/ca-certificates/1004370.pem /etc/ssl/certs/1004370.pem"
	I0812 13:13:15.115545 1212353 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/1004370.pem
	I0812 13:13:15.120357 1212353 certs.go:528] hashing: -rw-r--r-- 1 root root 1338 Aug 12 12:31 /usr/share/ca-certificates/1004370.pem
	I0812 13:13:15.120485 1212353 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/1004370.pem
	I0812 13:13:15.129328 1212353 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/1004370.pem /etc/ssl/certs/51391683.0"
	I0812 13:13:15.140756 1212353 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/10043702.pem && ln -fs /usr/share/ca-certificates/10043702.pem /etc/ssl/certs/10043702.pem"
	I0812 13:13:15.161381 1212353 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/10043702.pem
	I0812 13:13:15.166186 1212353 certs.go:528] hashing: -rw-r--r-- 1 root root 1708 Aug 12 12:31 /usr/share/ca-certificates/10043702.pem
	I0812 13:13:15.166306 1212353 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/10043702.pem
	I0812 13:13:15.175058 1212353 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/10043702.pem /etc/ssl/certs/3ec20f2e.0"
	I0812 13:13:15.188495 1212353 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt
	I0812 13:13:15.193406 1212353 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/apiserver-etcd-client.crt -checkend 86400
	I0812 13:13:15.202091 1212353 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/apiserver-kubelet-client.crt -checkend 86400
	I0812 13:13:15.210622 1212353 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/server.crt -checkend 86400
	I0812 13:13:15.218856 1212353 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/healthcheck-client.crt -checkend 86400
	I0812 13:13:15.226672 1212353 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/peer.crt -checkend 86400
	I0812 13:13:15.234358 1212353 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/front-proxy-client.crt -checkend 86400
	I0812 13:13:15.242149 1212353 kubeadm.go:392] StartCluster: {Name:old-k8s-version-112335 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1723026928-19389@sha256:7715fe0c5dce35b4eb757765cbbe02d40cd8b5effa0639735e42ad89f4f51ef0 Memory:2200 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-112335 Namespace:default APIServerHAVIP: APIServerName:minikube
CA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.85.2 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[dashboard:true default-storageclass:true metrics-server:true storage-provisioner:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4 MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/hom
e/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I0812 13:13:15.242305 1212353 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:paused Name: Namespaces:[kube-system]}
	I0812 13:13:15.242409 1212353 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"
	I0812 13:13:15.295028 1212353 cri.go:89] found id: "7f8e543bcce0c03b365394bc942dab039d350b1340f5856f43b90551a5645f67"
	I0812 13:13:15.295102 1212353 cri.go:89] found id: "162b80fe4af51619d233d78c0c67ed2c8e6f24d40ec23dd44a431d1b76caed13"
	I0812 13:13:15.295121 1212353 cri.go:89] found id: "2b8fb92ecd7c569da75c4f2d73bd5ed74ff849493db6c5ffa754f7450549e203"
	I0812 13:13:15.295142 1212353 cri.go:89] found id: "e6326fb96d89ee49b3da7ef3f75a5f41a53b9acb3526ac907bf55dfcc30b8d6c"
	I0812 13:13:15.295175 1212353 cri.go:89] found id: "7b67a4fc117cb884b3aec00880229a7613be0e0af79872ccc25b2ef06932d06f"
	I0812 13:13:15.295201 1212353 cri.go:89] found id: "8dc43146b8eece1e84ac23cedd68a17cad2d2457bc209bbe351bbfa0454d1bc2"
	I0812 13:13:15.295221 1212353 cri.go:89] found id: "bf352ab2c17cc4485d3b3f899d758963b292f9829240ec0e4e650d678908e30a"
	I0812 13:13:15.295239 1212353 cri.go:89] found id: "39f629658753d4fd7ceceee2f8ec0ffc8c98db08a6b70240ea91f87cd6dcee03"
	I0812 13:13:15.295259 1212353 cri.go:89] found id: ""
	I0812 13:13:15.295341 1212353 ssh_runner.go:195] Run: sudo runc --root /run/containerd/runc/k8s.io list -f json
	I0812 13:13:15.308967 1212353 cri.go:116] JSON = null
	W0812 13:13:15.309068 1212353 kubeadm.go:399] unpause failed: list paused: list returned 0 containers, but ps returned 8
	I0812 13:13:15.309168 1212353 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd
	I0812 13:13:15.319599 1212353 kubeadm.go:408] found existing configuration files, will attempt cluster restart
	I0812 13:13:15.319670 1212353 kubeadm.go:593] restartPrimaryControlPlane start ...
	I0812 13:13:15.319756 1212353 ssh_runner.go:195] Run: sudo test -d /data/minikube
	I0812 13:13:15.329333 1212353 kubeadm.go:130] /data/minikube skipping compat symlinks: sudo test -d /data/minikube: Process exited with status 1
	stdout:
	
	stderr:
	I0812 13:13:15.329819 1212353 kubeconfig.go:47] verify endpoint returned: get endpoint: "old-k8s-version-112335" does not appear in /home/jenkins/minikube-integration/19411-998978/kubeconfig
	I0812 13:13:15.329996 1212353 kubeconfig.go:62] /home/jenkins/minikube-integration/19411-998978/kubeconfig needs updating (will repair): [kubeconfig missing "old-k8s-version-112335" cluster setting kubeconfig missing "old-k8s-version-112335" context setting]
	I0812 13:13:15.330331 1212353 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19411-998978/kubeconfig: {Name:mk5cff3a2472180f06252810f10ea42538787fa2 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0812 13:13:15.331838 1212353 ssh_runner.go:195] Run: sudo diff -u /var/tmp/minikube/kubeadm.yaml /var/tmp/minikube/kubeadm.yaml.new
	I0812 13:13:15.341488 1212353 kubeadm.go:630] The running cluster does not require reconfiguration: 192.168.85.2
	I0812 13:13:15.341561 1212353 kubeadm.go:597] duration metric: took 21.871908ms to restartPrimaryControlPlane
	I0812 13:13:15.341585 1212353 kubeadm.go:394] duration metric: took 99.444541ms to StartCluster
	I0812 13:13:15.341627 1212353 settings.go:142] acquiring lock: {Name:mk658f1fe8b144393e435c8af021f2e0f3b1e6c6 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0812 13:13:15.341712 1212353 settings.go:150] Updating kubeconfig:  /home/jenkins/minikube-integration/19411-998978/kubeconfig
	I0812 13:13:15.342353 1212353 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19411-998978/kubeconfig: {Name:mk5cff3a2472180f06252810f10ea42538787fa2 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0812 13:13:15.342608 1212353 start.go:235] Will wait 6m0s for node &{Name: IP:192.168.85.2 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:containerd ControlPlane:true Worker:true}
	I0812 13:13:15.343016 1212353 config.go:182] Loaded profile config "old-k8s-version-112335": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.20.0
	I0812 13:13:15.342993 1212353 addons.go:507] enable addons start: toEnable=map[ambassador:false auto-pause:false cloud-spanner:false csi-hostpath-driver:false dashboard:true default-storageclass:true efk:false freshpod:false gcp-auth:false gvisor:false headlamp:false helm-tiller:false inaccel:false ingress:false ingress-dns:false inspektor-gadget:false istio:false istio-provisioner:false kong:false kubeflow:false kubevirt:false logviewer:false metallb:false metrics-server:true nvidia-device-plugin:false nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:false registry-aliases:false registry-creds:false storage-provisioner:true storage-provisioner-gluster:false storage-provisioner-rancher:false volcano:false volumesnapshots:false yakd:false]
	I0812 13:13:15.343090 1212353 addons.go:69] Setting storage-provisioner=true in profile "old-k8s-version-112335"
	I0812 13:13:15.343120 1212353 addons.go:234] Setting addon storage-provisioner=true in "old-k8s-version-112335"
	W0812 13:13:15.343130 1212353 addons.go:243] addon storage-provisioner should already be in state true
	I0812 13:13:15.343144 1212353 addons.go:69] Setting default-storageclass=true in profile "old-k8s-version-112335"
	I0812 13:13:15.343161 1212353 addons.go:69] Setting metrics-server=true in profile "old-k8s-version-112335"
	I0812 13:13:15.343179 1212353 addons.go:234] Setting addon metrics-server=true in "old-k8s-version-112335"
	W0812 13:13:15.343189 1212353 addons.go:243] addon metrics-server should already be in state true
	I0812 13:13:15.343205 1212353 host.go:66] Checking if "old-k8s-version-112335" exists ...
	I0812 13:13:15.343229 1212353 addons_storage_classes.go:33] enableOrDisableStorageClasses default-storageclass=true on "old-k8s-version-112335"
	I0812 13:13:15.343543 1212353 cli_runner.go:164] Run: docker container inspect old-k8s-version-112335 --format={{.State.Status}}
	I0812 13:13:15.343633 1212353 cli_runner.go:164] Run: docker container inspect old-k8s-version-112335 --format={{.State.Status}}
	I0812 13:13:15.343641 1212353 addons.go:69] Setting dashboard=true in profile "old-k8s-version-112335"
	I0812 13:13:15.345513 1212353 addons.go:234] Setting addon dashboard=true in "old-k8s-version-112335"
	W0812 13:13:15.345539 1212353 addons.go:243] addon dashboard should already be in state true
	I0812 13:13:15.345595 1212353 host.go:66] Checking if "old-k8s-version-112335" exists ...
	I0812 13:13:15.346898 1212353 cli_runner.go:164] Run: docker container inspect old-k8s-version-112335 --format={{.State.Status}}
	I0812 13:13:15.347097 1212353 out.go:177] * Verifying Kubernetes components...
	I0812 13:13:15.343156 1212353 host.go:66] Checking if "old-k8s-version-112335" exists ...
	I0812 13:13:15.347771 1212353 cli_runner.go:164] Run: docker container inspect old-k8s-version-112335 --format={{.State.Status}}
	I0812 13:13:15.349609 1212353 ssh_runner.go:195] Run: sudo systemctl daemon-reload
	I0812 13:13:15.402403 1212353 addons.go:234] Setting addon default-storageclass=true in "old-k8s-version-112335"
	W0812 13:13:15.402421 1212353 addons.go:243] addon default-storageclass should already be in state true
	I0812 13:13:15.402454 1212353 host.go:66] Checking if "old-k8s-version-112335" exists ...
	I0812 13:13:15.402871 1212353 cli_runner.go:164] Run: docker container inspect old-k8s-version-112335 --format={{.State.Status}}
	I0812 13:13:15.424718 1212353 out.go:177]   - Using image registry.k8s.io/echoserver:1.4
	I0812 13:13:15.426860 1212353 out.go:177]   - Using image fake.domain/registry.k8s.io/echoserver:1.4
	I0812 13:13:15.429100 1212353 out.go:177]   - Using image docker.io/kubernetesui/dashboard:v2.7.0
	I0812 13:13:15.429266 1212353 addons.go:431] installing /etc/kubernetes/addons/metrics-apiservice.yaml
	I0812 13:13:15.429281 1212353 ssh_runner.go:362] scp metrics-server/metrics-apiservice.yaml --> /etc/kubernetes/addons/metrics-apiservice.yaml (424 bytes)
	I0812 13:13:15.429392 1212353 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-112335
	I0812 13:13:15.432141 1212353 addons.go:431] installing /etc/kubernetes/addons/dashboard-ns.yaml
	I0812 13:13:15.432162 1212353 ssh_runner.go:362] scp dashboard/dashboard-ns.yaml --> /etc/kubernetes/addons/dashboard-ns.yaml (759 bytes)
	I0812 13:13:15.432227 1212353 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-112335
	I0812 13:13:15.432364 1212353 out.go:177]   - Using image gcr.io/k8s-minikube/storage-provisioner:v5
	I0812 13:13:15.437397 1212353 addons.go:431] installing /etc/kubernetes/addons/storage-provisioner.yaml
	I0812 13:13:15.437427 1212353 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storage-provisioner.yaml (2676 bytes)
	I0812 13:13:15.437495 1212353 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-112335
	I0812 13:13:15.474749 1212353 addons.go:431] installing /etc/kubernetes/addons/storageclass.yaml
	I0812 13:13:15.474783 1212353 ssh_runner.go:362] scp storageclass/storageclass.yaml --> /etc/kubernetes/addons/storageclass.yaml (271 bytes)
	I0812 13:13:15.474856 1212353 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-112335
	I0812 13:13:15.513745 1212353 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:34190 SSHKeyPath:/home/jenkins/minikube-integration/19411-998978/.minikube/machines/old-k8s-version-112335/id_rsa Username:docker}
	I0812 13:13:15.514703 1212353 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:34190 SSHKeyPath:/home/jenkins/minikube-integration/19411-998978/.minikube/machines/old-k8s-version-112335/id_rsa Username:docker}
	I0812 13:13:15.525345 1212353 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:34190 SSHKeyPath:/home/jenkins/minikube-integration/19411-998978/.minikube/machines/old-k8s-version-112335/id_rsa Username:docker}
	I0812 13:13:15.539051 1212353 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:34190 SSHKeyPath:/home/jenkins/minikube-integration/19411-998978/.minikube/machines/old-k8s-version-112335/id_rsa Username:docker}
	I0812 13:13:15.589501 1212353 ssh_runner.go:195] Run: sudo systemctl start kubelet
	I0812 13:13:15.667461 1212353 node_ready.go:35] waiting up to 6m0s for node "old-k8s-version-112335" to be "Ready" ...
	I0812 13:13:15.735106 1212353 addons.go:431] installing /etc/kubernetes/addons/dashboard-clusterrole.yaml
	I0812 13:13:15.735183 1212353 ssh_runner.go:362] scp dashboard/dashboard-clusterrole.yaml --> /etc/kubernetes/addons/dashboard-clusterrole.yaml (1001 bytes)
	I0812 13:13:15.745748 1212353 addons.go:431] installing /etc/kubernetes/addons/metrics-server-deployment.yaml
	I0812 13:13:15.745818 1212353 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-server-deployment.yaml (1825 bytes)
	I0812 13:13:15.797220 1212353 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml
	I0812 13:13:15.813511 1212353 addons.go:431] installing /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml
	I0812 13:13:15.813585 1212353 ssh_runner.go:362] scp dashboard/dashboard-clusterrolebinding.yaml --> /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml (1018 bytes)
	I0812 13:13:15.817076 1212353 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml
	I0812 13:13:15.831729 1212353 addons.go:431] installing /etc/kubernetes/addons/metrics-server-rbac.yaml
	I0812 13:13:15.831805 1212353 ssh_runner.go:362] scp metrics-server/metrics-server-rbac.yaml --> /etc/kubernetes/addons/metrics-server-rbac.yaml (2175 bytes)
	I0812 13:13:15.889184 1212353 addons.go:431] installing /etc/kubernetes/addons/dashboard-configmap.yaml
	I0812 13:13:15.889277 1212353 ssh_runner.go:362] scp dashboard/dashboard-configmap.yaml --> /etc/kubernetes/addons/dashboard-configmap.yaml (837 bytes)
	I0812 13:13:15.947170 1212353 addons.go:431] installing /etc/kubernetes/addons/metrics-server-service.yaml
	I0812 13:13:15.947237 1212353 ssh_runner.go:362] scp metrics-server/metrics-server-service.yaml --> /etc/kubernetes/addons/metrics-server-service.yaml (446 bytes)
	I0812 13:13:15.999065 1212353 addons.go:431] installing /etc/kubernetes/addons/dashboard-dp.yaml
	I0812 13:13:15.999149 1212353 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-dp.yaml (4201 bytes)
	I0812 13:13:16.040131 1212353 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
	I0812 13:13:16.053754 1212353 addons.go:431] installing /etc/kubernetes/addons/dashboard-role.yaml
	I0812 13:13:16.053836 1212353 ssh_runner.go:362] scp dashboard/dashboard-role.yaml --> /etc/kubernetes/addons/dashboard-role.yaml (1724 bytes)
	I0812 13:13:16.133489 1212353 addons.go:431] installing /etc/kubernetes/addons/dashboard-rolebinding.yaml
	I0812 13:13:16.133553 1212353 ssh_runner.go:362] scp dashboard/dashboard-rolebinding.yaml --> /etc/kubernetes/addons/dashboard-rolebinding.yaml (1046 bytes)
	W0812 13:13:16.140604 1212353 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
	stdout:
	
	stderr:
	The connection to the server localhost:8443 was refused - did you specify the right host or port?
	I0812 13:13:16.140694 1212353 retry.go:31] will retry after 139.750557ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
	stdout:
	
	stderr:
	The connection to the server localhost:8443 was refused - did you specify the right host or port?
	W0812 13:13:16.172366 1212353 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
	stdout:
	
	stderr:
	The connection to the server localhost:8443 was refused - did you specify the right host or port?
	I0812 13:13:16.172458 1212353 retry.go:31] will retry after 346.698625ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
	stdout:
	
	stderr:
	The connection to the server localhost:8443 was refused - did you specify the right host or port?
	I0812 13:13:16.208462 1212353 addons.go:431] installing /etc/kubernetes/addons/dashboard-sa.yaml
	I0812 13:13:16.208536 1212353 ssh_runner.go:362] scp dashboard/dashboard-sa.yaml --> /etc/kubernetes/addons/dashboard-sa.yaml (837 bytes)
	W0812 13:13:16.268344 1212353 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
	stdout:
	
	stderr:
	The connection to the server localhost:8443 was refused - did you specify the right host or port?
	I0812 13:13:16.268435 1212353 retry.go:31] will retry after 183.349511ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
	stdout:
	
	stderr:
	The connection to the server localhost:8443 was refused - did you specify the right host or port?
	I0812 13:13:16.277101 1212353 addons.go:431] installing /etc/kubernetes/addons/dashboard-secret.yaml
	I0812 13:13:16.277169 1212353 ssh_runner.go:362] scp dashboard/dashboard-secret.yaml --> /etc/kubernetes/addons/dashboard-secret.yaml (1389 bytes)
	I0812 13:13:16.280737 1212353 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml
	I0812 13:13:16.308402 1212353 addons.go:431] installing /etc/kubernetes/addons/dashboard-svc.yaml
	I0812 13:13:16.308443 1212353 ssh_runner.go:362] scp dashboard/dashboard-svc.yaml --> /etc/kubernetes/addons/dashboard-svc.yaml (1294 bytes)
	I0812 13:13:16.328835 1212353 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
	I0812 13:13:16.452010 1212353 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
	W0812 13:13:16.510331 1212353 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
	stdout:
	
	stderr:
	The connection to the server localhost:8443 was refused - did you specify the right host or port?
	I0812 13:13:16.510429 1212353 retry.go:31] will retry after 245.7002ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
	stdout:
	
	stderr:
	The connection to the server localhost:8443 was refused - did you specify the right host or port?
	W0812 13:13:16.510397 1212353 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
	stdout:
	
	stderr:
	The connection to the server localhost:8443 was refused - did you specify the right host or port?
	I0812 13:13:16.510450 1212353 retry.go:31] will retry after 182.873273ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
	stdout:
	
	stderr:
	The connection to the server localhost:8443 was refused - did you specify the right host or port?
	I0812 13:13:16.519609 1212353 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml
	W0812 13:13:16.665002 1212353 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
	stdout:
	
	stderr:
	The connection to the server localhost:8443 was refused - did you specify the right host or port?
	I0812 13:13:16.665047 1212353 retry.go:31] will retry after 429.980464ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
	stdout:
	
	stderr:
	The connection to the server localhost:8443 was refused - did you specify the right host or port?
	I0812 13:13:16.693732 1212353 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
	W0812 13:13:16.698609 1212353 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
	stdout:
	
	stderr:
	The connection to the server localhost:8443 was refused - did you specify the right host or port?
	I0812 13:13:16.698641 1212353 retry.go:31] will retry after 465.526487ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
	stdout:
	
	stderr:
	The connection to the server localhost:8443 was refused - did you specify the right host or port?
	I0812 13:13:16.756872 1212353 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml
	W0812 13:13:16.801900 1212353 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
	stdout:
	
	stderr:
	The connection to the server localhost:8443 was refused - did you specify the right host or port?
	I0812 13:13:16.801936 1212353 retry.go:31] will retry after 230.028781ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
	stdout:
	
	stderr:
	The connection to the server localhost:8443 was refused - did you specify the right host or port?
	W0812 13:13:16.884618 1212353 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
	stdout:
	
	stderr:
	The connection to the server localhost:8443 was refused - did you specify the right host or port?
	I0812 13:13:16.884648 1212353 retry.go:31] will retry after 660.99364ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
	stdout:
	
	stderr:
	The connection to the server localhost:8443 was refused - did you specify the right host or port?
	I0812 13:13:17.032810 1212353 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
	I0812 13:13:17.095462 1212353 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
	I0812 13:13:17.165039 1212353 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml
	W0812 13:13:17.179251 1212353 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
	stdout:
	
	stderr:
	The connection to the server localhost:8443 was refused - did you specify the right host or port?
	I0812 13:13:17.179348 1212353 retry.go:31] will retry after 586.829471ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
	stdout:
	
	stderr:
	The connection to the server localhost:8443 was refused - did you specify the right host or port?
	W0812 13:13:17.321854 1212353 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
	stdout:
	
	stderr:
	The connection to the server localhost:8443 was refused - did you specify the right host or port?
	I0812 13:13:17.321935 1212353 retry.go:31] will retry after 798.24927ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
	stdout:
	
	stderr:
	The connection to the server localhost:8443 was refused - did you specify the right host or port?
	W0812 13:13:17.378640 1212353 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
	stdout:
	
	stderr:
	The connection to the server localhost:8443 was refused - did you specify the right host or port?
	I0812 13:13:17.378721 1212353 retry.go:31] will retry after 816.108183ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
	stdout:
	
	stderr:
	The connection to the server localhost:8443 was refused - did you specify the right host or port?
	I0812 13:13:17.546116 1212353 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml
	W0812 13:13:17.634628 1212353 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
	stdout:
	
	stderr:
	The connection to the server localhost:8443 was refused - did you specify the right host or port?
	I0812 13:13:17.634700 1212353 retry.go:31] will retry after 1.191192529s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
	stdout:
	
	stderr:
	The connection to the server localhost:8443 was refused - did you specify the right host or port?
	I0812 13:13:17.668298 1212353 node_ready.go:53] error getting node "old-k8s-version-112335": Get "https://192.168.85.2:8443/api/v1/nodes/old-k8s-version-112335": dial tcp 192.168.85.2:8443: connect: connection refused
	I0812 13:13:17.766665 1212353 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
	W0812 13:13:17.858364 1212353 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
	stdout:
	
	stderr:
	The connection to the server localhost:8443 was refused - did you specify the right host or port?
	I0812 13:13:17.858452 1212353 retry.go:31] will retry after 771.160667ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
	stdout:
	
	stderr:
	The connection to the server localhost:8443 was refused - did you specify the right host or port?
	I0812 13:13:18.121001 1212353 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
	I0812 13:13:18.195033 1212353 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml
	W0812 13:13:18.277760 1212353 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
	stdout:
	
	stderr:
	The connection to the server localhost:8443 was refused - did you specify the right host or port?
	I0812 13:13:18.277843 1212353 retry.go:31] will retry after 454.921245ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
	stdout:
	
	stderr:
	The connection to the server localhost:8443 was refused - did you specify the right host or port?
	W0812 13:13:18.323386 1212353 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
	stdout:
	
	stderr:
	The connection to the server localhost:8443 was refused - did you specify the right host or port?
	I0812 13:13:18.323475 1212353 retry.go:31] will retry after 491.890913ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
	stdout:
	
	stderr:
	The connection to the server localhost:8443 was refused - did you specify the right host or port?
	I0812 13:13:18.629833 1212353 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
	W0812 13:13:18.721207 1212353 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
	stdout:
	
	stderr:
	The connection to the server localhost:8443 was refused - did you specify the right host or port?
	I0812 13:13:18.721251 1212353 retry.go:31] will retry after 1.396062045s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
	stdout:
	
	stderr:
	The connection to the server localhost:8443 was refused - did you specify the right host or port?
	I0812 13:13:18.733522 1212353 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
	I0812 13:13:18.815846 1212353 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml
	I0812 13:13:18.826185 1212353 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml
	W0812 13:13:18.836263 1212353 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
	stdout:
	
	stderr:
	The connection to the server localhost:8443 was refused - did you specify the right host or port?
	I0812 13:13:18.836292 1212353 retry.go:31] will retry after 1.568026288s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
	stdout:
	
	stderr:
	The connection to the server localhost:8443 was refused - did you specify the right host or port?
	W0812 13:13:18.951452 1212353 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
	stdout:
	
	stderr:
	The connection to the server localhost:8443 was refused - did you specify the right host or port?
	I0812 13:13:18.951482 1212353 retry.go:31] will retry after 1.381768975s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
	stdout:
	
	stderr:
	The connection to the server localhost:8443 was refused - did you specify the right host or port?
	W0812 13:13:18.998390 1212353 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
	stdout:
	
	stderr:
	The connection to the server localhost:8443 was refused - did you specify the right host or port?
	I0812 13:13:18.998419 1212353 retry.go:31] will retry after 1.018163522s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
	stdout:
	
	stderr:
	The connection to the server localhost:8443 was refused - did you specify the right host or port?
	I0812 13:13:20.017583 1212353 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml
	I0812 13:13:20.117789 1212353 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
	W0812 13:13:20.126724 1212353 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
	stdout:
	
	stderr:
	The connection to the server localhost:8443 was refused - did you specify the right host or port?
	I0812 13:13:20.126761 1212353 retry.go:31] will retry after 1.8849765s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
	stdout:
	
	stderr:
	The connection to the server localhost:8443 was refused - did you specify the right host or port?
	I0812 13:13:20.168307 1212353 node_ready.go:53] error getting node "old-k8s-version-112335": Get "https://192.168.85.2:8443/api/v1/nodes/old-k8s-version-112335": dial tcp 192.168.85.2:8443: connect: connection refused
	W0812 13:13:20.213931 1212353 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
	stdout:
	
	stderr:
	The connection to the server localhost:8443 was refused - did you specify the right host or port?
	I0812 13:13:20.213973 1212353 retry.go:31] will retry after 2.70576006s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
	stdout:
	
	stderr:
	The connection to the server localhost:8443 was refused - did you specify the right host or port?
	I0812 13:13:20.334260 1212353 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml
	W0812 13:13:20.404096 1212353 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
	stdout:
	
	stderr:
	The connection to the server localhost:8443 was refused - did you specify the right host or port?
	I0812 13:13:20.404133 1212353 retry.go:31] will retry after 2.787263419s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
	stdout:
	
	stderr:
	The connection to the server localhost:8443 was refused - did you specify the right host or port?
	I0812 13:13:20.405322 1212353 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
	W0812 13:13:20.474176 1212353 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
	stdout:
	
	stderr:
	The connection to the server localhost:8443 was refused - did you specify the right host or port?
	I0812 13:13:20.474216 1212353 retry.go:31] will retry after 2.190286843s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
	stdout:
	
	stderr:
	The connection to the server localhost:8443 was refused - did you specify the right host or port?
	I0812 13:13:22.012823 1212353 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml
	W0812 13:13:22.146442 1212353 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
	stdout:
	
	stderr:
	The connection to the server localhost:8443 was refused - did you specify the right host or port?
	I0812 13:13:22.146479 1212353 retry.go:31] will retry after 3.967963616s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
	stdout:
	
	stderr:
	The connection to the server localhost:8443 was refused - did you specify the right host or port?
	I0812 13:13:22.665603 1212353 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
	I0812 13:13:22.668195 1212353 node_ready.go:53] error getting node "old-k8s-version-112335": Get "https://192.168.85.2:8443/api/v1/nodes/old-k8s-version-112335": dial tcp 192.168.85.2:8443: connect: connection refused
	W0812 13:13:22.796338 1212353 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
	stdout:
	
	stderr:
	The connection to the server localhost:8443 was refused - did you specify the right host or port?
	I0812 13:13:22.796374 1212353 retry.go:31] will retry after 3.429275829s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
	stdout:
	
	stderr:
	The connection to the server localhost:8443 was refused - did you specify the right host or port?
	I0812 13:13:22.920655 1212353 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
	W0812 13:13:23.042804 1212353 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
	stdout:
	
	stderr:
	The connection to the server localhost:8443 was refused - did you specify the right host or port?
	I0812 13:13:23.042893 1212353 retry.go:31] will retry after 4.092229475s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
	stdout:
	
	stderr:
	The connection to the server localhost:8443 was refused - did you specify the right host or port?
	I0812 13:13:23.191746 1212353 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml
	W0812 13:13:23.408028 1212353 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
	stdout:
	
	stderr:
	The connection to the server localhost:8443 was refused - did you specify the right host or port?
	I0812 13:13:23.408064 1212353 retry.go:31] will retry after 1.56963224s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
	stdout:
	
	stderr:
	The connection to the server localhost:8443 was refused - did you specify the right host or port?
	I0812 13:13:24.978409 1212353 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml
	I0812 13:13:26.114661 1212353 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml
	I0812 13:13:26.226638 1212353 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
	I0812 13:13:27.136124 1212353 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
	I0812 13:13:34.669529 1212353 node_ready.go:53] error getting node "old-k8s-version-112335": Get "https://192.168.85.2:8443/api/v1/nodes/old-k8s-version-112335": net/http: TLS handshake timeout
	I0812 13:13:35.693072 1212353 node_ready.go:49] node "old-k8s-version-112335" has status "Ready":"True"
	I0812 13:13:35.693098 1212353 node_ready.go:38] duration metric: took 20.025547718s for node "old-k8s-version-112335" to be "Ready" ...
	I0812 13:13:35.693107 1212353 pod_ready.go:35] extra waiting up to 6m0s for all system-critical pods including labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
	I0812 13:13:35.964886 1212353 pod_ready.go:78] waiting up to 6m0s for pod "coredns-74ff55c5b-wcjn8" in "kube-system" namespace to be "Ready" ...
	I0812 13:13:36.195143 1212353 pod_ready.go:92] pod "coredns-74ff55c5b-wcjn8" in "kube-system" namespace has status "Ready":"True"
	I0812 13:13:36.195220 1212353 pod_ready.go:81] duration metric: took 230.155583ms for pod "coredns-74ff55c5b-wcjn8" in "kube-system" namespace to be "Ready" ...
	I0812 13:13:36.195247 1212353 pod_ready.go:78] waiting up to 6m0s for pod "etcd-old-k8s-version-112335" in "kube-system" namespace to be "Ready" ...
	I0812 13:13:38.178189 1212353 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: (12.063483479s)
	I0812 13:13:38.178296 1212353 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: (13.199854671s)
	I0812 13:13:38.205531 1212353 pod_ready.go:102] pod "etcd-old-k8s-version-112335" in "kube-system" namespace has status "Ready":"False"
	I0812 13:13:38.780077 1212353 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: (12.553389893s)
	I0812 13:13:38.780172 1212353 addons.go:475] Verifying addon metrics-server=true in "old-k8s-version-112335"
	I0812 13:13:38.964439 1212353 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: (11.828255645s)
	I0812 13:13:38.966367 1212353 out.go:177] * Some dashboard features require the metrics-server addon. To enable all features please run:
	
		minikube -p old-k8s-version-112335 addons enable metrics-server
	
	I0812 13:13:38.968293 1212353 out.go:177] * Enabled addons: storage-provisioner, default-storageclass, metrics-server, dashboard
	I0812 13:13:38.969848 1212353 addons.go:510] duration metric: took 23.626851519s for enable addons: enabled=[storage-provisioner default-storageclass metrics-server dashboard]
	I0812 13:13:40.214817 1212353 pod_ready.go:102] pod "etcd-old-k8s-version-112335" in "kube-system" namespace has status "Ready":"False"
	I0812 13:13:42.215639 1212353 pod_ready.go:102] pod "etcd-old-k8s-version-112335" in "kube-system" namespace has status "Ready":"False"
	I0812 13:13:44.705113 1212353 pod_ready.go:102] pod "etcd-old-k8s-version-112335" in "kube-system" namespace has status "Ready":"False"
	I0812 13:13:47.201087 1212353 pod_ready.go:102] pod "etcd-old-k8s-version-112335" in "kube-system" namespace has status "Ready":"False"
	I0812 13:13:49.702055 1212353 pod_ready.go:102] pod "etcd-old-k8s-version-112335" in "kube-system" namespace has status "Ready":"False"
	I0812 13:13:51.702391 1212353 pod_ready.go:102] pod "etcd-old-k8s-version-112335" in "kube-system" namespace has status "Ready":"False"
	I0812 13:13:54.202822 1212353 pod_ready.go:102] pod "etcd-old-k8s-version-112335" in "kube-system" namespace has status "Ready":"False"
	I0812 13:13:56.212447 1212353 pod_ready.go:102] pod "etcd-old-k8s-version-112335" in "kube-system" namespace has status "Ready":"False"
	I0812 13:13:58.702162 1212353 pod_ready.go:102] pod "etcd-old-k8s-version-112335" in "kube-system" namespace has status "Ready":"False"
	I0812 13:14:01.217861 1212353 pod_ready.go:102] pod "etcd-old-k8s-version-112335" in "kube-system" namespace has status "Ready":"False"
	I0812 13:14:03.704398 1212353 pod_ready.go:102] pod "etcd-old-k8s-version-112335" in "kube-system" namespace has status "Ready":"False"
	I0812 13:14:06.202820 1212353 pod_ready.go:102] pod "etcd-old-k8s-version-112335" in "kube-system" namespace has status "Ready":"False"
	I0812 13:14:08.202894 1212353 pod_ready.go:102] pod "etcd-old-k8s-version-112335" in "kube-system" namespace has status "Ready":"False"
	I0812 13:14:10.206364 1212353 pod_ready.go:102] pod "etcd-old-k8s-version-112335" in "kube-system" namespace has status "Ready":"False"
	I0812 13:14:12.705715 1212353 pod_ready.go:102] pod "etcd-old-k8s-version-112335" in "kube-system" namespace has status "Ready":"False"
	I0812 13:14:15.203393 1212353 pod_ready.go:102] pod "etcd-old-k8s-version-112335" in "kube-system" namespace has status "Ready":"False"
	I0812 13:14:17.701847 1212353 pod_ready.go:102] pod "etcd-old-k8s-version-112335" in "kube-system" namespace has status "Ready":"False"
	I0812 13:14:19.702282 1212353 pod_ready.go:102] pod "etcd-old-k8s-version-112335" in "kube-system" namespace has status "Ready":"False"
	I0812 13:14:21.707618 1212353 pod_ready.go:102] pod "etcd-old-k8s-version-112335" in "kube-system" namespace has status "Ready":"False"
	I0812 13:14:24.202036 1212353 pod_ready.go:102] pod "etcd-old-k8s-version-112335" in "kube-system" namespace has status "Ready":"False"
	I0812 13:14:26.206052 1212353 pod_ready.go:102] pod "etcd-old-k8s-version-112335" in "kube-system" namespace has status "Ready":"False"
	I0812 13:14:28.701523 1212353 pod_ready.go:102] pod "etcd-old-k8s-version-112335" in "kube-system" namespace has status "Ready":"False"
	I0812 13:14:30.704380 1212353 pod_ready.go:102] pod "etcd-old-k8s-version-112335" in "kube-system" namespace has status "Ready":"False"
	I0812 13:14:33.204822 1212353 pod_ready.go:102] pod "etcd-old-k8s-version-112335" in "kube-system" namespace has status "Ready":"False"
	I0812 13:14:35.701336 1212353 pod_ready.go:102] pod "etcd-old-k8s-version-112335" in "kube-system" namespace has status "Ready":"False"
	I0812 13:14:37.702327 1212353 pod_ready.go:102] pod "etcd-old-k8s-version-112335" in "kube-system" namespace has status "Ready":"False"
	I0812 13:14:39.702696 1212353 pod_ready.go:102] pod "etcd-old-k8s-version-112335" in "kube-system" namespace has status "Ready":"False"
	I0812 13:14:41.707023 1212353 pod_ready.go:102] pod "etcd-old-k8s-version-112335" in "kube-system" namespace has status "Ready":"False"
	I0812 13:14:44.201832 1212353 pod_ready.go:102] pod "etcd-old-k8s-version-112335" in "kube-system" namespace has status "Ready":"False"
	I0812 13:14:44.701711 1212353 pod_ready.go:92] pod "etcd-old-k8s-version-112335" in "kube-system" namespace has status "Ready":"True"
	I0812 13:14:44.701738 1212353 pod_ready.go:81] duration metric: took 1m8.506469758s for pod "etcd-old-k8s-version-112335" in "kube-system" namespace to be "Ready" ...
	I0812 13:14:44.701754 1212353 pod_ready.go:78] waiting up to 6m0s for pod "kube-apiserver-old-k8s-version-112335" in "kube-system" namespace to be "Ready" ...
	I0812 13:14:44.709463 1212353 pod_ready.go:92] pod "kube-apiserver-old-k8s-version-112335" in "kube-system" namespace has status "Ready":"True"
	I0812 13:14:44.709491 1212353 pod_ready.go:81] duration metric: took 7.728804ms for pod "kube-apiserver-old-k8s-version-112335" in "kube-system" namespace to be "Ready" ...
	I0812 13:14:44.709503 1212353 pod_ready.go:78] waiting up to 6m0s for pod "kube-controller-manager-old-k8s-version-112335" in "kube-system" namespace to be "Ready" ...
	I0812 13:14:45.746323 1212353 pod_ready.go:92] pod "kube-controller-manager-old-k8s-version-112335" in "kube-system" namespace has status "Ready":"True"
	I0812 13:14:45.746350 1212353 pod_ready.go:81] duration metric: took 1.036838922s for pod "kube-controller-manager-old-k8s-version-112335" in "kube-system" namespace to be "Ready" ...
	I0812 13:14:45.746363 1212353 pod_ready.go:78] waiting up to 6m0s for pod "kube-proxy-n52m2" in "kube-system" namespace to be "Ready" ...
	I0812 13:14:45.752719 1212353 pod_ready.go:92] pod "kube-proxy-n52m2" in "kube-system" namespace has status "Ready":"True"
	I0812 13:14:45.752748 1212353 pod_ready.go:81] duration metric: took 6.375697ms for pod "kube-proxy-n52m2" in "kube-system" namespace to be "Ready" ...
	I0812 13:14:45.752760 1212353 pod_ready.go:78] waiting up to 6m0s for pod "kube-scheduler-old-k8s-version-112335" in "kube-system" namespace to be "Ready" ...
	I0812 13:14:47.761063 1212353 pod_ready.go:102] pod "kube-scheduler-old-k8s-version-112335" in "kube-system" namespace has status "Ready":"False"
	I0812 13:14:49.762509 1212353 pod_ready.go:102] pod "kube-scheduler-old-k8s-version-112335" in "kube-system" namespace has status "Ready":"False"
	I0812 13:14:52.261301 1212353 pod_ready.go:102] pod "kube-scheduler-old-k8s-version-112335" in "kube-system" namespace has status "Ready":"False"
	I0812 13:14:54.759274 1212353 pod_ready.go:102] pod "kube-scheduler-old-k8s-version-112335" in "kube-system" namespace has status "Ready":"False"
	I0812 13:14:56.764060 1212353 pod_ready.go:102] pod "kube-scheduler-old-k8s-version-112335" in "kube-system" namespace has status "Ready":"False"
	I0812 13:14:57.761420 1212353 pod_ready.go:92] pod "kube-scheduler-old-k8s-version-112335" in "kube-system" namespace has status "Ready":"True"
	I0812 13:14:57.761497 1212353 pod_ready.go:81] duration metric: took 12.008728298s for pod "kube-scheduler-old-k8s-version-112335" in "kube-system" namespace to be "Ready" ...
	I0812 13:14:57.761513 1212353 pod_ready.go:78] waiting up to 6m0s for pod "metrics-server-9975d5f86-v2prr" in "kube-system" namespace to be "Ready" ...
	I0812 13:14:59.771660 1212353 pod_ready.go:102] pod "metrics-server-9975d5f86-v2prr" in "kube-system" namespace has status "Ready":"False"
	I0812 13:15:02.269125 1212353 pod_ready.go:102] pod "metrics-server-9975d5f86-v2prr" in "kube-system" namespace has status "Ready":"False"
	I0812 13:15:04.774791 1212353 pod_ready.go:102] pod "metrics-server-9975d5f86-v2prr" in "kube-system" namespace has status "Ready":"False"
	I0812 13:15:07.268350 1212353 pod_ready.go:102] pod "metrics-server-9975d5f86-v2prr" in "kube-system" namespace has status "Ready":"False"
	I0812 13:15:09.269027 1212353 pod_ready.go:102] pod "metrics-server-9975d5f86-v2prr" in "kube-system" namespace has status "Ready":"False"
	I0812 13:15:11.275051 1212353 pod_ready.go:102] pod "metrics-server-9975d5f86-v2prr" in "kube-system" namespace has status "Ready":"False"
	I0812 13:15:13.772386 1212353 pod_ready.go:102] pod "metrics-server-9975d5f86-v2prr" in "kube-system" namespace has status "Ready":"False"
	I0812 13:15:15.775207 1212353 pod_ready.go:102] pod "metrics-server-9975d5f86-v2prr" in "kube-system" namespace has status "Ready":"False"
	I0812 13:15:18.267419 1212353 pod_ready.go:102] pod "metrics-server-9975d5f86-v2prr" in "kube-system" namespace has status "Ready":"False"
	I0812 13:15:20.268104 1212353 pod_ready.go:102] pod "metrics-server-9975d5f86-v2prr" in "kube-system" namespace has status "Ready":"False"
	I0812 13:15:22.268608 1212353 pod_ready.go:102] pod "metrics-server-9975d5f86-v2prr" in "kube-system" namespace has status "Ready":"False"
	I0812 13:15:24.770819 1212353 pod_ready.go:102] pod "metrics-server-9975d5f86-v2prr" in "kube-system" namespace has status "Ready":"False"
	I0812 13:15:27.268094 1212353 pod_ready.go:102] pod "metrics-server-9975d5f86-v2prr" in "kube-system" namespace has status "Ready":"False"
	I0812 13:15:29.768504 1212353 pod_ready.go:102] pod "metrics-server-9975d5f86-v2prr" in "kube-system" namespace has status "Ready":"False"
	I0812 13:15:31.770746 1212353 pod_ready.go:102] pod "metrics-server-9975d5f86-v2prr" in "kube-system" namespace has status "Ready":"False"
	I0812 13:15:33.774295 1212353 pod_ready.go:102] pod "metrics-server-9975d5f86-v2prr" in "kube-system" namespace has status "Ready":"False"
	I0812 13:15:36.267490 1212353 pod_ready.go:102] pod "metrics-server-9975d5f86-v2prr" in "kube-system" namespace has status "Ready":"False"
	I0812 13:15:38.268237 1212353 pod_ready.go:102] pod "metrics-server-9975d5f86-v2prr" in "kube-system" namespace has status "Ready":"False"
	I0812 13:15:40.268330 1212353 pod_ready.go:102] pod "metrics-server-9975d5f86-v2prr" in "kube-system" namespace has status "Ready":"False"
	I0812 13:15:42.269644 1212353 pod_ready.go:102] pod "metrics-server-9975d5f86-v2prr" in "kube-system" namespace has status "Ready":"False"
	I0812 13:15:44.767831 1212353 pod_ready.go:102] pod "metrics-server-9975d5f86-v2prr" in "kube-system" namespace has status "Ready":"False"
	I0812 13:15:46.770637 1212353 pod_ready.go:102] pod "metrics-server-9975d5f86-v2prr" in "kube-system" namespace has status "Ready":"False"
	I0812 13:15:48.771458 1212353 pod_ready.go:102] pod "metrics-server-9975d5f86-v2prr" in "kube-system" namespace has status "Ready":"False"
	I0812 13:15:50.774151 1212353 pod_ready.go:102] pod "metrics-server-9975d5f86-v2prr" in "kube-system" namespace has status "Ready":"False"
	I0812 13:15:53.268215 1212353 pod_ready.go:102] pod "metrics-server-9975d5f86-v2prr" in "kube-system" namespace has status "Ready":"False"
	I0812 13:15:55.268614 1212353 pod_ready.go:102] pod "metrics-server-9975d5f86-v2prr" in "kube-system" namespace has status "Ready":"False"
	I0812 13:15:57.773061 1212353 pod_ready.go:102] pod "metrics-server-9975d5f86-v2prr" in "kube-system" namespace has status "Ready":"False"
	I0812 13:15:59.775190 1212353 pod_ready.go:102] pod "metrics-server-9975d5f86-v2prr" in "kube-system" namespace has status "Ready":"False"
	I0812 13:16:02.269116 1212353 pod_ready.go:102] pod "metrics-server-9975d5f86-v2prr" in "kube-system" namespace has status "Ready":"False"
	I0812 13:16:04.770448 1212353 pod_ready.go:102] pod "metrics-server-9975d5f86-v2prr" in "kube-system" namespace has status "Ready":"False"
	I0812 13:16:06.777529 1212353 pod_ready.go:102] pod "metrics-server-9975d5f86-v2prr" in "kube-system" namespace has status "Ready":"False"
	I0812 13:16:09.270556 1212353 pod_ready.go:102] pod "metrics-server-9975d5f86-v2prr" in "kube-system" namespace has status "Ready":"False"
	I0812 13:16:11.771774 1212353 pod_ready.go:102] pod "metrics-server-9975d5f86-v2prr" in "kube-system" namespace has status "Ready":"False"
	I0812 13:16:13.772576 1212353 pod_ready.go:102] pod "metrics-server-9975d5f86-v2prr" in "kube-system" namespace has status "Ready":"False"
	I0812 13:16:16.268962 1212353 pod_ready.go:102] pod "metrics-server-9975d5f86-v2prr" in "kube-system" namespace has status "Ready":"False"
	I0812 13:16:18.269941 1212353 pod_ready.go:102] pod "metrics-server-9975d5f86-v2prr" in "kube-system" namespace has status "Ready":"False"
	I0812 13:16:20.773813 1212353 pod_ready.go:102] pod "metrics-server-9975d5f86-v2prr" in "kube-system" namespace has status "Ready":"False"
	I0812 13:16:23.271139 1212353 pod_ready.go:102] pod "metrics-server-9975d5f86-v2prr" in "kube-system" namespace has status "Ready":"False"
	I0812 13:16:25.772404 1212353 pod_ready.go:102] pod "metrics-server-9975d5f86-v2prr" in "kube-system" namespace has status "Ready":"False"
	I0812 13:16:28.268016 1212353 pod_ready.go:102] pod "metrics-server-9975d5f86-v2prr" in "kube-system" namespace has status "Ready":"False"
	I0812 13:16:30.268943 1212353 pod_ready.go:102] pod "metrics-server-9975d5f86-v2prr" in "kube-system" namespace has status "Ready":"False"
	I0812 13:16:32.773654 1212353 pod_ready.go:102] pod "metrics-server-9975d5f86-v2prr" in "kube-system" namespace has status "Ready":"False"
	I0812 13:16:35.268497 1212353 pod_ready.go:102] pod "metrics-server-9975d5f86-v2prr" in "kube-system" namespace has status "Ready":"False"
	I0812 13:16:37.268595 1212353 pod_ready.go:102] pod "metrics-server-9975d5f86-v2prr" in "kube-system" namespace has status "Ready":"False"
	I0812 13:16:39.772005 1212353 pod_ready.go:102] pod "metrics-server-9975d5f86-v2prr" in "kube-system" namespace has status "Ready":"False"
	I0812 13:16:41.772190 1212353 pod_ready.go:102] pod "metrics-server-9975d5f86-v2prr" in "kube-system" namespace has status "Ready":"False"
	I0812 13:16:43.774070 1212353 pod_ready.go:102] pod "metrics-server-9975d5f86-v2prr" in "kube-system" namespace has status "Ready":"False"
	I0812 13:16:46.268831 1212353 pod_ready.go:102] pod "metrics-server-9975d5f86-v2prr" in "kube-system" namespace has status "Ready":"False"
	I0812 13:16:48.269080 1212353 pod_ready.go:102] pod "metrics-server-9975d5f86-v2prr" in "kube-system" namespace has status "Ready":"False"
	I0812 13:16:50.774017 1212353 pod_ready.go:102] pod "metrics-server-9975d5f86-v2prr" in "kube-system" namespace has status "Ready":"False"
	I0812 13:16:53.268017 1212353 pod_ready.go:102] pod "metrics-server-9975d5f86-v2prr" in "kube-system" namespace has status "Ready":"False"
	I0812 13:16:55.268570 1212353 pod_ready.go:102] pod "metrics-server-9975d5f86-v2prr" in "kube-system" namespace has status "Ready":"False"
	I0812 13:16:57.268625 1212353 pod_ready.go:102] pod "metrics-server-9975d5f86-v2prr" in "kube-system" namespace has status "Ready":"False"
	I0812 13:16:59.789130 1212353 pod_ready.go:102] pod "metrics-server-9975d5f86-v2prr" in "kube-system" namespace has status "Ready":"False"
	I0812 13:17:02.269719 1212353 pod_ready.go:102] pod "metrics-server-9975d5f86-v2prr" in "kube-system" namespace has status "Ready":"False"
	I0812 13:17:04.771239 1212353 pod_ready.go:102] pod "metrics-server-9975d5f86-v2prr" in "kube-system" namespace has status "Ready":"False"
	I0812 13:17:06.772325 1212353 pod_ready.go:102] pod "metrics-server-9975d5f86-v2prr" in "kube-system" namespace has status "Ready":"False"
	I0812 13:17:08.773089 1212353 pod_ready.go:102] pod "metrics-server-9975d5f86-v2prr" in "kube-system" namespace has status "Ready":"False"
	I0812 13:17:11.268488 1212353 pod_ready.go:102] pod "metrics-server-9975d5f86-v2prr" in "kube-system" namespace has status "Ready":"False"
	I0812 13:17:13.268778 1212353 pod_ready.go:102] pod "metrics-server-9975d5f86-v2prr" in "kube-system" namespace has status "Ready":"False"
	I0812 13:17:15.268865 1212353 pod_ready.go:102] pod "metrics-server-9975d5f86-v2prr" in "kube-system" namespace has status "Ready":"False"
	I0812 13:17:17.771826 1212353 pod_ready.go:102] pod "metrics-server-9975d5f86-v2prr" in "kube-system" namespace has status "Ready":"False"
	I0812 13:17:20.268580 1212353 pod_ready.go:102] pod "metrics-server-9975d5f86-v2prr" in "kube-system" namespace has status "Ready":"False"
	I0812 13:17:22.773123 1212353 pod_ready.go:102] pod "metrics-server-9975d5f86-v2prr" in "kube-system" namespace has status "Ready":"False"
	I0812 13:17:25.268014 1212353 pod_ready.go:102] pod "metrics-server-9975d5f86-v2prr" in "kube-system" namespace has status "Ready":"False"
	I0812 13:17:27.770470 1212353 pod_ready.go:102] pod "metrics-server-9975d5f86-v2prr" in "kube-system" namespace has status "Ready":"False"
	I0812 13:17:29.773568 1212353 pod_ready.go:102] pod "metrics-server-9975d5f86-v2prr" in "kube-system" namespace has status "Ready":"False"
	I0812 13:17:32.268535 1212353 pod_ready.go:102] pod "metrics-server-9975d5f86-v2prr" in "kube-system" namespace has status "Ready":"False"
	I0812 13:17:34.771797 1212353 pod_ready.go:102] pod "metrics-server-9975d5f86-v2prr" in "kube-system" namespace has status "Ready":"False"
	I0812 13:17:36.772006 1212353 pod_ready.go:102] pod "metrics-server-9975d5f86-v2prr" in "kube-system" namespace has status "Ready":"False"
	I0812 13:17:38.773178 1212353 pod_ready.go:102] pod "metrics-server-9975d5f86-v2prr" in "kube-system" namespace has status "Ready":"False"
	I0812 13:17:41.268084 1212353 pod_ready.go:102] pod "metrics-server-9975d5f86-v2prr" in "kube-system" namespace has status "Ready":"False"
	I0812 13:17:43.268698 1212353 pod_ready.go:102] pod "metrics-server-9975d5f86-v2prr" in "kube-system" namespace has status "Ready":"False"
	I0812 13:17:45.287546 1212353 pod_ready.go:102] pod "metrics-server-9975d5f86-v2prr" in "kube-system" namespace has status "Ready":"False"
	I0812 13:17:47.768099 1212353 pod_ready.go:102] pod "metrics-server-9975d5f86-v2prr" in "kube-system" namespace has status "Ready":"False"
	I0812 13:17:49.773320 1212353 pod_ready.go:102] pod "metrics-server-9975d5f86-v2prr" in "kube-system" namespace has status "Ready":"False"
	I0812 13:17:52.267735 1212353 pod_ready.go:102] pod "metrics-server-9975d5f86-v2prr" in "kube-system" namespace has status "Ready":"False"
	I0812 13:17:54.771606 1212353 pod_ready.go:102] pod "metrics-server-9975d5f86-v2prr" in "kube-system" namespace has status "Ready":"False"
	I0812 13:17:57.339889 1212353 pod_ready.go:102] pod "metrics-server-9975d5f86-v2prr" in "kube-system" namespace has status "Ready":"False"
	I0812 13:17:59.767088 1212353 pod_ready.go:102] pod "metrics-server-9975d5f86-v2prr" in "kube-system" namespace has status "Ready":"False"
	I0812 13:18:01.771684 1212353 pod_ready.go:102] pod "metrics-server-9975d5f86-v2prr" in "kube-system" namespace has status "Ready":"False"
	I0812 13:18:03.773601 1212353 pod_ready.go:102] pod "metrics-server-9975d5f86-v2prr" in "kube-system" namespace has status "Ready":"False"
	I0812 13:18:06.269410 1212353 pod_ready.go:102] pod "metrics-server-9975d5f86-v2prr" in "kube-system" namespace has status "Ready":"False"
	I0812 13:18:08.772370 1212353 pod_ready.go:102] pod "metrics-server-9975d5f86-v2prr" in "kube-system" namespace has status "Ready":"False"
	I0812 13:18:10.772581 1212353 pod_ready.go:102] pod "metrics-server-9975d5f86-v2prr" in "kube-system" namespace has status "Ready":"False"
	I0812 13:18:12.776229 1212353 pod_ready.go:102] pod "metrics-server-9975d5f86-v2prr" in "kube-system" namespace has status "Ready":"False"
	I0812 13:18:15.268470 1212353 pod_ready.go:102] pod "metrics-server-9975d5f86-v2prr" in "kube-system" namespace has status "Ready":"False"
	I0812 13:18:17.268522 1212353 pod_ready.go:102] pod "metrics-server-9975d5f86-v2prr" in "kube-system" namespace has status "Ready":"False"
	I0812 13:18:19.774880 1212353 pod_ready.go:102] pod "metrics-server-9975d5f86-v2prr" in "kube-system" namespace has status "Ready":"False"
	I0812 13:18:22.270323 1212353 pod_ready.go:102] pod "metrics-server-9975d5f86-v2prr" in "kube-system" namespace has status "Ready":"False"
	I0812 13:18:24.270846 1212353 pod_ready.go:102] pod "metrics-server-9975d5f86-v2prr" in "kube-system" namespace has status "Ready":"False"
	I0812 13:18:26.771783 1212353 pod_ready.go:102] pod "metrics-server-9975d5f86-v2prr" in "kube-system" namespace has status "Ready":"False"
	I0812 13:18:28.772055 1212353 pod_ready.go:102] pod "metrics-server-9975d5f86-v2prr" in "kube-system" namespace has status "Ready":"False"
	I0812 13:18:30.773334 1212353 pod_ready.go:102] pod "metrics-server-9975d5f86-v2prr" in "kube-system" namespace has status "Ready":"False"
	I0812 13:18:33.268406 1212353 pod_ready.go:102] pod "metrics-server-9975d5f86-v2prr" in "kube-system" namespace has status "Ready":"False"
	I0812 13:18:35.268696 1212353 pod_ready.go:102] pod "metrics-server-9975d5f86-v2prr" in "kube-system" namespace has status "Ready":"False"
	I0812 13:18:37.274871 1212353 pod_ready.go:102] pod "metrics-server-9975d5f86-v2prr" in "kube-system" namespace has status "Ready":"False"
	I0812 13:18:39.773640 1212353 pod_ready.go:102] pod "metrics-server-9975d5f86-v2prr" in "kube-system" namespace has status "Ready":"False"
	I0812 13:18:41.777905 1212353 pod_ready.go:102] pod "metrics-server-9975d5f86-v2prr" in "kube-system" namespace has status "Ready":"False"
	I0812 13:18:44.268062 1212353 pod_ready.go:102] pod "metrics-server-9975d5f86-v2prr" in "kube-system" namespace has status "Ready":"False"
	I0812 13:18:46.272890 1212353 pod_ready.go:102] pod "metrics-server-9975d5f86-v2prr" in "kube-system" namespace has status "Ready":"False"
	I0812 13:18:48.772726 1212353 pod_ready.go:102] pod "metrics-server-9975d5f86-v2prr" in "kube-system" namespace has status "Ready":"False"
	I0812 13:18:51.268594 1212353 pod_ready.go:102] pod "metrics-server-9975d5f86-v2prr" in "kube-system" namespace has status "Ready":"False"
	I0812 13:18:53.269616 1212353 pod_ready.go:102] pod "metrics-server-9975d5f86-v2prr" in "kube-system" namespace has status "Ready":"False"
	I0812 13:18:55.777509 1212353 pod_ready.go:102] pod "metrics-server-9975d5f86-v2prr" in "kube-system" namespace has status "Ready":"False"
	I0812 13:18:57.771553 1212353 pod_ready.go:81] duration metric: took 4m0.010025453s for pod "metrics-server-9975d5f86-v2prr" in "kube-system" namespace to be "Ready" ...
	E0812 13:18:57.771579 1212353 pod_ready.go:66] WaitExtra: waitPodCondition: context deadline exceeded
	I0812 13:18:57.771589 1212353 pod_ready.go:38] duration metric: took 5m22.078471457s for extra waiting for all system-critical and pods with labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
	I0812 13:18:57.771605 1212353 api_server.go:52] waiting for apiserver process to appear ...
	I0812 13:18:57.771652 1212353 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-apiserver Namespaces:[]}
	I0812 13:18:57.771721 1212353 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
	I0812 13:18:57.824798 1212353 cri.go:89] found id: "e4cf465775a34b80fbfbd63dc4f0643c8d6a61c508c1c06d6e58548109c82a20"
	I0812 13:18:57.824825 1212353 cri.go:89] found id: "bf352ab2c17cc4485d3b3f899d758963b292f9829240ec0e4e650d678908e30a"
	I0812 13:18:57.824829 1212353 cri.go:89] found id: ""
	I0812 13:18:57.824836 1212353 logs.go:276] 2 containers: [e4cf465775a34b80fbfbd63dc4f0643c8d6a61c508c1c06d6e58548109c82a20 bf352ab2c17cc4485d3b3f899d758963b292f9829240ec0e4e650d678908e30a]
	I0812 13:18:57.824894 1212353 ssh_runner.go:195] Run: which crictl
	I0812 13:18:57.837920 1212353 ssh_runner.go:195] Run: which crictl
	I0812 13:18:57.841739 1212353 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:etcd Namespaces:[]}
	I0812 13:18:57.841813 1212353 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
	I0812 13:18:57.892706 1212353 cri.go:89] found id: "8cc926d2c577f511b103d70b73314019d0ec31451c321551981ab0306c91088f"
	I0812 13:18:57.892726 1212353 cri.go:89] found id: "39f629658753d4fd7ceceee2f8ec0ffc8c98db08a6b70240ea91f87cd6dcee03"
	I0812 13:18:57.892731 1212353 cri.go:89] found id: ""
	I0812 13:18:57.892737 1212353 logs.go:276] 2 containers: [8cc926d2c577f511b103d70b73314019d0ec31451c321551981ab0306c91088f 39f629658753d4fd7ceceee2f8ec0ffc8c98db08a6b70240ea91f87cd6dcee03]
	I0812 13:18:57.892796 1212353 ssh_runner.go:195] Run: which crictl
	I0812 13:18:57.896501 1212353 ssh_runner.go:195] Run: which crictl
	I0812 13:18:57.899951 1212353 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:coredns Namespaces:[]}
	I0812 13:18:57.900027 1212353 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
	I0812 13:18:57.937732 1212353 cri.go:89] found id: "d01d8e8aeec0f477f1c58244a66d7f7b8fb10d090d3d987c0469a55648945b18"
	I0812 13:18:57.937752 1212353 cri.go:89] found id: "7f8e543bcce0c03b365394bc942dab039d350b1340f5856f43b90551a5645f67"
	I0812 13:18:57.937757 1212353 cri.go:89] found id: ""
	I0812 13:18:57.937765 1212353 logs.go:276] 2 containers: [d01d8e8aeec0f477f1c58244a66d7f7b8fb10d090d3d987c0469a55648945b18 7f8e543bcce0c03b365394bc942dab039d350b1340f5856f43b90551a5645f67]
	I0812 13:18:57.937821 1212353 ssh_runner.go:195] Run: which crictl
	I0812 13:18:57.941685 1212353 ssh_runner.go:195] Run: which crictl
	I0812 13:18:57.945579 1212353 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-scheduler Namespaces:[]}
	I0812 13:18:57.945653 1212353 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
	I0812 13:18:57.990841 1212353 cri.go:89] found id: "b27ed17bf7551f01faf083be84883f36e5f141508c39cfd28e4ca7bf298a5ef2"
	I0812 13:18:57.990880 1212353 cri.go:89] found id: "7b67a4fc117cb884b3aec00880229a7613be0e0af79872ccc25b2ef06932d06f"
	I0812 13:18:57.990886 1212353 cri.go:89] found id: ""
	I0812 13:18:57.990894 1212353 logs.go:276] 2 containers: [b27ed17bf7551f01faf083be84883f36e5f141508c39cfd28e4ca7bf298a5ef2 7b67a4fc117cb884b3aec00880229a7613be0e0af79872ccc25b2ef06932d06f]
	I0812 13:18:57.990971 1212353 ssh_runner.go:195] Run: which crictl
	I0812 13:18:57.994668 1212353 ssh_runner.go:195] Run: which crictl
	I0812 13:18:57.998773 1212353 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-proxy Namespaces:[]}
	I0812 13:18:57.998847 1212353 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
	I0812 13:18:58.040560 1212353 cri.go:89] found id: "2af20ac6f2602d8c076b3bed058353203858c5832593d98d2de3ccc55cbf9c7d"
	I0812 13:18:58.040637 1212353 cri.go:89] found id: "e6326fb96d89ee49b3da7ef3f75a5f41a53b9acb3526ac907bf55dfcc30b8d6c"
	I0812 13:18:58.040657 1212353 cri.go:89] found id: ""
	I0812 13:18:58.040681 1212353 logs.go:276] 2 containers: [2af20ac6f2602d8c076b3bed058353203858c5832593d98d2de3ccc55cbf9c7d e6326fb96d89ee49b3da7ef3f75a5f41a53b9acb3526ac907bf55dfcc30b8d6c]
	I0812 13:18:58.040770 1212353 ssh_runner.go:195] Run: which crictl
	I0812 13:18:58.045956 1212353 ssh_runner.go:195] Run: which crictl
	I0812 13:18:58.050020 1212353 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-controller-manager Namespaces:[]}
	I0812 13:18:58.050105 1212353 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
	I0812 13:18:58.098231 1212353 cri.go:89] found id: "533139b834baffb74463be6b648bfd76085ea1587efa7aa575c1e09af6ee13da"
	I0812 13:18:58.098252 1212353 cri.go:89] found id: "8dc43146b8eece1e84ac23cedd68a17cad2d2457bc209bbe351bbfa0454d1bc2"
	I0812 13:18:58.098258 1212353 cri.go:89] found id: ""
	I0812 13:18:58.098265 1212353 logs.go:276] 2 containers: [533139b834baffb74463be6b648bfd76085ea1587efa7aa575c1e09af6ee13da 8dc43146b8eece1e84ac23cedd68a17cad2d2457bc209bbe351bbfa0454d1bc2]
	I0812 13:18:58.098322 1212353 ssh_runner.go:195] Run: which crictl
	I0812 13:18:58.102115 1212353 ssh_runner.go:195] Run: which crictl
	I0812 13:18:58.105588 1212353 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kindnet Namespaces:[]}
	I0812 13:18:58.105663 1212353 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet
	I0812 13:18:58.151543 1212353 cri.go:89] found id: "6f8e38e073e1197c4df808103d10e92b26179a23da02465137f194bb4e1b5dfe"
	I0812 13:18:58.151565 1212353 cri.go:89] found id: "162b80fe4af51619d233d78c0c67ed2c8e6f24d40ec23dd44a431d1b76caed13"
	I0812 13:18:58.151570 1212353 cri.go:89] found id: ""
	I0812 13:18:58.151577 1212353 logs.go:276] 2 containers: [6f8e38e073e1197c4df808103d10e92b26179a23da02465137f194bb4e1b5dfe 162b80fe4af51619d233d78c0c67ed2c8e6f24d40ec23dd44a431d1b76caed13]
	I0812 13:18:58.151664 1212353 ssh_runner.go:195] Run: which crictl
	I0812 13:18:58.156468 1212353 ssh_runner.go:195] Run: which crictl
	I0812 13:18:58.160243 1212353 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kubernetes-dashboard Namespaces:[]}
	I0812 13:18:58.160369 1212353 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kubernetes-dashboard
	I0812 13:18:58.199672 1212353 cri.go:89] found id: "19e7d460788a0ea1f90292f01072ce22cf88076ab7cc590b1b16483fb405d505"
	I0812 13:18:58.199697 1212353 cri.go:89] found id: ""
	I0812 13:18:58.199706 1212353 logs.go:276] 1 containers: [19e7d460788a0ea1f90292f01072ce22cf88076ab7cc590b1b16483fb405d505]
	I0812 13:18:58.199788 1212353 ssh_runner.go:195] Run: which crictl
	I0812 13:18:58.203434 1212353 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:storage-provisioner Namespaces:[]}
	I0812 13:18:58.203508 1212353 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=storage-provisioner
	I0812 13:18:58.250884 1212353 cri.go:89] found id: "b8ecac9f4ddfb227119bf73b728923825eb3a038f35063eed01a12b20b1560d7"
	I0812 13:18:58.250949 1212353 cri.go:89] found id: "2924918d73f931bf85384ca7b1f96cf6760849232fe33069fff149704e2ae596"
	I0812 13:18:58.250968 1212353 cri.go:89] found id: ""
	I0812 13:18:58.250997 1212353 logs.go:276] 2 containers: [b8ecac9f4ddfb227119bf73b728923825eb3a038f35063eed01a12b20b1560d7 2924918d73f931bf85384ca7b1f96cf6760849232fe33069fff149704e2ae596]
	I0812 13:18:58.251087 1212353 ssh_runner.go:195] Run: which crictl
	I0812 13:18:58.255286 1212353 ssh_runner.go:195] Run: which crictl
	I0812 13:18:58.259098 1212353 logs.go:123] Gathering logs for coredns [d01d8e8aeec0f477f1c58244a66d7f7b8fb10d090d3d987c0469a55648945b18] ...
	I0812 13:18:58.259125 1212353 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 d01d8e8aeec0f477f1c58244a66d7f7b8fb10d090d3d987c0469a55648945b18"
	I0812 13:18:58.300179 1212353 logs.go:123] Gathering logs for kubernetes-dashboard [19e7d460788a0ea1f90292f01072ce22cf88076ab7cc590b1b16483fb405d505] ...
	I0812 13:18:58.300214 1212353 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 19e7d460788a0ea1f90292f01072ce22cf88076ab7cc590b1b16483fb405d505"
	I0812 13:18:58.341477 1212353 logs.go:123] Gathering logs for container status ...
	I0812 13:18:58.341504 1212353 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
	I0812 13:18:58.393209 1212353 logs.go:123] Gathering logs for kubelet ...
	I0812 13:18:58.393297 1212353 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
	W0812 13:18:58.459125 1212353 logs.go:138] Found kubelet problem: Aug 12 13:13:35 old-k8s-version-112335 kubelet[671]: E0812 13:13:35.526602     671 reflector.go:138] object-"kube-system"/"kube-proxy": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "kube-proxy" is forbidden: User "system:node:old-k8s-version-112335" cannot list resource "configmaps" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-112335' and this object
	W0812 13:18:58.459416 1212353 logs.go:138] Found kubelet problem: Aug 12 13:13:35 old-k8s-version-112335 kubelet[671]: E0812 13:13:35.531551     671 reflector.go:138] object-"kube-system"/"kube-proxy-token-spdxp": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "kube-proxy-token-spdxp" is forbidden: User "system:node:old-k8s-version-112335" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-112335' and this object
	W0812 13:18:58.459664 1212353 logs.go:138] Found kubelet problem: Aug 12 13:13:35 old-k8s-version-112335 kubelet[671]: E0812 13:13:35.531828     671 reflector.go:138] object-"kube-system"/"kindnet-token-bnvnb": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "kindnet-token-bnvnb" is forbidden: User "system:node:old-k8s-version-112335" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-112335' and this object
	W0812 13:18:58.459908 1212353 logs.go:138] Found kubelet problem: Aug 12 13:13:35 old-k8s-version-112335 kubelet[671]: E0812 13:13:35.543185     671 reflector.go:138] object-"kube-system"/"coredns-token-wj7tz": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "coredns-token-wj7tz" is forbidden: User "system:node:old-k8s-version-112335" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-112335' and this object
	W0812 13:18:58.460144 1212353 logs.go:138] Found kubelet problem: Aug 12 13:13:35 old-k8s-version-112335 kubelet[671]: E0812 13:13:35.565702     671 reflector.go:138] object-"default"/"default-token-nqvmq": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "default-token-nqvmq" is forbidden: User "system:node:old-k8s-version-112335" cannot list resource "secrets" in API group "" in the namespace "default": no relationship found between node 'old-k8s-version-112335' and this object
	W0812 13:18:58.460414 1212353 logs.go:138] Found kubelet problem: Aug 12 13:13:35 old-k8s-version-112335 kubelet[671]: E0812 13:13:35.565958     671 reflector.go:138] object-"kube-system"/"storage-provisioner-token-cmdsj": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "storage-provisioner-token-cmdsj" is forbidden: User "system:node:old-k8s-version-112335" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-112335' and this object
	W0812 13:18:58.460637 1212353 logs.go:138] Found kubelet problem: Aug 12 13:13:35 old-k8s-version-112335 kubelet[671]: E0812 13:13:35.566053     671 reflector.go:138] object-"kube-system"/"coredns": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "coredns" is forbidden: User "system:node:old-k8s-version-112335" cannot list resource "configmaps" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-112335' and this object
	W0812 13:18:58.460886 1212353 logs.go:138] Found kubelet problem: Aug 12 13:13:35 old-k8s-version-112335 kubelet[671]: E0812 13:13:35.590326     671 reflector.go:138] object-"kube-system"/"metrics-server-token-ngnjg": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "metrics-server-token-ngnjg" is forbidden: User "system:node:old-k8s-version-112335" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-112335' and this object
	W0812 13:18:58.471962 1212353 logs.go:138] Found kubelet problem: Aug 12 13:13:39 old-k8s-version-112335 kubelet[671]: E0812 13:13:39.806774     671 pod_workers.go:191] Error syncing pod 34d824a4-d65e-4566-b95e-8f00f2c6fc71 ("metrics-server-9975d5f86-v2prr_kube-system(34d824a4-d65e-4566-b95e-8f00f2c6fc71)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.85.1:53: no such host"
	W0812 13:18:58.472283 1212353 logs.go:138] Found kubelet problem: Aug 12 13:13:40 old-k8s-version-112335 kubelet[671]: E0812 13:13:40.760714     671 pod_workers.go:191] Error syncing pod 34d824a4-d65e-4566-b95e-8f00f2c6fc71 ("metrics-server-9975d5f86-v2prr_kube-system(34d824a4-d65e-4566-b95e-8f00f2c6fc71)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W0812 13:18:58.477587 1212353 logs.go:138] Found kubelet problem: Aug 12 13:14:04 old-k8s-version-112335 kubelet[671]: E0812 13:14:04.278650     671 pod_workers.go:191] Error syncing pod 34d824a4-d65e-4566-b95e-8f00f2c6fc71 ("metrics-server-9975d5f86-v2prr_kube-system(34d824a4-d65e-4566-b95e-8f00f2c6fc71)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.85.1:53: no such host"
	W0812 13:18:58.478168 1212353 logs.go:138] Found kubelet problem: Aug 12 13:14:05 old-k8s-version-112335 kubelet[671]: E0812 13:14:05.847014     671 pod_workers.go:191] Error syncing pod 98eb45e0-5ebb-4a91-950c-b25211aceb65 ("dashboard-metrics-scraper-8d5bb5db8-6w7h6_kubernetes-dashboard(98eb45e0-5ebb-4a91-950c-b25211aceb65)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 10s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-6w7h6_kubernetes-dashboard(98eb45e0-5ebb-4a91-950c-b25211aceb65)"
	W0812 13:18:58.478723 1212353 logs.go:138] Found kubelet problem: Aug 12 13:14:06 old-k8s-version-112335 kubelet[671]: E0812 13:14:06.851261     671 pod_workers.go:191] Error syncing pod 98eb45e0-5ebb-4a91-950c-b25211aceb65 ("dashboard-metrics-scraper-8d5bb5db8-6w7h6_kubernetes-dashboard(98eb45e0-5ebb-4a91-950c-b25211aceb65)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 10s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-6w7h6_kubernetes-dashboard(98eb45e0-5ebb-4a91-950c-b25211aceb65)"
	W0812 13:18:58.479288 1212353 logs.go:138] Found kubelet problem: Aug 12 13:14:09 old-k8s-version-112335 kubelet[671]: E0812 13:14:09.866088     671 pod_workers.go:191] Error syncing pod 3c993bf4-fc61-4ad4-9f3b-a2c99cce757e ("storage-provisioner_kube-system(3c993bf4-fc61-4ad4-9f3b-a2c99cce757e)"), skipping: failed to "StartContainer" for "storage-provisioner" with CrashLoopBackOff: "back-off 10s restarting failed container=storage-provisioner pod=storage-provisioner_kube-system(3c993bf4-fc61-4ad4-9f3b-a2c99cce757e)"
	W0812 13:18:58.479700 1212353 logs.go:138] Found kubelet problem: Aug 12 13:14:12 old-k8s-version-112335 kubelet[671]: E0812 13:14:12.967750     671 pod_workers.go:191] Error syncing pod 98eb45e0-5ebb-4a91-950c-b25211aceb65 ("dashboard-metrics-scraper-8d5bb5db8-6w7h6_kubernetes-dashboard(98eb45e0-5ebb-4a91-950c-b25211aceb65)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 10s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-6w7h6_kubernetes-dashboard(98eb45e0-5ebb-4a91-950c-b25211aceb65)"
	W0812 13:18:58.480320 1212353 logs.go:138] Found kubelet problem: Aug 12 13:14:17 old-k8s-version-112335 kubelet[671]: E0812 13:14:17.357070     671 pod_workers.go:191] Error syncing pod 34d824a4-d65e-4566-b95e-8f00f2c6fc71 ("metrics-server-9975d5f86-v2prr_kube-system(34d824a4-d65e-4566-b95e-8f00f2c6fc71)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W0812 13:18:58.481096 1212353 logs.go:138] Found kubelet problem: Aug 12 13:14:25 old-k8s-version-112335 kubelet[671]: E0812 13:14:25.914407     671 pod_workers.go:191] Error syncing pod 98eb45e0-5ebb-4a91-950c-b25211aceb65 ("dashboard-metrics-scraper-8d5bb5db8-6w7h6_kubernetes-dashboard(98eb45e0-5ebb-4a91-950c-b25211aceb65)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-6w7h6_kubernetes-dashboard(98eb45e0-5ebb-4a91-950c-b25211aceb65)"
	W0812 13:18:58.483851 1212353 logs.go:138] Found kubelet problem: Aug 12 13:14:32 old-k8s-version-112335 kubelet[671]: E0812 13:14:32.368369     671 pod_workers.go:191] Error syncing pod 34d824a4-d65e-4566-b95e-8f00f2c6fc71 ("metrics-server-9975d5f86-v2prr_kube-system(34d824a4-d65e-4566-b95e-8f00f2c6fc71)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.85.1:53: no such host"
	W0812 13:18:58.484240 1212353 logs.go:138] Found kubelet problem: Aug 12 13:14:32 old-k8s-version-112335 kubelet[671]: E0812 13:14:32.966383     671 pod_workers.go:191] Error syncing pod 98eb45e0-5ebb-4a91-950c-b25211aceb65 ("dashboard-metrics-scraper-8d5bb5db8-6w7h6_kubernetes-dashboard(98eb45e0-5ebb-4a91-950c-b25211aceb65)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-6w7h6_kubernetes-dashboard(98eb45e0-5ebb-4a91-950c-b25211aceb65)"
	W0812 13:18:58.484462 1212353 logs.go:138] Found kubelet problem: Aug 12 13:14:45 old-k8s-version-112335 kubelet[671]: E0812 13:14:45.357518     671 pod_workers.go:191] Error syncing pod 34d824a4-d65e-4566-b95e-8f00f2c6fc71 ("metrics-server-9975d5f86-v2prr_kube-system(34d824a4-d65e-4566-b95e-8f00f2c6fc71)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W0812 13:18:58.485131 1212353 logs.go:138] Found kubelet problem: Aug 12 13:14:47 old-k8s-version-112335 kubelet[671]: E0812 13:14:47.982636     671 pod_workers.go:191] Error syncing pod 98eb45e0-5ebb-4a91-950c-b25211aceb65 ("dashboard-metrics-scraper-8d5bb5db8-6w7h6_kubernetes-dashboard(98eb45e0-5ebb-4a91-950c-b25211aceb65)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-6w7h6_kubernetes-dashboard(98eb45e0-5ebb-4a91-950c-b25211aceb65)"
	W0812 13:18:58.485521 1212353 logs.go:138] Found kubelet problem: Aug 12 13:14:52 old-k8s-version-112335 kubelet[671]: E0812 13:14:52.966081     671 pod_workers.go:191] Error syncing pod 98eb45e0-5ebb-4a91-950c-b25211aceb65 ("dashboard-metrics-scraper-8d5bb5db8-6w7h6_kubernetes-dashboard(98eb45e0-5ebb-4a91-950c-b25211aceb65)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-6w7h6_kubernetes-dashboard(98eb45e0-5ebb-4a91-950c-b25211aceb65)"
	W0812 13:18:58.485711 1212353 logs.go:138] Found kubelet problem: Aug 12 13:14:58 old-k8s-version-112335 kubelet[671]: E0812 13:14:58.356659     671 pod_workers.go:191] Error syncing pod 34d824a4-d65e-4566-b95e-8f00f2c6fc71 ("metrics-server-9975d5f86-v2prr_kube-system(34d824a4-d65e-4566-b95e-8f00f2c6fc71)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W0812 13:18:58.486064 1212353 logs.go:138] Found kubelet problem: Aug 12 13:15:06 old-k8s-version-112335 kubelet[671]: E0812 13:15:06.356379     671 pod_workers.go:191] Error syncing pod 98eb45e0-5ebb-4a91-950c-b25211aceb65 ("dashboard-metrics-scraper-8d5bb5db8-6w7h6_kubernetes-dashboard(98eb45e0-5ebb-4a91-950c-b25211aceb65)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-6w7h6_kubernetes-dashboard(98eb45e0-5ebb-4a91-950c-b25211aceb65)"
	W0812 13:18:58.486286 1212353 logs.go:138] Found kubelet problem: Aug 12 13:15:11 old-k8s-version-112335 kubelet[671]: E0812 13:15:11.360283     671 pod_workers.go:191] Error syncing pod 34d824a4-d65e-4566-b95e-8f00f2c6fc71 ("metrics-server-9975d5f86-v2prr_kube-system(34d824a4-d65e-4566-b95e-8f00f2c6fc71)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W0812 13:18:58.486681 1212353 logs.go:138] Found kubelet problem: Aug 12 13:15:20 old-k8s-version-112335 kubelet[671]: E0812 13:15:20.356356     671 pod_workers.go:191] Error syncing pod 98eb45e0-5ebb-4a91-950c-b25211aceb65 ("dashboard-metrics-scraper-8d5bb5db8-6w7h6_kubernetes-dashboard(98eb45e0-5ebb-4a91-950c-b25211aceb65)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-6w7h6_kubernetes-dashboard(98eb45e0-5ebb-4a91-950c-b25211aceb65)"
	W0812 13:18:58.489527 1212353 logs.go:138] Found kubelet problem: Aug 12 13:15:23 old-k8s-version-112335 kubelet[671]: E0812 13:15:23.375625     671 pod_workers.go:191] Error syncing pod 34d824a4-d65e-4566-b95e-8f00f2c6fc71 ("metrics-server-9975d5f86-v2prr_kube-system(34d824a4-d65e-4566-b95e-8f00f2c6fc71)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.85.1:53: no such host"
	W0812 13:18:58.490214 1212353 logs.go:138] Found kubelet problem: Aug 12 13:15:36 old-k8s-version-112335 kubelet[671]: E0812 13:15:36.141806     671 pod_workers.go:191] Error syncing pod 98eb45e0-5ebb-4a91-950c-b25211aceb65 ("dashboard-metrics-scraper-8d5bb5db8-6w7h6_kubernetes-dashboard(98eb45e0-5ebb-4a91-950c-b25211aceb65)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-6w7h6_kubernetes-dashboard(98eb45e0-5ebb-4a91-950c-b25211aceb65)"
	W0812 13:18:58.490443 1212353 logs.go:138] Found kubelet problem: Aug 12 13:15:36 old-k8s-version-112335 kubelet[671]: E0812 13:15:36.356776     671 pod_workers.go:191] Error syncing pod 34d824a4-d65e-4566-b95e-8f00f2c6fc71 ("metrics-server-9975d5f86-v2prr_kube-system(34d824a4-d65e-4566-b95e-8f00f2c6fc71)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W0812 13:18:58.490815 1212353 logs.go:138] Found kubelet problem: Aug 12 13:15:42 old-k8s-version-112335 kubelet[671]: E0812 13:15:42.967870     671 pod_workers.go:191] Error syncing pod 98eb45e0-5ebb-4a91-950c-b25211aceb65 ("dashboard-metrics-scraper-8d5bb5db8-6w7h6_kubernetes-dashboard(98eb45e0-5ebb-4a91-950c-b25211aceb65)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-6w7h6_kubernetes-dashboard(98eb45e0-5ebb-4a91-950c-b25211aceb65)"
	W0812 13:18:58.491013 1212353 logs.go:138] Found kubelet problem: Aug 12 13:15:51 old-k8s-version-112335 kubelet[671]: E0812 13:15:51.358415     671 pod_workers.go:191] Error syncing pod 34d824a4-d65e-4566-b95e-8f00f2c6fc71 ("metrics-server-9975d5f86-v2prr_kube-system(34d824a4-d65e-4566-b95e-8f00f2c6fc71)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W0812 13:18:58.491387 1212353 logs.go:138] Found kubelet problem: Aug 12 13:15:56 old-k8s-version-112335 kubelet[671]: E0812 13:15:56.357561     671 pod_workers.go:191] Error syncing pod 98eb45e0-5ebb-4a91-950c-b25211aceb65 ("dashboard-metrics-scraper-8d5bb5db8-6w7h6_kubernetes-dashboard(98eb45e0-5ebb-4a91-950c-b25211aceb65)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-6w7h6_kubernetes-dashboard(98eb45e0-5ebb-4a91-950c-b25211aceb65)"
	W0812 13:18:58.491601 1212353 logs.go:138] Found kubelet problem: Aug 12 13:16:05 old-k8s-version-112335 kubelet[671]: E0812 13:16:05.356796     671 pod_workers.go:191] Error syncing pod 34d824a4-d65e-4566-b95e-8f00f2c6fc71 ("metrics-server-9975d5f86-v2prr_kube-system(34d824a4-d65e-4566-b95e-8f00f2c6fc71)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W0812 13:18:58.491986 1212353 logs.go:138] Found kubelet problem: Aug 12 13:16:09 old-k8s-version-112335 kubelet[671]: E0812 13:16:09.356580     671 pod_workers.go:191] Error syncing pod 98eb45e0-5ebb-4a91-950c-b25211aceb65 ("dashboard-metrics-scraper-8d5bb5db8-6w7h6_kubernetes-dashboard(98eb45e0-5ebb-4a91-950c-b25211aceb65)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-6w7h6_kubernetes-dashboard(98eb45e0-5ebb-4a91-950c-b25211aceb65)"
	W0812 13:18:58.492183 1212353 logs.go:138] Found kubelet problem: Aug 12 13:16:19 old-k8s-version-112335 kubelet[671]: E0812 13:16:19.360216     671 pod_workers.go:191] Error syncing pod 34d824a4-d65e-4566-b95e-8f00f2c6fc71 ("metrics-server-9975d5f86-v2prr_kube-system(34d824a4-d65e-4566-b95e-8f00f2c6fc71)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W0812 13:18:58.492578 1212353 logs.go:138] Found kubelet problem: Aug 12 13:16:24 old-k8s-version-112335 kubelet[671]: E0812 13:16:24.356502     671 pod_workers.go:191] Error syncing pod 98eb45e0-5ebb-4a91-950c-b25211aceb65 ("dashboard-metrics-scraper-8d5bb5db8-6w7h6_kubernetes-dashboard(98eb45e0-5ebb-4a91-950c-b25211aceb65)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-6w7h6_kubernetes-dashboard(98eb45e0-5ebb-4a91-950c-b25211aceb65)"
	W0812 13:18:58.492796 1212353 logs.go:138] Found kubelet problem: Aug 12 13:16:34 old-k8s-version-112335 kubelet[671]: E0812 13:16:34.356788     671 pod_workers.go:191] Error syncing pod 34d824a4-d65e-4566-b95e-8f00f2c6fc71 ("metrics-server-9975d5f86-v2prr_kube-system(34d824a4-d65e-4566-b95e-8f00f2c6fc71)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W0812 13:18:58.493179 1212353 logs.go:138] Found kubelet problem: Aug 12 13:16:39 old-k8s-version-112335 kubelet[671]: E0812 13:16:39.356466     671 pod_workers.go:191] Error syncing pod 98eb45e0-5ebb-4a91-950c-b25211aceb65 ("dashboard-metrics-scraper-8d5bb5db8-6w7h6_kubernetes-dashboard(98eb45e0-5ebb-4a91-950c-b25211aceb65)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-6w7h6_kubernetes-dashboard(98eb45e0-5ebb-4a91-950c-b25211aceb65)"
	W0812 13:18:58.496052 1212353 logs.go:138] Found kubelet problem: Aug 12 13:16:46 old-k8s-version-112335 kubelet[671]: E0812 13:16:46.364626     671 pod_workers.go:191] Error syncing pod 34d824a4-d65e-4566-b95e-8f00f2c6fc71 ("metrics-server-9975d5f86-v2prr_kube-system(34d824a4-d65e-4566-b95e-8f00f2c6fc71)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.85.1:53: no such host"
	W0812 13:18:58.496443 1212353 logs.go:138] Found kubelet problem: Aug 12 13:16:53 old-k8s-version-112335 kubelet[671]: E0812 13:16:53.357451     671 pod_workers.go:191] Error syncing pod 98eb45e0-5ebb-4a91-950c-b25211aceb65 ("dashboard-metrics-scraper-8d5bb5db8-6w7h6_kubernetes-dashboard(98eb45e0-5ebb-4a91-950c-b25211aceb65)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-6w7h6_kubernetes-dashboard(98eb45e0-5ebb-4a91-950c-b25211aceb65)"
	W0812 13:18:58.496660 1212353 logs.go:138] Found kubelet problem: Aug 12 13:16:59 old-k8s-version-112335 kubelet[671]: E0812 13:16:59.356869     671 pod_workers.go:191] Error syncing pod 34d824a4-d65e-4566-b95e-8f00f2c6fc71 ("metrics-server-9975d5f86-v2prr_kube-system(34d824a4-d65e-4566-b95e-8f00f2c6fc71)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W0812 13:18:58.497458 1212353 logs.go:138] Found kubelet problem: Aug 12 13:17:08 old-k8s-version-112335 kubelet[671]: E0812 13:17:08.461635     671 pod_workers.go:191] Error syncing pod 98eb45e0-5ebb-4a91-950c-b25211aceb65 ("dashboard-metrics-scraper-8d5bb5db8-6w7h6_kubernetes-dashboard(98eb45e0-5ebb-4a91-950c-b25211aceb65)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-6w7h6_kubernetes-dashboard(98eb45e0-5ebb-4a91-950c-b25211aceb65)"
	W0812 13:18:58.497677 1212353 logs.go:138] Found kubelet problem: Aug 12 13:17:10 old-k8s-version-112335 kubelet[671]: E0812 13:17:10.356646     671 pod_workers.go:191] Error syncing pod 34d824a4-d65e-4566-b95e-8f00f2c6fc71 ("metrics-server-9975d5f86-v2prr_kube-system(34d824a4-d65e-4566-b95e-8f00f2c6fc71)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W0812 13:18:58.498056 1212353 logs.go:138] Found kubelet problem: Aug 12 13:17:12 old-k8s-version-112335 kubelet[671]: E0812 13:17:12.982447     671 pod_workers.go:191] Error syncing pod 98eb45e0-5ebb-4a91-950c-b25211aceb65 ("dashboard-metrics-scraper-8d5bb5db8-6w7h6_kubernetes-dashboard(98eb45e0-5ebb-4a91-950c-b25211aceb65)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-6w7h6_kubernetes-dashboard(98eb45e0-5ebb-4a91-950c-b25211aceb65)"
	W0812 13:18:58.498273 1212353 logs.go:138] Found kubelet problem: Aug 12 13:17:23 old-k8s-version-112335 kubelet[671]: E0812 13:17:23.357066     671 pod_workers.go:191] Error syncing pod 34d824a4-d65e-4566-b95e-8f00f2c6fc71 ("metrics-server-9975d5f86-v2prr_kube-system(34d824a4-d65e-4566-b95e-8f00f2c6fc71)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W0812 13:18:58.498658 1212353 logs.go:138] Found kubelet problem: Aug 12 13:17:27 old-k8s-version-112335 kubelet[671]: E0812 13:17:27.356820     671 pod_workers.go:191] Error syncing pod 98eb45e0-5ebb-4a91-950c-b25211aceb65 ("dashboard-metrics-scraper-8d5bb5db8-6w7h6_kubernetes-dashboard(98eb45e0-5ebb-4a91-950c-b25211aceb65)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-6w7h6_kubernetes-dashboard(98eb45e0-5ebb-4a91-950c-b25211aceb65)"
	W0812 13:18:58.498877 1212353 logs.go:138] Found kubelet problem: Aug 12 13:17:36 old-k8s-version-112335 kubelet[671]: E0812 13:17:36.356796     671 pod_workers.go:191] Error syncing pod 34d824a4-d65e-4566-b95e-8f00f2c6fc71 ("metrics-server-9975d5f86-v2prr_kube-system(34d824a4-d65e-4566-b95e-8f00f2c6fc71)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W0812 13:18:58.499260 1212353 logs.go:138] Found kubelet problem: Aug 12 13:17:38 old-k8s-version-112335 kubelet[671]: E0812 13:17:38.356467     671 pod_workers.go:191] Error syncing pod 98eb45e0-5ebb-4a91-950c-b25211aceb65 ("dashboard-metrics-scraper-8d5bb5db8-6w7h6_kubernetes-dashboard(98eb45e0-5ebb-4a91-950c-b25211aceb65)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-6w7h6_kubernetes-dashboard(98eb45e0-5ebb-4a91-950c-b25211aceb65)"
	W0812 13:18:58.499479 1212353 logs.go:138] Found kubelet problem: Aug 12 13:17:47 old-k8s-version-112335 kubelet[671]: E0812 13:17:47.357155     671 pod_workers.go:191] Error syncing pod 34d824a4-d65e-4566-b95e-8f00f2c6fc71 ("metrics-server-9975d5f86-v2prr_kube-system(34d824a4-d65e-4566-b95e-8f00f2c6fc71)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W0812 13:18:58.499870 1212353 logs.go:138] Found kubelet problem: Aug 12 13:17:51 old-k8s-version-112335 kubelet[671]: E0812 13:17:51.357564     671 pod_workers.go:191] Error syncing pod 98eb45e0-5ebb-4a91-950c-b25211aceb65 ("dashboard-metrics-scraper-8d5bb5db8-6w7h6_kubernetes-dashboard(98eb45e0-5ebb-4a91-950c-b25211aceb65)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-6w7h6_kubernetes-dashboard(98eb45e0-5ebb-4a91-950c-b25211aceb65)"
	W0812 13:18:58.500073 1212353 logs.go:138] Found kubelet problem: Aug 12 13:18:00 old-k8s-version-112335 kubelet[671]: E0812 13:18:00.357436     671 pod_workers.go:191] Error syncing pod 34d824a4-d65e-4566-b95e-8f00f2c6fc71 ("metrics-server-9975d5f86-v2prr_kube-system(34d824a4-d65e-4566-b95e-8f00f2c6fc71)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W0812 13:18:58.500467 1212353 logs.go:138] Found kubelet problem: Aug 12 13:18:06 old-k8s-version-112335 kubelet[671]: E0812 13:18:06.356382     671 pod_workers.go:191] Error syncing pod 98eb45e0-5ebb-4a91-950c-b25211aceb65 ("dashboard-metrics-scraper-8d5bb5db8-6w7h6_kubernetes-dashboard(98eb45e0-5ebb-4a91-950c-b25211aceb65)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-6w7h6_kubernetes-dashboard(98eb45e0-5ebb-4a91-950c-b25211aceb65)"
	W0812 13:18:58.500674 1212353 logs.go:138] Found kubelet problem: Aug 12 13:18:11 old-k8s-version-112335 kubelet[671]: E0812 13:18:11.356726     671 pod_workers.go:191] Error syncing pod 34d824a4-d65e-4566-b95e-8f00f2c6fc71 ("metrics-server-9975d5f86-v2prr_kube-system(34d824a4-d65e-4566-b95e-8f00f2c6fc71)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W0812 13:18:58.501046 1212353 logs.go:138] Found kubelet problem: Aug 12 13:18:21 old-k8s-version-112335 kubelet[671]: E0812 13:18:21.358016     671 pod_workers.go:191] Error syncing pod 98eb45e0-5ebb-4a91-950c-b25211aceb65 ("dashboard-metrics-scraper-8d5bb5db8-6w7h6_kubernetes-dashboard(98eb45e0-5ebb-4a91-950c-b25211aceb65)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-6w7h6_kubernetes-dashboard(98eb45e0-5ebb-4a91-950c-b25211aceb65)"
	W0812 13:18:58.501270 1212353 logs.go:138] Found kubelet problem: Aug 12 13:18:25 old-k8s-version-112335 kubelet[671]: E0812 13:18:25.359255     671 pod_workers.go:191] Error syncing pod 34d824a4-d65e-4566-b95e-8f00f2c6fc71 ("metrics-server-9975d5f86-v2prr_kube-system(34d824a4-d65e-4566-b95e-8f00f2c6fc71)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W0812 13:18:58.501651 1212353 logs.go:138] Found kubelet problem: Aug 12 13:18:33 old-k8s-version-112335 kubelet[671]: E0812 13:18:33.356927     671 pod_workers.go:191] Error syncing pod 98eb45e0-5ebb-4a91-950c-b25211aceb65 ("dashboard-metrics-scraper-8d5bb5db8-6w7h6_kubernetes-dashboard(98eb45e0-5ebb-4a91-950c-b25211aceb65)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-6w7h6_kubernetes-dashboard(98eb45e0-5ebb-4a91-950c-b25211aceb65)"
	W0812 13:18:58.501856 1212353 logs.go:138] Found kubelet problem: Aug 12 13:18:39 old-k8s-version-112335 kubelet[671]: E0812 13:18:39.356920     671 pod_workers.go:191] Error syncing pod 34d824a4-d65e-4566-b95e-8f00f2c6fc71 ("metrics-server-9975d5f86-v2prr_kube-system(34d824a4-d65e-4566-b95e-8f00f2c6fc71)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W0812 13:18:58.502231 1212353 logs.go:138] Found kubelet problem: Aug 12 13:18:45 old-k8s-version-112335 kubelet[671]: E0812 13:18:45.356665     671 pod_workers.go:191] Error syncing pod 98eb45e0-5ebb-4a91-950c-b25211aceb65 ("dashboard-metrics-scraper-8d5bb5db8-6w7h6_kubernetes-dashboard(98eb45e0-5ebb-4a91-950c-b25211aceb65)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-6w7h6_kubernetes-dashboard(98eb45e0-5ebb-4a91-950c-b25211aceb65)"
	W0812 13:18:58.502459 1212353 logs.go:138] Found kubelet problem: Aug 12 13:18:51 old-k8s-version-112335 kubelet[671]: E0812 13:18:51.356752     671 pod_workers.go:191] Error syncing pod 34d824a4-d65e-4566-b95e-8f00f2c6fc71 ("metrics-server-9975d5f86-v2prr_kube-system(34d824a4-d65e-4566-b95e-8f00f2c6fc71)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W0812 13:18:58.502876 1212353 logs.go:138] Found kubelet problem: Aug 12 13:18:57 old-k8s-version-112335 kubelet[671]: E0812 13:18:57.356673     671 pod_workers.go:191] Error syncing pod 98eb45e0-5ebb-4a91-950c-b25211aceb65 ("dashboard-metrics-scraper-8d5bb5db8-6w7h6_kubernetes-dashboard(98eb45e0-5ebb-4a91-950c-b25211aceb65)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-6w7h6_kubernetes-dashboard(98eb45e0-5ebb-4a91-950c-b25211aceb65)"
	I0812 13:18:58.502888 1212353 logs.go:123] Gathering logs for coredns [7f8e543bcce0c03b365394bc942dab039d350b1340f5856f43b90551a5645f67] ...
	I0812 13:18:58.502906 1212353 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 7f8e543bcce0c03b365394bc942dab039d350b1340f5856f43b90551a5645f67"
	I0812 13:18:58.552268 1212353 logs.go:123] Gathering logs for kube-scheduler [7b67a4fc117cb884b3aec00880229a7613be0e0af79872ccc25b2ef06932d06f] ...
	I0812 13:18:58.552355 1212353 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 7b67a4fc117cb884b3aec00880229a7613be0e0af79872ccc25b2ef06932d06f"
	I0812 13:18:58.607735 1212353 logs.go:123] Gathering logs for kube-proxy [e6326fb96d89ee49b3da7ef3f75a5f41a53b9acb3526ac907bf55dfcc30b8d6c] ...
	I0812 13:18:58.607764 1212353 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 e6326fb96d89ee49b3da7ef3f75a5f41a53b9acb3526ac907bf55dfcc30b8d6c"
	I0812 13:18:58.649036 1212353 logs.go:123] Gathering logs for kube-controller-manager [8dc43146b8eece1e84ac23cedd68a17cad2d2457bc209bbe351bbfa0454d1bc2] ...
	I0812 13:18:58.649067 1212353 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 8dc43146b8eece1e84ac23cedd68a17cad2d2457bc209bbe351bbfa0454d1bc2"
	I0812 13:18:58.720408 1212353 logs.go:123] Gathering logs for kindnet [162b80fe4af51619d233d78c0c67ed2c8e6f24d40ec23dd44a431d1b76caed13] ...
	I0812 13:18:58.720449 1212353 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 162b80fe4af51619d233d78c0c67ed2c8e6f24d40ec23dd44a431d1b76caed13"
	I0812 13:18:58.776559 1212353 logs.go:123] Gathering logs for containerd ...
	I0812 13:18:58.776591 1212353 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u containerd -n 400"
	I0812 13:18:58.837722 1212353 logs.go:123] Gathering logs for dmesg ...
	I0812 13:18:58.837758 1212353 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
	I0812 13:18:58.858241 1212353 logs.go:123] Gathering logs for etcd [39f629658753d4fd7ceceee2f8ec0ffc8c98db08a6b70240ea91f87cd6dcee03] ...
	I0812 13:18:58.858275 1212353 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 39f629658753d4fd7ceceee2f8ec0ffc8c98db08a6b70240ea91f87cd6dcee03"
	I0812 13:18:58.900600 1212353 logs.go:123] Gathering logs for kube-scheduler [b27ed17bf7551f01faf083be84883f36e5f141508c39cfd28e4ca7bf298a5ef2] ...
	I0812 13:18:58.900632 1212353 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 b27ed17bf7551f01faf083be84883f36e5f141508c39cfd28e4ca7bf298a5ef2"
	I0812 13:18:58.955714 1212353 logs.go:123] Gathering logs for kube-proxy [2af20ac6f2602d8c076b3bed058353203858c5832593d98d2de3ccc55cbf9c7d] ...
	I0812 13:18:58.955745 1212353 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 2af20ac6f2602d8c076b3bed058353203858c5832593d98d2de3ccc55cbf9c7d"
	I0812 13:18:59.000451 1212353 logs.go:123] Gathering logs for kube-controller-manager [533139b834baffb74463be6b648bfd76085ea1587efa7aa575c1e09af6ee13da] ...
	I0812 13:18:59.000495 1212353 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 533139b834baffb74463be6b648bfd76085ea1587efa7aa575c1e09af6ee13da"
	I0812 13:18:59.077277 1212353 logs.go:123] Gathering logs for storage-provisioner [b8ecac9f4ddfb227119bf73b728923825eb3a038f35063eed01a12b20b1560d7] ...
	I0812 13:18:59.077314 1212353 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 b8ecac9f4ddfb227119bf73b728923825eb3a038f35063eed01a12b20b1560d7"
	I0812 13:18:59.115567 1212353 logs.go:123] Gathering logs for describe nodes ...
	I0812 13:18:59.115594 1212353 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
	I0812 13:18:59.260124 1212353 logs.go:123] Gathering logs for kube-apiserver [e4cf465775a34b80fbfbd63dc4f0643c8d6a61c508c1c06d6e58548109c82a20] ...
	I0812 13:18:59.260153 1212353 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 e4cf465775a34b80fbfbd63dc4f0643c8d6a61c508c1c06d6e58548109c82a20"
	I0812 13:18:59.328913 1212353 logs.go:123] Gathering logs for kube-apiserver [bf352ab2c17cc4485d3b3f899d758963b292f9829240ec0e4e650d678908e30a] ...
	I0812 13:18:59.328947 1212353 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 bf352ab2c17cc4485d3b3f899d758963b292f9829240ec0e4e650d678908e30a"
	I0812 13:18:59.414390 1212353 logs.go:123] Gathering logs for etcd [8cc926d2c577f511b103d70b73314019d0ec31451c321551981ab0306c91088f] ...
	I0812 13:18:59.414425 1212353 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 8cc926d2c577f511b103d70b73314019d0ec31451c321551981ab0306c91088f"
	I0812 13:18:59.471466 1212353 logs.go:123] Gathering logs for kindnet [6f8e38e073e1197c4df808103d10e92b26179a23da02465137f194bb4e1b5dfe] ...
	I0812 13:18:59.471495 1212353 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 6f8e38e073e1197c4df808103d10e92b26179a23da02465137f194bb4e1b5dfe"
	I0812 13:18:59.534640 1212353 logs.go:123] Gathering logs for storage-provisioner [2924918d73f931bf85384ca7b1f96cf6760849232fe33069fff149704e2ae596] ...
	I0812 13:18:59.534674 1212353 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 2924918d73f931bf85384ca7b1f96cf6760849232fe33069fff149704e2ae596"
	I0812 13:18:59.582215 1212353 out.go:304] Setting ErrFile to fd 2...
	I0812 13:18:59.582243 1212353 out.go:338] TERM=,COLORTERM=, which probably does not support color
	W0812 13:18:59.582296 1212353 out.go:239] X Problems detected in kubelet:
	X Problems detected in kubelet:
	W0812 13:18:59.582310 1212353 out.go:239]   Aug 12 13:18:33 old-k8s-version-112335 kubelet[671]: E0812 13:18:33.356927     671 pod_workers.go:191] Error syncing pod 98eb45e0-5ebb-4a91-950c-b25211aceb65 ("dashboard-metrics-scraper-8d5bb5db8-6w7h6_kubernetes-dashboard(98eb45e0-5ebb-4a91-950c-b25211aceb65)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-6w7h6_kubernetes-dashboard(98eb45e0-5ebb-4a91-950c-b25211aceb65)"
	  Aug 12 13:18:33 old-k8s-version-112335 kubelet[671]: E0812 13:18:33.356927     671 pod_workers.go:191] Error syncing pod 98eb45e0-5ebb-4a91-950c-b25211aceb65 ("dashboard-metrics-scraper-8d5bb5db8-6w7h6_kubernetes-dashboard(98eb45e0-5ebb-4a91-950c-b25211aceb65)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-6w7h6_kubernetes-dashboard(98eb45e0-5ebb-4a91-950c-b25211aceb65)"
	W0812 13:18:59.582318 1212353 out.go:239]   Aug 12 13:18:39 old-k8s-version-112335 kubelet[671]: E0812 13:18:39.356920     671 pod_workers.go:191] Error syncing pod 34d824a4-d65e-4566-b95e-8f00f2c6fc71 ("metrics-server-9975d5f86-v2prr_kube-system(34d824a4-d65e-4566-b95e-8f00f2c6fc71)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	  Aug 12 13:18:39 old-k8s-version-112335 kubelet[671]: E0812 13:18:39.356920     671 pod_workers.go:191] Error syncing pod 34d824a4-d65e-4566-b95e-8f00f2c6fc71 ("metrics-server-9975d5f86-v2prr_kube-system(34d824a4-d65e-4566-b95e-8f00f2c6fc71)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W0812 13:18:59.582335 1212353 out.go:239]   Aug 12 13:18:45 old-k8s-version-112335 kubelet[671]: E0812 13:18:45.356665     671 pod_workers.go:191] Error syncing pod 98eb45e0-5ebb-4a91-950c-b25211aceb65 ("dashboard-metrics-scraper-8d5bb5db8-6w7h6_kubernetes-dashboard(98eb45e0-5ebb-4a91-950c-b25211aceb65)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-6w7h6_kubernetes-dashboard(98eb45e0-5ebb-4a91-950c-b25211aceb65)"
	  Aug 12 13:18:45 old-k8s-version-112335 kubelet[671]: E0812 13:18:45.356665     671 pod_workers.go:191] Error syncing pod 98eb45e0-5ebb-4a91-950c-b25211aceb65 ("dashboard-metrics-scraper-8d5bb5db8-6w7h6_kubernetes-dashboard(98eb45e0-5ebb-4a91-950c-b25211aceb65)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-6w7h6_kubernetes-dashboard(98eb45e0-5ebb-4a91-950c-b25211aceb65)"
	W0812 13:18:59.582471 1212353 out.go:239]   Aug 12 13:18:51 old-k8s-version-112335 kubelet[671]: E0812 13:18:51.356752     671 pod_workers.go:191] Error syncing pod 34d824a4-d65e-4566-b95e-8f00f2c6fc71 ("metrics-server-9975d5f86-v2prr_kube-system(34d824a4-d65e-4566-b95e-8f00f2c6fc71)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	  Aug 12 13:18:51 old-k8s-version-112335 kubelet[671]: E0812 13:18:51.356752     671 pod_workers.go:191] Error syncing pod 34d824a4-d65e-4566-b95e-8f00f2c6fc71 ("metrics-server-9975d5f86-v2prr_kube-system(34d824a4-d65e-4566-b95e-8f00f2c6fc71)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W0812 13:18:59.582479 1212353 out.go:239]   Aug 12 13:18:57 old-k8s-version-112335 kubelet[671]: E0812 13:18:57.356673     671 pod_workers.go:191] Error syncing pod 98eb45e0-5ebb-4a91-950c-b25211aceb65 ("dashboard-metrics-scraper-8d5bb5db8-6w7h6_kubernetes-dashboard(98eb45e0-5ebb-4a91-950c-b25211aceb65)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-6w7h6_kubernetes-dashboard(98eb45e0-5ebb-4a91-950c-b25211aceb65)"
	  Aug 12 13:18:57 old-k8s-version-112335 kubelet[671]: E0812 13:18:57.356673     671 pod_workers.go:191] Error syncing pod 98eb45e0-5ebb-4a91-950c-b25211aceb65 ("dashboard-metrics-scraper-8d5bb5db8-6w7h6_kubernetes-dashboard(98eb45e0-5ebb-4a91-950c-b25211aceb65)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-6w7h6_kubernetes-dashboard(98eb45e0-5ebb-4a91-950c-b25211aceb65)"
	I0812 13:18:59.582487 1212353 out.go:304] Setting ErrFile to fd 2...
	I0812 13:18:59.582495 1212353 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0812 13:19:09.583497 1212353 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0812 13:19:09.595720 1212353 api_server.go:72] duration metric: took 5m54.253054514s to wait for apiserver process to appear ...
	I0812 13:19:09.595750 1212353 api_server.go:88] waiting for apiserver healthz status ...
	I0812 13:19:09.595785 1212353 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-apiserver Namespaces:[]}
	I0812 13:19:09.595849 1212353 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
	I0812 13:19:09.634473 1212353 cri.go:89] found id: "e4cf465775a34b80fbfbd63dc4f0643c8d6a61c508c1c06d6e58548109c82a20"
	I0812 13:19:09.634496 1212353 cri.go:89] found id: "bf352ab2c17cc4485d3b3f899d758963b292f9829240ec0e4e650d678908e30a"
	I0812 13:19:09.634502 1212353 cri.go:89] found id: ""
	I0812 13:19:09.634508 1212353 logs.go:276] 2 containers: [e4cf465775a34b80fbfbd63dc4f0643c8d6a61c508c1c06d6e58548109c82a20 bf352ab2c17cc4485d3b3f899d758963b292f9829240ec0e4e650d678908e30a]
	I0812 13:19:09.634572 1212353 ssh_runner.go:195] Run: which crictl
	I0812 13:19:09.638291 1212353 ssh_runner.go:195] Run: which crictl
	I0812 13:19:09.641843 1212353 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:etcd Namespaces:[]}
	I0812 13:19:09.641924 1212353 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
	I0812 13:19:09.687444 1212353 cri.go:89] found id: "8cc926d2c577f511b103d70b73314019d0ec31451c321551981ab0306c91088f"
	I0812 13:19:09.687465 1212353 cri.go:89] found id: "39f629658753d4fd7ceceee2f8ec0ffc8c98db08a6b70240ea91f87cd6dcee03"
	I0812 13:19:09.687470 1212353 cri.go:89] found id: ""
	I0812 13:19:09.687477 1212353 logs.go:276] 2 containers: [8cc926d2c577f511b103d70b73314019d0ec31451c321551981ab0306c91088f 39f629658753d4fd7ceceee2f8ec0ffc8c98db08a6b70240ea91f87cd6dcee03]
	I0812 13:19:09.687533 1212353 ssh_runner.go:195] Run: which crictl
	I0812 13:19:09.692474 1212353 ssh_runner.go:195] Run: which crictl
	I0812 13:19:09.697389 1212353 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:coredns Namespaces:[]}
	I0812 13:19:09.697468 1212353 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
	I0812 13:19:09.808285 1212353 cri.go:89] found id: "d01d8e8aeec0f477f1c58244a66d7f7b8fb10d090d3d987c0469a55648945b18"
	I0812 13:19:09.808306 1212353 cri.go:89] found id: "7f8e543bcce0c03b365394bc942dab039d350b1340f5856f43b90551a5645f67"
	I0812 13:19:09.808311 1212353 cri.go:89] found id: ""
	I0812 13:19:09.808318 1212353 logs.go:276] 2 containers: [d01d8e8aeec0f477f1c58244a66d7f7b8fb10d090d3d987c0469a55648945b18 7f8e543bcce0c03b365394bc942dab039d350b1340f5856f43b90551a5645f67]
	I0812 13:19:09.808375 1212353 ssh_runner.go:195] Run: which crictl
	I0812 13:19:09.811869 1212353 ssh_runner.go:195] Run: which crictl
	I0812 13:19:09.817875 1212353 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-scheduler Namespaces:[]}
	I0812 13:19:09.817949 1212353 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
	I0812 13:19:09.876968 1212353 cri.go:89] found id: "b27ed17bf7551f01faf083be84883f36e5f141508c39cfd28e4ca7bf298a5ef2"
	I0812 13:19:09.877002 1212353 cri.go:89] found id: "7b67a4fc117cb884b3aec00880229a7613be0e0af79872ccc25b2ef06932d06f"
	I0812 13:19:09.877007 1212353 cri.go:89] found id: ""
	I0812 13:19:09.877014 1212353 logs.go:276] 2 containers: [b27ed17bf7551f01faf083be84883f36e5f141508c39cfd28e4ca7bf298a5ef2 7b67a4fc117cb884b3aec00880229a7613be0e0af79872ccc25b2ef06932d06f]
	I0812 13:19:09.877067 1212353 ssh_runner.go:195] Run: which crictl
	I0812 13:19:09.881713 1212353 ssh_runner.go:195] Run: which crictl
	I0812 13:19:09.887001 1212353 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-proxy Namespaces:[]}
	I0812 13:19:09.887073 1212353 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
	I0812 13:19:09.986056 1212353 cri.go:89] found id: "2af20ac6f2602d8c076b3bed058353203858c5832593d98d2de3ccc55cbf9c7d"
	I0812 13:19:09.986078 1212353 cri.go:89] found id: "e6326fb96d89ee49b3da7ef3f75a5f41a53b9acb3526ac907bf55dfcc30b8d6c"
	I0812 13:19:09.986083 1212353 cri.go:89] found id: ""
	I0812 13:19:09.986089 1212353 logs.go:276] 2 containers: [2af20ac6f2602d8c076b3bed058353203858c5832593d98d2de3ccc55cbf9c7d e6326fb96d89ee49b3da7ef3f75a5f41a53b9acb3526ac907bf55dfcc30b8d6c]
	I0812 13:19:09.986151 1212353 ssh_runner.go:195] Run: which crictl
	I0812 13:19:09.990326 1212353 ssh_runner.go:195] Run: which crictl
	I0812 13:19:10.008493 1212353 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-controller-manager Namespaces:[]}
	I0812 13:19:10.008641 1212353 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
	I0812 13:19:10.078309 1212353 cri.go:89] found id: "533139b834baffb74463be6b648bfd76085ea1587efa7aa575c1e09af6ee13da"
	I0812 13:19:10.078334 1212353 cri.go:89] found id: "8dc43146b8eece1e84ac23cedd68a17cad2d2457bc209bbe351bbfa0454d1bc2"
	I0812 13:19:10.078340 1212353 cri.go:89] found id: ""
	I0812 13:19:10.078348 1212353 logs.go:276] 2 containers: [533139b834baffb74463be6b648bfd76085ea1587efa7aa575c1e09af6ee13da 8dc43146b8eece1e84ac23cedd68a17cad2d2457bc209bbe351bbfa0454d1bc2]
	I0812 13:19:10.078410 1212353 ssh_runner.go:195] Run: which crictl
	I0812 13:19:10.082875 1212353 ssh_runner.go:195] Run: which crictl
	I0812 13:19:10.087661 1212353 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kindnet Namespaces:[]}
	I0812 13:19:10.087782 1212353 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet
	I0812 13:19:10.142899 1212353 cri.go:89] found id: "6f8e38e073e1197c4df808103d10e92b26179a23da02465137f194bb4e1b5dfe"
	I0812 13:19:10.142929 1212353 cri.go:89] found id: "162b80fe4af51619d233d78c0c67ed2c8e6f24d40ec23dd44a431d1b76caed13"
	I0812 13:19:10.142935 1212353 cri.go:89] found id: ""
	I0812 13:19:10.142942 1212353 logs.go:276] 2 containers: [6f8e38e073e1197c4df808103d10e92b26179a23da02465137f194bb4e1b5dfe 162b80fe4af51619d233d78c0c67ed2c8e6f24d40ec23dd44a431d1b76caed13]
	I0812 13:19:10.143002 1212353 ssh_runner.go:195] Run: which crictl
	I0812 13:19:10.147465 1212353 ssh_runner.go:195] Run: which crictl
	I0812 13:19:10.151396 1212353 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:storage-provisioner Namespaces:[]}
	I0812 13:19:10.151492 1212353 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=storage-provisioner
	I0812 13:19:10.210258 1212353 cri.go:89] found id: "b8ecac9f4ddfb227119bf73b728923825eb3a038f35063eed01a12b20b1560d7"
	I0812 13:19:10.210277 1212353 cri.go:89] found id: "2924918d73f931bf85384ca7b1f96cf6760849232fe33069fff149704e2ae596"
	I0812 13:19:10.210282 1212353 cri.go:89] found id: ""
	I0812 13:19:10.210288 1212353 logs.go:276] 2 containers: [b8ecac9f4ddfb227119bf73b728923825eb3a038f35063eed01a12b20b1560d7 2924918d73f931bf85384ca7b1f96cf6760849232fe33069fff149704e2ae596]
	I0812 13:19:10.210345 1212353 ssh_runner.go:195] Run: which crictl
	I0812 13:19:10.214692 1212353 ssh_runner.go:195] Run: which crictl
	I0812 13:19:10.218836 1212353 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kubernetes-dashboard Namespaces:[]}
	I0812 13:19:10.218947 1212353 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kubernetes-dashboard
	I0812 13:19:10.276175 1212353 cri.go:89] found id: "19e7d460788a0ea1f90292f01072ce22cf88076ab7cc590b1b16483fb405d505"
	I0812 13:19:10.276194 1212353 cri.go:89] found id: ""
	I0812 13:19:10.276202 1212353 logs.go:276] 1 containers: [19e7d460788a0ea1f90292f01072ce22cf88076ab7cc590b1b16483fb405d505]
	I0812 13:19:10.276261 1212353 ssh_runner.go:195] Run: which crictl
	I0812 13:19:10.280578 1212353 logs.go:123] Gathering logs for kube-controller-manager [533139b834baffb74463be6b648bfd76085ea1587efa7aa575c1e09af6ee13da] ...
	I0812 13:19:10.280654 1212353 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 533139b834baffb74463be6b648bfd76085ea1587efa7aa575c1e09af6ee13da"
	I0812 13:19:10.349131 1212353 logs.go:123] Gathering logs for storage-provisioner [b8ecac9f4ddfb227119bf73b728923825eb3a038f35063eed01a12b20b1560d7] ...
	I0812 13:19:10.349379 1212353 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 b8ecac9f4ddfb227119bf73b728923825eb3a038f35063eed01a12b20b1560d7"
	I0812 13:19:10.399579 1212353 logs.go:123] Gathering logs for kubernetes-dashboard [19e7d460788a0ea1f90292f01072ce22cf88076ab7cc590b1b16483fb405d505] ...
	I0812 13:19:10.399612 1212353 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 19e7d460788a0ea1f90292f01072ce22cf88076ab7cc590b1b16483fb405d505"
	I0812 13:19:10.467425 1212353 logs.go:123] Gathering logs for container status ...
	I0812 13:19:10.467546 1212353 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
	I0812 13:19:10.555908 1212353 logs.go:123] Gathering logs for describe nodes ...
	I0812 13:19:10.556028 1212353 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
	I0812 13:19:10.847034 1212353 logs.go:123] Gathering logs for kube-scheduler [b27ed17bf7551f01faf083be84883f36e5f141508c39cfd28e4ca7bf298a5ef2] ...
	I0812 13:19:10.847074 1212353 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 b27ed17bf7551f01faf083be84883f36e5f141508c39cfd28e4ca7bf298a5ef2"
	I0812 13:19:10.894829 1212353 logs.go:123] Gathering logs for kube-proxy [e6326fb96d89ee49b3da7ef3f75a5f41a53b9acb3526ac907bf55dfcc30b8d6c] ...
	I0812 13:19:10.894867 1212353 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 e6326fb96d89ee49b3da7ef3f75a5f41a53b9acb3526ac907bf55dfcc30b8d6c"
	I0812 13:19:10.959087 1212353 logs.go:123] Gathering logs for kube-controller-manager [8dc43146b8eece1e84ac23cedd68a17cad2d2457bc209bbe351bbfa0454d1bc2] ...
	I0812 13:19:10.959118 1212353 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 8dc43146b8eece1e84ac23cedd68a17cad2d2457bc209bbe351bbfa0454d1bc2"
	I0812 13:19:11.046872 1212353 logs.go:123] Gathering logs for storage-provisioner [2924918d73f931bf85384ca7b1f96cf6760849232fe33069fff149704e2ae596] ...
	I0812 13:19:11.046947 1212353 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 2924918d73f931bf85384ca7b1f96cf6760849232fe33069fff149704e2ae596"
	I0812 13:19:11.093849 1212353 logs.go:123] Gathering logs for kube-proxy [2af20ac6f2602d8c076b3bed058353203858c5832593d98d2de3ccc55cbf9c7d] ...
	I0812 13:19:11.093878 1212353 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 2af20ac6f2602d8c076b3bed058353203858c5832593d98d2de3ccc55cbf9c7d"
	I0812 13:19:11.148584 1212353 logs.go:123] Gathering logs for kube-apiserver [bf352ab2c17cc4485d3b3f899d758963b292f9829240ec0e4e650d678908e30a] ...
	I0812 13:19:11.148610 1212353 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 bf352ab2c17cc4485d3b3f899d758963b292f9829240ec0e4e650d678908e30a"
	I0812 13:19:11.247494 1212353 logs.go:123] Gathering logs for etcd [39f629658753d4fd7ceceee2f8ec0ffc8c98db08a6b70240ea91f87cd6dcee03] ...
	I0812 13:19:11.247569 1212353 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 39f629658753d4fd7ceceee2f8ec0ffc8c98db08a6b70240ea91f87cd6dcee03"
	I0812 13:19:11.309771 1212353 logs.go:123] Gathering logs for coredns [7f8e543bcce0c03b365394bc942dab039d350b1340f5856f43b90551a5645f67] ...
	I0812 13:19:11.309922 1212353 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 7f8e543bcce0c03b365394bc942dab039d350b1340f5856f43b90551a5645f67"
	I0812 13:19:11.376719 1212353 logs.go:123] Gathering logs for etcd [8cc926d2c577f511b103d70b73314019d0ec31451c321551981ab0306c91088f] ...
	I0812 13:19:11.376745 1212353 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 8cc926d2c577f511b103d70b73314019d0ec31451c321551981ab0306c91088f"
	I0812 13:19:11.438967 1212353 logs.go:123] Gathering logs for coredns [d01d8e8aeec0f477f1c58244a66d7f7b8fb10d090d3d987c0469a55648945b18] ...
	I0812 13:19:11.439041 1212353 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 d01d8e8aeec0f477f1c58244a66d7f7b8fb10d090d3d987c0469a55648945b18"
	I0812 13:19:11.492466 1212353 logs.go:123] Gathering logs for kube-scheduler [7b67a4fc117cb884b3aec00880229a7613be0e0af79872ccc25b2ef06932d06f] ...
	I0812 13:19:11.492491 1212353 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 7b67a4fc117cb884b3aec00880229a7613be0e0af79872ccc25b2ef06932d06f"
	I0812 13:19:11.549434 1212353 logs.go:123] Gathering logs for kindnet [6f8e38e073e1197c4df808103d10e92b26179a23da02465137f194bb4e1b5dfe] ...
	I0812 13:19:11.549515 1212353 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 6f8e38e073e1197c4df808103d10e92b26179a23da02465137f194bb4e1b5dfe"
	I0812 13:19:11.658330 1212353 logs.go:123] Gathering logs for kindnet [162b80fe4af51619d233d78c0c67ed2c8e6f24d40ec23dd44a431d1b76caed13] ...
	I0812 13:19:11.658369 1212353 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 162b80fe4af51619d233d78c0c67ed2c8e6f24d40ec23dd44a431d1b76caed13"
	I0812 13:19:11.727535 1212353 logs.go:123] Gathering logs for kubelet ...
	I0812 13:19:11.727573 1212353 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
	W0812 13:19:11.816146 1212353 logs.go:138] Found kubelet problem: Aug 12 13:13:35 old-k8s-version-112335 kubelet[671]: E0812 13:13:35.526602     671 reflector.go:138] object-"kube-system"/"kube-proxy": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "kube-proxy" is forbidden: User "system:node:old-k8s-version-112335" cannot list resource "configmaps" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-112335' and this object
	W0812 13:19:11.816440 1212353 logs.go:138] Found kubelet problem: Aug 12 13:13:35 old-k8s-version-112335 kubelet[671]: E0812 13:13:35.531551     671 reflector.go:138] object-"kube-system"/"kube-proxy-token-spdxp": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "kube-proxy-token-spdxp" is forbidden: User "system:node:old-k8s-version-112335" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-112335' and this object
	W0812 13:19:11.816687 1212353 logs.go:138] Found kubelet problem: Aug 12 13:13:35 old-k8s-version-112335 kubelet[671]: E0812 13:13:35.531828     671 reflector.go:138] object-"kube-system"/"kindnet-token-bnvnb": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "kindnet-token-bnvnb" is forbidden: User "system:node:old-k8s-version-112335" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-112335' and this object
	W0812 13:19:11.816922 1212353 logs.go:138] Found kubelet problem: Aug 12 13:13:35 old-k8s-version-112335 kubelet[671]: E0812 13:13:35.543185     671 reflector.go:138] object-"kube-system"/"coredns-token-wj7tz": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "coredns-token-wj7tz" is forbidden: User "system:node:old-k8s-version-112335" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-112335' and this object
	W0812 13:19:11.817156 1212353 logs.go:138] Found kubelet problem: Aug 12 13:13:35 old-k8s-version-112335 kubelet[671]: E0812 13:13:35.565702     671 reflector.go:138] object-"default"/"default-token-nqvmq": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "default-token-nqvmq" is forbidden: User "system:node:old-k8s-version-112335" cannot list resource "secrets" in API group "" in the namespace "default": no relationship found between node 'old-k8s-version-112335' and this object
	W0812 13:19:11.817420 1212353 logs.go:138] Found kubelet problem: Aug 12 13:13:35 old-k8s-version-112335 kubelet[671]: E0812 13:13:35.565958     671 reflector.go:138] object-"kube-system"/"storage-provisioner-token-cmdsj": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "storage-provisioner-token-cmdsj" is forbidden: User "system:node:old-k8s-version-112335" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-112335' and this object
	W0812 13:19:11.817658 1212353 logs.go:138] Found kubelet problem: Aug 12 13:13:35 old-k8s-version-112335 kubelet[671]: E0812 13:13:35.566053     671 reflector.go:138] object-"kube-system"/"coredns": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "coredns" is forbidden: User "system:node:old-k8s-version-112335" cannot list resource "configmaps" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-112335' and this object
	W0812 13:19:11.817902 1212353 logs.go:138] Found kubelet problem: Aug 12 13:13:35 old-k8s-version-112335 kubelet[671]: E0812 13:13:35.590326     671 reflector.go:138] object-"kube-system"/"metrics-server-token-ngnjg": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "metrics-server-token-ngnjg" is forbidden: User "system:node:old-k8s-version-112335" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-112335' and this object
	W0812 13:19:11.827670 1212353 logs.go:138] Found kubelet problem: Aug 12 13:13:39 old-k8s-version-112335 kubelet[671]: E0812 13:13:39.806774     671 pod_workers.go:191] Error syncing pod 34d824a4-d65e-4566-b95e-8f00f2c6fc71 ("metrics-server-9975d5f86-v2prr_kube-system(34d824a4-d65e-4566-b95e-8f00f2c6fc71)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.85.1:53: no such host"
	W0812 13:19:11.827916 1212353 logs.go:138] Found kubelet problem: Aug 12 13:13:40 old-k8s-version-112335 kubelet[671]: E0812 13:13:40.760714     671 pod_workers.go:191] Error syncing pod 34d824a4-d65e-4566-b95e-8f00f2c6fc71 ("metrics-server-9975d5f86-v2prr_kube-system(34d824a4-d65e-4566-b95e-8f00f2c6fc71)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W0812 13:19:11.832971 1212353 logs.go:138] Found kubelet problem: Aug 12 13:14:04 old-k8s-version-112335 kubelet[671]: E0812 13:14:04.278650     671 pod_workers.go:191] Error syncing pod 34d824a4-d65e-4566-b95e-8f00f2c6fc71 ("metrics-server-9975d5f86-v2prr_kube-system(34d824a4-d65e-4566-b95e-8f00f2c6fc71)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.85.1:53: no such host"
	W0812 13:19:11.833517 1212353 logs.go:138] Found kubelet problem: Aug 12 13:14:05 old-k8s-version-112335 kubelet[671]: E0812 13:14:05.847014     671 pod_workers.go:191] Error syncing pod 98eb45e0-5ebb-4a91-950c-b25211aceb65 ("dashboard-metrics-scraper-8d5bb5db8-6w7h6_kubernetes-dashboard(98eb45e0-5ebb-4a91-950c-b25211aceb65)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 10s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-6w7h6_kubernetes-dashboard(98eb45e0-5ebb-4a91-950c-b25211aceb65)"
	W0812 13:19:11.834024 1212353 logs.go:138] Found kubelet problem: Aug 12 13:14:06 old-k8s-version-112335 kubelet[671]: E0812 13:14:06.851261     671 pod_workers.go:191] Error syncing pod 98eb45e0-5ebb-4a91-950c-b25211aceb65 ("dashboard-metrics-scraper-8d5bb5db8-6w7h6_kubernetes-dashboard(98eb45e0-5ebb-4a91-950c-b25211aceb65)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 10s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-6w7h6_kubernetes-dashboard(98eb45e0-5ebb-4a91-950c-b25211aceb65)"
	W0812 13:19:11.834560 1212353 logs.go:138] Found kubelet problem: Aug 12 13:14:09 old-k8s-version-112335 kubelet[671]: E0812 13:14:09.866088     671 pod_workers.go:191] Error syncing pod 3c993bf4-fc61-4ad4-9f3b-a2c99cce757e ("storage-provisioner_kube-system(3c993bf4-fc61-4ad4-9f3b-a2c99cce757e)"), skipping: failed to "StartContainer" for "storage-provisioner" with CrashLoopBackOff: "back-off 10s restarting failed container=storage-provisioner pod=storage-provisioner_kube-system(3c993bf4-fc61-4ad4-9f3b-a2c99cce757e)"
	W0812 13:19:11.834928 1212353 logs.go:138] Found kubelet problem: Aug 12 13:14:12 old-k8s-version-112335 kubelet[671]: E0812 13:14:12.967750     671 pod_workers.go:191] Error syncing pod 98eb45e0-5ebb-4a91-950c-b25211aceb65 ("dashboard-metrics-scraper-8d5bb5db8-6w7h6_kubernetes-dashboard(98eb45e0-5ebb-4a91-950c-b25211aceb65)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 10s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-6w7h6_kubernetes-dashboard(98eb45e0-5ebb-4a91-950c-b25211aceb65)"
	W0812 13:19:11.835545 1212353 logs.go:138] Found kubelet problem: Aug 12 13:14:17 old-k8s-version-112335 kubelet[671]: E0812 13:14:17.357070     671 pod_workers.go:191] Error syncing pod 34d824a4-d65e-4566-b95e-8f00f2c6fc71 ("metrics-server-9975d5f86-v2prr_kube-system(34d824a4-d65e-4566-b95e-8f00f2c6fc71)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W0812 13:19:11.836312 1212353 logs.go:138] Found kubelet problem: Aug 12 13:14:25 old-k8s-version-112335 kubelet[671]: E0812 13:14:25.914407     671 pod_workers.go:191] Error syncing pod 98eb45e0-5ebb-4a91-950c-b25211aceb65 ("dashboard-metrics-scraper-8d5bb5db8-6w7h6_kubernetes-dashboard(98eb45e0-5ebb-4a91-950c-b25211aceb65)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-6w7h6_kubernetes-dashboard(98eb45e0-5ebb-4a91-950c-b25211aceb65)"
	W0812 13:19:11.838819 1212353 logs.go:138] Found kubelet problem: Aug 12 13:14:32 old-k8s-version-112335 kubelet[671]: E0812 13:14:32.368369     671 pod_workers.go:191] Error syncing pod 34d824a4-d65e-4566-b95e-8f00f2c6fc71 ("metrics-server-9975d5f86-v2prr_kube-system(34d824a4-d65e-4566-b95e-8f00f2c6fc71)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.85.1:53: no such host"
	W0812 13:19:11.839227 1212353 logs.go:138] Found kubelet problem: Aug 12 13:14:32 old-k8s-version-112335 kubelet[671]: E0812 13:14:32.966383     671 pod_workers.go:191] Error syncing pod 98eb45e0-5ebb-4a91-950c-b25211aceb65 ("dashboard-metrics-scraper-8d5bb5db8-6w7h6_kubernetes-dashboard(98eb45e0-5ebb-4a91-950c-b25211aceb65)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-6w7h6_kubernetes-dashboard(98eb45e0-5ebb-4a91-950c-b25211aceb65)"
	W0812 13:19:11.839444 1212353 logs.go:138] Found kubelet problem: Aug 12 13:14:45 old-k8s-version-112335 kubelet[671]: E0812 13:14:45.357518     671 pod_workers.go:191] Error syncing pod 34d824a4-d65e-4566-b95e-8f00f2c6fc71 ("metrics-server-9975d5f86-v2prr_kube-system(34d824a4-d65e-4566-b95e-8f00f2c6fc71)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W0812 13:19:11.841930 1212353 logs.go:138] Found kubelet problem: Aug 12 13:14:47 old-k8s-version-112335 kubelet[671]: E0812 13:14:47.982636     671 pod_workers.go:191] Error syncing pod 98eb45e0-5ebb-4a91-950c-b25211aceb65 ("dashboard-metrics-scraper-8d5bb5db8-6w7h6_kubernetes-dashboard(98eb45e0-5ebb-4a91-950c-b25211aceb65)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-6w7h6_kubernetes-dashboard(98eb45e0-5ebb-4a91-950c-b25211aceb65)"
	W0812 13:19:11.842317 1212353 logs.go:138] Found kubelet problem: Aug 12 13:14:52 old-k8s-version-112335 kubelet[671]: E0812 13:14:52.966081     671 pod_workers.go:191] Error syncing pod 98eb45e0-5ebb-4a91-950c-b25211aceb65 ("dashboard-metrics-scraper-8d5bb5db8-6w7h6_kubernetes-dashboard(98eb45e0-5ebb-4a91-950c-b25211aceb65)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-6w7h6_kubernetes-dashboard(98eb45e0-5ebb-4a91-950c-b25211aceb65)"
	W0812 13:19:11.842535 1212353 logs.go:138] Found kubelet problem: Aug 12 13:14:58 old-k8s-version-112335 kubelet[671]: E0812 13:14:58.356659     671 pod_workers.go:191] Error syncing pod 34d824a4-d65e-4566-b95e-8f00f2c6fc71 ("metrics-server-9975d5f86-v2prr_kube-system(34d824a4-d65e-4566-b95e-8f00f2c6fc71)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W0812 13:19:11.842913 1212353 logs.go:138] Found kubelet problem: Aug 12 13:15:06 old-k8s-version-112335 kubelet[671]: E0812 13:15:06.356379     671 pod_workers.go:191] Error syncing pod 98eb45e0-5ebb-4a91-950c-b25211aceb65 ("dashboard-metrics-scraper-8d5bb5db8-6w7h6_kubernetes-dashboard(98eb45e0-5ebb-4a91-950c-b25211aceb65)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-6w7h6_kubernetes-dashboard(98eb45e0-5ebb-4a91-950c-b25211aceb65)"
	W0812 13:19:11.843122 1212353 logs.go:138] Found kubelet problem: Aug 12 13:15:11 old-k8s-version-112335 kubelet[671]: E0812 13:15:11.360283     671 pod_workers.go:191] Error syncing pod 34d824a4-d65e-4566-b95e-8f00f2c6fc71 ("metrics-server-9975d5f86-v2prr_kube-system(34d824a4-d65e-4566-b95e-8f00f2c6fc71)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W0812 13:19:11.843574 1212353 logs.go:138] Found kubelet problem: Aug 12 13:15:20 old-k8s-version-112335 kubelet[671]: E0812 13:15:20.356356     671 pod_workers.go:191] Error syncing pod 98eb45e0-5ebb-4a91-950c-b25211aceb65 ("dashboard-metrics-scraper-8d5bb5db8-6w7h6_kubernetes-dashboard(98eb45e0-5ebb-4a91-950c-b25211aceb65)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-6w7h6_kubernetes-dashboard(98eb45e0-5ebb-4a91-950c-b25211aceb65)"
	W0812 13:19:11.846743 1212353 logs.go:138] Found kubelet problem: Aug 12 13:15:23 old-k8s-version-112335 kubelet[671]: E0812 13:15:23.375625     671 pod_workers.go:191] Error syncing pod 34d824a4-d65e-4566-b95e-8f00f2c6fc71 ("metrics-server-9975d5f86-v2prr_kube-system(34d824a4-d65e-4566-b95e-8f00f2c6fc71)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.85.1:53: no such host"
	W0812 13:19:11.847480 1212353 logs.go:138] Found kubelet problem: Aug 12 13:15:36 old-k8s-version-112335 kubelet[671]: E0812 13:15:36.141806     671 pod_workers.go:191] Error syncing pod 98eb45e0-5ebb-4a91-950c-b25211aceb65 ("dashboard-metrics-scraper-8d5bb5db8-6w7h6_kubernetes-dashboard(98eb45e0-5ebb-4a91-950c-b25211aceb65)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-6w7h6_kubernetes-dashboard(98eb45e0-5ebb-4a91-950c-b25211aceb65)"
	W0812 13:19:11.847721 1212353 logs.go:138] Found kubelet problem: Aug 12 13:15:36 old-k8s-version-112335 kubelet[671]: E0812 13:15:36.356776     671 pod_workers.go:191] Error syncing pod 34d824a4-d65e-4566-b95e-8f00f2c6fc71 ("metrics-server-9975d5f86-v2prr_kube-system(34d824a4-d65e-4566-b95e-8f00f2c6fc71)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W0812 13:19:11.848130 1212353 logs.go:138] Found kubelet problem: Aug 12 13:15:42 old-k8s-version-112335 kubelet[671]: E0812 13:15:42.967870     671 pod_workers.go:191] Error syncing pod 98eb45e0-5ebb-4a91-950c-b25211aceb65 ("dashboard-metrics-scraper-8d5bb5db8-6w7h6_kubernetes-dashboard(98eb45e0-5ebb-4a91-950c-b25211aceb65)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-6w7h6_kubernetes-dashboard(98eb45e0-5ebb-4a91-950c-b25211aceb65)"
	W0812 13:19:11.848364 1212353 logs.go:138] Found kubelet problem: Aug 12 13:15:51 old-k8s-version-112335 kubelet[671]: E0812 13:15:51.358415     671 pod_workers.go:191] Error syncing pod 34d824a4-d65e-4566-b95e-8f00f2c6fc71 ("metrics-server-9975d5f86-v2prr_kube-system(34d824a4-d65e-4566-b95e-8f00f2c6fc71)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W0812 13:19:11.848787 1212353 logs.go:138] Found kubelet problem: Aug 12 13:15:56 old-k8s-version-112335 kubelet[671]: E0812 13:15:56.357561     671 pod_workers.go:191] Error syncing pod 98eb45e0-5ebb-4a91-950c-b25211aceb65 ("dashboard-metrics-scraper-8d5bb5db8-6w7h6_kubernetes-dashboard(98eb45e0-5ebb-4a91-950c-b25211aceb65)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-6w7h6_kubernetes-dashboard(98eb45e0-5ebb-4a91-950c-b25211aceb65)"
	W0812 13:19:11.849050 1212353 logs.go:138] Found kubelet problem: Aug 12 13:16:05 old-k8s-version-112335 kubelet[671]: E0812 13:16:05.356796     671 pod_workers.go:191] Error syncing pod 34d824a4-d65e-4566-b95e-8f00f2c6fc71 ("metrics-server-9975d5f86-v2prr_kube-system(34d824a4-d65e-4566-b95e-8f00f2c6fc71)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W0812 13:19:11.849482 1212353 logs.go:138] Found kubelet problem: Aug 12 13:16:09 old-k8s-version-112335 kubelet[671]: E0812 13:16:09.356580     671 pod_workers.go:191] Error syncing pod 98eb45e0-5ebb-4a91-950c-b25211aceb65 ("dashboard-metrics-scraper-8d5bb5db8-6w7h6_kubernetes-dashboard(98eb45e0-5ebb-4a91-950c-b25211aceb65)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-6w7h6_kubernetes-dashboard(98eb45e0-5ebb-4a91-950c-b25211aceb65)"
	W0812 13:19:11.849718 1212353 logs.go:138] Found kubelet problem: Aug 12 13:16:19 old-k8s-version-112335 kubelet[671]: E0812 13:16:19.360216     671 pod_workers.go:191] Error syncing pod 34d824a4-d65e-4566-b95e-8f00f2c6fc71 ("metrics-server-9975d5f86-v2prr_kube-system(34d824a4-d65e-4566-b95e-8f00f2c6fc71)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W0812 13:19:11.850130 1212353 logs.go:138] Found kubelet problem: Aug 12 13:16:24 old-k8s-version-112335 kubelet[671]: E0812 13:16:24.356502     671 pod_workers.go:191] Error syncing pod 98eb45e0-5ebb-4a91-950c-b25211aceb65 ("dashboard-metrics-scraper-8d5bb5db8-6w7h6_kubernetes-dashboard(98eb45e0-5ebb-4a91-950c-b25211aceb65)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-6w7h6_kubernetes-dashboard(98eb45e0-5ebb-4a91-950c-b25211aceb65)"
	W0812 13:19:11.850361 1212353 logs.go:138] Found kubelet problem: Aug 12 13:16:34 old-k8s-version-112335 kubelet[671]: E0812 13:16:34.356788     671 pod_workers.go:191] Error syncing pod 34d824a4-d65e-4566-b95e-8f00f2c6fc71 ("metrics-server-9975d5f86-v2prr_kube-system(34d824a4-d65e-4566-b95e-8f00f2c6fc71)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W0812 13:19:11.850774 1212353 logs.go:138] Found kubelet problem: Aug 12 13:16:39 old-k8s-version-112335 kubelet[671]: E0812 13:16:39.356466     671 pod_workers.go:191] Error syncing pod 98eb45e0-5ebb-4a91-950c-b25211aceb65 ("dashboard-metrics-scraper-8d5bb5db8-6w7h6_kubernetes-dashboard(98eb45e0-5ebb-4a91-950c-b25211aceb65)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-6w7h6_kubernetes-dashboard(98eb45e0-5ebb-4a91-950c-b25211aceb65)"
	W0812 13:19:11.854036 1212353 logs.go:138] Found kubelet problem: Aug 12 13:16:46 old-k8s-version-112335 kubelet[671]: E0812 13:16:46.364626     671 pod_workers.go:191] Error syncing pod 34d824a4-d65e-4566-b95e-8f00f2c6fc71 ("metrics-server-9975d5f86-v2prr_kube-system(34d824a4-d65e-4566-b95e-8f00f2c6fc71)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.85.1:53: no such host"
	W0812 13:19:11.854484 1212353 logs.go:138] Found kubelet problem: Aug 12 13:16:53 old-k8s-version-112335 kubelet[671]: E0812 13:16:53.357451     671 pod_workers.go:191] Error syncing pod 98eb45e0-5ebb-4a91-950c-b25211aceb65 ("dashboard-metrics-scraper-8d5bb5db8-6w7h6_kubernetes-dashboard(98eb45e0-5ebb-4a91-950c-b25211aceb65)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-6w7h6_kubernetes-dashboard(98eb45e0-5ebb-4a91-950c-b25211aceb65)"
	W0812 13:19:11.854726 1212353 logs.go:138] Found kubelet problem: Aug 12 13:16:59 old-k8s-version-112335 kubelet[671]: E0812 13:16:59.356869     671 pod_workers.go:191] Error syncing pod 34d824a4-d65e-4566-b95e-8f00f2c6fc71 ("metrics-server-9975d5f86-v2prr_kube-system(34d824a4-d65e-4566-b95e-8f00f2c6fc71)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W0812 13:19:11.855465 1212353 logs.go:138] Found kubelet problem: Aug 12 13:17:08 old-k8s-version-112335 kubelet[671]: E0812 13:17:08.461635     671 pod_workers.go:191] Error syncing pod 98eb45e0-5ebb-4a91-950c-b25211aceb65 ("dashboard-metrics-scraper-8d5bb5db8-6w7h6_kubernetes-dashboard(98eb45e0-5ebb-4a91-950c-b25211aceb65)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-6w7h6_kubernetes-dashboard(98eb45e0-5ebb-4a91-950c-b25211aceb65)"
	W0812 13:19:11.855721 1212353 logs.go:138] Found kubelet problem: Aug 12 13:17:10 old-k8s-version-112335 kubelet[671]: E0812 13:17:10.356646     671 pod_workers.go:191] Error syncing pod 34d824a4-d65e-4566-b95e-8f00f2c6fc71 ("metrics-server-9975d5f86-v2prr_kube-system(34d824a4-d65e-4566-b95e-8f00f2c6fc71)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W0812 13:19:11.856121 1212353 logs.go:138] Found kubelet problem: Aug 12 13:17:12 old-k8s-version-112335 kubelet[671]: E0812 13:17:12.982447     671 pod_workers.go:191] Error syncing pod 98eb45e0-5ebb-4a91-950c-b25211aceb65 ("dashboard-metrics-scraper-8d5bb5db8-6w7h6_kubernetes-dashboard(98eb45e0-5ebb-4a91-950c-b25211aceb65)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-6w7h6_kubernetes-dashboard(98eb45e0-5ebb-4a91-950c-b25211aceb65)"
	W0812 13:19:11.856356 1212353 logs.go:138] Found kubelet problem: Aug 12 13:17:23 old-k8s-version-112335 kubelet[671]: E0812 13:17:23.357066     671 pod_workers.go:191] Error syncing pod 34d824a4-d65e-4566-b95e-8f00f2c6fc71 ("metrics-server-9975d5f86-v2prr_kube-system(34d824a4-d65e-4566-b95e-8f00f2c6fc71)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W0812 13:19:11.856800 1212353 logs.go:138] Found kubelet problem: Aug 12 13:17:27 old-k8s-version-112335 kubelet[671]: E0812 13:17:27.356820     671 pod_workers.go:191] Error syncing pod 98eb45e0-5ebb-4a91-950c-b25211aceb65 ("dashboard-metrics-scraper-8d5bb5db8-6w7h6_kubernetes-dashboard(98eb45e0-5ebb-4a91-950c-b25211aceb65)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-6w7h6_kubernetes-dashboard(98eb45e0-5ebb-4a91-950c-b25211aceb65)"
	W0812 13:19:11.857023 1212353 logs.go:138] Found kubelet problem: Aug 12 13:17:36 old-k8s-version-112335 kubelet[671]: E0812 13:17:36.356796     671 pod_workers.go:191] Error syncing pod 34d824a4-d65e-4566-b95e-8f00f2c6fc71 ("metrics-server-9975d5f86-v2prr_kube-system(34d824a4-d65e-4566-b95e-8f00f2c6fc71)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W0812 13:19:11.857427 1212353 logs.go:138] Found kubelet problem: Aug 12 13:17:38 old-k8s-version-112335 kubelet[671]: E0812 13:17:38.356467     671 pod_workers.go:191] Error syncing pod 98eb45e0-5ebb-4a91-950c-b25211aceb65 ("dashboard-metrics-scraper-8d5bb5db8-6w7h6_kubernetes-dashboard(98eb45e0-5ebb-4a91-950c-b25211aceb65)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-6w7h6_kubernetes-dashboard(98eb45e0-5ebb-4a91-950c-b25211aceb65)"
	W0812 13:19:11.857666 1212353 logs.go:138] Found kubelet problem: Aug 12 13:17:47 old-k8s-version-112335 kubelet[671]: E0812 13:17:47.357155     671 pod_workers.go:191] Error syncing pod 34d824a4-d65e-4566-b95e-8f00f2c6fc71 ("metrics-server-9975d5f86-v2prr_kube-system(34d824a4-d65e-4566-b95e-8f00f2c6fc71)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W0812 13:19:11.858132 1212353 logs.go:138] Found kubelet problem: Aug 12 13:17:51 old-k8s-version-112335 kubelet[671]: E0812 13:17:51.357564     671 pod_workers.go:191] Error syncing pod 98eb45e0-5ebb-4a91-950c-b25211aceb65 ("dashboard-metrics-scraper-8d5bb5db8-6w7h6_kubernetes-dashboard(98eb45e0-5ebb-4a91-950c-b25211aceb65)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-6w7h6_kubernetes-dashboard(98eb45e0-5ebb-4a91-950c-b25211aceb65)"
	W0812 13:19:11.858444 1212353 logs.go:138] Found kubelet problem: Aug 12 13:18:00 old-k8s-version-112335 kubelet[671]: E0812 13:18:00.357436     671 pod_workers.go:191] Error syncing pod 34d824a4-d65e-4566-b95e-8f00f2c6fc71 ("metrics-server-9975d5f86-v2prr_kube-system(34d824a4-d65e-4566-b95e-8f00f2c6fc71)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W0812 13:19:11.858842 1212353 logs.go:138] Found kubelet problem: Aug 12 13:18:06 old-k8s-version-112335 kubelet[671]: E0812 13:18:06.356382     671 pod_workers.go:191] Error syncing pod 98eb45e0-5ebb-4a91-950c-b25211aceb65 ("dashboard-metrics-scraper-8d5bb5db8-6w7h6_kubernetes-dashboard(98eb45e0-5ebb-4a91-950c-b25211aceb65)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-6w7h6_kubernetes-dashboard(98eb45e0-5ebb-4a91-950c-b25211aceb65)"
	W0812 13:19:11.859084 1212353 logs.go:138] Found kubelet problem: Aug 12 13:18:11 old-k8s-version-112335 kubelet[671]: E0812 13:18:11.356726     671 pod_workers.go:191] Error syncing pod 34d824a4-d65e-4566-b95e-8f00f2c6fc71 ("metrics-server-9975d5f86-v2prr_kube-system(34d824a4-d65e-4566-b95e-8f00f2c6fc71)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W0812 13:19:11.859501 1212353 logs.go:138] Found kubelet problem: Aug 12 13:18:21 old-k8s-version-112335 kubelet[671]: E0812 13:18:21.358016     671 pod_workers.go:191] Error syncing pod 98eb45e0-5ebb-4a91-950c-b25211aceb65 ("dashboard-metrics-scraper-8d5bb5db8-6w7h6_kubernetes-dashboard(98eb45e0-5ebb-4a91-950c-b25211aceb65)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-6w7h6_kubernetes-dashboard(98eb45e0-5ebb-4a91-950c-b25211aceb65)"
	W0812 13:19:11.859758 1212353 logs.go:138] Found kubelet problem: Aug 12 13:18:25 old-k8s-version-112335 kubelet[671]: E0812 13:18:25.359255     671 pod_workers.go:191] Error syncing pod 34d824a4-d65e-4566-b95e-8f00f2c6fc71 ("metrics-server-9975d5f86-v2prr_kube-system(34d824a4-d65e-4566-b95e-8f00f2c6fc71)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W0812 13:19:11.860173 1212353 logs.go:138] Found kubelet problem: Aug 12 13:18:33 old-k8s-version-112335 kubelet[671]: E0812 13:18:33.356927     671 pod_workers.go:191] Error syncing pod 98eb45e0-5ebb-4a91-950c-b25211aceb65 ("dashboard-metrics-scraper-8d5bb5db8-6w7h6_kubernetes-dashboard(98eb45e0-5ebb-4a91-950c-b25211aceb65)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-6w7h6_kubernetes-dashboard(98eb45e0-5ebb-4a91-950c-b25211aceb65)"
	W0812 13:19:11.860409 1212353 logs.go:138] Found kubelet problem: Aug 12 13:18:39 old-k8s-version-112335 kubelet[671]: E0812 13:18:39.356920     671 pod_workers.go:191] Error syncing pod 34d824a4-d65e-4566-b95e-8f00f2c6fc71 ("metrics-server-9975d5f86-v2prr_kube-system(34d824a4-d65e-4566-b95e-8f00f2c6fc71)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W0812 13:19:11.860805 1212353 logs.go:138] Found kubelet problem: Aug 12 13:18:45 old-k8s-version-112335 kubelet[671]: E0812 13:18:45.356665     671 pod_workers.go:191] Error syncing pod 98eb45e0-5ebb-4a91-950c-b25211aceb65 ("dashboard-metrics-scraper-8d5bb5db8-6w7h6_kubernetes-dashboard(98eb45e0-5ebb-4a91-950c-b25211aceb65)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-6w7h6_kubernetes-dashboard(98eb45e0-5ebb-4a91-950c-b25211aceb65)"
	W0812 13:19:11.861040 1212353 logs.go:138] Found kubelet problem: Aug 12 13:18:51 old-k8s-version-112335 kubelet[671]: E0812 13:18:51.356752     671 pod_workers.go:191] Error syncing pod 34d824a4-d65e-4566-b95e-8f00f2c6fc71 ("metrics-server-9975d5f86-v2prr_kube-system(34d824a4-d65e-4566-b95e-8f00f2c6fc71)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W0812 13:19:11.861491 1212353 logs.go:138] Found kubelet problem: Aug 12 13:18:57 old-k8s-version-112335 kubelet[671]: E0812 13:18:57.356673     671 pod_workers.go:191] Error syncing pod 98eb45e0-5ebb-4a91-950c-b25211aceb65 ("dashboard-metrics-scraper-8d5bb5db8-6w7h6_kubernetes-dashboard(98eb45e0-5ebb-4a91-950c-b25211aceb65)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-6w7h6_kubernetes-dashboard(98eb45e0-5ebb-4a91-950c-b25211aceb65)"
	W0812 13:19:11.861706 1212353 logs.go:138] Found kubelet problem: Aug 12 13:19:06 old-k8s-version-112335 kubelet[671]: E0812 13:19:06.357355     671 pod_workers.go:191] Error syncing pod 34d824a4-d65e-4566-b95e-8f00f2c6fc71 ("metrics-server-9975d5f86-v2prr_kube-system(34d824a4-d65e-4566-b95e-8f00f2c6fc71)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W0812 13:19:11.862254 1212353 logs.go:138] Found kubelet problem: Aug 12 13:19:08 old-k8s-version-112335 kubelet[671]: E0812 13:19:08.356438     671 pod_workers.go:191] Error syncing pod 98eb45e0-5ebb-4a91-950c-b25211aceb65 ("dashboard-metrics-scraper-8d5bb5db8-6w7h6_kubernetes-dashboard(98eb45e0-5ebb-4a91-950c-b25211aceb65)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-6w7h6_kubernetes-dashboard(98eb45e0-5ebb-4a91-950c-b25211aceb65)"
	I0812 13:19:11.862292 1212353 logs.go:123] Gathering logs for dmesg ...
	I0812 13:19:11.862307 1212353 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
	I0812 13:19:11.886918 1212353 logs.go:123] Gathering logs for kube-apiserver [e4cf465775a34b80fbfbd63dc4f0643c8d6a61c508c1c06d6e58548109c82a20] ...
	I0812 13:19:11.886948 1212353 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 e4cf465775a34b80fbfbd63dc4f0643c8d6a61c508c1c06d6e58548109c82a20"
	I0812 13:19:12.044977 1212353 logs.go:123] Gathering logs for containerd ...
	I0812 13:19:12.045038 1212353 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u containerd -n 400"
	I0812 13:19:12.135386 1212353 out.go:304] Setting ErrFile to fd 2...
	I0812 13:19:12.135423 1212353 out.go:338] TERM=,COLORTERM=, which probably does not support color
	W0812 13:19:12.135480 1212353 out.go:239] X Problems detected in kubelet:
	X Problems detected in kubelet:
	W0812 13:19:12.135495 1212353 out.go:239]   Aug 12 13:18:45 old-k8s-version-112335 kubelet[671]: E0812 13:18:45.356665     671 pod_workers.go:191] Error syncing pod 98eb45e0-5ebb-4a91-950c-b25211aceb65 ("dashboard-metrics-scraper-8d5bb5db8-6w7h6_kubernetes-dashboard(98eb45e0-5ebb-4a91-950c-b25211aceb65)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-6w7h6_kubernetes-dashboard(98eb45e0-5ebb-4a91-950c-b25211aceb65)"
	  Aug 12 13:18:45 old-k8s-version-112335 kubelet[671]: E0812 13:18:45.356665     671 pod_workers.go:191] Error syncing pod 98eb45e0-5ebb-4a91-950c-b25211aceb65 ("dashboard-metrics-scraper-8d5bb5db8-6w7h6_kubernetes-dashboard(98eb45e0-5ebb-4a91-950c-b25211aceb65)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-6w7h6_kubernetes-dashboard(98eb45e0-5ebb-4a91-950c-b25211aceb65)"
	W0812 13:19:12.135506 1212353 out.go:239]   Aug 12 13:18:51 old-k8s-version-112335 kubelet[671]: E0812 13:18:51.356752     671 pod_workers.go:191] Error syncing pod 34d824a4-d65e-4566-b95e-8f00f2c6fc71 ("metrics-server-9975d5f86-v2prr_kube-system(34d824a4-d65e-4566-b95e-8f00f2c6fc71)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	  Aug 12 13:18:51 old-k8s-version-112335 kubelet[671]: E0812 13:18:51.356752     671 pod_workers.go:191] Error syncing pod 34d824a4-d65e-4566-b95e-8f00f2c6fc71 ("metrics-server-9975d5f86-v2prr_kube-system(34d824a4-d65e-4566-b95e-8f00f2c6fc71)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W0812 13:19:12.135522 1212353 out.go:239]   Aug 12 13:18:57 old-k8s-version-112335 kubelet[671]: E0812 13:18:57.356673     671 pod_workers.go:191] Error syncing pod 98eb45e0-5ebb-4a91-950c-b25211aceb65 ("dashboard-metrics-scraper-8d5bb5db8-6w7h6_kubernetes-dashboard(98eb45e0-5ebb-4a91-950c-b25211aceb65)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-6w7h6_kubernetes-dashboard(98eb45e0-5ebb-4a91-950c-b25211aceb65)"
	  Aug 12 13:18:57 old-k8s-version-112335 kubelet[671]: E0812 13:18:57.356673     671 pod_workers.go:191] Error syncing pod 98eb45e0-5ebb-4a91-950c-b25211aceb65 ("dashboard-metrics-scraper-8d5bb5db8-6w7h6_kubernetes-dashboard(98eb45e0-5ebb-4a91-950c-b25211aceb65)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-6w7h6_kubernetes-dashboard(98eb45e0-5ebb-4a91-950c-b25211aceb65)"
	W0812 13:19:12.135529 1212353 out.go:239]   Aug 12 13:19:06 old-k8s-version-112335 kubelet[671]: E0812 13:19:06.357355     671 pod_workers.go:191] Error syncing pod 34d824a4-d65e-4566-b95e-8f00f2c6fc71 ("metrics-server-9975d5f86-v2prr_kube-system(34d824a4-d65e-4566-b95e-8f00f2c6fc71)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	  Aug 12 13:19:06 old-k8s-version-112335 kubelet[671]: E0812 13:19:06.357355     671 pod_workers.go:191] Error syncing pod 34d824a4-d65e-4566-b95e-8f00f2c6fc71 ("metrics-server-9975d5f86-v2prr_kube-system(34d824a4-d65e-4566-b95e-8f00f2c6fc71)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W0812 13:19:12.135542 1212353 out.go:239]   Aug 12 13:19:08 old-k8s-version-112335 kubelet[671]: E0812 13:19:08.356438     671 pod_workers.go:191] Error syncing pod 98eb45e0-5ebb-4a91-950c-b25211aceb65 ("dashboard-metrics-scraper-8d5bb5db8-6w7h6_kubernetes-dashboard(98eb45e0-5ebb-4a91-950c-b25211aceb65)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-6w7h6_kubernetes-dashboard(98eb45e0-5ebb-4a91-950c-b25211aceb65)"
	  Aug 12 13:19:08 old-k8s-version-112335 kubelet[671]: E0812 13:19:08.356438     671 pod_workers.go:191] Error syncing pod 98eb45e0-5ebb-4a91-950c-b25211aceb65 ("dashboard-metrics-scraper-8d5bb5db8-6w7h6_kubernetes-dashboard(98eb45e0-5ebb-4a91-950c-b25211aceb65)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-6w7h6_kubernetes-dashboard(98eb45e0-5ebb-4a91-950c-b25211aceb65)"
	I0812 13:19:12.135549 1212353 out.go:304] Setting ErrFile to fd 2...
	I0812 13:19:12.135555 1212353 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0812 13:19:22.137007 1212353 api_server.go:253] Checking apiserver healthz at https://192.168.85.2:8443/healthz ...
	I0812 13:19:22.148426 1212353 api_server.go:279] https://192.168.85.2:8443/healthz returned 200:
	ok
	I0812 13:19:22.150863 1212353 out.go:177] 
	W0812 13:19:22.152732 1212353 out.go:239] X Exiting due to K8S_UNHEALTHY_CONTROL_PLANE: wait 6m0s for node: wait for healthy API server: controlPlane never updated to v1.20.0
	X Exiting due to K8S_UNHEALTHY_CONTROL_PLANE: wait 6m0s for node: wait for healthy API server: controlPlane never updated to v1.20.0
	W0812 13:19:22.152770 1212353 out.go:239] * Suggestion: Control Plane could not update, try minikube delete --all --purge
	* Suggestion: Control Plane could not update, try minikube delete --all --purge
	W0812 13:19:22.152954 1212353 out.go:239] * Related issue: https://github.com/kubernetes/minikube/issues/11417
	* Related issue: https://github.com/kubernetes/minikube/issues/11417
	W0812 13:19:22.152967 1212353 out.go:239] * 
	* 
	W0812 13:19:22.154614 1212353 out.go:239] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                             │
	│    * If the above advice does not help, please let us know:                                 │
	│      https://github.com/kubernetes/minikube/issues/new/choose                               │
	│                                                                                             │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │
	│                                                                                             │
	╰─────────────────────────────────────────────────────────────────────────────────────────────╯
	╭─────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                             │
	│    * If the above advice does not help, please let us know:                                 │
	│      https://github.com/kubernetes/minikube/issues/new/choose                               │
	│                                                                                             │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │
	│                                                                                             │
	╰─────────────────────────────────────────────────────────────────────────────────────────────╯
	I0812 13:19:22.156233 1212353 out.go:177] 

                                                
                                                
** /stderr **
start_stop_delete_test.go:259: failed to start minikube post-stop. args "out/minikube-linux-arm64 start -p old-k8s-version-112335 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=docker  --container-runtime=containerd --kubernetes-version=v1.20.0": exit status 102
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:230: ======>  post-mortem[TestStartStop/group/old-k8s-version/serial/SecondStart]: docker inspect <======
helpers_test.go:231: (dbg) Run:  docker inspect old-k8s-version-112335
helpers_test.go:235: (dbg) docker inspect old-k8s-version-112335:

                                                
                                                
-- stdout --
	[
	    {
	        "Id": "8129fd334711848645ba7af283ad700d40cfa3d99f7d758ad5ddce6c6b920f34",
	        "Created": "2024-08-12T13:10:10.093470564Z",
	        "Path": "/usr/local/bin/entrypoint",
	        "Args": [
	            "/sbin/init"
	        ],
	        "State": {
	            "Status": "running",
	            "Running": true,
	            "Paused": false,
	            "Restarting": false,
	            "OOMKilled": false,
	            "Dead": false,
	            "Pid": 1212565,
	            "ExitCode": 0,
	            "Error": "",
	            "StartedAt": "2024-08-12T13:13:07.632484346Z",
	            "FinishedAt": "2024-08-12T13:13:06.302477036Z"
	        },
	        "Image": "sha256:3c2a9878c3c4bba39f30158565171acf4131a22446ec76f61f10b90a1f2f9e07",
	        "ResolvConfPath": "/var/lib/docker/containers/8129fd334711848645ba7af283ad700d40cfa3d99f7d758ad5ddce6c6b920f34/resolv.conf",
	        "HostnamePath": "/var/lib/docker/containers/8129fd334711848645ba7af283ad700d40cfa3d99f7d758ad5ddce6c6b920f34/hostname",
	        "HostsPath": "/var/lib/docker/containers/8129fd334711848645ba7af283ad700d40cfa3d99f7d758ad5ddce6c6b920f34/hosts",
	        "LogPath": "/var/lib/docker/containers/8129fd334711848645ba7af283ad700d40cfa3d99f7d758ad5ddce6c6b920f34/8129fd334711848645ba7af283ad700d40cfa3d99f7d758ad5ddce6c6b920f34-json.log",
	        "Name": "/old-k8s-version-112335",
	        "RestartCount": 0,
	        "Driver": "overlay2",
	        "Platform": "linux",
	        "MountLabel": "",
	        "ProcessLabel": "",
	        "AppArmorProfile": "unconfined",
	        "ExecIDs": null,
	        "HostConfig": {
	            "Binds": [
	                "/lib/modules:/lib/modules:ro",
	                "old-k8s-version-112335:/var"
	            ],
	            "ContainerIDFile": "",
	            "LogConfig": {
	                "Type": "json-file",
	                "Config": {}
	            },
	            "NetworkMode": "old-k8s-version-112335",
	            "PortBindings": {
	                "22/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": ""
	                    }
	                ],
	                "2376/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": ""
	                    }
	                ],
	                "32443/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": ""
	                    }
	                ],
	                "5000/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": ""
	                    }
	                ],
	                "8443/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": ""
	                    }
	                ]
	            },
	            "RestartPolicy": {
	                "Name": "no",
	                "MaximumRetryCount": 0
	            },
	            "AutoRemove": false,
	            "VolumeDriver": "",
	            "VolumesFrom": null,
	            "ConsoleSize": [
	                0,
	                0
	            ],
	            "CapAdd": null,
	            "CapDrop": null,
	            "CgroupnsMode": "host",
	            "Dns": [],
	            "DnsOptions": [],
	            "DnsSearch": [],
	            "ExtraHosts": null,
	            "GroupAdd": null,
	            "IpcMode": "private",
	            "Cgroup": "",
	            "Links": null,
	            "OomScoreAdj": 0,
	            "PidMode": "",
	            "Privileged": true,
	            "PublishAllPorts": false,
	            "ReadonlyRootfs": false,
	            "SecurityOpt": [
	                "seccomp=unconfined",
	                "apparmor=unconfined",
	                "label=disable"
	            ],
	            "Tmpfs": {
	                "/run": "",
	                "/tmp": ""
	            },
	            "UTSMode": "",
	            "UsernsMode": "",
	            "ShmSize": 67108864,
	            "Runtime": "runc",
	            "Isolation": "",
	            "CpuShares": 0,
	            "Memory": 2306867200,
	            "NanoCpus": 2000000000,
	            "CgroupParent": "",
	            "BlkioWeight": 0,
	            "BlkioWeightDevice": [],
	            "BlkioDeviceReadBps": [],
	            "BlkioDeviceWriteBps": [],
	            "BlkioDeviceReadIOps": [],
	            "BlkioDeviceWriteIOps": [],
	            "CpuPeriod": 0,
	            "CpuQuota": 0,
	            "CpuRealtimePeriod": 0,
	            "CpuRealtimeRuntime": 0,
	            "CpusetCpus": "",
	            "CpusetMems": "",
	            "Devices": [],
	            "DeviceCgroupRules": null,
	            "DeviceRequests": null,
	            "MemoryReservation": 0,
	            "MemorySwap": 4613734400,
	            "MemorySwappiness": null,
	            "OomKillDisable": false,
	            "PidsLimit": null,
	            "Ulimits": [],
	            "CpuCount": 0,
	            "CpuPercent": 0,
	            "IOMaximumIOps": 0,
	            "IOMaximumBandwidth": 0,
	            "MaskedPaths": null,
	            "ReadonlyPaths": null
	        },
	        "GraphDriver": {
	            "Data": {
	                "LowerDir": "/var/lib/docker/overlay2/5ece74f878c1bc62e5623ceb03b3d42516dbc11d6c0605d9aa84232194aa8afb-init/diff:/var/lib/docker/overlay2/1f2e4529443bfeb33feb3238889864713c36cb4ab004f88ab476ba0ee1a2cd6b/diff",
	                "MergedDir": "/var/lib/docker/overlay2/5ece74f878c1bc62e5623ceb03b3d42516dbc11d6c0605d9aa84232194aa8afb/merged",
	                "UpperDir": "/var/lib/docker/overlay2/5ece74f878c1bc62e5623ceb03b3d42516dbc11d6c0605d9aa84232194aa8afb/diff",
	                "WorkDir": "/var/lib/docker/overlay2/5ece74f878c1bc62e5623ceb03b3d42516dbc11d6c0605d9aa84232194aa8afb/work"
	            },
	            "Name": "overlay2"
	        },
	        "Mounts": [
	            {
	                "Type": "bind",
	                "Source": "/lib/modules",
	                "Destination": "/lib/modules",
	                "Mode": "ro",
	                "RW": false,
	                "Propagation": "rprivate"
	            },
	            {
	                "Type": "volume",
	                "Name": "old-k8s-version-112335",
	                "Source": "/var/lib/docker/volumes/old-k8s-version-112335/_data",
	                "Destination": "/var",
	                "Driver": "local",
	                "Mode": "z",
	                "RW": true,
	                "Propagation": ""
	            }
	        ],
	        "Config": {
	            "Hostname": "old-k8s-version-112335",
	            "Domainname": "",
	            "User": "",
	            "AttachStdin": false,
	            "AttachStdout": false,
	            "AttachStderr": false,
	            "ExposedPorts": {
	                "22/tcp": {},
	                "2376/tcp": {},
	                "32443/tcp": {},
	                "5000/tcp": {},
	                "8443/tcp": {}
	            },
	            "Tty": true,
	            "OpenStdin": false,
	            "StdinOnce": false,
	            "Env": [
	                "container=docker",
	                "PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin"
	            ],
	            "Cmd": null,
	            "Image": "gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1723026928-19389@sha256:7715fe0c5dce35b4eb757765cbbe02d40cd8b5effa0639735e42ad89f4f51ef0",
	            "Volumes": null,
	            "WorkingDir": "/",
	            "Entrypoint": [
	                "/usr/local/bin/entrypoint",
	                "/sbin/init"
	            ],
	            "OnBuild": null,
	            "Labels": {
	                "created_by.minikube.sigs.k8s.io": "true",
	                "mode.minikube.sigs.k8s.io": "old-k8s-version-112335",
	                "name.minikube.sigs.k8s.io": "old-k8s-version-112335",
	                "role.minikube.sigs.k8s.io": ""
	            },
	            "StopSignal": "SIGRTMIN+3"
	        },
	        "NetworkSettings": {
	            "Bridge": "",
	            "SandboxID": "ba1ffccf3d2c031f964e6b392d85d6e1094892e11c2e4b3438da8b5f8841a725",
	            "SandboxKey": "/var/run/docker/netns/ba1ffccf3d2c",
	            "Ports": {
	                "22/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": "34190"
	                    }
	                ],
	                "2376/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": "34191"
	                    }
	                ],
	                "32443/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": "34194"
	                    }
	                ],
	                "5000/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": "34192"
	                    }
	                ],
	                "8443/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": "34193"
	                    }
	                ]
	            },
	            "HairpinMode": false,
	            "LinkLocalIPv6Address": "",
	            "LinkLocalIPv6PrefixLen": 0,
	            "SecondaryIPAddresses": null,
	            "SecondaryIPv6Addresses": null,
	            "EndpointID": "",
	            "Gateway": "",
	            "GlobalIPv6Address": "",
	            "GlobalIPv6PrefixLen": 0,
	            "IPAddress": "",
	            "IPPrefixLen": 0,
	            "IPv6Gateway": "",
	            "MacAddress": "",
	            "Networks": {
	                "old-k8s-version-112335": {
	                    "IPAMConfig": {
	                        "IPv4Address": "192.168.85.2"
	                    },
	                    "Links": null,
	                    "Aliases": null,
	                    "MacAddress": "02:42:c0:a8:55:02",
	                    "DriverOpts": null,
	                    "NetworkID": "c4f23ab1e97f8b56d1ac5e5e398652917025c1681a5350e7915a17c876bbed64",
	                    "EndpointID": "da54cb6ce667fe18a7d1539a734a670907d71d94cf720512fe3be7ecd9046fdc",
	                    "Gateway": "192.168.85.1",
	                    "IPAddress": "192.168.85.2",
	                    "IPPrefixLen": 24,
	                    "IPv6Gateway": "",
	                    "GlobalIPv6Address": "",
	                    "GlobalIPv6PrefixLen": 0,
	                    "DNSNames": [
	                        "old-k8s-version-112335",
	                        "8129fd334711"
	                    ]
	                }
	            }
	        }
	    }
	]

                                                
                                                
-- /stdout --
helpers_test.go:239: (dbg) Run:  out/minikube-linux-arm64 status --format={{.Host}} -p old-k8s-version-112335 -n old-k8s-version-112335
helpers_test.go:244: <<< TestStartStop/group/old-k8s-version/serial/SecondStart FAILED: start of post-mortem logs <<<
helpers_test.go:245: ======>  post-mortem[TestStartStop/group/old-k8s-version/serial/SecondStart]: minikube logs <======
helpers_test.go:247: (dbg) Run:  out/minikube-linux-arm64 -p old-k8s-version-112335 logs -n 25
helpers_test.go:247: (dbg) Done: out/minikube-linux-arm64 -p old-k8s-version-112335 logs -n 25: (2.634572828s)
helpers_test.go:252: TestStartStop/group/old-k8s-version/serial/SecondStart logs: 
-- stdout --
	
	==> Audit <==
	|---------|--------------------------------------------------------|--------------------------|---------|---------|---------------------|---------------------|
	| Command |                          Args                          |         Profile          |  User   | Version |     Start Time      |      End Time       |
	|---------|--------------------------------------------------------|--------------------------|---------|---------|---------------------|---------------------|
	| start   | -p cert-expiration-886280                              | cert-expiration-886280   | jenkins | v1.33.1 | 12 Aug 24 13:08 UTC | 12 Aug 24 13:09 UTC |
	|         | --memory=2048                                          |                          |         |         |                     |                     |
	|         | --cert-expiration=3m                                   |                          |         |         |                     |                     |
	|         | --driver=docker                                        |                          |         |         |                     |                     |
	|         | --container-runtime=containerd                         |                          |         |         |                     |                     |
	| ssh     | force-systemd-env-633251                               | force-systemd-env-633251 | jenkins | v1.33.1 | 12 Aug 24 13:09 UTC | 12 Aug 24 13:09 UTC |
	|         | ssh cat                                                |                          |         |         |                     |                     |
	|         | /etc/containerd/config.toml                            |                          |         |         |                     |                     |
	| delete  | -p force-systemd-env-633251                            | force-systemd-env-633251 | jenkins | v1.33.1 | 12 Aug 24 13:09 UTC | 12 Aug 24 13:09 UTC |
	| start   | -p cert-options-583042                                 | cert-options-583042      | jenkins | v1.33.1 | 12 Aug 24 13:09 UTC | 12 Aug 24 13:09 UTC |
	|         | --memory=2048                                          |                          |         |         |                     |                     |
	|         | --apiserver-ips=127.0.0.1                              |                          |         |         |                     |                     |
	|         | --apiserver-ips=192.168.15.15                          |                          |         |         |                     |                     |
	|         | --apiserver-names=localhost                            |                          |         |         |                     |                     |
	|         | --apiserver-names=www.google.com                       |                          |         |         |                     |                     |
	|         | --apiserver-port=8555                                  |                          |         |         |                     |                     |
	|         | --driver=docker                                        |                          |         |         |                     |                     |
	|         | --container-runtime=containerd                         |                          |         |         |                     |                     |
	| ssh     | cert-options-583042 ssh                                | cert-options-583042      | jenkins | v1.33.1 | 12 Aug 24 13:09 UTC | 12 Aug 24 13:09 UTC |
	|         | openssl x509 -text -noout -in                          |                          |         |         |                     |                     |
	|         | /var/lib/minikube/certs/apiserver.crt                  |                          |         |         |                     |                     |
	| ssh     | -p cert-options-583042 -- sudo                         | cert-options-583042      | jenkins | v1.33.1 | 12 Aug 24 13:09 UTC | 12 Aug 24 13:09 UTC |
	|         | cat /etc/kubernetes/admin.conf                         |                          |         |         |                     |                     |
	| delete  | -p cert-options-583042                                 | cert-options-583042      | jenkins | v1.33.1 | 12 Aug 24 13:09 UTC | 12 Aug 24 13:10 UTC |
	| start   | -p old-k8s-version-112335                              | old-k8s-version-112335   | jenkins | v1.33.1 | 12 Aug 24 13:10 UTC | 12 Aug 24 13:12 UTC |
	|         | --memory=2200                                          |                          |         |         |                     |                     |
	|         | --alsologtostderr --wait=true                          |                          |         |         |                     |                     |
	|         | --kvm-network=default                                  |                          |         |         |                     |                     |
	|         | --kvm-qemu-uri=qemu:///system                          |                          |         |         |                     |                     |
	|         | --disable-driver-mounts                                |                          |         |         |                     |                     |
	|         | --keep-context=false                                   |                          |         |         |                     |                     |
	|         | --driver=docker                                        |                          |         |         |                     |                     |
	|         | --container-runtime=containerd                         |                          |         |         |                     |                     |
	|         | --kubernetes-version=v1.20.0                           |                          |         |         |                     |                     |
	| start   | -p cert-expiration-886280                              | cert-expiration-886280   | jenkins | v1.33.1 | 12 Aug 24 13:12 UTC | 12 Aug 24 13:12 UTC |
	|         | --memory=2048                                          |                          |         |         |                     |                     |
	|         | --cert-expiration=8760h                                |                          |         |         |                     |                     |
	|         | --driver=docker                                        |                          |         |         |                     |                     |
	|         | --container-runtime=containerd                         |                          |         |         |                     |                     |
	| delete  | -p cert-expiration-886280                              | cert-expiration-886280   | jenkins | v1.33.1 | 12 Aug 24 13:12 UTC | 12 Aug 24 13:12 UTC |
	| start   | -p no-preload-824604                                   | no-preload-824604        | jenkins | v1.33.1 | 12 Aug 24 13:12 UTC | 12 Aug 24 13:14 UTC |
	|         | --memory=2200 --alsologtostderr                        |                          |         |         |                     |                     |
	|         | --wait=true --preload=false                            |                          |         |         |                     |                     |
	|         | --driver=docker                                        |                          |         |         |                     |                     |
	|         | --container-runtime=containerd                         |                          |         |         |                     |                     |
	|         | --kubernetes-version=v1.31.0-rc.0                      |                          |         |         |                     |                     |
	| addons  | enable metrics-server -p old-k8s-version-112335        | old-k8s-version-112335   | jenkins | v1.33.1 | 12 Aug 24 13:12 UTC | 12 Aug 24 13:12 UTC |
	|         | --images=MetricsServer=registry.k8s.io/echoserver:1.4  |                          |         |         |                     |                     |
	|         | --registries=MetricsServer=fake.domain                 |                          |         |         |                     |                     |
	| stop    | -p old-k8s-version-112335                              | old-k8s-version-112335   | jenkins | v1.33.1 | 12 Aug 24 13:12 UTC | 12 Aug 24 13:13 UTC |
	|         | --alsologtostderr -v=3                                 |                          |         |         |                     |                     |
	| addons  | enable dashboard -p old-k8s-version-112335             | old-k8s-version-112335   | jenkins | v1.33.1 | 12 Aug 24 13:13 UTC | 12 Aug 24 13:13 UTC |
	|         | --images=MetricsScraper=registry.k8s.io/echoserver:1.4 |                          |         |         |                     |                     |
	| start   | -p old-k8s-version-112335                              | old-k8s-version-112335   | jenkins | v1.33.1 | 12 Aug 24 13:13 UTC |                     |
	|         | --memory=2200                                          |                          |         |         |                     |                     |
	|         | --alsologtostderr --wait=true                          |                          |         |         |                     |                     |
	|         | --kvm-network=default                                  |                          |         |         |                     |                     |
	|         | --kvm-qemu-uri=qemu:///system                          |                          |         |         |                     |                     |
	|         | --disable-driver-mounts                                |                          |         |         |                     |                     |
	|         | --keep-context=false                                   |                          |         |         |                     |                     |
	|         | --driver=docker                                        |                          |         |         |                     |                     |
	|         | --container-runtime=containerd                         |                          |         |         |                     |                     |
	|         | --kubernetes-version=v1.20.0                           |                          |         |         |                     |                     |
	| addons  | enable metrics-server -p no-preload-824604             | no-preload-824604        | jenkins | v1.33.1 | 12 Aug 24 13:14 UTC | 12 Aug 24 13:14 UTC |
	|         | --images=MetricsServer=registry.k8s.io/echoserver:1.4  |                          |         |         |                     |                     |
	|         | --registries=MetricsServer=fake.domain                 |                          |         |         |                     |                     |
	| stop    | -p no-preload-824604                                   | no-preload-824604        | jenkins | v1.33.1 | 12 Aug 24 13:14 UTC | 12 Aug 24 13:14 UTC |
	|         | --alsologtostderr -v=3                                 |                          |         |         |                     |                     |
	| addons  | enable dashboard -p no-preload-824604                  | no-preload-824604        | jenkins | v1.33.1 | 12 Aug 24 13:14 UTC | 12 Aug 24 13:14 UTC |
	|         | --images=MetricsScraper=registry.k8s.io/echoserver:1.4 |                          |         |         |                     |                     |
	| start   | -p no-preload-824604                                   | no-preload-824604        | jenkins | v1.33.1 | 12 Aug 24 13:14 UTC | 12 Aug 24 13:18 UTC |
	|         | --memory=2200 --alsologtostderr                        |                          |         |         |                     |                     |
	|         | --wait=true --preload=false                            |                          |         |         |                     |                     |
	|         | --driver=docker                                        |                          |         |         |                     |                     |
	|         | --container-runtime=containerd                         |                          |         |         |                     |                     |
	|         | --kubernetes-version=v1.31.0-rc.0                      |                          |         |         |                     |                     |
	| image   | no-preload-824604 image list                           | no-preload-824604        | jenkins | v1.33.1 | 12 Aug 24 13:19 UTC | 12 Aug 24 13:19 UTC |
	|         | --format=json                                          |                          |         |         |                     |                     |
	| pause   | -p no-preload-824604                                   | no-preload-824604        | jenkins | v1.33.1 | 12 Aug 24 13:19 UTC | 12 Aug 24 13:19 UTC |
	|         | --alsologtostderr -v=1                                 |                          |         |         |                     |                     |
	| unpause | -p no-preload-824604                                   | no-preload-824604        | jenkins | v1.33.1 | 12 Aug 24 13:19 UTC | 12 Aug 24 13:19 UTC |
	|         | --alsologtostderr -v=1                                 |                          |         |         |                     |                     |
	| delete  | -p no-preload-824604                                   | no-preload-824604        | jenkins | v1.33.1 | 12 Aug 24 13:19 UTC | 12 Aug 24 13:19 UTC |
	| delete  | -p no-preload-824604                                   | no-preload-824604        | jenkins | v1.33.1 | 12 Aug 24 13:19 UTC | 12 Aug 24 13:19 UTC |
	| start   | -p embed-certs-097595                                  | embed-certs-097595       | jenkins | v1.33.1 | 12 Aug 24 13:19 UTC |                     |
	|         | --memory=2200                                          |                          |         |         |                     |                     |
	|         | --alsologtostderr --wait=true                          |                          |         |         |                     |                     |
	|         | --embed-certs --driver=docker                          |                          |         |         |                     |                     |
	|         | --container-runtime=containerd                         |                          |         |         |                     |                     |
	|         | --kubernetes-version=v1.30.3                           |                          |         |         |                     |                     |
	|---------|--------------------------------------------------------|--------------------------|---------|---------|---------------------|---------------------|
	
	
	==> Last Start <==
	Log file created at: 2024/08/12 13:19:11
	Running on machine: ip-172-31-30-239
	Binary: Built with gc go1.22.5 for linux/arm64
	Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg
	I0812 13:19:11.434069 1223708 out.go:291] Setting OutFile to fd 1 ...
	I0812 13:19:11.434521 1223708 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0812 13:19:11.434533 1223708 out.go:304] Setting ErrFile to fd 2...
	I0812 13:19:11.434552 1223708 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0812 13:19:11.434949 1223708 root.go:338] Updating PATH: /home/jenkins/minikube-integration/19411-998978/.minikube/bin
	I0812 13:19:11.435579 1223708 out.go:298] Setting JSON to false
	I0812 13:19:11.436996 1223708 start.go:129] hostinfo: {"hostname":"ip-172-31-30-239","uptime":18100,"bootTime":1723450651,"procs":230,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1066-aws","kernelArch":"aarch64","virtualizationSystem":"","virtualizationRole":"","hostId":"92f46a7d-c249-4c12-924a-77f64874c910"}
	I0812 13:19:11.437088 1223708 start.go:139] virtualization:  
	I0812 13:19:11.439787 1223708 out.go:177] * [embed-certs-097595] minikube v1.33.1 on Ubuntu 20.04 (arm64)
	I0812 13:19:11.442489 1223708 out.go:177]   - MINIKUBE_LOCATION=19411
	I0812 13:19:11.442534 1223708 notify.go:220] Checking for updates...
	I0812 13:19:11.445829 1223708 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I0812 13:19:11.449418 1223708 out.go:177]   - KUBECONFIG=/home/jenkins/minikube-integration/19411-998978/kubeconfig
	I0812 13:19:11.451401 1223708 out.go:177]   - MINIKUBE_HOME=/home/jenkins/minikube-integration/19411-998978/.minikube
	I0812 13:19:11.453390 1223708 out.go:177]   - MINIKUBE_BIN=out/minikube-linux-arm64
	I0812 13:19:11.455045 1223708 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=
	I0812 13:19:11.457685 1223708 config.go:182] Loaded profile config "old-k8s-version-112335": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.20.0
	I0812 13:19:11.457792 1223708 driver.go:392] Setting default libvirt URI to qemu:///system
	I0812 13:19:11.490121 1223708 docker.go:123] docker version: linux-27.1.1:Docker Engine - Community
	I0812 13:19:11.490236 1223708 cli_runner.go:164] Run: docker system info --format "{{json .}}"
	I0812 13:19:11.597047 1223708 info.go:266] docker info: {ID:6ZPO:QZND:VNGE:LUKL:4Y3K:XELL:AAX4:2GTK:E6LM:MPRN:3ZXR:TTMR Containers:1 ContainersRunning:1 ContainersPaused:0 ContainersStopped:0 Images:4 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:35 OomKillDisable:true NGoroutines:53 SystemTime:2024-08-12 13:19:11.583646087 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1066-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Architecture:aar
ch64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8214896640 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-30-239 Labels:[] ExperimentalBuild:false ServerVersion:27.1.1 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:2bf793ef6dc9a18e00cb12efb64355c2c9d5eb41 Expected:2bf793ef6dc9a18e00cb12efb64355c2c9d5eb41} RuncCommit:{ID:v1.1.13-0-g58aa920 Expected:v1.1.13-0-g58aa920} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:<nil> ServerErro
rs:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.16.1] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.29.1]] Warnings:<nil>}}
	I0812 13:19:11.597185 1223708 docker.go:307] overlay module found
	I0812 13:19:11.599286 1223708 out.go:177] * Using the docker driver based on user configuration
	I0812 13:19:11.601003 1223708 start.go:297] selected driver: docker
	I0812 13:19:11.601019 1223708 start.go:901] validating driver "docker" against <nil>
	I0812 13:19:11.601034 1223708 start.go:912] status for docker: {Installed:true Healthy:true Running:false NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I0812 13:19:11.601722 1223708 cli_runner.go:164] Run: docker system info --format "{{json .}}"
	I0812 13:19:11.690778 1223708 info.go:266] docker info: {ID:6ZPO:QZND:VNGE:LUKL:4Y3K:XELL:AAX4:2GTK:E6LM:MPRN:3ZXR:TTMR Containers:1 ContainersRunning:1 ContainersPaused:0 ContainersStopped:0 Images:4 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:35 OomKillDisable:true NGoroutines:53 SystemTime:2024-08-12 13:19:11.681146483 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1066-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Architecture:aar
ch64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8214896640 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-30-239 Labels:[] ExperimentalBuild:false ServerVersion:27.1.1 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:2bf793ef6dc9a18e00cb12efb64355c2c9d5eb41 Expected:2bf793ef6dc9a18e00cb12efb64355c2c9d5eb41} RuncCommit:{ID:v1.1.13-0-g58aa920 Expected:v1.1.13-0-g58aa920} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:<nil> ServerErro
rs:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.16.1] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.29.1]] Warnings:<nil>}}
	I0812 13:19:11.690955 1223708 start_flags.go:310] no existing cluster config was found, will generate one from the flags 
	I0812 13:19:11.691197 1223708 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
	I0812 13:19:11.693125 1223708 out.go:177] * Using Docker driver with root privileges
	I0812 13:19:11.695237 1223708 cni.go:84] Creating CNI manager for ""
	I0812 13:19:11.695264 1223708 cni.go:143] "docker" driver + "containerd" runtime found, recommending kindnet
	I0812 13:19:11.695275 1223708 start_flags.go:319] Found "CNI" CNI - setting NetworkPlugin=cni
	I0812 13:19:11.695359 1223708 start.go:340] cluster config:
	{Name:embed-certs-097595 KeepContext:false EmbedCerts:true MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1723026928-19389@sha256:7715fe0c5dce35b4eb757765cbbe02d40cd8b5effa0639735e42ad89f4f51ef0 Memory:2200 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.30.3 ClusterName:embed-certs-097595 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local Contain
erRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.30.3 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: Stati
cIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I0812 13:19:11.697791 1223708 out.go:177] * Starting "embed-certs-097595" primary control-plane node in "embed-certs-097595" cluster
	I0812 13:19:11.699533 1223708 cache.go:121] Beginning downloading kic base image for docker with containerd
	I0812 13:19:11.701376 1223708 out.go:177] * Pulling base image v0.0.44-1723026928-19389 ...
	I0812 13:19:11.703050 1223708 preload.go:131] Checking if preload exists for k8s version v1.30.3 and runtime containerd
	I0812 13:19:11.703105 1223708 preload.go:146] Found local preload: /home/jenkins/minikube-integration/19411-998978/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.30.3-containerd-overlay2-arm64.tar.lz4
	I0812 13:19:11.703119 1223708 cache.go:56] Caching tarball of preloaded images
	I0812 13:19:11.703202 1223708 preload.go:172] Found /home/jenkins/minikube-integration/19411-998978/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.30.3-containerd-overlay2-arm64.tar.lz4 in cache, skipping download
	I0812 13:19:11.703217 1223708 cache.go:59] Finished verifying existence of preloaded tar for v1.30.3 on containerd
	I0812 13:19:11.703344 1223708 profile.go:143] Saving config to /home/jenkins/minikube-integration/19411-998978/.minikube/profiles/embed-certs-097595/config.json ...
	I0812 13:19:11.703368 1223708 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19411-998978/.minikube/profiles/embed-certs-097595/config.json: {Name:mk87e0b4bf78cf34a91b03be833f082bd18fd658 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0812 13:19:11.703541 1223708 image.go:79] Checking for gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1723026928-19389@sha256:7715fe0c5dce35b4eb757765cbbe02d40cd8b5effa0639735e42ad89f4f51ef0 in local docker daemon
	W0812 13:19:11.739658 1223708 image.go:95] image gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1723026928-19389@sha256:7715fe0c5dce35b4eb757765cbbe02d40cd8b5effa0639735e42ad89f4f51ef0 is of wrong architecture
	I0812 13:19:11.739680 1223708 cache.go:149] Downloading gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1723026928-19389@sha256:7715fe0c5dce35b4eb757765cbbe02d40cd8b5effa0639735e42ad89f4f51ef0 to local cache
	I0812 13:19:11.739759 1223708 image.go:63] Checking for gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1723026928-19389@sha256:7715fe0c5dce35b4eb757765cbbe02d40cd8b5effa0639735e42ad89f4f51ef0 in local cache directory
	I0812 13:19:11.739777 1223708 image.go:66] Found gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1723026928-19389@sha256:7715fe0c5dce35b4eb757765cbbe02d40cd8b5effa0639735e42ad89f4f51ef0 in local cache directory, skipping pull
	I0812 13:19:11.739781 1223708 image.go:135] gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1723026928-19389@sha256:7715fe0c5dce35b4eb757765cbbe02d40cd8b5effa0639735e42ad89f4f51ef0 exists in cache, skipping pull
	I0812 13:19:11.739789 1223708 cache.go:152] successfully saved gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1723026928-19389@sha256:7715fe0c5dce35b4eb757765cbbe02d40cd8b5effa0639735e42ad89f4f51ef0 as a tarball
	I0812 13:19:11.739795 1223708 cache.go:162] Loading gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1723026928-19389@sha256:7715fe0c5dce35b4eb757765cbbe02d40cd8b5effa0639735e42ad89f4f51ef0 from local cache
	I0812 13:19:11.867804 1223708 cache.go:164] successfully loaded and using gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1723026928-19389@sha256:7715fe0c5dce35b4eb757765cbbe02d40cd8b5effa0639735e42ad89f4f51ef0 from cached tarball
	I0812 13:19:11.867841 1223708 cache.go:194] Successfully downloaded all kic artifacts
	I0812 13:19:11.867884 1223708 start.go:360] acquireMachinesLock for embed-certs-097595: {Name:mkdf39c894757393a07d6435062cf3279eb43256 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0812 13:19:11.868004 1223708 start.go:364] duration metric: took 101.093µs to acquireMachinesLock for "embed-certs-097595"
	I0812 13:19:11.868032 1223708 start.go:93] Provisioning new machine with config: &{Name:embed-certs-097595 KeepContext:false EmbedCerts:true MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1723026928-19389@sha256:7715fe0c5dce35b4eb757765cbbe02d40cd8b5effa0639735e42ad89f4f51ef0 Memory:2200 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.30.3 ClusterName:embed-certs-097595 Namespace:default APIServerHAVIP: APIServe
rName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.30.3 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableM
etrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.30.3 ContainerRuntime:containerd ControlPlane:true Worker:true}
	I0812 13:19:11.868119 1223708 start.go:125] createHost starting for "" (driver="docker")
	I0812 13:19:09.583497 1212353 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0812 13:19:09.595720 1212353 api_server.go:72] duration metric: took 5m54.253054514s to wait for apiserver process to appear ...
	I0812 13:19:09.595750 1212353 api_server.go:88] waiting for apiserver healthz status ...
	I0812 13:19:09.595785 1212353 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-apiserver Namespaces:[]}
	I0812 13:19:09.595849 1212353 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
	I0812 13:19:09.634473 1212353 cri.go:89] found id: "e4cf465775a34b80fbfbd63dc4f0643c8d6a61c508c1c06d6e58548109c82a20"
	I0812 13:19:09.634496 1212353 cri.go:89] found id: "bf352ab2c17cc4485d3b3f899d758963b292f9829240ec0e4e650d678908e30a"
	I0812 13:19:09.634502 1212353 cri.go:89] found id: ""
	I0812 13:19:09.634508 1212353 logs.go:276] 2 containers: [e4cf465775a34b80fbfbd63dc4f0643c8d6a61c508c1c06d6e58548109c82a20 bf352ab2c17cc4485d3b3f899d758963b292f9829240ec0e4e650d678908e30a]
	I0812 13:19:09.634572 1212353 ssh_runner.go:195] Run: which crictl
	I0812 13:19:09.638291 1212353 ssh_runner.go:195] Run: which crictl
	I0812 13:19:09.641843 1212353 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:etcd Namespaces:[]}
	I0812 13:19:09.641924 1212353 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
	I0812 13:19:09.687444 1212353 cri.go:89] found id: "8cc926d2c577f511b103d70b73314019d0ec31451c321551981ab0306c91088f"
	I0812 13:19:09.687465 1212353 cri.go:89] found id: "39f629658753d4fd7ceceee2f8ec0ffc8c98db08a6b70240ea91f87cd6dcee03"
	I0812 13:19:09.687470 1212353 cri.go:89] found id: ""
	I0812 13:19:09.687477 1212353 logs.go:276] 2 containers: [8cc926d2c577f511b103d70b73314019d0ec31451c321551981ab0306c91088f 39f629658753d4fd7ceceee2f8ec0ffc8c98db08a6b70240ea91f87cd6dcee03]
	I0812 13:19:09.687533 1212353 ssh_runner.go:195] Run: which crictl
	I0812 13:19:09.692474 1212353 ssh_runner.go:195] Run: which crictl
	I0812 13:19:09.697389 1212353 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:coredns Namespaces:[]}
	I0812 13:19:09.697468 1212353 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
	I0812 13:19:09.808285 1212353 cri.go:89] found id: "d01d8e8aeec0f477f1c58244a66d7f7b8fb10d090d3d987c0469a55648945b18"
	I0812 13:19:09.808306 1212353 cri.go:89] found id: "7f8e543bcce0c03b365394bc942dab039d350b1340f5856f43b90551a5645f67"
	I0812 13:19:09.808311 1212353 cri.go:89] found id: ""
	I0812 13:19:09.808318 1212353 logs.go:276] 2 containers: [d01d8e8aeec0f477f1c58244a66d7f7b8fb10d090d3d987c0469a55648945b18 7f8e543bcce0c03b365394bc942dab039d350b1340f5856f43b90551a5645f67]
	I0812 13:19:09.808375 1212353 ssh_runner.go:195] Run: which crictl
	I0812 13:19:09.811869 1212353 ssh_runner.go:195] Run: which crictl
	I0812 13:19:09.817875 1212353 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-scheduler Namespaces:[]}
	I0812 13:19:09.817949 1212353 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
	I0812 13:19:09.876968 1212353 cri.go:89] found id: "b27ed17bf7551f01faf083be84883f36e5f141508c39cfd28e4ca7bf298a5ef2"
	I0812 13:19:09.877002 1212353 cri.go:89] found id: "7b67a4fc117cb884b3aec00880229a7613be0e0af79872ccc25b2ef06932d06f"
	I0812 13:19:09.877007 1212353 cri.go:89] found id: ""
	I0812 13:19:09.877014 1212353 logs.go:276] 2 containers: [b27ed17bf7551f01faf083be84883f36e5f141508c39cfd28e4ca7bf298a5ef2 7b67a4fc117cb884b3aec00880229a7613be0e0af79872ccc25b2ef06932d06f]
	I0812 13:19:09.877067 1212353 ssh_runner.go:195] Run: which crictl
	I0812 13:19:09.881713 1212353 ssh_runner.go:195] Run: which crictl
	I0812 13:19:09.887001 1212353 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-proxy Namespaces:[]}
	I0812 13:19:09.887073 1212353 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
	I0812 13:19:09.986056 1212353 cri.go:89] found id: "2af20ac6f2602d8c076b3bed058353203858c5832593d98d2de3ccc55cbf9c7d"
	I0812 13:19:09.986078 1212353 cri.go:89] found id: "e6326fb96d89ee49b3da7ef3f75a5f41a53b9acb3526ac907bf55dfcc30b8d6c"
	I0812 13:19:09.986083 1212353 cri.go:89] found id: ""
	I0812 13:19:09.986089 1212353 logs.go:276] 2 containers: [2af20ac6f2602d8c076b3bed058353203858c5832593d98d2de3ccc55cbf9c7d e6326fb96d89ee49b3da7ef3f75a5f41a53b9acb3526ac907bf55dfcc30b8d6c]
	I0812 13:19:09.986151 1212353 ssh_runner.go:195] Run: which crictl
	I0812 13:19:09.990326 1212353 ssh_runner.go:195] Run: which crictl
	I0812 13:19:10.008493 1212353 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-controller-manager Namespaces:[]}
	I0812 13:19:10.008641 1212353 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
	I0812 13:19:10.078309 1212353 cri.go:89] found id: "533139b834baffb74463be6b648bfd76085ea1587efa7aa575c1e09af6ee13da"
	I0812 13:19:10.078334 1212353 cri.go:89] found id: "8dc43146b8eece1e84ac23cedd68a17cad2d2457bc209bbe351bbfa0454d1bc2"
	I0812 13:19:10.078340 1212353 cri.go:89] found id: ""
	I0812 13:19:10.078348 1212353 logs.go:276] 2 containers: [533139b834baffb74463be6b648bfd76085ea1587efa7aa575c1e09af6ee13da 8dc43146b8eece1e84ac23cedd68a17cad2d2457bc209bbe351bbfa0454d1bc2]
	I0812 13:19:10.078410 1212353 ssh_runner.go:195] Run: which crictl
	I0812 13:19:10.082875 1212353 ssh_runner.go:195] Run: which crictl
	I0812 13:19:10.087661 1212353 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kindnet Namespaces:[]}
	I0812 13:19:10.087782 1212353 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet
	I0812 13:19:10.142899 1212353 cri.go:89] found id: "6f8e38e073e1197c4df808103d10e92b26179a23da02465137f194bb4e1b5dfe"
	I0812 13:19:10.142929 1212353 cri.go:89] found id: "162b80fe4af51619d233d78c0c67ed2c8e6f24d40ec23dd44a431d1b76caed13"
	I0812 13:19:10.142935 1212353 cri.go:89] found id: ""
	I0812 13:19:10.142942 1212353 logs.go:276] 2 containers: [6f8e38e073e1197c4df808103d10e92b26179a23da02465137f194bb4e1b5dfe 162b80fe4af51619d233d78c0c67ed2c8e6f24d40ec23dd44a431d1b76caed13]
	I0812 13:19:10.143002 1212353 ssh_runner.go:195] Run: which crictl
	I0812 13:19:10.147465 1212353 ssh_runner.go:195] Run: which crictl
	I0812 13:19:10.151396 1212353 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:storage-provisioner Namespaces:[]}
	I0812 13:19:10.151492 1212353 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=storage-provisioner
	I0812 13:19:10.210258 1212353 cri.go:89] found id: "b8ecac9f4ddfb227119bf73b728923825eb3a038f35063eed01a12b20b1560d7"
	I0812 13:19:10.210277 1212353 cri.go:89] found id: "2924918d73f931bf85384ca7b1f96cf6760849232fe33069fff149704e2ae596"
	I0812 13:19:10.210282 1212353 cri.go:89] found id: ""
	I0812 13:19:10.210288 1212353 logs.go:276] 2 containers: [b8ecac9f4ddfb227119bf73b728923825eb3a038f35063eed01a12b20b1560d7 2924918d73f931bf85384ca7b1f96cf6760849232fe33069fff149704e2ae596]
	I0812 13:19:10.210345 1212353 ssh_runner.go:195] Run: which crictl
	I0812 13:19:10.214692 1212353 ssh_runner.go:195] Run: which crictl
	I0812 13:19:10.218836 1212353 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kubernetes-dashboard Namespaces:[]}
	I0812 13:19:10.218947 1212353 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kubernetes-dashboard
	I0812 13:19:10.276175 1212353 cri.go:89] found id: "19e7d460788a0ea1f90292f01072ce22cf88076ab7cc590b1b16483fb405d505"
	I0812 13:19:10.276194 1212353 cri.go:89] found id: ""
	I0812 13:19:10.276202 1212353 logs.go:276] 1 containers: [19e7d460788a0ea1f90292f01072ce22cf88076ab7cc590b1b16483fb405d505]
	I0812 13:19:10.276261 1212353 ssh_runner.go:195] Run: which crictl
	I0812 13:19:10.280578 1212353 logs.go:123] Gathering logs for kube-controller-manager [533139b834baffb74463be6b648bfd76085ea1587efa7aa575c1e09af6ee13da] ...
	I0812 13:19:10.280654 1212353 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 533139b834baffb74463be6b648bfd76085ea1587efa7aa575c1e09af6ee13da"
	I0812 13:19:10.349131 1212353 logs.go:123] Gathering logs for storage-provisioner [b8ecac9f4ddfb227119bf73b728923825eb3a038f35063eed01a12b20b1560d7] ...
	I0812 13:19:10.349379 1212353 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 b8ecac9f4ddfb227119bf73b728923825eb3a038f35063eed01a12b20b1560d7"
	I0812 13:19:10.399579 1212353 logs.go:123] Gathering logs for kubernetes-dashboard [19e7d460788a0ea1f90292f01072ce22cf88076ab7cc590b1b16483fb405d505] ...
	I0812 13:19:10.399612 1212353 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 19e7d460788a0ea1f90292f01072ce22cf88076ab7cc590b1b16483fb405d505"
	I0812 13:19:10.467425 1212353 logs.go:123] Gathering logs for container status ...
	I0812 13:19:10.467546 1212353 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
	I0812 13:19:10.555908 1212353 logs.go:123] Gathering logs for describe nodes ...
	I0812 13:19:10.556028 1212353 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
	I0812 13:19:10.847034 1212353 logs.go:123] Gathering logs for kube-scheduler [b27ed17bf7551f01faf083be84883f36e5f141508c39cfd28e4ca7bf298a5ef2] ...
	I0812 13:19:10.847074 1212353 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 b27ed17bf7551f01faf083be84883f36e5f141508c39cfd28e4ca7bf298a5ef2"
	I0812 13:19:10.894829 1212353 logs.go:123] Gathering logs for kube-proxy [e6326fb96d89ee49b3da7ef3f75a5f41a53b9acb3526ac907bf55dfcc30b8d6c] ...
	I0812 13:19:10.894867 1212353 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 e6326fb96d89ee49b3da7ef3f75a5f41a53b9acb3526ac907bf55dfcc30b8d6c"
	I0812 13:19:10.959087 1212353 logs.go:123] Gathering logs for kube-controller-manager [8dc43146b8eece1e84ac23cedd68a17cad2d2457bc209bbe351bbfa0454d1bc2] ...
	I0812 13:19:10.959118 1212353 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 8dc43146b8eece1e84ac23cedd68a17cad2d2457bc209bbe351bbfa0454d1bc2"
	I0812 13:19:11.046872 1212353 logs.go:123] Gathering logs for storage-provisioner [2924918d73f931bf85384ca7b1f96cf6760849232fe33069fff149704e2ae596] ...
	I0812 13:19:11.046947 1212353 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 2924918d73f931bf85384ca7b1f96cf6760849232fe33069fff149704e2ae596"
	I0812 13:19:11.093849 1212353 logs.go:123] Gathering logs for kube-proxy [2af20ac6f2602d8c076b3bed058353203858c5832593d98d2de3ccc55cbf9c7d] ...
	I0812 13:19:11.093878 1212353 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 2af20ac6f2602d8c076b3bed058353203858c5832593d98d2de3ccc55cbf9c7d"
	I0812 13:19:11.148584 1212353 logs.go:123] Gathering logs for kube-apiserver [bf352ab2c17cc4485d3b3f899d758963b292f9829240ec0e4e650d678908e30a] ...
	I0812 13:19:11.148610 1212353 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 bf352ab2c17cc4485d3b3f899d758963b292f9829240ec0e4e650d678908e30a"
	I0812 13:19:11.247494 1212353 logs.go:123] Gathering logs for etcd [39f629658753d4fd7ceceee2f8ec0ffc8c98db08a6b70240ea91f87cd6dcee03] ...
	I0812 13:19:11.247569 1212353 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 39f629658753d4fd7ceceee2f8ec0ffc8c98db08a6b70240ea91f87cd6dcee03"
	I0812 13:19:11.309771 1212353 logs.go:123] Gathering logs for coredns [7f8e543bcce0c03b365394bc942dab039d350b1340f5856f43b90551a5645f67] ...
	I0812 13:19:11.309922 1212353 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 7f8e543bcce0c03b365394bc942dab039d350b1340f5856f43b90551a5645f67"
	I0812 13:19:11.376719 1212353 logs.go:123] Gathering logs for etcd [8cc926d2c577f511b103d70b73314019d0ec31451c321551981ab0306c91088f] ...
	I0812 13:19:11.376745 1212353 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 8cc926d2c577f511b103d70b73314019d0ec31451c321551981ab0306c91088f"
	I0812 13:19:11.438967 1212353 logs.go:123] Gathering logs for coredns [d01d8e8aeec0f477f1c58244a66d7f7b8fb10d090d3d987c0469a55648945b18] ...
	I0812 13:19:11.439041 1212353 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 d01d8e8aeec0f477f1c58244a66d7f7b8fb10d090d3d987c0469a55648945b18"
	I0812 13:19:11.492466 1212353 logs.go:123] Gathering logs for kube-scheduler [7b67a4fc117cb884b3aec00880229a7613be0e0af79872ccc25b2ef06932d06f] ...
	I0812 13:19:11.492491 1212353 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 7b67a4fc117cb884b3aec00880229a7613be0e0af79872ccc25b2ef06932d06f"
	I0812 13:19:11.549434 1212353 logs.go:123] Gathering logs for kindnet [6f8e38e073e1197c4df808103d10e92b26179a23da02465137f194bb4e1b5dfe] ...
	I0812 13:19:11.549515 1212353 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 6f8e38e073e1197c4df808103d10e92b26179a23da02465137f194bb4e1b5dfe"
	I0812 13:19:11.658330 1212353 logs.go:123] Gathering logs for kindnet [162b80fe4af51619d233d78c0c67ed2c8e6f24d40ec23dd44a431d1b76caed13] ...
	I0812 13:19:11.658369 1212353 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 162b80fe4af51619d233d78c0c67ed2c8e6f24d40ec23dd44a431d1b76caed13"
	I0812 13:19:11.727535 1212353 logs.go:123] Gathering logs for kubelet ...
	I0812 13:19:11.727573 1212353 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
	W0812 13:19:11.816146 1212353 logs.go:138] Found kubelet problem: Aug 12 13:13:35 old-k8s-version-112335 kubelet[671]: E0812 13:13:35.526602     671 reflector.go:138] object-"kube-system"/"kube-proxy": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "kube-proxy" is forbidden: User "system:node:old-k8s-version-112335" cannot list resource "configmaps" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-112335' and this object
	W0812 13:19:11.816440 1212353 logs.go:138] Found kubelet problem: Aug 12 13:13:35 old-k8s-version-112335 kubelet[671]: E0812 13:13:35.531551     671 reflector.go:138] object-"kube-system"/"kube-proxy-token-spdxp": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "kube-proxy-token-spdxp" is forbidden: User "system:node:old-k8s-version-112335" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-112335' and this object
	W0812 13:19:11.816687 1212353 logs.go:138] Found kubelet problem: Aug 12 13:13:35 old-k8s-version-112335 kubelet[671]: E0812 13:13:35.531828     671 reflector.go:138] object-"kube-system"/"kindnet-token-bnvnb": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "kindnet-token-bnvnb" is forbidden: User "system:node:old-k8s-version-112335" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-112335' and this object
	W0812 13:19:11.816922 1212353 logs.go:138] Found kubelet problem: Aug 12 13:13:35 old-k8s-version-112335 kubelet[671]: E0812 13:13:35.543185     671 reflector.go:138] object-"kube-system"/"coredns-token-wj7tz": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "coredns-token-wj7tz" is forbidden: User "system:node:old-k8s-version-112335" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-112335' and this object
	W0812 13:19:11.817156 1212353 logs.go:138] Found kubelet problem: Aug 12 13:13:35 old-k8s-version-112335 kubelet[671]: E0812 13:13:35.565702     671 reflector.go:138] object-"default"/"default-token-nqvmq": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "default-token-nqvmq" is forbidden: User "system:node:old-k8s-version-112335" cannot list resource "secrets" in API group "" in the namespace "default": no relationship found between node 'old-k8s-version-112335' and this object
	W0812 13:19:11.817420 1212353 logs.go:138] Found kubelet problem: Aug 12 13:13:35 old-k8s-version-112335 kubelet[671]: E0812 13:13:35.565958     671 reflector.go:138] object-"kube-system"/"storage-provisioner-token-cmdsj": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "storage-provisioner-token-cmdsj" is forbidden: User "system:node:old-k8s-version-112335" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-112335' and this object
	W0812 13:19:11.817658 1212353 logs.go:138] Found kubelet problem: Aug 12 13:13:35 old-k8s-version-112335 kubelet[671]: E0812 13:13:35.566053     671 reflector.go:138] object-"kube-system"/"coredns": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "coredns" is forbidden: User "system:node:old-k8s-version-112335" cannot list resource "configmaps" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-112335' and this object
	W0812 13:19:11.817902 1212353 logs.go:138] Found kubelet problem: Aug 12 13:13:35 old-k8s-version-112335 kubelet[671]: E0812 13:13:35.590326     671 reflector.go:138] object-"kube-system"/"metrics-server-token-ngnjg": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "metrics-server-token-ngnjg" is forbidden: User "system:node:old-k8s-version-112335" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-112335' and this object
	W0812 13:19:11.827670 1212353 logs.go:138] Found kubelet problem: Aug 12 13:13:39 old-k8s-version-112335 kubelet[671]: E0812 13:13:39.806774     671 pod_workers.go:191] Error syncing pod 34d824a4-d65e-4566-b95e-8f00f2c6fc71 ("metrics-server-9975d5f86-v2prr_kube-system(34d824a4-d65e-4566-b95e-8f00f2c6fc71)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.85.1:53: no such host"
	W0812 13:19:11.827916 1212353 logs.go:138] Found kubelet problem: Aug 12 13:13:40 old-k8s-version-112335 kubelet[671]: E0812 13:13:40.760714     671 pod_workers.go:191] Error syncing pod 34d824a4-d65e-4566-b95e-8f00f2c6fc71 ("metrics-server-9975d5f86-v2prr_kube-system(34d824a4-d65e-4566-b95e-8f00f2c6fc71)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W0812 13:19:11.832971 1212353 logs.go:138] Found kubelet problem: Aug 12 13:14:04 old-k8s-version-112335 kubelet[671]: E0812 13:14:04.278650     671 pod_workers.go:191] Error syncing pod 34d824a4-d65e-4566-b95e-8f00f2c6fc71 ("metrics-server-9975d5f86-v2prr_kube-system(34d824a4-d65e-4566-b95e-8f00f2c6fc71)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.85.1:53: no such host"
	W0812 13:19:11.833517 1212353 logs.go:138] Found kubelet problem: Aug 12 13:14:05 old-k8s-version-112335 kubelet[671]: E0812 13:14:05.847014     671 pod_workers.go:191] Error syncing pod 98eb45e0-5ebb-4a91-950c-b25211aceb65 ("dashboard-metrics-scraper-8d5bb5db8-6w7h6_kubernetes-dashboard(98eb45e0-5ebb-4a91-950c-b25211aceb65)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 10s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-6w7h6_kubernetes-dashboard(98eb45e0-5ebb-4a91-950c-b25211aceb65)"
	W0812 13:19:11.834024 1212353 logs.go:138] Found kubelet problem: Aug 12 13:14:06 old-k8s-version-112335 kubelet[671]: E0812 13:14:06.851261     671 pod_workers.go:191] Error syncing pod 98eb45e0-5ebb-4a91-950c-b25211aceb65 ("dashboard-metrics-scraper-8d5bb5db8-6w7h6_kubernetes-dashboard(98eb45e0-5ebb-4a91-950c-b25211aceb65)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 10s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-6w7h6_kubernetes-dashboard(98eb45e0-5ebb-4a91-950c-b25211aceb65)"
	W0812 13:19:11.834560 1212353 logs.go:138] Found kubelet problem: Aug 12 13:14:09 old-k8s-version-112335 kubelet[671]: E0812 13:14:09.866088     671 pod_workers.go:191] Error syncing pod 3c993bf4-fc61-4ad4-9f3b-a2c99cce757e ("storage-provisioner_kube-system(3c993bf4-fc61-4ad4-9f3b-a2c99cce757e)"), skipping: failed to "StartContainer" for "storage-provisioner" with CrashLoopBackOff: "back-off 10s restarting failed container=storage-provisioner pod=storage-provisioner_kube-system(3c993bf4-fc61-4ad4-9f3b-a2c99cce757e)"
	W0812 13:19:11.834928 1212353 logs.go:138] Found kubelet problem: Aug 12 13:14:12 old-k8s-version-112335 kubelet[671]: E0812 13:14:12.967750     671 pod_workers.go:191] Error syncing pod 98eb45e0-5ebb-4a91-950c-b25211aceb65 ("dashboard-metrics-scraper-8d5bb5db8-6w7h6_kubernetes-dashboard(98eb45e0-5ebb-4a91-950c-b25211aceb65)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 10s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-6w7h6_kubernetes-dashboard(98eb45e0-5ebb-4a91-950c-b25211aceb65)"
	W0812 13:19:11.835545 1212353 logs.go:138] Found kubelet problem: Aug 12 13:14:17 old-k8s-version-112335 kubelet[671]: E0812 13:14:17.357070     671 pod_workers.go:191] Error syncing pod 34d824a4-d65e-4566-b95e-8f00f2c6fc71 ("metrics-server-9975d5f86-v2prr_kube-system(34d824a4-d65e-4566-b95e-8f00f2c6fc71)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W0812 13:19:11.836312 1212353 logs.go:138] Found kubelet problem: Aug 12 13:14:25 old-k8s-version-112335 kubelet[671]: E0812 13:14:25.914407     671 pod_workers.go:191] Error syncing pod 98eb45e0-5ebb-4a91-950c-b25211aceb65 ("dashboard-metrics-scraper-8d5bb5db8-6w7h6_kubernetes-dashboard(98eb45e0-5ebb-4a91-950c-b25211aceb65)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-6w7h6_kubernetes-dashboard(98eb45e0-5ebb-4a91-950c-b25211aceb65)"
	W0812 13:19:11.838819 1212353 logs.go:138] Found kubelet problem: Aug 12 13:14:32 old-k8s-version-112335 kubelet[671]: E0812 13:14:32.368369     671 pod_workers.go:191] Error syncing pod 34d824a4-d65e-4566-b95e-8f00f2c6fc71 ("metrics-server-9975d5f86-v2prr_kube-system(34d824a4-d65e-4566-b95e-8f00f2c6fc71)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.85.1:53: no such host"
	W0812 13:19:11.839227 1212353 logs.go:138] Found kubelet problem: Aug 12 13:14:32 old-k8s-version-112335 kubelet[671]: E0812 13:14:32.966383     671 pod_workers.go:191] Error syncing pod 98eb45e0-5ebb-4a91-950c-b25211aceb65 ("dashboard-metrics-scraper-8d5bb5db8-6w7h6_kubernetes-dashboard(98eb45e0-5ebb-4a91-950c-b25211aceb65)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-6w7h6_kubernetes-dashboard(98eb45e0-5ebb-4a91-950c-b25211aceb65)"
	W0812 13:19:11.839444 1212353 logs.go:138] Found kubelet problem: Aug 12 13:14:45 old-k8s-version-112335 kubelet[671]: E0812 13:14:45.357518     671 pod_workers.go:191] Error syncing pod 34d824a4-d65e-4566-b95e-8f00f2c6fc71 ("metrics-server-9975d5f86-v2prr_kube-system(34d824a4-d65e-4566-b95e-8f00f2c6fc71)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W0812 13:19:11.841930 1212353 logs.go:138] Found kubelet problem: Aug 12 13:14:47 old-k8s-version-112335 kubelet[671]: E0812 13:14:47.982636     671 pod_workers.go:191] Error syncing pod 98eb45e0-5ebb-4a91-950c-b25211aceb65 ("dashboard-metrics-scraper-8d5bb5db8-6w7h6_kubernetes-dashboard(98eb45e0-5ebb-4a91-950c-b25211aceb65)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-6w7h6_kubernetes-dashboard(98eb45e0-5ebb-4a91-950c-b25211aceb65)"
	W0812 13:19:11.842317 1212353 logs.go:138] Found kubelet problem: Aug 12 13:14:52 old-k8s-version-112335 kubelet[671]: E0812 13:14:52.966081     671 pod_workers.go:191] Error syncing pod 98eb45e0-5ebb-4a91-950c-b25211aceb65 ("dashboard-metrics-scraper-8d5bb5db8-6w7h6_kubernetes-dashboard(98eb45e0-5ebb-4a91-950c-b25211aceb65)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-6w7h6_kubernetes-dashboard(98eb45e0-5ebb-4a91-950c-b25211aceb65)"
	W0812 13:19:11.842535 1212353 logs.go:138] Found kubelet problem: Aug 12 13:14:58 old-k8s-version-112335 kubelet[671]: E0812 13:14:58.356659     671 pod_workers.go:191] Error syncing pod 34d824a4-d65e-4566-b95e-8f00f2c6fc71 ("metrics-server-9975d5f86-v2prr_kube-system(34d824a4-d65e-4566-b95e-8f00f2c6fc71)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W0812 13:19:11.842913 1212353 logs.go:138] Found kubelet problem: Aug 12 13:15:06 old-k8s-version-112335 kubelet[671]: E0812 13:15:06.356379     671 pod_workers.go:191] Error syncing pod 98eb45e0-5ebb-4a91-950c-b25211aceb65 ("dashboard-metrics-scraper-8d5bb5db8-6w7h6_kubernetes-dashboard(98eb45e0-5ebb-4a91-950c-b25211aceb65)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-6w7h6_kubernetes-dashboard(98eb45e0-5ebb-4a91-950c-b25211aceb65)"
	W0812 13:19:11.843122 1212353 logs.go:138] Found kubelet problem: Aug 12 13:15:11 old-k8s-version-112335 kubelet[671]: E0812 13:15:11.360283     671 pod_workers.go:191] Error syncing pod 34d824a4-d65e-4566-b95e-8f00f2c6fc71 ("metrics-server-9975d5f86-v2prr_kube-system(34d824a4-d65e-4566-b95e-8f00f2c6fc71)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W0812 13:19:11.843574 1212353 logs.go:138] Found kubelet problem: Aug 12 13:15:20 old-k8s-version-112335 kubelet[671]: E0812 13:15:20.356356     671 pod_workers.go:191] Error syncing pod 98eb45e0-5ebb-4a91-950c-b25211aceb65 ("dashboard-metrics-scraper-8d5bb5db8-6w7h6_kubernetes-dashboard(98eb45e0-5ebb-4a91-950c-b25211aceb65)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-6w7h6_kubernetes-dashboard(98eb45e0-5ebb-4a91-950c-b25211aceb65)"
	W0812 13:19:11.846743 1212353 logs.go:138] Found kubelet problem: Aug 12 13:15:23 old-k8s-version-112335 kubelet[671]: E0812 13:15:23.375625     671 pod_workers.go:191] Error syncing pod 34d824a4-d65e-4566-b95e-8f00f2c6fc71 ("metrics-server-9975d5f86-v2prr_kube-system(34d824a4-d65e-4566-b95e-8f00f2c6fc71)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.85.1:53: no such host"
	W0812 13:19:11.847480 1212353 logs.go:138] Found kubelet problem: Aug 12 13:15:36 old-k8s-version-112335 kubelet[671]: E0812 13:15:36.141806     671 pod_workers.go:191] Error syncing pod 98eb45e0-5ebb-4a91-950c-b25211aceb65 ("dashboard-metrics-scraper-8d5bb5db8-6w7h6_kubernetes-dashboard(98eb45e0-5ebb-4a91-950c-b25211aceb65)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-6w7h6_kubernetes-dashboard(98eb45e0-5ebb-4a91-950c-b25211aceb65)"
	W0812 13:19:11.847721 1212353 logs.go:138] Found kubelet problem: Aug 12 13:15:36 old-k8s-version-112335 kubelet[671]: E0812 13:15:36.356776     671 pod_workers.go:191] Error syncing pod 34d824a4-d65e-4566-b95e-8f00f2c6fc71 ("metrics-server-9975d5f86-v2prr_kube-system(34d824a4-d65e-4566-b95e-8f00f2c6fc71)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W0812 13:19:11.848130 1212353 logs.go:138] Found kubelet problem: Aug 12 13:15:42 old-k8s-version-112335 kubelet[671]: E0812 13:15:42.967870     671 pod_workers.go:191] Error syncing pod 98eb45e0-5ebb-4a91-950c-b25211aceb65 ("dashboard-metrics-scraper-8d5bb5db8-6w7h6_kubernetes-dashboard(98eb45e0-5ebb-4a91-950c-b25211aceb65)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-6w7h6_kubernetes-dashboard(98eb45e0-5ebb-4a91-950c-b25211aceb65)"
	W0812 13:19:11.848364 1212353 logs.go:138] Found kubelet problem: Aug 12 13:15:51 old-k8s-version-112335 kubelet[671]: E0812 13:15:51.358415     671 pod_workers.go:191] Error syncing pod 34d824a4-d65e-4566-b95e-8f00f2c6fc71 ("metrics-server-9975d5f86-v2prr_kube-system(34d824a4-d65e-4566-b95e-8f00f2c6fc71)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W0812 13:19:11.848787 1212353 logs.go:138] Found kubelet problem: Aug 12 13:15:56 old-k8s-version-112335 kubelet[671]: E0812 13:15:56.357561     671 pod_workers.go:191] Error syncing pod 98eb45e0-5ebb-4a91-950c-b25211aceb65 ("dashboard-metrics-scraper-8d5bb5db8-6w7h6_kubernetes-dashboard(98eb45e0-5ebb-4a91-950c-b25211aceb65)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-6w7h6_kubernetes-dashboard(98eb45e0-5ebb-4a91-950c-b25211aceb65)"
	W0812 13:19:11.849050 1212353 logs.go:138] Found kubelet problem: Aug 12 13:16:05 old-k8s-version-112335 kubelet[671]: E0812 13:16:05.356796     671 pod_workers.go:191] Error syncing pod 34d824a4-d65e-4566-b95e-8f00f2c6fc71 ("metrics-server-9975d5f86-v2prr_kube-system(34d824a4-d65e-4566-b95e-8f00f2c6fc71)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W0812 13:19:11.849482 1212353 logs.go:138] Found kubelet problem: Aug 12 13:16:09 old-k8s-version-112335 kubelet[671]: E0812 13:16:09.356580     671 pod_workers.go:191] Error syncing pod 98eb45e0-5ebb-4a91-950c-b25211aceb65 ("dashboard-metrics-scraper-8d5bb5db8-6w7h6_kubernetes-dashboard(98eb45e0-5ebb-4a91-950c-b25211aceb65)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-6w7h6_kubernetes-dashboard(98eb45e0-5ebb-4a91-950c-b25211aceb65)"
	W0812 13:19:11.849718 1212353 logs.go:138] Found kubelet problem: Aug 12 13:16:19 old-k8s-version-112335 kubelet[671]: E0812 13:16:19.360216     671 pod_workers.go:191] Error syncing pod 34d824a4-d65e-4566-b95e-8f00f2c6fc71 ("metrics-server-9975d5f86-v2prr_kube-system(34d824a4-d65e-4566-b95e-8f00f2c6fc71)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W0812 13:19:11.850130 1212353 logs.go:138] Found kubelet problem: Aug 12 13:16:24 old-k8s-version-112335 kubelet[671]: E0812 13:16:24.356502     671 pod_workers.go:191] Error syncing pod 98eb45e0-5ebb-4a91-950c-b25211aceb65 ("dashboard-metrics-scraper-8d5bb5db8-6w7h6_kubernetes-dashboard(98eb45e0-5ebb-4a91-950c-b25211aceb65)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-6w7h6_kubernetes-dashboard(98eb45e0-5ebb-4a91-950c-b25211aceb65)"
	W0812 13:19:11.850361 1212353 logs.go:138] Found kubelet problem: Aug 12 13:16:34 old-k8s-version-112335 kubelet[671]: E0812 13:16:34.356788     671 pod_workers.go:191] Error syncing pod 34d824a4-d65e-4566-b95e-8f00f2c6fc71 ("metrics-server-9975d5f86-v2prr_kube-system(34d824a4-d65e-4566-b95e-8f00f2c6fc71)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W0812 13:19:11.850774 1212353 logs.go:138] Found kubelet problem: Aug 12 13:16:39 old-k8s-version-112335 kubelet[671]: E0812 13:16:39.356466     671 pod_workers.go:191] Error syncing pod 98eb45e0-5ebb-4a91-950c-b25211aceb65 ("dashboard-metrics-scraper-8d5bb5db8-6w7h6_kubernetes-dashboard(98eb45e0-5ebb-4a91-950c-b25211aceb65)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-6w7h6_kubernetes-dashboard(98eb45e0-5ebb-4a91-950c-b25211aceb65)"
	W0812 13:19:11.854036 1212353 logs.go:138] Found kubelet problem: Aug 12 13:16:46 old-k8s-version-112335 kubelet[671]: E0812 13:16:46.364626     671 pod_workers.go:191] Error syncing pod 34d824a4-d65e-4566-b95e-8f00f2c6fc71 ("metrics-server-9975d5f86-v2prr_kube-system(34d824a4-d65e-4566-b95e-8f00f2c6fc71)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.85.1:53: no such host"
	W0812 13:19:11.854484 1212353 logs.go:138] Found kubelet problem: Aug 12 13:16:53 old-k8s-version-112335 kubelet[671]: E0812 13:16:53.357451     671 pod_workers.go:191] Error syncing pod 98eb45e0-5ebb-4a91-950c-b25211aceb65 ("dashboard-metrics-scraper-8d5bb5db8-6w7h6_kubernetes-dashboard(98eb45e0-5ebb-4a91-950c-b25211aceb65)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-6w7h6_kubernetes-dashboard(98eb45e0-5ebb-4a91-950c-b25211aceb65)"
	W0812 13:19:11.854726 1212353 logs.go:138] Found kubelet problem: Aug 12 13:16:59 old-k8s-version-112335 kubelet[671]: E0812 13:16:59.356869     671 pod_workers.go:191] Error syncing pod 34d824a4-d65e-4566-b95e-8f00f2c6fc71 ("metrics-server-9975d5f86-v2prr_kube-system(34d824a4-d65e-4566-b95e-8f00f2c6fc71)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W0812 13:19:11.855465 1212353 logs.go:138] Found kubelet problem: Aug 12 13:17:08 old-k8s-version-112335 kubelet[671]: E0812 13:17:08.461635     671 pod_workers.go:191] Error syncing pod 98eb45e0-5ebb-4a91-950c-b25211aceb65 ("dashboard-metrics-scraper-8d5bb5db8-6w7h6_kubernetes-dashboard(98eb45e0-5ebb-4a91-950c-b25211aceb65)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-6w7h6_kubernetes-dashboard(98eb45e0-5ebb-4a91-950c-b25211aceb65)"
	W0812 13:19:11.855721 1212353 logs.go:138] Found kubelet problem: Aug 12 13:17:10 old-k8s-version-112335 kubelet[671]: E0812 13:17:10.356646     671 pod_workers.go:191] Error syncing pod 34d824a4-d65e-4566-b95e-8f00f2c6fc71 ("metrics-server-9975d5f86-v2prr_kube-system(34d824a4-d65e-4566-b95e-8f00f2c6fc71)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W0812 13:19:11.856121 1212353 logs.go:138] Found kubelet problem: Aug 12 13:17:12 old-k8s-version-112335 kubelet[671]: E0812 13:17:12.982447     671 pod_workers.go:191] Error syncing pod 98eb45e0-5ebb-4a91-950c-b25211aceb65 ("dashboard-metrics-scraper-8d5bb5db8-6w7h6_kubernetes-dashboard(98eb45e0-5ebb-4a91-950c-b25211aceb65)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-6w7h6_kubernetes-dashboard(98eb45e0-5ebb-4a91-950c-b25211aceb65)"
	W0812 13:19:11.856356 1212353 logs.go:138] Found kubelet problem: Aug 12 13:17:23 old-k8s-version-112335 kubelet[671]: E0812 13:17:23.357066     671 pod_workers.go:191] Error syncing pod 34d824a4-d65e-4566-b95e-8f00f2c6fc71 ("metrics-server-9975d5f86-v2prr_kube-system(34d824a4-d65e-4566-b95e-8f00f2c6fc71)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W0812 13:19:11.856800 1212353 logs.go:138] Found kubelet problem: Aug 12 13:17:27 old-k8s-version-112335 kubelet[671]: E0812 13:17:27.356820     671 pod_workers.go:191] Error syncing pod 98eb45e0-5ebb-4a91-950c-b25211aceb65 ("dashboard-metrics-scraper-8d5bb5db8-6w7h6_kubernetes-dashboard(98eb45e0-5ebb-4a91-950c-b25211aceb65)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-6w7h6_kubernetes-dashboard(98eb45e0-5ebb-4a91-950c-b25211aceb65)"
	W0812 13:19:11.857023 1212353 logs.go:138] Found kubelet problem: Aug 12 13:17:36 old-k8s-version-112335 kubelet[671]: E0812 13:17:36.356796     671 pod_workers.go:191] Error syncing pod 34d824a4-d65e-4566-b95e-8f00f2c6fc71 ("metrics-server-9975d5f86-v2prr_kube-system(34d824a4-d65e-4566-b95e-8f00f2c6fc71)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W0812 13:19:11.857427 1212353 logs.go:138] Found kubelet problem: Aug 12 13:17:38 old-k8s-version-112335 kubelet[671]: E0812 13:17:38.356467     671 pod_workers.go:191] Error syncing pod 98eb45e0-5ebb-4a91-950c-b25211aceb65 ("dashboard-metrics-scraper-8d5bb5db8-6w7h6_kubernetes-dashboard(98eb45e0-5ebb-4a91-950c-b25211aceb65)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-6w7h6_kubernetes-dashboard(98eb45e0-5ebb-4a91-950c-b25211aceb65)"
	W0812 13:19:11.857666 1212353 logs.go:138] Found kubelet problem: Aug 12 13:17:47 old-k8s-version-112335 kubelet[671]: E0812 13:17:47.357155     671 pod_workers.go:191] Error syncing pod 34d824a4-d65e-4566-b95e-8f00f2c6fc71 ("metrics-server-9975d5f86-v2prr_kube-system(34d824a4-d65e-4566-b95e-8f00f2c6fc71)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W0812 13:19:11.858132 1212353 logs.go:138] Found kubelet problem: Aug 12 13:17:51 old-k8s-version-112335 kubelet[671]: E0812 13:17:51.357564     671 pod_workers.go:191] Error syncing pod 98eb45e0-5ebb-4a91-950c-b25211aceb65 ("dashboard-metrics-scraper-8d5bb5db8-6w7h6_kubernetes-dashboard(98eb45e0-5ebb-4a91-950c-b25211aceb65)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-6w7h6_kubernetes-dashboard(98eb45e0-5ebb-4a91-950c-b25211aceb65)"
	W0812 13:19:11.858444 1212353 logs.go:138] Found kubelet problem: Aug 12 13:18:00 old-k8s-version-112335 kubelet[671]: E0812 13:18:00.357436     671 pod_workers.go:191] Error syncing pod 34d824a4-d65e-4566-b95e-8f00f2c6fc71 ("metrics-server-9975d5f86-v2prr_kube-system(34d824a4-d65e-4566-b95e-8f00f2c6fc71)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W0812 13:19:11.858842 1212353 logs.go:138] Found kubelet problem: Aug 12 13:18:06 old-k8s-version-112335 kubelet[671]: E0812 13:18:06.356382     671 pod_workers.go:191] Error syncing pod 98eb45e0-5ebb-4a91-950c-b25211aceb65 ("dashboard-metrics-scraper-8d5bb5db8-6w7h6_kubernetes-dashboard(98eb45e0-5ebb-4a91-950c-b25211aceb65)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-6w7h6_kubernetes-dashboard(98eb45e0-5ebb-4a91-950c-b25211aceb65)"
	W0812 13:19:11.859084 1212353 logs.go:138] Found kubelet problem: Aug 12 13:18:11 old-k8s-version-112335 kubelet[671]: E0812 13:18:11.356726     671 pod_workers.go:191] Error syncing pod 34d824a4-d65e-4566-b95e-8f00f2c6fc71 ("metrics-server-9975d5f86-v2prr_kube-system(34d824a4-d65e-4566-b95e-8f00f2c6fc71)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W0812 13:19:11.859501 1212353 logs.go:138] Found kubelet problem: Aug 12 13:18:21 old-k8s-version-112335 kubelet[671]: E0812 13:18:21.358016     671 pod_workers.go:191] Error syncing pod 98eb45e0-5ebb-4a91-950c-b25211aceb65 ("dashboard-metrics-scraper-8d5bb5db8-6w7h6_kubernetes-dashboard(98eb45e0-5ebb-4a91-950c-b25211aceb65)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-6w7h6_kubernetes-dashboard(98eb45e0-5ebb-4a91-950c-b25211aceb65)"
	W0812 13:19:11.859758 1212353 logs.go:138] Found kubelet problem: Aug 12 13:18:25 old-k8s-version-112335 kubelet[671]: E0812 13:18:25.359255     671 pod_workers.go:191] Error syncing pod 34d824a4-d65e-4566-b95e-8f00f2c6fc71 ("metrics-server-9975d5f86-v2prr_kube-system(34d824a4-d65e-4566-b95e-8f00f2c6fc71)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W0812 13:19:11.860173 1212353 logs.go:138] Found kubelet problem: Aug 12 13:18:33 old-k8s-version-112335 kubelet[671]: E0812 13:18:33.356927     671 pod_workers.go:191] Error syncing pod 98eb45e0-5ebb-4a91-950c-b25211aceb65 ("dashboard-metrics-scraper-8d5bb5db8-6w7h6_kubernetes-dashboard(98eb45e0-5ebb-4a91-950c-b25211aceb65)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-6w7h6_kubernetes-dashboard(98eb45e0-5ebb-4a91-950c-b25211aceb65)"
	W0812 13:19:11.860409 1212353 logs.go:138] Found kubelet problem: Aug 12 13:18:39 old-k8s-version-112335 kubelet[671]: E0812 13:18:39.356920     671 pod_workers.go:191] Error syncing pod 34d824a4-d65e-4566-b95e-8f00f2c6fc71 ("metrics-server-9975d5f86-v2prr_kube-system(34d824a4-d65e-4566-b95e-8f00f2c6fc71)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W0812 13:19:11.860805 1212353 logs.go:138] Found kubelet problem: Aug 12 13:18:45 old-k8s-version-112335 kubelet[671]: E0812 13:18:45.356665     671 pod_workers.go:191] Error syncing pod 98eb45e0-5ebb-4a91-950c-b25211aceb65 ("dashboard-metrics-scraper-8d5bb5db8-6w7h6_kubernetes-dashboard(98eb45e0-5ebb-4a91-950c-b25211aceb65)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-6w7h6_kubernetes-dashboard(98eb45e0-5ebb-4a91-950c-b25211aceb65)"
	W0812 13:19:11.861040 1212353 logs.go:138] Found kubelet problem: Aug 12 13:18:51 old-k8s-version-112335 kubelet[671]: E0812 13:18:51.356752     671 pod_workers.go:191] Error syncing pod 34d824a4-d65e-4566-b95e-8f00f2c6fc71 ("metrics-server-9975d5f86-v2prr_kube-system(34d824a4-d65e-4566-b95e-8f00f2c6fc71)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W0812 13:19:11.861491 1212353 logs.go:138] Found kubelet problem: Aug 12 13:18:57 old-k8s-version-112335 kubelet[671]: E0812 13:18:57.356673     671 pod_workers.go:191] Error syncing pod 98eb45e0-5ebb-4a91-950c-b25211aceb65 ("dashboard-metrics-scraper-8d5bb5db8-6w7h6_kubernetes-dashboard(98eb45e0-5ebb-4a91-950c-b25211aceb65)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-6w7h6_kubernetes-dashboard(98eb45e0-5ebb-4a91-950c-b25211aceb65)"
	W0812 13:19:11.861706 1212353 logs.go:138] Found kubelet problem: Aug 12 13:19:06 old-k8s-version-112335 kubelet[671]: E0812 13:19:06.357355     671 pod_workers.go:191] Error syncing pod 34d824a4-d65e-4566-b95e-8f00f2c6fc71 ("metrics-server-9975d5f86-v2prr_kube-system(34d824a4-d65e-4566-b95e-8f00f2c6fc71)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W0812 13:19:11.862254 1212353 logs.go:138] Found kubelet problem: Aug 12 13:19:08 old-k8s-version-112335 kubelet[671]: E0812 13:19:08.356438     671 pod_workers.go:191] Error syncing pod 98eb45e0-5ebb-4a91-950c-b25211aceb65 ("dashboard-metrics-scraper-8d5bb5db8-6w7h6_kubernetes-dashboard(98eb45e0-5ebb-4a91-950c-b25211aceb65)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-6w7h6_kubernetes-dashboard(98eb45e0-5ebb-4a91-950c-b25211aceb65)"
	I0812 13:19:11.862292 1212353 logs.go:123] Gathering logs for dmesg ...
	I0812 13:19:11.862307 1212353 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
	I0812 13:19:11.886918 1212353 logs.go:123] Gathering logs for kube-apiserver [e4cf465775a34b80fbfbd63dc4f0643c8d6a61c508c1c06d6e58548109c82a20] ...
	I0812 13:19:11.886948 1212353 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 e4cf465775a34b80fbfbd63dc4f0643c8d6a61c508c1c06d6e58548109c82a20"
	I0812 13:19:11.870722 1223708 out.go:204] * Creating docker container (CPUs=2, Memory=2200MB) ...
	I0812 13:19:11.870982 1223708 start.go:159] libmachine.API.Create for "embed-certs-097595" (driver="docker")
	I0812 13:19:11.871035 1223708 client.go:168] LocalClient.Create starting
	I0812 13:19:11.871136 1223708 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/19411-998978/.minikube/certs/ca.pem
	I0812 13:19:11.871169 1223708 main.go:141] libmachine: Decoding PEM data...
	I0812 13:19:11.871183 1223708 main.go:141] libmachine: Parsing certificate...
	I0812 13:19:11.871232 1223708 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/19411-998978/.minikube/certs/cert.pem
	I0812 13:19:11.871249 1223708 main.go:141] libmachine: Decoding PEM data...
	I0812 13:19:11.871276 1223708 main.go:141] libmachine: Parsing certificate...
	I0812 13:19:11.871657 1223708 cli_runner.go:164] Run: docker network inspect embed-certs-097595 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
	W0812 13:19:11.893510 1223708 cli_runner.go:211] docker network inspect embed-certs-097595 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}" returned with exit code 1
	I0812 13:19:11.893586 1223708 network_create.go:284] running [docker network inspect embed-certs-097595] to gather additional debugging logs...
	I0812 13:19:11.893603 1223708 cli_runner.go:164] Run: docker network inspect embed-certs-097595
	W0812 13:19:11.911012 1223708 cli_runner.go:211] docker network inspect embed-certs-097595 returned with exit code 1
	I0812 13:19:11.911048 1223708 network_create.go:287] error running [docker network inspect embed-certs-097595]: docker network inspect embed-certs-097595: exit status 1
	stdout:
	[]
	
	stderr:
	Error response from daemon: network embed-certs-097595 not found
	I0812 13:19:11.911061 1223708 network_create.go:289] output of [docker network inspect embed-certs-097595]: -- stdout --
	[]
	
	-- /stdout --
	** stderr ** 
	Error response from daemon: network embed-certs-097595 not found
	
	** /stderr **
	I0812 13:19:11.911165 1223708 cli_runner.go:164] Run: docker network inspect bridge --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
	I0812 13:19:11.957895 1223708 network.go:211] skipping subnet 192.168.49.0/24 that is taken: &{IP:192.168.49.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.49.0/24 Gateway:192.168.49.1 ClientMin:192.168.49.2 ClientMax:192.168.49.254 Broadcast:192.168.49.255 IsPrivate:true Interface:{IfaceName:br-766220ed0460 IfaceIPv4:192.168.49.1 IfaceMTU:1500 IfaceMAC:02:42:ab:c1:87:ce} reservation:<nil>}
	I0812 13:19:11.958270 1223708 network.go:211] skipping subnet 192.168.58.0/24 that is taken: &{IP:192.168.58.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.58.0/24 Gateway:192.168.58.1 ClientMin:192.168.58.2 ClientMax:192.168.58.254 Broadcast:192.168.58.255 IsPrivate:true Interface:{IfaceName:br-13d3af32c371 IfaceIPv4:192.168.58.1 IfaceMTU:1500 IfaceMAC:02:42:8c:c0:c5:b4} reservation:<nil>}
	I0812 13:19:11.958852 1223708 network.go:211] skipping subnet 192.168.67.0/24 that is taken: &{IP:192.168.67.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.67.0/24 Gateway:192.168.67.1 ClientMin:192.168.67.2 ClientMax:192.168.67.254 Broadcast:192.168.67.255 IsPrivate:true Interface:{IfaceName:br-9c9ecaeb8540 IfaceIPv4:192.168.67.1 IfaceMTU:1500 IfaceMAC:02:42:5c:1e:7c:1c} reservation:<nil>}
	I0812 13:19:11.959480 1223708 network.go:206] using free private subnet 192.168.76.0/24: &{IP:192.168.76.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.76.0/24 Gateway:192.168.76.1 ClientMin:192.168.76.2 ClientMax:192.168.76.254 Broadcast:192.168.76.255 IsPrivate:true Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:} reservation:0x40017c1780}
	I0812 13:19:11.959533 1223708 network_create.go:124] attempt to create docker network embed-certs-097595 192.168.76.0/24 with gateway 192.168.76.1 and MTU of 1500 ...
	I0812 13:19:11.959627 1223708 cli_runner.go:164] Run: docker network create --driver=bridge --subnet=192.168.76.0/24 --gateway=192.168.76.1 -o --ip-masq -o --icc -o com.docker.network.driver.mtu=1500 --label=created_by.minikube.sigs.k8s.io=true --label=name.minikube.sigs.k8s.io=embed-certs-097595 embed-certs-097595
	I0812 13:19:12.067069 1223708 network_create.go:108] docker network embed-certs-097595 192.168.76.0/24 created
	I0812 13:19:12.067117 1223708 kic.go:121] calculated static IP "192.168.76.2" for the "embed-certs-097595" container
	I0812 13:19:12.067200 1223708 cli_runner.go:164] Run: docker ps -a --format {{.Names}}
	I0812 13:19:12.094985 1223708 cli_runner.go:164] Run: docker volume create embed-certs-097595 --label name.minikube.sigs.k8s.io=embed-certs-097595 --label created_by.minikube.sigs.k8s.io=true
	I0812 13:19:12.124481 1223708 oci.go:103] Successfully created a docker volume embed-certs-097595
	I0812 13:19:12.124567 1223708 cli_runner.go:164] Run: docker run --rm --name embed-certs-097595-preload-sidecar --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=embed-certs-097595 --entrypoint /usr/bin/test -v embed-certs-097595:/var gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1723026928-19389@sha256:7715fe0c5dce35b4eb757765cbbe02d40cd8b5effa0639735e42ad89f4f51ef0 -d /var/lib
	I0812 13:19:12.763578 1223708 oci.go:107] Successfully prepared a docker volume embed-certs-097595
	I0812 13:19:12.763622 1223708 preload.go:131] Checking if preload exists for k8s version v1.30.3 and runtime containerd
	I0812 13:19:12.763643 1223708 kic.go:194] Starting extracting preloaded images to volume ...
	I0812 13:19:12.763763 1223708 cli_runner.go:164] Run: docker run --rm --entrypoint /usr/bin/tar -v /home/jenkins/minikube-integration/19411-998978/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.30.3-containerd-overlay2-arm64.tar.lz4:/preloaded.tar:ro -v embed-certs-097595:/extractDir gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1723026928-19389@sha256:7715fe0c5dce35b4eb757765cbbe02d40cd8b5effa0639735e42ad89f4f51ef0 -I lz4 -xf /preloaded.tar -C /extractDir
	I0812 13:19:12.044977 1212353 logs.go:123] Gathering logs for containerd ...
	I0812 13:19:12.045038 1212353 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u containerd -n 400"
	I0812 13:19:12.135386 1212353 out.go:304] Setting ErrFile to fd 2...
	I0812 13:19:12.135423 1212353 out.go:338] TERM=,COLORTERM=, which probably does not support color
	W0812 13:19:12.135480 1212353 out.go:239] X Problems detected in kubelet:
	W0812 13:19:12.135495 1212353 out.go:239]   Aug 12 13:18:45 old-k8s-version-112335 kubelet[671]: E0812 13:18:45.356665     671 pod_workers.go:191] Error syncing pod 98eb45e0-5ebb-4a91-950c-b25211aceb65 ("dashboard-metrics-scraper-8d5bb5db8-6w7h6_kubernetes-dashboard(98eb45e0-5ebb-4a91-950c-b25211aceb65)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-6w7h6_kubernetes-dashboard(98eb45e0-5ebb-4a91-950c-b25211aceb65)"
	W0812 13:19:12.135506 1212353 out.go:239]   Aug 12 13:18:51 old-k8s-version-112335 kubelet[671]: E0812 13:18:51.356752     671 pod_workers.go:191] Error syncing pod 34d824a4-d65e-4566-b95e-8f00f2c6fc71 ("metrics-server-9975d5f86-v2prr_kube-system(34d824a4-d65e-4566-b95e-8f00f2c6fc71)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W0812 13:19:12.135522 1212353 out.go:239]   Aug 12 13:18:57 old-k8s-version-112335 kubelet[671]: E0812 13:18:57.356673     671 pod_workers.go:191] Error syncing pod 98eb45e0-5ebb-4a91-950c-b25211aceb65 ("dashboard-metrics-scraper-8d5bb5db8-6w7h6_kubernetes-dashboard(98eb45e0-5ebb-4a91-950c-b25211aceb65)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-6w7h6_kubernetes-dashboard(98eb45e0-5ebb-4a91-950c-b25211aceb65)"
	W0812 13:19:12.135529 1212353 out.go:239]   Aug 12 13:19:06 old-k8s-version-112335 kubelet[671]: E0812 13:19:06.357355     671 pod_workers.go:191] Error syncing pod 34d824a4-d65e-4566-b95e-8f00f2c6fc71 ("metrics-server-9975d5f86-v2prr_kube-system(34d824a4-d65e-4566-b95e-8f00f2c6fc71)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W0812 13:19:12.135542 1212353 out.go:239]   Aug 12 13:19:08 old-k8s-version-112335 kubelet[671]: E0812 13:19:08.356438     671 pod_workers.go:191] Error syncing pod 98eb45e0-5ebb-4a91-950c-b25211aceb65 ("dashboard-metrics-scraper-8d5bb5db8-6w7h6_kubernetes-dashboard(98eb45e0-5ebb-4a91-950c-b25211aceb65)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-6w7h6_kubernetes-dashboard(98eb45e0-5ebb-4a91-950c-b25211aceb65)"
	I0812 13:19:12.135549 1212353 out.go:304] Setting ErrFile to fd 2...
	I0812 13:19:12.135555 1212353 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0812 13:19:18.378786 1223708 cli_runner.go:217] Completed: docker run --rm --entrypoint /usr/bin/tar -v /home/jenkins/minikube-integration/19411-998978/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.30.3-containerd-overlay2-arm64.tar.lz4:/preloaded.tar:ro -v embed-certs-097595:/extractDir gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1723026928-19389@sha256:7715fe0c5dce35b4eb757765cbbe02d40cd8b5effa0639735e42ad89f4f51ef0 -I lz4 -xf /preloaded.tar -C /extractDir: (5.614983893s)
	I0812 13:19:18.378820 1223708 kic.go:203] duration metric: took 5.615173394s to extract preloaded images to volume ...
	W0812 13:19:18.378960 1223708 cgroups_linux.go:77] Your kernel does not support swap limit capabilities or the cgroup is not mounted.
	I0812 13:19:18.379086 1223708 cli_runner.go:164] Run: docker info --format "'{{json .SecurityOptions}}'"
	I0812 13:19:18.437384 1223708 cli_runner.go:164] Run: docker run -d -t --privileged --security-opt seccomp=unconfined --tmpfs /tmp --tmpfs /run -v /lib/modules:/lib/modules:ro --hostname embed-certs-097595 --name embed-certs-097595 --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=embed-certs-097595 --label role.minikube.sigs.k8s.io= --label mode.minikube.sigs.k8s.io=embed-certs-097595 --network embed-certs-097595 --ip 192.168.76.2 --volume embed-certs-097595:/var --security-opt apparmor=unconfined --memory=2200mb --cpus=2 -e container=docker --expose 8443 --publish=127.0.0.1::8443 --publish=127.0.0.1::22 --publish=127.0.0.1::2376 --publish=127.0.0.1::5000 --publish=127.0.0.1::32443 gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1723026928-19389@sha256:7715fe0c5dce35b4eb757765cbbe02d40cd8b5effa0639735e42ad89f4f51ef0
	I0812 13:19:18.803347 1223708 cli_runner.go:164] Run: docker container inspect embed-certs-097595 --format={{.State.Running}}
	I0812 13:19:18.832689 1223708 cli_runner.go:164] Run: docker container inspect embed-certs-097595 --format={{.State.Status}}
	I0812 13:19:18.858363 1223708 cli_runner.go:164] Run: docker exec embed-certs-097595 stat /var/lib/dpkg/alternatives/iptables
	I0812 13:19:18.940672 1223708 oci.go:144] the created container "embed-certs-097595" has a running status.
	I0812 13:19:18.940715 1223708 kic.go:225] Creating ssh key for kic: /home/jenkins/minikube-integration/19411-998978/.minikube/machines/embed-certs-097595/id_rsa...
	I0812 13:19:19.486940 1223708 kic_runner.go:191] docker (temp): /home/jenkins/minikube-integration/19411-998978/.minikube/machines/embed-certs-097595/id_rsa.pub --> /home/docker/.ssh/authorized_keys (381 bytes)
	I0812 13:19:19.518309 1223708 cli_runner.go:164] Run: docker container inspect embed-certs-097595 --format={{.State.Status}}
	I0812 13:19:19.544213 1223708 kic_runner.go:93] Run: chown docker:docker /home/docker/.ssh/authorized_keys
	I0812 13:19:19.544240 1223708 kic_runner.go:114] Args: [docker exec --privileged embed-certs-097595 chown docker:docker /home/docker/.ssh/authorized_keys]
	I0812 13:19:19.626517 1223708 cli_runner.go:164] Run: docker container inspect embed-certs-097595 --format={{.State.Status}}
	I0812 13:19:19.652441 1223708 machine.go:94] provisionDockerMachine start ...
	I0812 13:19:19.652530 1223708 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-097595
	I0812 13:19:19.681398 1223708 main.go:141] libmachine: Using SSH client type: native
	I0812 13:19:19.681673 1223708 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x3e2cd0] 0x3e5530 <nil>  [] 0s} 127.0.0.1 34200 <nil> <nil>}
	I0812 13:19:19.681691 1223708 main.go:141] libmachine: About to run SSH command:
	hostname
	I0812 13:19:19.877280 1223708 main.go:141] libmachine: SSH cmd err, output: <nil>: embed-certs-097595
	
	I0812 13:19:19.877319 1223708 ubuntu.go:169] provisioning hostname "embed-certs-097595"
	I0812 13:19:19.877384 1223708 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-097595
	I0812 13:19:19.905948 1223708 main.go:141] libmachine: Using SSH client type: native
	I0812 13:19:19.906210 1223708 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x3e2cd0] 0x3e5530 <nil>  [] 0s} 127.0.0.1 34200 <nil> <nil>}
	I0812 13:19:19.906227 1223708 main.go:141] libmachine: About to run SSH command:
	sudo hostname embed-certs-097595 && echo "embed-certs-097595" | sudo tee /etc/hostname
	I0812 13:19:20.096825 1223708 main.go:141] libmachine: SSH cmd err, output: <nil>: embed-certs-097595
	
	I0812 13:19:20.096915 1223708 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-097595
	I0812 13:19:20.126405 1223708 main.go:141] libmachine: Using SSH client type: native
	I0812 13:19:20.126723 1223708 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x3e2cd0] 0x3e5530 <nil>  [] 0s} 127.0.0.1 34200 <nil> <nil>}
	I0812 13:19:20.126755 1223708 main.go:141] libmachine: About to run SSH command:
	
			if ! grep -xq '.*\sembed-certs-097595' /etc/hosts; then
				if grep -xq '127.0.1.1\s.*' /etc/hosts; then
					sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 embed-certs-097595/g' /etc/hosts;
				else 
					echo '127.0.1.1 embed-certs-097595' | sudo tee -a /etc/hosts; 
				fi
			fi
	I0812 13:19:20.281671 1223708 main.go:141] libmachine: SSH cmd err, output: <nil>: 
	I0812 13:19:20.281712 1223708 ubuntu.go:175] set auth options {CertDir:/home/jenkins/minikube-integration/19411-998978/.minikube CaCertPath:/home/jenkins/minikube-integration/19411-998978/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/19411-998978/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/19411-998978/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/19411-998978/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/19411-998978/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/19411-998978/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/19411-998978/.minikube}
	I0812 13:19:20.281733 1223708 ubuntu.go:177] setting up certificates
	I0812 13:19:20.281744 1223708 provision.go:84] configureAuth start
	I0812 13:19:20.281806 1223708 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" embed-certs-097595
	I0812 13:19:20.299520 1223708 provision.go:143] copyHostCerts
	I0812 13:19:20.299583 1223708 exec_runner.go:144] found /home/jenkins/minikube-integration/19411-998978/.minikube/ca.pem, removing ...
	I0812 13:19:20.299601 1223708 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19411-998978/.minikube/ca.pem
	I0812 13:19:20.299681 1223708 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19411-998978/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/19411-998978/.minikube/ca.pem (1082 bytes)
	I0812 13:19:20.299777 1223708 exec_runner.go:144] found /home/jenkins/minikube-integration/19411-998978/.minikube/cert.pem, removing ...
	I0812 13:19:20.299787 1223708 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19411-998978/.minikube/cert.pem
	I0812 13:19:20.299815 1223708 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19411-998978/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/19411-998978/.minikube/cert.pem (1123 bytes)
	I0812 13:19:20.299878 1223708 exec_runner.go:144] found /home/jenkins/minikube-integration/19411-998978/.minikube/key.pem, removing ...
	I0812 13:19:20.299883 1223708 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19411-998978/.minikube/key.pem
	I0812 13:19:20.299908 1223708 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19411-998978/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/19411-998978/.minikube/key.pem (1679 bytes)
	I0812 13:19:20.299992 1223708 provision.go:117] generating server cert: /home/jenkins/minikube-integration/19411-998978/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/19411-998978/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/19411-998978/.minikube/certs/ca-key.pem org=jenkins.embed-certs-097595 san=[127.0.0.1 192.168.76.2 embed-certs-097595 localhost minikube]
	I0812 13:19:20.801178 1223708 provision.go:177] copyRemoteCerts
	I0812 13:19:20.801325 1223708 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
	I0812 13:19:20.801402 1223708 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-097595
	I0812 13:19:20.822546 1223708 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:34200 SSHKeyPath:/home/jenkins/minikube-integration/19411-998978/.minikube/machines/embed-certs-097595/id_rsa Username:docker}
	I0812 13:19:20.930110 1223708 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19411-998978/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1082 bytes)
	I0812 13:19:20.957797 1223708 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19411-998978/.minikube/machines/server.pem --> /etc/docker/server.pem (1220 bytes)
	I0812 13:19:20.983803 1223708 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19411-998978/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1675 bytes)
	I0812 13:19:21.015250 1223708 provision.go:87] duration metric: took 733.490148ms to configureAuth
	I0812 13:19:21.015283 1223708 ubuntu.go:193] setting minikube options for container-runtime
	I0812 13:19:21.015494 1223708 config.go:182] Loaded profile config "embed-certs-097595": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.30.3
	I0812 13:19:21.015507 1223708 machine.go:97] duration metric: took 1.363045161s to provisionDockerMachine
	I0812 13:19:21.015515 1223708 client.go:171] duration metric: took 9.144473425s to LocalClient.Create
	I0812 13:19:21.015536 1223708 start.go:167] duration metric: took 9.144553931s to libmachine.API.Create "embed-certs-097595"
	I0812 13:19:21.015550 1223708 start.go:293] postStartSetup for "embed-certs-097595" (driver="docker")
	I0812 13:19:21.015560 1223708 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
	I0812 13:19:21.015621 1223708 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
	I0812 13:19:21.015667 1223708 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-097595
	I0812 13:19:21.034400 1223708 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:34200 SSHKeyPath:/home/jenkins/minikube-integration/19411-998978/.minikube/machines/embed-certs-097595/id_rsa Username:docker}
	I0812 13:19:21.143501 1223708 ssh_runner.go:195] Run: cat /etc/os-release
	I0812 13:19:21.147311 1223708 main.go:141] libmachine: Couldn't set key VERSION_CODENAME, no corresponding struct field found
	I0812 13:19:21.147357 1223708 main.go:141] libmachine: Couldn't set key PRIVACY_POLICY_URL, no corresponding struct field found
	I0812 13:19:21.147368 1223708 main.go:141] libmachine: Couldn't set key UBUNTU_CODENAME, no corresponding struct field found
	I0812 13:19:21.147375 1223708 info.go:137] Remote host: Ubuntu 22.04.4 LTS
	I0812 13:19:21.147386 1223708 filesync.go:126] Scanning /home/jenkins/minikube-integration/19411-998978/.minikube/addons for local assets ...
	I0812 13:19:21.147445 1223708 filesync.go:126] Scanning /home/jenkins/minikube-integration/19411-998978/.minikube/files for local assets ...
	I0812 13:19:21.147527 1223708 filesync.go:149] local asset: /home/jenkins/minikube-integration/19411-998978/.minikube/files/etc/ssl/certs/10043702.pem -> 10043702.pem in /etc/ssl/certs
	I0812 13:19:21.147649 1223708 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs
	I0812 13:19:21.157907 1223708 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19411-998978/.minikube/files/etc/ssl/certs/10043702.pem --> /etc/ssl/certs/10043702.pem (1708 bytes)
	I0812 13:19:21.184152 1223708 start.go:296] duration metric: took 168.585659ms for postStartSetup
	I0812 13:19:21.184515 1223708 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" embed-certs-097595
	I0812 13:19:21.202346 1223708 profile.go:143] Saving config to /home/jenkins/minikube-integration/19411-998978/.minikube/profiles/embed-certs-097595/config.json ...
	I0812 13:19:21.202659 1223708 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
	I0812 13:19:21.202706 1223708 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-097595
	I0812 13:19:21.220317 1223708 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:34200 SSHKeyPath:/home/jenkins/minikube-integration/19411-998978/.minikube/machines/embed-certs-097595/id_rsa Username:docker}
	I0812 13:19:21.319168 1223708 ssh_runner.go:195] Run: sh -c "df -BG /var | awk 'NR==2{print $4}'"
	I0812 13:19:21.324113 1223708 start.go:128] duration metric: took 9.455977603s to createHost
	I0812 13:19:21.324140 1223708 start.go:83] releasing machines lock for "embed-certs-097595", held for 9.456126048s
	I0812 13:19:21.324223 1223708 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" embed-certs-097595
	I0812 13:19:21.340251 1223708 ssh_runner.go:195] Run: cat /version.json
	I0812 13:19:21.340309 1223708 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-097595
	I0812 13:19:21.340397 1223708 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/
	I0812 13:19:21.340456 1223708 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-097595
	I0812 13:19:21.371079 1223708 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:34200 SSHKeyPath:/home/jenkins/minikube-integration/19411-998978/.minikube/machines/embed-certs-097595/id_rsa Username:docker}
	I0812 13:19:21.378749 1223708 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:34200 SSHKeyPath:/home/jenkins/minikube-integration/19411-998978/.minikube/machines/embed-certs-097595/id_rsa Username:docker}
	I0812 13:19:22.137007 1212353 api_server.go:253] Checking apiserver healthz at https://192.168.85.2:8443/healthz ...
	I0812 13:19:22.148426 1212353 api_server.go:279] https://192.168.85.2:8443/healthz returned 200:
	ok
	I0812 13:19:22.150863 1212353 out.go:177] 
	W0812 13:19:22.152732 1212353 out.go:239] X Exiting due to K8S_UNHEALTHY_CONTROL_PLANE: wait 6m0s for node: wait for healthy API server: controlPlane never updated to v1.20.0
	W0812 13:19:22.152770 1212353 out.go:239] * Suggestion: Control Plane could not update, try minikube delete --all --purge
	W0812 13:19:22.152954 1212353 out.go:239] * Related issue: https://github.com/kubernetes/minikube/issues/11417
	W0812 13:19:22.152967 1212353 out.go:239] * 
	W0812 13:19:22.154614 1212353 out.go:239] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                             │
	│    * If the above advice does not help, please let us know:                                 │
	│      https://github.com/kubernetes/minikube/issues/new/choose                               │
	│                                                                                             │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │
	│                                                                                             │
	╰─────────────────────────────────────────────────────────────────────────────────────────────╯
	I0812 13:19:22.156233 1212353 out.go:177] 
	I0812 13:19:21.601344 1223708 ssh_runner.go:195] Run: systemctl --version
	I0812 13:19:21.607132 1223708 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"
	I0812 13:19:21.611480 1223708 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f -name *loopback.conf* -not -name *.mk_disabled -exec sh -c "grep -q loopback {} && ( grep -q name {} || sudo sed -i '/"type": "loopback"/i \ \ \ \ "name": "loopback",' {} ) && sudo sed -i 's|"cniVersion": ".*"|"cniVersion": "1.0.0"|g' {}" ;
	I0812 13:19:21.638957 1223708 cni.go:230] loopback cni configuration patched: "/etc/cni/net.d/*loopback.conf*" found
	I0812 13:19:21.639050 1223708 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%!p(MISSING), " -exec sh -c "sudo mv {} {}.mk_disabled" ;
	I0812 13:19:21.668617 1223708 cni.go:262] disabled [/etc/cni/net.d/87-podman-bridge.conflist, /etc/cni/net.d/100-crio-bridge.conf] bridge cni config(s)
	I0812 13:19:21.668644 1223708 start.go:495] detecting cgroup driver to use...
	I0812 13:19:21.668678 1223708 detect.go:187] detected "cgroupfs" cgroup driver on host os
	I0812 13:19:21.668734 1223708 ssh_runner.go:195] Run: sudo systemctl stop -f crio
	I0812 13:19:21.682686 1223708 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service crio
	I0812 13:19:21.694805 1223708 docker.go:217] disabling cri-docker service (if available) ...
	I0812 13:19:21.694925 1223708 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.socket
	I0812 13:19:21.708449 1223708 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.service
	I0812 13:19:21.724206 1223708 ssh_runner.go:195] Run: sudo systemctl disable cri-docker.socket
	I0812 13:19:21.825264 1223708 ssh_runner.go:195] Run: sudo systemctl mask cri-docker.service
	I0812 13:19:21.928540 1223708 docker.go:233] disabling docker service ...
	I0812 13:19:21.928657 1223708 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket
	I0812 13:19:21.953457 1223708 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service
	I0812 13:19:21.966954 1223708 ssh_runner.go:195] Run: sudo systemctl disable docker.socket
	I0812 13:19:22.073518 1223708 ssh_runner.go:195] Run: sudo systemctl mask docker.service
	I0812 13:19:22.205432 1223708 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker
	I0812 13:19:22.224489 1223708 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %!s(MISSING) "runtime-endpoint: unix:///run/containerd/containerd.sock
	" | sudo tee /etc/crictl.yaml"
	I0812 13:19:22.242809 1223708 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)sandbox_image = .*$|\1sandbox_image = "registry.k8s.io/pause:3.9"|' /etc/containerd/config.toml"
	I0812 13:19:22.254026 1223708 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)restrict_oom_score_adj = .*$|\1restrict_oom_score_adj = false|' /etc/containerd/config.toml"
	I0812 13:19:22.266390 1223708 containerd.go:146] configuring containerd to use "cgroupfs" as cgroup driver...
	I0812 13:19:22.266458 1223708 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)SystemdCgroup = .*$|\1SystemdCgroup = false|g' /etc/containerd/config.toml"
	I0812 13:19:22.277939 1223708 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runtime.v1.linux"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"
	I0812 13:19:22.289458 1223708 ssh_runner.go:195] Run: sh -c "sudo sed -i '/systemd_cgroup/d' /etc/containerd/config.toml"
	I0812 13:19:22.302072 1223708 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runc.v1"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"
	I0812 13:19:22.319140 1223708 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"
	I0812 13:19:22.337958 1223708 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)conf_dir = .*$|\1conf_dir = "/etc/cni/net.d"|g' /etc/containerd/config.toml"
	I0812 13:19:22.356176 1223708 ssh_runner.go:195] Run: sh -c "sudo sed -i '/^ *enable_unprivileged_ports = .*/d' /etc/containerd/config.toml"
	I0812 13:19:22.375614 1223708 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)\[plugins."io.containerd.grpc.v1.cri"\]|&\n\1  enable_unprivileged_ports = true|' /etc/containerd/config.toml"
	I0812 13:19:22.387693 1223708 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
	I0812 13:19:22.398892 1223708 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
	I0812 13:19:22.408912 1223708 ssh_runner.go:195] Run: sudo systemctl daemon-reload
	I0812 13:19:22.535844 1223708 ssh_runner.go:195] Run: sudo systemctl restart containerd
	I0812 13:19:22.748177 1223708 start.go:542] Will wait 60s for socket path /run/containerd/containerd.sock
	I0812 13:19:22.748254 1223708 ssh_runner.go:195] Run: stat /run/containerd/containerd.sock
	I0812 13:19:22.752571 1223708 start.go:563] Will wait 60s for crictl version
	I0812 13:19:22.752635 1223708 ssh_runner.go:195] Run: which crictl
	I0812 13:19:22.756492 1223708 ssh_runner.go:195] Run: sudo /usr/bin/crictl version
	I0812 13:19:22.816928 1223708 start.go:579] Version:  0.1.0
	RuntimeName:  containerd
	RuntimeVersion:  1.7.19
	RuntimeApiVersion:  v1
	I0812 13:19:22.817004 1223708 ssh_runner.go:195] Run: containerd --version
	I0812 13:19:22.858134 1223708 ssh_runner.go:195] Run: containerd --version
	I0812 13:19:22.884346 1223708 out.go:177] * Preparing Kubernetes v1.30.3 on containerd 1.7.19 ...
	
	
	==> container status <==
	CONTAINER           IMAGE               CREATED             STATE               NAME                        ATTEMPT             POD ID              POD
	68c5b6ed9f1cb       523cad1a4df73       2 minutes ago       Exited              dashboard-metrics-scraper   5                   2b01b3b95ebd8       dashboard-metrics-scraper-8d5bb5db8-6w7h6
	b8ecac9f4ddfb       ba04bb24b9575       5 minutes ago       Running             storage-provisioner         2                   ac7389f3358f4       storage-provisioner
	19e7d460788a0       20b332c9a70d8       5 minutes ago       Running             kubernetes-dashboard        0                   06abba147c815       kubernetes-dashboard-cd95d586-l4krc
	8f03aa2de5666       1611cd07b61d5       5 minutes ago       Running             busybox                     1                   772ddc44f1ac1       busybox
	d01d8e8aeec0f       db91994f4ee8f       5 minutes ago       Running             coredns                     1                   9bcdcae6833bb       coredns-74ff55c5b-wcjn8
	2924918d73f93       ba04bb24b9575       5 minutes ago       Exited              storage-provisioner         1                   ac7389f3358f4       storage-provisioner
	6f8e38e073e11       d5e283bc63d43       5 minutes ago       Running             kindnet-cni                 1                   7bc04ae9576ab       kindnet-m988p
	2af20ac6f2602       25a5233254979       5 minutes ago       Running             kube-proxy                  1                   5ff5b0d4b80e3       kube-proxy-n52m2
	533139b834baf       1df8a2b116bd1       5 minutes ago       Running             kube-controller-manager     1                   2cc8d87260f42       kube-controller-manager-old-k8s-version-112335
	b27ed17bf7551       e7605f88f17d6       5 minutes ago       Running             kube-scheduler              1                   b4732ac31ab8d       kube-scheduler-old-k8s-version-112335
	8cc926d2c577f       05b738aa1bc63       5 minutes ago       Running             etcd                        1                   b8e7d249672bc       etcd-old-k8s-version-112335
	e4cf465775a34       2c08bbbc02d3a       5 minutes ago       Running             kube-apiserver              1                   f4cc3d1dc0ee6       kube-apiserver-old-k8s-version-112335
	9d307a9137a58       1611cd07b61d5       6 minutes ago       Exited              busybox                     0                   58ea0abdad443       busybox
	7f8e543bcce0c       db91994f4ee8f       8 minutes ago       Exited              coredns                     0                   ca97d00987759       coredns-74ff55c5b-wcjn8
	162b80fe4af51       d5e283bc63d43       8 minutes ago       Exited              kindnet-cni                 0                   c8d7047e2bd31       kindnet-m988p
	e6326fb96d89e       25a5233254979       8 minutes ago       Exited              kube-proxy                  0                   3c672eb3e9a65       kube-proxy-n52m2
	7b67a4fc117cb       e7605f88f17d6       8 minutes ago       Exited              kube-scheduler              0                   ee7fcdc7775e1       kube-scheduler-old-k8s-version-112335
	8dc43146b8eec       1df8a2b116bd1       8 minutes ago       Exited              kube-controller-manager     0                   684c673749250       kube-controller-manager-old-k8s-version-112335
	bf352ab2c17cc       2c08bbbc02d3a       8 minutes ago       Exited              kube-apiserver              0                   8d7717dccd624       kube-apiserver-old-k8s-version-112335
	39f629658753d       05b738aa1bc63       8 minutes ago       Exited              etcd                        0                   336c917e9c307       etcd-old-k8s-version-112335
	
	
	==> containerd <==
	Aug 12 13:15:23 old-k8s-version-112335 containerd[572]: time="2024-08-12T13:15:23.372797396Z" level=info msg="trying next host" error="failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.85.1:53: no such host" host=fake.domain
	Aug 12 13:15:23 old-k8s-version-112335 containerd[572]: time="2024-08-12T13:15:23.374215651Z" level=error msg="PullImage \"fake.domain/registry.k8s.io/echoserver:1.4\" failed" error="failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.85.1:53: no such host"
	Aug 12 13:15:23 old-k8s-version-112335 containerd[572]: time="2024-08-12T13:15:23.374417574Z" level=info msg="stop pulling image fake.domain/registry.k8s.io/echoserver:1.4: active requests=0, bytes read=0"
	Aug 12 13:15:35 old-k8s-version-112335 containerd[572]: time="2024-08-12T13:15:35.365600868Z" level=info msg="CreateContainer within sandbox \"2b01b3b95ebd88019b025a79a80fb0b9ed53d0bd3692eadafb534f3c96b19535\" for container name:\"dashboard-metrics-scraper\" attempt:4"
	Aug 12 13:15:35 old-k8s-version-112335 containerd[572]: time="2024-08-12T13:15:35.386471783Z" level=info msg="CreateContainer within sandbox \"2b01b3b95ebd88019b025a79a80fb0b9ed53d0bd3692eadafb534f3c96b19535\" for name:\"dashboard-metrics-scraper\" attempt:4 returns container id \"e4988cc5cd6fa7c427fe603d387ff6893bd571b3076d59802cab5503ca990f6b\""
	Aug 12 13:15:35 old-k8s-version-112335 containerd[572]: time="2024-08-12T13:15:35.389092027Z" level=info msg="StartContainer for \"e4988cc5cd6fa7c427fe603d387ff6893bd571b3076d59802cab5503ca990f6b\""
	Aug 12 13:15:35 old-k8s-version-112335 containerd[572]: time="2024-08-12T13:15:35.473732879Z" level=info msg="StartContainer for \"e4988cc5cd6fa7c427fe603d387ff6893bd571b3076d59802cab5503ca990f6b\" returns successfully"
	Aug 12 13:15:35 old-k8s-version-112335 containerd[572]: time="2024-08-12T13:15:35.502467142Z" level=info msg="shim disconnected" id=e4988cc5cd6fa7c427fe603d387ff6893bd571b3076d59802cab5503ca990f6b namespace=k8s.io
	Aug 12 13:15:35 old-k8s-version-112335 containerd[572]: time="2024-08-12T13:15:35.502527096Z" level=warning msg="cleaning up after shim disconnected" id=e4988cc5cd6fa7c427fe603d387ff6893bd571b3076d59802cab5503ca990f6b namespace=k8s.io
	Aug 12 13:15:35 old-k8s-version-112335 containerd[572]: time="2024-08-12T13:15:35.502537204Z" level=info msg="cleaning up dead shim" namespace=k8s.io
	Aug 12 13:15:36 old-k8s-version-112335 containerd[572]: time="2024-08-12T13:15:36.143577310Z" level=info msg="RemoveContainer for \"9c22676f48cd704956a105e279eb338e2fe2de55ed9dc566068b4079d0715f16\""
	Aug 12 13:15:36 old-k8s-version-112335 containerd[572]: time="2024-08-12T13:15:36.150221398Z" level=info msg="RemoveContainer for \"9c22676f48cd704956a105e279eb338e2fe2de55ed9dc566068b4079d0715f16\" returns successfully"
	Aug 12 13:16:46 old-k8s-version-112335 containerd[572]: time="2024-08-12T13:16:46.357218453Z" level=info msg="PullImage \"fake.domain/registry.k8s.io/echoserver:1.4\""
	Aug 12 13:16:46 old-k8s-version-112335 containerd[572]: time="2024-08-12T13:16:46.362719906Z" level=info msg="trying next host" error="failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.85.1:53: no such host" host=fake.domain
	Aug 12 13:16:46 old-k8s-version-112335 containerd[572]: time="2024-08-12T13:16:46.364111486Z" level=error msg="PullImage \"fake.domain/registry.k8s.io/echoserver:1.4\" failed" error="failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.85.1:53: no such host"
	Aug 12 13:16:46 old-k8s-version-112335 containerd[572]: time="2024-08-12T13:16:46.364220858Z" level=info msg="stop pulling image fake.domain/registry.k8s.io/echoserver:1.4: active requests=0, bytes read=0"
	Aug 12 13:17:07 old-k8s-version-112335 containerd[572]: time="2024-08-12T13:17:07.360812935Z" level=info msg="CreateContainer within sandbox \"2b01b3b95ebd88019b025a79a80fb0b9ed53d0bd3692eadafb534f3c96b19535\" for container name:\"dashboard-metrics-scraper\" attempt:5"
	Aug 12 13:17:07 old-k8s-version-112335 containerd[572]: time="2024-08-12T13:17:07.383770692Z" level=info msg="CreateContainer within sandbox \"2b01b3b95ebd88019b025a79a80fb0b9ed53d0bd3692eadafb534f3c96b19535\" for name:\"dashboard-metrics-scraper\" attempt:5 returns container id \"68c5b6ed9f1cbab202b567a4ae06e4e8166d16f5b90ede71a00a03007d5990ac\""
	Aug 12 13:17:07 old-k8s-version-112335 containerd[572]: time="2024-08-12T13:17:07.384494161Z" level=info msg="StartContainer for \"68c5b6ed9f1cbab202b567a4ae06e4e8166d16f5b90ede71a00a03007d5990ac\""
	Aug 12 13:17:07 old-k8s-version-112335 containerd[572]: time="2024-08-12T13:17:07.460696237Z" level=info msg="StartContainer for \"68c5b6ed9f1cbab202b567a4ae06e4e8166d16f5b90ede71a00a03007d5990ac\" returns successfully"
	Aug 12 13:17:07 old-k8s-version-112335 containerd[572]: time="2024-08-12T13:17:07.493344605Z" level=info msg="shim disconnected" id=68c5b6ed9f1cbab202b567a4ae06e4e8166d16f5b90ede71a00a03007d5990ac namespace=k8s.io
	Aug 12 13:17:07 old-k8s-version-112335 containerd[572]: time="2024-08-12T13:17:07.493449119Z" level=warning msg="cleaning up after shim disconnected" id=68c5b6ed9f1cbab202b567a4ae06e4e8166d16f5b90ede71a00a03007d5990ac namespace=k8s.io
	Aug 12 13:17:07 old-k8s-version-112335 containerd[572]: time="2024-08-12T13:17:07.493484893Z" level=info msg="cleaning up dead shim" namespace=k8s.io
	Aug 12 13:17:08 old-k8s-version-112335 containerd[572]: time="2024-08-12T13:17:08.463481243Z" level=info msg="RemoveContainer for \"e4988cc5cd6fa7c427fe603d387ff6893bd571b3076d59802cab5503ca990f6b\""
	Aug 12 13:17:08 old-k8s-version-112335 containerd[572]: time="2024-08-12T13:17:08.469183381Z" level=info msg="RemoveContainer for \"e4988cc5cd6fa7c427fe603d387ff6893bd571b3076d59802cab5503ca990f6b\" returns successfully"
	
	
	==> coredns [7f8e543bcce0c03b365394bc942dab039d350b1340f5856f43b90551a5645f67] <==
	.:53
	[INFO] plugin/reload: Running configuration MD5 = 093a0bf1423dd8c4eee62372bb216168
	CoreDNS-1.7.0
	linux/arm64, go1.14.4, f59c03d
	[INFO] 127.0.0.1:59226 - 10539 "HINFO IN 3518431529806439663.7230155240604307572. udp 57 false 512" NXDOMAIN qr,rd,ra 57 0.025156011s
	
	
	==> coredns [d01d8e8aeec0f477f1c58244a66d7f7b8fb10d090d3d987c0469a55648945b18] <==
	.:53
	[INFO] plugin/reload: Running configuration MD5 = 093a0bf1423dd8c4eee62372bb216168
	CoreDNS-1.7.0
	linux/arm64, go1.14.4, f59c03d
	[INFO] 127.0.0.1:54039 - 1853 "HINFO IN 5070659610878553415.3187851474976594331. udp 57 false 512" NXDOMAIN qr,rd,ra 57 0.030739129s
	
	
	==> describe nodes <==
	Name:               old-k8s-version-112335
	Roles:              control-plane,master
	Labels:             beta.kubernetes.io/arch=arm64
	                    beta.kubernetes.io/os=linux
	                    kubernetes.io/arch=arm64
	                    kubernetes.io/hostname=old-k8s-version-112335
	                    kubernetes.io/os=linux
	                    minikube.k8s.io/commit=799e8a7dafc4266c6fcf08e799ac850effb94bc5
	                    minikube.k8s.io/name=old-k8s-version-112335
	                    minikube.k8s.io/primary=true
	                    minikube.k8s.io/updated_at=2024_08_12T13_10_49_0700
	                    minikube.k8s.io/version=v1.33.1
	                    node-role.kubernetes.io/control-plane=
	                    node-role.kubernetes.io/master=
	Annotations:        kubeadm.alpha.kubernetes.io/cri-socket: /run/containerd/containerd.sock
	                    node.alpha.kubernetes.io/ttl: 0
	                    volumes.kubernetes.io/controller-managed-attach-detach: true
	CreationTimestamp:  Mon, 12 Aug 2024 13:10:46 +0000
	Taints:             <none>
	Unschedulable:      false
	Lease:
	  HolderIdentity:  old-k8s-version-112335
	  AcquireTime:     <unset>
	  RenewTime:       Mon, 12 Aug 2024 13:19:18 +0000
	Conditions:
	  Type             Status  LastHeartbeatTime                 LastTransitionTime                Reason                       Message
	  ----             ------  -----------------                 ------------------                ------                       -------
	  MemoryPressure   False   Mon, 12 Aug 2024 13:14:26 +0000   Mon, 12 Aug 2024 13:10:39 +0000   KubeletHasSufficientMemory   kubelet has sufficient memory available
	  DiskPressure     False   Mon, 12 Aug 2024 13:14:26 +0000   Mon, 12 Aug 2024 13:10:39 +0000   KubeletHasNoDiskPressure     kubelet has no disk pressure
	  PIDPressure      False   Mon, 12 Aug 2024 13:14:26 +0000   Mon, 12 Aug 2024 13:10:39 +0000   KubeletHasSufficientPID      kubelet has sufficient PID available
	  Ready            True    Mon, 12 Aug 2024 13:14:26 +0000   Mon, 12 Aug 2024 13:11:04 +0000   KubeletReady                 kubelet is posting ready status
	Addresses:
	  InternalIP:  192.168.85.2
	  Hostname:    old-k8s-version-112335
	Capacity:
	  cpu:                2
	  ephemeral-storage:  203034800Ki
	  hugepages-1Gi:      0
	  hugepages-2Mi:      0
	  hugepages-32Mi:     0
	  hugepages-64Ki:     0
	  memory:             8022360Ki
	  pods:               110
	Allocatable:
	  cpu:                2
	  ephemeral-storage:  203034800Ki
	  hugepages-1Gi:      0
	  hugepages-2Mi:      0
	  hugepages-32Mi:     0
	  hugepages-64Ki:     0
	  memory:             8022360Ki
	  pods:               110
	System Info:
	  Machine ID:                 b5164a0f120b463dbd9b8095de6c7d22
	  System UUID:                4b42a20d-9e4b-4d42-bc90-8deeac67c234
	  Boot ID:                    dd4d5961-e962-479e-810d-640f3b509a00
	  Kernel Version:             5.15.0-1066-aws
	  OS Image:                   Ubuntu 22.04.4 LTS
	  Operating System:           linux
	  Architecture:               arm64
	  Container Runtime Version:  containerd://1.7.19
	  Kubelet Version:            v1.20.0
	  Kube-Proxy Version:         v1.20.0
	PodCIDR:                      10.244.0.0/24
	PodCIDRs:                     10.244.0.0/24
	Non-terminated Pods:          (12 in total)
	  Namespace                   Name                                              CPU Requests  CPU Limits  Memory Requests  Memory Limits  AGE
	  ---------                   ----                                              ------------  ----------  ---------------  -------------  ---
	  default                     busybox                                           0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         6m42s
	  kube-system                 coredns-74ff55c5b-wcjn8                           100m (5%!)(MISSING)     0 (0%!)(MISSING)      70Mi (0%!)(MISSING)        170Mi (2%!)(MISSING)     8m20s
	  kube-system                 etcd-old-k8s-version-112335                       100m (5%!)(MISSING)     0 (0%!)(MISSING)      100Mi (1%!)(MISSING)       0 (0%!)(MISSING)         8m27s
	  kube-system                 kindnet-m988p                                     100m (5%!)(MISSING)     100m (5%!)(MISSING)   50Mi (0%!)(MISSING)        50Mi (0%!)(MISSING)      8m20s
	  kube-system                 kube-apiserver-old-k8s-version-112335             250m (12%!)(MISSING)    0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         8m27s
	  kube-system                 kube-controller-manager-old-k8s-version-112335    200m (10%!)(MISSING)    0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         8m27s
	  kube-system                 kube-proxy-n52m2                                  0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         8m20s
	  kube-system                 kube-scheduler-old-k8s-version-112335             100m (5%!)(MISSING)     0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         8m27s
	  kube-system                 metrics-server-9975d5f86-v2prr                    100m (5%!)(MISSING)     0 (0%!)(MISSING)      200Mi (2%!)(MISSING)       0 (0%!)(MISSING)         6m31s
	  kube-system                 storage-provisioner                               0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         8m18s
	  kubernetes-dashboard        dashboard-metrics-scraper-8d5bb5db8-6w7h6         0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         5m29s
	  kubernetes-dashboard        kubernetes-dashboard-cd95d586-l4krc               0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         5m29s
	Allocated resources:
	  (Total limits may be over 100 percent, i.e., overcommitted.)
	  Resource           Requests    Limits
	  --------           --------    ------
	  cpu                950m (47%!)(MISSING)  100m (5%!)(MISSING)
	  memory             420Mi (5%!)(MISSING)  220Mi (2%!)(MISSING)
	  ephemeral-storage  100Mi (0%!)(MISSING)  0 (0%!)(MISSING)
	  hugepages-1Gi      0 (0%!)(MISSING)      0 (0%!)(MISSING)
	  hugepages-2Mi      0 (0%!)(MISSING)      0 (0%!)(MISSING)
	  hugepages-32Mi     0 (0%!)(MISSING)      0 (0%!)(MISSING)
	  hugepages-64Ki     0 (0%!)(MISSING)      0 (0%!)(MISSING)
	Events:
	  Type    Reason                   Age                    From        Message
	  ----    ------                   ----                   ----        -------
	  Normal  NodeHasSufficientMemory  8m47s (x5 over 8m47s)  kubelet     Node old-k8s-version-112335 status is now: NodeHasSufficientMemory
	  Normal  NodeHasNoDiskPressure    8m47s (x4 over 8m47s)  kubelet     Node old-k8s-version-112335 status is now: NodeHasNoDiskPressure
	  Normal  Starting                 8m27s                  kubelet     Starting kubelet.
	  Normal  NodeHasSufficientMemory  8m27s                  kubelet     Node old-k8s-version-112335 status is now: NodeHasSufficientMemory
	  Normal  NodeHasNoDiskPressure    8m27s                  kubelet     Node old-k8s-version-112335 status is now: NodeHasNoDiskPressure
	  Normal  NodeHasSufficientPID     8m27s                  kubelet     Node old-k8s-version-112335 status is now: NodeHasSufficientPID
	  Normal  NodeAllocatableEnforced  8m27s                  kubelet     Updated Node Allocatable limit across pods
	  Normal  NodeReady                8m20s                  kubelet     Node old-k8s-version-112335 status is now: NodeReady
	  Normal  Starting                 8m19s                  kube-proxy  Starting kube-proxy.
	  Normal  Starting                 6m1s                   kubelet     Starting kubelet.
	  Normal  NodeHasSufficientMemory  6m1s (x8 over 6m1s)    kubelet     Node old-k8s-version-112335 status is now: NodeHasSufficientMemory
	  Normal  NodeHasNoDiskPressure    6m1s (x8 over 6m1s)    kubelet     Node old-k8s-version-112335 status is now: NodeHasNoDiskPressure
	  Normal  NodeHasSufficientPID     6m1s (x7 over 6m1s)    kubelet     Node old-k8s-version-112335 status is now: NodeHasSufficientPID
	  Normal  NodeAllocatableEnforced  6m1s                   kubelet     Updated Node Allocatable limit across pods
	  Normal  Starting                 5m45s                  kube-proxy  Starting kube-proxy.
	
	
	==> dmesg <==
	[  +0.000985] FS-Cache: O-key=[8] 'f372ed0000000000'
	[  +0.000699] FS-Cache: N-cookie c=00000042 [p=00000039 fl=2 nc=0 na=1]
	[  +0.000883] FS-Cache: N-cookie d=0000000036654dfe{9p.inode} n=000000005ed15f93
	[  +0.000983] FS-Cache: N-key=[8] 'f372ed0000000000'
	[  +0.002760] FS-Cache: Duplicate cookie detected
	[  +0.000642] FS-Cache: O-cookie c=0000003c [p=00000039 fl=226 nc=0 na=1]
	[  +0.000913] FS-Cache: O-cookie d=0000000036654dfe{9p.inode} n=0000000014a93604
	[  +0.000984] FS-Cache: O-key=[8] 'f372ed0000000000'
	[  +0.000688] FS-Cache: N-cookie c=00000043 [p=00000039 fl=2 nc=0 na=1]
	[  +0.000878] FS-Cache: N-cookie d=0000000036654dfe{9p.inode} n=00000000893bf24b
	[  +0.000976] FS-Cache: N-key=[8] 'f372ed0000000000'
	[  +1.910512] FS-Cache: Duplicate cookie detected
	[  +0.000688] FS-Cache: O-cookie c=0000003a [p=00000039 fl=226 nc=0 na=1]
	[  +0.000948] FS-Cache: O-cookie d=0000000036654dfe{9p.inode} n=000000003708f28c
	[  +0.001015] FS-Cache: O-key=[8] 'f272ed0000000000'
	[  +0.000728] FS-Cache: N-cookie c=00000045 [p=00000039 fl=2 nc=0 na=1]
	[  +0.000928] FS-Cache: N-cookie d=0000000036654dfe{9p.inode} n=00000000ea862a11
	[  +0.001047] FS-Cache: N-key=[8] 'f272ed0000000000'
	[  +0.294687] FS-Cache: Duplicate cookie detected
	[  +0.000664] FS-Cache: O-cookie c=0000003f [p=00000039 fl=226 nc=0 na=1]
	[  +0.000904] FS-Cache: O-cookie d=0000000036654dfe{9p.inode} n=00000000747711bd
	[  +0.001004] FS-Cache: O-key=[8] 'f872ed0000000000'
	[  +0.000673] FS-Cache: N-cookie c=00000046 [p=00000039 fl=2 nc=0 na=1]
	[  +0.000920] FS-Cache: N-cookie d=0000000036654dfe{9p.inode} n=000000005ed15f93
	[  +0.000991] FS-Cache: N-key=[8] 'f872ed0000000000'
	
	
	==> etcd [39f629658753d4fd7ceceee2f8ec0ffc8c98db08a6b70240ea91f87cd6dcee03] <==
	raft2024/08/12 13:10:39 INFO: 9f0758e1c58a86ed became candidate at term 2
	raft2024/08/12 13:10:39 INFO: 9f0758e1c58a86ed received MsgVoteResp from 9f0758e1c58a86ed at term 2
	raft2024/08/12 13:10:39 INFO: 9f0758e1c58a86ed became leader at term 2
	raft2024/08/12 13:10:39 INFO: raft.node: 9f0758e1c58a86ed elected leader 9f0758e1c58a86ed at term 2
	2024-08-12 13:10:39.538418 I | etcdserver: published {Name:old-k8s-version-112335 ClientURLs:[https://192.168.85.2:2379]} to cluster 68eaea490fab4e05
	2024-08-12 13:10:39.538810 I | embed: ready to serve client requests
	2024-08-12 13:10:39.540877 I | embed: serving client requests on 127.0.0.1:2379
	2024-08-12 13:10:39.541099 I | etcdserver: setting up the initial cluster version to 3.4
	2024-08-12 13:10:39.545795 N | etcdserver/membership: set the initial cluster version to 3.4
	2024-08-12 13:10:39.547475 I | embed: ready to serve client requests
	2024-08-12 13:10:39.549869 I | embed: serving client requests on 192.168.85.2:2379
	2024-08-12 13:10:39.580079 I | etcdserver/api: enabled capabilities for version 3.4
	2024-08-12 13:10:57.838189 I | etcdserver/api/etcdhttp: /health OK (status code 200)
	2024-08-12 13:11:01.156475 I | etcdserver/api/etcdhttp: /health OK (status code 200)
	2024-08-12 13:11:11.156660 I | etcdserver/api/etcdhttp: /health OK (status code 200)
	2024-08-12 13:11:21.156521 I | etcdserver/api/etcdhttp: /health OK (status code 200)
	2024-08-12 13:11:31.156788 I | etcdserver/api/etcdhttp: /health OK (status code 200)
	2024-08-12 13:11:41.156453 I | etcdserver/api/etcdhttp: /health OK (status code 200)
	2024-08-12 13:11:51.156653 I | etcdserver/api/etcdhttp: /health OK (status code 200)
	2024-08-12 13:12:01.156544 I | etcdserver/api/etcdhttp: /health OK (status code 200)
	2024-08-12 13:12:11.156551 I | etcdserver/api/etcdhttp: /health OK (status code 200)
	2024-08-12 13:12:21.156634 I | etcdserver/api/etcdhttp: /health OK (status code 200)
	2024-08-12 13:12:31.156870 I | etcdserver/api/etcdhttp: /health OK (status code 200)
	2024-08-12 13:12:41.156629 I | etcdserver/api/etcdhttp: /health OK (status code 200)
	2024-08-12 13:12:51.157523 I | etcdserver/api/etcdhttp: /health OK (status code 200)
	
	
	==> etcd [8cc926d2c577f511b103d70b73314019d0ec31451c321551981ab0306c91088f] <==
	2024-08-12 13:15:20.456363 I | etcdserver/api/etcdhttp: /health OK (status code 200)
	2024-08-12 13:15:30.455908 I | etcdserver/api/etcdhttp: /health OK (status code 200)
	2024-08-12 13:15:40.455898 I | etcdserver/api/etcdhttp: /health OK (status code 200)
	2024-08-12 13:15:50.455868 I | etcdserver/api/etcdhttp: /health OK (status code 200)
	2024-08-12 13:16:00.456852 I | etcdserver/api/etcdhttp: /health OK (status code 200)
	2024-08-12 13:16:10.455927 I | etcdserver/api/etcdhttp: /health OK (status code 200)
	2024-08-12 13:16:20.455912 I | etcdserver/api/etcdhttp: /health OK (status code 200)
	2024-08-12 13:16:30.456029 I | etcdserver/api/etcdhttp: /health OK (status code 200)
	2024-08-12 13:16:40.455825 I | etcdserver/api/etcdhttp: /health OK (status code 200)
	2024-08-12 13:16:50.455874 I | etcdserver/api/etcdhttp: /health OK (status code 200)
	2024-08-12 13:17:00.456345 I | etcdserver/api/etcdhttp: /health OK (status code 200)
	2024-08-12 13:17:10.455853 I | etcdserver/api/etcdhttp: /health OK (status code 200)
	2024-08-12 13:17:20.455883 I | etcdserver/api/etcdhttp: /health OK (status code 200)
	2024-08-12 13:17:30.455951 I | etcdserver/api/etcdhttp: /health OK (status code 200)
	2024-08-12 13:17:40.455783 I | etcdserver/api/etcdhttp: /health OK (status code 200)
	2024-08-12 13:17:50.456039 I | etcdserver/api/etcdhttp: /health OK (status code 200)
	2024-08-12 13:18:00.456022 I | etcdserver/api/etcdhttp: /health OK (status code 200)
	2024-08-12 13:18:10.455920 I | etcdserver/api/etcdhttp: /health OK (status code 200)
	2024-08-12 13:18:20.455958 I | etcdserver/api/etcdhttp: /health OK (status code 200)
	2024-08-12 13:18:30.455902 I | etcdserver/api/etcdhttp: /health OK (status code 200)
	2024-08-12 13:18:40.456018 I | etcdserver/api/etcdhttp: /health OK (status code 200)
	2024-08-12 13:18:50.456005 I | etcdserver/api/etcdhttp: /health OK (status code 200)
	2024-08-12 13:19:00.456206 I | etcdserver/api/etcdhttp: /health OK (status code 200)
	2024-08-12 13:19:10.458078 I | etcdserver/api/etcdhttp: /health OK (status code 200)
	2024-08-12 13:19:20.455998 I | etcdserver/api/etcdhttp: /health OK (status code 200)
	
	
	==> kernel <==
	 13:19:24 up  5:01,  0 users,  load average: 1.48, 2.04, 2.50
	Linux old-k8s-version-112335 5.15.0-1066-aws #72~20.04.1-Ubuntu SMP Sat Jul 20 07:44:07 UTC 2024 aarch64 aarch64 aarch64 GNU/Linux
	PRETTY_NAME="Ubuntu 22.04.4 LTS"
	
	
	==> kindnet [162b80fe4af51619d233d78c0c67ed2c8e6f24d40ec23dd44a431d1b76caed13] <==
	E0812 13:11:44.543614       1 reflector.go:150] pkg/mod/k8s.io/client-go@v0.30.3/tools/cache/reflector.go:232: Failed to watch *v1.Pod: failed to list *v1.Pod: pods is forbidden: User "system:serviceaccount:kube-system:kindnet" cannot list resource "pods" in API group "" at the cluster scope
	W0812 13:11:47.270135       1 reflector.go:547] pkg/mod/k8s.io/client-go@v0.30.3/tools/cache/reflector.go:232: failed to list *v1.NetworkPolicy: networkpolicies.networking.k8s.io is forbidden: User "system:serviceaccount:kube-system:kindnet" cannot list resource "networkpolicies" in API group "networking.k8s.io" at the cluster scope
	E0812 13:11:47.270170       1 reflector.go:150] pkg/mod/k8s.io/client-go@v0.30.3/tools/cache/reflector.go:232: Failed to watch *v1.NetworkPolicy: failed to list *v1.NetworkPolicy: networkpolicies.networking.k8s.io is forbidden: User "system:serviceaccount:kube-system:kindnet" cannot list resource "networkpolicies" in API group "networking.k8s.io" at the cluster scope
	I0812 13:11:49.262188       1 main.go:295] Handling node with IPs: map[192.168.85.2:{}]
	I0812 13:11:49.262229       1 main.go:299] handling current node
	W0812 13:11:54.363357       1 reflector.go:547] pkg/mod/k8s.io/client-go@v0.30.3/tools/cache/reflector.go:232: failed to list *v1.Namespace: namespaces is forbidden: User "system:serviceaccount:kube-system:kindnet" cannot list resource "namespaces" in API group "" at the cluster scope
	E0812 13:11:54.363392       1 reflector.go:150] pkg/mod/k8s.io/client-go@v0.30.3/tools/cache/reflector.go:232: Failed to watch *v1.Namespace: failed to list *v1.Namespace: namespaces is forbidden: User "system:serviceaccount:kube-system:kindnet" cannot list resource "namespaces" in API group "" at the cluster scope
	I0812 13:11:59.262948       1 main.go:295] Handling node with IPs: map[192.168.85.2:{}]
	I0812 13:11:59.262987       1 main.go:299] handling current node
	I0812 13:12:09.262903       1 main.go:295] Handling node with IPs: map[192.168.85.2:{}]
	I0812 13:12:09.262939       1 main.go:299] handling current node
	I0812 13:12:19.262398       1 main.go:295] Handling node with IPs: map[192.168.85.2:{}]
	I0812 13:12:19.262433       1 main.go:299] handling current node
	W0812 13:12:24.941897       1 reflector.go:547] pkg/mod/k8s.io/client-go@v0.30.3/tools/cache/reflector.go:232: failed to list *v1.Pod: pods is forbidden: User "system:serviceaccount:kube-system:kindnet" cannot list resource "pods" in API group "" at the cluster scope
	E0812 13:12:24.941934       1 reflector.go:150] pkg/mod/k8s.io/client-go@v0.30.3/tools/cache/reflector.go:232: Failed to watch *v1.Pod: failed to list *v1.Pod: pods is forbidden: User "system:serviceaccount:kube-system:kindnet" cannot list resource "pods" in API group "" at the cluster scope
	I0812 13:12:29.262422       1 main.go:295] Handling node with IPs: map[192.168.85.2:{}]
	I0812 13:12:29.262460       1 main.go:299] handling current node
	W0812 13:12:32.273487       1 reflector.go:547] pkg/mod/k8s.io/client-go@v0.30.3/tools/cache/reflector.go:232: failed to list *v1.NetworkPolicy: networkpolicies.networking.k8s.io is forbidden: User "system:serviceaccount:kube-system:kindnet" cannot list resource "networkpolicies" in API group "networking.k8s.io" at the cluster scope
	E0812 13:12:32.273522       1 reflector.go:150] pkg/mod/k8s.io/client-go@v0.30.3/tools/cache/reflector.go:232: Failed to watch *v1.NetworkPolicy: failed to list *v1.NetworkPolicy: networkpolicies.networking.k8s.io is forbidden: User "system:serviceaccount:kube-system:kindnet" cannot list resource "networkpolicies" in API group "networking.k8s.io" at the cluster scope
	I0812 13:12:39.262691       1 main.go:295] Handling node with IPs: map[192.168.85.2:{}]
	I0812 13:12:39.262732       1 main.go:299] handling current node
	W0812 13:12:41.214364       1 reflector.go:547] pkg/mod/k8s.io/client-go@v0.30.3/tools/cache/reflector.go:232: failed to list *v1.Namespace: namespaces is forbidden: User "system:serviceaccount:kube-system:kindnet" cannot list resource "namespaces" in API group "" at the cluster scope
	E0812 13:12:41.214419       1 reflector.go:150] pkg/mod/k8s.io/client-go@v0.30.3/tools/cache/reflector.go:232: Failed to watch *v1.Namespace: failed to list *v1.Namespace: namespaces is forbidden: User "system:serviceaccount:kube-system:kindnet" cannot list resource "namespaces" in API group "" at the cluster scope
	I0812 13:12:49.262256       1 main.go:295] Handling node with IPs: map[192.168.85.2:{}]
	I0812 13:12:49.263101       1 main.go:299] handling current node
	
	
	==> kindnet [6f8e38e073e1197c4df808103d10e92b26179a23da02465137f194bb4e1b5dfe] <==
	E0812 13:18:18.311569       1 reflector.go:150] pkg/mod/k8s.io/client-go@v0.30.3/tools/cache/reflector.go:232: Failed to watch *v1.Namespace: failed to list *v1.Namespace: namespaces is forbidden: User "system:serviceaccount:kube-system:kindnet" cannot list resource "namespaces" in API group "" at the cluster scope
	I0812 13:18:19.771323       1 main.go:295] Handling node with IPs: map[192.168.85.2:{}]
	I0812 13:18:19.771412       1 main.go:299] handling current node
	I0812 13:18:29.771155       1 main.go:295] Handling node with IPs: map[192.168.85.2:{}]
	I0812 13:18:29.771189       1 main.go:299] handling current node
	I0812 13:18:39.773346       1 main.go:295] Handling node with IPs: map[192.168.85.2:{}]
	I0812 13:18:39.773609       1 main.go:299] handling current node
	W0812 13:18:46.887701       1 reflector.go:547] pkg/mod/k8s.io/client-go@v0.30.3/tools/cache/reflector.go:232: failed to list *v1.NetworkPolicy: networkpolicies.networking.k8s.io is forbidden: User "system:serviceaccount:kube-system:kindnet" cannot list resource "networkpolicies" in API group "networking.k8s.io" at the cluster scope
	E0812 13:18:46.887735       1 reflector.go:150] pkg/mod/k8s.io/client-go@v0.30.3/tools/cache/reflector.go:232: Failed to watch *v1.NetworkPolicy: failed to list *v1.NetworkPolicy: networkpolicies.networking.k8s.io is forbidden: User "system:serviceaccount:kube-system:kindnet" cannot list resource "networkpolicies" in API group "networking.k8s.io" at the cluster scope
	I0812 13:18:49.771226       1 main.go:295] Handling node with IPs: map[192.168.85.2:{}]
	I0812 13:18:49.771260       1 main.go:299] handling current node
	W0812 13:18:52.694696       1 reflector.go:547] pkg/mod/k8s.io/client-go@v0.30.3/tools/cache/reflector.go:232: failed to list *v1.Namespace: namespaces is forbidden: User "system:serviceaccount:kube-system:kindnet" cannot list resource "namespaces" in API group "" at the cluster scope
	E0812 13:18:52.694731       1 reflector.go:150] pkg/mod/k8s.io/client-go@v0.30.3/tools/cache/reflector.go:232: Failed to watch *v1.Namespace: failed to list *v1.Namespace: namespaces is forbidden: User "system:serviceaccount:kube-system:kindnet" cannot list resource "namespaces" in API group "" at the cluster scope
	W0812 13:18:56.702122       1 reflector.go:547] pkg/mod/k8s.io/client-go@v0.30.3/tools/cache/reflector.go:232: failed to list *v1.Pod: pods is forbidden: User "system:serviceaccount:kube-system:kindnet" cannot list resource "pods" in API group "" at the cluster scope
	E0812 13:18:56.702171       1 reflector.go:150] pkg/mod/k8s.io/client-go@v0.30.3/tools/cache/reflector.go:232: Failed to watch *v1.Pod: failed to list *v1.Pod: pods is forbidden: User "system:serviceaccount:kube-system:kindnet" cannot list resource "pods" in API group "" at the cluster scope
	I0812 13:18:59.773446       1 main.go:295] Handling node with IPs: map[192.168.85.2:{}]
	I0812 13:18:59.773479       1 main.go:299] handling current node
	I0812 13:19:09.773382       1 main.go:295] Handling node with IPs: map[192.168.85.2:{}]
	I0812 13:19:09.773414       1 main.go:299] handling current node
	I0812 13:19:19.771574       1 main.go:295] Handling node with IPs: map[192.168.85.2:{}]
	I0812 13:19:19.771686       1 main.go:299] handling current node
	W0812 13:19:22.788812       1 reflector.go:547] pkg/mod/k8s.io/client-go@v0.30.3/tools/cache/reflector.go:232: failed to list *v1.NetworkPolicy: networkpolicies.networking.k8s.io is forbidden: User "system:serviceaccount:kube-system:kindnet" cannot list resource "networkpolicies" in API group "networking.k8s.io" at the cluster scope
	E0812 13:19:22.788916       1 reflector.go:150] pkg/mod/k8s.io/client-go@v0.30.3/tools/cache/reflector.go:232: Failed to watch *v1.NetworkPolicy: failed to list *v1.NetworkPolicy: networkpolicies.networking.k8s.io is forbidden: User "system:serviceaccount:kube-system:kindnet" cannot list resource "networkpolicies" in API group "networking.k8s.io" at the cluster scope
	W0812 13:19:24.577419       1 reflector.go:547] pkg/mod/k8s.io/client-go@v0.30.3/tools/cache/reflector.go:232: failed to list *v1.Namespace: namespaces is forbidden: User "system:serviceaccount:kube-system:kindnet" cannot list resource "namespaces" in API group "" at the cluster scope
	E0812 13:19:24.577453       1 reflector.go:150] pkg/mod/k8s.io/client-go@v0.30.3/tools/cache/reflector.go:232: Failed to watch *v1.Namespace: failed to list *v1.Namespace: namespaces is forbidden: User "system:serviceaccount:kube-system:kindnet" cannot list resource "namespaces" in API group "" at the cluster scope
	
	
	==> kube-apiserver [bf352ab2c17cc4485d3b3f899d758963b292f9829240ec0e4e650d678908e30a] <==
	I0812 13:10:46.820542       1 controller.go:132] OpenAPI AggregationController: action for item : Nothing (removed from the queue).
	I0812 13:10:46.820575       1 controller.go:132] OpenAPI AggregationController: action for item k8s_internal_local_delegation_chain_0000000000: Nothing (removed from the queue).
	I0812 13:10:46.841317       1 storage_scheduling.go:132] created PriorityClass system-node-critical with value 2000001000
	I0812 13:10:46.846604       1 storage_scheduling.go:132] created PriorityClass system-cluster-critical with value 2000000000
	I0812 13:10:46.846632       1 storage_scheduling.go:148] all system priority classes are created successfully or already exist.
	I0812 13:10:47.333331       1 controller.go:606] quota admission added evaluator for: roles.rbac.authorization.k8s.io
	I0812 13:10:47.386719       1 controller.go:606] quota admission added evaluator for: rolebindings.rbac.authorization.k8s.io
	W0812 13:10:47.518499       1 lease.go:233] Resetting endpoints for master service "kubernetes" to [192.168.85.2]
	I0812 13:10:47.519776       1 controller.go:606] quota admission added evaluator for: endpoints
	I0812 13:10:47.525278       1 controller.go:606] quota admission added evaluator for: endpointslices.discovery.k8s.io
	I0812 13:10:48.408888       1 controller.go:606] quota admission added evaluator for: serviceaccounts
	I0812 13:10:48.897446       1 controller.go:606] quota admission added evaluator for: deployments.apps
	I0812 13:10:48.962656       1 controller.go:606] quota admission added evaluator for: daemonsets.apps
	I0812 13:10:57.415750       1 controller.go:606] quota admission added evaluator for: leases.coordination.k8s.io
	I0812 13:11:04.351031       1 controller.go:606] quota admission added evaluator for: controllerrevisions.apps
	I0812 13:11:04.384875       1 controller.go:606] quota admission added evaluator for: replicasets.apps
	I0812 13:11:19.938381       1 client.go:360] parsed scheme: "passthrough"
	I0812 13:11:19.938427       1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379  <nil> 0 <nil>}] <nil> <nil>}
	I0812 13:11:19.938439       1 clientconn.go:948] ClientConn switching balancer to "pick_first"
	I0812 13:11:58.301600       1 client.go:360] parsed scheme: "passthrough"
	I0812 13:11:58.301643       1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379  <nil> 0 <nil>}] <nil> <nil>}
	I0812 13:11:58.301653       1 clientconn.go:948] ClientConn switching balancer to "pick_first"
	I0812 13:12:28.490104       1 client.go:360] parsed scheme: "passthrough"
	I0812 13:12:28.490168       1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379  <nil> 0 <nil>}] <nil> <nil>}
	I0812 13:12:28.490255       1 clientconn.go:948] ClientConn switching balancer to "pick_first"
	
	
	==> kube-apiserver [e4cf465775a34b80fbfbd63dc4f0643c8d6a61c508c1c06d6e58548109c82a20] <==
	I0812 13:16:05.559991       1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379  <nil> 0 <nil>}] <nil> <nil>}
	I0812 13:16:05.560042       1 clientconn.go:948] ClientConn switching balancer to "pick_first"
	W0812 13:16:39.925179       1 handler_proxy.go:102] no RequestInfo found in the context
	E0812 13:16:39.925319       1 controller.go:116] loading OpenAPI spec for "v1beta1.metrics.k8s.io" failed with: failed to retrieve openAPI spec, http error: ResponseCode: 503, Body: service unavailable
	, Header: map[Content-Type:[text/plain; charset=utf-8] X-Content-Type-Options:[nosniff]]
	I0812 13:16:39.925343       1 controller.go:129] OpenAPI AggregationController: action for item v1beta1.metrics.k8s.io: Rate Limited Requeue.
	I0812 13:16:48.080166       1 client.go:360] parsed scheme: "passthrough"
	I0812 13:16:48.080215       1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379  <nil> 0 <nil>}] <nil> <nil>}
	I0812 13:16:48.080224       1 clientconn.go:948] ClientConn switching balancer to "pick_first"
	I0812 13:17:28.821198       1 client.go:360] parsed scheme: "passthrough"
	I0812 13:17:28.821289       1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379  <nil> 0 <nil>}] <nil> <nil>}
	I0812 13:17:28.821298       1 clientconn.go:948] ClientConn switching balancer to "pick_first"
	I0812 13:18:11.727288       1 client.go:360] parsed scheme: "passthrough"
	I0812 13:18:11.727336       1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379  <nil> 0 <nil>}] <nil> <nil>}
	I0812 13:18:11.727346       1 clientconn.go:948] ClientConn switching balancer to "pick_first"
	W0812 13:18:36.350115       1 handler_proxy.go:102] no RequestInfo found in the context
	E0812 13:18:36.350387       1 controller.go:116] loading OpenAPI spec for "v1beta1.metrics.k8s.io" failed with: failed to retrieve openAPI spec, http error: ResponseCode: 503, Body: service unavailable
	, Header: map[Content-Type:[text/plain; charset=utf-8] X-Content-Type-Options:[nosniff]]
	I0812 13:18:36.350406       1 controller.go:129] OpenAPI AggregationController: action for item v1beta1.metrics.k8s.io: Rate Limited Requeue.
	I0812 13:18:46.464323       1 client.go:360] parsed scheme: "passthrough"
	I0812 13:18:46.464368       1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379  <nil> 0 <nil>}] <nil> <nil>}
	I0812 13:18:46.464523       1 clientconn.go:948] ClientConn switching balancer to "pick_first"
	I0812 13:19:19.147294       1 client.go:360] parsed scheme: "passthrough"
	I0812 13:19:19.147401       1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379  <nil> 0 <nil>}] <nil> <nil>}
	I0812 13:19:19.147428       1 clientconn.go:948] ClientConn switching balancer to "pick_first"
	
	
	==> kube-controller-manager [533139b834baffb74463be6b648bfd76085ea1587efa7aa575c1e09af6ee13da] <==
	W0812 13:15:01.184716       1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
	E0812 13:15:28.758187       1 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
	I0812 13:15:32.835263       1 request.go:655] Throttling request took 1.048557552s, request: GET:https://192.168.85.2:8443/apis/events.k8s.io/v1beta1?timeout=32s
	W0812 13:15:33.686541       1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
	E0812 13:15:59.260348       1 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
	I0812 13:16:05.337124       1 request.go:655] Throttling request took 1.048512323s, request: GET:https://192.168.85.2:8443/apis/apiextensions.k8s.io/v1beta1?timeout=32s
	W0812 13:16:06.188598       1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
	E0812 13:16:29.762792       1 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
	I0812 13:16:37.839116       1 request.go:655] Throttling request took 1.048591267s, request: GET:https://192.168.85.2:8443/apis/scheduling.k8s.io/v1?timeout=32s
	W0812 13:16:38.690682       1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
	E0812 13:17:00.311619       1 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
	I0812 13:17:10.341133       1 request.go:655] Throttling request took 1.048231141s, request: GET:https://192.168.85.2:8443/apis/apiextensions.k8s.io/v1beta1?timeout=32s
	W0812 13:17:11.192556       1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
	E0812 13:17:30.813733       1 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
	I0812 13:17:42.843102       1 request.go:655] Throttling request took 1.048530698s, request: GET:https://192.168.85.2:8443/apis/apiextensions.k8s.io/v1?timeout=32s
	W0812 13:17:43.694606       1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
	E0812 13:18:01.315948       1 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
	I0812 13:18:15.345182       1 request.go:655] Throttling request took 1.048440325s, request: GET:https://192.168.85.2:8443/apis/apiextensions.k8s.io/v1beta1?timeout=32s
	W0812 13:18:16.196802       1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
	E0812 13:18:31.818265       1 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
	I0812 13:18:47.847159       1 request.go:655] Throttling request took 1.04837162s, request: GET:https://192.168.85.2:8443/apis/coordination.k8s.io/v1?timeout=32s
	W0812 13:18:48.698598       1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
	E0812 13:19:02.320164       1 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
	I0812 13:19:20.355741       1 request.go:655] Throttling request took 1.049964176s, request: GET:https://192.168.85.2:8443/apis/extensions/v1beta1?timeout=32s
	W0812 13:19:21.205420       1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
	
	
	==> kube-controller-manager [8dc43146b8eece1e84ac23cedd68a17cad2d2457bc209bbe351bbfa0454d1bc2] <==
	I0812 13:11:04.486399       1 shared_informer.go:247] Caches are synced for attach detach 
	I0812 13:11:04.503285       1 event.go:291] "Event occurred" object="kube-system/coredns-74ff55c5b" kind="ReplicaSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: coredns-74ff55c5b-t78fq"
	I0812 13:11:04.506484       1 event.go:291] "Event occurred" object="kube-system/kindnet" kind="DaemonSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: kindnet-m988p"
	I0812 13:11:04.600917       1 shared_informer.go:247] Caches are synced for persistent volume 
	I0812 13:11:04.604263       1 shared_informer.go:247] Caches are synced for resource quota 
	I0812 13:11:04.607704       1 shared_informer.go:247] Caches are synced for disruption 
	I0812 13:11:04.607738       1 disruption.go:339] Sending events to api server.
	I0812 13:11:04.659570       1 event.go:291] "Event occurred" object="kube-system/kube-proxy" kind="DaemonSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: kube-proxy-n52m2"
	I0812 13:11:04.660061       1 event.go:291] "Event occurred" object="kube-system/coredns-74ff55c5b" kind="ReplicaSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: coredns-74ff55c5b-wcjn8"
	I0812 13:11:04.686687       1 event.go:291] "Event occurred" object="kube-dns" kind="Endpoints" apiVersion="v1" type="Warning" reason="FailedToCreateEndpoint" message="Failed to create endpoint for service kube-system/kube-dns: endpoints \"kube-dns\" already exists"
	I0812 13:11:04.782637       1 shared_informer.go:240] Waiting for caches to sync for garbage collector
	I0812 13:11:04.840894       1 request.go:655] Throttling request took 1.047341487s, request: GET:https://192.168.85.2:8443/apis/extensions/v1beta1?timeout=32s
	E0812 13:11:04.877014       1 daemon_controller.go:320] kube-system/kube-proxy failed with : error storing status for daemon set &v1.DaemonSet{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"kube-proxy", GenerateName:"", Namespace:"kube-system", SelfLink:"", UID:"1003247b-a2a0-4a14-8a2d-9adb32a0660a", ResourceVersion:"262", Generation:1, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:63859065048, loc:(*time.Location)(0x632eb80)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string{"k8s-app":"kube-proxy"}, Annotations:map[string]string{"deprecated.daemonset.template.generation":"1"}, OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ClusterName:"", ManagedFields:[]v1.ManagedFieldsEntry{v1.ManagedFieldsEntry{Manager:"kubeadm", Operation:"Update", APIVersion:"apps/v1", Time:(*v1.Time)(0x40016b96a0), FieldsType:"FieldsV1", FieldsV1:(*v1.FieldsV1)(0x40016b96c0)}}}, Spec:v1.DaemonSetSpec{Selector:(*v1.
LabelSelector)(0x40016b96e0), Template:v1.PodTemplateSpec{ObjectMeta:v1.ObjectMeta{Name:"", GenerateName:"", Namespace:"", SelfLink:"", UID:"", ResourceVersion:"", Generation:0, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string{"k8s-app":"kube-proxy"}, Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ClusterName:"", ManagedFields:[]v1.ManagedFieldsEntry(nil)}, Spec:v1.PodSpec{Volumes:[]v1.Volume{v1.Volume{Name:"kube-proxy", VolumeSource:v1.VolumeSource{HostPath:(*v1.HostPathVolumeSource)(nil), EmptyDir:(*v1.EmptyDirVolumeSource)(nil), GCEPersistentDisk:(*v1.GCEPersistentDiskVolumeSource)(nil), AWSElasticBlockStore:(*v1.AWSElasticBlockStoreVolumeSource)(nil), GitRepo:(*v1.GitRepoVolumeSource)(nil), Secret:(*v1.SecretVolumeSource)(nil), NFS:(*v1.NFSVolumeSource)(nil), ISCSI:(*v1.ISCSIVolumeSource)(nil), Glusterfs:(*v1.Gl
usterfsVolumeSource)(nil), PersistentVolumeClaim:(*v1.PersistentVolumeClaimVolumeSource)(nil), RBD:(*v1.RBDVolumeSource)(nil), FlexVolume:(*v1.FlexVolumeSource)(nil), Cinder:(*v1.CinderVolumeSource)(nil), CephFS:(*v1.CephFSVolumeSource)(nil), Flocker:(*v1.FlockerVolumeSource)(nil), DownwardAPI:(*v1.DownwardAPIVolumeSource)(nil), FC:(*v1.FCVolumeSource)(nil), AzureFile:(*v1.AzureFileVolumeSource)(nil), ConfigMap:(*v1.ConfigMapVolumeSource)(0x40012359c0), VsphereVolume:(*v1.VsphereVirtualDiskVolumeSource)(nil), Quobyte:(*v1.QuobyteVolumeSource)(nil), AzureDisk:(*v1.AzureDiskVolumeSource)(nil), PhotonPersistentDisk:(*v1.PhotonPersistentDiskVolumeSource)(nil), Projected:(*v1.ProjectedVolumeSource)(nil), PortworxVolume:(*v1.PortworxVolumeSource)(nil), ScaleIO:(*v1.ScaleIOVolumeSource)(nil), StorageOS:(*v1.StorageOSVolumeSource)(nil), CSI:(*v1.CSIVolumeSource)(nil), Ephemeral:(*v1.EphemeralVolumeSource)(nil)}}, v1.Volume{Name:"xtables-lock", VolumeSource:v1.VolumeSource{HostPath:(*v1.HostPathVolumeSource)(0x40016b9
700), EmptyDir:(*v1.EmptyDirVolumeSource)(nil), GCEPersistentDisk:(*v1.GCEPersistentDiskVolumeSource)(nil), AWSElasticBlockStore:(*v1.AWSElasticBlockStoreVolumeSource)(nil), GitRepo:(*v1.GitRepoVolumeSource)(nil), Secret:(*v1.SecretVolumeSource)(nil), NFS:(*v1.NFSVolumeSource)(nil), ISCSI:(*v1.ISCSIVolumeSource)(nil), Glusterfs:(*v1.GlusterfsVolumeSource)(nil), PersistentVolumeClaim:(*v1.PersistentVolumeClaimVolumeSource)(nil), RBD:(*v1.RBDVolumeSource)(nil), FlexVolume:(*v1.FlexVolumeSource)(nil), Cinder:(*v1.CinderVolumeSource)(nil), CephFS:(*v1.CephFSVolumeSource)(nil), Flocker:(*v1.FlockerVolumeSource)(nil), DownwardAPI:(*v1.DownwardAPIVolumeSource)(nil), FC:(*v1.FCVolumeSource)(nil), AzureFile:(*v1.AzureFileVolumeSource)(nil), ConfigMap:(*v1.ConfigMapVolumeSource)(nil), VsphereVolume:(*v1.VsphereVirtualDiskVolumeSource)(nil), Quobyte:(*v1.QuobyteVolumeSource)(nil), AzureDisk:(*v1.AzureDiskVolumeSource)(nil), PhotonPersistentDisk:(*v1.PhotonPersistentDiskVolumeSource)(nil), Projected:(*v1.ProjectedVolumeS
ource)(nil), PortworxVolume:(*v1.PortworxVolumeSource)(nil), ScaleIO:(*v1.ScaleIOVolumeSource)(nil), StorageOS:(*v1.StorageOSVolumeSource)(nil), CSI:(*v1.CSIVolumeSource)(nil), Ephemeral:(*v1.EphemeralVolumeSource)(nil)}}, v1.Volume{Name:"lib-modules", VolumeSource:v1.VolumeSource{HostPath:(*v1.HostPathVolumeSource)(0x40016b9720), EmptyDir:(*v1.EmptyDirVolumeSource)(nil), GCEPersistentDisk:(*v1.GCEPersistentDiskVolumeSource)(nil), AWSElasticBlockStore:(*v1.AWSElasticBlockStoreVolumeSource)(nil), GitRepo:(*v1.GitRepoVolumeSource)(nil), Secret:(*v1.SecretVolumeSource)(nil), NFS:(*v1.NFSVolumeSource)(nil), ISCSI:(*v1.ISCSIVolumeSource)(nil), Glusterfs:(*v1.GlusterfsVolumeSource)(nil), PersistentVolumeClaim:(*v1.PersistentVolumeClaimVolumeSource)(nil), RBD:(*v1.RBDVolumeSource)(nil), FlexVolume:(*v1.FlexVolumeSource)(nil), Cinder:(*v1.CinderVolumeSource)(nil), CephFS:(*v1.CephFSVolumeSource)(nil), Flocker:(*v1.FlockerVolumeSource)(nil), DownwardAPI:(*v1.DownwardAPIVolumeSource)(nil), FC:(*v1.FCVolumeSource)(nil),
AzureFile:(*v1.AzureFileVolumeSource)(nil), ConfigMap:(*v1.ConfigMapVolumeSource)(nil), VsphereVolume:(*v1.VsphereVirtualDiskVolumeSource)(nil), Quobyte:(*v1.QuobyteVolumeSource)(nil), AzureDisk:(*v1.AzureDiskVolumeSource)(nil), PhotonPersistentDisk:(*v1.PhotonPersistentDiskVolumeSource)(nil), Projected:(*v1.ProjectedVolumeSource)(nil), PortworxVolume:(*v1.PortworxVolumeSource)(nil), ScaleIO:(*v1.ScaleIOVolumeSource)(nil), StorageOS:(*v1.StorageOSVolumeSource)(nil), CSI:(*v1.CSIVolumeSource)(nil), Ephemeral:(*v1.EphemeralVolumeSource)(nil)}}}, InitContainers:[]v1.Container(nil), Containers:[]v1.Container{v1.Container{Name:"kube-proxy", Image:"k8s.gcr.io/kube-proxy:v1.20.0", Command:[]string{"/usr/local/bin/kube-proxy", "--config=/var/lib/kube-proxy/config.conf", "--hostname-override=$(NODE_NAME)"}, Args:[]string(nil), WorkingDir:"", Ports:[]v1.ContainerPort(nil), EnvFrom:[]v1.EnvFromSource(nil), Env:[]v1.EnvVar{v1.EnvVar{Name:"NODE_NAME", Value:"", ValueFrom:(*v1.EnvVarSource)(0x40016b9760)}}, Resources:v1.R
esourceRequirements{Limits:v1.ResourceList(nil), Requests:v1.ResourceList(nil)}, VolumeMounts:[]v1.VolumeMount{v1.VolumeMount{Name:"kube-proxy", ReadOnly:false, MountPath:"/var/lib/kube-proxy", SubPath:"", MountPropagation:(*v1.MountPropagationMode)(nil), SubPathExpr:""}, v1.VolumeMount{Name:"xtables-lock", ReadOnly:false, MountPath:"/run/xtables.lock", SubPath:"", MountPropagation:(*v1.MountPropagationMode)(nil), SubPathExpr:""}, v1.VolumeMount{Name:"lib-modules", ReadOnly:true, MountPath:"/lib/modules", SubPath:"", MountPropagation:(*v1.MountPropagationMode)(nil), SubPathExpr:""}}, VolumeDevices:[]v1.VolumeDevice(nil), LivenessProbe:(*v1.Probe)(nil), ReadinessProbe:(*v1.Probe)(nil), StartupProbe:(*v1.Probe)(nil), Lifecycle:(*v1.Lifecycle)(nil), TerminationMessagePath:"/dev/termination-log", TerminationMessagePolicy:"File", ImagePullPolicy:"IfNotPresent", SecurityContext:(*v1.SecurityContext)(0x4000e59bc0), Stdin:false, StdinOnce:false, TTY:false}}, EphemeralContainers:[]v1.EphemeralContainer(nil), RestartPo
licy:"Always", TerminationGracePeriodSeconds:(*int64)(0x4000bc5a58), ActiveDeadlineSeconds:(*int64)(nil), DNSPolicy:"ClusterFirst", NodeSelector:map[string]string{"kubernetes.io/os":"linux"}, ServiceAccountName:"kube-proxy", DeprecatedServiceAccount:"kube-proxy", AutomountServiceAccountToken:(*bool)(nil), NodeName:"", HostNetwork:true, HostPID:false, HostIPC:false, ShareProcessNamespace:(*bool)(nil), SecurityContext:(*v1.PodSecurityContext)(0x4000a28540), ImagePullSecrets:[]v1.LocalObjectReference(nil), Hostname:"", Subdomain:"", Affinity:(*v1.Affinity)(nil), SchedulerName:"default-scheduler", Tolerations:[]v1.Toleration{v1.Toleration{Key:"CriticalAddonsOnly", Operator:"Exists", Value:"", Effect:"", TolerationSeconds:(*int64)(nil)}, v1.Toleration{Key:"", Operator:"Exists", Value:"", Effect:"", TolerationSeconds:(*int64)(nil)}}, HostAliases:[]v1.HostAlias(nil), PriorityClassName:"system-node-critical", Priority:(*int32)(nil), DNSConfig:(*v1.PodDNSConfig)(nil), ReadinessGates:[]v1.PodReadinessGate(nil), Runtime
ClassName:(*string)(nil), EnableServiceLinks:(*bool)(nil), PreemptionPolicy:(*v1.PreemptionPolicy)(nil), Overhead:v1.ResourceList(nil), TopologySpreadConstraints:[]v1.TopologySpreadConstraint(nil), SetHostnameAsFQDN:(*bool)(nil)}}, UpdateStrategy:v1.DaemonSetUpdateStrategy{Type:"RollingUpdate", RollingUpdate:(*v1.RollingUpdateDaemonSet)(0x400000f538)}, MinReadySeconds:0, RevisionHistoryLimit:(*int32)(0x4000bc5b88)}, Status:v1.DaemonSetStatus{CurrentNumberScheduled:0, NumberMisscheduled:0, DesiredNumberScheduled:0, NumberReady:0, ObservedGeneration:0, UpdatedNumberScheduled:0, NumberAvailable:0, NumberUnavailable:0, CollisionCount:(*int32)(nil), Conditions:[]v1.DaemonSetCondition(nil)}}: Operation cannot be fulfilled on daemonsets.apps "kube-proxy": the object has been modified; please apply your changes to the latest version and try again
	E0812 13:11:04.877909       1 daemon_controller.go:320] kube-system/kindnet failed with : error storing status for daemon set &v1.DaemonSet{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"kindnet", GenerateName:"", Namespace:"kube-system", SelfLink:"", UID:"4ab6c54b-2b4a-4623-9486-73e806f7dad3", ResourceVersion:"389", Generation:1, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:63859065049, loc:(*time.Location)(0x632eb80)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string{"app":"kindnet", "k8s-app":"kindnet", "tier":"node"}, Annotations:map[string]string{"deprecated.daemonset.template.generation":"1", "kubectl.kubernetes.io/last-applied-configuration":"{\"apiVersion\":\"apps/v1\",\"kind\":\"DaemonSet\",\"metadata\":{\"annotations\":{},\"labels\":{\"app\":\"kindnet\",\"k8s-app\":\"kindnet\",\"tier\":\"node\"},\"name\":\"kindnet\",\"namespace\":\"kube-system\"},\"spec\":{\"selector\":{\"matchLabels\":{\"app\":\"k
indnet\"}},\"template\":{\"metadata\":{\"labels\":{\"app\":\"kindnet\",\"k8s-app\":\"kindnet\",\"tier\":\"node\"}},\"spec\":{\"containers\":[{\"env\":[{\"name\":\"HOST_IP\",\"valueFrom\":{\"fieldRef\":{\"fieldPath\":\"status.hostIP\"}}},{\"name\":\"POD_IP\",\"valueFrom\":{\"fieldRef\":{\"fieldPath\":\"status.podIP\"}}},{\"name\":\"POD_SUBNET\",\"value\":\"10.244.0.0/16\"}],\"image\":\"docker.io/kindest/kindnetd:v20240730-75a5af0c\",\"name\":\"kindnet-cni\",\"resources\":{\"limits\":{\"cpu\":\"100m\",\"memory\":\"50Mi\"},\"requests\":{\"cpu\":\"100m\",\"memory\":\"50Mi\"}},\"securityContext\":{\"capabilities\":{\"add\":[\"NET_RAW\",\"NET_ADMIN\"]},\"privileged\":false},\"volumeMounts\":[{\"mountPath\":\"/etc/cni/net.d\",\"name\":\"cni-cfg\"},{\"mountPath\":\"/run/xtables.lock\",\"name\":\"xtables-lock\",\"readOnly\":false},{\"mountPath\":\"/lib/modules\",\"name\":\"lib-modules\",\"readOnly\":true}]}],\"hostNetwork\":true,\"serviceAccountName\":\"kindnet\",\"tolerations\":[{\"effect\":\"NoSchedule\",\"operator\
":\"Exists\"}],\"volumes\":[{\"hostPath\":{\"path\":\"/etc/cni/net.d\",\"type\":\"DirectoryOrCreate\"},\"name\":\"cni-cfg\"},{\"hostPath\":{\"path\":\"/run/xtables.lock\",\"type\":\"FileOrCreate\"},\"name\":\"xtables-lock\"},{\"hostPath\":{\"path\":\"/lib/modules\"},\"name\":\"lib-modules\"}]}}}}\n"}, OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ClusterName:"", ManagedFields:[]v1.ManagedFieldsEntry{v1.ManagedFieldsEntry{Manager:"kubectl-client-side-apply", Operation:"Update", APIVersion:"apps/v1", Time:(*v1.Time)(0x4001fa90a0), FieldsType:"FieldsV1", FieldsV1:(*v1.FieldsV1)(0x4001fa90c0)}, v1.ManagedFieldsEntry{Manager:"kube-controller-manager", Operation:"Update", APIVersion:"apps/v1", Time:(*v1.Time)(0x4001fa90e0), FieldsType:"FieldsV1", FieldsV1:(*v1.FieldsV1)(0x4001fa9100)}}}, Spec:v1.DaemonSetSpec{Selector:(*v1.LabelSelector)(0x4001fa9120), Template:v1.PodTemplateSpec{ObjectMeta:v1.ObjectMeta{Name:"", GenerateName:"", Namespace:"", SelfLink:"", UID:"", ResourceVersion:"", Generatio
n:0, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string{"app":"kindnet", "k8s-app":"kindnet", "tier":"node"}, Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ClusterName:"", ManagedFields:[]v1.ManagedFieldsEntry(nil)}, Spec:v1.PodSpec{Volumes:[]v1.Volume{v1.Volume{Name:"cni-cfg", VolumeSource:v1.VolumeSource{HostPath:(*v1.HostPathVolumeSource)(0x4001fa9140), EmptyDir:(*v1.EmptyDirVolumeSource)(nil), GCEPersistentDisk:(*v1.GCEPersistentDiskVolumeSource)(nil), AWSElasticBlockStore:(*v1.AWSElasticBlockStoreVolumeSource)(nil), GitRepo:(*v1.GitRepoVolumeSource)(nil), Secret:(*v1.SecretVolumeSource)(nil), NFS:(*v1.NFSVolumeSource)(nil), ISCSI:(*v1.ISCSIVolumeSource)(nil), Glusterfs:(*v1.GlusterfsVolumeSource)(nil), PersistentVolumeClaim:(*v1.PersistentVolumeClaimVolumeSource)(nil), RBD:(*v1.RBDVolumeSource)(nil), FlexVolume:
(*v1.FlexVolumeSource)(nil), Cinder:(*v1.CinderVolumeSource)(nil), CephFS:(*v1.CephFSVolumeSource)(nil), Flocker:(*v1.FlockerVolumeSource)(nil), DownwardAPI:(*v1.DownwardAPIVolumeSource)(nil), FC:(*v1.FCVolumeSource)(nil), AzureFile:(*v1.AzureFileVolumeSource)(nil), ConfigMap:(*v1.ConfigMapVolumeSource)(nil), VsphereVolume:(*v1.VsphereVirtualDiskVolumeSource)(nil), Quobyte:(*v1.QuobyteVolumeSource)(nil), AzureDisk:(*v1.AzureDiskVolumeSource)(nil), PhotonPersistentDisk:(*v1.PhotonPersistentDiskVolumeSource)(nil), Projected:(*v1.ProjectedVolumeSource)(nil), PortworxVolume:(*v1.PortworxVolumeSource)(nil), ScaleIO:(*v1.ScaleIOVolumeSource)(nil), StorageOS:(*v1.StorageOSVolumeSource)(nil), CSI:(*v1.CSIVolumeSource)(nil), Ephemeral:(*v1.EphemeralVolumeSource)(nil)}}, v1.Volume{Name:"xtables-lock", VolumeSource:v1.VolumeSource{HostPath:(*v1.HostPathVolumeSource)(0x4001fa9160), EmptyDir:(*v1.EmptyDirVolumeSource)(nil), GCEPersistentDisk:(*v1.GCEPersistentDiskVolumeSource)(nil), AWSElasticBlockStore:(*v1.AWSElasticBlo
ckStoreVolumeSource)(nil), GitRepo:(*v1.GitRepoVolumeSource)(nil), Secret:(*v1.SecretVolumeSource)(nil), NFS:(*v1.NFSVolumeSource)(nil), ISCSI:(*v1.ISCSIVolumeSource)(nil), Glusterfs:(*v1.GlusterfsVolumeSource)(nil), PersistentVolumeClaim:(*v1.PersistentVolumeClaimVolumeSource)(nil), RBD:(*v1.RBDVolumeSource)(nil), FlexVolume:(*v1.FlexVolumeSource)(nil), Cinder:(*v1.CinderVolumeSource)(nil), CephFS:(*v1.CephFSVolumeSource)(nil), Flocker:(*v1.FlockerVolumeSource)(nil), DownwardAPI:(*v1.DownwardAPIVolumeSource)(nil), FC:(*v1.FCVolumeSource)(nil), AzureFile:(*v1.AzureFileVolumeSource)(nil), ConfigMap:(*v1.ConfigMapVolumeSource)(nil), VsphereVolume:(*v1.VsphereVirtualDiskVolumeSource)(nil), Quobyte:(*v1.QuobyteVolumeSource)(nil), AzureDisk:(*v1.AzureDiskVolumeSource)(nil), PhotonPersistentDisk:(*v1.PhotonPersistentDiskVolumeSource)(nil), Projected:(*v1.ProjectedVolumeSource)(nil), PortworxVolume:(*v1.PortworxVolumeSource)(nil), ScaleIO:(*v1.ScaleIOVolumeSource)(nil), StorageOS:(*v1.StorageOSVolumeSource)(nil), CS
I:(*v1.CSIVolumeSource)(nil), Ephemeral:(*v1.EphemeralVolumeSource)(nil)}}, v1.Volume{Name:"lib-modules", VolumeSource:v1.VolumeSource{HostPath:(*v1.HostPathVolumeSource)(0x4001fa9180), EmptyDir:(*v1.EmptyDirVolumeSource)(nil), GCEPersistentDisk:(*v1.GCEPersistentDiskVolumeSource)(nil), AWSElasticBlockStore:(*v1.AWSElasticBlockStoreVolumeSource)(nil), GitRepo:(*v1.GitRepoVolumeSource)(nil), Secret:(*v1.SecretVolumeSource)(nil), NFS:(*v1.NFSVolumeSource)(nil), ISCSI:(*v1.ISCSIVolumeSource)(nil), Glusterfs:(*v1.GlusterfsVolumeSource)(nil), PersistentVolumeClaim:(*v1.PersistentVolumeClaimVolumeSource)(nil), RBD:(*v1.RBDVolumeSource)(nil), FlexVolume:(*v1.FlexVolumeSource)(nil), Cinder:(*v1.CinderVolumeSource)(nil), CephFS:(*v1.CephFSVolumeSource)(nil), Flocker:(*v1.FlockerVolumeSource)(nil), DownwardAPI:(*v1.DownwardAPIVolumeSource)(nil), FC:(*v1.FCVolumeSource)(nil), AzureFile:(*v1.AzureFileVolumeSource)(nil), ConfigMap:(*v1.ConfigMapVolumeSource)(nil), VsphereVolume:(*v1.VsphereVirtualDiskVolumeSource)(nil), Q
uobyte:(*v1.QuobyteVolumeSource)(nil), AzureDisk:(*v1.AzureDiskVolumeSource)(nil), PhotonPersistentDisk:(*v1.PhotonPersistentDiskVolumeSource)(nil), Projected:(*v1.ProjectedVolumeSource)(nil), PortworxVolume:(*v1.PortworxVolumeSource)(nil), ScaleIO:(*v1.ScaleIOVolumeSource)(nil), StorageOS:(*v1.StorageOSVolumeSource)(nil), CSI:(*v1.CSIVolumeSource)(nil), Ephemeral:(*v1.EphemeralVolumeSource)(nil)}}}, InitContainers:[]v1.Container(nil), Containers:[]v1.Container{v1.Container{Name:"kindnet-cni", Image:"docker.io/kindest/kindnetd:v20240730-75a5af0c", Command:[]string(nil), Args:[]string(nil), WorkingDir:"", Ports:[]v1.ContainerPort(nil), EnvFrom:[]v1.EnvFromSource(nil), Env:[]v1.EnvVar{v1.EnvVar{Name:"HOST_IP", Value:"", ValueFrom:(*v1.EnvVarSource)(0x4001fa91a0)}, v1.EnvVar{Name:"POD_IP", Value:"", ValueFrom:(*v1.EnvVarSource)(0x4001fa91e0)}, v1.EnvVar{Name:"POD_SUBNET", Value:"10.244.0.0/16", ValueFrom:(*v1.EnvVarSource)(nil)}}, Resources:v1.ResourceRequirements{Limits:v1.ResourceList{"cpu":resource.Quantity{i
:resource.int64Amount{value:100, scale:-3}, d:resource.infDecAmount{Dec:(*inf.Dec)(nil)}, s:"100m", Format:"DecimalSI"}, "memory":resource.Quantity{i:resource.int64Amount{value:52428800, scale:0}, d:resource.infDecAmount{Dec:(*inf.Dec)(nil)}, s:"50Mi", Format:"BinarySI"}}, Requests:v1.ResourceList{"cpu":resource.Quantity{i:resource.int64Amount{value:100, scale:-3}, d:resource.infDecAmount{Dec:(*inf.Dec)(nil)}, s:"100m", Format:"DecimalSI"}, "memory":resource.Quantity{i:resource.int64Amount{value:52428800, scale:0}, d:resource.infDecAmount{Dec:(*inf.Dec)(nil)}, s:"50Mi", Format:"BinarySI"}}}, VolumeMounts:[]v1.VolumeMount{v1.VolumeMount{Name:"cni-cfg", ReadOnly:false, MountPath:"/etc/cni/net.d", SubPath:"", MountPropagation:(*v1.MountPropagationMode)(nil), SubPathExpr:""}, v1.VolumeMount{Name:"xtables-lock", ReadOnly:false, MountPath:"/run/xtables.lock", SubPath:"", MountPropagation:(*v1.MountPropagationMode)(nil), SubPathExpr:""}, v1.VolumeMount{Name:"lib-modules", ReadOnly:true, MountPath:"/lib/modules", Sub
Path:"", MountPropagation:(*v1.MountPropagationMode)(nil), SubPathExpr:""}}, VolumeDevices:[]v1.VolumeDevice(nil), LivenessProbe:(*v1.Probe)(nil), ReadinessProbe:(*v1.Probe)(nil), StartupProbe:(*v1.Probe)(nil), Lifecycle:(*v1.Lifecycle)(nil), TerminationMessagePath:"/dev/termination-log", TerminationMessagePolicy:"File", ImagePullPolicy:"IfNotPresent", SecurityContext:(*v1.SecurityContext)(0x4001d5b4a0), Stdin:false, StdinOnce:false, TTY:false}}, EphemeralContainers:[]v1.EphemeralContainer(nil), RestartPolicy:"Always", TerminationGracePeriodSeconds:(*int64)(0x4001d67518), ActiveDeadlineSeconds:(*int64)(nil), DNSPolicy:"ClusterFirst", NodeSelector:map[string]string(nil), ServiceAccountName:"kindnet", DeprecatedServiceAccount:"kindnet", AutomountServiceAccountToken:(*bool)(nil), NodeName:"", HostNetwork:true, HostPID:false, HostIPC:false, ShareProcessNamespace:(*bool)(nil), SecurityContext:(*v1.PodSecurityContext)(0x4000b12070), ImagePullSecrets:[]v1.LocalObjectReference(nil), Hostname:"", Subdomain:"", Affinit
y:(*v1.Affinity)(nil), SchedulerName:"default-scheduler", Tolerations:[]v1.Toleration{v1.Toleration{Key:"", Operator:"Exists", Value:"", Effect:"NoSchedule", TolerationSeconds:(*int64)(nil)}}, HostAliases:[]v1.HostAlias(nil), PriorityClassName:"", Priority:(*int32)(nil), DNSConfig:(*v1.PodDNSConfig)(nil), ReadinessGates:[]v1.PodReadinessGate(nil), RuntimeClassName:(*string)(nil), EnableServiceLinks:(*bool)(nil), PreemptionPolicy:(*v1.PreemptionPolicy)(nil), Overhead:v1.ResourceList(nil), TopologySpreadConstraints:[]v1.TopologySpreadConstraint(nil), SetHostnameAsFQDN:(*bool)(nil)}}, UpdateStrategy:v1.DaemonSetUpdateStrategy{Type:"RollingUpdate", RollingUpdate:(*v1.RollingUpdateDaemonSet)(0x4001b1a048)}, MinReadySeconds:0, RevisionHistoryLimit:(*int32)(0x4001d67560)}, Status:v1.DaemonSetStatus{CurrentNumberScheduled:0, NumberMisscheduled:0, DesiredNumberScheduled:1, NumberReady:0, ObservedGeneration:1, UpdatedNumberScheduled:0, NumberAvailable:0, NumberUnavailable:1, CollisionCount:(*int32)(nil), Conditions:[]v
1.DaemonSetCondition(nil)}}: Operation cannot be fulfilled on daemonsets.apps "kindnet": the object has been modified; please apply your changes to the latest version and try again
	I0812 13:11:05.041154       1 shared_informer.go:247] Caches are synced for garbage collector 
	I0812 13:11:05.041176       1 garbagecollector.go:151] Garbage collector: all resource monitors have synced. Proceeding to collect garbage
	I0812 13:11:05.084646       1 shared_informer.go:247] Caches are synced for garbage collector 
	I0812 13:11:05.641899       1 shared_informer.go:240] Waiting for caches to sync for resource quota
	I0812 13:11:05.641968       1 shared_informer.go:247] Caches are synced for resource quota 
	I0812 13:11:06.278745       1 event.go:291] "Event occurred" object="kube-system/coredns" kind="Deployment" apiVersion="apps/v1" type="Normal" reason="ScalingReplicaSet" message="Scaled down replica set coredns-74ff55c5b to 1"
	I0812 13:11:06.293831       1 event.go:291] "Event occurred" object="kube-system/coredns-74ff55c5b" kind="ReplicaSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulDelete" message="Deleted pod: coredns-74ff55c5b-t78fq"
	I0812 13:11:09.357633       1 node_lifecycle_controller.go:1222] Controller detected that some Nodes are Ready. Exiting master disruption mode.
	I0812 13:12:52.174559       1 event.go:291] "Event occurred" object="kube-system/metrics-server" kind="Deployment" apiVersion="apps/v1" type="Normal" reason="ScalingReplicaSet" message="Scaled up replica set metrics-server-9975d5f86 to 1"
	E0812 13:12:52.296170       1 clusterroleaggregation_controller.go:181] view failed with : Operation cannot be fulfilled on clusterroles.rbac.authorization.k8s.io "view": the object has been modified; please apply your changes to the latest version and try again
	E0812 13:12:52.298485       1 clusterroleaggregation_controller.go:181] edit failed with : Operation cannot be fulfilled on clusterroles.rbac.authorization.k8s.io "edit": the object has been modified; please apply your changes to the latest version and try again
	
	
	==> kube-proxy [2af20ac6f2602d8c076b3bed058353203858c5832593d98d2de3ccc55cbf9c7d] <==
	I0812 13:13:39.204112       1 node.go:172] Successfully retrieved node IP: 192.168.85.2
	I0812 13:13:39.204387       1 server_others.go:142] kube-proxy node IP is an IPv4 address (192.168.85.2), assume IPv4 operation
	W0812 13:13:39.250566       1 server_others.go:578] Unknown proxy mode "", assuming iptables proxy
	I0812 13:13:39.250976       1 server_others.go:185] Using iptables Proxier.
	I0812 13:13:39.251193       1 server.go:650] Version: v1.20.0
	I0812 13:13:39.251656       1 config.go:224] Starting endpoint slice config controller
	I0812 13:13:39.251668       1 shared_informer.go:240] Waiting for caches to sync for endpoint slice config
	I0812 13:13:39.251761       1 config.go:315] Starting service config controller
	I0812 13:13:39.251766       1 shared_informer.go:240] Waiting for caches to sync for service config
	I0812 13:13:39.351791       1 shared_informer.go:247] Caches are synced for endpoint slice config 
	I0812 13:13:39.351858       1 shared_informer.go:247] Caches are synced for service config 
	
	
	==> kube-proxy [e6326fb96d89ee49b3da7ef3f75a5f41a53b9acb3526ac907bf55dfcc30b8d6c] <==
	I0812 13:11:05.606717       1 node.go:172] Successfully retrieved node IP: 192.168.85.2
	I0812 13:11:05.606800       1 server_others.go:142] kube-proxy node IP is an IPv4 address (192.168.85.2), assume IPv4 operation
	W0812 13:11:05.642567       1 server_others.go:578] Unknown proxy mode "", assuming iptables proxy
	I0812 13:11:05.642658       1 server_others.go:185] Using iptables Proxier.
	I0812 13:11:05.642865       1 server.go:650] Version: v1.20.0
	I0812 13:11:05.643636       1 config.go:315] Starting service config controller
	I0812 13:11:05.643646       1 shared_informer.go:240] Waiting for caches to sync for service config
	I0812 13:11:05.643682       1 config.go:224] Starting endpoint slice config controller
	I0812 13:11:05.643686       1 shared_informer.go:240] Waiting for caches to sync for endpoint slice config
	I0812 13:11:05.744953       1 shared_informer.go:247] Caches are synced for endpoint slice config 
	I0812 13:11:05.745043       1 shared_informer.go:247] Caches are synced for service config 
	
	
	==> kube-scheduler [7b67a4fc117cb884b3aec00880229a7613be0e0af79872ccc25b2ef06932d06f] <==
	W0812 13:10:45.969874       1 authentication.go:334] To require authentication configuration lookup to succeed, set --authentication-tolerate-lookup-failure=false
	I0812 13:10:46.087934       1 secure_serving.go:197] Serving securely on 127.0.0.1:10259
	I0812 13:10:46.088766       1 configmap_cafile_content.go:202] Starting client-ca::kube-system::extension-apiserver-authentication::client-ca-file
	I0812 13:10:46.089050       1 shared_informer.go:240] Waiting for caches to sync for client-ca::kube-system::extension-apiserver-authentication::client-ca-file
	I0812 13:10:46.091262       1 tlsconfig.go:240] Starting DynamicServingCertificateController
	E0812 13:10:46.097811       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1beta1.PodDisruptionBudget: failed to list *v1beta1.PodDisruptionBudget: poddisruptionbudgets.policy is forbidden: User "system:kube-scheduler" cannot list resource "poddisruptionbudgets" in API group "policy" at the cluster scope
	E0812 13:10:46.105611       1 reflector.go:138] k8s.io/apiserver/pkg/server/dynamiccertificates/configmap_cafile_content.go:206: Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot list resource "configmaps" in API group "" in the namespace "kube-system"
	E0812 13:10:46.105855       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.StorageClass: failed to list *v1.StorageClass: storageclasses.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "storageclasses" in API group "storage.k8s.io" at the cluster scope
	E0812 13:10:46.115940       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.PersistentVolumeClaim: failed to list *v1.PersistentVolumeClaim: persistentvolumeclaims is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumeclaims" in API group "" at the cluster scope
	E0812 13:10:46.116042       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Service: failed to list *v1.Service: services is forbidden: User "system:kube-scheduler" cannot list resource "services" in API group "" at the cluster scope
	E0812 13:10:46.116113       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.ReplicationController: failed to list *v1.ReplicationController: replicationcontrollers is forbidden: User "system:kube-scheduler" cannot list resource "replicationcontrollers" in API group "" at the cluster scope
	E0812 13:10:46.116183       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Pod: failed to list *v1.Pod: pods is forbidden: User "system:kube-scheduler" cannot list resource "pods" in API group "" at the cluster scope
	E0812 13:10:46.116275       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.PersistentVolume: failed to list *v1.PersistentVolume: persistentvolumes is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumes" in API group "" at the cluster scope
	E0812 13:10:46.116336       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.ReplicaSet: failed to list *v1.ReplicaSet: replicasets.apps is forbidden: User "system:kube-scheduler" cannot list resource "replicasets" in API group "apps" at the cluster scope
	E0812 13:10:46.115942       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Node: failed to list *v1.Node: nodes is forbidden: User "system:kube-scheduler" cannot list resource "nodes" in API group "" at the cluster scope
	E0812 13:10:46.124554       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.StatefulSet: failed to list *v1.StatefulSet: statefulsets.apps is forbidden: User "system:kube-scheduler" cannot list resource "statefulsets" in API group "apps" at the cluster scope
	E0812 13:10:46.124908       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.CSINode: failed to list *v1.CSINode: csinodes.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csinodes" in API group "storage.k8s.io" at the cluster scope
	E0812 13:10:46.942458       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Service: failed to list *v1.Service: services is forbidden: User "system:kube-scheduler" cannot list resource "services" in API group "" at the cluster scope
	E0812 13:10:46.942453       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.PersistentVolume: failed to list *v1.PersistentVolume: persistentvolumes is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumes" in API group "" at the cluster scope
	E0812 13:10:46.969915       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.StorageClass: failed to list *v1.StorageClass: storageclasses.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "storageclasses" in API group "storage.k8s.io" at the cluster scope
	E0812 13:10:47.015045       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.ReplicationController: failed to list *v1.ReplicationController: replicationcontrollers is forbidden: User "system:kube-scheduler" cannot list resource "replicationcontrollers" in API group "" at the cluster scope
	E0812 13:10:47.094071       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Node: failed to list *v1.Node: nodes is forbidden: User "system:kube-scheduler" cannot list resource "nodes" in API group "" at the cluster scope
	E0812 13:10:47.116366       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1beta1.PodDisruptionBudget: failed to list *v1beta1.PodDisruptionBudget: poddisruptionbudgets.policy is forbidden: User "system:kube-scheduler" cannot list resource "poddisruptionbudgets" in API group "policy" at the cluster scope
	E0812 13:10:47.378327       1 reflector.go:138] k8s.io/apiserver/pkg/server/dynamiccertificates/configmap_cafile_content.go:206: Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot list resource "configmaps" in API group "" in the namespace "kube-system"
	I0812 13:10:49.189606       1 shared_informer.go:247] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file 
	
	
	==> kube-scheduler [b27ed17bf7551f01faf083be84883f36e5f141508c39cfd28e4ca7bf298a5ef2] <==
	I0812 13:13:28.045667       1 serving.go:331] Generated self-signed cert in-memory
	W0812 13:13:35.091380       1 requestheader_controller.go:193] Unable to get configmap/extension-apiserver-authentication in kube-system.  Usually fixed by 'kubectl create rolebinding -n kube-system ROLEBINDING_NAME --role=extension-apiserver-authentication-reader --serviceaccount=YOUR_NS:YOUR_SA'
	W0812 13:13:35.091516       1 authentication.go:332] Error looking up in-cluster authentication configuration: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot get resource "configmaps" in API group "" in the namespace "kube-system"
	W0812 13:13:35.091569       1 authentication.go:333] Continuing without authentication configuration. This may treat all requests as anonymous.
	W0812 13:13:35.091598       1 authentication.go:334] To require authentication configuration lookup to succeed, set --authentication-tolerate-lookup-failure=false
	I0812 13:13:35.539730       1 secure_serving.go:197] Serving securely on 127.0.0.1:10259
	I0812 13:13:35.542454       1 configmap_cafile_content.go:202] Starting client-ca::kube-system::extension-apiserver-authentication::client-ca-file
	I0812 13:13:35.542474       1 shared_informer.go:240] Waiting for caches to sync for client-ca::kube-system::extension-apiserver-authentication::client-ca-file
	I0812 13:13:35.542493       1 tlsconfig.go:240] Starting DynamicServingCertificateController
	E0812 13:13:35.584024       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.ReplicationController: failed to list *v1.ReplicationController: replicationcontrollers is forbidden: User "system:kube-scheduler" cannot list resource "replicationcontrollers" in API group "" at the cluster scope
	E0812 13:13:35.615082       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.ReplicaSet: failed to list *v1.ReplicaSet: replicasets.apps is forbidden: User "system:kube-scheduler" cannot list resource "replicasets" in API group "apps" at the cluster scope
	E0812 13:13:35.621076       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.PersistentVolume: failed to list *v1.PersistentVolume: persistentvolumes is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumes" in API group "" at the cluster scope
	E0812 13:13:35.621281       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.StorageClass: failed to list *v1.StorageClass: storageclasses.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "storageclasses" in API group "storage.k8s.io" at the cluster scope
	E0812 13:13:35.621354       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.CSINode: failed to list *v1.CSINode: csinodes.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csinodes" in API group "storage.k8s.io" at the cluster scope
	E0812 13:13:35.621399       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Node: failed to list *v1.Node: nodes is forbidden: User "system:kube-scheduler" cannot list resource "nodes" in API group "" at the cluster scope
	E0812 13:13:35.634958       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1beta1.PodDisruptionBudget: failed to list *v1beta1.PodDisruptionBudget: poddisruptionbudgets.policy is forbidden: User "system:kube-scheduler" cannot list resource "poddisruptionbudgets" in API group "policy" at the cluster scope
	E0812 13:13:35.635254       1 reflector.go:138] k8s.io/apiserver/pkg/server/dynamiccertificates/configmap_cafile_content.go:206: Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot list resource "configmaps" in API group "" in the namespace "kube-system"
	E0812 13:13:35.635341       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Service: failed to list *v1.Service: services is forbidden: User "system:kube-scheduler" cannot list resource "services" in API group "" at the cluster scope
	E0812 13:13:35.635412       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.StatefulSet: failed to list *v1.StatefulSet: statefulsets.apps is forbidden: User "system:kube-scheduler" cannot list resource "statefulsets" in API group "apps" at the cluster scope
	E0812 13:13:35.635488       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Pod: failed to list *v1.Pod: pods is forbidden: User "system:kube-scheduler" cannot list resource "pods" in API group "" at the cluster scope
	E0812 13:13:35.635560       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.PersistentVolumeClaim: failed to list *v1.PersistentVolumeClaim: persistentvolumeclaims is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumeclaims" in API group "" at the cluster scope
	I0812 13:13:36.746939       1 shared_informer.go:247] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file 
	
	
	==> kubelet <==
	Aug 12 13:17:38 old-k8s-version-112335 kubelet[671]: E0812 13:17:38.356467     671 pod_workers.go:191] Error syncing pod 98eb45e0-5ebb-4a91-950c-b25211aceb65 ("dashboard-metrics-scraper-8d5bb5db8-6w7h6_kubernetes-dashboard(98eb45e0-5ebb-4a91-950c-b25211aceb65)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-6w7h6_kubernetes-dashboard(98eb45e0-5ebb-4a91-950c-b25211aceb65)"
	Aug 12 13:17:47 old-k8s-version-112335 kubelet[671]: E0812 13:17:47.357155     671 pod_workers.go:191] Error syncing pod 34d824a4-d65e-4566-b95e-8f00f2c6fc71 ("metrics-server-9975d5f86-v2prr_kube-system(34d824a4-d65e-4566-b95e-8f00f2c6fc71)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	Aug 12 13:17:51 old-k8s-version-112335 kubelet[671]: I0812 13:17:51.356691     671 scope.go:95] [topologymanager] RemoveContainer - Container ID: 68c5b6ed9f1cbab202b567a4ae06e4e8166d16f5b90ede71a00a03007d5990ac
	Aug 12 13:17:51 old-k8s-version-112335 kubelet[671]: E0812 13:17:51.357564     671 pod_workers.go:191] Error syncing pod 98eb45e0-5ebb-4a91-950c-b25211aceb65 ("dashboard-metrics-scraper-8d5bb5db8-6w7h6_kubernetes-dashboard(98eb45e0-5ebb-4a91-950c-b25211aceb65)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-6w7h6_kubernetes-dashboard(98eb45e0-5ebb-4a91-950c-b25211aceb65)"
	Aug 12 13:18:00 old-k8s-version-112335 kubelet[671]: E0812 13:18:00.357436     671 pod_workers.go:191] Error syncing pod 34d824a4-d65e-4566-b95e-8f00f2c6fc71 ("metrics-server-9975d5f86-v2prr_kube-system(34d824a4-d65e-4566-b95e-8f00f2c6fc71)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	Aug 12 13:18:06 old-k8s-version-112335 kubelet[671]: I0812 13:18:06.356007     671 scope.go:95] [topologymanager] RemoveContainer - Container ID: 68c5b6ed9f1cbab202b567a4ae06e4e8166d16f5b90ede71a00a03007d5990ac
	Aug 12 13:18:06 old-k8s-version-112335 kubelet[671]: E0812 13:18:06.356382     671 pod_workers.go:191] Error syncing pod 98eb45e0-5ebb-4a91-950c-b25211aceb65 ("dashboard-metrics-scraper-8d5bb5db8-6w7h6_kubernetes-dashboard(98eb45e0-5ebb-4a91-950c-b25211aceb65)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-6w7h6_kubernetes-dashboard(98eb45e0-5ebb-4a91-950c-b25211aceb65)"
	Aug 12 13:18:11 old-k8s-version-112335 kubelet[671]: E0812 13:18:11.356726     671 pod_workers.go:191] Error syncing pod 34d824a4-d65e-4566-b95e-8f00f2c6fc71 ("metrics-server-9975d5f86-v2prr_kube-system(34d824a4-d65e-4566-b95e-8f00f2c6fc71)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	Aug 12 13:18:21 old-k8s-version-112335 kubelet[671]: I0812 13:18:21.357181     671 scope.go:95] [topologymanager] RemoveContainer - Container ID: 68c5b6ed9f1cbab202b567a4ae06e4e8166d16f5b90ede71a00a03007d5990ac
	Aug 12 13:18:21 old-k8s-version-112335 kubelet[671]: E0812 13:18:21.358016     671 pod_workers.go:191] Error syncing pod 98eb45e0-5ebb-4a91-950c-b25211aceb65 ("dashboard-metrics-scraper-8d5bb5db8-6w7h6_kubernetes-dashboard(98eb45e0-5ebb-4a91-950c-b25211aceb65)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-6w7h6_kubernetes-dashboard(98eb45e0-5ebb-4a91-950c-b25211aceb65)"
	Aug 12 13:18:25 old-k8s-version-112335 kubelet[671]: E0812 13:18:25.359255     671 pod_workers.go:191] Error syncing pod 34d824a4-d65e-4566-b95e-8f00f2c6fc71 ("metrics-server-9975d5f86-v2prr_kube-system(34d824a4-d65e-4566-b95e-8f00f2c6fc71)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	Aug 12 13:18:33 old-k8s-version-112335 kubelet[671]: I0812 13:18:33.356517     671 scope.go:95] [topologymanager] RemoveContainer - Container ID: 68c5b6ed9f1cbab202b567a4ae06e4e8166d16f5b90ede71a00a03007d5990ac
	Aug 12 13:18:33 old-k8s-version-112335 kubelet[671]: E0812 13:18:33.356927     671 pod_workers.go:191] Error syncing pod 98eb45e0-5ebb-4a91-950c-b25211aceb65 ("dashboard-metrics-scraper-8d5bb5db8-6w7h6_kubernetes-dashboard(98eb45e0-5ebb-4a91-950c-b25211aceb65)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-6w7h6_kubernetes-dashboard(98eb45e0-5ebb-4a91-950c-b25211aceb65)"
	Aug 12 13:18:39 old-k8s-version-112335 kubelet[671]: E0812 13:18:39.356920     671 pod_workers.go:191] Error syncing pod 34d824a4-d65e-4566-b95e-8f00f2c6fc71 ("metrics-server-9975d5f86-v2prr_kube-system(34d824a4-d65e-4566-b95e-8f00f2c6fc71)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	Aug 12 13:18:45 old-k8s-version-112335 kubelet[671]: I0812 13:18:45.356233     671 scope.go:95] [topologymanager] RemoveContainer - Container ID: 68c5b6ed9f1cbab202b567a4ae06e4e8166d16f5b90ede71a00a03007d5990ac
	Aug 12 13:18:45 old-k8s-version-112335 kubelet[671]: E0812 13:18:45.356665     671 pod_workers.go:191] Error syncing pod 98eb45e0-5ebb-4a91-950c-b25211aceb65 ("dashboard-metrics-scraper-8d5bb5db8-6w7h6_kubernetes-dashboard(98eb45e0-5ebb-4a91-950c-b25211aceb65)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-6w7h6_kubernetes-dashboard(98eb45e0-5ebb-4a91-950c-b25211aceb65)"
	Aug 12 13:18:51 old-k8s-version-112335 kubelet[671]: E0812 13:18:51.356752     671 pod_workers.go:191] Error syncing pod 34d824a4-d65e-4566-b95e-8f00f2c6fc71 ("metrics-server-9975d5f86-v2prr_kube-system(34d824a4-d65e-4566-b95e-8f00f2c6fc71)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	Aug 12 13:18:57 old-k8s-version-112335 kubelet[671]: I0812 13:18:57.356175     671 scope.go:95] [topologymanager] RemoveContainer - Container ID: 68c5b6ed9f1cbab202b567a4ae06e4e8166d16f5b90ede71a00a03007d5990ac
	Aug 12 13:18:57 old-k8s-version-112335 kubelet[671]: E0812 13:18:57.356673     671 pod_workers.go:191] Error syncing pod 98eb45e0-5ebb-4a91-950c-b25211aceb65 ("dashboard-metrics-scraper-8d5bb5db8-6w7h6_kubernetes-dashboard(98eb45e0-5ebb-4a91-950c-b25211aceb65)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-6w7h6_kubernetes-dashboard(98eb45e0-5ebb-4a91-950c-b25211aceb65)"
	Aug 12 13:19:06 old-k8s-version-112335 kubelet[671]: E0812 13:19:06.357355     671 pod_workers.go:191] Error syncing pod 34d824a4-d65e-4566-b95e-8f00f2c6fc71 ("metrics-server-9975d5f86-v2prr_kube-system(34d824a4-d65e-4566-b95e-8f00f2c6fc71)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	Aug 12 13:19:08 old-k8s-version-112335 kubelet[671]: I0812 13:19:08.356083     671 scope.go:95] [topologymanager] RemoveContainer - Container ID: 68c5b6ed9f1cbab202b567a4ae06e4e8166d16f5b90ede71a00a03007d5990ac
	Aug 12 13:19:08 old-k8s-version-112335 kubelet[671]: E0812 13:19:08.356438     671 pod_workers.go:191] Error syncing pod 98eb45e0-5ebb-4a91-950c-b25211aceb65 ("dashboard-metrics-scraper-8d5bb5db8-6w7h6_kubernetes-dashboard(98eb45e0-5ebb-4a91-950c-b25211aceb65)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-6w7h6_kubernetes-dashboard(98eb45e0-5ebb-4a91-950c-b25211aceb65)"
	Aug 12 13:19:17 old-k8s-version-112335 kubelet[671]: E0812 13:19:17.360654     671 pod_workers.go:191] Error syncing pod 34d824a4-d65e-4566-b95e-8f00f2c6fc71 ("metrics-server-9975d5f86-v2prr_kube-system(34d824a4-d65e-4566-b95e-8f00f2c6fc71)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	Aug 12 13:19:20 old-k8s-version-112335 kubelet[671]: I0812 13:19:20.356203     671 scope.go:95] [topologymanager] RemoveContainer - Container ID: 68c5b6ed9f1cbab202b567a4ae06e4e8166d16f5b90ede71a00a03007d5990ac
	Aug 12 13:19:20 old-k8s-version-112335 kubelet[671]: E0812 13:19:20.357306     671 pod_workers.go:191] Error syncing pod 98eb45e0-5ebb-4a91-950c-b25211aceb65 ("dashboard-metrics-scraper-8d5bb5db8-6w7h6_kubernetes-dashboard(98eb45e0-5ebb-4a91-950c-b25211aceb65)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-6w7h6_kubernetes-dashboard(98eb45e0-5ebb-4a91-950c-b25211aceb65)"
	
	
	==> kubernetes-dashboard [19e7d460788a0ea1f90292f01072ce22cf88076ab7cc590b1b16483fb405d505] <==
	2024/08/12 13:13:59 Using namespace: kubernetes-dashboard
	2024/08/12 13:13:59 Using in-cluster config to connect to apiserver
	2024/08/12 13:13:59 Using secret token for csrf signing
	2024/08/12 13:13:59 Initializing csrf token from kubernetes-dashboard-csrf secret
	2024/08/12 13:13:59 Empty token. Generating and storing in a secret kubernetes-dashboard-csrf
	2024/08/12 13:13:59 Successful initial request to the apiserver, version: v1.20.0
	2024/08/12 13:13:59 Generating JWE encryption key
	2024/08/12 13:13:59 New synchronizer has been registered: kubernetes-dashboard-key-holder-kubernetes-dashboard. Starting
	2024/08/12 13:13:59 Starting secret synchronizer for kubernetes-dashboard-key-holder in namespace kubernetes-dashboard
	2024/08/12 13:14:00 Initializing JWE encryption key from synchronized object
	2024/08/12 13:14:00 Creating in-cluster Sidecar client
	2024/08/12 13:14:00 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
	2024/08/12 13:14:00 Serving insecurely on HTTP port: 9090
	2024/08/12 13:14:30 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
	2024/08/12 13:15:00 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
	2024/08/12 13:15:30 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
	2024/08/12 13:16:00 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
	2024/08/12 13:16:30 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
	2024/08/12 13:17:00 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
	2024/08/12 13:17:30 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
	2024/08/12 13:18:00 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
	2024/08/12 13:18:30 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
	2024/08/12 13:19:00 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
	2024/08/12 13:13:59 Starting overwatch
	
	
	==> storage-provisioner [2924918d73f931bf85384ca7b1f96cf6760849232fe33069fff149704e2ae596] <==
	I0812 13:13:39.281141       1 storage_provisioner.go:116] Initializing the minikube storage provisioner...
	F0812 13:14:09.283492       1 main.go:39] error getting server version: Get "https://10.96.0.1:443/version?timeout=32s": dial tcp 10.96.0.1:443: i/o timeout
	
	
	==> storage-provisioner [b8ecac9f4ddfb227119bf73b728923825eb3a038f35063eed01a12b20b1560d7] <==
	I0812 13:14:20.466210       1 storage_provisioner.go:116] Initializing the minikube storage provisioner...
	I0812 13:14:20.482837       1 storage_provisioner.go:141] Storage provisioner initialized, now starting service!
	I0812 13:14:20.483044       1 leaderelection.go:243] attempting to acquire leader lease kube-system/k8s.io-minikube-hostpath...
	I0812 13:14:37.957789       1 leaderelection.go:253] successfully acquired lease kube-system/k8s.io-minikube-hostpath
	I0812 13:14:37.958554       1 controller.go:835] Starting provisioner controller k8s.io/minikube-hostpath_old-k8s-version-112335_08afc7d5-87e2-4fcb-8330-374640d7275a!
	I0812 13:14:37.958435       1 event.go:282] Event(v1.ObjectReference{Kind:"Endpoints", Namespace:"kube-system", Name:"k8s.io-minikube-hostpath", UID:"9aea4c3a-dc15-4915-80c0-cef508913245", APIVersion:"v1", ResourceVersion:"837", FieldPath:""}): type: 'Normal' reason: 'LeaderElection' old-k8s-version-112335_08afc7d5-87e2-4fcb-8330-374640d7275a became leader
	I0812 13:14:38.062538       1 controller.go:884] Started provisioner controller k8s.io/minikube-hostpath_old-k8s-version-112335_08afc7d5-87e2-4fcb-8330-374640d7275a!
	

                                                
                                                
-- /stdout --
helpers_test.go:254: (dbg) Run:  out/minikube-linux-arm64 status --format={{.APIServer}} -p old-k8s-version-112335 -n old-k8s-version-112335
helpers_test.go:261: (dbg) Run:  kubectl --context old-k8s-version-112335 get po -o=jsonpath={.items[*].metadata.name} -A --field-selector=status.phase!=Running
helpers_test.go:272: non-running pods: metrics-server-9975d5f86-v2prr
helpers_test.go:274: ======> post-mortem[TestStartStop/group/old-k8s-version/serial/SecondStart]: describe non-running pods <======
helpers_test.go:277: (dbg) Run:  kubectl --context old-k8s-version-112335 describe pod metrics-server-9975d5f86-v2prr
helpers_test.go:277: (dbg) Non-zero exit: kubectl --context old-k8s-version-112335 describe pod metrics-server-9975d5f86-v2prr: exit status 1 (146.247431ms)

                                                
                                                
** stderr ** 
	Error from server (NotFound): pods "metrics-server-9975d5f86-v2prr" not found

                                                
                                                
** /stderr **
helpers_test.go:279: kubectl --context old-k8s-version-112335 describe pod metrics-server-9975d5f86-v2prr: exit status 1
--- FAIL: TestStartStop/group/old-k8s-version/serial/SecondStart (379.47s)

                                                
                                    

Test pass (303/336)

Order passed test Duration
3 TestDownloadOnly/v1.20.0/json-events 8.18
4 TestDownloadOnly/v1.20.0/preload-exists 0
8 TestDownloadOnly/v1.20.0/LogsDuration 0.07
9 TestDownloadOnly/v1.20.0/DeleteAll 0.2
10 TestDownloadOnly/v1.20.0/DeleteAlwaysSucceeds 0.14
12 TestDownloadOnly/v1.30.3/json-events 7.16
13 TestDownloadOnly/v1.30.3/preload-exists 0
17 TestDownloadOnly/v1.30.3/LogsDuration 0.08
18 TestDownloadOnly/v1.30.3/DeleteAll 0.21
19 TestDownloadOnly/v1.30.3/DeleteAlwaysSucceeds 0.13
21 TestDownloadOnly/v1.31.0-rc.0/json-events 7.51
22 TestDownloadOnly/v1.31.0-rc.0/preload-exists 0
26 TestDownloadOnly/v1.31.0-rc.0/LogsDuration 0.42
27 TestDownloadOnly/v1.31.0-rc.0/DeleteAll 0.4
28 TestDownloadOnly/v1.31.0-rc.0/DeleteAlwaysSucceeds 0.39
30 TestBinaryMirror 0.6
34 TestAddons/PreSetup/EnablingAddonOnNonExistingCluster 0.07
35 TestAddons/PreSetup/DisablingAddonOnNonExistingCluster 0.08
36 TestAddons/Setup 161.45
40 TestAddons/serial/GCPAuth/Namespaces 0.17
42 TestAddons/parallel/Registry 15.73
43 TestAddons/parallel/Ingress 19.28
44 TestAddons/parallel/InspektorGadget 11.92
45 TestAddons/parallel/MetricsServer 6.83
48 TestAddons/parallel/CSI 60.34
49 TestAddons/parallel/Headlamp 16.92
50 TestAddons/parallel/CloudSpanner 6.56
51 TestAddons/parallel/LocalPath 51.57
52 TestAddons/parallel/NvidiaDevicePlugin 6.55
53 TestAddons/parallel/Yakd 11.8
54 TestAddons/StoppedEnableDisable 12.3
55 TestCertOptions 41.67
56 TestCertExpiration 231.84
58 TestForceSystemdFlag 37.77
59 TestForceSystemdEnv 44.07
60 TestDockerEnvContainerd 46.37
65 TestErrorSpam/setup 32.53
66 TestErrorSpam/start 0.98
67 TestErrorSpam/status 1.05
68 TestErrorSpam/pause 1.76
69 TestErrorSpam/unpause 1.84
70 TestErrorSpam/stop 1.44
73 TestFunctional/serial/CopySyncFile 0
74 TestFunctional/serial/StartWithProxy 57.84
75 TestFunctional/serial/AuditLog 0
76 TestFunctional/serial/SoftStart 6.34
77 TestFunctional/serial/KubeContext 0.07
78 TestFunctional/serial/KubectlGetPods 0.1
81 TestFunctional/serial/CacheCmd/cache/add_remote 3.77
82 TestFunctional/serial/CacheCmd/cache/add_local 1.24
83 TestFunctional/serial/CacheCmd/cache/CacheDelete 0.05
84 TestFunctional/serial/CacheCmd/cache/list 0.06
85 TestFunctional/serial/CacheCmd/cache/verify_cache_inside_node 0.31
86 TestFunctional/serial/CacheCmd/cache/cache_reload 2
87 TestFunctional/serial/CacheCmd/cache/delete 0.11
88 TestFunctional/serial/MinikubeKubectlCmd 0.14
89 TestFunctional/serial/MinikubeKubectlCmdDirectly 0.14
90 TestFunctional/serial/ExtraConfig 54.4
91 TestFunctional/serial/ComponentHealth 0.11
92 TestFunctional/serial/LogsCmd 1.57
93 TestFunctional/serial/LogsFileCmd 1.64
94 TestFunctional/serial/InvalidService 3.78
96 TestFunctional/parallel/ConfigCmd 0.47
97 TestFunctional/parallel/DashboardCmd 6.86
98 TestFunctional/parallel/DryRun 0.61
99 TestFunctional/parallel/InternationalLanguage 0.25
100 TestFunctional/parallel/StatusCmd 1.3
104 TestFunctional/parallel/ServiceCmdConnect 9.64
105 TestFunctional/parallel/AddonsCmd 0.14
106 TestFunctional/parallel/PersistentVolumeClaim 91.96
108 TestFunctional/parallel/SSHCmd 0.76
109 TestFunctional/parallel/CpCmd 2.46
111 TestFunctional/parallel/FileSync 0.27
112 TestFunctional/parallel/CertSync 1.8
116 TestFunctional/parallel/NodeLabels 0.08
118 TestFunctional/parallel/NonActiveRuntimeDisabled 0.68
120 TestFunctional/parallel/License 0.22
122 TestFunctional/parallel/TunnelCmd/serial/RunSecondTunnel 0.68
123 TestFunctional/parallel/TunnelCmd/serial/StartTunnel 0
125 TestFunctional/parallel/TunnelCmd/serial/WaitService/Setup 43.43
126 TestFunctional/parallel/TunnelCmd/serial/WaitService/IngressIP 0.08
127 TestFunctional/parallel/TunnelCmd/serial/AccessDirect 0
131 TestFunctional/parallel/TunnelCmd/serial/DeleteTunnel 0.11
132 TestFunctional/parallel/ServiceCmd/DeployApp 8.25
133 TestFunctional/parallel/ServiceCmd/List 0.51
134 TestFunctional/parallel/ServiceCmd/JSONOutput 0.55
135 TestFunctional/parallel/ServiceCmd/HTTPS 0.38
136 TestFunctional/parallel/ServiceCmd/Format 0.38
137 TestFunctional/parallel/ServiceCmd/URL 0.38
138 TestFunctional/parallel/ProfileCmd/profile_not_create 0.41
139 TestFunctional/parallel/ProfileCmd/profile_list 0.39
140 TestFunctional/parallel/ProfileCmd/profile_json_output 0.4
141 TestFunctional/parallel/MountCmd/any-port 5.21
142 TestFunctional/parallel/MountCmd/specific-port 1.87
143 TestFunctional/parallel/MountCmd/VerifyCleanup 1.47
144 TestFunctional/parallel/Version/short 0.09
145 TestFunctional/parallel/Version/components 1.27
146 TestFunctional/parallel/ImageCommands/ImageListShort 0.34
147 TestFunctional/parallel/ImageCommands/ImageListTable 0.25
148 TestFunctional/parallel/ImageCommands/ImageListJson 0.25
149 TestFunctional/parallel/ImageCommands/ImageListYaml 0.26
150 TestFunctional/parallel/ImageCommands/ImageBuild 2.67
151 TestFunctional/parallel/ImageCommands/Setup 0.94
152 TestFunctional/parallel/ImageCommands/ImageLoadDaemon 1.39
153 TestFunctional/parallel/ImageCommands/ImageReloadDaemon 1.15
154 TestFunctional/parallel/ImageCommands/ImageTagAndLoadDaemon 1.41
155 TestFunctional/parallel/ImageCommands/ImageSaveToFile 0.37
156 TestFunctional/parallel/ImageCommands/ImageRemove 0.5
157 TestFunctional/parallel/ImageCommands/ImageLoadFromFile 0.7
158 TestFunctional/parallel/ImageCommands/ImageSaveDaemon 0.42
159 TestFunctional/parallel/UpdateContextCmd/no_changes 0.14
160 TestFunctional/parallel/UpdateContextCmd/no_minikube_cluster 0.18
161 TestFunctional/parallel/UpdateContextCmd/no_clusters 0.15
162 TestFunctional/delete_echo-server_images 0.04
163 TestFunctional/delete_my-image_image 0.02
164 TestFunctional/delete_minikube_cached_images 0.02
168 TestMultiControlPlane/serial/StartCluster 129.9
169 TestMultiControlPlane/serial/DeployApp 31.05
170 TestMultiControlPlane/serial/PingHostFromPods 1.58
171 TestMultiControlPlane/serial/AddWorkerNode 23.21
172 TestMultiControlPlane/serial/NodeLabels 0.14
173 TestMultiControlPlane/serial/HAppyAfterClusterStart 0.79
174 TestMultiControlPlane/serial/CopyFile 20.36
175 TestMultiControlPlane/serial/StopSecondaryNode 13.18
176 TestMultiControlPlane/serial/DegradedAfterControlPlaneNodeStop 0.59
177 TestMultiControlPlane/serial/RestartSecondaryNode 19.58
178 TestMultiControlPlane/serial/HAppyAfterSecondaryNodeRestart 0.81
179 TestMultiControlPlane/serial/RestartClusterKeepsNodes 144.12
180 TestMultiControlPlane/serial/DeleteSecondaryNode 11.67
181 TestMultiControlPlane/serial/DegradedAfterSecondaryNodeDelete 0.55
182 TestMultiControlPlane/serial/StopCluster 36.2
183 TestMultiControlPlane/serial/RestartCluster 65.06
184 TestMultiControlPlane/serial/DegradedAfterClusterRestart 0.56
185 TestMultiControlPlane/serial/AddSecondaryNode 44.69
186 TestMultiControlPlane/serial/HAppyAfterSecondaryNodeAdd 0.83
190 TestJSONOutput/start/Command 70.39
191 TestJSONOutput/start/Audit 0
193 TestJSONOutput/start/parallel/DistinctCurrentSteps 0
194 TestJSONOutput/start/parallel/IncreasingCurrentSteps 0
196 TestJSONOutput/pause/Command 0.73
197 TestJSONOutput/pause/Audit 0
199 TestJSONOutput/pause/parallel/DistinctCurrentSteps 0
200 TestJSONOutput/pause/parallel/IncreasingCurrentSteps 0
202 TestJSONOutput/unpause/Command 0.66
203 TestJSONOutput/unpause/Audit 0
205 TestJSONOutput/unpause/parallel/DistinctCurrentSteps 0
206 TestJSONOutput/unpause/parallel/IncreasingCurrentSteps 0
208 TestJSONOutput/stop/Command 5.78
209 TestJSONOutput/stop/Audit 0
211 TestJSONOutput/stop/parallel/DistinctCurrentSteps 0
212 TestJSONOutput/stop/parallel/IncreasingCurrentSteps 0
213 TestErrorJSONOutput 0.23
215 TestKicCustomNetwork/create_custom_network 42.51
216 TestKicCustomNetwork/use_default_bridge_network 33.71
217 TestKicExistingNetwork 32.7
218 TestKicCustomSubnet 34.53
219 TestKicStaticIP 34.59
220 TestMainNoArgs 0.05
221 TestMinikubeProfile 69.64
224 TestMountStart/serial/StartWithMountFirst 6.48
225 TestMountStart/serial/VerifyMountFirst 0.27
226 TestMountStart/serial/StartWithMountSecond 9.05
227 TestMountStart/serial/VerifyMountSecond 0.27
228 TestMountStart/serial/DeleteFirst 1.63
229 TestMountStart/serial/VerifyMountPostDelete 0.28
230 TestMountStart/serial/Stop 1.23
231 TestMountStart/serial/RestartStopped 7.75
232 TestMountStart/serial/VerifyMountPostStop 0.28
235 TestMultiNode/serial/FreshStart2Nodes 76.75
236 TestMultiNode/serial/DeployApp2Nodes 19.06
237 TestMultiNode/serial/PingHostFrom2Pods 0.98
238 TestMultiNode/serial/AddNode 19.75
239 TestMultiNode/serial/MultiNodeLabels 0.1
240 TestMultiNode/serial/ProfileList 0.39
241 TestMultiNode/serial/CopyFile 10.34
242 TestMultiNode/serial/StopNode 2.31
243 TestMultiNode/serial/StartAfterStop 10.1
244 TestMultiNode/serial/RestartKeepsNodes 81.96
245 TestMultiNode/serial/DeleteNode 5.55
246 TestMultiNode/serial/StopMultiNode 24
247 TestMultiNode/serial/RestartMultiNode 54.82
248 TestMultiNode/serial/ValidateNameConflict 35.96
253 TestPreload 115.01
255 TestScheduledStopUnix 107.18
258 TestInsufficientStorage 11.08
259 TestRunningBinaryUpgrade 96.34
261 TestKubernetesUpgrade 359.94
262 TestMissingContainerUpgrade 166.86
264 TestPause/serial/Start 72.9
266 TestNoKubernetes/serial/StartNoK8sWithVersion 0.09
267 TestNoKubernetes/serial/StartWithK8s 45.1
268 TestNoKubernetes/serial/StartWithStopK8s 16.82
269 TestNoKubernetes/serial/Start 5.92
270 TestNoKubernetes/serial/VerifyK8sNotRunning 0.31
271 TestNoKubernetes/serial/ProfileList 1.02
272 TestNoKubernetes/serial/Stop 1.28
273 TestNoKubernetes/serial/StartNoArgs 7.46
274 TestPause/serial/SecondStartNoReconfiguration 7.94
275 TestNoKubernetes/serial/VerifyK8sNotRunningSecond 0.38
276 TestPause/serial/Pause 0.93
277 TestPause/serial/VerifyStatus 0.32
278 TestPause/serial/Unpause 0.89
279 TestPause/serial/PauseAgain 1.34
280 TestPause/serial/DeletePaused 4.84
281 TestPause/serial/VerifyDeletedResources 0.15
282 TestStoppedBinaryUpgrade/Setup 1.24
283 TestStoppedBinaryUpgrade/Upgrade 110.01
284 TestStoppedBinaryUpgrade/MinikubeLogs 1.14
299 TestNetworkPlugins/group/false 4.61
304 TestStartStop/group/old-k8s-version/serial/FirstStart 160.07
305 TestStartStop/group/old-k8s-version/serial/DeployApp 8.76
307 TestStartStop/group/no-preload/serial/FirstStart 80.66
308 TestStartStop/group/old-k8s-version/serial/EnableAddonWhileActive 1.53
309 TestStartStop/group/old-k8s-version/serial/Stop 13.93
310 TestStartStop/group/old-k8s-version/serial/EnableAddonAfterStop 0.31
312 TestStartStop/group/no-preload/serial/DeployApp 8.42
313 TestStartStop/group/no-preload/serial/EnableAddonWhileActive 1.16
314 TestStartStop/group/no-preload/serial/Stop 12.18
315 TestStartStop/group/no-preload/serial/EnableAddonAfterStop 0.18
316 TestStartStop/group/no-preload/serial/SecondStart 267.68
317 TestStartStop/group/no-preload/serial/UserAppExistsAfterStop 6.01
318 TestStartStop/group/no-preload/serial/AddonExistsAfterStop 5.1
319 TestStartStop/group/no-preload/serial/VerifyKubernetesImages 0.25
320 TestStartStop/group/no-preload/serial/Pause 3.21
322 TestStartStop/group/embed-certs/serial/FirstStart 76.94
323 TestStartStop/group/old-k8s-version/serial/UserAppExistsAfterStop 6.01
324 TestStartStop/group/old-k8s-version/serial/AddonExistsAfterStop 6.15
325 TestStartStop/group/old-k8s-version/serial/VerifyKubernetesImages 0.29
326 TestStartStop/group/old-k8s-version/serial/Pause 3.94
328 TestStartStop/group/default-k8s-diff-port/serial/FirstStart 64.69
329 TestStartStop/group/embed-certs/serial/DeployApp 9.33
330 TestStartStop/group/embed-certs/serial/EnableAddonWhileActive 1.1
331 TestStartStop/group/embed-certs/serial/Stop 12.2
332 TestStartStop/group/default-k8s-diff-port/serial/DeployApp 8.5
333 TestStartStop/group/embed-certs/serial/EnableAddonAfterStop 0.28
334 TestStartStop/group/embed-certs/serial/SecondStart 297.07
335 TestStartStop/group/default-k8s-diff-port/serial/EnableAddonWhileActive 1.67
336 TestStartStop/group/default-k8s-diff-port/serial/Stop 12.45
337 TestStartStop/group/default-k8s-diff-port/serial/EnableAddonAfterStop 0.18
338 TestStartStop/group/default-k8s-diff-port/serial/SecondStart 269.75
339 TestStartStop/group/default-k8s-diff-port/serial/UserAppExistsAfterStop 6.01
340 TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop 6.01
341 TestStartStop/group/default-k8s-diff-port/serial/AddonExistsAfterStop 6.11
342 TestStartStop/group/embed-certs/serial/AddonExistsAfterStop 5.16
343 TestStartStop/group/default-k8s-diff-port/serial/VerifyKubernetesImages 0.25
344 TestStartStop/group/default-k8s-diff-port/serial/Pause 3.11
345 TestStartStop/group/embed-certs/serial/VerifyKubernetesImages 0.29
346 TestStartStop/group/embed-certs/serial/Pause 4.71
348 TestStartStop/group/newest-cni/serial/FirstStart 43.05
349 TestNetworkPlugins/group/auto/Start 80.29
350 TestStartStop/group/newest-cni/serial/DeployApp 0
351 TestStartStop/group/newest-cni/serial/EnableAddonWhileActive 1.45
352 TestStartStop/group/newest-cni/serial/Stop 1.35
353 TestStartStop/group/newest-cni/serial/EnableAddonAfterStop 0.2
354 TestStartStop/group/newest-cni/serial/SecondStart 19.89
355 TestStartStop/group/newest-cni/serial/UserAppExistsAfterStop 0
356 TestStartStop/group/newest-cni/serial/AddonExistsAfterStop 0
357 TestStartStop/group/newest-cni/serial/VerifyKubernetesImages 0.26
358 TestStartStop/group/newest-cni/serial/Pause 3.04
359 TestNetworkPlugins/group/kindnet/Start 76.26
360 TestNetworkPlugins/group/auto/KubeletFlags 0.41
361 TestNetworkPlugins/group/auto/NetCatPod 12.31
362 TestNetworkPlugins/group/auto/DNS 0.25
363 TestNetworkPlugins/group/auto/Localhost 0.25
364 TestNetworkPlugins/group/auto/HairPin 0.18
365 TestNetworkPlugins/group/calico/Start 77.55
366 TestNetworkPlugins/group/kindnet/ControllerPod 6.01
367 TestNetworkPlugins/group/kindnet/KubeletFlags 0.31
368 TestNetworkPlugins/group/kindnet/NetCatPod 10.33
369 TestNetworkPlugins/group/kindnet/DNS 0.2
370 TestNetworkPlugins/group/kindnet/Localhost 0.17
371 TestNetworkPlugins/group/kindnet/HairPin 0.2
372 TestNetworkPlugins/group/custom-flannel/Start 62.44
373 TestNetworkPlugins/group/calico/ControllerPod 6.01
374 TestNetworkPlugins/group/calico/KubeletFlags 0.36
375 TestNetworkPlugins/group/calico/NetCatPod 11.34
376 TestNetworkPlugins/group/calico/DNS 0.25
377 TestNetworkPlugins/group/calico/Localhost 0.26
378 TestNetworkPlugins/group/calico/HairPin 0.27
379 TestNetworkPlugins/group/enable-default-cni/Start 56.03
380 TestNetworkPlugins/group/custom-flannel/KubeletFlags 0.36
381 TestNetworkPlugins/group/custom-flannel/NetCatPod 10.26
382 TestNetworkPlugins/group/custom-flannel/DNS 0.25
383 TestNetworkPlugins/group/custom-flannel/Localhost 0.19
384 TestNetworkPlugins/group/custom-flannel/HairPin 0.21
385 TestNetworkPlugins/group/flannel/Start 61.82
386 TestNetworkPlugins/group/enable-default-cni/KubeletFlags 0.41
387 TestNetworkPlugins/group/enable-default-cni/NetCatPod 11.36
388 TestNetworkPlugins/group/enable-default-cni/DNS 0.18
389 TestNetworkPlugins/group/enable-default-cni/Localhost 0.15
390 TestNetworkPlugins/group/enable-default-cni/HairPin 0.29
391 TestNetworkPlugins/group/bridge/Start 86.25
392 TestNetworkPlugins/group/flannel/ControllerPod 6.01
393 TestNetworkPlugins/group/flannel/KubeletFlags 0.47
394 TestNetworkPlugins/group/flannel/NetCatPod 12.4
395 TestNetworkPlugins/group/flannel/DNS 0.18
396 TestNetworkPlugins/group/flannel/Localhost 0.19
397 TestNetworkPlugins/group/flannel/HairPin 0.17
398 TestNetworkPlugins/group/bridge/KubeletFlags 0.28
399 TestNetworkPlugins/group/bridge/NetCatPod 8.26
400 TestNetworkPlugins/group/bridge/DNS 0.18
401 TestNetworkPlugins/group/bridge/Localhost 0.15
402 TestNetworkPlugins/group/bridge/HairPin 0.14
x
+
TestDownloadOnly/v1.20.0/json-events (8.18s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.20.0/json-events
aaa_download_only_test.go:81: (dbg) Run:  out/minikube-linux-arm64 start -o=json --download-only -p download-only-752214 --force --alsologtostderr --kubernetes-version=v1.20.0 --container-runtime=containerd --driver=docker  --container-runtime=containerd
aaa_download_only_test.go:81: (dbg) Done: out/minikube-linux-arm64 start -o=json --download-only -p download-only-752214 --force --alsologtostderr --kubernetes-version=v1.20.0 --container-runtime=containerd --driver=docker  --container-runtime=containerd: (8.180938952s)
--- PASS: TestDownloadOnly/v1.20.0/json-events (8.18s)

                                                
                                    
x
+
TestDownloadOnly/v1.20.0/preload-exists (0s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.20.0/preload-exists
--- PASS: TestDownloadOnly/v1.20.0/preload-exists (0.00s)

                                                
                                    
x
+
TestDownloadOnly/v1.20.0/LogsDuration (0.07s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.20.0/LogsDuration
aaa_download_only_test.go:184: (dbg) Run:  out/minikube-linux-arm64 logs -p download-only-752214
aaa_download_only_test.go:184: (dbg) Non-zero exit: out/minikube-linux-arm64 logs -p download-only-752214: exit status 85 (68.858359ms)

                                                
                                                
-- stdout --
	
	==> Audit <==
	|---------|--------------------------------|----------------------|---------|---------|---------------------|----------|
	| Command |              Args              |       Profile        |  User   | Version |     Start Time      | End Time |
	|---------|--------------------------------|----------------------|---------|---------|---------------------|----------|
	| start   | -o=json --download-only        | download-only-752214 | jenkins | v1.33.1 | 12 Aug 24 12:21 UTC |          |
	|         | -p download-only-752214        |                      |         |         |                     |          |
	|         | --force --alsologtostderr      |                      |         |         |                     |          |
	|         | --kubernetes-version=v1.20.0   |                      |         |         |                     |          |
	|         | --container-runtime=containerd |                      |         |         |                     |          |
	|         | --driver=docker                |                      |         |         |                     |          |
	|         | --container-runtime=containerd |                      |         |         |                     |          |
	|---------|--------------------------------|----------------------|---------|---------|---------------------|----------|
	
	
	==> Last Start <==
	Log file created at: 2024/08/12 12:21:35
	Running on machine: ip-172-31-30-239
	Binary: Built with gc go1.22.5 for linux/arm64
	Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg
	I0812 12:21:35.467536 1004375 out.go:291] Setting OutFile to fd 1 ...
	I0812 12:21:35.467763 1004375 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0812 12:21:35.467792 1004375 out.go:304] Setting ErrFile to fd 2...
	I0812 12:21:35.467812 1004375 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0812 12:21:35.468071 1004375 root.go:338] Updating PATH: /home/jenkins/minikube-integration/19411-998978/.minikube/bin
	W0812 12:21:35.468230 1004375 root.go:314] Error reading config file at /home/jenkins/minikube-integration/19411-998978/.minikube/config/config.json: open /home/jenkins/minikube-integration/19411-998978/.minikube/config/config.json: no such file or directory
	I0812 12:21:35.468662 1004375 out.go:298] Setting JSON to true
	I0812 12:21:35.469723 1004375 start.go:129] hostinfo: {"hostname":"ip-172-31-30-239","uptime":14644,"bootTime":1723450651,"procs":189,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1066-aws","kernelArch":"aarch64","virtualizationSystem":"","virtualizationRole":"","hostId":"92f46a7d-c249-4c12-924a-77f64874c910"}
	I0812 12:21:35.469825 1004375 start.go:139] virtualization:  
	I0812 12:21:35.473878 1004375 out.go:97] [download-only-752214] minikube v1.33.1 on Ubuntu 20.04 (arm64)
	W0812 12:21:35.474145 1004375 preload.go:293] Failed to list preload files: open /home/jenkins/minikube-integration/19411-998978/.minikube/cache/preloaded-tarball: no such file or directory
	I0812 12:21:35.474220 1004375 notify.go:220] Checking for updates...
	I0812 12:21:35.476609 1004375 out.go:169] MINIKUBE_LOCATION=19411
	I0812 12:21:35.479259 1004375 out.go:169] MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I0812 12:21:35.481996 1004375 out.go:169] KUBECONFIG=/home/jenkins/minikube-integration/19411-998978/kubeconfig
	I0812 12:21:35.484661 1004375 out.go:169] MINIKUBE_HOME=/home/jenkins/minikube-integration/19411-998978/.minikube
	I0812 12:21:35.487340 1004375 out.go:169] MINIKUBE_BIN=out/minikube-linux-arm64
	W0812 12:21:35.492480 1004375 out.go:267] minikube skips various validations when --force is supplied; this may lead to unexpected behavior
	I0812 12:21:35.492818 1004375 driver.go:392] Setting default libvirt URI to qemu:///system
	I0812 12:21:35.514041 1004375 docker.go:123] docker version: linux-27.1.1:Docker Engine - Community
	I0812 12:21:35.514163 1004375 cli_runner.go:164] Run: docker system info --format "{{json .}}"
	I0812 12:21:35.592144 1004375 info.go:266] docker info: {ID:6ZPO:QZND:VNGE:LUKL:4Y3K:XELL:AAX4:2GTK:E6LM:MPRN:3ZXR:TTMR Containers:0 ContainersRunning:0 ContainersPaused:0 ContainersStopped:0 Images:1 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:29 OomKillDisable:true NGoroutines:51 SystemTime:2024-08-12 12:21:35.581172037 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1066-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Architecture:aar
ch64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8214896640 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-30-239 Labels:[] ExperimentalBuild:false ServerVersion:27.1.1 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:2bf793ef6dc9a18e00cb12efb64355c2c9d5eb41 Expected:2bf793ef6dc9a18e00cb12efb64355c2c9d5eb41} RuncCommit:{ID:v1.1.13-0-g58aa920 Expected:v1.1.13-0-g58aa920} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:<nil> ServerErro
rs:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.16.1] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.29.1]] Warnings:<nil>}}
	I0812 12:21:35.592265 1004375 docker.go:307] overlay module found
	I0812 12:21:35.595857 1004375 out.go:97] Using the docker driver based on user configuration
	I0812 12:21:35.595891 1004375 start.go:297] selected driver: docker
	I0812 12:21:35.595898 1004375 start.go:901] validating driver "docker" against <nil>
	I0812 12:21:35.596018 1004375 cli_runner.go:164] Run: docker system info --format "{{json .}}"
	I0812 12:21:35.650533 1004375 info.go:266] docker info: {ID:6ZPO:QZND:VNGE:LUKL:4Y3K:XELL:AAX4:2GTK:E6LM:MPRN:3ZXR:TTMR Containers:0 ContainersRunning:0 ContainersPaused:0 ContainersStopped:0 Images:1 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:29 OomKillDisable:true NGoroutines:51 SystemTime:2024-08-12 12:21:35.640571974 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1066-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Architecture:aar
ch64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8214896640 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-30-239 Labels:[] ExperimentalBuild:false ServerVersion:27.1.1 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:2bf793ef6dc9a18e00cb12efb64355c2c9d5eb41 Expected:2bf793ef6dc9a18e00cb12efb64355c2c9d5eb41} RuncCommit:{ID:v1.1.13-0-g58aa920 Expected:v1.1.13-0-g58aa920} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:<nil> ServerErro
rs:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.16.1] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.29.1]] Warnings:<nil>}}
	I0812 12:21:35.650700 1004375 start_flags.go:310] no existing cluster config was found, will generate one from the flags 
	I0812 12:21:35.650996 1004375 start_flags.go:393] Using suggested 2200MB memory alloc based on sys=7834MB, container=7834MB
	I0812 12:21:35.651186 1004375 start_flags.go:929] Wait components to verify : map[apiserver:true system_pods:true]
	I0812 12:21:35.654146 1004375 out.go:169] Using Docker driver with root privileges
	I0812 12:21:35.656828 1004375 cni.go:84] Creating CNI manager for ""
	I0812 12:21:35.656851 1004375 cni.go:143] "docker" driver + "containerd" runtime found, recommending kindnet
	I0812 12:21:35.656871 1004375 start_flags.go:319] Found "CNI" CNI - setting NetworkPlugin=cni
	I0812 12:21:35.656969 1004375 start.go:340] cluster config:
	{Name:download-only-752214 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1723026928-19389@sha256:7715fe0c5dce35b4eb757765cbbe02d40cd8b5effa0639735e42ad89f4f51ef0 Memory:2200 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:download-only-752214 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local Co
ntainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I0812 12:21:35.659524 1004375 out.go:97] Starting "download-only-752214" primary control-plane node in "download-only-752214" cluster
	I0812 12:21:35.659561 1004375 cache.go:121] Beginning downloading kic base image for docker with containerd
	I0812 12:21:35.662216 1004375 out.go:97] Pulling base image v0.0.44-1723026928-19389 ...
	I0812 12:21:35.662253 1004375 preload.go:131] Checking if preload exists for k8s version v1.20.0 and runtime containerd
	I0812 12:21:35.662414 1004375 image.go:79] Checking for gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1723026928-19389@sha256:7715fe0c5dce35b4eb757765cbbe02d40cd8b5effa0639735e42ad89f4f51ef0 in local docker daemon
	I0812 12:21:35.676547 1004375 cache.go:149] Downloading gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1723026928-19389@sha256:7715fe0c5dce35b4eb757765cbbe02d40cd8b5effa0639735e42ad89f4f51ef0 to local cache
	I0812 12:21:35.676720 1004375 image.go:63] Checking for gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1723026928-19389@sha256:7715fe0c5dce35b4eb757765cbbe02d40cd8b5effa0639735e42ad89f4f51ef0 in local cache directory
	I0812 12:21:35.676818 1004375 image.go:148] Writing gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1723026928-19389@sha256:7715fe0c5dce35b4eb757765cbbe02d40cd8b5effa0639735e42ad89f4f51ef0 to local cache
	I0812 12:21:35.735007 1004375 preload.go:118] Found remote preload: https://storage.googleapis.com/minikube-preloaded-volume-tarballs/v18/v1.20.0/preloaded-images-k8s-v18-v1.20.0-containerd-overlay2-arm64.tar.lz4
	I0812 12:21:35.735037 1004375 cache.go:56] Caching tarball of preloaded images
	I0812 12:21:35.735807 1004375 preload.go:131] Checking if preload exists for k8s version v1.20.0 and runtime containerd
	I0812 12:21:35.738743 1004375 out.go:97] Downloading Kubernetes v1.20.0 preload ...
	I0812 12:21:35.738764 1004375 preload.go:236] getting checksum for preloaded-images-k8s-v18-v1.20.0-containerd-overlay2-arm64.tar.lz4 ...
	I0812 12:21:35.848844 1004375 download.go:107] Downloading: https://storage.googleapis.com/minikube-preloaded-volume-tarballs/v18/v1.20.0/preloaded-images-k8s-v18-v1.20.0-containerd-overlay2-arm64.tar.lz4?checksum=md5:7e3d48ccb9f143791669d02e14ce1643 -> /home/jenkins/minikube-integration/19411-998978/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-containerd-overlay2-arm64.tar.lz4
	
	
	* The control-plane node download-only-752214 host does not exist
	  To start a cluster, run: "minikube start -p download-only-752214"

                                                
                                                
-- /stdout --
aaa_download_only_test.go:185: minikube logs failed with error: exit status 85
--- PASS: TestDownloadOnly/v1.20.0/LogsDuration (0.07s)

                                                
                                    
x
+
TestDownloadOnly/v1.20.0/DeleteAll (0.2s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.20.0/DeleteAll
aaa_download_only_test.go:197: (dbg) Run:  out/minikube-linux-arm64 delete --all
--- PASS: TestDownloadOnly/v1.20.0/DeleteAll (0.20s)

                                                
                                    
x
+
TestDownloadOnly/v1.20.0/DeleteAlwaysSucceeds (0.14s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.20.0/DeleteAlwaysSucceeds
aaa_download_only_test.go:208: (dbg) Run:  out/minikube-linux-arm64 delete -p download-only-752214
--- PASS: TestDownloadOnly/v1.20.0/DeleteAlwaysSucceeds (0.14s)

                                                
                                    
x
+
TestDownloadOnly/v1.30.3/json-events (7.16s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.30.3/json-events
aaa_download_only_test.go:81: (dbg) Run:  out/minikube-linux-arm64 start -o=json --download-only -p download-only-767584 --force --alsologtostderr --kubernetes-version=v1.30.3 --container-runtime=containerd --driver=docker  --container-runtime=containerd
aaa_download_only_test.go:81: (dbg) Done: out/minikube-linux-arm64 start -o=json --download-only -p download-only-767584 --force --alsologtostderr --kubernetes-version=v1.30.3 --container-runtime=containerd --driver=docker  --container-runtime=containerd: (7.161753142s)
--- PASS: TestDownloadOnly/v1.30.3/json-events (7.16s)

                                                
                                    
x
+
TestDownloadOnly/v1.30.3/preload-exists (0s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.30.3/preload-exists
--- PASS: TestDownloadOnly/v1.30.3/preload-exists (0.00s)

                                                
                                    
x
+
TestDownloadOnly/v1.30.3/LogsDuration (0.08s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.30.3/LogsDuration
aaa_download_only_test.go:184: (dbg) Run:  out/minikube-linux-arm64 logs -p download-only-767584
aaa_download_only_test.go:184: (dbg) Non-zero exit: out/minikube-linux-arm64 logs -p download-only-767584: exit status 85 (75.425798ms)

                                                
                                                
-- stdout --
	
	==> Audit <==
	|---------|--------------------------------|----------------------|---------|---------|---------------------|---------------------|
	| Command |              Args              |       Profile        |  User   | Version |     Start Time      |      End Time       |
	|---------|--------------------------------|----------------------|---------|---------|---------------------|---------------------|
	| start   | -o=json --download-only        | download-only-752214 | jenkins | v1.33.1 | 12 Aug 24 12:21 UTC |                     |
	|         | -p download-only-752214        |                      |         |         |                     |                     |
	|         | --force --alsologtostderr      |                      |         |         |                     |                     |
	|         | --kubernetes-version=v1.20.0   |                      |         |         |                     |                     |
	|         | --container-runtime=containerd |                      |         |         |                     |                     |
	|         | --driver=docker                |                      |         |         |                     |                     |
	|         | --container-runtime=containerd |                      |         |         |                     |                     |
	| delete  | --all                          | minikube             | jenkins | v1.33.1 | 12 Aug 24 12:21 UTC | 12 Aug 24 12:21 UTC |
	| delete  | -p download-only-752214        | download-only-752214 | jenkins | v1.33.1 | 12 Aug 24 12:21 UTC | 12 Aug 24 12:21 UTC |
	| start   | -o=json --download-only        | download-only-767584 | jenkins | v1.33.1 | 12 Aug 24 12:21 UTC |                     |
	|         | -p download-only-767584        |                      |         |         |                     |                     |
	|         | --force --alsologtostderr      |                      |         |         |                     |                     |
	|         | --kubernetes-version=v1.30.3   |                      |         |         |                     |                     |
	|         | --container-runtime=containerd |                      |         |         |                     |                     |
	|         | --driver=docker                |                      |         |         |                     |                     |
	|         | --container-runtime=containerd |                      |         |         |                     |                     |
	|---------|--------------------------------|----------------------|---------|---------|---------------------|---------------------|
	
	
	==> Last Start <==
	Log file created at: 2024/08/12 12:21:44
	Running on machine: ip-172-31-30-239
	Binary: Built with gc go1.22.5 for linux/arm64
	Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg
	I0812 12:21:44.069410 1004585 out.go:291] Setting OutFile to fd 1 ...
	I0812 12:21:44.069544 1004585 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0812 12:21:44.069555 1004585 out.go:304] Setting ErrFile to fd 2...
	I0812 12:21:44.069567 1004585 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0812 12:21:44.070392 1004585 root.go:338] Updating PATH: /home/jenkins/minikube-integration/19411-998978/.minikube/bin
	I0812 12:21:44.070914 1004585 out.go:298] Setting JSON to true
	I0812 12:21:44.071926 1004585 start.go:129] hostinfo: {"hostname":"ip-172-31-30-239","uptime":14653,"bootTime":1723450651,"procs":187,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1066-aws","kernelArch":"aarch64","virtualizationSystem":"","virtualizationRole":"","hostId":"92f46a7d-c249-4c12-924a-77f64874c910"}
	I0812 12:21:44.072036 1004585 start.go:139] virtualization:  
	I0812 12:21:44.074430 1004585 out.go:97] [download-only-767584] minikube v1.33.1 on Ubuntu 20.04 (arm64)
	I0812 12:21:44.074718 1004585 notify.go:220] Checking for updates...
	I0812 12:21:44.076660 1004585 out.go:169] MINIKUBE_LOCATION=19411
	I0812 12:21:44.078593 1004585 out.go:169] MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I0812 12:21:44.080585 1004585 out.go:169] KUBECONFIG=/home/jenkins/minikube-integration/19411-998978/kubeconfig
	I0812 12:21:44.082347 1004585 out.go:169] MINIKUBE_HOME=/home/jenkins/minikube-integration/19411-998978/.minikube
	I0812 12:21:44.084140 1004585 out.go:169] MINIKUBE_BIN=out/minikube-linux-arm64
	W0812 12:21:44.087452 1004585 out.go:267] minikube skips various validations when --force is supplied; this may lead to unexpected behavior
	I0812 12:21:44.087750 1004585 driver.go:392] Setting default libvirt URI to qemu:///system
	I0812 12:21:44.109593 1004585 docker.go:123] docker version: linux-27.1.1:Docker Engine - Community
	I0812 12:21:44.109733 1004585 cli_runner.go:164] Run: docker system info --format "{{json .}}"
	I0812 12:21:44.183765 1004585 info.go:266] docker info: {ID:6ZPO:QZND:VNGE:LUKL:4Y3K:XELL:AAX4:2GTK:E6LM:MPRN:3ZXR:TTMR Containers:0 ContainersRunning:0 ContainersPaused:0 ContainersStopped:0 Images:1 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:29 OomKillDisable:true NGoroutines:45 SystemTime:2024-08-12 12:21:44.170085219 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1066-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Architecture:aar
ch64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8214896640 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-30-239 Labels:[] ExperimentalBuild:false ServerVersion:27.1.1 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:2bf793ef6dc9a18e00cb12efb64355c2c9d5eb41 Expected:2bf793ef6dc9a18e00cb12efb64355c2c9d5eb41} RuncCommit:{ID:v1.1.13-0-g58aa920 Expected:v1.1.13-0-g58aa920} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:<nil> ServerErro
rs:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.16.1] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.29.1]] Warnings:<nil>}}
	I0812 12:21:44.183872 1004585 docker.go:307] overlay module found
	I0812 12:21:44.185535 1004585 out.go:97] Using the docker driver based on user configuration
	I0812 12:21:44.185558 1004585 start.go:297] selected driver: docker
	I0812 12:21:44.185565 1004585 start.go:901] validating driver "docker" against <nil>
	I0812 12:21:44.185674 1004585 cli_runner.go:164] Run: docker system info --format "{{json .}}"
	I0812 12:21:44.241460 1004585 info.go:266] docker info: {ID:6ZPO:QZND:VNGE:LUKL:4Y3K:XELL:AAX4:2GTK:E6LM:MPRN:3ZXR:TTMR Containers:0 ContainersRunning:0 ContainersPaused:0 ContainersStopped:0 Images:1 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:25 OomKillDisable:true NGoroutines:45 SystemTime:2024-08-12 12:21:44.231519281 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1066-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Architecture:aar
ch64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8214896640 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-30-239 Labels:[] ExperimentalBuild:false ServerVersion:27.1.1 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:2bf793ef6dc9a18e00cb12efb64355c2c9d5eb41 Expected:2bf793ef6dc9a18e00cb12efb64355c2c9d5eb41} RuncCommit:{ID:v1.1.13-0-g58aa920 Expected:v1.1.13-0-g58aa920} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:<nil> ServerErro
rs:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.16.1] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.29.1]] Warnings:<nil>}}
	I0812 12:21:44.241640 1004585 start_flags.go:310] no existing cluster config was found, will generate one from the flags 
	I0812 12:21:44.241990 1004585 start_flags.go:393] Using suggested 2200MB memory alloc based on sys=7834MB, container=7834MB
	I0812 12:21:44.242152 1004585 start_flags.go:929] Wait components to verify : map[apiserver:true system_pods:true]
	I0812 12:21:44.244217 1004585 out.go:169] Using Docker driver with root privileges
	I0812 12:21:44.245978 1004585 cni.go:84] Creating CNI manager for ""
	I0812 12:21:44.246009 1004585 cni.go:143] "docker" driver + "containerd" runtime found, recommending kindnet
	I0812 12:21:44.246021 1004585 start_flags.go:319] Found "CNI" CNI - setting NetworkPlugin=cni
	I0812 12:21:44.246114 1004585 start.go:340] cluster config:
	{Name:download-only-767584 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1723026928-19389@sha256:7715fe0c5dce35b4eb757765cbbe02d40cd8b5effa0639735e42ad89f4f51ef0 Memory:2200 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.30.3 ClusterName:download-only-767584 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local Co
ntainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.30.3 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I0812 12:21:44.247902 1004585 out.go:97] Starting "download-only-767584" primary control-plane node in "download-only-767584" cluster
	I0812 12:21:44.247920 1004585 cache.go:121] Beginning downloading kic base image for docker with containerd
	I0812 12:21:44.249414 1004585 out.go:97] Pulling base image v0.0.44-1723026928-19389 ...
	I0812 12:21:44.249444 1004585 preload.go:131] Checking if preload exists for k8s version v1.30.3 and runtime containerd
	I0812 12:21:44.249624 1004585 image.go:79] Checking for gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1723026928-19389@sha256:7715fe0c5dce35b4eb757765cbbe02d40cd8b5effa0639735e42ad89f4f51ef0 in local docker daemon
	I0812 12:21:44.265082 1004585 cache.go:149] Downloading gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1723026928-19389@sha256:7715fe0c5dce35b4eb757765cbbe02d40cd8b5effa0639735e42ad89f4f51ef0 to local cache
	I0812 12:21:44.265212 1004585 image.go:63] Checking for gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1723026928-19389@sha256:7715fe0c5dce35b4eb757765cbbe02d40cd8b5effa0639735e42ad89f4f51ef0 in local cache directory
	I0812 12:21:44.265277 1004585 image.go:66] Found gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1723026928-19389@sha256:7715fe0c5dce35b4eb757765cbbe02d40cd8b5effa0639735e42ad89f4f51ef0 in local cache directory, skipping pull
	I0812 12:21:44.265289 1004585 image.go:135] gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1723026928-19389@sha256:7715fe0c5dce35b4eb757765cbbe02d40cd8b5effa0639735e42ad89f4f51ef0 exists in cache, skipping pull
	I0812 12:21:44.265298 1004585 cache.go:152] successfully saved gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1723026928-19389@sha256:7715fe0c5dce35b4eb757765cbbe02d40cd8b5effa0639735e42ad89f4f51ef0 as a tarball
	I0812 12:21:44.318580 1004585 preload.go:118] Found remote preload: https://storage.googleapis.com/minikube-preloaded-volume-tarballs/v18/v1.30.3/preloaded-images-k8s-v18-v1.30.3-containerd-overlay2-arm64.tar.lz4
	I0812 12:21:44.318614 1004585 cache.go:56] Caching tarball of preloaded images
	I0812 12:21:44.318778 1004585 preload.go:131] Checking if preload exists for k8s version v1.30.3 and runtime containerd
	I0812 12:21:44.320814 1004585 out.go:97] Downloading Kubernetes v1.30.3 preload ...
	I0812 12:21:44.320861 1004585 preload.go:236] getting checksum for preloaded-images-k8s-v18-v1.30.3-containerd-overlay2-arm64.tar.lz4 ...
	I0812 12:21:44.431592 1004585 download.go:107] Downloading: https://storage.googleapis.com/minikube-preloaded-volume-tarballs/v18/v1.30.3/preloaded-images-k8s-v18-v1.30.3-containerd-overlay2-arm64.tar.lz4?checksum=md5:2969442dcdf6412905c6484ccc8dd1ed -> /home/jenkins/minikube-integration/19411-998978/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.30.3-containerd-overlay2-arm64.tar.lz4
	
	
	* The control-plane node download-only-767584 host does not exist
	  To start a cluster, run: "minikube start -p download-only-767584"

                                                
                                                
-- /stdout --
aaa_download_only_test.go:185: minikube logs failed with error: exit status 85
--- PASS: TestDownloadOnly/v1.30.3/LogsDuration (0.08s)

                                                
                                    
x
+
TestDownloadOnly/v1.30.3/DeleteAll (0.21s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.30.3/DeleteAll
aaa_download_only_test.go:197: (dbg) Run:  out/minikube-linux-arm64 delete --all
--- PASS: TestDownloadOnly/v1.30.3/DeleteAll (0.21s)

                                                
                                    
x
+
TestDownloadOnly/v1.30.3/DeleteAlwaysSucceeds (0.13s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.30.3/DeleteAlwaysSucceeds
aaa_download_only_test.go:208: (dbg) Run:  out/minikube-linux-arm64 delete -p download-only-767584
--- PASS: TestDownloadOnly/v1.30.3/DeleteAlwaysSucceeds (0.13s)

                                                
                                    
x
+
TestDownloadOnly/v1.31.0-rc.0/json-events (7.51s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.31.0-rc.0/json-events
aaa_download_only_test.go:81: (dbg) Run:  out/minikube-linux-arm64 start -o=json --download-only -p download-only-005875 --force --alsologtostderr --kubernetes-version=v1.31.0-rc.0 --container-runtime=containerd --driver=docker  --container-runtime=containerd
aaa_download_only_test.go:81: (dbg) Done: out/minikube-linux-arm64 start -o=json --download-only -p download-only-005875 --force --alsologtostderr --kubernetes-version=v1.31.0-rc.0 --container-runtime=containerd --driver=docker  --container-runtime=containerd: (7.505236892s)
--- PASS: TestDownloadOnly/v1.31.0-rc.0/json-events (7.51s)

                                                
                                    
x
+
TestDownloadOnly/v1.31.0-rc.0/preload-exists (0s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.31.0-rc.0/preload-exists
--- PASS: TestDownloadOnly/v1.31.0-rc.0/preload-exists (0.00s)

                                                
                                    
x
+
TestDownloadOnly/v1.31.0-rc.0/LogsDuration (0.42s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.31.0-rc.0/LogsDuration
aaa_download_only_test.go:184: (dbg) Run:  out/minikube-linux-arm64 logs -p download-only-005875
aaa_download_only_test.go:184: (dbg) Non-zero exit: out/minikube-linux-arm64 logs -p download-only-005875: exit status 85 (423.294336ms)

                                                
                                                
-- stdout --
	
	==> Audit <==
	|---------|-----------------------------------|----------------------|---------|---------|---------------------|---------------------|
	| Command |               Args                |       Profile        |  User   | Version |     Start Time      |      End Time       |
	|---------|-----------------------------------|----------------------|---------|---------|---------------------|---------------------|
	| start   | -o=json --download-only           | download-only-752214 | jenkins | v1.33.1 | 12 Aug 24 12:21 UTC |                     |
	|         | -p download-only-752214           |                      |         |         |                     |                     |
	|         | --force --alsologtostderr         |                      |         |         |                     |                     |
	|         | --kubernetes-version=v1.20.0      |                      |         |         |                     |                     |
	|         | --container-runtime=containerd    |                      |         |         |                     |                     |
	|         | --driver=docker                   |                      |         |         |                     |                     |
	|         | --container-runtime=containerd    |                      |         |         |                     |                     |
	| delete  | --all                             | minikube             | jenkins | v1.33.1 | 12 Aug 24 12:21 UTC | 12 Aug 24 12:21 UTC |
	| delete  | -p download-only-752214           | download-only-752214 | jenkins | v1.33.1 | 12 Aug 24 12:21 UTC | 12 Aug 24 12:21 UTC |
	| start   | -o=json --download-only           | download-only-767584 | jenkins | v1.33.1 | 12 Aug 24 12:21 UTC |                     |
	|         | -p download-only-767584           |                      |         |         |                     |                     |
	|         | --force --alsologtostderr         |                      |         |         |                     |                     |
	|         | --kubernetes-version=v1.30.3      |                      |         |         |                     |                     |
	|         | --container-runtime=containerd    |                      |         |         |                     |                     |
	|         | --driver=docker                   |                      |         |         |                     |                     |
	|         | --container-runtime=containerd    |                      |         |         |                     |                     |
	| delete  | --all                             | minikube             | jenkins | v1.33.1 | 12 Aug 24 12:21 UTC | 12 Aug 24 12:21 UTC |
	| delete  | -p download-only-767584           | download-only-767584 | jenkins | v1.33.1 | 12 Aug 24 12:21 UTC | 12 Aug 24 12:21 UTC |
	| start   | -o=json --download-only           | download-only-005875 | jenkins | v1.33.1 | 12 Aug 24 12:21 UTC |                     |
	|         | -p download-only-005875           |                      |         |         |                     |                     |
	|         | --force --alsologtostderr         |                      |         |         |                     |                     |
	|         | --kubernetes-version=v1.31.0-rc.0 |                      |         |         |                     |                     |
	|         | --container-runtime=containerd    |                      |         |         |                     |                     |
	|         | --driver=docker                   |                      |         |         |                     |                     |
	|         | --container-runtime=containerd    |                      |         |         |                     |                     |
	|---------|-----------------------------------|----------------------|---------|---------|---------------------|---------------------|
	
	
	==> Last Start <==
	Log file created at: 2024/08/12 12:21:51
	Running on machine: ip-172-31-30-239
	Binary: Built with gc go1.22.5 for linux/arm64
	Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg
	I0812 12:21:51.648050 1004787 out.go:291] Setting OutFile to fd 1 ...
	I0812 12:21:51.648220 1004787 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0812 12:21:51.648232 1004787 out.go:304] Setting ErrFile to fd 2...
	I0812 12:21:51.648237 1004787 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0812 12:21:51.648479 1004787 root.go:338] Updating PATH: /home/jenkins/minikube-integration/19411-998978/.minikube/bin
	I0812 12:21:51.648881 1004787 out.go:298] Setting JSON to true
	I0812 12:21:51.649811 1004787 start.go:129] hostinfo: {"hostname":"ip-172-31-30-239","uptime":14660,"bootTime":1723450651,"procs":187,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1066-aws","kernelArch":"aarch64","virtualizationSystem":"","virtualizationRole":"","hostId":"92f46a7d-c249-4c12-924a-77f64874c910"}
	I0812 12:21:51.649879 1004787 start.go:139] virtualization:  
	I0812 12:21:51.651973 1004787 out.go:97] [download-only-005875] minikube v1.33.1 on Ubuntu 20.04 (arm64)
	I0812 12:21:51.652190 1004787 notify.go:220] Checking for updates...
	I0812 12:21:51.653990 1004787 out.go:169] MINIKUBE_LOCATION=19411
	I0812 12:21:51.655633 1004787 out.go:169] MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I0812 12:21:51.657344 1004787 out.go:169] KUBECONFIG=/home/jenkins/minikube-integration/19411-998978/kubeconfig
	I0812 12:21:51.659066 1004787 out.go:169] MINIKUBE_HOME=/home/jenkins/minikube-integration/19411-998978/.minikube
	I0812 12:21:51.660702 1004787 out.go:169] MINIKUBE_BIN=out/minikube-linux-arm64
	W0812 12:21:51.664122 1004787 out.go:267] minikube skips various validations when --force is supplied; this may lead to unexpected behavior
	I0812 12:21:51.664421 1004787 driver.go:392] Setting default libvirt URI to qemu:///system
	I0812 12:21:51.686146 1004787 docker.go:123] docker version: linux-27.1.1:Docker Engine - Community
	I0812 12:21:51.686269 1004787 cli_runner.go:164] Run: docker system info --format "{{json .}}"
	I0812 12:21:51.751286 1004787 info.go:266] docker info: {ID:6ZPO:QZND:VNGE:LUKL:4Y3K:XELL:AAX4:2GTK:E6LM:MPRN:3ZXR:TTMR Containers:0 ContainersRunning:0 ContainersPaused:0 ContainersStopped:0 Images:1 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:25 OomKillDisable:true NGoroutines:44 SystemTime:2024-08-12 12:21:51.74158118 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1066-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Architecture:aarc
h64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8214896640 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-30-239 Labels:[] ExperimentalBuild:false ServerVersion:27.1.1 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:2bf793ef6dc9a18e00cb12efb64355c2c9d5eb41 Expected:2bf793ef6dc9a18e00cb12efb64355c2c9d5eb41} RuncCommit:{ID:v1.1.13-0-g58aa920 Expected:v1.1.13-0-g58aa920} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:<nil> ServerError
s:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.16.1] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.29.1]] Warnings:<nil>}}
	I0812 12:21:51.751403 1004787 docker.go:307] overlay module found
	I0812 12:21:51.753347 1004787 out.go:97] Using the docker driver based on user configuration
	I0812 12:21:51.753384 1004787 start.go:297] selected driver: docker
	I0812 12:21:51.753403 1004787 start.go:901] validating driver "docker" against <nil>
	I0812 12:21:51.753511 1004787 cli_runner.go:164] Run: docker system info --format "{{json .}}"
	I0812 12:21:51.819247 1004787 info.go:266] docker info: {ID:6ZPO:QZND:VNGE:LUKL:4Y3K:XELL:AAX4:2GTK:E6LM:MPRN:3ZXR:TTMR Containers:0 ContainersRunning:0 ContainersPaused:0 ContainersStopped:0 Images:1 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:25 OomKillDisable:true NGoroutines:44 SystemTime:2024-08-12 12:21:51.809717891 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1066-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Architecture:aar
ch64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8214896640 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-30-239 Labels:[] ExperimentalBuild:false ServerVersion:27.1.1 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:2bf793ef6dc9a18e00cb12efb64355c2c9d5eb41 Expected:2bf793ef6dc9a18e00cb12efb64355c2c9d5eb41} RuncCommit:{ID:v1.1.13-0-g58aa920 Expected:v1.1.13-0-g58aa920} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:<nil> ServerErro
rs:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.16.1] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.29.1]] Warnings:<nil>}}
	I0812 12:21:51.819401 1004787 start_flags.go:310] no existing cluster config was found, will generate one from the flags 
	I0812 12:21:51.819689 1004787 start_flags.go:393] Using suggested 2200MB memory alloc based on sys=7834MB, container=7834MB
	I0812 12:21:51.819839 1004787 start_flags.go:929] Wait components to verify : map[apiserver:true system_pods:true]
	I0812 12:21:51.822113 1004787 out.go:169] Using Docker driver with root privileges
	I0812 12:21:51.823716 1004787 cni.go:84] Creating CNI manager for ""
	I0812 12:21:51.823738 1004787 cni.go:143] "docker" driver + "containerd" runtime found, recommending kindnet
	I0812 12:21:51.823749 1004787 start_flags.go:319] Found "CNI" CNI - setting NetworkPlugin=cni
	I0812 12:21:51.823839 1004787 start.go:340] cluster config:
	{Name:download-only-005875 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1723026928-19389@sha256:7715fe0c5dce35b4eb757765cbbe02d40cd8b5effa0639735e42ad89f4f51ef0 Memory:2200 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.31.0-rc.0 ClusterName:download-only-005875 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.loc
al ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.31.0-rc.0 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0
s}
	I0812 12:21:51.825756 1004787 out.go:97] Starting "download-only-005875" primary control-plane node in "download-only-005875" cluster
	I0812 12:21:51.825777 1004787 cache.go:121] Beginning downloading kic base image for docker with containerd
	I0812 12:21:51.827367 1004787 out.go:97] Pulling base image v0.0.44-1723026928-19389 ...
	I0812 12:21:51.827392 1004787 preload.go:131] Checking if preload exists for k8s version v1.31.0-rc.0 and runtime containerd
	I0812 12:21:51.827573 1004787 image.go:79] Checking for gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1723026928-19389@sha256:7715fe0c5dce35b4eb757765cbbe02d40cd8b5effa0639735e42ad89f4f51ef0 in local docker daemon
	I0812 12:21:51.842814 1004787 cache.go:149] Downloading gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1723026928-19389@sha256:7715fe0c5dce35b4eb757765cbbe02d40cd8b5effa0639735e42ad89f4f51ef0 to local cache
	I0812 12:21:51.842949 1004787 image.go:63] Checking for gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1723026928-19389@sha256:7715fe0c5dce35b4eb757765cbbe02d40cd8b5effa0639735e42ad89f4f51ef0 in local cache directory
	I0812 12:21:51.842980 1004787 image.go:66] Found gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1723026928-19389@sha256:7715fe0c5dce35b4eb757765cbbe02d40cd8b5effa0639735e42ad89f4f51ef0 in local cache directory, skipping pull
	I0812 12:21:51.842990 1004787 image.go:135] gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1723026928-19389@sha256:7715fe0c5dce35b4eb757765cbbe02d40cd8b5effa0639735e42ad89f4f51ef0 exists in cache, skipping pull
	I0812 12:21:51.842999 1004787 cache.go:152] successfully saved gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1723026928-19389@sha256:7715fe0c5dce35b4eb757765cbbe02d40cd8b5effa0639735e42ad89f4f51ef0 as a tarball
	I0812 12:21:51.897262 1004787 preload.go:118] Found remote preload: https://storage.googleapis.com/minikube-preloaded-volume-tarballs/v18/v1.31.0-rc.0/preloaded-images-k8s-v18-v1.31.0-rc.0-containerd-overlay2-arm64.tar.lz4
	I0812 12:21:51.897291 1004787 cache.go:56] Caching tarball of preloaded images
	I0812 12:21:51.898144 1004787 preload.go:131] Checking if preload exists for k8s version v1.31.0-rc.0 and runtime containerd
	I0812 12:21:51.900192 1004787 out.go:97] Downloading Kubernetes v1.31.0-rc.0 preload ...
	I0812 12:21:51.900221 1004787 preload.go:236] getting checksum for preloaded-images-k8s-v18-v1.31.0-rc.0-containerd-overlay2-arm64.tar.lz4 ...
	I0812 12:21:52.011881 1004787 download.go:107] Downloading: https://storage.googleapis.com/minikube-preloaded-volume-tarballs/v18/v1.31.0-rc.0/preloaded-images-k8s-v18-v1.31.0-rc.0-containerd-overlay2-arm64.tar.lz4?checksum=md5:9f4f64d897eefd701781dd1aad6e4f21 -> /home/jenkins/minikube-integration/19411-998978/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.0-rc.0-containerd-overlay2-arm64.tar.lz4
	
	
	* The control-plane node download-only-005875 host does not exist
	  To start a cluster, run: "minikube start -p download-only-005875"

                                                
                                                
-- /stdout --
aaa_download_only_test.go:185: minikube logs failed with error: exit status 85
--- PASS: TestDownloadOnly/v1.31.0-rc.0/LogsDuration (0.42s)

                                                
                                    
x
+
TestDownloadOnly/v1.31.0-rc.0/DeleteAll (0.4s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.31.0-rc.0/DeleteAll
aaa_download_only_test.go:197: (dbg) Run:  out/minikube-linux-arm64 delete --all
--- PASS: TestDownloadOnly/v1.31.0-rc.0/DeleteAll (0.40s)

                                                
                                    
x
+
TestDownloadOnly/v1.31.0-rc.0/DeleteAlwaysSucceeds (0.39s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.31.0-rc.0/DeleteAlwaysSucceeds
aaa_download_only_test.go:208: (dbg) Run:  out/minikube-linux-arm64 delete -p download-only-005875
--- PASS: TestDownloadOnly/v1.31.0-rc.0/DeleteAlwaysSucceeds (0.39s)

                                                
                                    
x
+
TestBinaryMirror (0.6s)

                                                
                                                
=== RUN   TestBinaryMirror
aaa_download_only_test.go:314: (dbg) Run:  out/minikube-linux-arm64 start --download-only -p binary-mirror-202284 --alsologtostderr --binary-mirror http://127.0.0.1:46139 --driver=docker  --container-runtime=containerd
helpers_test.go:175: Cleaning up "binary-mirror-202284" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-arm64 delete -p binary-mirror-202284
--- PASS: TestBinaryMirror (0.60s)

                                                
                                    
x
+
TestAddons/PreSetup/EnablingAddonOnNonExistingCluster (0.07s)

                                                
                                                
=== RUN   TestAddons/PreSetup/EnablingAddonOnNonExistingCluster
=== PAUSE TestAddons/PreSetup/EnablingAddonOnNonExistingCluster

                                                
                                                

                                                
                                                
=== CONT  TestAddons/PreSetup/EnablingAddonOnNonExistingCluster
addons_test.go:1037: (dbg) Run:  out/minikube-linux-arm64 addons enable dashboard -p addons-673965
addons_test.go:1037: (dbg) Non-zero exit: out/minikube-linux-arm64 addons enable dashboard -p addons-673965: exit status 85 (66.94748ms)

                                                
                                                
-- stdout --
	* Profile "addons-673965" not found. Run "minikube profile list" to view all profiles.
	  To start a cluster, run: "minikube start -p addons-673965"

                                                
                                                
-- /stdout --
--- PASS: TestAddons/PreSetup/EnablingAddonOnNonExistingCluster (0.07s)

                                                
                                    
x
+
TestAddons/PreSetup/DisablingAddonOnNonExistingCluster (0.08s)

                                                
                                                
=== RUN   TestAddons/PreSetup/DisablingAddonOnNonExistingCluster
=== PAUSE TestAddons/PreSetup/DisablingAddonOnNonExistingCluster

                                                
                                                

                                                
                                                
=== CONT  TestAddons/PreSetup/DisablingAddonOnNonExistingCluster
addons_test.go:1048: (dbg) Run:  out/minikube-linux-arm64 addons disable dashboard -p addons-673965
addons_test.go:1048: (dbg) Non-zero exit: out/minikube-linux-arm64 addons disable dashboard -p addons-673965: exit status 85 (84.676275ms)

                                                
                                                
-- stdout --
	* Profile "addons-673965" not found. Run "minikube profile list" to view all profiles.
	  To start a cluster, run: "minikube start -p addons-673965"

                                                
                                                
-- /stdout --
--- PASS: TestAddons/PreSetup/DisablingAddonOnNonExistingCluster (0.08s)

                                                
                                    
x
+
TestAddons/Setup (161.45s)

                                                
                                                
=== RUN   TestAddons/Setup
addons_test.go:110: (dbg) Run:  out/minikube-linux-arm64 start -p addons-673965 --wait=true --memory=4000 --alsologtostderr --addons=registry --addons=metrics-server --addons=volumesnapshots --addons=csi-hostpath-driver --addons=gcp-auth --addons=cloud-spanner --addons=inspektor-gadget --addons=storage-provisioner-rancher --addons=nvidia-device-plugin --addons=yakd --addons=volcano --driver=docker  --container-runtime=containerd --addons=ingress --addons=ingress-dns
addons_test.go:110: (dbg) Done: out/minikube-linux-arm64 start -p addons-673965 --wait=true --memory=4000 --alsologtostderr --addons=registry --addons=metrics-server --addons=volumesnapshots --addons=csi-hostpath-driver --addons=gcp-auth --addons=cloud-spanner --addons=inspektor-gadget --addons=storage-provisioner-rancher --addons=nvidia-device-plugin --addons=yakd --addons=volcano --driver=docker  --container-runtime=containerd --addons=ingress --addons=ingress-dns: (2m41.447019412s)
--- PASS: TestAddons/Setup (161.45s)

                                                
                                    
x
+
TestAddons/serial/GCPAuth/Namespaces (0.17s)

                                                
                                                
=== RUN   TestAddons/serial/GCPAuth/Namespaces
addons_test.go:656: (dbg) Run:  kubectl --context addons-673965 create ns new-namespace
addons_test.go:670: (dbg) Run:  kubectl --context addons-673965 get secret gcp-auth -n new-namespace
--- PASS: TestAddons/serial/GCPAuth/Namespaces (0.17s)

                                                
                                    
x
+
TestAddons/parallel/Registry (15.73s)

                                                
                                                
=== RUN   TestAddons/parallel/Registry
=== PAUSE TestAddons/parallel/Registry

                                                
                                                

                                                
                                                
=== CONT  TestAddons/parallel/Registry
addons_test.go:332: registry stabilized in 2.626743ms
addons_test.go:334: (dbg) TestAddons/parallel/Registry: waiting 6m0s for pods matching "actual-registry=true" in namespace "kube-system" ...
helpers_test.go:344: "registry-698f998955-rp6t5" [6fcd0097-9a1e-431b-a4d6-21fbc0382cee] Running
addons_test.go:334: (dbg) TestAddons/parallel/Registry: actual-registry=true healthy within 6.004595901s
addons_test.go:337: (dbg) TestAddons/parallel/Registry: waiting 10m0s for pods matching "registry-proxy=true" in namespace "kube-system" ...
helpers_test.go:344: "registry-proxy-ffzv5" [8dd51828-4266-477a-bf2c-0d230355a473] Running
addons_test.go:337: (dbg) TestAddons/parallel/Registry: registry-proxy=true healthy within 5.004606519s
addons_test.go:342: (dbg) Run:  kubectl --context addons-673965 delete po -l run=registry-test --now
addons_test.go:347: (dbg) Run:  kubectl --context addons-673965 run --rm registry-test --restart=Never --image=gcr.io/k8s-minikube/busybox -it -- sh -c "wget --spider -S http://registry.kube-system.svc.cluster.local"
addons_test.go:347: (dbg) Done: kubectl --context addons-673965 run --rm registry-test --restart=Never --image=gcr.io/k8s-minikube/busybox -it -- sh -c "wget --spider -S http://registry.kube-system.svc.cluster.local": (3.582251128s)
addons_test.go:361: (dbg) Run:  out/minikube-linux-arm64 -p addons-673965 ip
2024/08/12 12:28:36 [DEBUG] GET http://192.168.49.2:5000
addons_test.go:390: (dbg) Run:  out/minikube-linux-arm64 -p addons-673965 addons disable registry --alsologtostderr -v=1
--- PASS: TestAddons/parallel/Registry (15.73s)

                                                
                                    
x
+
TestAddons/parallel/Ingress (19.28s)

                                                
                                                
=== RUN   TestAddons/parallel/Ingress
=== PAUSE TestAddons/parallel/Ingress

                                                
                                                

                                                
                                                
=== CONT  TestAddons/parallel/Ingress
addons_test.go:209: (dbg) Run:  kubectl --context addons-673965 wait --for=condition=ready --namespace=ingress-nginx pod --selector=app.kubernetes.io/component=controller --timeout=90s
addons_test.go:234: (dbg) Run:  kubectl --context addons-673965 replace --force -f testdata/nginx-ingress-v1.yaml
addons_test.go:247: (dbg) Run:  kubectl --context addons-673965 replace --force -f testdata/nginx-pod-svc.yaml
addons_test.go:252: (dbg) TestAddons/parallel/Ingress: waiting 8m0s for pods matching "run=nginx" in namespace "default" ...
helpers_test.go:344: "nginx" [e376aa75-bd68-428b-8c30-df83601d1f6d] Pending / Ready:ContainersNotReady (containers with unready status: [nginx]) / ContainersReady:ContainersNotReady (containers with unready status: [nginx])
helpers_test.go:344: "nginx" [e376aa75-bd68-428b-8c30-df83601d1f6d] Running
addons_test.go:252: (dbg) TestAddons/parallel/Ingress: run=nginx healthy within 8.005504445s
addons_test.go:264: (dbg) Run:  out/minikube-linux-arm64 -p addons-673965 ssh "curl -s http://127.0.0.1/ -H 'Host: nginx.example.com'"
addons_test.go:288: (dbg) Run:  kubectl --context addons-673965 replace --force -f testdata/ingress-dns-example-v1.yaml
addons_test.go:293: (dbg) Run:  out/minikube-linux-arm64 -p addons-673965 ip
addons_test.go:299: (dbg) Run:  nslookup hello-john.test 192.168.49.2
addons_test.go:308: (dbg) Run:  out/minikube-linux-arm64 -p addons-673965 addons disable ingress-dns --alsologtostderr -v=1
addons_test.go:308: (dbg) Done: out/minikube-linux-arm64 -p addons-673965 addons disable ingress-dns --alsologtostderr -v=1: (1.493833504s)
addons_test.go:313: (dbg) Run:  out/minikube-linux-arm64 -p addons-673965 addons disable ingress --alsologtostderr -v=1
addons_test.go:313: (dbg) Done: out/minikube-linux-arm64 -p addons-673965 addons disable ingress --alsologtostderr -v=1: (7.969104897s)
--- PASS: TestAddons/parallel/Ingress (19.28s)

                                                
                                    
x
+
TestAddons/parallel/InspektorGadget (11.92s)

                                                
                                                
=== RUN   TestAddons/parallel/InspektorGadget
=== PAUSE TestAddons/parallel/InspektorGadget

                                                
                                                

                                                
                                                
=== CONT  TestAddons/parallel/InspektorGadget
addons_test.go:848: (dbg) TestAddons/parallel/InspektorGadget: waiting 8m0s for pods matching "k8s-app=gadget" in namespace "gadget" ...
helpers_test.go:344: "gadget-gdbxz" [e92bb787-a8ce-4879-97ad-a146759eb4a3] Running / Ready:ContainersNotReady (containers with unready status: [gadget]) / ContainersReady:ContainersNotReady (containers with unready status: [gadget])
addons_test.go:848: (dbg) TestAddons/parallel/InspektorGadget: k8s-app=gadget healthy within 6.004398246s
addons_test.go:851: (dbg) Run:  out/minikube-linux-arm64 addons disable inspektor-gadget -p addons-673965
addons_test.go:851: (dbg) Done: out/minikube-linux-arm64 addons disable inspektor-gadget -p addons-673965: (5.909758199s)
--- PASS: TestAddons/parallel/InspektorGadget (11.92s)

                                                
                                    
x
+
TestAddons/parallel/MetricsServer (6.83s)

                                                
                                                
=== RUN   TestAddons/parallel/MetricsServer
=== PAUSE TestAddons/parallel/MetricsServer

                                                
                                                

                                                
                                                
=== CONT  TestAddons/parallel/MetricsServer
addons_test.go:409: metrics-server stabilized in 2.555155ms
addons_test.go:411: (dbg) TestAddons/parallel/MetricsServer: waiting 6m0s for pods matching "k8s-app=metrics-server" in namespace "kube-system" ...
helpers_test.go:344: "metrics-server-c59844bb4-cwgnw" [9297a50d-ec7d-487b-94a5-ed964e17aa28] Running
addons_test.go:411: (dbg) TestAddons/parallel/MetricsServer: k8s-app=metrics-server healthy within 6.005938738s
addons_test.go:417: (dbg) Run:  kubectl --context addons-673965 top pods -n kube-system
addons_test.go:434: (dbg) Run:  out/minikube-linux-arm64 -p addons-673965 addons disable metrics-server --alsologtostderr -v=1
--- PASS: TestAddons/parallel/MetricsServer (6.83s)

                                                
                                    
x
+
TestAddons/parallel/CSI (60.34s)

                                                
                                                
=== RUN   TestAddons/parallel/CSI
=== PAUSE TestAddons/parallel/CSI

                                                
                                                

                                                
                                                
=== CONT  TestAddons/parallel/CSI
addons_test.go:567: csi-hostpath-driver pods stabilized in 11.425637ms
addons_test.go:570: (dbg) Run:  kubectl --context addons-673965 create -f testdata/csi-hostpath-driver/pvc.yaml
addons_test.go:575: (dbg) TestAddons/parallel/CSI: waiting 6m0s for pvc "hpvc" in namespace "default" ...
helpers_test.go:394: (dbg) Run:  kubectl --context addons-673965 get pvc hpvc -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-673965 get pvc hpvc -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-673965 get pvc hpvc -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-673965 get pvc hpvc -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-673965 get pvc hpvc -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-673965 get pvc hpvc -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-673965 get pvc hpvc -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-673965 get pvc hpvc -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-673965 get pvc hpvc -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-673965 get pvc hpvc -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-673965 get pvc hpvc -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-673965 get pvc hpvc -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-673965 get pvc hpvc -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-673965 get pvc hpvc -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-673965 get pvc hpvc -o jsonpath={.status.phase} -n default
addons_test.go:580: (dbg) Run:  kubectl --context addons-673965 create -f testdata/csi-hostpath-driver/pv-pod.yaml
addons_test.go:585: (dbg) TestAddons/parallel/CSI: waiting 6m0s for pods matching "app=task-pv-pod" in namespace "default" ...
helpers_test.go:344: "task-pv-pod" [b4a63cef-9d0c-4816-9d49-90b99f4d5253] Pending
helpers_test.go:344: "task-pv-pod" [b4a63cef-9d0c-4816-9d49-90b99f4d5253] Pending / Ready:ContainersNotReady (containers with unready status: [task-pv-container]) / ContainersReady:ContainersNotReady (containers with unready status: [task-pv-container])
helpers_test.go:344: "task-pv-pod" [b4a63cef-9d0c-4816-9d49-90b99f4d5253] Running
addons_test.go:585: (dbg) TestAddons/parallel/CSI: app=task-pv-pod healthy within 11.003834872s
addons_test.go:590: (dbg) Run:  kubectl --context addons-673965 create -f testdata/csi-hostpath-driver/snapshot.yaml
addons_test.go:595: (dbg) TestAddons/parallel/CSI: waiting 6m0s for volume snapshot "new-snapshot-demo" in namespace "default" ...
helpers_test.go:419: (dbg) Run:  kubectl --context addons-673965 get volumesnapshot new-snapshot-demo -o jsonpath={.status.readyToUse} -n default
helpers_test.go:419: (dbg) Run:  kubectl --context addons-673965 get volumesnapshot new-snapshot-demo -o jsonpath={.status.readyToUse} -n default
addons_test.go:600: (dbg) Run:  kubectl --context addons-673965 delete pod task-pv-pod
addons_test.go:600: (dbg) Done: kubectl --context addons-673965 delete pod task-pv-pod: (1.04194838s)
addons_test.go:606: (dbg) Run:  kubectl --context addons-673965 delete pvc hpvc
addons_test.go:612: (dbg) Run:  kubectl --context addons-673965 create -f testdata/csi-hostpath-driver/pvc-restore.yaml
addons_test.go:617: (dbg) TestAddons/parallel/CSI: waiting 6m0s for pvc "hpvc-restore" in namespace "default" ...
helpers_test.go:394: (dbg) Run:  kubectl --context addons-673965 get pvc hpvc-restore -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-673965 get pvc hpvc-restore -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-673965 get pvc hpvc-restore -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-673965 get pvc hpvc-restore -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-673965 get pvc hpvc-restore -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-673965 get pvc hpvc-restore -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-673965 get pvc hpvc-restore -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-673965 get pvc hpvc-restore -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-673965 get pvc hpvc-restore -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-673965 get pvc hpvc-restore -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-673965 get pvc hpvc-restore -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-673965 get pvc hpvc-restore -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-673965 get pvc hpvc-restore -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-673965 get pvc hpvc-restore -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-673965 get pvc hpvc-restore -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-673965 get pvc hpvc-restore -o jsonpath={.status.phase} -n default
addons_test.go:622: (dbg) Run:  kubectl --context addons-673965 create -f testdata/csi-hostpath-driver/pv-pod-restore.yaml
addons_test.go:627: (dbg) TestAddons/parallel/CSI: waiting 6m0s for pods matching "app=task-pv-pod-restore" in namespace "default" ...
helpers_test.go:344: "task-pv-pod-restore" [ae72400b-564f-4d54-b193-687115cecc5c] Pending
helpers_test.go:344: "task-pv-pod-restore" [ae72400b-564f-4d54-b193-687115cecc5c] Pending / Ready:ContainersNotReady (containers with unready status: [task-pv-container]) / ContainersReady:ContainersNotReady (containers with unready status: [task-pv-container])
helpers_test.go:344: "task-pv-pod-restore" [ae72400b-564f-4d54-b193-687115cecc5c] Running
addons_test.go:627: (dbg) TestAddons/parallel/CSI: app=task-pv-pod-restore healthy within 8.003950152s
addons_test.go:632: (dbg) Run:  kubectl --context addons-673965 delete pod task-pv-pod-restore
addons_test.go:636: (dbg) Run:  kubectl --context addons-673965 delete pvc hpvc-restore
addons_test.go:640: (dbg) Run:  kubectl --context addons-673965 delete volumesnapshot new-snapshot-demo
addons_test.go:644: (dbg) Run:  out/minikube-linux-arm64 -p addons-673965 addons disable csi-hostpath-driver --alsologtostderr -v=1
addons_test.go:644: (dbg) Done: out/minikube-linux-arm64 -p addons-673965 addons disable csi-hostpath-driver --alsologtostderr -v=1: (6.915513722s)
addons_test.go:648: (dbg) Run:  out/minikube-linux-arm64 -p addons-673965 addons disable volumesnapshots --alsologtostderr -v=1
--- PASS: TestAddons/parallel/CSI (60.34s)

                                                
                                    
x
+
TestAddons/parallel/Headlamp (16.92s)

                                                
                                                
=== RUN   TestAddons/parallel/Headlamp
=== PAUSE TestAddons/parallel/Headlamp

                                                
                                                

                                                
                                                
=== CONT  TestAddons/parallel/Headlamp
addons_test.go:830: (dbg) Run:  out/minikube-linux-arm64 addons enable headlamp -p addons-673965 --alsologtostderr -v=1
addons_test.go:830: (dbg) Done: out/minikube-linux-arm64 addons enable headlamp -p addons-673965 --alsologtostderr -v=1: (1.078590885s)
addons_test.go:835: (dbg) TestAddons/parallel/Headlamp: waiting 8m0s for pods matching "app.kubernetes.io/name=headlamp" in namespace "headlamp" ...
helpers_test.go:344: "headlamp-9d868696f-ktnjg" [fcb1a34d-3d69-46d5-ba57-4661b3a5ee3b] Pending
helpers_test.go:344: "headlamp-9d868696f-ktnjg" [fcb1a34d-3d69-46d5-ba57-4661b3a5ee3b] Pending / Ready:ContainersNotReady (containers with unready status: [headlamp]) / ContainersReady:ContainersNotReady (containers with unready status: [headlamp])
helpers_test.go:344: "headlamp-9d868696f-ktnjg" [fcb1a34d-3d69-46d5-ba57-4661b3a5ee3b] Running
addons_test.go:835: (dbg) TestAddons/parallel/Headlamp: app.kubernetes.io/name=headlamp healthy within 10.003646009s
addons_test.go:839: (dbg) Run:  out/minikube-linux-arm64 -p addons-673965 addons disable headlamp --alsologtostderr -v=1
addons_test.go:839: (dbg) Done: out/minikube-linux-arm64 -p addons-673965 addons disable headlamp --alsologtostderr -v=1: (5.839096022s)
--- PASS: TestAddons/parallel/Headlamp (16.92s)

                                                
                                    
x
+
TestAddons/parallel/CloudSpanner (6.56s)

                                                
                                                
=== RUN   TestAddons/parallel/CloudSpanner
=== PAUSE TestAddons/parallel/CloudSpanner

                                                
                                                

                                                
                                                
=== CONT  TestAddons/parallel/CloudSpanner
addons_test.go:867: (dbg) TestAddons/parallel/CloudSpanner: waiting 6m0s for pods matching "app=cloud-spanner-emulator" in namespace "default" ...
helpers_test.go:344: "cloud-spanner-emulator-5455fb9b69-m6p8s" [33d59f06-960f-4ded-ad57-3405478e44af] Running
addons_test.go:867: (dbg) TestAddons/parallel/CloudSpanner: app=cloud-spanner-emulator healthy within 6.003913059s
addons_test.go:870: (dbg) Run:  out/minikube-linux-arm64 addons disable cloud-spanner -p addons-673965
--- PASS: TestAddons/parallel/CloudSpanner (6.56s)

                                                
                                    
x
+
TestAddons/parallel/LocalPath (51.57s)

                                                
                                                
=== RUN   TestAddons/parallel/LocalPath
=== PAUSE TestAddons/parallel/LocalPath

                                                
                                                

                                                
                                                
=== CONT  TestAddons/parallel/LocalPath
addons_test.go:982: (dbg) Run:  kubectl --context addons-673965 apply -f testdata/storage-provisioner-rancher/pvc.yaml
addons_test.go:988: (dbg) Run:  kubectl --context addons-673965 apply -f testdata/storage-provisioner-rancher/pod.yaml
addons_test.go:992: (dbg) TestAddons/parallel/LocalPath: waiting 5m0s for pvc "test-pvc" in namespace "default" ...
helpers_test.go:394: (dbg) Run:  kubectl --context addons-673965 get pvc test-pvc -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-673965 get pvc test-pvc -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-673965 get pvc test-pvc -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-673965 get pvc test-pvc -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-673965 get pvc test-pvc -o jsonpath={.status.phase} -n default
addons_test.go:995: (dbg) TestAddons/parallel/LocalPath: waiting 3m0s for pods matching "run=test-local-path" in namespace "default" ...
helpers_test.go:344: "test-local-path" [e74d542a-ad55-4627-a33e-7976d4305b3d] Pending / Ready:ContainersNotReady (containers with unready status: [busybox]) / ContainersReady:ContainersNotReady (containers with unready status: [busybox])
helpers_test.go:344: "test-local-path" [e74d542a-ad55-4627-a33e-7976d4305b3d] Pending / Initialized:PodCompleted / Ready:PodCompleted / ContainersReady:PodCompleted
helpers_test.go:344: "test-local-path" [e74d542a-ad55-4627-a33e-7976d4305b3d] Succeeded / Initialized:PodCompleted / Ready:PodCompleted / ContainersReady:PodCompleted
addons_test.go:995: (dbg) TestAddons/parallel/LocalPath: run=test-local-path healthy within 3.003471647s
addons_test.go:1000: (dbg) Run:  kubectl --context addons-673965 get pvc test-pvc -o=json
addons_test.go:1009: (dbg) Run:  out/minikube-linux-arm64 -p addons-673965 ssh "cat /opt/local-path-provisioner/pvc-177e66ad-6648-4fda-910a-b0c57a039359_default_test-pvc/file1"
addons_test.go:1021: (dbg) Run:  kubectl --context addons-673965 delete pod test-local-path
addons_test.go:1025: (dbg) Run:  kubectl --context addons-673965 delete pvc test-pvc
addons_test.go:1029: (dbg) Run:  out/minikube-linux-arm64 -p addons-673965 addons disable storage-provisioner-rancher --alsologtostderr -v=1
addons_test.go:1029: (dbg) Done: out/minikube-linux-arm64 -p addons-673965 addons disable storage-provisioner-rancher --alsologtostderr -v=1: (43.369473155s)
--- PASS: TestAddons/parallel/LocalPath (51.57s)

                                                
                                    
x
+
TestAddons/parallel/NvidiaDevicePlugin (6.55s)

                                                
                                                
=== RUN   TestAddons/parallel/NvidiaDevicePlugin
=== PAUSE TestAddons/parallel/NvidiaDevicePlugin

                                                
                                                

                                                
                                                
=== CONT  TestAddons/parallel/NvidiaDevicePlugin
addons_test.go:1061: (dbg) TestAddons/parallel/NvidiaDevicePlugin: waiting 6m0s for pods matching "name=nvidia-device-plugin-ds" in namespace "kube-system" ...
helpers_test.go:344: "nvidia-device-plugin-daemonset-cnjct" [f02dfcaf-fe6d-447d-a835-87af4cfbf4c6] Running
addons_test.go:1061: (dbg) TestAddons/parallel/NvidiaDevicePlugin: name=nvidia-device-plugin-ds healthy within 6.00422885s
addons_test.go:1064: (dbg) Run:  out/minikube-linux-arm64 addons disable nvidia-device-plugin -p addons-673965
--- PASS: TestAddons/parallel/NvidiaDevicePlugin (6.55s)

                                                
                                    
x
+
TestAddons/parallel/Yakd (11.8s)

                                                
                                                
=== RUN   TestAddons/parallel/Yakd
=== PAUSE TestAddons/parallel/Yakd

                                                
                                                

                                                
                                                
=== CONT  TestAddons/parallel/Yakd
addons_test.go:1072: (dbg) TestAddons/parallel/Yakd: waiting 2m0s for pods matching "app.kubernetes.io/name=yakd-dashboard" in namespace "yakd-dashboard" ...
helpers_test.go:344: "yakd-dashboard-799879c74f-zqdcx" [c741ec72-dfc1-430c-b2b6-adff5f291795] Running
addons_test.go:1072: (dbg) TestAddons/parallel/Yakd: app.kubernetes.io/name=yakd-dashboard healthy within 6.003250526s
addons_test.go:1076: (dbg) Run:  out/minikube-linux-arm64 -p addons-673965 addons disable yakd --alsologtostderr -v=1
addons_test.go:1076: (dbg) Done: out/minikube-linux-arm64 -p addons-673965 addons disable yakd --alsologtostderr -v=1: (5.795414137s)
--- PASS: TestAddons/parallel/Yakd (11.80s)

                                                
                                    
x
+
TestAddons/StoppedEnableDisable (12.3s)

                                                
                                                
=== RUN   TestAddons/StoppedEnableDisable
addons_test.go:174: (dbg) Run:  out/minikube-linux-arm64 stop -p addons-673965
addons_test.go:174: (dbg) Done: out/minikube-linux-arm64 stop -p addons-673965: (12.038248115s)
addons_test.go:178: (dbg) Run:  out/minikube-linux-arm64 addons enable dashboard -p addons-673965
addons_test.go:182: (dbg) Run:  out/minikube-linux-arm64 addons disable dashboard -p addons-673965
addons_test.go:187: (dbg) Run:  out/minikube-linux-arm64 addons disable gvisor -p addons-673965
--- PASS: TestAddons/StoppedEnableDisable (12.30s)

                                                
                                    
x
+
TestCertOptions (41.67s)

                                                
                                                
=== RUN   TestCertOptions
=== PAUSE TestCertOptions

                                                
                                                

                                                
                                                
=== CONT  TestCertOptions
cert_options_test.go:49: (dbg) Run:  out/minikube-linux-arm64 start -p cert-options-583042 --memory=2048 --apiserver-ips=127.0.0.1 --apiserver-ips=192.168.15.15 --apiserver-names=localhost --apiserver-names=www.google.com --apiserver-port=8555 --driver=docker  --container-runtime=containerd
cert_options_test.go:49: (dbg) Done: out/minikube-linux-arm64 start -p cert-options-583042 --memory=2048 --apiserver-ips=127.0.0.1 --apiserver-ips=192.168.15.15 --apiserver-names=localhost --apiserver-names=www.google.com --apiserver-port=8555 --driver=docker  --container-runtime=containerd: (38.551102455s)
cert_options_test.go:60: (dbg) Run:  out/minikube-linux-arm64 -p cert-options-583042 ssh "openssl x509 -text -noout -in /var/lib/minikube/certs/apiserver.crt"
cert_options_test.go:88: (dbg) Run:  kubectl --context cert-options-583042 config view
cert_options_test.go:100: (dbg) Run:  out/minikube-linux-arm64 ssh -p cert-options-583042 -- "sudo cat /etc/kubernetes/admin.conf"
helpers_test.go:175: Cleaning up "cert-options-583042" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-arm64 delete -p cert-options-583042
helpers_test.go:178: (dbg) Done: out/minikube-linux-arm64 delete -p cert-options-583042: (2.415607279s)
--- PASS: TestCertOptions (41.67s)

                                                
                                    
x
+
TestCertExpiration (231.84s)

                                                
                                                
=== RUN   TestCertExpiration
=== PAUSE TestCertExpiration

                                                
                                                

                                                
                                                
=== CONT  TestCertExpiration
cert_options_test.go:123: (dbg) Run:  out/minikube-linux-arm64 start -p cert-expiration-886280 --memory=2048 --cert-expiration=3m --driver=docker  --container-runtime=containerd
E0812 13:09:12.756751 1004370 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19411-998978/.minikube/profiles/functional-986276/client.crt: no such file or directory
cert_options_test.go:123: (dbg) Done: out/minikube-linux-arm64 start -p cert-expiration-886280 --memory=2048 --cert-expiration=3m --driver=docker  --container-runtime=containerd: (42.058831677s)
E0812 13:09:43.525852 1004370 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19411-998978/.minikube/profiles/addons-673965/client.crt: no such file or directory
cert_options_test.go:131: (dbg) Run:  out/minikube-linux-arm64 start -p cert-expiration-886280 --memory=2048 --cert-expiration=8760h --driver=docker  --container-runtime=containerd
cert_options_test.go:131: (dbg) Done: out/minikube-linux-arm64 start -p cert-expiration-886280 --memory=2048 --cert-expiration=8760h --driver=docker  --container-runtime=containerd: (7.141049518s)
helpers_test.go:175: Cleaning up "cert-expiration-886280" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-arm64 delete -p cert-expiration-886280
helpers_test.go:178: (dbg) Done: out/minikube-linux-arm64 delete -p cert-expiration-886280: (2.638376795s)
--- PASS: TestCertExpiration (231.84s)

                                                
                                    
x
+
TestForceSystemdFlag (37.77s)

                                                
                                                
=== RUN   TestForceSystemdFlag
=== PAUSE TestForceSystemdFlag

                                                
                                                

                                                
                                                
=== CONT  TestForceSystemdFlag
docker_test.go:91: (dbg) Run:  out/minikube-linux-arm64 start -p force-systemd-flag-819709 --memory=2048 --force-systemd --alsologtostderr -v=5 --driver=docker  --container-runtime=containerd
docker_test.go:91: (dbg) Done: out/minikube-linux-arm64 start -p force-systemd-flag-819709 --memory=2048 --force-systemd --alsologtostderr -v=5 --driver=docker  --container-runtime=containerd: (35.186390057s)
docker_test.go:121: (dbg) Run:  out/minikube-linux-arm64 -p force-systemd-flag-819709 ssh "cat /etc/containerd/config.toml"
helpers_test.go:175: Cleaning up "force-systemd-flag-819709" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-arm64 delete -p force-systemd-flag-819709
helpers_test.go:178: (dbg) Done: out/minikube-linux-arm64 delete -p force-systemd-flag-819709: (2.213705564s)
--- PASS: TestForceSystemdFlag (37.77s)

                                                
                                    
x
+
TestForceSystemdEnv (44.07s)

                                                
                                                
=== RUN   TestForceSystemdEnv
=== PAUSE TestForceSystemdEnv

                                                
                                                

                                                
                                                
=== CONT  TestForceSystemdEnv
docker_test.go:155: (dbg) Run:  out/minikube-linux-arm64 start -p force-systemd-env-633251 --memory=2048 --alsologtostderr -v=5 --driver=docker  --container-runtime=containerd
docker_test.go:155: (dbg) Done: out/minikube-linux-arm64 start -p force-systemd-env-633251 --memory=2048 --alsologtostderr -v=5 --driver=docker  --container-runtime=containerd: (41.600443679s)
docker_test.go:121: (dbg) Run:  out/minikube-linux-arm64 -p force-systemd-env-633251 ssh "cat /etc/containerd/config.toml"
helpers_test.go:175: Cleaning up "force-systemd-env-633251" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-arm64 delete -p force-systemd-env-633251
helpers_test.go:178: (dbg) Done: out/minikube-linux-arm64 delete -p force-systemd-env-633251: (2.1046023s)
--- PASS: TestForceSystemdEnv (44.07s)

                                                
                                    
x
+
TestDockerEnvContainerd (46.37s)

                                                
                                                
=== RUN   TestDockerEnvContainerd
docker_test.go:170: running with containerd true linux arm64
docker_test.go:181: (dbg) Run:  out/minikube-linux-arm64 start -p dockerenv-702720 --driver=docker  --container-runtime=containerd
docker_test.go:181: (dbg) Done: out/minikube-linux-arm64 start -p dockerenv-702720 --driver=docker  --container-runtime=containerd: (29.868297942s)
docker_test.go:189: (dbg) Run:  /bin/bash -c "out/minikube-linux-arm64 docker-env --ssh-host --ssh-add -p dockerenv-702720"
docker_test.go:189: (dbg) Done: /bin/bash -c "out/minikube-linux-arm64 docker-env --ssh-host --ssh-add -p dockerenv-702720": (1.079679318s)
docker_test.go:220: (dbg) Run:  /bin/bash -c "SSH_AUTH_SOCK="/tmp/ssh-hSEO82wJ0AOx/agent.1023814" SSH_AGENT_PID="1023815" DOCKER_HOST=ssh://docker@127.0.0.1:33899 docker version"
docker_test.go:243: (dbg) Run:  /bin/bash -c "SSH_AUTH_SOCK="/tmp/ssh-hSEO82wJ0AOx/agent.1023814" SSH_AGENT_PID="1023815" DOCKER_HOST=ssh://docker@127.0.0.1:33899 DOCKER_BUILDKIT=0 docker build -t local/minikube-dockerenv-containerd-test:latest testdata/docker-env"
docker_test.go:243: (dbg) Done: /bin/bash -c "SSH_AUTH_SOCK="/tmp/ssh-hSEO82wJ0AOx/agent.1023814" SSH_AGENT_PID="1023815" DOCKER_HOST=ssh://docker@127.0.0.1:33899 DOCKER_BUILDKIT=0 docker build -t local/minikube-dockerenv-containerd-test:latest testdata/docker-env": (1.364180246s)
docker_test.go:250: (dbg) Run:  /bin/bash -c "SSH_AUTH_SOCK="/tmp/ssh-hSEO82wJ0AOx/agent.1023814" SSH_AGENT_PID="1023815" DOCKER_HOST=ssh://docker@127.0.0.1:33899 docker image ls"
docker_test.go:250: (dbg) Done: /bin/bash -c "SSH_AUTH_SOCK="/tmp/ssh-hSEO82wJ0AOx/agent.1023814" SSH_AGENT_PID="1023815" DOCKER_HOST=ssh://docker@127.0.0.1:33899 docker image ls": (1.355416815s)
helpers_test.go:175: Cleaning up "dockerenv-702720" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-arm64 delete -p dockerenv-702720
helpers_test.go:178: (dbg) Done: out/minikube-linux-arm64 delete -p dockerenv-702720: (2.072841052s)
--- PASS: TestDockerEnvContainerd (46.37s)

                                                
                                    
x
+
TestErrorSpam/setup (32.53s)

                                                
                                                
=== RUN   TestErrorSpam/setup
error_spam_test.go:81: (dbg) Run:  out/minikube-linux-arm64 start -p nospam-338102 -n=1 --memory=2250 --wait=false --log_dir=/tmp/nospam-338102 --driver=docker  --container-runtime=containerd
error_spam_test.go:81: (dbg) Done: out/minikube-linux-arm64 start -p nospam-338102 -n=1 --memory=2250 --wait=false --log_dir=/tmp/nospam-338102 --driver=docker  --container-runtime=containerd: (32.525627527s)
--- PASS: TestErrorSpam/setup (32.53s)

                                                
                                    
x
+
TestErrorSpam/start (0.98s)

                                                
                                                
=== RUN   TestErrorSpam/start
error_spam_test.go:216: Cleaning up 1 logfile(s) ...
error_spam_test.go:159: (dbg) Run:  out/minikube-linux-arm64 -p nospam-338102 --log_dir /tmp/nospam-338102 start --dry-run
error_spam_test.go:159: (dbg) Run:  out/minikube-linux-arm64 -p nospam-338102 --log_dir /tmp/nospam-338102 start --dry-run
error_spam_test.go:182: (dbg) Run:  out/minikube-linux-arm64 -p nospam-338102 --log_dir /tmp/nospam-338102 start --dry-run
--- PASS: TestErrorSpam/start (0.98s)

                                                
                                    
x
+
TestErrorSpam/status (1.05s)

                                                
                                                
=== RUN   TestErrorSpam/status
error_spam_test.go:216: Cleaning up 0 logfile(s) ...
error_spam_test.go:159: (dbg) Run:  out/minikube-linux-arm64 -p nospam-338102 --log_dir /tmp/nospam-338102 status
error_spam_test.go:159: (dbg) Run:  out/minikube-linux-arm64 -p nospam-338102 --log_dir /tmp/nospam-338102 status
error_spam_test.go:182: (dbg) Run:  out/minikube-linux-arm64 -p nospam-338102 --log_dir /tmp/nospam-338102 status
--- PASS: TestErrorSpam/status (1.05s)

                                                
                                    
x
+
TestErrorSpam/pause (1.76s)

                                                
                                                
=== RUN   TestErrorSpam/pause
error_spam_test.go:216: Cleaning up 0 logfile(s) ...
error_spam_test.go:159: (dbg) Run:  out/minikube-linux-arm64 -p nospam-338102 --log_dir /tmp/nospam-338102 pause
error_spam_test.go:159: (dbg) Run:  out/minikube-linux-arm64 -p nospam-338102 --log_dir /tmp/nospam-338102 pause
error_spam_test.go:182: (dbg) Run:  out/minikube-linux-arm64 -p nospam-338102 --log_dir /tmp/nospam-338102 pause
--- PASS: TestErrorSpam/pause (1.76s)

                                                
                                    
x
+
TestErrorSpam/unpause (1.84s)

                                                
                                                
=== RUN   TestErrorSpam/unpause
error_spam_test.go:216: Cleaning up 0 logfile(s) ...
error_spam_test.go:159: (dbg) Run:  out/minikube-linux-arm64 -p nospam-338102 --log_dir /tmp/nospam-338102 unpause
error_spam_test.go:159: (dbg) Run:  out/minikube-linux-arm64 -p nospam-338102 --log_dir /tmp/nospam-338102 unpause
error_spam_test.go:182: (dbg) Run:  out/minikube-linux-arm64 -p nospam-338102 --log_dir /tmp/nospam-338102 unpause
--- PASS: TestErrorSpam/unpause (1.84s)

                                                
                                    
x
+
TestErrorSpam/stop (1.44s)

                                                
                                                
=== RUN   TestErrorSpam/stop
error_spam_test.go:216: Cleaning up 0 logfile(s) ...
error_spam_test.go:159: (dbg) Run:  out/minikube-linux-arm64 -p nospam-338102 --log_dir /tmp/nospam-338102 stop
error_spam_test.go:159: (dbg) Done: out/minikube-linux-arm64 -p nospam-338102 --log_dir /tmp/nospam-338102 stop: (1.236340566s)
error_spam_test.go:159: (dbg) Run:  out/minikube-linux-arm64 -p nospam-338102 --log_dir /tmp/nospam-338102 stop
error_spam_test.go:182: (dbg) Run:  out/minikube-linux-arm64 -p nospam-338102 --log_dir /tmp/nospam-338102 stop
--- PASS: TestErrorSpam/stop (1.44s)

                                                
                                    
x
+
TestFunctional/serial/CopySyncFile (0s)

                                                
                                                
=== RUN   TestFunctional/serial/CopySyncFile
functional_test.go:1855: local sync path: /home/jenkins/minikube-integration/19411-998978/.minikube/files/etc/test/nested/copy/1004370/hosts
--- PASS: TestFunctional/serial/CopySyncFile (0.00s)

                                                
                                    
x
+
TestFunctional/serial/StartWithProxy (57.84s)

                                                
                                                
=== RUN   TestFunctional/serial/StartWithProxy
functional_test.go:2234: (dbg) Run:  out/minikube-linux-arm64 start -p functional-986276 --memory=4000 --apiserver-port=8441 --wait=all --driver=docker  --container-runtime=containerd
functional_test.go:2234: (dbg) Done: out/minikube-linux-arm64 start -p functional-986276 --memory=4000 --apiserver-port=8441 --wait=all --driver=docker  --container-runtime=containerd: (57.839962282s)
--- PASS: TestFunctional/serial/StartWithProxy (57.84s)

                                                
                                    
x
+
TestFunctional/serial/AuditLog (0s)

                                                
                                                
=== RUN   TestFunctional/serial/AuditLog
--- PASS: TestFunctional/serial/AuditLog (0.00s)

                                                
                                    
x
+
TestFunctional/serial/SoftStart (6.34s)

                                                
                                                
=== RUN   TestFunctional/serial/SoftStart
functional_test.go:659: (dbg) Run:  out/minikube-linux-arm64 start -p functional-986276 --alsologtostderr -v=8
functional_test.go:659: (dbg) Done: out/minikube-linux-arm64 start -p functional-986276 --alsologtostderr -v=8: (6.33629056s)
functional_test.go:663: soft start took 6.34039702s for "functional-986276" cluster.
--- PASS: TestFunctional/serial/SoftStart (6.34s)

                                                
                                    
x
+
TestFunctional/serial/KubeContext (0.07s)

                                                
                                                
=== RUN   TestFunctional/serial/KubeContext
functional_test.go:681: (dbg) Run:  kubectl config current-context
--- PASS: TestFunctional/serial/KubeContext (0.07s)

                                                
                                    
x
+
TestFunctional/serial/KubectlGetPods (0.1s)

                                                
                                                
=== RUN   TestFunctional/serial/KubectlGetPods
functional_test.go:696: (dbg) Run:  kubectl --context functional-986276 get po -A
--- PASS: TestFunctional/serial/KubectlGetPods (0.10s)

                                                
                                    
x
+
TestFunctional/serial/CacheCmd/cache/add_remote (3.77s)

                                                
                                                
=== RUN   TestFunctional/serial/CacheCmd/cache/add_remote
functional_test.go:1049: (dbg) Run:  out/minikube-linux-arm64 -p functional-986276 cache add registry.k8s.io/pause:3.1
functional_test.go:1049: (dbg) Done: out/minikube-linux-arm64 -p functional-986276 cache add registry.k8s.io/pause:3.1: (1.367495844s)
functional_test.go:1049: (dbg) Run:  out/minikube-linux-arm64 -p functional-986276 cache add registry.k8s.io/pause:3.3
functional_test.go:1049: (dbg) Done: out/minikube-linux-arm64 -p functional-986276 cache add registry.k8s.io/pause:3.3: (1.288215195s)
functional_test.go:1049: (dbg) Run:  out/minikube-linux-arm64 -p functional-986276 cache add registry.k8s.io/pause:latest
functional_test.go:1049: (dbg) Done: out/minikube-linux-arm64 -p functional-986276 cache add registry.k8s.io/pause:latest: (1.113367827s)
--- PASS: TestFunctional/serial/CacheCmd/cache/add_remote (3.77s)

                                                
                                    
x
+
TestFunctional/serial/CacheCmd/cache/add_local (1.24s)

                                                
                                                
=== RUN   TestFunctional/serial/CacheCmd/cache/add_local
functional_test.go:1077: (dbg) Run:  docker build -t minikube-local-cache-test:functional-986276 /tmp/TestFunctionalserialCacheCmdcacheadd_local3908186344/001
functional_test.go:1089: (dbg) Run:  out/minikube-linux-arm64 -p functional-986276 cache add minikube-local-cache-test:functional-986276
functional_test.go:1094: (dbg) Run:  out/minikube-linux-arm64 -p functional-986276 cache delete minikube-local-cache-test:functional-986276
functional_test.go:1083: (dbg) Run:  docker rmi minikube-local-cache-test:functional-986276
--- PASS: TestFunctional/serial/CacheCmd/cache/add_local (1.24s)

                                                
                                    
x
+
TestFunctional/serial/CacheCmd/cache/CacheDelete (0.05s)

                                                
                                                
=== RUN   TestFunctional/serial/CacheCmd/cache/CacheDelete
functional_test.go:1102: (dbg) Run:  out/minikube-linux-arm64 cache delete registry.k8s.io/pause:3.3
--- PASS: TestFunctional/serial/CacheCmd/cache/CacheDelete (0.05s)

                                                
                                    
x
+
TestFunctional/serial/CacheCmd/cache/list (0.06s)

                                                
                                                
=== RUN   TestFunctional/serial/CacheCmd/cache/list
functional_test.go:1110: (dbg) Run:  out/minikube-linux-arm64 cache list
--- PASS: TestFunctional/serial/CacheCmd/cache/list (0.06s)

                                                
                                    
x
+
TestFunctional/serial/CacheCmd/cache/verify_cache_inside_node (0.31s)

                                                
                                                
=== RUN   TestFunctional/serial/CacheCmd/cache/verify_cache_inside_node
functional_test.go:1124: (dbg) Run:  out/minikube-linux-arm64 -p functional-986276 ssh sudo crictl images
--- PASS: TestFunctional/serial/CacheCmd/cache/verify_cache_inside_node (0.31s)

                                                
                                    
x
+
TestFunctional/serial/CacheCmd/cache/cache_reload (2s)

                                                
                                                
=== RUN   TestFunctional/serial/CacheCmd/cache/cache_reload
functional_test.go:1147: (dbg) Run:  out/minikube-linux-arm64 -p functional-986276 ssh sudo crictl rmi registry.k8s.io/pause:latest
functional_test.go:1153: (dbg) Run:  out/minikube-linux-arm64 -p functional-986276 ssh sudo crictl inspecti registry.k8s.io/pause:latest
functional_test.go:1153: (dbg) Non-zero exit: out/minikube-linux-arm64 -p functional-986276 ssh sudo crictl inspecti registry.k8s.io/pause:latest: exit status 1 (295.519813ms)

                                                
                                                
-- stdout --
	FATA[0000] no such image "registry.k8s.io/pause:latest" present 

                                                
                                                
-- /stdout --
** stderr ** 
	ssh: Process exited with status 1

                                                
                                                
** /stderr **
functional_test.go:1158: (dbg) Run:  out/minikube-linux-arm64 -p functional-986276 cache reload
functional_test.go:1158: (dbg) Done: out/minikube-linux-arm64 -p functional-986276 cache reload: (1.043593191s)
functional_test.go:1163: (dbg) Run:  out/minikube-linux-arm64 -p functional-986276 ssh sudo crictl inspecti registry.k8s.io/pause:latest
--- PASS: TestFunctional/serial/CacheCmd/cache/cache_reload (2.00s)

                                                
                                    
x
+
TestFunctional/serial/CacheCmd/cache/delete (0.11s)

                                                
                                                
=== RUN   TestFunctional/serial/CacheCmd/cache/delete
functional_test.go:1172: (dbg) Run:  out/minikube-linux-arm64 cache delete registry.k8s.io/pause:3.1
functional_test.go:1172: (dbg) Run:  out/minikube-linux-arm64 cache delete registry.k8s.io/pause:latest
--- PASS: TestFunctional/serial/CacheCmd/cache/delete (0.11s)

                                                
                                    
x
+
TestFunctional/serial/MinikubeKubectlCmd (0.14s)

                                                
                                                
=== RUN   TestFunctional/serial/MinikubeKubectlCmd
functional_test.go:716: (dbg) Run:  out/minikube-linux-arm64 -p functional-986276 kubectl -- --context functional-986276 get pods
--- PASS: TestFunctional/serial/MinikubeKubectlCmd (0.14s)

                                                
                                    
x
+
TestFunctional/serial/MinikubeKubectlCmdDirectly (0.14s)

                                                
                                                
=== RUN   TestFunctional/serial/MinikubeKubectlCmdDirectly
functional_test.go:741: (dbg) Run:  out/kubectl --context functional-986276 get pods
--- PASS: TestFunctional/serial/MinikubeKubectlCmdDirectly (0.14s)

                                                
                                    
x
+
TestFunctional/serial/ExtraConfig (54.4s)

                                                
                                                
=== RUN   TestFunctional/serial/ExtraConfig
functional_test.go:757: (dbg) Run:  out/minikube-linux-arm64 start -p functional-986276 --extra-config=apiserver.enable-admission-plugins=NamespaceAutoProvision --wait=all
functional_test.go:757: (dbg) Done: out/minikube-linux-arm64 start -p functional-986276 --extra-config=apiserver.enable-admission-plugins=NamespaceAutoProvision --wait=all: (54.395033297s)
functional_test.go:761: restart took 54.395702443s for "functional-986276" cluster.
--- PASS: TestFunctional/serial/ExtraConfig (54.40s)

                                                
                                    
x
+
TestFunctional/serial/ComponentHealth (0.11s)

                                                
                                                
=== RUN   TestFunctional/serial/ComponentHealth
functional_test.go:810: (dbg) Run:  kubectl --context functional-986276 get po -l tier=control-plane -n kube-system -o=json
functional_test.go:825: etcd phase: Running
functional_test.go:835: etcd status: Ready
functional_test.go:825: kube-apiserver phase: Running
functional_test.go:835: kube-apiserver status: Ready
functional_test.go:825: kube-controller-manager phase: Running
functional_test.go:835: kube-controller-manager status: Ready
functional_test.go:825: kube-scheduler phase: Running
functional_test.go:835: kube-scheduler status: Ready
--- PASS: TestFunctional/serial/ComponentHealth (0.11s)

                                                
                                    
x
+
TestFunctional/serial/LogsCmd (1.57s)

                                                
                                                
=== RUN   TestFunctional/serial/LogsCmd
functional_test.go:1236: (dbg) Run:  out/minikube-linux-arm64 -p functional-986276 logs
functional_test.go:1236: (dbg) Done: out/minikube-linux-arm64 -p functional-986276 logs: (1.567430016s)
--- PASS: TestFunctional/serial/LogsCmd (1.57s)

                                                
                                    
x
+
TestFunctional/serial/LogsFileCmd (1.64s)

                                                
                                                
=== RUN   TestFunctional/serial/LogsFileCmd
functional_test.go:1250: (dbg) Run:  out/minikube-linux-arm64 -p functional-986276 logs --file /tmp/TestFunctionalserialLogsFileCmd3296445064/001/logs.txt
functional_test.go:1250: (dbg) Done: out/minikube-linux-arm64 -p functional-986276 logs --file /tmp/TestFunctionalserialLogsFileCmd3296445064/001/logs.txt: (1.638223459s)
--- PASS: TestFunctional/serial/LogsFileCmd (1.64s)

                                                
                                    
x
+
TestFunctional/serial/InvalidService (3.78s)

                                                
                                                
=== RUN   TestFunctional/serial/InvalidService
functional_test.go:2321: (dbg) Run:  kubectl --context functional-986276 apply -f testdata/invalidsvc.yaml
functional_test.go:2335: (dbg) Run:  out/minikube-linux-arm64 service invalid-svc -p functional-986276
functional_test.go:2335: (dbg) Non-zero exit: out/minikube-linux-arm64 service invalid-svc -p functional-986276: exit status 115 (434.164485ms)

                                                
                                                
-- stdout --
	|-----------|-------------|-------------|---------------------------|
	| NAMESPACE |    NAME     | TARGET PORT |            URL            |
	|-----------|-------------|-------------|---------------------------|
	| default   | invalid-svc |          80 | http://192.168.49.2:30722 |
	|-----------|-------------|-------------|---------------------------|
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	X Exiting due to SVC_UNREACHABLE: service not available: no running pod for service invalid-svc found
	* 
	╭─────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                             │
	│    * If the above advice does not help, please let us know:                                 │
	│      https://github.com/kubernetes/minikube/issues/new/choose                               │
	│                                                                                             │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │
	│    * Please also attach the following file to the GitHub issue:                             │
	│    * - /tmp/minikube_service_96b204199e3191fa1740d4430b018a3c8028d52d_0.log                 │
	│                                                                                             │
	╰─────────────────────────────────────────────────────────────────────────────────────────────╯

                                                
                                                
** /stderr **
functional_test.go:2327: (dbg) Run:  kubectl --context functional-986276 delete -f testdata/invalidsvc.yaml
--- PASS: TestFunctional/serial/InvalidService (3.78s)

                                                
                                    
x
+
TestFunctional/parallel/ConfigCmd (0.47s)

                                                
                                                
=== RUN   TestFunctional/parallel/ConfigCmd
=== PAUSE TestFunctional/parallel/ConfigCmd

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/ConfigCmd
functional_test.go:1199: (dbg) Run:  out/minikube-linux-arm64 -p functional-986276 config unset cpus
functional_test.go:1199: (dbg) Run:  out/minikube-linux-arm64 -p functional-986276 config get cpus
functional_test.go:1199: (dbg) Non-zero exit: out/minikube-linux-arm64 -p functional-986276 config get cpus: exit status 14 (64.585478ms)

                                                
                                                
** stderr ** 
	Error: specified key could not be found in config

                                                
                                                
** /stderr **
functional_test.go:1199: (dbg) Run:  out/minikube-linux-arm64 -p functional-986276 config set cpus 2
functional_test.go:1199: (dbg) Run:  out/minikube-linux-arm64 -p functional-986276 config get cpus
functional_test.go:1199: (dbg) Run:  out/minikube-linux-arm64 -p functional-986276 config unset cpus
functional_test.go:1199: (dbg) Run:  out/minikube-linux-arm64 -p functional-986276 config get cpus
functional_test.go:1199: (dbg) Non-zero exit: out/minikube-linux-arm64 -p functional-986276 config get cpus: exit status 14 (79.660347ms)

                                                
                                                
** stderr ** 
	Error: specified key could not be found in config

                                                
                                                
** /stderr **
--- PASS: TestFunctional/parallel/ConfigCmd (0.47s)

                                                
                                    
x
+
TestFunctional/parallel/DashboardCmd (6.86s)

                                                
                                                
=== RUN   TestFunctional/parallel/DashboardCmd
=== PAUSE TestFunctional/parallel/DashboardCmd

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/DashboardCmd
functional_test.go:905: (dbg) daemon: [out/minikube-linux-arm64 dashboard --url --port 36195 -p functional-986276 --alsologtostderr -v=1]
functional_test.go:910: (dbg) stopping [out/minikube-linux-arm64 dashboard --url --port 36195 -p functional-986276 --alsologtostderr -v=1] ...
helpers_test.go:508: unable to kill pid 1039494: os: process already finished
--- PASS: TestFunctional/parallel/DashboardCmd (6.86s)

                                                
                                    
x
+
TestFunctional/parallel/DryRun (0.61s)

                                                
                                                
=== RUN   TestFunctional/parallel/DryRun
=== PAUSE TestFunctional/parallel/DryRun

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/DryRun
functional_test.go:974: (dbg) Run:  out/minikube-linux-arm64 start -p functional-986276 --dry-run --memory 250MB --alsologtostderr --driver=docker  --container-runtime=containerd
functional_test.go:974: (dbg) Non-zero exit: out/minikube-linux-arm64 start -p functional-986276 --dry-run --memory 250MB --alsologtostderr --driver=docker  --container-runtime=containerd: exit status 23 (273.523208ms)

                                                
                                                
-- stdout --
	* [functional-986276] minikube v1.33.1 on Ubuntu 20.04 (arm64)
	  - MINIKUBE_LOCATION=19411
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - KUBECONFIG=/home/jenkins/minikube-integration/19411-998978/kubeconfig
	  - MINIKUBE_HOME=/home/jenkins/minikube-integration/19411-998978/.minikube
	  - MINIKUBE_BIN=out/minikube-linux-arm64
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the docker driver based on existing profile
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0812 12:35:28.013811 1039177 out.go:291] Setting OutFile to fd 1 ...
	I0812 12:35:28.013979 1039177 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0812 12:35:28.013990 1039177 out.go:304] Setting ErrFile to fd 2...
	I0812 12:35:28.013995 1039177 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0812 12:35:28.014986 1039177 root.go:338] Updating PATH: /home/jenkins/minikube-integration/19411-998978/.minikube/bin
	I0812 12:35:28.015643 1039177 out.go:298] Setting JSON to false
	I0812 12:35:28.016819 1039177 start.go:129] hostinfo: {"hostname":"ip-172-31-30-239","uptime":15477,"bootTime":1723450651,"procs":212,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1066-aws","kernelArch":"aarch64","virtualizationSystem":"","virtualizationRole":"","hostId":"92f46a7d-c249-4c12-924a-77f64874c910"}
	I0812 12:35:28.016906 1039177 start.go:139] virtualization:  
	I0812 12:35:28.019440 1039177 out.go:177] * [functional-986276] minikube v1.33.1 on Ubuntu 20.04 (arm64)
	I0812 12:35:28.021657 1039177 out.go:177]   - MINIKUBE_LOCATION=19411
	I0812 12:35:28.021923 1039177 notify.go:220] Checking for updates...
	I0812 12:35:28.025132 1039177 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I0812 12:35:28.027081 1039177 out.go:177]   - KUBECONFIG=/home/jenkins/minikube-integration/19411-998978/kubeconfig
	I0812 12:35:28.028720 1039177 out.go:177]   - MINIKUBE_HOME=/home/jenkins/minikube-integration/19411-998978/.minikube
	I0812 12:35:28.030558 1039177 out.go:177]   - MINIKUBE_BIN=out/minikube-linux-arm64
	I0812 12:35:28.032360 1039177 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=
	I0812 12:35:28.034753 1039177 config.go:182] Loaded profile config "functional-986276": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.30.3
	I0812 12:35:28.035549 1039177 driver.go:392] Setting default libvirt URI to qemu:///system
	I0812 12:35:28.078053 1039177 docker.go:123] docker version: linux-27.1.1:Docker Engine - Community
	I0812 12:35:28.078180 1039177 cli_runner.go:164] Run: docker system info --format "{{json .}}"
	I0812 12:35:28.177737 1039177 info.go:266] docker info: {ID:6ZPO:QZND:VNGE:LUKL:4Y3K:XELL:AAX4:2GTK:E6LM:MPRN:3ZXR:TTMR Containers:1 ContainersRunning:1 ContainersPaused:0 ContainersStopped:0 Images:2 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:32 OomKillDisable:true NGoroutines:51 SystemTime:2024-08-12 12:35:28.167481944 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1066-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Architecture:aar
ch64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8214896640 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-30-239 Labels:[] ExperimentalBuild:false ServerVersion:27.1.1 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:2bf793ef6dc9a18e00cb12efb64355c2c9d5eb41 Expected:2bf793ef6dc9a18e00cb12efb64355c2c9d5eb41} RuncCommit:{ID:v1.1.13-0-g58aa920 Expected:v1.1.13-0-g58aa920} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:<nil> ServerErro
rs:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.16.1] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.29.1]] Warnings:<nil>}}
	I0812 12:35:28.177847 1039177 docker.go:307] overlay module found
	I0812 12:35:28.180908 1039177 out.go:177] * Using the docker driver based on existing profile
	I0812 12:35:28.182770 1039177 start.go:297] selected driver: docker
	I0812 12:35:28.182788 1039177 start.go:901] validating driver "docker" against &{Name:functional-986276 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1723026928-19389@sha256:7715fe0c5dce35b4eb757765cbbe02d40cd8b5effa0639735e42ad89f4f51ef0 Memory:4000 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8441 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.30.3 ClusterName:functional-986276 Namespace:default APIServerHAVIP: APIServerNa
me:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[{Component:apiserver Key:enable-admission-plugins Value:NamespaceAutoProvision}] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.49.2 Port:8441 KubernetesVersion:v1.30.3 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[default-storageclass:true storage-provisioner:true] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:do
cker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I0812 12:35:28.182908 1039177 start.go:912] status for docker: {Installed:true Healthy:true Running:false NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I0812 12:35:28.185335 1039177 out.go:177] 
	W0812 12:35:28.187252 1039177 out.go:239] X Exiting due to RSRC_INSUFFICIENT_REQ_MEMORY: Requested memory allocation 250MiB is less than the usable minimum of 1800MB
	X Exiting due to RSRC_INSUFFICIENT_REQ_MEMORY: Requested memory allocation 250MiB is less than the usable minimum of 1800MB
	I0812 12:35:28.188952 1039177 out.go:177] 

                                                
                                                
** /stderr **
functional_test.go:991: (dbg) Run:  out/minikube-linux-arm64 start -p functional-986276 --dry-run --alsologtostderr -v=1 --driver=docker  --container-runtime=containerd
--- PASS: TestFunctional/parallel/DryRun (0.61s)

                                                
                                    
x
+
TestFunctional/parallel/InternationalLanguage (0.25s)

                                                
                                                
=== RUN   TestFunctional/parallel/InternationalLanguage
=== PAUSE TestFunctional/parallel/InternationalLanguage

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/InternationalLanguage
functional_test.go:1020: (dbg) Run:  out/minikube-linux-arm64 start -p functional-986276 --dry-run --memory 250MB --alsologtostderr --driver=docker  --container-runtime=containerd
functional_test.go:1020: (dbg) Non-zero exit: out/minikube-linux-arm64 start -p functional-986276 --dry-run --memory 250MB --alsologtostderr --driver=docker  --container-runtime=containerd: exit status 23 (251.582675ms)

                                                
                                                
-- stdout --
	* [functional-986276] minikube v1.33.1 sur Ubuntu 20.04 (arm64)
	  - MINIKUBE_LOCATION=19411
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - KUBECONFIG=/home/jenkins/minikube-integration/19411-998978/kubeconfig
	  - MINIKUBE_HOME=/home/jenkins/minikube-integration/19411-998978/.minikube
	  - MINIKUBE_BIN=out/minikube-linux-arm64
	  - MINIKUBE_FORCE_SYSTEMD=
	* Utilisation du pilote docker basé sur le profil existant
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0812 12:35:27.749088 1039130 out.go:291] Setting OutFile to fd 1 ...
	I0812 12:35:27.749388 1039130 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0812 12:35:27.749430 1039130 out.go:304] Setting ErrFile to fd 2...
	I0812 12:35:27.749450 1039130 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0812 12:35:27.749968 1039130 root.go:338] Updating PATH: /home/jenkins/minikube-integration/19411-998978/.minikube/bin
	I0812 12:35:27.750498 1039130 out.go:298] Setting JSON to false
	I0812 12:35:27.751706 1039130 start.go:129] hostinfo: {"hostname":"ip-172-31-30-239","uptime":15477,"bootTime":1723450651,"procs":212,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1066-aws","kernelArch":"aarch64","virtualizationSystem":"","virtualizationRole":"","hostId":"92f46a7d-c249-4c12-924a-77f64874c910"}
	I0812 12:35:27.751843 1039130 start.go:139] virtualization:  
	I0812 12:35:27.756535 1039130 out.go:177] * [functional-986276] minikube v1.33.1 sur Ubuntu 20.04 (arm64)
	I0812 12:35:27.762025 1039130 out.go:177]   - MINIKUBE_LOCATION=19411
	I0812 12:35:27.762112 1039130 notify.go:220] Checking for updates...
	I0812 12:35:27.767573 1039130 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I0812 12:35:27.769170 1039130 out.go:177]   - KUBECONFIG=/home/jenkins/minikube-integration/19411-998978/kubeconfig
	I0812 12:35:27.770972 1039130 out.go:177]   - MINIKUBE_HOME=/home/jenkins/minikube-integration/19411-998978/.minikube
	I0812 12:35:27.772960 1039130 out.go:177]   - MINIKUBE_BIN=out/minikube-linux-arm64
	I0812 12:35:27.774969 1039130 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=
	I0812 12:35:27.777417 1039130 config.go:182] Loaded profile config "functional-986276": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.30.3
	I0812 12:35:27.777912 1039130 driver.go:392] Setting default libvirt URI to qemu:///system
	I0812 12:35:27.818275 1039130 docker.go:123] docker version: linux-27.1.1:Docker Engine - Community
	I0812 12:35:27.818391 1039130 cli_runner.go:164] Run: docker system info --format "{{json .}}"
	I0812 12:35:27.904612 1039130 info.go:266] docker info: {ID:6ZPO:QZND:VNGE:LUKL:4Y3K:XELL:AAX4:2GTK:E6LM:MPRN:3ZXR:TTMR Containers:1 ContainersRunning:1 ContainersPaused:0 ContainersStopped:0 Images:2 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:32 OomKillDisable:true NGoroutines:51 SystemTime:2024-08-12 12:35:27.894382701 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1066-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Architecture:aar
ch64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8214896640 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-30-239 Labels:[] ExperimentalBuild:false ServerVersion:27.1.1 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:2bf793ef6dc9a18e00cb12efb64355c2c9d5eb41 Expected:2bf793ef6dc9a18e00cb12efb64355c2c9d5eb41} RuncCommit:{ID:v1.1.13-0-g58aa920 Expected:v1.1.13-0-g58aa920} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:<nil> ServerErro
rs:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.16.1] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.29.1]] Warnings:<nil>}}
	I0812 12:35:27.904723 1039130 docker.go:307] overlay module found
	I0812 12:35:27.908074 1039130 out.go:177] * Utilisation du pilote docker basé sur le profil existant
	I0812 12:35:27.909758 1039130 start.go:297] selected driver: docker
	I0812 12:35:27.909784 1039130 start.go:901] validating driver "docker" against &{Name:functional-986276 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1723026928-19389@sha256:7715fe0c5dce35b4eb757765cbbe02d40cd8b5effa0639735e42ad89f4f51ef0 Memory:4000 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8441 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.30.3 ClusterName:functional-986276 Namespace:default APIServerHAVIP: APIServerNa
me:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[{Component:apiserver Key:enable-admission-plugins Value:NamespaceAutoProvision}] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.49.2 Port:8441 KubernetesVersion:v1.30.3 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[default-storageclass:true storage-provisioner:true] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:do
cker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I0812 12:35:27.909890 1039130 start.go:912] status for docker: {Installed:true Healthy:true Running:false NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I0812 12:35:27.912022 1039130 out.go:177] 
	W0812 12:35:27.913747 1039130 out.go:239] X Fermeture en raison de RSRC_INSUFFICIENT_REQ_MEMORY : L'allocation de mémoire demandée 250 Mio est inférieure au minimum utilisable de 1800 Mo
	X Fermeture en raison de RSRC_INSUFFICIENT_REQ_MEMORY : L'allocation de mémoire demandée 250 Mio est inférieure au minimum utilisable de 1800 Mo
	I0812 12:35:27.915654 1039130 out.go:177] 

                                                
                                                
** /stderr **
--- PASS: TestFunctional/parallel/InternationalLanguage (0.25s)

                                                
                                    
x
+
TestFunctional/parallel/StatusCmd (1.3s)

                                                
                                                
=== RUN   TestFunctional/parallel/StatusCmd
=== PAUSE TestFunctional/parallel/StatusCmd

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/StatusCmd
functional_test.go:854: (dbg) Run:  out/minikube-linux-arm64 -p functional-986276 status
functional_test.go:860: (dbg) Run:  out/minikube-linux-arm64 -p functional-986276 status -f host:{{.Host}},kublet:{{.Kubelet}},apiserver:{{.APIServer}},kubeconfig:{{.Kubeconfig}}
functional_test.go:872: (dbg) Run:  out/minikube-linux-arm64 -p functional-986276 status -o json
--- PASS: TestFunctional/parallel/StatusCmd (1.30s)

                                                
                                    
x
+
TestFunctional/parallel/ServiceCmdConnect (9.64s)

                                                
                                                
=== RUN   TestFunctional/parallel/ServiceCmdConnect
=== PAUSE TestFunctional/parallel/ServiceCmdConnect

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/ServiceCmdConnect
functional_test.go:1627: (dbg) Run:  kubectl --context functional-986276 create deployment hello-node-connect --image=registry.k8s.io/echoserver-arm:1.8
functional_test.go:1635: (dbg) Run:  kubectl --context functional-986276 expose deployment hello-node-connect --type=NodePort --port=8080
functional_test.go:1640: (dbg) TestFunctional/parallel/ServiceCmdConnect: waiting 10m0s for pods matching "app=hello-node-connect" in namespace "default" ...
helpers_test.go:344: "hello-node-connect-6f49f58cd5-59fxt" [0983c3ab-c99d-4664-9196-b8ea9d6ff0aa] Pending / Ready:ContainersNotReady (containers with unready status: [echoserver-arm]) / ContainersReady:ContainersNotReady (containers with unready status: [echoserver-arm])
helpers_test.go:344: "hello-node-connect-6f49f58cd5-59fxt" [0983c3ab-c99d-4664-9196-b8ea9d6ff0aa] Running
E0812 12:35:04.009705 1004370 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19411-998978/.minikube/profiles/addons-673965/client.crt: no such file or directory
functional_test.go:1640: (dbg) TestFunctional/parallel/ServiceCmdConnect: app=hello-node-connect healthy within 9.003631232s
functional_test.go:1649: (dbg) Run:  out/minikube-linux-arm64 -p functional-986276 service hello-node-connect --url
functional_test.go:1655: found endpoint for hello-node-connect: http://192.168.49.2:32667
functional_test.go:1675: http://192.168.49.2:32667: success! body:

                                                
                                                

                                                
                                                
Hostname: hello-node-connect-6f49f58cd5-59fxt

                                                
                                                
Pod Information:
	-no pod information available-

                                                
                                                
Server values:
	server_version=nginx: 1.13.3 - lua: 10008

                                                
                                                
Request Information:
	client_address=10.244.0.1
	method=GET
	real path=/
	query=
	request_version=1.1
	request_uri=http://192.168.49.2:8080/

                                                
                                                
Request Headers:
	accept-encoding=gzip
	host=192.168.49.2:32667
	user-agent=Go-http-client/1.1

                                                
                                                
Request Body:
	-no body in request-

                                                
                                                
--- PASS: TestFunctional/parallel/ServiceCmdConnect (9.64s)

                                                
                                    
x
+
TestFunctional/parallel/AddonsCmd (0.14s)

                                                
                                                
=== RUN   TestFunctional/parallel/AddonsCmd
=== PAUSE TestFunctional/parallel/AddonsCmd

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/AddonsCmd
functional_test.go:1690: (dbg) Run:  out/minikube-linux-arm64 -p functional-986276 addons list
functional_test.go:1702: (dbg) Run:  out/minikube-linux-arm64 -p functional-986276 addons list -o json
--- PASS: TestFunctional/parallel/AddonsCmd (0.14s)

                                                
                                    
x
+
TestFunctional/parallel/PersistentVolumeClaim (91.96s)

                                                
                                                
=== RUN   TestFunctional/parallel/PersistentVolumeClaim
=== PAUSE TestFunctional/parallel/PersistentVolumeClaim

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/PersistentVolumeClaim
functional_test_pvc_test.go:44: (dbg) TestFunctional/parallel/PersistentVolumeClaim: waiting 4m0s for pods matching "integration-test=storage-provisioner" in namespace "kube-system" ...
helpers_test.go:344: "storage-provisioner" [097b7ab7-ccff-4688-86dd-a8e2b49d0ebe] Running
functional_test_pvc_test.go:44: (dbg) TestFunctional/parallel/PersistentVolumeClaim: integration-test=storage-provisioner healthy within 5.005157681s
functional_test_pvc_test.go:49: (dbg) Run:  kubectl --context functional-986276 get storageclass -o=json
functional_test_pvc_test.go:69: (dbg) Run:  kubectl --context functional-986276 apply -f testdata/storage-provisioner/pvc.yaml
functional_test_pvc_test.go:76: (dbg) Run:  kubectl --context functional-986276 get pvc myclaim -o=json
functional_test_pvc_test.go:76: (dbg) Run:  kubectl --context functional-986276 get pvc myclaim -o=json
functional_test_pvc_test.go:76: (dbg) Run:  kubectl --context functional-986276 get pvc myclaim -o=json
functional_test_pvc_test.go:76: (dbg) Run:  kubectl --context functional-986276 get pvc myclaim -o=json
functional_test_pvc_test.go:76: (dbg) Run:  kubectl --context functional-986276 get pvc myclaim -o=json
functional_test_pvc_test.go:76: (dbg) Run:  kubectl --context functional-986276 get pvc myclaim -o=json
E0812 12:34:43.527445 1004370 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19411-998978/.minikube/profiles/addons-673965/client.crt: no such file or directory
E0812 12:34:43.533171 1004370 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19411-998978/.minikube/profiles/addons-673965/client.crt: no such file or directory
E0812 12:34:43.543556 1004370 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19411-998978/.minikube/profiles/addons-673965/client.crt: no such file or directory
E0812 12:34:43.563841 1004370 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19411-998978/.minikube/profiles/addons-673965/client.crt: no such file or directory
E0812 12:34:43.604126 1004370 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19411-998978/.minikube/profiles/addons-673965/client.crt: no such file or directory
E0812 12:34:43.684555 1004370 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19411-998978/.minikube/profiles/addons-673965/client.crt: no such file or directory
E0812 12:34:43.845014 1004370 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19411-998978/.minikube/profiles/addons-673965/client.crt: no such file or directory
E0812 12:34:44.165587 1004370 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19411-998978/.minikube/profiles/addons-673965/client.crt: no such file or directory
E0812 12:34:44.805851 1004370 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19411-998978/.minikube/profiles/addons-673965/client.crt: no such file or directory
E0812 12:34:46.086805 1004370 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19411-998978/.minikube/profiles/addons-673965/client.crt: no such file or directory
functional_test_pvc_test.go:76: (dbg) Run:  kubectl --context functional-986276 get pvc myclaim -o=json
E0812 12:34:53.768502 1004370 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19411-998978/.minikube/profiles/addons-673965/client.crt: no such file or directory
functional_test_pvc_test.go:76: (dbg) Run:  kubectl --context functional-986276 get pvc myclaim -o=json
functional_test_pvc_test.go:125: (dbg) Run:  kubectl --context functional-986276 apply -f testdata/storage-provisioner/pod.yaml
functional_test_pvc_test.go:130: (dbg) TestFunctional/parallel/PersistentVolumeClaim: waiting 3m0s for pods matching "test=storage-provisioner" in namespace "default" ...
helpers_test.go:344: "sp-pod" [b330423a-d2d1-4829-9d4e-541932ce2d17] Pending
helpers_test.go:344: "sp-pod" [b330423a-d2d1-4829-9d4e-541932ce2d17] Pending / Ready:ContainersNotReady (containers with unready status: [myfrontend]) / ContainersReady:ContainersNotReady (containers with unready status: [myfrontend])
helpers_test.go:344: "sp-pod" [b330423a-d2d1-4829-9d4e-541932ce2d17] Running
2024/08/12 12:35:35 [DEBUG] GET http://127.0.0.1:36195/api/v1/namespaces/kubernetes-dashboard/services/http:kubernetes-dashboard:/proxy/
functional_test_pvc_test.go:130: (dbg) TestFunctional/parallel/PersistentVolumeClaim: test=storage-provisioner healthy within 10.016024529s
functional_test_pvc_test.go:100: (dbg) Run:  kubectl --context functional-986276 exec sp-pod -- touch /tmp/mount/foo
functional_test_pvc_test.go:106: (dbg) Run:  kubectl --context functional-986276 delete -f testdata/storage-provisioner/pod.yaml
functional_test_pvc_test.go:106: (dbg) Done: kubectl --context functional-986276 delete -f testdata/storage-provisioner/pod.yaml: (1.767275691s)
functional_test_pvc_test.go:125: (dbg) Run:  kubectl --context functional-986276 apply -f testdata/storage-provisioner/pod.yaml
functional_test_pvc_test.go:130: (dbg) TestFunctional/parallel/PersistentVolumeClaim: waiting 3m0s for pods matching "test=storage-provisioner" in namespace "default" ...
helpers_test.go:344: "sp-pod" [ff1d92e5-4659-4814-950f-4d1a413312f5] Pending
helpers_test.go:344: "sp-pod" [ff1d92e5-4659-4814-950f-4d1a413312f5] Running
functional_test_pvc_test.go:130: (dbg) TestFunctional/parallel/PersistentVolumeClaim: test=storage-provisioner healthy within 7.004092262s
functional_test_pvc_test.go:114: (dbg) Run:  kubectl --context functional-986276 exec sp-pod -- ls /tmp/mount
--- PASS: TestFunctional/parallel/PersistentVolumeClaim (91.96s)

                                                
                                    
x
+
TestFunctional/parallel/SSHCmd (0.76s)

                                                
                                                
=== RUN   TestFunctional/parallel/SSHCmd
=== PAUSE TestFunctional/parallel/SSHCmd

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/SSHCmd
functional_test.go:1725: (dbg) Run:  out/minikube-linux-arm64 -p functional-986276 ssh "echo hello"
functional_test.go:1742: (dbg) Run:  out/minikube-linux-arm64 -p functional-986276 ssh "cat /etc/hostname"
--- PASS: TestFunctional/parallel/SSHCmd (0.76s)

                                                
                                    
x
+
TestFunctional/parallel/CpCmd (2.46s)

                                                
                                                
=== RUN   TestFunctional/parallel/CpCmd
=== PAUSE TestFunctional/parallel/CpCmd

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/CpCmd
helpers_test.go:556: (dbg) Run:  out/minikube-linux-arm64 -p functional-986276 cp testdata/cp-test.txt /home/docker/cp-test.txt
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p functional-986276 ssh -n functional-986276 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:556: (dbg) Run:  out/minikube-linux-arm64 -p functional-986276 cp functional-986276:/home/docker/cp-test.txt /tmp/TestFunctionalparallelCpCmd2437460482/001/cp-test.txt
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p functional-986276 ssh -n functional-986276 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:556: (dbg) Run:  out/minikube-linux-arm64 -p functional-986276 cp testdata/cp-test.txt /tmp/does/not/exist/cp-test.txt
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p functional-986276 ssh -n functional-986276 "sudo cat /tmp/does/not/exist/cp-test.txt"
--- PASS: TestFunctional/parallel/CpCmd (2.46s)

                                                
                                    
x
+
TestFunctional/parallel/FileSync (0.27s)

                                                
                                                
=== RUN   TestFunctional/parallel/FileSync
=== PAUSE TestFunctional/parallel/FileSync

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/FileSync
functional_test.go:1929: Checking for existence of /etc/test/nested/copy/1004370/hosts within VM
functional_test.go:1931: (dbg) Run:  out/minikube-linux-arm64 -p functional-986276 ssh "sudo cat /etc/test/nested/copy/1004370/hosts"
functional_test.go:1936: file sync test content: Test file for checking file sync process
--- PASS: TestFunctional/parallel/FileSync (0.27s)

                                                
                                    
x
+
TestFunctional/parallel/CertSync (1.8s)

                                                
                                                
=== RUN   TestFunctional/parallel/CertSync
=== PAUSE TestFunctional/parallel/CertSync

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/CertSync
functional_test.go:1972: Checking for existence of /etc/ssl/certs/1004370.pem within VM
functional_test.go:1973: (dbg) Run:  out/minikube-linux-arm64 -p functional-986276 ssh "sudo cat /etc/ssl/certs/1004370.pem"
functional_test.go:1972: Checking for existence of /usr/share/ca-certificates/1004370.pem within VM
functional_test.go:1973: (dbg) Run:  out/minikube-linux-arm64 -p functional-986276 ssh "sudo cat /usr/share/ca-certificates/1004370.pem"
functional_test.go:1972: Checking for existence of /etc/ssl/certs/51391683.0 within VM
functional_test.go:1973: (dbg) Run:  out/minikube-linux-arm64 -p functional-986276 ssh "sudo cat /etc/ssl/certs/51391683.0"
functional_test.go:1999: Checking for existence of /etc/ssl/certs/10043702.pem within VM
functional_test.go:2000: (dbg) Run:  out/minikube-linux-arm64 -p functional-986276 ssh "sudo cat /etc/ssl/certs/10043702.pem"
functional_test.go:1999: Checking for existence of /usr/share/ca-certificates/10043702.pem within VM
functional_test.go:2000: (dbg) Run:  out/minikube-linux-arm64 -p functional-986276 ssh "sudo cat /usr/share/ca-certificates/10043702.pem"
functional_test.go:1999: Checking for existence of /etc/ssl/certs/3ec20f2e.0 within VM
functional_test.go:2000: (dbg) Run:  out/minikube-linux-arm64 -p functional-986276 ssh "sudo cat /etc/ssl/certs/3ec20f2e.0"
--- PASS: TestFunctional/parallel/CertSync (1.80s)

                                                
                                    
x
+
TestFunctional/parallel/NodeLabels (0.08s)

                                                
                                                
=== RUN   TestFunctional/parallel/NodeLabels
=== PAUSE TestFunctional/parallel/NodeLabels

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/NodeLabels
functional_test.go:219: (dbg) Run:  kubectl --context functional-986276 get nodes --output=go-template "--template='{{range $k, $v := (index .items 0).metadata.labels}}{{$k}} {{end}}'"
--- PASS: TestFunctional/parallel/NodeLabels (0.08s)

                                                
                                    
x
+
TestFunctional/parallel/NonActiveRuntimeDisabled (0.68s)

                                                
                                                
=== RUN   TestFunctional/parallel/NonActiveRuntimeDisabled
=== PAUSE TestFunctional/parallel/NonActiveRuntimeDisabled

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/NonActiveRuntimeDisabled
functional_test.go:2027: (dbg) Run:  out/minikube-linux-arm64 -p functional-986276 ssh "sudo systemctl is-active docker"
functional_test.go:2027: (dbg) Non-zero exit: out/minikube-linux-arm64 -p functional-986276 ssh "sudo systemctl is-active docker": exit status 1 (290.994466ms)

                                                
                                                
-- stdout --
	inactive

                                                
                                                
-- /stdout --
** stderr ** 
	ssh: Process exited with status 3

                                                
                                                
** /stderr **
functional_test.go:2027: (dbg) Run:  out/minikube-linux-arm64 -p functional-986276 ssh "sudo systemctl is-active crio"
functional_test.go:2027: (dbg) Non-zero exit: out/minikube-linux-arm64 -p functional-986276 ssh "sudo systemctl is-active crio": exit status 1 (388.737758ms)

                                                
                                                
-- stdout --
	inactive

                                                
                                                
-- /stdout --
** stderr ** 
	ssh: Process exited with status 3

                                                
                                                
** /stderr **
--- PASS: TestFunctional/parallel/NonActiveRuntimeDisabled (0.68s)

                                                
                                    
x
+
TestFunctional/parallel/License (0.22s)

                                                
                                                
=== RUN   TestFunctional/parallel/License
=== PAUSE TestFunctional/parallel/License

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/License
functional_test.go:2288: (dbg) Run:  out/minikube-linux-arm64 license
--- PASS: TestFunctional/parallel/License (0.22s)

                                                
                                    
x
+
TestFunctional/parallel/TunnelCmd/serial/RunSecondTunnel (0.68s)

                                                
                                                
=== RUN   TestFunctional/parallel/TunnelCmd/serial/RunSecondTunnel
functional_test_tunnel_test.go:154: (dbg) daemon: [out/minikube-linux-arm64 -p functional-986276 tunnel --alsologtostderr]
functional_test_tunnel_test.go:154: (dbg) daemon: [out/minikube-linux-arm64 -p functional-986276 tunnel --alsologtostderr]
functional_test_tunnel_test.go:194: (dbg) stopping [out/minikube-linux-arm64 -p functional-986276 tunnel --alsologtostderr] ...
helpers_test.go:490: unable to find parent, assuming dead: process does not exist
functional_test_tunnel_test.go:194: (dbg) stopping [out/minikube-linux-arm64 -p functional-986276 tunnel --alsologtostderr] ...
helpers_test.go:508: unable to kill pid 1035948: os: process already finished
--- PASS: TestFunctional/parallel/TunnelCmd/serial/RunSecondTunnel (0.68s)

                                                
                                    
x
+
TestFunctional/parallel/TunnelCmd/serial/StartTunnel (0s)

                                                
                                                
=== RUN   TestFunctional/parallel/TunnelCmd/serial/StartTunnel
functional_test_tunnel_test.go:129: (dbg) daemon: [out/minikube-linux-arm64 -p functional-986276 tunnel --alsologtostderr]
--- PASS: TestFunctional/parallel/TunnelCmd/serial/StartTunnel (0.00s)

                                                
                                    
x
+
TestFunctional/parallel/TunnelCmd/serial/WaitService/Setup (43.43s)

                                                
                                                
=== RUN   TestFunctional/parallel/TunnelCmd/serial/WaitService/Setup
functional_test_tunnel_test.go:212: (dbg) Run:  kubectl --context functional-986276 apply -f testdata/testsvc.yaml
functional_test_tunnel_test.go:216: (dbg) TestFunctional/parallel/TunnelCmd/serial/WaitService/Setup: waiting 4m0s for pods matching "run=nginx-svc" in namespace "default" ...
helpers_test.go:344: "nginx-svc" [569ef2ac-b442-4819-9816-84a9386d760b] Pending
helpers_test.go:344: "nginx-svc" [569ef2ac-b442-4819-9816-84a9386d760b] Pending / Ready:ContainersNotReady (containers with unready status: [nginx]) / ContainersReady:ContainersNotReady (containers with unready status: [nginx])
E0812 12:34:48.647858 1004370 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19411-998978/.minikube/profiles/addons-673965/client.crt: no such file or directory
helpers_test.go:344: "nginx-svc" [569ef2ac-b442-4819-9816-84a9386d760b] Running
functional_test_tunnel_test.go:216: (dbg) TestFunctional/parallel/TunnelCmd/serial/WaitService/Setup: run=nginx-svc healthy within 43.00352204s
--- PASS: TestFunctional/parallel/TunnelCmd/serial/WaitService/Setup (43.43s)

                                                
                                    
x
+
TestFunctional/parallel/TunnelCmd/serial/WaitService/IngressIP (0.08s)

                                                
                                                
=== RUN   TestFunctional/parallel/TunnelCmd/serial/WaitService/IngressIP
functional_test_tunnel_test.go:234: (dbg) Run:  kubectl --context functional-986276 get svc nginx-svc -o jsonpath={.status.loadBalancer.ingress[0].ip}
--- PASS: TestFunctional/parallel/TunnelCmd/serial/WaitService/IngressIP (0.08s)

                                                
                                    
x
+
TestFunctional/parallel/TunnelCmd/serial/AccessDirect (0s)

                                                
                                                
=== RUN   TestFunctional/parallel/TunnelCmd/serial/AccessDirect
functional_test_tunnel_test.go:299: tunnel at http://10.102.177.62 is working!
--- PASS: TestFunctional/parallel/TunnelCmd/serial/AccessDirect (0.00s)

                                                
                                    
x
+
TestFunctional/parallel/TunnelCmd/serial/DeleteTunnel (0.11s)

                                                
                                                
=== RUN   TestFunctional/parallel/TunnelCmd/serial/DeleteTunnel
functional_test_tunnel_test.go:434: (dbg) stopping [out/minikube-linux-arm64 -p functional-986276 tunnel --alsologtostderr] ...
--- PASS: TestFunctional/parallel/TunnelCmd/serial/DeleteTunnel (0.11s)

                                                
                                    
x
+
TestFunctional/parallel/ServiceCmd/DeployApp (8.25s)

                                                
                                                
=== RUN   TestFunctional/parallel/ServiceCmd/DeployApp
functional_test.go:1437: (dbg) Run:  kubectl --context functional-986276 create deployment hello-node --image=registry.k8s.io/echoserver-arm:1.8
functional_test.go:1445: (dbg) Run:  kubectl --context functional-986276 expose deployment hello-node --type=NodePort --port=8080
functional_test.go:1450: (dbg) TestFunctional/parallel/ServiceCmd/DeployApp: waiting 10m0s for pods matching "app=hello-node" in namespace "default" ...
helpers_test.go:344: "hello-node-65f5d5cc78-644rp" [1b457318-6b9a-4c2c-9560-90563b8aa247] Pending / Ready:ContainersNotReady (containers with unready status: [echoserver-arm]) / ContainersReady:ContainersNotReady (containers with unready status: [echoserver-arm])
helpers_test.go:344: "hello-node-65f5d5cc78-644rp" [1b457318-6b9a-4c2c-9560-90563b8aa247] Running
functional_test.go:1450: (dbg) TestFunctional/parallel/ServiceCmd/DeployApp: app=hello-node healthy within 8.004219786s
--- PASS: TestFunctional/parallel/ServiceCmd/DeployApp (8.25s)

                                                
                                    
x
+
TestFunctional/parallel/ServiceCmd/List (0.51s)

                                                
                                                
=== RUN   TestFunctional/parallel/ServiceCmd/List
functional_test.go:1459: (dbg) Run:  out/minikube-linux-arm64 -p functional-986276 service list
--- PASS: TestFunctional/parallel/ServiceCmd/List (0.51s)

                                                
                                    
x
+
TestFunctional/parallel/ServiceCmd/JSONOutput (0.55s)

                                                
                                                
=== RUN   TestFunctional/parallel/ServiceCmd/JSONOutput
functional_test.go:1489: (dbg) Run:  out/minikube-linux-arm64 -p functional-986276 service list -o json
functional_test.go:1494: Took "553.669049ms" to run "out/minikube-linux-arm64 -p functional-986276 service list -o json"
--- PASS: TestFunctional/parallel/ServiceCmd/JSONOutput (0.55s)

                                                
                                    
x
+
TestFunctional/parallel/ServiceCmd/HTTPS (0.38s)

                                                
                                                
=== RUN   TestFunctional/parallel/ServiceCmd/HTTPS
functional_test.go:1509: (dbg) Run:  out/minikube-linux-arm64 -p functional-986276 service --namespace=default --https --url hello-node
functional_test.go:1522: found endpoint: https://192.168.49.2:31043
--- PASS: TestFunctional/parallel/ServiceCmd/HTTPS (0.38s)

                                                
                                    
x
+
TestFunctional/parallel/ServiceCmd/Format (0.38s)

                                                
                                                
=== RUN   TestFunctional/parallel/ServiceCmd/Format
functional_test.go:1540: (dbg) Run:  out/minikube-linux-arm64 -p functional-986276 service hello-node --url --format={{.IP}}
--- PASS: TestFunctional/parallel/ServiceCmd/Format (0.38s)

                                                
                                    
x
+
TestFunctional/parallel/ServiceCmd/URL (0.38s)

                                                
                                                
=== RUN   TestFunctional/parallel/ServiceCmd/URL
functional_test.go:1559: (dbg) Run:  out/minikube-linux-arm64 -p functional-986276 service hello-node --url
functional_test.go:1565: found endpoint for hello-node: http://192.168.49.2:31043
--- PASS: TestFunctional/parallel/ServiceCmd/URL (0.38s)

                                                
                                    
x
+
TestFunctional/parallel/ProfileCmd/profile_not_create (0.41s)

                                                
                                                
=== RUN   TestFunctional/parallel/ProfileCmd/profile_not_create
functional_test.go:1270: (dbg) Run:  out/minikube-linux-arm64 profile lis
functional_test.go:1275: (dbg) Run:  out/minikube-linux-arm64 profile list --output json
--- PASS: TestFunctional/parallel/ProfileCmd/profile_not_create (0.41s)

                                                
                                    
x
+
TestFunctional/parallel/ProfileCmd/profile_list (0.39s)

                                                
                                                
=== RUN   TestFunctional/parallel/ProfileCmd/profile_list
functional_test.go:1310: (dbg) Run:  out/minikube-linux-arm64 profile list
functional_test.go:1315: Took "341.947296ms" to run "out/minikube-linux-arm64 profile list"
functional_test.go:1324: (dbg) Run:  out/minikube-linux-arm64 profile list -l
functional_test.go:1329: Took "52.842361ms" to run "out/minikube-linux-arm64 profile list -l"
--- PASS: TestFunctional/parallel/ProfileCmd/profile_list (0.39s)

                                                
                                    
x
+
TestFunctional/parallel/ProfileCmd/profile_json_output (0.4s)

                                                
                                                
=== RUN   TestFunctional/parallel/ProfileCmd/profile_json_output
functional_test.go:1361: (dbg) Run:  out/minikube-linux-arm64 profile list -o json
functional_test.go:1366: Took "346.443164ms" to run "out/minikube-linux-arm64 profile list -o json"
functional_test.go:1374: (dbg) Run:  out/minikube-linux-arm64 profile list -o json --light
functional_test.go:1379: Took "52.9889ms" to run "out/minikube-linux-arm64 profile list -o json --light"
--- PASS: TestFunctional/parallel/ProfileCmd/profile_json_output (0.40s)

                                                
                                    
x
+
TestFunctional/parallel/MountCmd/any-port (5.21s)

                                                
                                                
=== RUN   TestFunctional/parallel/MountCmd/any-port
functional_test_mount_test.go:73: (dbg) daemon: [out/minikube-linux-arm64 mount -p functional-986276 /tmp/TestFunctionalparallelMountCmdany-port1499585889/001:/mount-9p --alsologtostderr -v=1]
functional_test_mount_test.go:107: wrote "test-1723466117814411071" to /tmp/TestFunctionalparallelMountCmdany-port1499585889/001/created-by-test
functional_test_mount_test.go:107: wrote "test-1723466117814411071" to /tmp/TestFunctionalparallelMountCmdany-port1499585889/001/created-by-test-removed-by-pod
functional_test_mount_test.go:107: wrote "test-1723466117814411071" to /tmp/TestFunctionalparallelMountCmdany-port1499585889/001/test-1723466117814411071
functional_test_mount_test.go:115: (dbg) Run:  out/minikube-linux-arm64 -p functional-986276 ssh "findmnt -T /mount-9p | grep 9p"
functional_test_mount_test.go:129: (dbg) Run:  out/minikube-linux-arm64 -p functional-986276 ssh -- ls -la /mount-9p
functional_test_mount_test.go:133: guest mount directory contents
total 2
-rw-r--r-- 1 docker docker 24 Aug 12 12:35 created-by-test
-rw-r--r-- 1 docker docker 24 Aug 12 12:35 created-by-test-removed-by-pod
-rw-r--r-- 1 docker docker 24 Aug 12 12:35 test-1723466117814411071
functional_test_mount_test.go:137: (dbg) Run:  out/minikube-linux-arm64 -p functional-986276 ssh cat /mount-9p/test-1723466117814411071
functional_test_mount_test.go:148: (dbg) Run:  kubectl --context functional-986276 replace --force -f testdata/busybox-mount-test.yaml
functional_test_mount_test.go:153: (dbg) TestFunctional/parallel/MountCmd/any-port: waiting 4m0s for pods matching "integration-test=busybox-mount" in namespace "default" ...
helpers_test.go:344: "busybox-mount" [3b1d9654-fe80-4854-a355-9df43d0fcdcf] Pending
helpers_test.go:344: "busybox-mount" [3b1d9654-fe80-4854-a355-9df43d0fcdcf] Pending / Ready:ContainersNotReady (containers with unready status: [mount-munger]) / ContainersReady:ContainersNotReady (containers with unready status: [mount-munger])
helpers_test.go:344: "busybox-mount" [3b1d9654-fe80-4854-a355-9df43d0fcdcf] Pending / Initialized:PodCompleted / Ready:PodCompleted / ContainersReady:PodCompleted
helpers_test.go:344: "busybox-mount" [3b1d9654-fe80-4854-a355-9df43d0fcdcf] Succeeded / Initialized:PodCompleted / Ready:PodCompleted / ContainersReady:PodCompleted
functional_test_mount_test.go:153: (dbg) TestFunctional/parallel/MountCmd/any-port: integration-test=busybox-mount healthy within 3.005206685s
functional_test_mount_test.go:169: (dbg) Run:  kubectl --context functional-986276 logs busybox-mount
functional_test_mount_test.go:181: (dbg) Run:  out/minikube-linux-arm64 -p functional-986276 ssh stat /mount-9p/created-by-test
functional_test_mount_test.go:181: (dbg) Run:  out/minikube-linux-arm64 -p functional-986276 ssh stat /mount-9p/created-by-pod
functional_test_mount_test.go:90: (dbg) Run:  out/minikube-linux-arm64 -p functional-986276 ssh "sudo umount -f /mount-9p"
functional_test_mount_test.go:94: (dbg) stopping [out/minikube-linux-arm64 mount -p functional-986276 /tmp/TestFunctionalparallelMountCmdany-port1499585889/001:/mount-9p --alsologtostderr -v=1] ...
--- PASS: TestFunctional/parallel/MountCmd/any-port (5.21s)

                                                
                                    
x
+
TestFunctional/parallel/MountCmd/specific-port (1.87s)

                                                
                                                
=== RUN   TestFunctional/parallel/MountCmd/specific-port
functional_test_mount_test.go:213: (dbg) daemon: [out/minikube-linux-arm64 mount -p functional-986276 /tmp/TestFunctionalparallelMountCmdspecific-port2510434707/001:/mount-9p --alsologtostderr -v=1 --port 46464]
functional_test_mount_test.go:243: (dbg) Run:  out/minikube-linux-arm64 -p functional-986276 ssh "findmnt -T /mount-9p | grep 9p"
functional_test_mount_test.go:243: (dbg) Non-zero exit: out/minikube-linux-arm64 -p functional-986276 ssh "findmnt -T /mount-9p | grep 9p": exit status 1 (386.809066ms)

                                                
                                                
** stderr ** 
	ssh: Process exited with status 1

                                                
                                                
** /stderr **
functional_test_mount_test.go:243: (dbg) Run:  out/minikube-linux-arm64 -p functional-986276 ssh "findmnt -T /mount-9p | grep 9p"
functional_test_mount_test.go:257: (dbg) Run:  out/minikube-linux-arm64 -p functional-986276 ssh -- ls -la /mount-9p
functional_test_mount_test.go:261: guest mount directory contents
total 0
functional_test_mount_test.go:263: (dbg) stopping [out/minikube-linux-arm64 mount -p functional-986276 /tmp/TestFunctionalparallelMountCmdspecific-port2510434707/001:/mount-9p --alsologtostderr -v=1 --port 46464] ...
E0812 12:35:24.490885 1004370 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19411-998978/.minikube/profiles/addons-673965/client.crt: no such file or directory
functional_test_mount_test.go:264: reading mount text
functional_test_mount_test.go:278: done reading mount text
functional_test_mount_test.go:230: (dbg) Run:  out/minikube-linux-arm64 -p functional-986276 ssh "sudo umount -f /mount-9p"
functional_test_mount_test.go:230: (dbg) Non-zero exit: out/minikube-linux-arm64 -p functional-986276 ssh "sudo umount -f /mount-9p": exit status 1 (282.688271ms)

                                                
                                                
-- stdout --
	umount: /mount-9p: not mounted.

                                                
                                                
-- /stdout --
** stderr ** 
	ssh: Process exited with status 32

                                                
                                                
** /stderr **
functional_test_mount_test.go:232: "out/minikube-linux-arm64 -p functional-986276 ssh \"sudo umount -f /mount-9p\"": exit status 1
functional_test_mount_test.go:234: (dbg) stopping [out/minikube-linux-arm64 mount -p functional-986276 /tmp/TestFunctionalparallelMountCmdspecific-port2510434707/001:/mount-9p --alsologtostderr -v=1 --port 46464] ...
--- PASS: TestFunctional/parallel/MountCmd/specific-port (1.87s)

                                                
                                    
x
+
TestFunctional/parallel/MountCmd/VerifyCleanup (1.47s)

                                                
                                                
=== RUN   TestFunctional/parallel/MountCmd/VerifyCleanup
functional_test_mount_test.go:298: (dbg) daemon: [out/minikube-linux-arm64 mount -p functional-986276 /tmp/TestFunctionalparallelMountCmdVerifyCleanup2256511188/001:/mount1 --alsologtostderr -v=1]
functional_test_mount_test.go:298: (dbg) daemon: [out/minikube-linux-arm64 mount -p functional-986276 /tmp/TestFunctionalparallelMountCmdVerifyCleanup2256511188/001:/mount2 --alsologtostderr -v=1]
functional_test_mount_test.go:298: (dbg) daemon: [out/minikube-linux-arm64 mount -p functional-986276 /tmp/TestFunctionalparallelMountCmdVerifyCleanup2256511188/001:/mount3 --alsologtostderr -v=1]
functional_test_mount_test.go:325: (dbg) Run:  out/minikube-linux-arm64 -p functional-986276 ssh "findmnt -T" /mount1
functional_test_mount_test.go:325: (dbg) Run:  out/minikube-linux-arm64 -p functional-986276 ssh "findmnt -T" /mount2
functional_test_mount_test.go:325: (dbg) Run:  out/minikube-linux-arm64 -p functional-986276 ssh "findmnt -T" /mount3
functional_test_mount_test.go:370: (dbg) Run:  out/minikube-linux-arm64 mount -p functional-986276 --kill=true
functional_test_mount_test.go:313: (dbg) stopping [out/minikube-linux-arm64 mount -p functional-986276 /tmp/TestFunctionalparallelMountCmdVerifyCleanup2256511188/001:/mount1 --alsologtostderr -v=1] ...
helpers_test.go:490: unable to find parent, assuming dead: process does not exist
functional_test_mount_test.go:313: (dbg) stopping [out/minikube-linux-arm64 mount -p functional-986276 /tmp/TestFunctionalparallelMountCmdVerifyCleanup2256511188/001:/mount2 --alsologtostderr -v=1] ...
helpers_test.go:490: unable to find parent, assuming dead: process does not exist
functional_test_mount_test.go:313: (dbg) stopping [out/minikube-linux-arm64 mount -p functional-986276 /tmp/TestFunctionalparallelMountCmdVerifyCleanup2256511188/001:/mount3 --alsologtostderr -v=1] ...
helpers_test.go:490: unable to find parent, assuming dead: process does not exist
--- PASS: TestFunctional/parallel/MountCmd/VerifyCleanup (1.47s)

                                                
                                    
x
+
TestFunctional/parallel/Version/short (0.09s)

                                                
                                                
=== RUN   TestFunctional/parallel/Version/short
=== PAUSE TestFunctional/parallel/Version/short

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/Version/short
functional_test.go:2256: (dbg) Run:  out/minikube-linux-arm64 -p functional-986276 version --short
--- PASS: TestFunctional/parallel/Version/short (0.09s)

                                                
                                    
x
+
TestFunctional/parallel/Version/components (1.27s)

                                                
                                                
=== RUN   TestFunctional/parallel/Version/components
=== PAUSE TestFunctional/parallel/Version/components

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/Version/components
functional_test.go:2270: (dbg) Run:  out/minikube-linux-arm64 -p functional-986276 version -o=json --components
functional_test.go:2270: (dbg) Done: out/minikube-linux-arm64 -p functional-986276 version -o=json --components: (1.271848716s)
--- PASS: TestFunctional/parallel/Version/components (1.27s)

                                                
                                    
x
+
TestFunctional/parallel/ImageCommands/ImageListShort (0.34s)

                                                
                                                
=== RUN   TestFunctional/parallel/ImageCommands/ImageListShort
=== PAUSE TestFunctional/parallel/ImageCommands/ImageListShort

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/ImageCommands/ImageListShort
functional_test.go:261: (dbg) Run:  out/minikube-linux-arm64 -p functional-986276 image ls --format short --alsologtostderr
functional_test.go:266: (dbg) Stdout: out/minikube-linux-arm64 -p functional-986276 image ls --format short --alsologtostderr:
registry.k8s.io/pause:latest
registry.k8s.io/pause:3.9
registry.k8s.io/pause:3.3
registry.k8s.io/pause:3.1
registry.k8s.io/kube-scheduler:v1.30.3
registry.k8s.io/kube-proxy:v1.30.3
registry.k8s.io/kube-controller-manager:v1.30.3
registry.k8s.io/kube-apiserver:v1.30.3
registry.k8s.io/etcd:3.5.12-0
registry.k8s.io/echoserver-arm:1.8
registry.k8s.io/coredns/coredns:v1.11.1
gcr.io/k8s-minikube/storage-provisioner:v5
gcr.io/k8s-minikube/busybox:1.28.4-glibc
docker.io/library/nginx:latest
docker.io/library/nginx:alpine
docker.io/library/minikube-local-cache-test:functional-986276
docker.io/kindest/kindnetd:v20240730-75a5af0c
docker.io/kindest/kindnetd:v20240715-585640e9
docker.io/kicbase/echo-server:functional-986276
functional_test.go:269: (dbg) Stderr: out/minikube-linux-arm64 -p functional-986276 image ls --format short --alsologtostderr:
I0812 12:35:45.422856 1041116 out.go:291] Setting OutFile to fd 1 ...
I0812 12:35:45.423081 1041116 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0812 12:35:45.423089 1041116 out.go:304] Setting ErrFile to fd 2...
I0812 12:35:45.423094 1041116 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0812 12:35:45.423341 1041116 root.go:338] Updating PATH: /home/jenkins/minikube-integration/19411-998978/.minikube/bin
I0812 12:35:45.424164 1041116 config.go:182] Loaded profile config "functional-986276": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.30.3
I0812 12:35:45.424461 1041116 config.go:182] Loaded profile config "functional-986276": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.30.3
I0812 12:35:45.425172 1041116 cli_runner.go:164] Run: docker container inspect functional-986276 --format={{.State.Status}}
I0812 12:35:45.460670 1041116 ssh_runner.go:195] Run: systemctl --version
I0812 12:35:45.460754 1041116 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" functional-986276
I0812 12:35:45.509198 1041116 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33909 SSHKeyPath:/home/jenkins/minikube-integration/19411-998978/.minikube/machines/functional-986276/id_rsa Username:docker}
I0812 12:35:45.629844 1041116 ssh_runner.go:195] Run: sudo crictl images --output json
--- PASS: TestFunctional/parallel/ImageCommands/ImageListShort (0.34s)

                                                
                                    
x
+
TestFunctional/parallel/ImageCommands/ImageListTable (0.25s)

                                                
                                                
=== RUN   TestFunctional/parallel/ImageCommands/ImageListTable
=== PAUSE TestFunctional/parallel/ImageCommands/ImageListTable

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/ImageCommands/ImageListTable
functional_test.go:261: (dbg) Run:  out/minikube-linux-arm64 -p functional-986276 image ls --format table --alsologtostderr
functional_test.go:266: (dbg) Stdout: out/minikube-linux-arm64 -p functional-986276 image ls --format table --alsologtostderr:
|---------------------------------------------|--------------------|---------------|--------|
|                    Image                    |        Tag         |   Image ID    |  Size  |
|---------------------------------------------|--------------------|---------------|--------|
| registry.k8s.io/kube-apiserver              | v1.30.3            | sha256:617731 | 29.9MB |
| registry.k8s.io/pause                       | 3.3                | sha256:3d1873 | 249kB  |
| docker.io/kindest/kindnetd                  | v20240715-585640e9 | sha256:5e3296 | 33.3MB |
| docker.io/kicbase/echo-server               | functional-986276  | sha256:ce2d2c | 2.17MB |
| gcr.io/k8s-minikube/storage-provisioner     | v5                 | sha256:ba04bb | 8.03MB |
| registry.k8s.io/echoserver-arm              | 1.8                | sha256:72565b | 45.3MB |
| registry.k8s.io/pause                       | 3.9                | sha256:829e9d | 268kB  |
| registry.k8s.io/pause                       | latest             | sha256:8cb209 | 71.3kB |
| docker.io/library/nginx                     | latest             | sha256:43b17f | 67.6MB |
| registry.k8s.io/coredns/coredns             | v1.11.1            | sha256:2437cf | 16.5MB |
| registry.k8s.io/etcd                        | 3.5.12-0           | sha256:014faa | 66.2MB |
| registry.k8s.io/kube-controller-manager     | v1.30.3            | sha256:8e97cd | 28.4MB |
| registry.k8s.io/kube-proxy                  | v1.30.3            | sha256:2351f5 | 25.6MB |
| docker.io/kindest/kindnetd                  | v20240730-75a5af0c | sha256:d5e283 | 33.3MB |
| docker.io/library/minikube-local-cache-test | functional-986276  | sha256:99e582 | 991B   |
| docker.io/library/nginx                     | alpine             | sha256:d7cd33 | 18.3MB |
| gcr.io/k8s-minikube/busybox                 | 1.28.4-glibc       | sha256:1611cd | 1.94MB |
| registry.k8s.io/kube-scheduler              | v1.30.3            | sha256:d48f99 | 17.6MB |
| registry.k8s.io/pause                       | 3.1                | sha256:8057e0 | 262kB  |
|---------------------------------------------|--------------------|---------------|--------|
functional_test.go:269: (dbg) Stderr: out/minikube-linux-arm64 -p functional-986276 image ls --format table --alsologtostderr:
I0812 12:35:46.893797 1041446 out.go:291] Setting OutFile to fd 1 ...
I0812 12:35:46.893966 1041446 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0812 12:35:46.893997 1041446 out.go:304] Setting ErrFile to fd 2...
I0812 12:35:46.894018 1041446 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0812 12:35:46.894288 1041446 root.go:338] Updating PATH: /home/jenkins/minikube-integration/19411-998978/.minikube/bin
I0812 12:35:46.894922 1041446 config.go:182] Loaded profile config "functional-986276": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.30.3
I0812 12:35:46.895121 1041446 config.go:182] Loaded profile config "functional-986276": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.30.3
I0812 12:35:46.895658 1041446 cli_runner.go:164] Run: docker container inspect functional-986276 --format={{.State.Status}}
I0812 12:35:46.916905 1041446 ssh_runner.go:195] Run: systemctl --version
I0812 12:35:46.916966 1041446 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" functional-986276
I0812 12:35:46.936870 1041446 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33909 SSHKeyPath:/home/jenkins/minikube-integration/19411-998978/.minikube/machines/functional-986276/id_rsa Username:docker}
I0812 12:35:47.037886 1041446 ssh_runner.go:195] Run: sudo crictl images --output json
--- PASS: TestFunctional/parallel/ImageCommands/ImageListTable (0.25s)

                                                
                                    
x
+
TestFunctional/parallel/ImageCommands/ImageListJson (0.25s)

                                                
                                                
=== RUN   TestFunctional/parallel/ImageCommands/ImageListJson
=== PAUSE TestFunctional/parallel/ImageCommands/ImageListJson

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/ImageCommands/ImageListJson
functional_test.go:261: (dbg) Run:  out/minikube-linux-arm64 -p functional-986276 image ls --format json --alsologtostderr
functional_test.go:266: (dbg) Stdout: out/minikube-linux-arm64 -p functional-986276 image ls --format json --alsologtostderr:
[{"id":"sha256:43b17fe33c4b4cf8de762123d33e02f2ed0c5e1178002f533d4fb5df1e05fb76","repoDigests":["docker.io/library/nginx@sha256:6af79ae5de407283dcea8b00d5c37ace95441fd58a8b1d2aa1ed93f5511bb18c"],"repoTags":["docker.io/library/nginx:latest"],"size":"67647629"},{"id":"sha256:1611cd07b61d57dbbfebe6db242513fd51e1c02d20ba08af17a45837d86a8a8c","repoDigests":["gcr.io/k8s-minikube/busybox@sha256:2d03e6ceeb99250061dd110530b0ece7998cd84121f952adef120ea7c5a6f00e"],"repoTags":["gcr.io/k8s-minikube/busybox:1.28.4-glibc"],"size":"1935750"},{"id":"sha256:014faa467e29798aeef733fe6d1a3b5e382688217b053ad23410e6cccd5d22fd","repoDigests":["registry.k8s.io/etcd@sha256:44a8e24dcbba3470ee1fee21d5e88d128c936e9b55d4bc51fbef8086f8ed123b"],"repoTags":["registry.k8s.io/etcd:3.5.12-0"],"size":"66189079"},{"id":"sha256:8057e0500773a37cde2cff041eb13ebd68c748419a2fbfd1dfb5bf38696cc8e5","repoDigests":[],"repoTags":["registry.k8s.io/pause:3.1"],"size":"262191"},{"id":"sha256:99e58243e5780b87ded6cc62e05b9aa60a8b3c7d603fdb21141384789f55
462a","repoDigests":[],"repoTags":["docker.io/library/minikube-local-cache-test:functional-986276"],"size":"991"},{"id":"sha256:d7cd33d7d4ed1cdef69594adc36fcc03a0aa45ba930d39a9286024d9b2322660","repoDigests":["docker.io/library/nginx@sha256:208b70eefac13ee9be00e486f79c695b15cef861c680527171a27d253d834be9"],"repoTags":["docker.io/library/nginx:alpine"],"size":"18253575"},{"id":"sha256:20b332c9a70d8516d849d1ac23eff5800cbb2f263d379f0ec11ee908db6b25a8","repoDigests":["docker.io/kubernetesui/dashboard@sha256:2e500d29e9d5f4a086b908eb8dfe7ecac57d2ab09d65b24f588b1d449841ef93"],"repoTags":[],"size":"74084559"},{"id":"sha256:d5e283bc63d431d0446af8b48a1618696def3b777347a97b8b3553d2c989c806","repoDigests":["docker.io/kindest/kindnetd@sha256:4067b91686869e19bac601aec305ba55d2e74cdcb91347869bfb4fd3a26cd3c3"],"repoTags":["docker.io/kindest/kindnetd:v20240730-75a5af0c"],"size":"33305789"},{"id":"sha256:72565bf5bbedfb62e9d21afa2b1221b2c7a5e05b746dae33430bc550d3f87beb","repoDigests":["registry.k8s.io/echoserver-arm@sha256:b33d
4cdf6ed097f4e9b77b135d83a596ab73c6268b0342648818eb85f5edfdb5"],"repoTags":["registry.k8s.io/echoserver-arm:1.8"],"size":"45324675"},{"id":"sha256:61773190d42ff0792f3bab2658e80b1c07519170955bb350b153b564ef28f4ca","repoDigests":["registry.k8s.io/kube-apiserver@sha256:a36d558835e48950f6d13b1edbe20605b8dfbc81e088f58221796631e107966c"],"repoTags":["registry.k8s.io/kube-apiserver:v1.30.3"],"size":"29942692"},{"id":"sha256:d48f992a22722fc0290769b8fab1186db239bbad4cff837fbb641c55faef9355","repoDigests":["registry.k8s.io/kube-scheduler@sha256:2147ab5d2c73dd84e28332fcbee6826d1648eed30a531a52a96501b37d7ee4e4"],"repoTags":["registry.k8s.io/kube-scheduler:v1.30.3"],"size":"17641143"},{"id":"sha256:829e9de338bd5fdd3f16f68f83a9fb288fbc8453e881e5d5cfd0f6f2ff72b43e","repoDigests":["registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097"],"repoTags":["registry.k8s.io/pause:3.9"],"size":"268051"},{"id":"sha256:8cb2091f603e75187e2f6226c5901d12e00b1d1f778c6471ae4578e8a1c4724a","repoDigests":
[],"repoTags":["registry.k8s.io/pause:latest"],"size":"71300"},{"id":"sha256:ce2d2cda2d858fdaea84129deb86d18e5dbf1c548f230b79fdca74cc91729d17","repoDigests":[],"repoTags":["docker.io/kicbase/echo-server:functional-986276"],"size":"2173567"},{"id":"sha256:ba04bb24b95753201135cbc420b233c1b0b9fa2e1fd21d28319c348c33fbcde6","repoDigests":["gcr.io/k8s-minikube/storage-provisioner@sha256:18eb69d1418e854ad5a19e399310e52808a8321e4c441c1dddad8977a0d7a944"],"repoTags":["gcr.io/k8s-minikube/storage-provisioner:v5"],"size":"8034419"},{"id":"sha256:8e97cdb19e7cc420af7c71de8b5c9ab536bd278758c8c0878c464b833d91b31a","repoDigests":["registry.k8s.io/kube-controller-manager@sha256:eff43da55a29a5e66ec9480f28233d733a6a8433b7a46f6e8c07086fa4ef69b7"],"repoTags":["registry.k8s.io/kube-controller-manager:v1.30.3"],"size":"28374500"},{"id":"sha256:2351f570ed0eac5533e538280d73c6aa5d6b6f6379f5f3fac08f51378621e6be","repoDigests":["registry.k8s.io/kube-proxy@sha256:b26e535e8ee1cbd7dc5642fb61bd36e9d23f32e9242ae0010b2905656e664f65"],"repoTag
s":["registry.k8s.io/kube-proxy:v1.30.3"],"size":"25645955"},{"id":"sha256:3d18732f8686cc3c878055d99a05fa80289502fa496b36b6a0fe0f77206a7300","repoDigests":[],"repoTags":["registry.k8s.io/pause:3.3"],"size":"249461"},{"id":"sha256:a422e0e982356f6c1cf0e5bb7b733363caae3992a07c99951fbcc73e58ed656a","repoDigests":["docker.io/kubernetesui/metrics-scraper@sha256:76049887f07a0476dc93efc2d3569b9529bf982b22d29f356092ce206e98765c"],"repoTags":[],"size":"18306114"},{"id":"sha256:5e32961ddcea3ade65511b2e27f675bbda25305639279f8b708014019e8cebb2","repoDigests":["docker.io/kindest/kindnetd@sha256:88ed2adbc140254762f98fad7f4b16d279117356ebaf95aebf191713c828a493"],"repoTags":["docker.io/kindest/kindnetd:v20240715-585640e9"],"size":"33290438"},{"id":"sha256:2437cf762177702dec2dfe99a09c37427a15af6d9a57c456b65352667c223d93","repoDigests":["registry.k8s.io/coredns/coredns@sha256:1eeb4c7316bacb1d4c8ead65571cd92dd21e27359f0d4917f1a5822a73b75db1"],"repoTags":["registry.k8s.io/coredns/coredns:v1.11.1"],"size":"16482581"}]
functional_test.go:269: (dbg) Stderr: out/minikube-linux-arm64 -p functional-986276 image ls --format json --alsologtostderr:
I0812 12:35:46.655985 1041413 out.go:291] Setting OutFile to fd 1 ...
I0812 12:35:46.656232 1041413 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0812 12:35:46.656261 1041413 out.go:304] Setting ErrFile to fd 2...
I0812 12:35:46.656281 1041413 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0812 12:35:46.656596 1041413 root.go:338] Updating PATH: /home/jenkins/minikube-integration/19411-998978/.minikube/bin
I0812 12:35:46.657306 1041413 config.go:182] Loaded profile config "functional-986276": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.30.3
I0812 12:35:46.657535 1041413 config.go:182] Loaded profile config "functional-986276": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.30.3
I0812 12:35:46.658058 1041413 cli_runner.go:164] Run: docker container inspect functional-986276 --format={{.State.Status}}
I0812 12:35:46.675683 1041413 ssh_runner.go:195] Run: systemctl --version
I0812 12:35:46.675747 1041413 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" functional-986276
I0812 12:35:46.699593 1041413 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33909 SSHKeyPath:/home/jenkins/minikube-integration/19411-998978/.minikube/machines/functional-986276/id_rsa Username:docker}
I0812 12:35:46.798031 1041413 ssh_runner.go:195] Run: sudo crictl images --output json
--- PASS: TestFunctional/parallel/ImageCommands/ImageListJson (0.25s)

                                                
                                    
x
+
TestFunctional/parallel/ImageCommands/ImageListYaml (0.26s)

                                                
                                                
=== RUN   TestFunctional/parallel/ImageCommands/ImageListYaml
=== PAUSE TestFunctional/parallel/ImageCommands/ImageListYaml

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/ImageCommands/ImageListYaml
functional_test.go:261: (dbg) Run:  out/minikube-linux-arm64 -p functional-986276 image ls --format yaml --alsologtostderr
functional_test.go:266: (dbg) Stdout: out/minikube-linux-arm64 -p functional-986276 image ls --format yaml --alsologtostderr:
- id: sha256:ba04bb24b95753201135cbc420b233c1b0b9fa2e1fd21d28319c348c33fbcde6
repoDigests:
- gcr.io/k8s-minikube/storage-provisioner@sha256:18eb69d1418e854ad5a19e399310e52808a8321e4c441c1dddad8977a0d7a944
repoTags:
- gcr.io/k8s-minikube/storage-provisioner:v5
size: "8034419"
- id: sha256:61773190d42ff0792f3bab2658e80b1c07519170955bb350b153b564ef28f4ca
repoDigests:
- registry.k8s.io/kube-apiserver@sha256:a36d558835e48950f6d13b1edbe20605b8dfbc81e088f58221796631e107966c
repoTags:
- registry.k8s.io/kube-apiserver:v1.30.3
size: "29942692"
- id: sha256:8057e0500773a37cde2cff041eb13ebd68c748419a2fbfd1dfb5bf38696cc8e5
repoDigests: []
repoTags:
- registry.k8s.io/pause:3.1
size: "262191"
- id: sha256:8cb2091f603e75187e2f6226c5901d12e00b1d1f778c6471ae4578e8a1c4724a
repoDigests: []
repoTags:
- registry.k8s.io/pause:latest
size: "71300"
- id: sha256:d7cd33d7d4ed1cdef69594adc36fcc03a0aa45ba930d39a9286024d9b2322660
repoDigests:
- docker.io/library/nginx@sha256:208b70eefac13ee9be00e486f79c695b15cef861c680527171a27d253d834be9
repoTags:
- docker.io/library/nginx:alpine
size: "18253575"
- id: sha256:43b17fe33c4b4cf8de762123d33e02f2ed0c5e1178002f533d4fb5df1e05fb76
repoDigests:
- docker.io/library/nginx@sha256:6af79ae5de407283dcea8b00d5c37ace95441fd58a8b1d2aa1ed93f5511bb18c
repoTags:
- docker.io/library/nginx:latest
size: "67647629"
- id: sha256:2351f570ed0eac5533e538280d73c6aa5d6b6f6379f5f3fac08f51378621e6be
repoDigests:
- registry.k8s.io/kube-proxy@sha256:b26e535e8ee1cbd7dc5642fb61bd36e9d23f32e9242ae0010b2905656e664f65
repoTags:
- registry.k8s.io/kube-proxy:v1.30.3
size: "25645955"
- id: sha256:829e9de338bd5fdd3f16f68f83a9fb288fbc8453e881e5d5cfd0f6f2ff72b43e
repoDigests:
- registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097
repoTags:
- registry.k8s.io/pause:3.9
size: "268051"
- id: sha256:72565bf5bbedfb62e9d21afa2b1221b2c7a5e05b746dae33430bc550d3f87beb
repoDigests:
- registry.k8s.io/echoserver-arm@sha256:b33d4cdf6ed097f4e9b77b135d83a596ab73c6268b0342648818eb85f5edfdb5
repoTags:
- registry.k8s.io/echoserver-arm:1.8
size: "45324675"
- id: sha256:8e97cdb19e7cc420af7c71de8b5c9ab536bd278758c8c0878c464b833d91b31a
repoDigests:
- registry.k8s.io/kube-controller-manager@sha256:eff43da55a29a5e66ec9480f28233d733a6a8433b7a46f6e8c07086fa4ef69b7
repoTags:
- registry.k8s.io/kube-controller-manager:v1.30.3
size: "28374500"
- id: sha256:99e58243e5780b87ded6cc62e05b9aa60a8b3c7d603fdb21141384789f55462a
repoDigests: []
repoTags:
- docker.io/library/minikube-local-cache-test:functional-986276
size: "991"
- id: sha256:2437cf762177702dec2dfe99a09c37427a15af6d9a57c456b65352667c223d93
repoDigests:
- registry.k8s.io/coredns/coredns@sha256:1eeb4c7316bacb1d4c8ead65571cd92dd21e27359f0d4917f1a5822a73b75db1
repoTags:
- registry.k8s.io/coredns/coredns:v1.11.1
size: "16482581"
- id: sha256:014faa467e29798aeef733fe6d1a3b5e382688217b053ad23410e6cccd5d22fd
repoDigests:
- registry.k8s.io/etcd@sha256:44a8e24dcbba3470ee1fee21d5e88d128c936e9b55d4bc51fbef8086f8ed123b
repoTags:
- registry.k8s.io/etcd:3.5.12-0
size: "66189079"
- id: sha256:3d18732f8686cc3c878055d99a05fa80289502fa496b36b6a0fe0f77206a7300
repoDigests: []
repoTags:
- registry.k8s.io/pause:3.3
size: "249461"
- id: sha256:20b332c9a70d8516d849d1ac23eff5800cbb2f263d379f0ec11ee908db6b25a8
repoDigests:
- docker.io/kubernetesui/dashboard@sha256:2e500d29e9d5f4a086b908eb8dfe7ecac57d2ab09d65b24f588b1d449841ef93
repoTags: []
size: "74084559"
- id: sha256:ce2d2cda2d858fdaea84129deb86d18e5dbf1c548f230b79fdca74cc91729d17
repoDigests: []
repoTags:
- docker.io/kicbase/echo-server:functional-986276
size: "2173567"
- id: sha256:a422e0e982356f6c1cf0e5bb7b733363caae3992a07c99951fbcc73e58ed656a
repoDigests:
- docker.io/kubernetesui/metrics-scraper@sha256:76049887f07a0476dc93efc2d3569b9529bf982b22d29f356092ce206e98765c
repoTags: []
size: "18306114"
- id: sha256:1611cd07b61d57dbbfebe6db242513fd51e1c02d20ba08af17a45837d86a8a8c
repoDigests:
- gcr.io/k8s-minikube/busybox@sha256:2d03e6ceeb99250061dd110530b0ece7998cd84121f952adef120ea7c5a6f00e
repoTags:
- gcr.io/k8s-minikube/busybox:1.28.4-glibc
size: "1935750"
- id: sha256:d48f992a22722fc0290769b8fab1186db239bbad4cff837fbb641c55faef9355
repoDigests:
- registry.k8s.io/kube-scheduler@sha256:2147ab5d2c73dd84e28332fcbee6826d1648eed30a531a52a96501b37d7ee4e4
repoTags:
- registry.k8s.io/kube-scheduler:v1.30.3
size: "17641143"
- id: sha256:5e32961ddcea3ade65511b2e27f675bbda25305639279f8b708014019e8cebb2
repoDigests:
- docker.io/kindest/kindnetd@sha256:88ed2adbc140254762f98fad7f4b16d279117356ebaf95aebf191713c828a493
repoTags:
- docker.io/kindest/kindnetd:v20240715-585640e9
size: "33290438"
- id: sha256:d5e283bc63d431d0446af8b48a1618696def3b777347a97b8b3553d2c989c806
repoDigests:
- docker.io/kindest/kindnetd@sha256:4067b91686869e19bac601aec305ba55d2e74cdcb91347869bfb4fd3a26cd3c3
repoTags:
- docker.io/kindest/kindnetd:v20240730-75a5af0c
size: "33305789"

                                                
                                                
functional_test.go:269: (dbg) Stderr: out/minikube-linux-arm64 -p functional-986276 image ls --format yaml --alsologtostderr:
I0812 12:35:45.754660 1041205 out.go:291] Setting OutFile to fd 1 ...
I0812 12:35:45.754818 1041205 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0812 12:35:45.754828 1041205 out.go:304] Setting ErrFile to fd 2...
I0812 12:35:45.754833 1041205 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0812 12:35:45.755063 1041205 root.go:338] Updating PATH: /home/jenkins/minikube-integration/19411-998978/.minikube/bin
I0812 12:35:45.755708 1041205 config.go:182] Loaded profile config "functional-986276": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.30.3
I0812 12:35:45.755832 1041205 config.go:182] Loaded profile config "functional-986276": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.30.3
I0812 12:35:45.756309 1041205 cli_runner.go:164] Run: docker container inspect functional-986276 --format={{.State.Status}}
I0812 12:35:45.774589 1041205 ssh_runner.go:195] Run: systemctl --version
I0812 12:35:45.774642 1041205 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" functional-986276
I0812 12:35:45.795425 1041205 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33909 SSHKeyPath:/home/jenkins/minikube-integration/19411-998978/.minikube/machines/functional-986276/id_rsa Username:docker}
I0812 12:35:45.894109 1041205 ssh_runner.go:195] Run: sudo crictl images --output json
--- PASS: TestFunctional/parallel/ImageCommands/ImageListYaml (0.26s)

                                                
                                    
x
+
TestFunctional/parallel/ImageCommands/ImageBuild (2.67s)

                                                
                                                
=== RUN   TestFunctional/parallel/ImageCommands/ImageBuild
=== PAUSE TestFunctional/parallel/ImageCommands/ImageBuild

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/ImageCommands/ImageBuild
functional_test.go:308: (dbg) Run:  out/minikube-linux-arm64 -p functional-986276 ssh pgrep buildkitd
functional_test.go:308: (dbg) Non-zero exit: out/minikube-linux-arm64 -p functional-986276 ssh pgrep buildkitd: exit status 1 (303.383632ms)

                                                
                                                
** stderr ** 
	ssh: Process exited with status 1

                                                
                                                
** /stderr **
functional_test.go:315: (dbg) Run:  out/minikube-linux-arm64 -p functional-986276 image build -t localhost/my-image:functional-986276 testdata/build --alsologtostderr
functional_test.go:315: (dbg) Done: out/minikube-linux-arm64 -p functional-986276 image build -t localhost/my-image:functional-986276 testdata/build --alsologtostderr: (2.140165782s)
functional_test.go:323: (dbg) Stderr: out/minikube-linux-arm64 -p functional-986276 image build -t localhost/my-image:functional-986276 testdata/build --alsologtostderr:
I0812 12:35:46.296518 1041307 out.go:291] Setting OutFile to fd 1 ...
I0812 12:35:46.297458 1041307 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0812 12:35:46.297474 1041307 out.go:304] Setting ErrFile to fd 2...
I0812 12:35:46.297478 1041307 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0812 12:35:46.297747 1041307 root.go:338] Updating PATH: /home/jenkins/minikube-integration/19411-998978/.minikube/bin
I0812 12:35:46.298423 1041307 config.go:182] Loaded profile config "functional-986276": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.30.3
I0812 12:35:46.299957 1041307 config.go:182] Loaded profile config "functional-986276": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.30.3
I0812 12:35:46.300466 1041307 cli_runner.go:164] Run: docker container inspect functional-986276 --format={{.State.Status}}
I0812 12:35:46.320316 1041307 ssh_runner.go:195] Run: systemctl --version
I0812 12:35:46.320373 1041307 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" functional-986276
I0812 12:35:46.338755 1041307 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33909 SSHKeyPath:/home/jenkins/minikube-integration/19411-998978/.minikube/machines/functional-986276/id_rsa Username:docker}
I0812 12:35:46.444866 1041307 build_images.go:161] Building image from path: /tmp/build.2220722034.tar
I0812 12:35:46.444945 1041307 ssh_runner.go:195] Run: sudo mkdir -p /var/lib/minikube/build
I0812 12:35:46.457858 1041307 ssh_runner.go:195] Run: stat -c "%s %y" /var/lib/minikube/build/build.2220722034.tar
I0812 12:35:46.472704 1041307 ssh_runner.go:352] existence check for /var/lib/minikube/build/build.2220722034.tar: stat -c "%s %y" /var/lib/minikube/build/build.2220722034.tar: Process exited with status 1
stdout:

                                                
                                                
stderr:
stat: cannot statx '/var/lib/minikube/build/build.2220722034.tar': No such file or directory
I0812 12:35:46.472749 1041307 ssh_runner.go:362] scp /tmp/build.2220722034.tar --> /var/lib/minikube/build/build.2220722034.tar (3072 bytes)
I0812 12:35:46.521135 1041307 ssh_runner.go:195] Run: sudo mkdir -p /var/lib/minikube/build/build.2220722034
I0812 12:35:46.539374 1041307 ssh_runner.go:195] Run: sudo tar -C /var/lib/minikube/build/build.2220722034 -xf /var/lib/minikube/build/build.2220722034.tar
I0812 12:35:46.549756 1041307 containerd.go:394] Building image: /var/lib/minikube/build/build.2220722034
I0812 12:35:46.549833 1041307 ssh_runner.go:195] Run: sudo buildctl build --frontend dockerfile.v0 --local context=/var/lib/minikube/build/build.2220722034 --local dockerfile=/var/lib/minikube/build/build.2220722034 --output type=image,name=localhost/my-image:functional-986276
#1 [internal] load build definition from Dockerfile
#1 transferring dockerfile: 97B done
#1 DONE 0.0s

                                                
                                                
#2 [internal] load metadata for gcr.io/k8s-minikube/busybox:latest
#2 DONE 0.7s

                                                
                                                
#3 [internal] load .dockerignore
#3 transferring context: 2B done
#3 DONE 0.0s

                                                
                                                
#4 [internal] load build context
#4 transferring context: 62B done
#4 DONE 0.0s

                                                
                                                
#5 [1/3] FROM gcr.io/k8s-minikube/busybox:latest@sha256:ca5ae90100d50772da31f3b5016209e25ad61972404e2ccd83d44f10dee7e79b
#5 resolve gcr.io/k8s-minikube/busybox:latest@sha256:ca5ae90100d50772da31f3b5016209e25ad61972404e2ccd83d44f10dee7e79b 0.0s done
#5 sha256:a01966dde7f8d5ba10b6d87e776c7c8fb5a5f6bfa678874bd28b33b1fc6dba34 0B / 828.50kB 0.2s
#5 sha256:a01966dde7f8d5ba10b6d87e776c7c8fb5a5f6bfa678874bd28b33b1fc6dba34 828.50kB / 828.50kB 0.2s done
#5 extracting sha256:a01966dde7f8d5ba10b6d87e776c7c8fb5a5f6bfa678874bd28b33b1fc6dba34 0.1s done
#5 DONE 0.3s

                                                
                                                
#6 [2/3] RUN true
#6 DONE 0.3s

                                                
                                                
#7 [3/3] ADD content.txt /
#7 DONE 0.0s

                                                
                                                
#8 exporting to image
#8 exporting layers 0.1s done
#8 exporting manifest sha256:6376976d0a4f188c5e813ad09557038b0126eefcafa5955e0706255fce1e88eb 0.0s done
#8 exporting config sha256:9afcf165939762a051da2a238a30c10aaf56723cb83c3567f6f6a997c7671f5b 0.0s done
#8 naming to localhost/my-image:functional-986276 done
#8 DONE 0.2s
I0812 12:35:48.355299 1041307 ssh_runner.go:235] Completed: sudo buildctl build --frontend dockerfile.v0 --local context=/var/lib/minikube/build/build.2220722034 --local dockerfile=/var/lib/minikube/build/build.2220722034 --output type=image,name=localhost/my-image:functional-986276: (1.805420297s)
I0812 12:35:48.355378 1041307 ssh_runner.go:195] Run: sudo rm -rf /var/lib/minikube/build/build.2220722034
I0812 12:35:48.365397 1041307 ssh_runner.go:195] Run: sudo rm -f /var/lib/minikube/build/build.2220722034.tar
I0812 12:35:48.375355 1041307 build_images.go:217] Built localhost/my-image:functional-986276 from /tmp/build.2220722034.tar
I0812 12:35:48.375406 1041307 build_images.go:133] succeeded building to: functional-986276
I0812 12:35:48.375412 1041307 build_images.go:134] failed building to: 
functional_test.go:451: (dbg) Run:  out/minikube-linux-arm64 -p functional-986276 image ls
--- PASS: TestFunctional/parallel/ImageCommands/ImageBuild (2.67s)

                                                
                                    
x
+
TestFunctional/parallel/ImageCommands/Setup (0.94s)

                                                
                                                
=== RUN   TestFunctional/parallel/ImageCommands/Setup
functional_test.go:342: (dbg) Run:  docker pull kicbase/echo-server:1.0
functional_test.go:347: (dbg) Run:  docker tag kicbase/echo-server:1.0 kicbase/echo-server:functional-986276
--- PASS: TestFunctional/parallel/ImageCommands/Setup (0.94s)

                                                
                                    
x
+
TestFunctional/parallel/ImageCommands/ImageLoadDaemon (1.39s)

                                                
                                                
=== RUN   TestFunctional/parallel/ImageCommands/ImageLoadDaemon
functional_test.go:355: (dbg) Run:  out/minikube-linux-arm64 -p functional-986276 image load --daemon kicbase/echo-server:functional-986276 --alsologtostderr
functional_test.go:355: (dbg) Done: out/minikube-linux-arm64 -p functional-986276 image load --daemon kicbase/echo-server:functional-986276 --alsologtostderr: (1.125452698s)
functional_test.go:451: (dbg) Run:  out/minikube-linux-arm64 -p functional-986276 image ls
--- PASS: TestFunctional/parallel/ImageCommands/ImageLoadDaemon (1.39s)

                                                
                                    
x
+
TestFunctional/parallel/ImageCommands/ImageReloadDaemon (1.15s)

                                                
                                                
=== RUN   TestFunctional/parallel/ImageCommands/ImageReloadDaemon
functional_test.go:365: (dbg) Run:  out/minikube-linux-arm64 -p functional-986276 image load --daemon kicbase/echo-server:functional-986276 --alsologtostderr
functional_test.go:451: (dbg) Run:  out/minikube-linux-arm64 -p functional-986276 image ls
--- PASS: TestFunctional/parallel/ImageCommands/ImageReloadDaemon (1.15s)

                                                
                                    
x
+
TestFunctional/parallel/ImageCommands/ImageTagAndLoadDaemon (1.41s)

                                                
                                                
=== RUN   TestFunctional/parallel/ImageCommands/ImageTagAndLoadDaemon
functional_test.go:235: (dbg) Run:  docker pull kicbase/echo-server:latest
functional_test.go:240: (dbg) Run:  docker tag kicbase/echo-server:latest kicbase/echo-server:functional-986276
functional_test.go:245: (dbg) Run:  out/minikube-linux-arm64 -p functional-986276 image load --daemon kicbase/echo-server:functional-986276 --alsologtostderr
functional_test.go:451: (dbg) Run:  out/minikube-linux-arm64 -p functional-986276 image ls
--- PASS: TestFunctional/parallel/ImageCommands/ImageTagAndLoadDaemon (1.41s)

                                                
                                    
x
+
TestFunctional/parallel/ImageCommands/ImageSaveToFile (0.37s)

                                                
                                                
=== RUN   TestFunctional/parallel/ImageCommands/ImageSaveToFile
functional_test.go:380: (dbg) Run:  out/minikube-linux-arm64 -p functional-986276 image save kicbase/echo-server:functional-986276 /home/jenkins/workspace/Docker_Linux_containerd_arm64/echo-server-save.tar --alsologtostderr
--- PASS: TestFunctional/parallel/ImageCommands/ImageSaveToFile (0.37s)

                                                
                                    
x
+
TestFunctional/parallel/ImageCommands/ImageRemove (0.5s)

                                                
                                                
=== RUN   TestFunctional/parallel/ImageCommands/ImageRemove
functional_test.go:392: (dbg) Run:  out/minikube-linux-arm64 -p functional-986276 image rm kicbase/echo-server:functional-986276 --alsologtostderr
functional_test.go:451: (dbg) Run:  out/minikube-linux-arm64 -p functional-986276 image ls
--- PASS: TestFunctional/parallel/ImageCommands/ImageRemove (0.50s)

                                                
                                    
x
+
TestFunctional/parallel/ImageCommands/ImageLoadFromFile (0.7s)

                                                
                                                
=== RUN   TestFunctional/parallel/ImageCommands/ImageLoadFromFile
functional_test.go:409: (dbg) Run:  out/minikube-linux-arm64 -p functional-986276 image load /home/jenkins/workspace/Docker_Linux_containerd_arm64/echo-server-save.tar --alsologtostderr
functional_test.go:451: (dbg) Run:  out/minikube-linux-arm64 -p functional-986276 image ls
--- PASS: TestFunctional/parallel/ImageCommands/ImageLoadFromFile (0.70s)

                                                
                                    
x
+
TestFunctional/parallel/ImageCommands/ImageSaveDaemon (0.42s)

                                                
                                                
=== RUN   TestFunctional/parallel/ImageCommands/ImageSaveDaemon
functional_test.go:419: (dbg) Run:  docker rmi kicbase/echo-server:functional-986276
functional_test.go:424: (dbg) Run:  out/minikube-linux-arm64 -p functional-986276 image save --daemon kicbase/echo-server:functional-986276 --alsologtostderr
functional_test.go:432: (dbg) Run:  docker image inspect kicbase/echo-server:functional-986276
--- PASS: TestFunctional/parallel/ImageCommands/ImageSaveDaemon (0.42s)

                                                
                                    
x
+
TestFunctional/parallel/UpdateContextCmd/no_changes (0.14s)

                                                
                                                
=== RUN   TestFunctional/parallel/UpdateContextCmd/no_changes
=== PAUSE TestFunctional/parallel/UpdateContextCmd/no_changes

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/UpdateContextCmd/no_changes
functional_test.go:2119: (dbg) Run:  out/minikube-linux-arm64 -p functional-986276 update-context --alsologtostderr -v=2
--- PASS: TestFunctional/parallel/UpdateContextCmd/no_changes (0.14s)

                                                
                                    
x
+
TestFunctional/parallel/UpdateContextCmd/no_minikube_cluster (0.18s)

                                                
                                                
=== RUN   TestFunctional/parallel/UpdateContextCmd/no_minikube_cluster
=== PAUSE TestFunctional/parallel/UpdateContextCmd/no_minikube_cluster

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/UpdateContextCmd/no_minikube_cluster
functional_test.go:2119: (dbg) Run:  out/minikube-linux-arm64 -p functional-986276 update-context --alsologtostderr -v=2
--- PASS: TestFunctional/parallel/UpdateContextCmd/no_minikube_cluster (0.18s)

                                                
                                    
x
+
TestFunctional/parallel/UpdateContextCmd/no_clusters (0.15s)

                                                
                                                
=== RUN   TestFunctional/parallel/UpdateContextCmd/no_clusters
=== PAUSE TestFunctional/parallel/UpdateContextCmd/no_clusters

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/UpdateContextCmd/no_clusters
functional_test.go:2119: (dbg) Run:  out/minikube-linux-arm64 -p functional-986276 update-context --alsologtostderr -v=2
--- PASS: TestFunctional/parallel/UpdateContextCmd/no_clusters (0.15s)

                                                
                                    
x
+
TestFunctional/delete_echo-server_images (0.04s)

                                                
                                                
=== RUN   TestFunctional/delete_echo-server_images
functional_test.go:190: (dbg) Run:  docker rmi -f kicbase/echo-server:1.0
functional_test.go:190: (dbg) Run:  docker rmi -f kicbase/echo-server:functional-986276
--- PASS: TestFunctional/delete_echo-server_images (0.04s)

                                                
                                    
x
+
TestFunctional/delete_my-image_image (0.02s)

                                                
                                                
=== RUN   TestFunctional/delete_my-image_image
functional_test.go:198: (dbg) Run:  docker rmi -f localhost/my-image:functional-986276
--- PASS: TestFunctional/delete_my-image_image (0.02s)

                                                
                                    
x
+
TestFunctional/delete_minikube_cached_images (0.02s)

                                                
                                                
=== RUN   TestFunctional/delete_minikube_cached_images
functional_test.go:206: (dbg) Run:  docker rmi -f minikube-local-cache-test:functional-986276
--- PASS: TestFunctional/delete_minikube_cached_images (0.02s)

                                                
                                    
x
+
TestMultiControlPlane/serial/StartCluster (129.9s)

                                                
                                                
=== RUN   TestMultiControlPlane/serial/StartCluster
ha_test.go:101: (dbg) Run:  out/minikube-linux-arm64 start -p ha-668120 --wait=true --memory=2200 --ha -v=7 --alsologtostderr --driver=docker  --container-runtime=containerd
E0812 12:36:05.451957 1004370 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19411-998978/.minikube/profiles/addons-673965/client.crt: no such file or directory
E0812 12:37:27.372274 1004370 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19411-998978/.minikube/profiles/addons-673965/client.crt: no such file or directory
ha_test.go:101: (dbg) Done: out/minikube-linux-arm64 start -p ha-668120 --wait=true --memory=2200 --ha -v=7 --alsologtostderr --driver=docker  --container-runtime=containerd: (2m8.933153573s)
ha_test.go:107: (dbg) Run:  out/minikube-linux-arm64 -p ha-668120 status -v=7 --alsologtostderr
--- PASS: TestMultiControlPlane/serial/StartCluster (129.90s)

                                                
                                    
x
+
TestMultiControlPlane/serial/DeployApp (31.05s)

                                                
                                                
=== RUN   TestMultiControlPlane/serial/DeployApp
ha_test.go:128: (dbg) Run:  out/minikube-linux-arm64 kubectl -p ha-668120 -- apply -f ./testdata/ha/ha-pod-dns-test.yaml
ha_test.go:133: (dbg) Run:  out/minikube-linux-arm64 kubectl -p ha-668120 -- rollout status deployment/busybox
ha_test.go:133: (dbg) Done: out/minikube-linux-arm64 kubectl -p ha-668120 -- rollout status deployment/busybox: (28.084566568s)
ha_test.go:140: (dbg) Run:  out/minikube-linux-arm64 kubectl -p ha-668120 -- get pods -o jsonpath='{.items[*].status.podIP}'
ha_test.go:163: (dbg) Run:  out/minikube-linux-arm64 kubectl -p ha-668120 -- get pods -o jsonpath='{.items[*].metadata.name}'
ha_test.go:171: (dbg) Run:  out/minikube-linux-arm64 kubectl -p ha-668120 -- exec busybox-fc5497c4f-2tlhw -- nslookup kubernetes.io
ha_test.go:171: (dbg) Run:  out/minikube-linux-arm64 kubectl -p ha-668120 -- exec busybox-fc5497c4f-472kv -- nslookup kubernetes.io
ha_test.go:171: (dbg) Run:  out/minikube-linux-arm64 kubectl -p ha-668120 -- exec busybox-fc5497c4f-h7x5b -- nslookup kubernetes.io
ha_test.go:181: (dbg) Run:  out/minikube-linux-arm64 kubectl -p ha-668120 -- exec busybox-fc5497c4f-2tlhw -- nslookup kubernetes.default
ha_test.go:181: (dbg) Run:  out/minikube-linux-arm64 kubectl -p ha-668120 -- exec busybox-fc5497c4f-472kv -- nslookup kubernetes.default
ha_test.go:181: (dbg) Run:  out/minikube-linux-arm64 kubectl -p ha-668120 -- exec busybox-fc5497c4f-h7x5b -- nslookup kubernetes.default
ha_test.go:189: (dbg) Run:  out/minikube-linux-arm64 kubectl -p ha-668120 -- exec busybox-fc5497c4f-2tlhw -- nslookup kubernetes.default.svc.cluster.local
ha_test.go:189: (dbg) Run:  out/minikube-linux-arm64 kubectl -p ha-668120 -- exec busybox-fc5497c4f-472kv -- nslookup kubernetes.default.svc.cluster.local
ha_test.go:189: (dbg) Run:  out/minikube-linux-arm64 kubectl -p ha-668120 -- exec busybox-fc5497c4f-h7x5b -- nslookup kubernetes.default.svc.cluster.local
--- PASS: TestMultiControlPlane/serial/DeployApp (31.05s)

                                                
                                    
x
+
TestMultiControlPlane/serial/PingHostFromPods (1.58s)

                                                
                                                
=== RUN   TestMultiControlPlane/serial/PingHostFromPods
ha_test.go:199: (dbg) Run:  out/minikube-linux-arm64 kubectl -p ha-668120 -- get pods -o jsonpath='{.items[*].metadata.name}'
ha_test.go:207: (dbg) Run:  out/minikube-linux-arm64 kubectl -p ha-668120 -- exec busybox-fc5497c4f-2tlhw -- sh -c "nslookup host.minikube.internal | awk 'NR==5' | cut -d' ' -f3"
ha_test.go:218: (dbg) Run:  out/minikube-linux-arm64 kubectl -p ha-668120 -- exec busybox-fc5497c4f-2tlhw -- sh -c "ping -c 1 192.168.49.1"
ha_test.go:207: (dbg) Run:  out/minikube-linux-arm64 kubectl -p ha-668120 -- exec busybox-fc5497c4f-472kv -- sh -c "nslookup host.minikube.internal | awk 'NR==5' | cut -d' ' -f3"
ha_test.go:218: (dbg) Run:  out/minikube-linux-arm64 kubectl -p ha-668120 -- exec busybox-fc5497c4f-472kv -- sh -c "ping -c 1 192.168.49.1"
ha_test.go:207: (dbg) Run:  out/minikube-linux-arm64 kubectl -p ha-668120 -- exec busybox-fc5497c4f-h7x5b -- sh -c "nslookup host.minikube.internal | awk 'NR==5' | cut -d' ' -f3"
ha_test.go:218: (dbg) Run:  out/minikube-linux-arm64 kubectl -p ha-668120 -- exec busybox-fc5497c4f-h7x5b -- sh -c "ping -c 1 192.168.49.1"
--- PASS: TestMultiControlPlane/serial/PingHostFromPods (1.58s)

                                                
                                    
x
+
TestMultiControlPlane/serial/AddWorkerNode (23.21s)

                                                
                                                
=== RUN   TestMultiControlPlane/serial/AddWorkerNode
ha_test.go:228: (dbg) Run:  out/minikube-linux-arm64 node add -p ha-668120 -v=7 --alsologtostderr
ha_test.go:228: (dbg) Done: out/minikube-linux-arm64 node add -p ha-668120 -v=7 --alsologtostderr: (22.18587288s)
ha_test.go:234: (dbg) Run:  out/minikube-linux-arm64 -p ha-668120 status -v=7 --alsologtostderr
ha_test.go:234: (dbg) Done: out/minikube-linux-arm64 -p ha-668120 status -v=7 --alsologtostderr: (1.02194569s)
--- PASS: TestMultiControlPlane/serial/AddWorkerNode (23.21s)

                                                
                                    
x
+
TestMultiControlPlane/serial/NodeLabels (0.14s)

                                                
                                                
=== RUN   TestMultiControlPlane/serial/NodeLabels
ha_test.go:255: (dbg) Run:  kubectl --context ha-668120 get nodes -o "jsonpath=[{range .items[*]}{.metadata.labels},{end}]"
--- PASS: TestMultiControlPlane/serial/NodeLabels (0.14s)

                                                
                                    
x
+
TestMultiControlPlane/serial/HAppyAfterClusterStart (0.79s)

                                                
                                                
=== RUN   TestMultiControlPlane/serial/HAppyAfterClusterStart
ha_test.go:281: (dbg) Run:  out/minikube-linux-arm64 profile list --output json
--- PASS: TestMultiControlPlane/serial/HAppyAfterClusterStart (0.79s)

                                                
                                    
x
+
TestMultiControlPlane/serial/CopyFile (20.36s)

                                                
                                                
=== RUN   TestMultiControlPlane/serial/CopyFile
ha_test.go:326: (dbg) Run:  out/minikube-linux-arm64 -p ha-668120 status --output json -v=7 --alsologtostderr
ha_test.go:326: (dbg) Done: out/minikube-linux-arm64 -p ha-668120 status --output json -v=7 --alsologtostderr: (1.029957673s)
helpers_test.go:556: (dbg) Run:  out/minikube-linux-arm64 -p ha-668120 cp testdata/cp-test.txt ha-668120:/home/docker/cp-test.txt
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p ha-668120 ssh -n ha-668120 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:556: (dbg) Run:  out/minikube-linux-arm64 -p ha-668120 cp ha-668120:/home/docker/cp-test.txt /tmp/TestMultiControlPlaneserialCopyFile2258706406/001/cp-test_ha-668120.txt
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p ha-668120 ssh -n ha-668120 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:556: (dbg) Run:  out/minikube-linux-arm64 -p ha-668120 cp ha-668120:/home/docker/cp-test.txt ha-668120-m02:/home/docker/cp-test_ha-668120_ha-668120-m02.txt
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p ha-668120 ssh -n ha-668120 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p ha-668120 ssh -n ha-668120-m02 "sudo cat /home/docker/cp-test_ha-668120_ha-668120-m02.txt"
helpers_test.go:556: (dbg) Run:  out/minikube-linux-arm64 -p ha-668120 cp ha-668120:/home/docker/cp-test.txt ha-668120-m03:/home/docker/cp-test_ha-668120_ha-668120-m03.txt
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p ha-668120 ssh -n ha-668120 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p ha-668120 ssh -n ha-668120-m03 "sudo cat /home/docker/cp-test_ha-668120_ha-668120-m03.txt"
helpers_test.go:556: (dbg) Run:  out/minikube-linux-arm64 -p ha-668120 cp ha-668120:/home/docker/cp-test.txt ha-668120-m04:/home/docker/cp-test_ha-668120_ha-668120-m04.txt
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p ha-668120 ssh -n ha-668120 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p ha-668120 ssh -n ha-668120-m04 "sudo cat /home/docker/cp-test_ha-668120_ha-668120-m04.txt"
helpers_test.go:556: (dbg) Run:  out/minikube-linux-arm64 -p ha-668120 cp testdata/cp-test.txt ha-668120-m02:/home/docker/cp-test.txt
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p ha-668120 ssh -n ha-668120-m02 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:556: (dbg) Run:  out/minikube-linux-arm64 -p ha-668120 cp ha-668120-m02:/home/docker/cp-test.txt /tmp/TestMultiControlPlaneserialCopyFile2258706406/001/cp-test_ha-668120-m02.txt
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p ha-668120 ssh -n ha-668120-m02 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:556: (dbg) Run:  out/minikube-linux-arm64 -p ha-668120 cp ha-668120-m02:/home/docker/cp-test.txt ha-668120:/home/docker/cp-test_ha-668120-m02_ha-668120.txt
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p ha-668120 ssh -n ha-668120-m02 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p ha-668120 ssh -n ha-668120 "sudo cat /home/docker/cp-test_ha-668120-m02_ha-668120.txt"
helpers_test.go:556: (dbg) Run:  out/minikube-linux-arm64 -p ha-668120 cp ha-668120-m02:/home/docker/cp-test.txt ha-668120-m03:/home/docker/cp-test_ha-668120-m02_ha-668120-m03.txt
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p ha-668120 ssh -n ha-668120-m02 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p ha-668120 ssh -n ha-668120-m03 "sudo cat /home/docker/cp-test_ha-668120-m02_ha-668120-m03.txt"
helpers_test.go:556: (dbg) Run:  out/minikube-linux-arm64 -p ha-668120 cp ha-668120-m02:/home/docker/cp-test.txt ha-668120-m04:/home/docker/cp-test_ha-668120-m02_ha-668120-m04.txt
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p ha-668120 ssh -n ha-668120-m02 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p ha-668120 ssh -n ha-668120-m04 "sudo cat /home/docker/cp-test_ha-668120-m02_ha-668120-m04.txt"
helpers_test.go:556: (dbg) Run:  out/minikube-linux-arm64 -p ha-668120 cp testdata/cp-test.txt ha-668120-m03:/home/docker/cp-test.txt
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p ha-668120 ssh -n ha-668120-m03 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:556: (dbg) Run:  out/minikube-linux-arm64 -p ha-668120 cp ha-668120-m03:/home/docker/cp-test.txt /tmp/TestMultiControlPlaneserialCopyFile2258706406/001/cp-test_ha-668120-m03.txt
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p ha-668120 ssh -n ha-668120-m03 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:556: (dbg) Run:  out/minikube-linux-arm64 -p ha-668120 cp ha-668120-m03:/home/docker/cp-test.txt ha-668120:/home/docker/cp-test_ha-668120-m03_ha-668120.txt
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p ha-668120 ssh -n ha-668120-m03 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p ha-668120 ssh -n ha-668120 "sudo cat /home/docker/cp-test_ha-668120-m03_ha-668120.txt"
helpers_test.go:556: (dbg) Run:  out/minikube-linux-arm64 -p ha-668120 cp ha-668120-m03:/home/docker/cp-test.txt ha-668120-m02:/home/docker/cp-test_ha-668120-m03_ha-668120-m02.txt
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p ha-668120 ssh -n ha-668120-m03 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p ha-668120 ssh -n ha-668120-m02 "sudo cat /home/docker/cp-test_ha-668120-m03_ha-668120-m02.txt"
helpers_test.go:556: (dbg) Run:  out/minikube-linux-arm64 -p ha-668120 cp ha-668120-m03:/home/docker/cp-test.txt ha-668120-m04:/home/docker/cp-test_ha-668120-m03_ha-668120-m04.txt
E0812 12:39:12.757359 1004370 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19411-998978/.minikube/profiles/functional-986276/client.crt: no such file or directory
E0812 12:39:12.762600 1004370 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19411-998978/.minikube/profiles/functional-986276/client.crt: no such file or directory
E0812 12:39:12.773415 1004370 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19411-998978/.minikube/profiles/functional-986276/client.crt: no such file or directory
E0812 12:39:12.793694 1004370 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19411-998978/.minikube/profiles/functional-986276/client.crt: no such file or directory
E0812 12:39:12.833925 1004370 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19411-998978/.minikube/profiles/functional-986276/client.crt: no such file or directory
E0812 12:39:12.914265 1004370 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19411-998978/.minikube/profiles/functional-986276/client.crt: no such file or directory
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p ha-668120 ssh -n ha-668120-m03 "sudo cat /home/docker/cp-test.txt"
E0812 12:39:13.075313 1004370 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19411-998978/.minikube/profiles/functional-986276/client.crt: no such file or directory
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p ha-668120 ssh -n ha-668120-m04 "sudo cat /home/docker/cp-test_ha-668120-m03_ha-668120-m04.txt"
E0812 12:39:13.396100 1004370 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19411-998978/.minikube/profiles/functional-986276/client.crt: no such file or directory
helpers_test.go:556: (dbg) Run:  out/minikube-linux-arm64 -p ha-668120 cp testdata/cp-test.txt ha-668120-m04:/home/docker/cp-test.txt
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p ha-668120 ssh -n ha-668120-m04 "sudo cat /home/docker/cp-test.txt"
E0812 12:39:14.036862 1004370 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19411-998978/.minikube/profiles/functional-986276/client.crt: no such file or directory
helpers_test.go:556: (dbg) Run:  out/minikube-linux-arm64 -p ha-668120 cp ha-668120-m04:/home/docker/cp-test.txt /tmp/TestMultiControlPlaneserialCopyFile2258706406/001/cp-test_ha-668120-m04.txt
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p ha-668120 ssh -n ha-668120-m04 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:556: (dbg) Run:  out/minikube-linux-arm64 -p ha-668120 cp ha-668120-m04:/home/docker/cp-test.txt ha-668120:/home/docker/cp-test_ha-668120-m04_ha-668120.txt
E0812 12:39:15.317339 1004370 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19411-998978/.minikube/profiles/functional-986276/client.crt: no such file or directory
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p ha-668120 ssh -n ha-668120-m04 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p ha-668120 ssh -n ha-668120 "sudo cat /home/docker/cp-test_ha-668120-m04_ha-668120.txt"
helpers_test.go:556: (dbg) Run:  out/minikube-linux-arm64 -p ha-668120 cp ha-668120-m04:/home/docker/cp-test.txt ha-668120-m02:/home/docker/cp-test_ha-668120-m04_ha-668120-m02.txt
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p ha-668120 ssh -n ha-668120-m04 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p ha-668120 ssh -n ha-668120-m02 "sudo cat /home/docker/cp-test_ha-668120-m04_ha-668120-m02.txt"
helpers_test.go:556: (dbg) Run:  out/minikube-linux-arm64 -p ha-668120 cp ha-668120-m04:/home/docker/cp-test.txt ha-668120-m03:/home/docker/cp-test_ha-668120-m04_ha-668120-m03.txt
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p ha-668120 ssh -n ha-668120-m04 "sudo cat /home/docker/cp-test.txt"
E0812 12:39:17.878283 1004370 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19411-998978/.minikube/profiles/functional-986276/client.crt: no such file or directory
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p ha-668120 ssh -n ha-668120-m03 "sudo cat /home/docker/cp-test_ha-668120-m04_ha-668120-m03.txt"
--- PASS: TestMultiControlPlane/serial/CopyFile (20.36s)

                                                
                                    
x
+
TestMultiControlPlane/serial/StopSecondaryNode (13.18s)

                                                
                                                
=== RUN   TestMultiControlPlane/serial/StopSecondaryNode
ha_test.go:363: (dbg) Run:  out/minikube-linux-arm64 -p ha-668120 node stop m02 -v=7 --alsologtostderr
E0812 12:39:22.998421 1004370 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19411-998978/.minikube/profiles/functional-986276/client.crt: no such file or directory
ha_test.go:363: (dbg) Done: out/minikube-linux-arm64 -p ha-668120 node stop m02 -v=7 --alsologtostderr: (12.383452032s)
ha_test.go:369: (dbg) Run:  out/minikube-linux-arm64 -p ha-668120 status -v=7 --alsologtostderr
ha_test.go:369: (dbg) Non-zero exit: out/minikube-linux-arm64 -p ha-668120 status -v=7 --alsologtostderr: exit status 7 (797.334697ms)

                                                
                                                
-- stdout --
	ha-668120
	type: Control Plane
	host: Running
	kubelet: Running
	apiserver: Running
	kubeconfig: Configured
	
	ha-668120-m02
	type: Control Plane
	host: Stopped
	kubelet: Stopped
	apiserver: Stopped
	kubeconfig: Stopped
	
	ha-668120-m03
	type: Control Plane
	host: Running
	kubelet: Running
	apiserver: Running
	kubeconfig: Configured
	
	ha-668120-m04
	type: Worker
	host: Running
	kubelet: Running
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0812 12:39:30.879081 1058017 out.go:291] Setting OutFile to fd 1 ...
	I0812 12:39:30.879335 1058017 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0812 12:39:30.879351 1058017 out.go:304] Setting ErrFile to fd 2...
	I0812 12:39:30.879357 1058017 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0812 12:39:30.879838 1058017 root.go:338] Updating PATH: /home/jenkins/minikube-integration/19411-998978/.minikube/bin
	I0812 12:39:30.880190 1058017 out.go:298] Setting JSON to false
	I0812 12:39:30.880261 1058017 mustload.go:65] Loading cluster: ha-668120
	I0812 12:39:30.880398 1058017 notify.go:220] Checking for updates...
	I0812 12:39:30.882626 1058017 config.go:182] Loaded profile config "ha-668120": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.30.3
	I0812 12:39:30.882665 1058017 status.go:255] checking status of ha-668120 ...
	I0812 12:39:30.883771 1058017 cli_runner.go:164] Run: docker container inspect ha-668120 --format={{.State.Status}}
	I0812 12:39:30.904602 1058017 status.go:330] ha-668120 host status = "Running" (err=<nil>)
	I0812 12:39:30.904648 1058017 host.go:66] Checking if "ha-668120" exists ...
	I0812 12:39:30.905075 1058017 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" ha-668120
	I0812 12:39:30.934874 1058017 host.go:66] Checking if "ha-668120" exists ...
	I0812 12:39:30.935341 1058017 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
	I0812 12:39:30.935387 1058017 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-668120
	I0812 12:39:30.957617 1058017 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33914 SSHKeyPath:/home/jenkins/minikube-integration/19411-998978/.minikube/machines/ha-668120/id_rsa Username:docker}
	I0812 12:39:31.067984 1058017 ssh_runner.go:195] Run: systemctl --version
	I0812 12:39:31.073731 1058017 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
	I0812 12:39:31.090850 1058017 cli_runner.go:164] Run: docker system info --format "{{json .}}"
	I0812 12:39:31.164806 1058017 info.go:266] docker info: {ID:6ZPO:QZND:VNGE:LUKL:4Y3K:XELL:AAX4:2GTK:E6LM:MPRN:3ZXR:TTMR Containers:4 ContainersRunning:3 ContainersPaused:0 ContainersStopped:1 Images:3 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:48 OomKillDisable:true NGoroutines:71 SystemTime:2024-08-12 12:39:31.15356542 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1066-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Architecture:aarc
h64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8214896640 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-30-239 Labels:[] ExperimentalBuild:false ServerVersion:27.1.1 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:2bf793ef6dc9a18e00cb12efb64355c2c9d5eb41 Expected:2bf793ef6dc9a18e00cb12efb64355c2c9d5eb41} RuncCommit:{ID:v1.1.13-0-g58aa920 Expected:v1.1.13-0-g58aa920} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:<nil> ServerError
s:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.16.1] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.29.1]] Warnings:<nil>}}
	I0812 12:39:31.165734 1058017 kubeconfig.go:125] found "ha-668120" server: "https://192.168.49.254:8443"
	I0812 12:39:31.165768 1058017 api_server.go:166] Checking apiserver status ...
	I0812 12:39:31.165821 1058017 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0812 12:39:31.179208 1058017 ssh_runner.go:195] Run: sudo egrep ^[0-9]+:freezer: /proc/1516/cgroup
	I0812 12:39:31.190970 1058017 api_server.go:182] apiserver freezer: "13:freezer:/docker/f626d185ef65e3acfc27080a6b43ee55d3b5cdba283ca9913993c46032dd3941/kubepods/burstable/podb6afca1b89466875942f3d252850cd65/00342a8e7cf9c5e5c28cf52e67fe53598bc2b3973b1907989bf3d95106049a7d"
	I0812 12:39:31.191045 1058017 ssh_runner.go:195] Run: sudo cat /sys/fs/cgroup/freezer/docker/f626d185ef65e3acfc27080a6b43ee55d3b5cdba283ca9913993c46032dd3941/kubepods/burstable/podb6afca1b89466875942f3d252850cd65/00342a8e7cf9c5e5c28cf52e67fe53598bc2b3973b1907989bf3d95106049a7d/freezer.state
	I0812 12:39:31.201157 1058017 api_server.go:204] freezer state: "THAWED"
	I0812 12:39:31.201191 1058017 api_server.go:253] Checking apiserver healthz at https://192.168.49.254:8443/healthz ...
	I0812 12:39:31.210933 1058017 api_server.go:279] https://192.168.49.254:8443/healthz returned 200:
	ok
	I0812 12:39:31.210965 1058017 status.go:422] ha-668120 apiserver status = Running (err=<nil>)
	I0812 12:39:31.210977 1058017 status.go:257] ha-668120 status: &{Name:ha-668120 Host:Running Kubelet:Running APIServer:Running Kubeconfig:Configured Worker:false TimeToStop: DockerEnv: PodManEnv:}
	I0812 12:39:31.211025 1058017 status.go:255] checking status of ha-668120-m02 ...
	I0812 12:39:31.211337 1058017 cli_runner.go:164] Run: docker container inspect ha-668120-m02 --format={{.State.Status}}
	I0812 12:39:31.228552 1058017 status.go:330] ha-668120-m02 host status = "Stopped" (err=<nil>)
	I0812 12:39:31.228588 1058017 status.go:343] host is not running, skipping remaining checks
	I0812 12:39:31.228597 1058017 status.go:257] ha-668120-m02 status: &{Name:ha-668120-m02 Host:Stopped Kubelet:Stopped APIServer:Stopped Kubeconfig:Stopped Worker:false TimeToStop: DockerEnv: PodManEnv:}
	I0812 12:39:31.228635 1058017 status.go:255] checking status of ha-668120-m03 ...
	I0812 12:39:31.228951 1058017 cli_runner.go:164] Run: docker container inspect ha-668120-m03 --format={{.State.Status}}
	I0812 12:39:31.246245 1058017 status.go:330] ha-668120-m03 host status = "Running" (err=<nil>)
	I0812 12:39:31.246370 1058017 host.go:66] Checking if "ha-668120-m03" exists ...
	I0812 12:39:31.246682 1058017 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" ha-668120-m03
	I0812 12:39:31.263945 1058017 host.go:66] Checking if "ha-668120-m03" exists ...
	I0812 12:39:31.264417 1058017 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
	I0812 12:39:31.264493 1058017 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-668120-m03
	I0812 12:39:31.284484 1058017 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33924 SSHKeyPath:/home/jenkins/minikube-integration/19411-998978/.minikube/machines/ha-668120-m03/id_rsa Username:docker}
	I0812 12:39:31.382707 1058017 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
	I0812 12:39:31.395813 1058017 kubeconfig.go:125] found "ha-668120" server: "https://192.168.49.254:8443"
	I0812 12:39:31.395843 1058017 api_server.go:166] Checking apiserver status ...
	I0812 12:39:31.395887 1058017 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0812 12:39:31.407793 1058017 ssh_runner.go:195] Run: sudo egrep ^[0-9]+:freezer: /proc/1462/cgroup
	I0812 12:39:31.418587 1058017 api_server.go:182] apiserver freezer: "13:freezer:/docker/0222de912da9fb75eb6ed3208706005efef1c880cc4b387b9680da428d6ec046/kubepods/burstable/pod58a4c8d16a9b5b800af5fa8b4ce301c2/06c7710f06e7ab237a4a819edae013b52b8dda518c26967e38c9b48fbe3c9ac5"
	I0812 12:39:31.418671 1058017 ssh_runner.go:195] Run: sudo cat /sys/fs/cgroup/freezer/docker/0222de912da9fb75eb6ed3208706005efef1c880cc4b387b9680da428d6ec046/kubepods/burstable/pod58a4c8d16a9b5b800af5fa8b4ce301c2/06c7710f06e7ab237a4a819edae013b52b8dda518c26967e38c9b48fbe3c9ac5/freezer.state
	I0812 12:39:31.429061 1058017 api_server.go:204] freezer state: "THAWED"
	I0812 12:39:31.429092 1058017 api_server.go:253] Checking apiserver healthz at https://192.168.49.254:8443/healthz ...
	I0812 12:39:31.436936 1058017 api_server.go:279] https://192.168.49.254:8443/healthz returned 200:
	ok
	I0812 12:39:31.436965 1058017 status.go:422] ha-668120-m03 apiserver status = Running (err=<nil>)
	I0812 12:39:31.436976 1058017 status.go:257] ha-668120-m03 status: &{Name:ha-668120-m03 Host:Running Kubelet:Running APIServer:Running Kubeconfig:Configured Worker:false TimeToStop: DockerEnv: PodManEnv:}
	I0812 12:39:31.436991 1058017 status.go:255] checking status of ha-668120-m04 ...
	I0812 12:39:31.437354 1058017 cli_runner.go:164] Run: docker container inspect ha-668120-m04 --format={{.State.Status}}
	I0812 12:39:31.455913 1058017 status.go:330] ha-668120-m04 host status = "Running" (err=<nil>)
	I0812 12:39:31.455942 1058017 host.go:66] Checking if "ha-668120-m04" exists ...
	I0812 12:39:31.456248 1058017 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" ha-668120-m04
	I0812 12:39:31.473448 1058017 host.go:66] Checking if "ha-668120-m04" exists ...
	I0812 12:39:31.473757 1058017 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
	I0812 12:39:31.473804 1058017 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-668120-m04
	I0812 12:39:31.492000 1058017 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33929 SSHKeyPath:/home/jenkins/minikube-integration/19411-998978/.minikube/machines/ha-668120-m04/id_rsa Username:docker}
	I0812 12:39:31.591565 1058017 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
	I0812 12:39:31.603679 1058017 status.go:257] ha-668120-m04 status: &{Name:ha-668120-m04 Host:Running Kubelet:Running APIServer:Irrelevant Kubeconfig:Irrelevant Worker:true TimeToStop: DockerEnv: PodManEnv:}

                                                
                                                
** /stderr **
--- PASS: TestMultiControlPlane/serial/StopSecondaryNode (13.18s)

                                                
                                    
x
+
TestMultiControlPlane/serial/DegradedAfterControlPlaneNodeStop (0.59s)

                                                
                                                
=== RUN   TestMultiControlPlane/serial/DegradedAfterControlPlaneNodeStop
ha_test.go:390: (dbg) Run:  out/minikube-linux-arm64 profile list --output json
--- PASS: TestMultiControlPlane/serial/DegradedAfterControlPlaneNodeStop (0.59s)

                                                
                                    
x
+
TestMultiControlPlane/serial/RestartSecondaryNode (19.58s)

                                                
                                                
=== RUN   TestMultiControlPlane/serial/RestartSecondaryNode
ha_test.go:420: (dbg) Run:  out/minikube-linux-arm64 -p ha-668120 node start m02 -v=7 --alsologtostderr
E0812 12:39:33.238634 1004370 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19411-998978/.minikube/profiles/functional-986276/client.crt: no such file or directory
E0812 12:39:43.525018 1004370 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19411-998978/.minikube/profiles/addons-673965/client.crt: no such file or directory
ha_test.go:420: (dbg) Done: out/minikube-linux-arm64 -p ha-668120 node start m02 -v=7 --alsologtostderr: (18.327064926s)
ha_test.go:428: (dbg) Run:  out/minikube-linux-arm64 -p ha-668120 status -v=7 --alsologtostderr
ha_test.go:428: (dbg) Done: out/minikube-linux-arm64 -p ha-668120 status -v=7 --alsologtostderr: (1.142951445s)
ha_test.go:448: (dbg) Run:  kubectl get nodes
--- PASS: TestMultiControlPlane/serial/RestartSecondaryNode (19.58s)

                                                
                                    
x
+
TestMultiControlPlane/serial/HAppyAfterSecondaryNodeRestart (0.81s)

                                                
                                                
=== RUN   TestMultiControlPlane/serial/HAppyAfterSecondaryNodeRestart
ha_test.go:281: (dbg) Run:  out/minikube-linux-arm64 profile list --output json
--- PASS: TestMultiControlPlane/serial/HAppyAfterSecondaryNodeRestart (0.81s)

                                                
                                    
x
+
TestMultiControlPlane/serial/RestartClusterKeepsNodes (144.12s)

                                                
                                                
=== RUN   TestMultiControlPlane/serial/RestartClusterKeepsNodes
ha_test.go:456: (dbg) Run:  out/minikube-linux-arm64 node list -p ha-668120 -v=7 --alsologtostderr
ha_test.go:462: (dbg) Run:  out/minikube-linux-arm64 stop -p ha-668120 -v=7 --alsologtostderr
E0812 12:39:53.719177 1004370 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19411-998978/.minikube/profiles/functional-986276/client.crt: no such file or directory
E0812 12:40:11.213374 1004370 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19411-998978/.minikube/profiles/addons-673965/client.crt: no such file or directory
ha_test.go:462: (dbg) Done: out/minikube-linux-arm64 stop -p ha-668120 -v=7 --alsologtostderr: (37.461983002s)
ha_test.go:467: (dbg) Run:  out/minikube-linux-arm64 start -p ha-668120 --wait=true -v=7 --alsologtostderr
E0812 12:40:34.679844 1004370 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19411-998978/.minikube/profiles/functional-986276/client.crt: no such file or directory
E0812 12:41:56.600697 1004370 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19411-998978/.minikube/profiles/functional-986276/client.crt: no such file or directory
ha_test.go:467: (dbg) Done: out/minikube-linux-arm64 start -p ha-668120 --wait=true -v=7 --alsologtostderr: (1m46.484008308s)
ha_test.go:472: (dbg) Run:  out/minikube-linux-arm64 node list -p ha-668120
--- PASS: TestMultiControlPlane/serial/RestartClusterKeepsNodes (144.12s)

                                                
                                    
x
+
TestMultiControlPlane/serial/DeleteSecondaryNode (11.67s)

                                                
                                                
=== RUN   TestMultiControlPlane/serial/DeleteSecondaryNode
ha_test.go:487: (dbg) Run:  out/minikube-linux-arm64 -p ha-668120 node delete m03 -v=7 --alsologtostderr
ha_test.go:487: (dbg) Done: out/minikube-linux-arm64 -p ha-668120 node delete m03 -v=7 --alsologtostderr: (10.705668503s)
ha_test.go:493: (dbg) Run:  out/minikube-linux-arm64 -p ha-668120 status -v=7 --alsologtostderr
ha_test.go:511: (dbg) Run:  kubectl get nodes
ha_test.go:519: (dbg) Run:  kubectl get nodes -o "go-template='{{range .items}}{{range .status.conditions}}{{if eq .type "Ready"}} {{.status}}{{"\n"}}{{end}}{{end}}{{end}}'"
--- PASS: TestMultiControlPlane/serial/DeleteSecondaryNode (11.67s)

                                                
                                    
x
+
TestMultiControlPlane/serial/DegradedAfterSecondaryNodeDelete (0.55s)

                                                
                                                
=== RUN   TestMultiControlPlane/serial/DegradedAfterSecondaryNodeDelete
ha_test.go:390: (dbg) Run:  out/minikube-linux-arm64 profile list --output json
--- PASS: TestMultiControlPlane/serial/DegradedAfterSecondaryNodeDelete (0.55s)

                                                
                                    
x
+
TestMultiControlPlane/serial/StopCluster (36.2s)

                                                
                                                
=== RUN   TestMultiControlPlane/serial/StopCluster
ha_test.go:531: (dbg) Run:  out/minikube-linux-arm64 -p ha-668120 stop -v=7 --alsologtostderr
ha_test.go:531: (dbg) Done: out/minikube-linux-arm64 -p ha-668120 stop -v=7 --alsologtostderr: (36.073667708s)
ha_test.go:537: (dbg) Run:  out/minikube-linux-arm64 -p ha-668120 status -v=7 --alsologtostderr
ha_test.go:537: (dbg) Non-zero exit: out/minikube-linux-arm64 -p ha-668120 status -v=7 --alsologtostderr: exit status 7 (124.756884ms)

                                                
                                                
-- stdout --
	ha-668120
	type: Control Plane
	host: Stopped
	kubelet: Stopped
	apiserver: Stopped
	kubeconfig: Stopped
	
	ha-668120-m02
	type: Control Plane
	host: Stopped
	kubelet: Stopped
	apiserver: Stopped
	kubeconfig: Stopped
	
	ha-668120-m04
	type: Worker
	host: Stopped
	kubelet: Stopped
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0812 12:43:05.045348 1072427 out.go:291] Setting OutFile to fd 1 ...
	I0812 12:43:05.045479 1072427 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0812 12:43:05.045490 1072427 out.go:304] Setting ErrFile to fd 2...
	I0812 12:43:05.045495 1072427 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0812 12:43:05.045753 1072427 root.go:338] Updating PATH: /home/jenkins/minikube-integration/19411-998978/.minikube/bin
	I0812 12:43:05.045947 1072427 out.go:298] Setting JSON to false
	I0812 12:43:05.045984 1072427 mustload.go:65] Loading cluster: ha-668120
	I0812 12:43:05.046113 1072427 notify.go:220] Checking for updates...
	I0812 12:43:05.046420 1072427 config.go:182] Loaded profile config "ha-668120": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.30.3
	I0812 12:43:05.046434 1072427 status.go:255] checking status of ha-668120 ...
	I0812 12:43:05.046930 1072427 cli_runner.go:164] Run: docker container inspect ha-668120 --format={{.State.Status}}
	I0812 12:43:05.066409 1072427 status.go:330] ha-668120 host status = "Stopped" (err=<nil>)
	I0812 12:43:05.066430 1072427 status.go:343] host is not running, skipping remaining checks
	I0812 12:43:05.066438 1072427 status.go:257] ha-668120 status: &{Name:ha-668120 Host:Stopped Kubelet:Stopped APIServer:Stopped Kubeconfig:Stopped Worker:false TimeToStop: DockerEnv: PodManEnv:}
	I0812 12:43:05.066470 1072427 status.go:255] checking status of ha-668120-m02 ...
	I0812 12:43:05.066829 1072427 cli_runner.go:164] Run: docker container inspect ha-668120-m02 --format={{.State.Status}}
	I0812 12:43:05.089214 1072427 status.go:330] ha-668120-m02 host status = "Stopped" (err=<nil>)
	I0812 12:43:05.089248 1072427 status.go:343] host is not running, skipping remaining checks
	I0812 12:43:05.089256 1072427 status.go:257] ha-668120-m02 status: &{Name:ha-668120-m02 Host:Stopped Kubelet:Stopped APIServer:Stopped Kubeconfig:Stopped Worker:false TimeToStop: DockerEnv: PodManEnv:}
	I0812 12:43:05.089330 1072427 status.go:255] checking status of ha-668120-m04 ...
	I0812 12:43:05.089778 1072427 cli_runner.go:164] Run: docker container inspect ha-668120-m04 --format={{.State.Status}}
	I0812 12:43:05.116603 1072427 status.go:330] ha-668120-m04 host status = "Stopped" (err=<nil>)
	I0812 12:43:05.116624 1072427 status.go:343] host is not running, skipping remaining checks
	I0812 12:43:05.116633 1072427 status.go:257] ha-668120-m04 status: &{Name:ha-668120-m04 Host:Stopped Kubelet:Stopped APIServer:Stopped Kubeconfig:Stopped Worker:true TimeToStop: DockerEnv: PodManEnv:}

                                                
                                                
** /stderr **
--- PASS: TestMultiControlPlane/serial/StopCluster (36.20s)

                                                
                                    
x
+
TestMultiControlPlane/serial/RestartCluster (65.06s)

                                                
                                                
=== RUN   TestMultiControlPlane/serial/RestartCluster
ha_test.go:560: (dbg) Run:  out/minikube-linux-arm64 start -p ha-668120 --wait=true -v=7 --alsologtostderr --driver=docker  --container-runtime=containerd
ha_test.go:560: (dbg) Done: out/minikube-linux-arm64 start -p ha-668120 --wait=true -v=7 --alsologtostderr --driver=docker  --container-runtime=containerd: (1m4.066285552s)
ha_test.go:566: (dbg) Run:  out/minikube-linux-arm64 -p ha-668120 status -v=7 --alsologtostderr
ha_test.go:584: (dbg) Run:  kubectl get nodes
ha_test.go:592: (dbg) Run:  kubectl get nodes -o "go-template='{{range .items}}{{range .status.conditions}}{{if eq .type "Ready"}} {{.status}}{{"\n"}}{{end}}{{end}}{{end}}'"
--- PASS: TestMultiControlPlane/serial/RestartCluster (65.06s)

                                                
                                    
x
+
TestMultiControlPlane/serial/DegradedAfterClusterRestart (0.56s)

                                                
                                                
=== RUN   TestMultiControlPlane/serial/DegradedAfterClusterRestart
ha_test.go:390: (dbg) Run:  out/minikube-linux-arm64 profile list --output json
--- PASS: TestMultiControlPlane/serial/DegradedAfterClusterRestart (0.56s)

                                                
                                    
x
+
TestMultiControlPlane/serial/AddSecondaryNode (44.69s)

                                                
                                                
=== RUN   TestMultiControlPlane/serial/AddSecondaryNode
ha_test.go:605: (dbg) Run:  out/minikube-linux-arm64 node add -p ha-668120 --control-plane -v=7 --alsologtostderr
E0812 12:44:12.756558 1004370 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19411-998978/.minikube/profiles/functional-986276/client.crt: no such file or directory
E0812 12:44:40.441399 1004370 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19411-998978/.minikube/profiles/functional-986276/client.crt: no such file or directory
E0812 12:44:43.525389 1004370 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19411-998978/.minikube/profiles/addons-673965/client.crt: no such file or directory
ha_test.go:605: (dbg) Done: out/minikube-linux-arm64 node add -p ha-668120 --control-plane -v=7 --alsologtostderr: (43.548606649s)
ha_test.go:611: (dbg) Run:  out/minikube-linux-arm64 -p ha-668120 status -v=7 --alsologtostderr
ha_test.go:611: (dbg) Done: out/minikube-linux-arm64 -p ha-668120 status -v=7 --alsologtostderr: (1.143038573s)
--- PASS: TestMultiControlPlane/serial/AddSecondaryNode (44.69s)

                                                
                                    
x
+
TestMultiControlPlane/serial/HAppyAfterSecondaryNodeAdd (0.83s)

                                                
                                                
=== RUN   TestMultiControlPlane/serial/HAppyAfterSecondaryNodeAdd
ha_test.go:281: (dbg) Run:  out/minikube-linux-arm64 profile list --output json
--- PASS: TestMultiControlPlane/serial/HAppyAfterSecondaryNodeAdd (0.83s)

                                                
                                    
x
+
TestJSONOutput/start/Command (70.39s)

                                                
                                                
=== RUN   TestJSONOutput/start/Command
json_output_test.go:63: (dbg) Run:  out/minikube-linux-arm64 start -p json-output-841670 --output=json --user=testUser --memory=2200 --wait=true --driver=docker  --container-runtime=containerd
json_output_test.go:63: (dbg) Done: out/minikube-linux-arm64 start -p json-output-841670 --output=json --user=testUser --memory=2200 --wait=true --driver=docker  --container-runtime=containerd: (1m10.383822482s)
--- PASS: TestJSONOutput/start/Command (70.39s)

                                                
                                    
x
+
TestJSONOutput/start/Audit (0s)

                                                
                                                
=== RUN   TestJSONOutput/start/Audit
--- PASS: TestJSONOutput/start/Audit (0.00s)

                                                
                                    
x
+
TestJSONOutput/start/parallel/DistinctCurrentSteps (0s)

                                                
                                                
=== RUN   TestJSONOutput/start/parallel/DistinctCurrentSteps
=== PAUSE TestJSONOutput/start/parallel/DistinctCurrentSteps

                                                
                                                

                                                
                                                
=== CONT  TestJSONOutput/start/parallel/DistinctCurrentSteps
--- PASS: TestJSONOutput/start/parallel/DistinctCurrentSteps (0.00s)

                                                
                                    
x
+
TestJSONOutput/start/parallel/IncreasingCurrentSteps (0s)

                                                
                                                
=== RUN   TestJSONOutput/start/parallel/IncreasingCurrentSteps
=== PAUSE TestJSONOutput/start/parallel/IncreasingCurrentSteps

                                                
                                                

                                                
                                                
=== CONT  TestJSONOutput/start/parallel/IncreasingCurrentSteps
--- PASS: TestJSONOutput/start/parallel/IncreasingCurrentSteps (0.00s)

                                                
                                    
x
+
TestJSONOutput/pause/Command (0.73s)

                                                
                                                
=== RUN   TestJSONOutput/pause/Command
json_output_test.go:63: (dbg) Run:  out/minikube-linux-arm64 pause -p json-output-841670 --output=json --user=testUser
--- PASS: TestJSONOutput/pause/Command (0.73s)

                                                
                                    
x
+
TestJSONOutput/pause/Audit (0s)

                                                
                                                
=== RUN   TestJSONOutput/pause/Audit
--- PASS: TestJSONOutput/pause/Audit (0.00s)

                                                
                                    
x
+
TestJSONOutput/pause/parallel/DistinctCurrentSteps (0s)

                                                
                                                
=== RUN   TestJSONOutput/pause/parallel/DistinctCurrentSteps
=== PAUSE TestJSONOutput/pause/parallel/DistinctCurrentSteps

                                                
                                                

                                                
                                                
=== CONT  TestJSONOutput/pause/parallel/DistinctCurrentSteps
--- PASS: TestJSONOutput/pause/parallel/DistinctCurrentSteps (0.00s)

                                                
                                    
x
+
TestJSONOutput/pause/parallel/IncreasingCurrentSteps (0s)

                                                
                                                
=== RUN   TestJSONOutput/pause/parallel/IncreasingCurrentSteps
=== PAUSE TestJSONOutput/pause/parallel/IncreasingCurrentSteps

                                                
                                                

                                                
                                                
=== CONT  TestJSONOutput/pause/parallel/IncreasingCurrentSteps
--- PASS: TestJSONOutput/pause/parallel/IncreasingCurrentSteps (0.00s)

                                                
                                    
x
+
TestJSONOutput/unpause/Command (0.66s)

                                                
                                                
=== RUN   TestJSONOutput/unpause/Command
json_output_test.go:63: (dbg) Run:  out/minikube-linux-arm64 unpause -p json-output-841670 --output=json --user=testUser
--- PASS: TestJSONOutput/unpause/Command (0.66s)

                                                
                                    
x
+
TestJSONOutput/unpause/Audit (0s)

                                                
                                                
=== RUN   TestJSONOutput/unpause/Audit
--- PASS: TestJSONOutput/unpause/Audit (0.00s)

                                                
                                    
x
+
TestJSONOutput/unpause/parallel/DistinctCurrentSteps (0s)

                                                
                                                
=== RUN   TestJSONOutput/unpause/parallel/DistinctCurrentSteps
=== PAUSE TestJSONOutput/unpause/parallel/DistinctCurrentSteps

                                                
                                                

                                                
                                                
=== CONT  TestJSONOutput/unpause/parallel/DistinctCurrentSteps
--- PASS: TestJSONOutput/unpause/parallel/DistinctCurrentSteps (0.00s)

                                                
                                    
x
+
TestJSONOutput/unpause/parallel/IncreasingCurrentSteps (0s)

                                                
                                                
=== RUN   TestJSONOutput/unpause/parallel/IncreasingCurrentSteps
=== PAUSE TestJSONOutput/unpause/parallel/IncreasingCurrentSteps

                                                
                                                

                                                
                                                
=== CONT  TestJSONOutput/unpause/parallel/IncreasingCurrentSteps
--- PASS: TestJSONOutput/unpause/parallel/IncreasingCurrentSteps (0.00s)

                                                
                                    
x
+
TestJSONOutput/stop/Command (5.78s)

                                                
                                                
=== RUN   TestJSONOutput/stop/Command
json_output_test.go:63: (dbg) Run:  out/minikube-linux-arm64 stop -p json-output-841670 --output=json --user=testUser
json_output_test.go:63: (dbg) Done: out/minikube-linux-arm64 stop -p json-output-841670 --output=json --user=testUser: (5.779986224s)
--- PASS: TestJSONOutput/stop/Command (5.78s)

                                                
                                    
x
+
TestJSONOutput/stop/Audit (0s)

                                                
                                                
=== RUN   TestJSONOutput/stop/Audit
--- PASS: TestJSONOutput/stop/Audit (0.00s)

                                                
                                    
x
+
TestJSONOutput/stop/parallel/DistinctCurrentSteps (0s)

                                                
                                                
=== RUN   TestJSONOutput/stop/parallel/DistinctCurrentSteps
=== PAUSE TestJSONOutput/stop/parallel/DistinctCurrentSteps

                                                
                                                

                                                
                                                
=== CONT  TestJSONOutput/stop/parallel/DistinctCurrentSteps
--- PASS: TestJSONOutput/stop/parallel/DistinctCurrentSteps (0.00s)

                                                
                                    
x
+
TestJSONOutput/stop/parallel/IncreasingCurrentSteps (0s)

                                                
                                                
=== RUN   TestJSONOutput/stop/parallel/IncreasingCurrentSteps
=== PAUSE TestJSONOutput/stop/parallel/IncreasingCurrentSteps

                                                
                                                

                                                
                                                
=== CONT  TestJSONOutput/stop/parallel/IncreasingCurrentSteps
--- PASS: TestJSONOutput/stop/parallel/IncreasingCurrentSteps (0.00s)

                                                
                                    
x
+
TestErrorJSONOutput (0.23s)

                                                
                                                
=== RUN   TestErrorJSONOutput
json_output_test.go:160: (dbg) Run:  out/minikube-linux-arm64 start -p json-output-error-711954 --memory=2200 --output=json --wait=true --driver=fail
json_output_test.go:160: (dbg) Non-zero exit: out/minikube-linux-arm64 start -p json-output-error-711954 --memory=2200 --output=json --wait=true --driver=fail: exit status 56 (79.177512ms)

                                                
                                                
-- stdout --
	{"specversion":"1.0","id":"7db018dd-f321-448a-a877-e614810bcf31","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.step","datacontenttype":"application/json","data":{"currentstep":"0","message":"[json-output-error-711954] minikube v1.33.1 on Ubuntu 20.04 (arm64)","name":"Initial Minikube Setup","totalsteps":"19"}}
	{"specversion":"1.0","id":"937082ed-e4ae-4af4-8dd4-1c9af39334fa","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_LOCATION=19411"}}
	{"specversion":"1.0","id":"ceea642e-49dc-4615-8f31-de9d3446cf3d","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true"}}
	{"specversion":"1.0","id":"0ef31774-4f6e-4af9-beff-d24e9a11a345","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"KUBECONFIG=/home/jenkins/minikube-integration/19411-998978/kubeconfig"}}
	{"specversion":"1.0","id":"98a5729d-5adf-482e-81c6-e5f160144477","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_HOME=/home/jenkins/minikube-integration/19411-998978/.minikube"}}
	{"specversion":"1.0","id":"0c171859-ce09-4dc4-8d55-4ffe2d1cd120","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_BIN=out/minikube-linux-arm64"}}
	{"specversion":"1.0","id":"b525b435-27fa-43a2-b1a1-7ea8edf6ba31","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_FORCE_SYSTEMD="}}
	{"specversion":"1.0","id":"52fa5cbb-7273-4f1c-8e6c-1488d92450ef","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.error","datacontenttype":"application/json","data":{"advice":"","exitcode":"56","issues":"","message":"The driver 'fail' is not supported on linux/arm64","name":"DRV_UNSUPPORTED_OS","url":""}}

                                                
                                                
-- /stdout --
helpers_test.go:175: Cleaning up "json-output-error-711954" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-arm64 delete -p json-output-error-711954
--- PASS: TestErrorJSONOutput (0.23s)

                                                
                                    
x
+
TestKicCustomNetwork/create_custom_network (42.51s)

                                                
                                                
=== RUN   TestKicCustomNetwork/create_custom_network
kic_custom_network_test.go:57: (dbg) Run:  out/minikube-linux-arm64 start -p docker-network-689830 --network=
kic_custom_network_test.go:57: (dbg) Done: out/minikube-linux-arm64 start -p docker-network-689830 --network=: (40.411206634s)
kic_custom_network_test.go:150: (dbg) Run:  docker network ls --format {{.Name}}
helpers_test.go:175: Cleaning up "docker-network-689830" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-arm64 delete -p docker-network-689830
helpers_test.go:178: (dbg) Done: out/minikube-linux-arm64 delete -p docker-network-689830: (2.070674301s)
--- PASS: TestKicCustomNetwork/create_custom_network (42.51s)

                                                
                                    
x
+
TestKicCustomNetwork/use_default_bridge_network (33.71s)

                                                
                                                
=== RUN   TestKicCustomNetwork/use_default_bridge_network
kic_custom_network_test.go:57: (dbg) Run:  out/minikube-linux-arm64 start -p docker-network-939657 --network=bridge
kic_custom_network_test.go:57: (dbg) Done: out/minikube-linux-arm64 start -p docker-network-939657 --network=bridge: (31.611517719s)
kic_custom_network_test.go:150: (dbg) Run:  docker network ls --format {{.Name}}
helpers_test.go:175: Cleaning up "docker-network-939657" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-arm64 delete -p docker-network-939657
helpers_test.go:178: (dbg) Done: out/minikube-linux-arm64 delete -p docker-network-939657: (2.044294013s)
--- PASS: TestKicCustomNetwork/use_default_bridge_network (33.71s)

                                                
                                    
x
+
TestKicExistingNetwork (32.7s)

                                                
                                                
=== RUN   TestKicExistingNetwork
kic_custom_network_test.go:150: (dbg) Run:  docker network ls --format {{.Name}}
kic_custom_network_test.go:93: (dbg) Run:  out/minikube-linux-arm64 start -p existing-network-266170 --network=existing-network
kic_custom_network_test.go:93: (dbg) Done: out/minikube-linux-arm64 start -p existing-network-266170 --network=existing-network: (30.526132631s)
helpers_test.go:175: Cleaning up "existing-network-266170" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-arm64 delete -p existing-network-266170
helpers_test.go:178: (dbg) Done: out/minikube-linux-arm64 delete -p existing-network-266170: (2.000584701s)
--- PASS: TestKicExistingNetwork (32.70s)

                                                
                                    
x
+
TestKicCustomSubnet (34.53s)

                                                
                                                
=== RUN   TestKicCustomSubnet
kic_custom_network_test.go:112: (dbg) Run:  out/minikube-linux-arm64 start -p custom-subnet-190480 --subnet=192.168.60.0/24
kic_custom_network_test.go:112: (dbg) Done: out/minikube-linux-arm64 start -p custom-subnet-190480 --subnet=192.168.60.0/24: (32.411525797s)
kic_custom_network_test.go:161: (dbg) Run:  docker network inspect custom-subnet-190480 --format "{{(index .IPAM.Config 0).Subnet}}"
helpers_test.go:175: Cleaning up "custom-subnet-190480" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-arm64 delete -p custom-subnet-190480
helpers_test.go:178: (dbg) Done: out/minikube-linux-arm64 delete -p custom-subnet-190480: (2.093137693s)
--- PASS: TestKicCustomSubnet (34.53s)

                                                
                                    
x
+
TestKicStaticIP (34.59s)

                                                
                                                
=== RUN   TestKicStaticIP
kic_custom_network_test.go:132: (dbg) Run:  out/minikube-linux-arm64 start -p static-ip-360833 --static-ip=192.168.200.200
E0812 12:49:12.758867 1004370 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19411-998978/.minikube/profiles/functional-986276/client.crt: no such file or directory
kic_custom_network_test.go:132: (dbg) Done: out/minikube-linux-arm64 start -p static-ip-360833 --static-ip=192.168.200.200: (32.267894079s)
kic_custom_network_test.go:138: (dbg) Run:  out/minikube-linux-arm64 -p static-ip-360833 ip
helpers_test.go:175: Cleaning up "static-ip-360833" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-arm64 delete -p static-ip-360833
helpers_test.go:178: (dbg) Done: out/minikube-linux-arm64 delete -p static-ip-360833: (2.177725668s)
--- PASS: TestKicStaticIP (34.59s)

                                                
                                    
x
+
TestMainNoArgs (0.05s)

                                                
                                                
=== RUN   TestMainNoArgs
main_test.go:68: (dbg) Run:  out/minikube-linux-arm64
--- PASS: TestMainNoArgs (0.05s)

                                                
                                    
x
+
TestMinikubeProfile (69.64s)

                                                
                                                
=== RUN   TestMinikubeProfile
minikube_profile_test.go:44: (dbg) Run:  out/minikube-linux-arm64 start -p first-333669 --driver=docker  --container-runtime=containerd
E0812 12:49:43.525335 1004370 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19411-998978/.minikube/profiles/addons-673965/client.crt: no such file or directory
minikube_profile_test.go:44: (dbg) Done: out/minikube-linux-arm64 start -p first-333669 --driver=docker  --container-runtime=containerd: (30.314525077s)
minikube_profile_test.go:44: (dbg) Run:  out/minikube-linux-arm64 start -p second-336886 --driver=docker  --container-runtime=containerd
minikube_profile_test.go:44: (dbg) Done: out/minikube-linux-arm64 start -p second-336886 --driver=docker  --container-runtime=containerd: (33.881521986s)
minikube_profile_test.go:51: (dbg) Run:  out/minikube-linux-arm64 profile first-333669
minikube_profile_test.go:55: (dbg) Run:  out/minikube-linux-arm64 profile list -ojson
minikube_profile_test.go:51: (dbg) Run:  out/minikube-linux-arm64 profile second-336886
minikube_profile_test.go:55: (dbg) Run:  out/minikube-linux-arm64 profile list -ojson
helpers_test.go:175: Cleaning up "second-336886" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-arm64 delete -p second-336886
helpers_test.go:178: (dbg) Done: out/minikube-linux-arm64 delete -p second-336886: (1.968830341s)
helpers_test.go:175: Cleaning up "first-333669" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-arm64 delete -p first-333669
helpers_test.go:178: (dbg) Done: out/minikube-linux-arm64 delete -p first-333669: (2.233305127s)
--- PASS: TestMinikubeProfile (69.64s)

                                                
                                    
x
+
TestMountStart/serial/StartWithMountFirst (6.48s)

                                                
                                                
=== RUN   TestMountStart/serial/StartWithMountFirst
mount_start_test.go:98: (dbg) Run:  out/minikube-linux-arm64 start -p mount-start-1-752267 --memory=2048 --mount --mount-gid 0 --mount-msize 6543 --mount-port 46464 --mount-uid 0 --no-kubernetes --driver=docker  --container-runtime=containerd
mount_start_test.go:98: (dbg) Done: out/minikube-linux-arm64 start -p mount-start-1-752267 --memory=2048 --mount --mount-gid 0 --mount-msize 6543 --mount-port 46464 --mount-uid 0 --no-kubernetes --driver=docker  --container-runtime=containerd: (5.477644028s)
--- PASS: TestMountStart/serial/StartWithMountFirst (6.48s)

                                                
                                    
x
+
TestMountStart/serial/VerifyMountFirst (0.27s)

                                                
                                                
=== RUN   TestMountStart/serial/VerifyMountFirst
mount_start_test.go:114: (dbg) Run:  out/minikube-linux-arm64 -p mount-start-1-752267 ssh -- ls /minikube-host
--- PASS: TestMountStart/serial/VerifyMountFirst (0.27s)

                                                
                                    
x
+
TestMountStart/serial/StartWithMountSecond (9.05s)

                                                
                                                
=== RUN   TestMountStart/serial/StartWithMountSecond
mount_start_test.go:98: (dbg) Run:  out/minikube-linux-arm64 start -p mount-start-2-766617 --memory=2048 --mount --mount-gid 0 --mount-msize 6543 --mount-port 46465 --mount-uid 0 --no-kubernetes --driver=docker  --container-runtime=containerd
mount_start_test.go:98: (dbg) Done: out/minikube-linux-arm64 start -p mount-start-2-766617 --memory=2048 --mount --mount-gid 0 --mount-msize 6543 --mount-port 46465 --mount-uid 0 --no-kubernetes --driver=docker  --container-runtime=containerd: (8.054536286s)
--- PASS: TestMountStart/serial/StartWithMountSecond (9.05s)

                                                
                                    
x
+
TestMountStart/serial/VerifyMountSecond (0.27s)

                                                
                                                
=== RUN   TestMountStart/serial/VerifyMountSecond
mount_start_test.go:114: (dbg) Run:  out/minikube-linux-arm64 -p mount-start-2-766617 ssh -- ls /minikube-host
--- PASS: TestMountStart/serial/VerifyMountSecond (0.27s)

                                                
                                    
x
+
TestMountStart/serial/DeleteFirst (1.63s)

                                                
                                                
=== RUN   TestMountStart/serial/DeleteFirst
pause_test.go:132: (dbg) Run:  out/minikube-linux-arm64 delete -p mount-start-1-752267 --alsologtostderr -v=5
pause_test.go:132: (dbg) Done: out/minikube-linux-arm64 delete -p mount-start-1-752267 --alsologtostderr -v=5: (1.630411113s)
--- PASS: TestMountStart/serial/DeleteFirst (1.63s)

                                                
                                    
x
+
TestMountStart/serial/VerifyMountPostDelete (0.28s)

                                                
                                                
=== RUN   TestMountStart/serial/VerifyMountPostDelete
mount_start_test.go:114: (dbg) Run:  out/minikube-linux-arm64 -p mount-start-2-766617 ssh -- ls /minikube-host
--- PASS: TestMountStart/serial/VerifyMountPostDelete (0.28s)

                                                
                                    
x
+
TestMountStart/serial/Stop (1.23s)

                                                
                                                
=== RUN   TestMountStart/serial/Stop
mount_start_test.go:155: (dbg) Run:  out/minikube-linux-arm64 stop -p mount-start-2-766617
mount_start_test.go:155: (dbg) Done: out/minikube-linux-arm64 stop -p mount-start-2-766617: (1.227505314s)
--- PASS: TestMountStart/serial/Stop (1.23s)

                                                
                                    
x
+
TestMountStart/serial/RestartStopped (7.75s)

                                                
                                                
=== RUN   TestMountStart/serial/RestartStopped
mount_start_test.go:166: (dbg) Run:  out/minikube-linux-arm64 start -p mount-start-2-766617
mount_start_test.go:166: (dbg) Done: out/minikube-linux-arm64 start -p mount-start-2-766617: (6.747078721s)
--- PASS: TestMountStart/serial/RestartStopped (7.75s)

                                                
                                    
x
+
TestMountStart/serial/VerifyMountPostStop (0.28s)

                                                
                                                
=== RUN   TestMountStart/serial/VerifyMountPostStop
mount_start_test.go:114: (dbg) Run:  out/minikube-linux-arm64 -p mount-start-2-766617 ssh -- ls /minikube-host
--- PASS: TestMountStart/serial/VerifyMountPostStop (0.28s)

                                                
                                    
x
+
TestMultiNode/serial/FreshStart2Nodes (76.75s)

                                                
                                                
=== RUN   TestMultiNode/serial/FreshStart2Nodes
multinode_test.go:96: (dbg) Run:  out/minikube-linux-arm64 start -p multinode-447639 --wait=true --memory=2200 --nodes=2 -v=8 --alsologtostderr --driver=docker  --container-runtime=containerd
E0812 12:51:06.574430 1004370 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19411-998978/.minikube/profiles/addons-673965/client.crt: no such file or directory
multinode_test.go:96: (dbg) Done: out/minikube-linux-arm64 start -p multinode-447639 --wait=true --memory=2200 --nodes=2 -v=8 --alsologtostderr --driver=docker  --container-runtime=containerd: (1m16.218499107s)
multinode_test.go:102: (dbg) Run:  out/minikube-linux-arm64 -p multinode-447639 status --alsologtostderr
--- PASS: TestMultiNode/serial/FreshStart2Nodes (76.75s)

                                                
                                    
x
+
TestMultiNode/serial/DeployApp2Nodes (19.06s)

                                                
                                                
=== RUN   TestMultiNode/serial/DeployApp2Nodes
multinode_test.go:493: (dbg) Run:  out/minikube-linux-arm64 kubectl -p multinode-447639 -- apply -f ./testdata/multinodes/multinode-pod-dns-test.yaml
multinode_test.go:498: (dbg) Run:  out/minikube-linux-arm64 kubectl -p multinode-447639 -- rollout status deployment/busybox
multinode_test.go:498: (dbg) Done: out/minikube-linux-arm64 kubectl -p multinode-447639 -- rollout status deployment/busybox: (17.0563314s)
multinode_test.go:505: (dbg) Run:  out/minikube-linux-arm64 kubectl -p multinode-447639 -- get pods -o jsonpath='{.items[*].status.podIP}'
multinode_test.go:528: (dbg) Run:  out/minikube-linux-arm64 kubectl -p multinode-447639 -- get pods -o jsonpath='{.items[*].metadata.name}'
multinode_test.go:536: (dbg) Run:  out/minikube-linux-arm64 kubectl -p multinode-447639 -- exec busybox-fc5497c4f-cnt78 -- nslookup kubernetes.io
multinode_test.go:536: (dbg) Run:  out/minikube-linux-arm64 kubectl -p multinode-447639 -- exec busybox-fc5497c4f-d4bcz -- nslookup kubernetes.io
multinode_test.go:546: (dbg) Run:  out/minikube-linux-arm64 kubectl -p multinode-447639 -- exec busybox-fc5497c4f-cnt78 -- nslookup kubernetes.default
multinode_test.go:546: (dbg) Run:  out/minikube-linux-arm64 kubectl -p multinode-447639 -- exec busybox-fc5497c4f-d4bcz -- nslookup kubernetes.default
multinode_test.go:554: (dbg) Run:  out/minikube-linux-arm64 kubectl -p multinode-447639 -- exec busybox-fc5497c4f-cnt78 -- nslookup kubernetes.default.svc.cluster.local
multinode_test.go:554: (dbg) Run:  out/minikube-linux-arm64 kubectl -p multinode-447639 -- exec busybox-fc5497c4f-d4bcz -- nslookup kubernetes.default.svc.cluster.local
--- PASS: TestMultiNode/serial/DeployApp2Nodes (19.06s)

                                                
                                    
x
+
TestMultiNode/serial/PingHostFrom2Pods (0.98s)

                                                
                                                
=== RUN   TestMultiNode/serial/PingHostFrom2Pods
multinode_test.go:564: (dbg) Run:  out/minikube-linux-arm64 kubectl -p multinode-447639 -- get pods -o jsonpath='{.items[*].metadata.name}'
multinode_test.go:572: (dbg) Run:  out/minikube-linux-arm64 kubectl -p multinode-447639 -- exec busybox-fc5497c4f-cnt78 -- sh -c "nslookup host.minikube.internal | awk 'NR==5' | cut -d' ' -f3"
multinode_test.go:583: (dbg) Run:  out/minikube-linux-arm64 kubectl -p multinode-447639 -- exec busybox-fc5497c4f-cnt78 -- sh -c "ping -c 1 192.168.58.1"
multinode_test.go:572: (dbg) Run:  out/minikube-linux-arm64 kubectl -p multinode-447639 -- exec busybox-fc5497c4f-d4bcz -- sh -c "nslookup host.minikube.internal | awk 'NR==5' | cut -d' ' -f3"
multinode_test.go:583: (dbg) Run:  out/minikube-linux-arm64 kubectl -p multinode-447639 -- exec busybox-fc5497c4f-d4bcz -- sh -c "ping -c 1 192.168.58.1"
--- PASS: TestMultiNode/serial/PingHostFrom2Pods (0.98s)

                                                
                                    
x
+
TestMultiNode/serial/AddNode (19.75s)

                                                
                                                
=== RUN   TestMultiNode/serial/AddNode
multinode_test.go:121: (dbg) Run:  out/minikube-linux-arm64 node add -p multinode-447639 -v 3 --alsologtostderr
multinode_test.go:121: (dbg) Done: out/minikube-linux-arm64 node add -p multinode-447639 -v 3 --alsologtostderr: (18.909580204s)
multinode_test.go:127: (dbg) Run:  out/minikube-linux-arm64 -p multinode-447639 status --alsologtostderr
--- PASS: TestMultiNode/serial/AddNode (19.75s)

                                                
                                    
x
+
TestMultiNode/serial/MultiNodeLabels (0.1s)

                                                
                                                
=== RUN   TestMultiNode/serial/MultiNodeLabels
multinode_test.go:221: (dbg) Run:  kubectl --context multinode-447639 get nodes -o "jsonpath=[{range .items[*]}{.metadata.labels},{end}]"
--- PASS: TestMultiNode/serial/MultiNodeLabels (0.10s)

                                                
                                    
x
+
TestMultiNode/serial/ProfileList (0.39s)

                                                
                                                
=== RUN   TestMultiNode/serial/ProfileList
multinode_test.go:143: (dbg) Run:  out/minikube-linux-arm64 profile list --output json
--- PASS: TestMultiNode/serial/ProfileList (0.39s)

                                                
                                    
x
+
TestMultiNode/serial/CopyFile (10.34s)

                                                
                                                
=== RUN   TestMultiNode/serial/CopyFile
multinode_test.go:184: (dbg) Run:  out/minikube-linux-arm64 -p multinode-447639 status --output json --alsologtostderr
helpers_test.go:556: (dbg) Run:  out/minikube-linux-arm64 -p multinode-447639 cp testdata/cp-test.txt multinode-447639:/home/docker/cp-test.txt
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p multinode-447639 ssh -n multinode-447639 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:556: (dbg) Run:  out/minikube-linux-arm64 -p multinode-447639 cp multinode-447639:/home/docker/cp-test.txt /tmp/TestMultiNodeserialCopyFile3793478463/001/cp-test_multinode-447639.txt
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p multinode-447639 ssh -n multinode-447639 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:556: (dbg) Run:  out/minikube-linux-arm64 -p multinode-447639 cp multinode-447639:/home/docker/cp-test.txt multinode-447639-m02:/home/docker/cp-test_multinode-447639_multinode-447639-m02.txt
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p multinode-447639 ssh -n multinode-447639 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p multinode-447639 ssh -n multinode-447639-m02 "sudo cat /home/docker/cp-test_multinode-447639_multinode-447639-m02.txt"
helpers_test.go:556: (dbg) Run:  out/minikube-linux-arm64 -p multinode-447639 cp multinode-447639:/home/docker/cp-test.txt multinode-447639-m03:/home/docker/cp-test_multinode-447639_multinode-447639-m03.txt
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p multinode-447639 ssh -n multinode-447639 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p multinode-447639 ssh -n multinode-447639-m03 "sudo cat /home/docker/cp-test_multinode-447639_multinode-447639-m03.txt"
helpers_test.go:556: (dbg) Run:  out/minikube-linux-arm64 -p multinode-447639 cp testdata/cp-test.txt multinode-447639-m02:/home/docker/cp-test.txt
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p multinode-447639 ssh -n multinode-447639-m02 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:556: (dbg) Run:  out/minikube-linux-arm64 -p multinode-447639 cp multinode-447639-m02:/home/docker/cp-test.txt /tmp/TestMultiNodeserialCopyFile3793478463/001/cp-test_multinode-447639-m02.txt
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p multinode-447639 ssh -n multinode-447639-m02 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:556: (dbg) Run:  out/minikube-linux-arm64 -p multinode-447639 cp multinode-447639-m02:/home/docker/cp-test.txt multinode-447639:/home/docker/cp-test_multinode-447639-m02_multinode-447639.txt
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p multinode-447639 ssh -n multinode-447639-m02 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p multinode-447639 ssh -n multinode-447639 "sudo cat /home/docker/cp-test_multinode-447639-m02_multinode-447639.txt"
helpers_test.go:556: (dbg) Run:  out/minikube-linux-arm64 -p multinode-447639 cp multinode-447639-m02:/home/docker/cp-test.txt multinode-447639-m03:/home/docker/cp-test_multinode-447639-m02_multinode-447639-m03.txt
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p multinode-447639 ssh -n multinode-447639-m02 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p multinode-447639 ssh -n multinode-447639-m03 "sudo cat /home/docker/cp-test_multinode-447639-m02_multinode-447639-m03.txt"
helpers_test.go:556: (dbg) Run:  out/minikube-linux-arm64 -p multinode-447639 cp testdata/cp-test.txt multinode-447639-m03:/home/docker/cp-test.txt
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p multinode-447639 ssh -n multinode-447639-m03 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:556: (dbg) Run:  out/minikube-linux-arm64 -p multinode-447639 cp multinode-447639-m03:/home/docker/cp-test.txt /tmp/TestMultiNodeserialCopyFile3793478463/001/cp-test_multinode-447639-m03.txt
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p multinode-447639 ssh -n multinode-447639-m03 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:556: (dbg) Run:  out/minikube-linux-arm64 -p multinode-447639 cp multinode-447639-m03:/home/docker/cp-test.txt multinode-447639:/home/docker/cp-test_multinode-447639-m03_multinode-447639.txt
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p multinode-447639 ssh -n multinode-447639-m03 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p multinode-447639 ssh -n multinode-447639 "sudo cat /home/docker/cp-test_multinode-447639-m03_multinode-447639.txt"
helpers_test.go:556: (dbg) Run:  out/minikube-linux-arm64 -p multinode-447639 cp multinode-447639-m03:/home/docker/cp-test.txt multinode-447639-m02:/home/docker/cp-test_multinode-447639-m03_multinode-447639-m02.txt
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p multinode-447639 ssh -n multinode-447639-m03 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p multinode-447639 ssh -n multinode-447639-m02 "sudo cat /home/docker/cp-test_multinode-447639-m03_multinode-447639-m02.txt"
--- PASS: TestMultiNode/serial/CopyFile (10.34s)

                                                
                                    
x
+
TestMultiNode/serial/StopNode (2.31s)

                                                
                                                
=== RUN   TestMultiNode/serial/StopNode
multinode_test.go:248: (dbg) Run:  out/minikube-linux-arm64 -p multinode-447639 node stop m03
multinode_test.go:248: (dbg) Done: out/minikube-linux-arm64 -p multinode-447639 node stop m03: (1.221478184s)
multinode_test.go:254: (dbg) Run:  out/minikube-linux-arm64 -p multinode-447639 status
multinode_test.go:254: (dbg) Non-zero exit: out/minikube-linux-arm64 -p multinode-447639 status: exit status 7 (564.085144ms)

                                                
                                                
-- stdout --
	multinode-447639
	type: Control Plane
	host: Running
	kubelet: Running
	apiserver: Running
	kubeconfig: Configured
	
	multinode-447639-m02
	type: Worker
	host: Running
	kubelet: Running
	
	multinode-447639-m03
	type: Worker
	host: Stopped
	kubelet: Stopped
	

                                                
                                                
-- /stdout --
multinode_test.go:261: (dbg) Run:  out/minikube-linux-arm64 -p multinode-447639 status --alsologtostderr
multinode_test.go:261: (dbg) Non-zero exit: out/minikube-linux-arm64 -p multinode-447639 status --alsologtostderr: exit status 7 (527.263729ms)

                                                
                                                
-- stdout --
	multinode-447639
	type: Control Plane
	host: Running
	kubelet: Running
	apiserver: Running
	kubeconfig: Configured
	
	multinode-447639-m02
	type: Worker
	host: Running
	kubelet: Running
	
	multinode-447639-m03
	type: Worker
	host: Stopped
	kubelet: Stopped
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0812 12:53:14.112091 1126679 out.go:291] Setting OutFile to fd 1 ...
	I0812 12:53:14.112264 1126679 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0812 12:53:14.112276 1126679 out.go:304] Setting ErrFile to fd 2...
	I0812 12:53:14.112281 1126679 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0812 12:53:14.112671 1126679 root.go:338] Updating PATH: /home/jenkins/minikube-integration/19411-998978/.minikube/bin
	I0812 12:53:14.112900 1126679 out.go:298] Setting JSON to false
	I0812 12:53:14.112957 1126679 mustload.go:65] Loading cluster: multinode-447639
	I0812 12:53:14.113070 1126679 notify.go:220] Checking for updates...
	I0812 12:53:14.113427 1126679 config.go:182] Loaded profile config "multinode-447639": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.30.3
	I0812 12:53:14.113441 1126679 status.go:255] checking status of multinode-447639 ...
	I0812 12:53:14.114276 1126679 cli_runner.go:164] Run: docker container inspect multinode-447639 --format={{.State.Status}}
	I0812 12:53:14.133480 1126679 status.go:330] multinode-447639 host status = "Running" (err=<nil>)
	I0812 12:53:14.133511 1126679 host.go:66] Checking if "multinode-447639" exists ...
	I0812 12:53:14.133815 1126679 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" multinode-447639
	I0812 12:53:14.162563 1126679 host.go:66] Checking if "multinode-447639" exists ...
	I0812 12:53:14.162952 1126679 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
	I0812 12:53:14.162997 1126679 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" multinode-447639
	I0812 12:53:14.181115 1126679 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:34034 SSHKeyPath:/home/jenkins/minikube-integration/19411-998978/.minikube/machines/multinode-447639/id_rsa Username:docker}
	I0812 12:53:14.279137 1126679 ssh_runner.go:195] Run: systemctl --version
	I0812 12:53:14.284017 1126679 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
	I0812 12:53:14.296321 1126679 cli_runner.go:164] Run: docker system info --format "{{json .}}"
	I0812 12:53:14.355728 1126679 info.go:266] docker info: {ID:6ZPO:QZND:VNGE:LUKL:4Y3K:XELL:AAX4:2GTK:E6LM:MPRN:3ZXR:TTMR Containers:3 ContainersRunning:2 ContainersPaused:0 ContainersStopped:1 Images:3 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:41 OomKillDisable:true NGoroutines:61 SystemTime:2024-08-12 12:53:14.345701799 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1066-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Architecture:aar
ch64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8214896640 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-30-239 Labels:[] ExperimentalBuild:false ServerVersion:27.1.1 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:2bf793ef6dc9a18e00cb12efb64355c2c9d5eb41 Expected:2bf793ef6dc9a18e00cb12efb64355c2c9d5eb41} RuncCommit:{ID:v1.1.13-0-g58aa920 Expected:v1.1.13-0-g58aa920} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:<nil> ServerErro
rs:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.16.1] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.29.1]] Warnings:<nil>}}
	I0812 12:53:14.356403 1126679 kubeconfig.go:125] found "multinode-447639" server: "https://192.168.58.2:8443"
	I0812 12:53:14.356433 1126679 api_server.go:166] Checking apiserver status ...
	I0812 12:53:14.356479 1126679 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0812 12:53:14.368326 1126679 ssh_runner.go:195] Run: sudo egrep ^[0-9]+:freezer: /proc/1503/cgroup
	I0812 12:53:14.378498 1126679 api_server.go:182] apiserver freezer: "13:freezer:/docker/60e6cc6a2e5acb696ae431ffe210bfc377f192aa4f7bd28228f3b41062855c58/kubepods/burstable/poddccabfece6ebb0f8c846b8f4a39f2523/8deb4f11c64939d5efc091a900c8c82469f2413619bc25a5c18077d20a63b574"
	I0812 12:53:14.378584 1126679 ssh_runner.go:195] Run: sudo cat /sys/fs/cgroup/freezer/docker/60e6cc6a2e5acb696ae431ffe210bfc377f192aa4f7bd28228f3b41062855c58/kubepods/burstable/poddccabfece6ebb0f8c846b8f4a39f2523/8deb4f11c64939d5efc091a900c8c82469f2413619bc25a5c18077d20a63b574/freezer.state
	I0812 12:53:14.387943 1126679 api_server.go:204] freezer state: "THAWED"
	I0812 12:53:14.387984 1126679 api_server.go:253] Checking apiserver healthz at https://192.168.58.2:8443/healthz ...
	I0812 12:53:14.395694 1126679 api_server.go:279] https://192.168.58.2:8443/healthz returned 200:
	ok
	I0812 12:53:14.395724 1126679 status.go:422] multinode-447639 apiserver status = Running (err=<nil>)
	I0812 12:53:14.395735 1126679 status.go:257] multinode-447639 status: &{Name:multinode-447639 Host:Running Kubelet:Running APIServer:Running Kubeconfig:Configured Worker:false TimeToStop: DockerEnv: PodManEnv:}
	I0812 12:53:14.395753 1126679 status.go:255] checking status of multinode-447639-m02 ...
	I0812 12:53:14.396066 1126679 cli_runner.go:164] Run: docker container inspect multinode-447639-m02 --format={{.State.Status}}
	I0812 12:53:14.413388 1126679 status.go:330] multinode-447639-m02 host status = "Running" (err=<nil>)
	I0812 12:53:14.413422 1126679 host.go:66] Checking if "multinode-447639-m02" exists ...
	I0812 12:53:14.413733 1126679 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" multinode-447639-m02
	I0812 12:53:14.430815 1126679 host.go:66] Checking if "multinode-447639-m02" exists ...
	I0812 12:53:14.431200 1126679 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
	I0812 12:53:14.431291 1126679 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" multinode-447639-m02
	I0812 12:53:14.452831 1126679 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:34039 SSHKeyPath:/home/jenkins/minikube-integration/19411-998978/.minikube/machines/multinode-447639-m02/id_rsa Username:docker}
	I0812 12:53:14.550608 1126679 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
	I0812 12:53:14.562556 1126679 status.go:257] multinode-447639-m02 status: &{Name:multinode-447639-m02 Host:Running Kubelet:Running APIServer:Irrelevant Kubeconfig:Irrelevant Worker:true TimeToStop: DockerEnv: PodManEnv:}
	I0812 12:53:14.562589 1126679 status.go:255] checking status of multinode-447639-m03 ...
	I0812 12:53:14.562884 1126679 cli_runner.go:164] Run: docker container inspect multinode-447639-m03 --format={{.State.Status}}
	I0812 12:53:14.581431 1126679 status.go:330] multinode-447639-m03 host status = "Stopped" (err=<nil>)
	I0812 12:53:14.581457 1126679 status.go:343] host is not running, skipping remaining checks
	I0812 12:53:14.581465 1126679 status.go:257] multinode-447639-m03 status: &{Name:multinode-447639-m03 Host:Stopped Kubelet:Stopped APIServer:Stopped Kubeconfig:Stopped Worker:true TimeToStop: DockerEnv: PodManEnv:}

                                                
                                                
** /stderr **
--- PASS: TestMultiNode/serial/StopNode (2.31s)

                                                
                                    
x
+
TestMultiNode/serial/StartAfterStop (10.1s)

                                                
                                                
=== RUN   TestMultiNode/serial/StartAfterStop
multinode_test.go:282: (dbg) Run:  out/minikube-linux-arm64 -p multinode-447639 node start m03 -v=7 --alsologtostderr
multinode_test.go:282: (dbg) Done: out/minikube-linux-arm64 -p multinode-447639 node start m03 -v=7 --alsologtostderr: (9.288471908s)
multinode_test.go:290: (dbg) Run:  out/minikube-linux-arm64 -p multinode-447639 status -v=7 --alsologtostderr
multinode_test.go:306: (dbg) Run:  kubectl get nodes
--- PASS: TestMultiNode/serial/StartAfterStop (10.10s)

                                                
                                    
x
+
TestMultiNode/serial/RestartKeepsNodes (81.96s)

                                                
                                                
=== RUN   TestMultiNode/serial/RestartKeepsNodes
multinode_test.go:314: (dbg) Run:  out/minikube-linux-arm64 node list -p multinode-447639
multinode_test.go:321: (dbg) Run:  out/minikube-linux-arm64 stop -p multinode-447639
multinode_test.go:321: (dbg) Done: out/minikube-linux-arm64 stop -p multinode-447639: (25.021352339s)
multinode_test.go:326: (dbg) Run:  out/minikube-linux-arm64 start -p multinode-447639 --wait=true -v=8 --alsologtostderr
E0812 12:54:12.757022 1004370 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19411-998978/.minikube/profiles/functional-986276/client.crt: no such file or directory
E0812 12:54:43.524977 1004370 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19411-998978/.minikube/profiles/addons-673965/client.crt: no such file or directory
multinode_test.go:326: (dbg) Done: out/minikube-linux-arm64 start -p multinode-447639 --wait=true -v=8 --alsologtostderr: (56.79167155s)
multinode_test.go:331: (dbg) Run:  out/minikube-linux-arm64 node list -p multinode-447639
--- PASS: TestMultiNode/serial/RestartKeepsNodes (81.96s)

                                                
                                    
x
+
TestMultiNode/serial/DeleteNode (5.55s)

                                                
                                                
=== RUN   TestMultiNode/serial/DeleteNode
multinode_test.go:416: (dbg) Run:  out/minikube-linux-arm64 -p multinode-447639 node delete m03
multinode_test.go:416: (dbg) Done: out/minikube-linux-arm64 -p multinode-447639 node delete m03: (4.863636036s)
multinode_test.go:422: (dbg) Run:  out/minikube-linux-arm64 -p multinode-447639 status --alsologtostderr
multinode_test.go:436: (dbg) Run:  kubectl get nodes
multinode_test.go:444: (dbg) Run:  kubectl get nodes -o "go-template='{{range .items}}{{range .status.conditions}}{{if eq .type "Ready"}} {{.status}}{{"\n"}}{{end}}{{end}}{{end}}'"
--- PASS: TestMultiNode/serial/DeleteNode (5.55s)

                                                
                                    
x
+
TestMultiNode/serial/StopMultiNode (24s)

                                                
                                                
=== RUN   TestMultiNode/serial/StopMultiNode
multinode_test.go:345: (dbg) Run:  out/minikube-linux-arm64 -p multinode-447639 stop
multinode_test.go:345: (dbg) Done: out/minikube-linux-arm64 -p multinode-447639 stop: (23.797933578s)
multinode_test.go:351: (dbg) Run:  out/minikube-linux-arm64 -p multinode-447639 status
multinode_test.go:351: (dbg) Non-zero exit: out/minikube-linux-arm64 -p multinode-447639 status: exit status 7 (98.370701ms)

                                                
                                                
-- stdout --
	multinode-447639
	type: Control Plane
	host: Stopped
	kubelet: Stopped
	apiserver: Stopped
	kubeconfig: Stopped
	
	multinode-447639-m02
	type: Worker
	host: Stopped
	kubelet: Stopped
	

                                                
                                                
-- /stdout --
multinode_test.go:358: (dbg) Run:  out/minikube-linux-arm64 -p multinode-447639 status --alsologtostderr
multinode_test.go:358: (dbg) Non-zero exit: out/minikube-linux-arm64 -p multinode-447639 status --alsologtostderr: exit status 7 (99.846938ms)

                                                
                                                
-- stdout --
	multinode-447639
	type: Control Plane
	host: Stopped
	kubelet: Stopped
	apiserver: Stopped
	kubeconfig: Stopped
	
	multinode-447639-m02
	type: Worker
	host: Stopped
	kubelet: Stopped
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0812 12:55:16.137283 1134696 out.go:291] Setting OutFile to fd 1 ...
	I0812 12:55:16.137506 1134696 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0812 12:55:16.137535 1134696 out.go:304] Setting ErrFile to fd 2...
	I0812 12:55:16.137554 1134696 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0812 12:55:16.137833 1134696 root.go:338] Updating PATH: /home/jenkins/minikube-integration/19411-998978/.minikube/bin
	I0812 12:55:16.138070 1134696 out.go:298] Setting JSON to false
	I0812 12:55:16.138146 1134696 mustload.go:65] Loading cluster: multinode-447639
	I0812 12:55:16.138230 1134696 notify.go:220] Checking for updates...
	I0812 12:55:16.139219 1134696 config.go:182] Loaded profile config "multinode-447639": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.30.3
	I0812 12:55:16.139262 1134696 status.go:255] checking status of multinode-447639 ...
	I0812 12:55:16.139801 1134696 cli_runner.go:164] Run: docker container inspect multinode-447639 --format={{.State.Status}}
	I0812 12:55:16.158264 1134696 status.go:330] multinode-447639 host status = "Stopped" (err=<nil>)
	I0812 12:55:16.158288 1134696 status.go:343] host is not running, skipping remaining checks
	I0812 12:55:16.158297 1134696 status.go:257] multinode-447639 status: &{Name:multinode-447639 Host:Stopped Kubelet:Stopped APIServer:Stopped Kubeconfig:Stopped Worker:false TimeToStop: DockerEnv: PodManEnv:}
	I0812 12:55:16.158336 1134696 status.go:255] checking status of multinode-447639-m02 ...
	I0812 12:55:16.158655 1134696 cli_runner.go:164] Run: docker container inspect multinode-447639-m02 --format={{.State.Status}}
	I0812 12:55:16.188722 1134696 status.go:330] multinode-447639-m02 host status = "Stopped" (err=<nil>)
	I0812 12:55:16.188747 1134696 status.go:343] host is not running, skipping remaining checks
	I0812 12:55:16.188755 1134696 status.go:257] multinode-447639-m02 status: &{Name:multinode-447639-m02 Host:Stopped Kubelet:Stopped APIServer:Stopped Kubeconfig:Stopped Worker:true TimeToStop: DockerEnv: PodManEnv:}

                                                
                                                
** /stderr **
--- PASS: TestMultiNode/serial/StopMultiNode (24.00s)

                                                
                                    
x
+
TestMultiNode/serial/RestartMultiNode (54.82s)

                                                
                                                
=== RUN   TestMultiNode/serial/RestartMultiNode
multinode_test.go:376: (dbg) Run:  out/minikube-linux-arm64 start -p multinode-447639 --wait=true -v=8 --alsologtostderr --driver=docker  --container-runtime=containerd
E0812 12:55:35.801793 1004370 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19411-998978/.minikube/profiles/functional-986276/client.crt: no such file or directory
multinode_test.go:376: (dbg) Done: out/minikube-linux-arm64 start -p multinode-447639 --wait=true -v=8 --alsologtostderr --driver=docker  --container-runtime=containerd: (54.109339821s)
multinode_test.go:382: (dbg) Run:  out/minikube-linux-arm64 -p multinode-447639 status --alsologtostderr
multinode_test.go:396: (dbg) Run:  kubectl get nodes
multinode_test.go:404: (dbg) Run:  kubectl get nodes -o "go-template='{{range .items}}{{range .status.conditions}}{{if eq .type "Ready"}} {{.status}}{{"\n"}}{{end}}{{end}}{{end}}'"
--- PASS: TestMultiNode/serial/RestartMultiNode (54.82s)

                                                
                                    
x
+
TestMultiNode/serial/ValidateNameConflict (35.96s)

                                                
                                                
=== RUN   TestMultiNode/serial/ValidateNameConflict
multinode_test.go:455: (dbg) Run:  out/minikube-linux-arm64 node list -p multinode-447639
multinode_test.go:464: (dbg) Run:  out/minikube-linux-arm64 start -p multinode-447639-m02 --driver=docker  --container-runtime=containerd
multinode_test.go:464: (dbg) Non-zero exit: out/minikube-linux-arm64 start -p multinode-447639-m02 --driver=docker  --container-runtime=containerd: exit status 14 (104.945247ms)

                                                
                                                
-- stdout --
	* [multinode-447639-m02] minikube v1.33.1 on Ubuntu 20.04 (arm64)
	  - MINIKUBE_LOCATION=19411
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - KUBECONFIG=/home/jenkins/minikube-integration/19411-998978/kubeconfig
	  - MINIKUBE_HOME=/home/jenkins/minikube-integration/19411-998978/.minikube
	  - MINIKUBE_BIN=out/minikube-linux-arm64
	  - MINIKUBE_FORCE_SYSTEMD=
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	! Profile name 'multinode-447639-m02' is duplicated with machine name 'multinode-447639-m02' in profile 'multinode-447639'
	X Exiting due to MK_USAGE: Profile name should be unique

                                                
                                                
** /stderr **
multinode_test.go:472: (dbg) Run:  out/minikube-linux-arm64 start -p multinode-447639-m03 --driver=docker  --container-runtime=containerd
multinode_test.go:472: (dbg) Done: out/minikube-linux-arm64 start -p multinode-447639-m03 --driver=docker  --container-runtime=containerd: (33.349123186s)
multinode_test.go:479: (dbg) Run:  out/minikube-linux-arm64 node add -p multinode-447639
multinode_test.go:479: (dbg) Non-zero exit: out/minikube-linux-arm64 node add -p multinode-447639: exit status 80 (318.118471ms)

                                                
                                                
-- stdout --
	* Adding node m03 to cluster multinode-447639 as [worker]
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	X Exiting due to GUEST_NODE_ADD: failed to add node: Node multinode-447639-m03 already exists in multinode-447639-m03 profile
	* 
	╭─────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                             │
	│    * If the above advice does not help, please let us know:                                 │
	│      https://github.com/kubernetes/minikube/issues/new/choose                               │
	│                                                                                             │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │
	│    * Please also attach the following file to the GitHub issue:                             │
	│    * - /tmp/minikube_node_040ea7097fd6ed71e65be9a474587f81f0ccd21d_1.log                    │
	│                                                                                             │
	╰─────────────────────────────────────────────────────────────────────────────────────────────╯

                                                
                                                
** /stderr **
multinode_test.go:484: (dbg) Run:  out/minikube-linux-arm64 delete -p multinode-447639-m03
multinode_test.go:484: (dbg) Done: out/minikube-linux-arm64 delete -p multinode-447639-m03: (2.132296532s)
--- PASS: TestMultiNode/serial/ValidateNameConflict (35.96s)

                                                
                                    
x
+
TestPreload (115.01s)

                                                
                                                
=== RUN   TestPreload
preload_test.go:44: (dbg) Run:  out/minikube-linux-arm64 start -p test-preload-824212 --memory=2200 --alsologtostderr --wait=true --preload=false --driver=docker  --container-runtime=containerd --kubernetes-version=v1.24.4
preload_test.go:44: (dbg) Done: out/minikube-linux-arm64 start -p test-preload-824212 --memory=2200 --alsologtostderr --wait=true --preload=false --driver=docker  --container-runtime=containerd --kubernetes-version=v1.24.4: (1m18.261069637s)
preload_test.go:52: (dbg) Run:  out/minikube-linux-arm64 -p test-preload-824212 image pull gcr.io/k8s-minikube/busybox
preload_test.go:52: (dbg) Done: out/minikube-linux-arm64 -p test-preload-824212 image pull gcr.io/k8s-minikube/busybox: (1.192505969s)
preload_test.go:58: (dbg) Run:  out/minikube-linux-arm64 stop -p test-preload-824212
preload_test.go:58: (dbg) Done: out/minikube-linux-arm64 stop -p test-preload-824212: (12.056403536s)
preload_test.go:66: (dbg) Run:  out/minikube-linux-arm64 start -p test-preload-824212 --memory=2200 --alsologtostderr -v=1 --wait=true --driver=docker  --container-runtime=containerd
preload_test.go:66: (dbg) Done: out/minikube-linux-arm64 start -p test-preload-824212 --memory=2200 --alsologtostderr -v=1 --wait=true --driver=docker  --container-runtime=containerd: (20.457242593s)
preload_test.go:71: (dbg) Run:  out/minikube-linux-arm64 -p test-preload-824212 image list
helpers_test.go:175: Cleaning up "test-preload-824212" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-arm64 delete -p test-preload-824212
helpers_test.go:178: (dbg) Done: out/minikube-linux-arm64 delete -p test-preload-824212: (2.642558722s)
--- PASS: TestPreload (115.01s)

                                                
                                    
x
+
TestScheduledStopUnix (107.18s)

                                                
                                                
=== RUN   TestScheduledStopUnix
scheduled_stop_test.go:128: (dbg) Run:  out/minikube-linux-arm64 start -p scheduled-stop-882075 --memory=2048 --driver=docker  --container-runtime=containerd
E0812 12:59:12.758856 1004370 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19411-998978/.minikube/profiles/functional-986276/client.crt: no such file or directory
scheduled_stop_test.go:128: (dbg) Done: out/minikube-linux-arm64 start -p scheduled-stop-882075 --memory=2048 --driver=docker  --container-runtime=containerd: (30.688135899s)
scheduled_stop_test.go:137: (dbg) Run:  out/minikube-linux-arm64 stop -p scheduled-stop-882075 --schedule 5m
scheduled_stop_test.go:191: (dbg) Run:  out/minikube-linux-arm64 status --format={{.TimeToStop}} -p scheduled-stop-882075 -n scheduled-stop-882075
scheduled_stop_test.go:169: signal error was:  <nil>
scheduled_stop_test.go:137: (dbg) Run:  out/minikube-linux-arm64 stop -p scheduled-stop-882075 --schedule 15s
scheduled_stop_test.go:169: signal error was:  os: process already finished
scheduled_stop_test.go:137: (dbg) Run:  out/minikube-linux-arm64 stop -p scheduled-stop-882075 --cancel-scheduled
scheduled_stop_test.go:176: (dbg) Run:  out/minikube-linux-arm64 status --format={{.Host}} -p scheduled-stop-882075 -n scheduled-stop-882075
scheduled_stop_test.go:205: (dbg) Run:  out/minikube-linux-arm64 status -p scheduled-stop-882075
scheduled_stop_test.go:137: (dbg) Run:  out/minikube-linux-arm64 stop -p scheduled-stop-882075 --schedule 15s
E0812 12:59:43.525086 1004370 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19411-998978/.minikube/profiles/addons-673965/client.crt: no such file or directory
scheduled_stop_test.go:169: signal error was:  os: process already finished
scheduled_stop_test.go:205: (dbg) Run:  out/minikube-linux-arm64 status -p scheduled-stop-882075
scheduled_stop_test.go:205: (dbg) Non-zero exit: out/minikube-linux-arm64 status -p scheduled-stop-882075: exit status 7 (72.871152ms)

                                                
                                                
-- stdout --
	scheduled-stop-882075
	type: Control Plane
	host: Stopped
	kubelet: Stopped
	apiserver: Stopped
	kubeconfig: Stopped
	

                                                
                                                
-- /stdout --
scheduled_stop_test.go:176: (dbg) Run:  out/minikube-linux-arm64 status --format={{.Host}} -p scheduled-stop-882075 -n scheduled-stop-882075
scheduled_stop_test.go:176: (dbg) Non-zero exit: out/minikube-linux-arm64 status --format={{.Host}} -p scheduled-stop-882075 -n scheduled-stop-882075: exit status 7 (64.73985ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
scheduled_stop_test.go:176: status error: exit status 7 (may be ok)
helpers_test.go:175: Cleaning up "scheduled-stop-882075" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-arm64 delete -p scheduled-stop-882075
helpers_test.go:178: (dbg) Done: out/minikube-linux-arm64 delete -p scheduled-stop-882075: (4.868128099s)
--- PASS: TestScheduledStopUnix (107.18s)

                                                
                                    
x
+
TestInsufficientStorage (11.08s)

                                                
                                                
=== RUN   TestInsufficientStorage
status_test.go:50: (dbg) Run:  out/minikube-linux-arm64 start -p insufficient-storage-872768 --memory=2048 --output=json --wait=true --driver=docker  --container-runtime=containerd
status_test.go:50: (dbg) Non-zero exit: out/minikube-linux-arm64 start -p insufficient-storage-872768 --memory=2048 --output=json --wait=true --driver=docker  --container-runtime=containerd: exit status 26 (8.489560709s)

                                                
                                                
-- stdout --
	{"specversion":"1.0","id":"27943676-43d0-4f9b-aff1-a89c04b60255","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.step","datacontenttype":"application/json","data":{"currentstep":"0","message":"[insufficient-storage-872768] minikube v1.33.1 on Ubuntu 20.04 (arm64)","name":"Initial Minikube Setup","totalsteps":"19"}}
	{"specversion":"1.0","id":"453accc6-7c36-406d-9428-adab1b68b403","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_LOCATION=19411"}}
	{"specversion":"1.0","id":"339bc4c1-8217-4c35-8213-d375ee45ce3c","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true"}}
	{"specversion":"1.0","id":"d409e45a-33e3-4cc9-b5d4-72effb070ac8","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"KUBECONFIG=/home/jenkins/minikube-integration/19411-998978/kubeconfig"}}
	{"specversion":"1.0","id":"7e233dd2-a180-4ed5-b7a0-5a3ed6496a7d","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_HOME=/home/jenkins/minikube-integration/19411-998978/.minikube"}}
	{"specversion":"1.0","id":"7034c623-2ed5-4105-9b04-5296165bfce6","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_BIN=out/minikube-linux-arm64"}}
	{"specversion":"1.0","id":"bf1fed40-335f-43ac-9e83-42701358da92","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_FORCE_SYSTEMD="}}
	{"specversion":"1.0","id":"00cf5b4b-5501-44e5-9393-18673c039cd6","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_TEST_STORAGE_CAPACITY=100"}}
	{"specversion":"1.0","id":"d0c2ffe4-a5ce-4d66-ba3d-fb6d68f190a7","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_TEST_AVAILABLE_STORAGE=19"}}
	{"specversion":"1.0","id":"56297826-0ab4-4aa3-a55f-f610bbacad2e","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.step","datacontenttype":"application/json","data":{"currentstep":"1","message":"Using the docker driver based on user configuration","name":"Selecting Driver","totalsteps":"19"}}
	{"specversion":"1.0","id":"48c2eca1-f000-4279-929d-31483a5bcc5e","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"Using Docker driver with root privileges"}}
	{"specversion":"1.0","id":"fc14fe97-85c0-4104-a50b-9761798cc65e","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.step","datacontenttype":"application/json","data":{"currentstep":"3","message":"Starting \"insufficient-storage-872768\" primary control-plane node in \"insufficient-storage-872768\" cluster","name":"Starting Node","totalsteps":"19"}}
	{"specversion":"1.0","id":"7b60e513-a353-4613-aa2d-288562f34b33","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.step","datacontenttype":"application/json","data":{"currentstep":"5","message":"Pulling base image v0.0.44-1723026928-19389 ...","name":"Pulling Base Image","totalsteps":"19"}}
	{"specversion":"1.0","id":"10546c12-1502-417c-a86c-c5e46b1a4190","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.step","datacontenttype":"application/json","data":{"currentstep":"8","message":"Creating docker container (CPUs=2, Memory=2048MB) ...","name":"Creating Container","totalsteps":"19"}}
	{"specversion":"1.0","id":"a9087c7a-9436-49d9-aef4-7cdfe3af581a","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.error","datacontenttype":"application/json","data":{"advice":"Try one or more of the following to free up space on the device:\n\t\n\t\t\t1. Run \"docker system prune\" to remove unused Docker data (optionally with \"-a\")\n\t\t\t2. Increase the storage allocated to Docker for Desktop by clicking on:\n\t\t\t\tDocker icon \u003e Preferences \u003e Resources \u003e Disk Image Size\n\t\t\t3. Run \"minikube ssh -- docker system prune\" if using the Docker container runtime","exitcode":"26","issues":"https://github.com/kubernetes/minikube/issues/9024","message":"Docker is out of disk space! (/var is at 100%% of capacity). You can pass '--force' to skip this check.","name":"RSRC_DOCKER_STORAGE","url":""}}

                                                
                                                
-- /stdout --
status_test.go:76: (dbg) Run:  out/minikube-linux-arm64 status -p insufficient-storage-872768 --output=json --layout=cluster
status_test.go:76: (dbg) Non-zero exit: out/minikube-linux-arm64 status -p insufficient-storage-872768 --output=json --layout=cluster: exit status 7 (293.539026ms)

                                                
                                                
-- stdout --
	{"Name":"insufficient-storage-872768","StatusCode":507,"StatusName":"InsufficientStorage","StatusDetail":"/var is almost out of disk space","Step":"Creating Container","StepDetail":"Creating docker container (CPUs=2, Memory=2048MB) ...","BinaryVersion":"v1.33.1","Components":{"kubeconfig":{"Name":"kubeconfig","StatusCode":500,"StatusName":"Error"}},"Nodes":[{"Name":"insufficient-storage-872768","StatusCode":507,"StatusName":"InsufficientStorage","Components":{"apiserver":{"Name":"apiserver","StatusCode":405,"StatusName":"Stopped"},"kubelet":{"Name":"kubelet","StatusCode":405,"StatusName":"Stopped"}}}]}

                                                
                                                
-- /stdout --
** stderr ** 
	E0812 13:00:41.936907 1153404 status.go:417] kubeconfig endpoint: get endpoint: "insufficient-storage-872768" does not appear in /home/jenkins/minikube-integration/19411-998978/kubeconfig

                                                
                                                
** /stderr **
status_test.go:76: (dbg) Run:  out/minikube-linux-arm64 status -p insufficient-storage-872768 --output=json --layout=cluster
status_test.go:76: (dbg) Non-zero exit: out/minikube-linux-arm64 status -p insufficient-storage-872768 --output=json --layout=cluster: exit status 7 (339.526111ms)

                                                
                                                
-- stdout --
	{"Name":"insufficient-storage-872768","StatusCode":507,"StatusName":"InsufficientStorage","StatusDetail":"/var is almost out of disk space","BinaryVersion":"v1.33.1","Components":{"kubeconfig":{"Name":"kubeconfig","StatusCode":500,"StatusName":"Error"}},"Nodes":[{"Name":"insufficient-storage-872768","StatusCode":507,"StatusName":"InsufficientStorage","Components":{"apiserver":{"Name":"apiserver","StatusCode":405,"StatusName":"Stopped"},"kubelet":{"Name":"kubelet","StatusCode":405,"StatusName":"Stopped"}}}]}

                                                
                                                
-- /stdout --
** stderr ** 
	E0812 13:00:42.279717 1153464 status.go:417] kubeconfig endpoint: get endpoint: "insufficient-storage-872768" does not appear in /home/jenkins/minikube-integration/19411-998978/kubeconfig
	E0812 13:00:42.292342 1153464 status.go:560] unable to read event log: stat: stat /home/jenkins/minikube-integration/19411-998978/.minikube/profiles/insufficient-storage-872768/events.json: no such file or directory

                                                
                                                
** /stderr **
helpers_test.go:175: Cleaning up "insufficient-storage-872768" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-arm64 delete -p insufficient-storage-872768
helpers_test.go:178: (dbg) Done: out/minikube-linux-arm64 delete -p insufficient-storage-872768: (1.958595112s)
--- PASS: TestInsufficientStorage (11.08s)

                                                
                                    
x
+
TestRunningBinaryUpgrade (96.34s)

                                                
                                                
=== RUN   TestRunningBinaryUpgrade
=== PAUSE TestRunningBinaryUpgrade

                                                
                                                

                                                
                                                
=== CONT  TestRunningBinaryUpgrade
version_upgrade_test.go:120: (dbg) Run:  /tmp/minikube-v1.26.0.2341944055 start -p running-upgrade-849184 --memory=2200 --vm-driver=docker  --container-runtime=containerd
version_upgrade_test.go:120: (dbg) Done: /tmp/minikube-v1.26.0.2341944055 start -p running-upgrade-849184 --memory=2200 --vm-driver=docker  --container-runtime=containerd: (47.408552237s)
version_upgrade_test.go:130: (dbg) Run:  out/minikube-linux-arm64 start -p running-upgrade-849184 --memory=2200 --alsologtostderr -v=1 --driver=docker  --container-runtime=containerd
E0812 13:07:46.575402 1004370 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19411-998978/.minikube/profiles/addons-673965/client.crt: no such file or directory
version_upgrade_test.go:130: (dbg) Done: out/minikube-linux-arm64 start -p running-upgrade-849184 --memory=2200 --alsologtostderr -v=1 --driver=docker  --container-runtime=containerd: (43.937417048s)
helpers_test.go:175: Cleaning up "running-upgrade-849184" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-arm64 delete -p running-upgrade-849184
helpers_test.go:178: (dbg) Done: out/minikube-linux-arm64 delete -p running-upgrade-849184: (3.709820241s)
--- PASS: TestRunningBinaryUpgrade (96.34s)

                                                
                                    
x
+
TestKubernetesUpgrade (359.94s)

                                                
                                                
=== RUN   TestKubernetesUpgrade
=== PAUSE TestKubernetesUpgrade

                                                
                                                

                                                
                                                
=== CONT  TestKubernetesUpgrade
version_upgrade_test.go:222: (dbg) Run:  out/minikube-linux-arm64 start -p kubernetes-upgrade-804304 --memory=2200 --kubernetes-version=v1.20.0 --alsologtostderr -v=1 --driver=docker  --container-runtime=containerd
version_upgrade_test.go:222: (dbg) Done: out/minikube-linux-arm64 start -p kubernetes-upgrade-804304 --memory=2200 --kubernetes-version=v1.20.0 --alsologtostderr -v=1 --driver=docker  --container-runtime=containerd: (59.325872682s)
version_upgrade_test.go:227: (dbg) Run:  out/minikube-linux-arm64 stop -p kubernetes-upgrade-804304
version_upgrade_test.go:227: (dbg) Done: out/minikube-linux-arm64 stop -p kubernetes-upgrade-804304: (1.351079764s)
version_upgrade_test.go:232: (dbg) Run:  out/minikube-linux-arm64 -p kubernetes-upgrade-804304 status --format={{.Host}}
version_upgrade_test.go:232: (dbg) Non-zero exit: out/minikube-linux-arm64 -p kubernetes-upgrade-804304 status --format={{.Host}}: exit status 7 (111.843196ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
version_upgrade_test.go:234: status error: exit status 7 (may be ok)
version_upgrade_test.go:243: (dbg) Run:  out/minikube-linux-arm64 start -p kubernetes-upgrade-804304 --memory=2200 --kubernetes-version=v1.31.0-rc.0 --alsologtostderr -v=1 --driver=docker  --container-runtime=containerd
version_upgrade_test.go:243: (dbg) Done: out/minikube-linux-arm64 start -p kubernetes-upgrade-804304 --memory=2200 --kubernetes-version=v1.31.0-rc.0 --alsologtostderr -v=1 --driver=docker  --container-runtime=containerd: (4m46.274459157s)
version_upgrade_test.go:248: (dbg) Run:  kubectl --context kubernetes-upgrade-804304 version --output=json
version_upgrade_test.go:267: Attempting to downgrade Kubernetes (should fail)
version_upgrade_test.go:269: (dbg) Run:  out/minikube-linux-arm64 start -p kubernetes-upgrade-804304 --memory=2200 --kubernetes-version=v1.20.0 --driver=docker  --container-runtime=containerd
version_upgrade_test.go:269: (dbg) Non-zero exit: out/minikube-linux-arm64 start -p kubernetes-upgrade-804304 --memory=2200 --kubernetes-version=v1.20.0 --driver=docker  --container-runtime=containerd: exit status 106 (143.317819ms)

                                                
                                                
-- stdout --
	* [kubernetes-upgrade-804304] minikube v1.33.1 on Ubuntu 20.04 (arm64)
	  - MINIKUBE_LOCATION=19411
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - KUBECONFIG=/home/jenkins/minikube-integration/19411-998978/kubeconfig
	  - MINIKUBE_HOME=/home/jenkins/minikube-integration/19411-998978/.minikube
	  - MINIKUBE_BIN=out/minikube-linux-arm64
	  - MINIKUBE_FORCE_SYSTEMD=
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	X Exiting due to K8S_DOWNGRADE_UNSUPPORTED: Unable to safely downgrade existing Kubernetes v1.31.0-rc.0 cluster to v1.20.0
	* Suggestion: 
	
	    1) Recreate the cluster with Kubernetes 1.20.0, by running:
	    
	    minikube delete -p kubernetes-upgrade-804304
	    minikube start -p kubernetes-upgrade-804304 --kubernetes-version=v1.20.0
	    
	    2) Create a second cluster with Kubernetes 1.20.0, by running:
	    
	    minikube start -p kubernetes-upgrade-8043042 --kubernetes-version=v1.20.0
	    
	    3) Use the existing cluster at version Kubernetes 1.31.0-rc.0, by running:
	    
	    minikube start -p kubernetes-upgrade-804304 --kubernetes-version=v1.31.0-rc.0
	    

                                                
                                                
** /stderr **
version_upgrade_test.go:273: Attempting restart after unsuccessful downgrade
version_upgrade_test.go:275: (dbg) Run:  out/minikube-linux-arm64 start -p kubernetes-upgrade-804304 --memory=2200 --kubernetes-version=v1.31.0-rc.0 --alsologtostderr -v=1 --driver=docker  --container-runtime=containerd
version_upgrade_test.go:275: (dbg) Done: out/minikube-linux-arm64 start -p kubernetes-upgrade-804304 --memory=2200 --kubernetes-version=v1.31.0-rc.0 --alsologtostderr -v=1 --driver=docker  --container-runtime=containerd: (10.090579354s)
helpers_test.go:175: Cleaning up "kubernetes-upgrade-804304" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-arm64 delete -p kubernetes-upgrade-804304
helpers_test.go:178: (dbg) Done: out/minikube-linux-arm64 delete -p kubernetes-upgrade-804304: (2.376557473s)
--- PASS: TestKubernetesUpgrade (359.94s)

                                                
                                    
x
+
TestMissingContainerUpgrade (166.86s)

                                                
                                                
=== RUN   TestMissingContainerUpgrade
=== PAUSE TestMissingContainerUpgrade

                                                
                                                

                                                
                                                
=== CONT  TestMissingContainerUpgrade
version_upgrade_test.go:309: (dbg) Run:  /tmp/minikube-v1.26.0.119279820 start -p missing-upgrade-858102 --memory=2200 --driver=docker  --container-runtime=containerd
version_upgrade_test.go:309: (dbg) Done: /tmp/minikube-v1.26.0.119279820 start -p missing-upgrade-858102 --memory=2200 --driver=docker  --container-runtime=containerd: (1m26.506050296s)
version_upgrade_test.go:318: (dbg) Run:  docker stop missing-upgrade-858102
version_upgrade_test.go:318: (dbg) Done: docker stop missing-upgrade-858102: (10.319339146s)
version_upgrade_test.go:323: (dbg) Run:  docker rm missing-upgrade-858102
version_upgrade_test.go:329: (dbg) Run:  out/minikube-linux-arm64 start -p missing-upgrade-858102 --memory=2200 --alsologtostderr -v=1 --driver=docker  --container-runtime=containerd
E0812 13:04:12.759771 1004370 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19411-998978/.minikube/profiles/functional-986276/client.crt: no such file or directory
E0812 13:04:43.525398 1004370 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19411-998978/.minikube/profiles/addons-673965/client.crt: no such file or directory
version_upgrade_test.go:329: (dbg) Done: out/minikube-linux-arm64 start -p missing-upgrade-858102 --memory=2200 --alsologtostderr -v=1 --driver=docker  --container-runtime=containerd: (1m6.470059689s)
helpers_test.go:175: Cleaning up "missing-upgrade-858102" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-arm64 delete -p missing-upgrade-858102
helpers_test.go:178: (dbg) Done: out/minikube-linux-arm64 delete -p missing-upgrade-858102: (2.316194473s)
--- PASS: TestMissingContainerUpgrade (166.86s)

                                                
                                    
x
+
TestPause/serial/Start (72.9s)

                                                
                                                
=== RUN   TestPause/serial/Start
pause_test.go:80: (dbg) Run:  out/minikube-linux-arm64 start -p pause-465351 --memory=2048 --install-addons=false --wait=all --driver=docker  --container-runtime=containerd
pause_test.go:80: (dbg) Done: out/minikube-linux-arm64 start -p pause-465351 --memory=2048 --install-addons=false --wait=all --driver=docker  --container-runtime=containerd: (1m12.898642584s)
--- PASS: TestPause/serial/Start (72.90s)

                                                
                                    
x
+
TestNoKubernetes/serial/StartNoK8sWithVersion (0.09s)

                                                
                                                
=== RUN   TestNoKubernetes/serial/StartNoK8sWithVersion
no_kubernetes_test.go:83: (dbg) Run:  out/minikube-linux-arm64 start -p NoKubernetes-151151 --no-kubernetes --kubernetes-version=1.20 --driver=docker  --container-runtime=containerd
no_kubernetes_test.go:83: (dbg) Non-zero exit: out/minikube-linux-arm64 start -p NoKubernetes-151151 --no-kubernetes --kubernetes-version=1.20 --driver=docker  --container-runtime=containerd: exit status 14 (86.670868ms)

                                                
                                                
-- stdout --
	* [NoKubernetes-151151] minikube v1.33.1 on Ubuntu 20.04 (arm64)
	  - MINIKUBE_LOCATION=19411
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - KUBECONFIG=/home/jenkins/minikube-integration/19411-998978/kubeconfig
	  - MINIKUBE_HOME=/home/jenkins/minikube-integration/19411-998978/.minikube
	  - MINIKUBE_BIN=out/minikube-linux-arm64
	  - MINIKUBE_FORCE_SYSTEMD=
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	X Exiting due to MK_USAGE: cannot specify --kubernetes-version with --no-kubernetes,
	to unset a global config run:
	
	$ minikube config unset kubernetes-version

                                                
                                                
** /stderr **
--- PASS: TestNoKubernetes/serial/StartNoK8sWithVersion (0.09s)

                                                
                                    
x
+
TestNoKubernetes/serial/StartWithK8s (45.1s)

                                                
                                                
=== RUN   TestNoKubernetes/serial/StartWithK8s
no_kubernetes_test.go:95: (dbg) Run:  out/minikube-linux-arm64 start -p NoKubernetes-151151 --driver=docker  --container-runtime=containerd
no_kubernetes_test.go:95: (dbg) Done: out/minikube-linux-arm64 start -p NoKubernetes-151151 --driver=docker  --container-runtime=containerd: (44.72027106s)
no_kubernetes_test.go:200: (dbg) Run:  out/minikube-linux-arm64 -p NoKubernetes-151151 status -o json
--- PASS: TestNoKubernetes/serial/StartWithK8s (45.10s)

                                                
                                    
x
+
TestNoKubernetes/serial/StartWithStopK8s (16.82s)

                                                
                                                
=== RUN   TestNoKubernetes/serial/StartWithStopK8s
no_kubernetes_test.go:112: (dbg) Run:  out/minikube-linux-arm64 start -p NoKubernetes-151151 --no-kubernetes --driver=docker  --container-runtime=containerd
no_kubernetes_test.go:112: (dbg) Done: out/minikube-linux-arm64 start -p NoKubernetes-151151 --no-kubernetes --driver=docker  --container-runtime=containerd: (14.49567569s)
no_kubernetes_test.go:200: (dbg) Run:  out/minikube-linux-arm64 -p NoKubernetes-151151 status -o json
no_kubernetes_test.go:200: (dbg) Non-zero exit: out/minikube-linux-arm64 -p NoKubernetes-151151 status -o json: exit status 2 (319.695422ms)

                                                
                                                
-- stdout --
	{"Name":"NoKubernetes-151151","Host":"Running","Kubelet":"Stopped","APIServer":"Stopped","Kubeconfig":"Configured","Worker":false}

                                                
                                                
-- /stdout --
no_kubernetes_test.go:124: (dbg) Run:  out/minikube-linux-arm64 delete -p NoKubernetes-151151
no_kubernetes_test.go:124: (dbg) Done: out/minikube-linux-arm64 delete -p NoKubernetes-151151: (2.001894737s)
--- PASS: TestNoKubernetes/serial/StartWithStopK8s (16.82s)

                                                
                                    
x
+
TestNoKubernetes/serial/Start (5.92s)

                                                
                                                
=== RUN   TestNoKubernetes/serial/Start
no_kubernetes_test.go:136: (dbg) Run:  out/minikube-linux-arm64 start -p NoKubernetes-151151 --no-kubernetes --driver=docker  --container-runtime=containerd
no_kubernetes_test.go:136: (dbg) Done: out/minikube-linux-arm64 start -p NoKubernetes-151151 --no-kubernetes --driver=docker  --container-runtime=containerd: (5.919135727s)
--- PASS: TestNoKubernetes/serial/Start (5.92s)

                                                
                                    
x
+
TestNoKubernetes/serial/VerifyK8sNotRunning (0.31s)

                                                
                                                
=== RUN   TestNoKubernetes/serial/VerifyK8sNotRunning
no_kubernetes_test.go:147: (dbg) Run:  out/minikube-linux-arm64 ssh -p NoKubernetes-151151 "sudo systemctl is-active --quiet service kubelet"
no_kubernetes_test.go:147: (dbg) Non-zero exit: out/minikube-linux-arm64 ssh -p NoKubernetes-151151 "sudo systemctl is-active --quiet service kubelet": exit status 1 (309.830068ms)

                                                
                                                
** stderr ** 
	ssh: Process exited with status 3

                                                
                                                
** /stderr **
--- PASS: TestNoKubernetes/serial/VerifyK8sNotRunning (0.31s)

                                                
                                    
x
+
TestNoKubernetes/serial/ProfileList (1.02s)

                                                
                                                
=== RUN   TestNoKubernetes/serial/ProfileList
no_kubernetes_test.go:169: (dbg) Run:  out/minikube-linux-arm64 profile list
no_kubernetes_test.go:179: (dbg) Run:  out/minikube-linux-arm64 profile list --output=json
--- PASS: TestNoKubernetes/serial/ProfileList (1.02s)

                                                
                                    
x
+
TestNoKubernetes/serial/Stop (1.28s)

                                                
                                                
=== RUN   TestNoKubernetes/serial/Stop
no_kubernetes_test.go:158: (dbg) Run:  out/minikube-linux-arm64 stop -p NoKubernetes-151151
no_kubernetes_test.go:158: (dbg) Done: out/minikube-linux-arm64 stop -p NoKubernetes-151151: (1.276547916s)
--- PASS: TestNoKubernetes/serial/Stop (1.28s)

                                                
                                    
x
+
TestNoKubernetes/serial/StartNoArgs (7.46s)

                                                
                                                
=== RUN   TestNoKubernetes/serial/StartNoArgs
no_kubernetes_test.go:191: (dbg) Run:  out/minikube-linux-arm64 start -p NoKubernetes-151151 --driver=docker  --container-runtime=containerd
no_kubernetes_test.go:191: (dbg) Done: out/minikube-linux-arm64 start -p NoKubernetes-151151 --driver=docker  --container-runtime=containerd: (7.462598264s)
--- PASS: TestNoKubernetes/serial/StartNoArgs (7.46s)

                                                
                                    
x
+
TestPause/serial/SecondStartNoReconfiguration (7.94s)

                                                
                                                
=== RUN   TestPause/serial/SecondStartNoReconfiguration
pause_test.go:92: (dbg) Run:  out/minikube-linux-arm64 start -p pause-465351 --alsologtostderr -v=1 --driver=docker  --container-runtime=containerd
pause_test.go:92: (dbg) Done: out/minikube-linux-arm64 start -p pause-465351 --alsologtostderr -v=1 --driver=docker  --container-runtime=containerd: (7.919750045s)
--- PASS: TestPause/serial/SecondStartNoReconfiguration (7.94s)

                                                
                                    
x
+
TestNoKubernetes/serial/VerifyK8sNotRunningSecond (0.38s)

                                                
                                                
=== RUN   TestNoKubernetes/serial/VerifyK8sNotRunningSecond
no_kubernetes_test.go:147: (dbg) Run:  out/minikube-linux-arm64 ssh -p NoKubernetes-151151 "sudo systemctl is-active --quiet service kubelet"
no_kubernetes_test.go:147: (dbg) Non-zero exit: out/minikube-linux-arm64 ssh -p NoKubernetes-151151 "sudo systemctl is-active --quiet service kubelet": exit status 1 (376.664102ms)

                                                
                                                
** stderr ** 
	ssh: Process exited with status 3

                                                
                                                
** /stderr **
--- PASS: TestNoKubernetes/serial/VerifyK8sNotRunningSecond (0.38s)

                                                
                                    
x
+
TestPause/serial/Pause (0.93s)

                                                
                                                
=== RUN   TestPause/serial/Pause
pause_test.go:110: (dbg) Run:  out/minikube-linux-arm64 pause -p pause-465351 --alsologtostderr -v=5
--- PASS: TestPause/serial/Pause (0.93s)

                                                
                                    
x
+
TestPause/serial/VerifyStatus (0.32s)

                                                
                                                
=== RUN   TestPause/serial/VerifyStatus
status_test.go:76: (dbg) Run:  out/minikube-linux-arm64 status -p pause-465351 --output=json --layout=cluster
status_test.go:76: (dbg) Non-zero exit: out/minikube-linux-arm64 status -p pause-465351 --output=json --layout=cluster: exit status 2 (319.999477ms)

                                                
                                                
-- stdout --
	{"Name":"pause-465351","StatusCode":418,"StatusName":"Paused","Step":"Done","StepDetail":"* Paused 7 containers in: kube-system, kubernetes-dashboard, storage-gluster, istio-operator","BinaryVersion":"v1.33.1","Components":{"kubeconfig":{"Name":"kubeconfig","StatusCode":200,"StatusName":"OK"}},"Nodes":[{"Name":"pause-465351","StatusCode":200,"StatusName":"OK","Components":{"apiserver":{"Name":"apiserver","StatusCode":418,"StatusName":"Paused"},"kubelet":{"Name":"kubelet","StatusCode":405,"StatusName":"Stopped"}}}]}

                                                
                                                
-- /stdout --
--- PASS: TestPause/serial/VerifyStatus (0.32s)

                                                
                                    
x
+
TestPause/serial/Unpause (0.89s)

                                                
                                                
=== RUN   TestPause/serial/Unpause
pause_test.go:121: (dbg) Run:  out/minikube-linux-arm64 unpause -p pause-465351 --alsologtostderr -v=5
--- PASS: TestPause/serial/Unpause (0.89s)

                                                
                                    
x
+
TestPause/serial/PauseAgain (1.34s)

                                                
                                                
=== RUN   TestPause/serial/PauseAgain
pause_test.go:110: (dbg) Run:  out/minikube-linux-arm64 pause -p pause-465351 --alsologtostderr -v=5
pause_test.go:110: (dbg) Done: out/minikube-linux-arm64 pause -p pause-465351 --alsologtostderr -v=5: (1.340734238s)
--- PASS: TestPause/serial/PauseAgain (1.34s)

                                                
                                    
x
+
TestPause/serial/DeletePaused (4.84s)

                                                
                                                
=== RUN   TestPause/serial/DeletePaused
pause_test.go:132: (dbg) Run:  out/minikube-linux-arm64 delete -p pause-465351 --alsologtostderr -v=5
pause_test.go:132: (dbg) Done: out/minikube-linux-arm64 delete -p pause-465351 --alsologtostderr -v=5: (4.839449924s)
--- PASS: TestPause/serial/DeletePaused (4.84s)

                                                
                                    
x
+
TestPause/serial/VerifyDeletedResources (0.15s)

                                                
                                                
=== RUN   TestPause/serial/VerifyDeletedResources
pause_test.go:142: (dbg) Run:  out/minikube-linux-arm64 profile list --output json
pause_test.go:168: (dbg) Run:  docker ps -a
pause_test.go:173: (dbg) Run:  docker volume inspect pause-465351
pause_test.go:173: (dbg) Non-zero exit: docker volume inspect pause-465351: exit status 1 (18.325651ms)

                                                
                                                
-- stdout --
	[]

                                                
                                                
-- /stdout --
** stderr ** 
	Error response from daemon: get pause-465351: no such volume

                                                
                                                
** /stderr **
pause_test.go:178: (dbg) Run:  docker network ls
--- PASS: TestPause/serial/VerifyDeletedResources (0.15s)

                                                
                                    
x
+
TestStoppedBinaryUpgrade/Setup (1.24s)

                                                
                                                
=== RUN   TestStoppedBinaryUpgrade/Setup
--- PASS: TestStoppedBinaryUpgrade/Setup (1.24s)

                                                
                                    
x
+
TestStoppedBinaryUpgrade/Upgrade (110.01s)

                                                
                                                
=== RUN   TestStoppedBinaryUpgrade/Upgrade
version_upgrade_test.go:183: (dbg) Run:  /tmp/minikube-v1.26.0.1131312780 start -p stopped-upgrade-789894 --memory=2200 --vm-driver=docker  --container-runtime=containerd
version_upgrade_test.go:183: (dbg) Done: /tmp/minikube-v1.26.0.1131312780 start -p stopped-upgrade-789894 --memory=2200 --vm-driver=docker  --container-runtime=containerd: (45.375403424s)
version_upgrade_test.go:192: (dbg) Run:  /tmp/minikube-v1.26.0.1131312780 -p stopped-upgrade-789894 stop
version_upgrade_test.go:192: (dbg) Done: /tmp/minikube-v1.26.0.1131312780 -p stopped-upgrade-789894 stop: (20.132719968s)
version_upgrade_test.go:198: (dbg) Run:  out/minikube-linux-arm64 start -p stopped-upgrade-789894 --memory=2200 --alsologtostderr -v=1 --driver=docker  --container-runtime=containerd
version_upgrade_test.go:198: (dbg) Done: out/minikube-linux-arm64 start -p stopped-upgrade-789894 --memory=2200 --alsologtostderr -v=1 --driver=docker  --container-runtime=containerd: (44.502195635s)
--- PASS: TestStoppedBinaryUpgrade/Upgrade (110.01s)

                                                
                                    
x
+
TestStoppedBinaryUpgrade/MinikubeLogs (1.14s)

                                                
                                                
=== RUN   TestStoppedBinaryUpgrade/MinikubeLogs
version_upgrade_test.go:206: (dbg) Run:  out/minikube-linux-arm64 logs -p stopped-upgrade-789894
version_upgrade_test.go:206: (dbg) Done: out/minikube-linux-arm64 logs -p stopped-upgrade-789894: (1.137890696s)
--- PASS: TestStoppedBinaryUpgrade/MinikubeLogs (1.14s)

                                                
                                    
x
+
TestNetworkPlugins/group/false (4.61s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/false
net_test.go:246: (dbg) Run:  out/minikube-linux-arm64 start -p false-927381 --memory=2048 --alsologtostderr --cni=false --driver=docker  --container-runtime=containerd
net_test.go:246: (dbg) Non-zero exit: out/minikube-linux-arm64 start -p false-927381 --memory=2048 --alsologtostderr --cni=false --driver=docker  --container-runtime=containerd: exit status 14 (235.046777ms)

                                                
                                                
-- stdout --
	* [false-927381] minikube v1.33.1 on Ubuntu 20.04 (arm64)
	  - MINIKUBE_LOCATION=19411
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - KUBECONFIG=/home/jenkins/minikube-integration/19411-998978/kubeconfig
	  - MINIKUBE_HOME=/home/jenkins/minikube-integration/19411-998978/.minikube
	  - MINIKUBE_BIN=out/minikube-linux-arm64
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the docker driver based on user configuration
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0812 13:08:27.159380 1194108 out.go:291] Setting OutFile to fd 1 ...
	I0812 13:08:27.161409 1194108 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0812 13:08:27.161420 1194108 out.go:304] Setting ErrFile to fd 2...
	I0812 13:08:27.161426 1194108 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0812 13:08:27.161786 1194108 root.go:338] Updating PATH: /home/jenkins/minikube-integration/19411-998978/.minikube/bin
	I0812 13:08:27.162211 1194108 out.go:298] Setting JSON to false
	I0812 13:08:27.163241 1194108 start.go:129] hostinfo: {"hostname":"ip-172-31-30-239","uptime":17456,"bootTime":1723450651,"procs":188,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1066-aws","kernelArch":"aarch64","virtualizationSystem":"","virtualizationRole":"","hostId":"92f46a7d-c249-4c12-924a-77f64874c910"}
	I0812 13:08:27.163306 1194108 start.go:139] virtualization:  
	I0812 13:08:27.169350 1194108 out.go:177] * [false-927381] minikube v1.33.1 on Ubuntu 20.04 (arm64)
	I0812 13:08:27.171303 1194108 out.go:177]   - MINIKUBE_LOCATION=19411
	I0812 13:08:27.171383 1194108 notify.go:220] Checking for updates...
	I0812 13:08:27.176097 1194108 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I0812 13:08:27.177932 1194108 out.go:177]   - KUBECONFIG=/home/jenkins/minikube-integration/19411-998978/kubeconfig
	I0812 13:08:27.183850 1194108 out.go:177]   - MINIKUBE_HOME=/home/jenkins/minikube-integration/19411-998978/.minikube
	I0812 13:08:27.185741 1194108 out.go:177]   - MINIKUBE_BIN=out/minikube-linux-arm64
	I0812 13:08:27.187611 1194108 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=
	I0812 13:08:27.189958 1194108 config.go:182] Loaded profile config "force-systemd-flag-819709": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.30.3
	I0812 13:08:27.190117 1194108 driver.go:392] Setting default libvirt URI to qemu:///system
	I0812 13:08:27.222761 1194108 docker.go:123] docker version: linux-27.1.1:Docker Engine - Community
	I0812 13:08:27.222917 1194108 cli_runner.go:164] Run: docker system info --format "{{json .}}"
	I0812 13:08:27.305012 1194108 info.go:266] docker info: {ID:6ZPO:QZND:VNGE:LUKL:4Y3K:XELL:AAX4:2GTK:E6LM:MPRN:3ZXR:TTMR Containers:1 ContainersRunning:1 ContainersPaused:0 ContainersStopped:0 Images:4 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:36 OomKillDisable:true NGoroutines:53 SystemTime:2024-08-12 13:08:27.2918391 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1066-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Architecture:aarch
64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8214896640 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-30-239 Labels:[] ExperimentalBuild:false ServerVersion:27.1.1 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:2bf793ef6dc9a18e00cb12efb64355c2c9d5eb41 Expected:2bf793ef6dc9a18e00cb12efb64355c2c9d5eb41} RuncCommit:{ID:v1.1.13-0-g58aa920 Expected:v1.1.13-0-g58aa920} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:<nil> ServerErrors
:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.16.1] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.29.1]] Warnings:<nil>}}
	I0812 13:08:27.305157 1194108 docker.go:307] overlay module found
	I0812 13:08:27.308709 1194108 out.go:177] * Using the docker driver based on user configuration
	I0812 13:08:27.310406 1194108 start.go:297] selected driver: docker
	I0812 13:08:27.310426 1194108 start.go:901] validating driver "docker" against <nil>
	I0812 13:08:27.310445 1194108 start.go:912] status for docker: {Installed:true Healthy:true Running:false NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I0812 13:08:27.312751 1194108 out.go:177] 
	W0812 13:08:27.314576 1194108 out.go:239] X Exiting due to MK_USAGE: The "containerd" container runtime requires CNI
	X Exiting due to MK_USAGE: The "containerd" container runtime requires CNI
	I0812 13:08:27.316514 1194108 out.go:177] 

                                                
                                                
** /stderr **
net_test.go:88: 
----------------------- debugLogs start: false-927381 [pass: true] --------------------------------
>>> netcat: nslookup kubernetes.default:
Error in configuration: context was not found for specified context: false-927381

                                                
                                                

                                                
                                                
>>> netcat: nslookup debug kubernetes.default a-records:
Error in configuration: context was not found for specified context: false-927381

                                                
                                                

                                                
                                                
>>> netcat: dig search kubernetes.default:
Error in configuration: context was not found for specified context: false-927381

                                                
                                                

                                                
                                                
>>> netcat: dig @10.96.0.10 kubernetes.default.svc.cluster.local udp/53:
Error in configuration: context was not found for specified context: false-927381

                                                
                                                

                                                
                                                
>>> netcat: dig @10.96.0.10 kubernetes.default.svc.cluster.local tcp/53:
Error in configuration: context was not found for specified context: false-927381

                                                
                                                

                                                
                                                
>>> netcat: nc 10.96.0.10 udp/53:
Error in configuration: context was not found for specified context: false-927381

                                                
                                                

                                                
                                                
>>> netcat: nc 10.96.0.10 tcp/53:
Error in configuration: context was not found for specified context: false-927381

                                                
                                                

                                                
                                                
>>> netcat: /etc/nsswitch.conf:
Error in configuration: context was not found for specified context: false-927381

                                                
                                                

                                                
                                                
>>> netcat: /etc/hosts:
Error in configuration: context was not found for specified context: false-927381

                                                
                                                

                                                
                                                
>>> netcat: /etc/resolv.conf:
Error in configuration: context was not found for specified context: false-927381

                                                
                                                

                                                
                                                
>>> host: /etc/nsswitch.conf:
* Profile "false-927381" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-927381"

                                                
                                                

                                                
                                                
>>> host: /etc/hosts:
* Profile "false-927381" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-927381"

                                                
                                                

                                                
                                                
>>> host: /etc/resolv.conf:
* Profile "false-927381" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-927381"

                                                
                                                

                                                
                                                
>>> k8s: nodes, services, endpoints, daemon sets, deployments and pods, :
Error in configuration: context was not found for specified context: false-927381

                                                
                                                

                                                
                                                
>>> host: crictl pods:
* Profile "false-927381" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-927381"

                                                
                                                

                                                
                                                
>>> host: crictl containers:
* Profile "false-927381" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-927381"

                                                
                                                

                                                
                                                
>>> k8s: describe netcat deployment:
error: context "false-927381" does not exist

                                                
                                                

                                                
                                                
>>> k8s: describe netcat pod(s):
error: context "false-927381" does not exist

                                                
                                                

                                                
                                                
>>> k8s: netcat logs:
error: context "false-927381" does not exist

                                                
                                                

                                                
                                                
>>> k8s: describe coredns deployment:
error: context "false-927381" does not exist

                                                
                                                

                                                
                                                
>>> k8s: describe coredns pods:
error: context "false-927381" does not exist

                                                
                                                

                                                
                                                
>>> k8s: coredns logs:
error: context "false-927381" does not exist

                                                
                                                

                                                
                                                
>>> k8s: describe api server pod(s):
error: context "false-927381" does not exist

                                                
                                                

                                                
                                                
>>> k8s: api server logs:
error: context "false-927381" does not exist

                                                
                                                

                                                
                                                
>>> host: /etc/cni:
* Profile "false-927381" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-927381"

                                                
                                                

                                                
                                                
>>> host: ip a s:
* Profile "false-927381" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-927381"

                                                
                                                

                                                
                                                
>>> host: ip r s:
* Profile "false-927381" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-927381"

                                                
                                                

                                                
                                                
>>> host: iptables-save:
* Profile "false-927381" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-927381"

                                                
                                                

                                                
                                                
>>> host: iptables table nat:
* Profile "false-927381" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-927381"

                                                
                                                

                                                
                                                
>>> k8s: describe kube-proxy daemon set:
error: context "false-927381" does not exist

                                                
                                                

                                                
                                                
>>> k8s: describe kube-proxy pod(s):
error: context "false-927381" does not exist

                                                
                                                

                                                
                                                
>>> k8s: kube-proxy logs:
error: context "false-927381" does not exist

                                                
                                                

                                                
                                                
>>> host: kubelet daemon status:
* Profile "false-927381" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-927381"

                                                
                                                

                                                
                                                
>>> host: kubelet daemon config:
* Profile "false-927381" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-927381"

                                                
                                                

                                                
                                                
>>> k8s: kubelet logs:
* Profile "false-927381" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-927381"

                                                
                                                

                                                
                                                
>>> host: /etc/kubernetes/kubelet.conf:
* Profile "false-927381" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-927381"

                                                
                                                

                                                
                                                
>>> host: /var/lib/kubelet/config.yaml:
* Profile "false-927381" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-927381"

                                                
                                                

                                                
                                                
>>> k8s: kubectl config:
apiVersion: v1
clusters: null
contexts: null
current-context: ""
kind: Config
preferences: {}
users: null

                                                
                                                

                                                
                                                
>>> k8s: cms:
Error in configuration: context was not found for specified context: false-927381

                                                
                                                

                                                
                                                
>>> host: docker daemon status:
* Profile "false-927381" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-927381"

                                                
                                                

                                                
                                                
>>> host: docker daemon config:
* Profile "false-927381" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-927381"

                                                
                                                

                                                
                                                
>>> host: /etc/docker/daemon.json:
* Profile "false-927381" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-927381"

                                                
                                                

                                                
                                                
>>> host: docker system info:
* Profile "false-927381" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-927381"

                                                
                                                

                                                
                                                
>>> host: cri-docker daemon status:
* Profile "false-927381" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-927381"

                                                
                                                

                                                
                                                
>>> host: cri-docker daemon config:
* Profile "false-927381" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-927381"

                                                
                                                

                                                
                                                
>>> host: /etc/systemd/system/cri-docker.service.d/10-cni.conf:
* Profile "false-927381" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-927381"

                                                
                                                

                                                
                                                
>>> host: /usr/lib/systemd/system/cri-docker.service:
* Profile "false-927381" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-927381"

                                                
                                                

                                                
                                                
>>> host: cri-dockerd version:
* Profile "false-927381" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-927381"

                                                
                                                

                                                
                                                
>>> host: containerd daemon status:
* Profile "false-927381" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-927381"

                                                
                                                

                                                
                                                
>>> host: containerd daemon config:
* Profile "false-927381" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-927381"

                                                
                                                

                                                
                                                
>>> host: /lib/systemd/system/containerd.service:
* Profile "false-927381" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-927381"

                                                
                                                

                                                
                                                
>>> host: /etc/containerd/config.toml:
* Profile "false-927381" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-927381"

                                                
                                                

                                                
                                                
>>> host: containerd config dump:
* Profile "false-927381" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-927381"

                                                
                                                

                                                
                                                
>>> host: crio daemon status:
* Profile "false-927381" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-927381"

                                                
                                                

                                                
                                                
>>> host: crio daemon config:
* Profile "false-927381" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-927381"

                                                
                                                

                                                
                                                
>>> host: /etc/crio:
* Profile "false-927381" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-927381"

                                                
                                                

                                                
                                                
>>> host: crio config:
* Profile "false-927381" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-927381"

                                                
                                                
----------------------- debugLogs end: false-927381 [took: 4.175174959s] --------------------------------
helpers_test.go:175: Cleaning up "false-927381" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-arm64 delete -p false-927381
--- PASS: TestNetworkPlugins/group/false (4.61s)

                                                
                                    
x
+
TestStartStop/group/old-k8s-version/serial/FirstStart (160.07s)

                                                
                                                
=== RUN   TestStartStop/group/old-k8s-version/serial/FirstStart
start_stop_delete_test.go:186: (dbg) Run:  out/minikube-linux-arm64 start -p old-k8s-version-112335 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=docker  --container-runtime=containerd --kubernetes-version=v1.20.0
E0812 13:12:15.802941 1004370 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19411-998978/.minikube/profiles/functional-986276/client.crt: no such file or directory
start_stop_delete_test.go:186: (dbg) Done: out/minikube-linux-arm64 start -p old-k8s-version-112335 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=docker  --container-runtime=containerd --kubernetes-version=v1.20.0: (2m40.065386938s)
--- PASS: TestStartStop/group/old-k8s-version/serial/FirstStart (160.07s)

                                                
                                    
x
+
TestStartStop/group/old-k8s-version/serial/DeployApp (8.76s)

                                                
                                                
=== RUN   TestStartStop/group/old-k8s-version/serial/DeployApp
start_stop_delete_test.go:196: (dbg) Run:  kubectl --context old-k8s-version-112335 create -f testdata/busybox.yaml
start_stop_delete_test.go:196: (dbg) TestStartStop/group/old-k8s-version/serial/DeployApp: waiting 8m0s for pods matching "integration-test=busybox" in namespace "default" ...
helpers_test.go:344: "busybox" [73e72bc4-6730-4654-bd1e-562273935df3] Pending
helpers_test.go:344: "busybox" [73e72bc4-6730-4654-bd1e-562273935df3] Pending / Ready:ContainersNotReady (containers with unready status: [busybox]) / ContainersReady:ContainersNotReady (containers with unready status: [busybox])
helpers_test.go:344: "busybox" [73e72bc4-6730-4654-bd1e-562273935df3] Running
start_stop_delete_test.go:196: (dbg) TestStartStop/group/old-k8s-version/serial/DeployApp: integration-test=busybox healthy within 8.003569606s
start_stop_delete_test.go:196: (dbg) Run:  kubectl --context old-k8s-version-112335 exec busybox -- /bin/sh -c "ulimit -n"
--- PASS: TestStartStop/group/old-k8s-version/serial/DeployApp (8.76s)

                                                
                                    
x
+
TestStartStop/group/no-preload/serial/FirstStart (80.66s)

                                                
                                                
=== RUN   TestStartStop/group/no-preload/serial/FirstStart
start_stop_delete_test.go:186: (dbg) Run:  out/minikube-linux-arm64 start -p no-preload-824604 --memory=2200 --alsologtostderr --wait=true --preload=false --driver=docker  --container-runtime=containerd --kubernetes-version=v1.31.0-rc.0
start_stop_delete_test.go:186: (dbg) Done: out/minikube-linux-arm64 start -p no-preload-824604 --memory=2200 --alsologtostderr --wait=true --preload=false --driver=docker  --container-runtime=containerd --kubernetes-version=v1.31.0-rc.0: (1m20.664083571s)
--- PASS: TestStartStop/group/no-preload/serial/FirstStart (80.66s)

                                                
                                    
x
+
TestStartStop/group/old-k8s-version/serial/EnableAddonWhileActive (1.53s)

                                                
                                                
=== RUN   TestStartStop/group/old-k8s-version/serial/EnableAddonWhileActive
start_stop_delete_test.go:205: (dbg) Run:  out/minikube-linux-arm64 addons enable metrics-server -p old-k8s-version-112335 --images=MetricsServer=registry.k8s.io/echoserver:1.4 --registries=MetricsServer=fake.domain
start_stop_delete_test.go:205: (dbg) Done: out/minikube-linux-arm64 addons enable metrics-server -p old-k8s-version-112335 --images=MetricsServer=registry.k8s.io/echoserver:1.4 --registries=MetricsServer=fake.domain: (1.312669384s)
start_stop_delete_test.go:215: (dbg) Run:  kubectl --context old-k8s-version-112335 describe deploy/metrics-server -n kube-system
--- PASS: TestStartStop/group/old-k8s-version/serial/EnableAddonWhileActive (1.53s)

                                                
                                    
x
+
TestStartStop/group/old-k8s-version/serial/Stop (13.93s)

                                                
                                                
=== RUN   TestStartStop/group/old-k8s-version/serial/Stop
start_stop_delete_test.go:228: (dbg) Run:  out/minikube-linux-arm64 stop -p old-k8s-version-112335 --alsologtostderr -v=3
start_stop_delete_test.go:228: (dbg) Done: out/minikube-linux-arm64 stop -p old-k8s-version-112335 --alsologtostderr -v=3: (13.933805932s)
--- PASS: TestStartStop/group/old-k8s-version/serial/Stop (13.93s)

                                                
                                    
x
+
TestStartStop/group/old-k8s-version/serial/EnableAddonAfterStop (0.31s)

                                                
                                                
=== RUN   TestStartStop/group/old-k8s-version/serial/EnableAddonAfterStop
start_stop_delete_test.go:239: (dbg) Run:  out/minikube-linux-arm64 status --format={{.Host}} -p old-k8s-version-112335 -n old-k8s-version-112335
start_stop_delete_test.go:239: (dbg) Non-zero exit: out/minikube-linux-arm64 status --format={{.Host}} -p old-k8s-version-112335 -n old-k8s-version-112335: exit status 7 (113.71487ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
start_stop_delete_test.go:239: status error: exit status 7 (may be ok)
start_stop_delete_test.go:246: (dbg) Run:  out/minikube-linux-arm64 addons enable dashboard -p old-k8s-version-112335 --images=MetricsScraper=registry.k8s.io/echoserver:1.4
--- PASS: TestStartStop/group/old-k8s-version/serial/EnableAddonAfterStop (0.31s)

                                                
                                    
x
+
TestStartStop/group/no-preload/serial/DeployApp (8.42s)

                                                
                                                
=== RUN   TestStartStop/group/no-preload/serial/DeployApp
start_stop_delete_test.go:196: (dbg) Run:  kubectl --context no-preload-824604 create -f testdata/busybox.yaml
start_stop_delete_test.go:196: (dbg) TestStartStop/group/no-preload/serial/DeployApp: waiting 8m0s for pods matching "integration-test=busybox" in namespace "default" ...
helpers_test.go:344: "busybox" [b791c892-a29a-49f4-9ff9-7ca92cd8b05a] Pending
helpers_test.go:344: "busybox" [b791c892-a29a-49f4-9ff9-7ca92cd8b05a] Pending / Ready:ContainersNotReady (containers with unready status: [busybox]) / ContainersReady:ContainersNotReady (containers with unready status: [busybox])
helpers_test.go:344: "busybox" [b791c892-a29a-49f4-9ff9-7ca92cd8b05a] Running
start_stop_delete_test.go:196: (dbg) TestStartStop/group/no-preload/serial/DeployApp: integration-test=busybox healthy within 8.003679666s
start_stop_delete_test.go:196: (dbg) Run:  kubectl --context no-preload-824604 exec busybox -- /bin/sh -c "ulimit -n"
--- PASS: TestStartStop/group/no-preload/serial/DeployApp (8.42s)

                                                
                                    
x
+
TestStartStop/group/no-preload/serial/EnableAddonWhileActive (1.16s)

                                                
                                                
=== RUN   TestStartStop/group/no-preload/serial/EnableAddonWhileActive
start_stop_delete_test.go:205: (dbg) Run:  out/minikube-linux-arm64 addons enable metrics-server -p no-preload-824604 --images=MetricsServer=registry.k8s.io/echoserver:1.4 --registries=MetricsServer=fake.domain
E0812 13:14:12.757125 1004370 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19411-998978/.minikube/profiles/functional-986276/client.crt: no such file or directory
start_stop_delete_test.go:205: (dbg) Done: out/minikube-linux-arm64 addons enable metrics-server -p no-preload-824604 --images=MetricsServer=registry.k8s.io/echoserver:1.4 --registries=MetricsServer=fake.domain: (1.050297639s)
start_stop_delete_test.go:215: (dbg) Run:  kubectl --context no-preload-824604 describe deploy/metrics-server -n kube-system
--- PASS: TestStartStop/group/no-preload/serial/EnableAddonWhileActive (1.16s)

                                                
                                    
x
+
TestStartStop/group/no-preload/serial/Stop (12.18s)

                                                
                                                
=== RUN   TestStartStop/group/no-preload/serial/Stop
start_stop_delete_test.go:228: (dbg) Run:  out/minikube-linux-arm64 stop -p no-preload-824604 --alsologtostderr -v=3
start_stop_delete_test.go:228: (dbg) Done: out/minikube-linux-arm64 stop -p no-preload-824604 --alsologtostderr -v=3: (12.182505127s)
--- PASS: TestStartStop/group/no-preload/serial/Stop (12.18s)

                                                
                                    
x
+
TestStartStop/group/no-preload/serial/EnableAddonAfterStop (0.18s)

                                                
                                                
=== RUN   TestStartStop/group/no-preload/serial/EnableAddonAfterStop
start_stop_delete_test.go:239: (dbg) Run:  out/minikube-linux-arm64 status --format={{.Host}} -p no-preload-824604 -n no-preload-824604
start_stop_delete_test.go:239: (dbg) Non-zero exit: out/minikube-linux-arm64 status --format={{.Host}} -p no-preload-824604 -n no-preload-824604: exit status 7 (73.054131ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
start_stop_delete_test.go:239: status error: exit status 7 (may be ok)
start_stop_delete_test.go:246: (dbg) Run:  out/minikube-linux-arm64 addons enable dashboard -p no-preload-824604 --images=MetricsScraper=registry.k8s.io/echoserver:1.4
--- PASS: TestStartStop/group/no-preload/serial/EnableAddonAfterStop (0.18s)

                                                
                                    
x
+
TestStartStop/group/no-preload/serial/SecondStart (267.68s)

                                                
                                                
=== RUN   TestStartStop/group/no-preload/serial/SecondStart
start_stop_delete_test.go:256: (dbg) Run:  out/minikube-linux-arm64 start -p no-preload-824604 --memory=2200 --alsologtostderr --wait=true --preload=false --driver=docker  --container-runtime=containerd --kubernetes-version=v1.31.0-rc.0
E0812 13:14:43.525440 1004370 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19411-998978/.minikube/profiles/addons-673965/client.crt: no such file or directory
start_stop_delete_test.go:256: (dbg) Done: out/minikube-linux-arm64 start -p no-preload-824604 --memory=2200 --alsologtostderr --wait=true --preload=false --driver=docker  --container-runtime=containerd --kubernetes-version=v1.31.0-rc.0: (4m27.312021381s)
start_stop_delete_test.go:262: (dbg) Run:  out/minikube-linux-arm64 status --format={{.Host}} -p no-preload-824604 -n no-preload-824604
--- PASS: TestStartStop/group/no-preload/serial/SecondStart (267.68s)

                                                
                                    
x
+
TestStartStop/group/no-preload/serial/UserAppExistsAfterStop (6.01s)

                                                
                                                
=== RUN   TestStartStop/group/no-preload/serial/UserAppExistsAfterStop
start_stop_delete_test.go:274: (dbg) TestStartStop/group/no-preload/serial/UserAppExistsAfterStop: waiting 9m0s for pods matching "k8s-app=kubernetes-dashboard" in namespace "kubernetes-dashboard" ...
helpers_test.go:344: "kubernetes-dashboard-695b96c756-s7p6w" [bb14d41a-a83f-4e15-89aa-b1798427dc55] Running
start_stop_delete_test.go:274: (dbg) TestStartStop/group/no-preload/serial/UserAppExistsAfterStop: k8s-app=kubernetes-dashboard healthy within 6.003576985s
--- PASS: TestStartStop/group/no-preload/serial/UserAppExistsAfterStop (6.01s)

                                                
                                    
x
+
TestStartStop/group/no-preload/serial/AddonExistsAfterStop (5.1s)

                                                
                                                
=== RUN   TestStartStop/group/no-preload/serial/AddonExistsAfterStop
start_stop_delete_test.go:287: (dbg) TestStartStop/group/no-preload/serial/AddonExistsAfterStop: waiting 9m0s for pods matching "k8s-app=kubernetes-dashboard" in namespace "kubernetes-dashboard" ...
helpers_test.go:344: "kubernetes-dashboard-695b96c756-s7p6w" [bb14d41a-a83f-4e15-89aa-b1798427dc55] Running
start_stop_delete_test.go:287: (dbg) TestStartStop/group/no-preload/serial/AddonExistsAfterStop: k8s-app=kubernetes-dashboard healthy within 5.004338731s
start_stop_delete_test.go:291: (dbg) Run:  kubectl --context no-preload-824604 describe deploy/dashboard-metrics-scraper -n kubernetes-dashboard
--- PASS: TestStartStop/group/no-preload/serial/AddonExistsAfterStop (5.10s)

                                                
                                    
x
+
TestStartStop/group/no-preload/serial/VerifyKubernetesImages (0.25s)

                                                
                                                
=== RUN   TestStartStop/group/no-preload/serial/VerifyKubernetesImages
start_stop_delete_test.go:304: (dbg) Run:  out/minikube-linux-arm64 -p no-preload-824604 image list --format=json
start_stop_delete_test.go:304: Found non-minikube image: kindest/kindnetd:v20240730-75a5af0c
start_stop_delete_test.go:304: Found non-minikube image: gcr.io/k8s-minikube/busybox:1.28.4-glibc
--- PASS: TestStartStop/group/no-preload/serial/VerifyKubernetesImages (0.25s)

                                                
                                    
x
+
TestStartStop/group/no-preload/serial/Pause (3.21s)

                                                
                                                
=== RUN   TestStartStop/group/no-preload/serial/Pause
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 pause -p no-preload-824604 --alsologtostderr -v=1
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 status --format={{.APIServer}} -p no-preload-824604 -n no-preload-824604
start_stop_delete_test.go:311: (dbg) Non-zero exit: out/minikube-linux-arm64 status --format={{.APIServer}} -p no-preload-824604 -n no-preload-824604: exit status 2 (387.564254ms)

                                                
                                                
-- stdout --
	Paused

                                                
                                                
-- /stdout --
start_stop_delete_test.go:311: status error: exit status 2 (may be ok)
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 status --format={{.Kubelet}} -p no-preload-824604 -n no-preload-824604
start_stop_delete_test.go:311: (dbg) Non-zero exit: out/minikube-linux-arm64 status --format={{.Kubelet}} -p no-preload-824604 -n no-preload-824604: exit status 2 (331.519197ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
start_stop_delete_test.go:311: status error: exit status 2 (may be ok)
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 unpause -p no-preload-824604 --alsologtostderr -v=1
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 status --format={{.APIServer}} -p no-preload-824604 -n no-preload-824604
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 status --format={{.Kubelet}} -p no-preload-824604 -n no-preload-824604
--- PASS: TestStartStop/group/no-preload/serial/Pause (3.21s)

                                                
                                    
x
+
TestStartStop/group/embed-certs/serial/FirstStart (76.94s)

                                                
                                                
=== RUN   TestStartStop/group/embed-certs/serial/FirstStart
start_stop_delete_test.go:186: (dbg) Run:  out/minikube-linux-arm64 start -p embed-certs-097595 --memory=2200 --alsologtostderr --wait=true --embed-certs --driver=docker  --container-runtime=containerd --kubernetes-version=v1.30.3
E0812 13:19:12.757020 1004370 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19411-998978/.minikube/profiles/functional-986276/client.crt: no such file or directory
start_stop_delete_test.go:186: (dbg) Done: out/minikube-linux-arm64 start -p embed-certs-097595 --memory=2200 --alsologtostderr --wait=true --embed-certs --driver=docker  --container-runtime=containerd --kubernetes-version=v1.30.3: (1m16.940005609s)
--- PASS: TestStartStop/group/embed-certs/serial/FirstStart (76.94s)

                                                
                                    
x
+
TestStartStop/group/old-k8s-version/serial/UserAppExistsAfterStop (6.01s)

                                                
                                                
=== RUN   TestStartStop/group/old-k8s-version/serial/UserAppExistsAfterStop
start_stop_delete_test.go:274: (dbg) TestStartStop/group/old-k8s-version/serial/UserAppExistsAfterStop: waiting 9m0s for pods matching "k8s-app=kubernetes-dashboard" in namespace "kubernetes-dashboard" ...
helpers_test.go:344: "kubernetes-dashboard-cd95d586-l4krc" [f39c3b95-c8d8-485b-beea-d3d59fbc1d99] Running
start_stop_delete_test.go:274: (dbg) TestStartStop/group/old-k8s-version/serial/UserAppExistsAfterStop: k8s-app=kubernetes-dashboard healthy within 6.004093258s
--- PASS: TestStartStop/group/old-k8s-version/serial/UserAppExistsAfterStop (6.01s)

                                                
                                    
x
+
TestStartStop/group/old-k8s-version/serial/AddonExistsAfterStop (6.15s)

                                                
                                                
=== RUN   TestStartStop/group/old-k8s-version/serial/AddonExistsAfterStop
start_stop_delete_test.go:287: (dbg) TestStartStop/group/old-k8s-version/serial/AddonExistsAfterStop: waiting 9m0s for pods matching "k8s-app=kubernetes-dashboard" in namespace "kubernetes-dashboard" ...
helpers_test.go:344: "kubernetes-dashboard-cd95d586-l4krc" [f39c3b95-c8d8-485b-beea-d3d59fbc1d99] Running
start_stop_delete_test.go:287: (dbg) TestStartStop/group/old-k8s-version/serial/AddonExistsAfterStop: k8s-app=kubernetes-dashboard healthy within 6.003421918s
start_stop_delete_test.go:291: (dbg) Run:  kubectl --context old-k8s-version-112335 describe deploy/dashboard-metrics-scraper -n kubernetes-dashboard
--- PASS: TestStartStop/group/old-k8s-version/serial/AddonExistsAfterStop (6.15s)

                                                
                                    
x
+
TestStartStop/group/old-k8s-version/serial/VerifyKubernetesImages (0.29s)

                                                
                                                
=== RUN   TestStartStop/group/old-k8s-version/serial/VerifyKubernetesImages
start_stop_delete_test.go:304: (dbg) Run:  out/minikube-linux-arm64 -p old-k8s-version-112335 image list --format=json
start_stop_delete_test.go:304: Found non-minikube image: kindest/kindnetd:v20240202-8f1494ea
start_stop_delete_test.go:304: Found non-minikube image: kindest/kindnetd:v20240730-75a5af0c
start_stop_delete_test.go:304: Found non-minikube image: gcr.io/k8s-minikube/busybox:1.28.4-glibc
--- PASS: TestStartStop/group/old-k8s-version/serial/VerifyKubernetesImages (0.29s)

                                                
                                    
x
+
TestStartStop/group/old-k8s-version/serial/Pause (3.94s)

                                                
                                                
=== RUN   TestStartStop/group/old-k8s-version/serial/Pause
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 pause -p old-k8s-version-112335 --alsologtostderr -v=1
start_stop_delete_test.go:311: (dbg) Done: out/minikube-linux-arm64 pause -p old-k8s-version-112335 --alsologtostderr -v=1: (1.162143936s)
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 status --format={{.APIServer}} -p old-k8s-version-112335 -n old-k8s-version-112335
start_stop_delete_test.go:311: (dbg) Non-zero exit: out/minikube-linux-arm64 status --format={{.APIServer}} -p old-k8s-version-112335 -n old-k8s-version-112335: exit status 2 (409.253449ms)

                                                
                                                
-- stdout --
	Paused

                                                
                                                
-- /stdout --
start_stop_delete_test.go:311: status error: exit status 2 (may be ok)
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 status --format={{.Kubelet}} -p old-k8s-version-112335 -n old-k8s-version-112335
start_stop_delete_test.go:311: (dbg) Non-zero exit: out/minikube-linux-arm64 status --format={{.Kubelet}} -p old-k8s-version-112335 -n old-k8s-version-112335: exit status 2 (447.618681ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
start_stop_delete_test.go:311: status error: exit status 2 (may be ok)
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 unpause -p old-k8s-version-112335 --alsologtostderr -v=1
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 status --format={{.APIServer}} -p old-k8s-version-112335 -n old-k8s-version-112335
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 status --format={{.Kubelet}} -p old-k8s-version-112335 -n old-k8s-version-112335
--- PASS: TestStartStop/group/old-k8s-version/serial/Pause (3.94s)

                                                
                                    
x
+
TestStartStop/group/default-k8s-diff-port/serial/FirstStart (64.69s)

                                                
                                                
=== RUN   TestStartStop/group/default-k8s-diff-port/serial/FirstStart
start_stop_delete_test.go:186: (dbg) Run:  out/minikube-linux-arm64 start -p default-k8s-diff-port-496134 --memory=2200 --alsologtostderr --wait=true --apiserver-port=8444 --driver=docker  --container-runtime=containerd --kubernetes-version=v1.30.3
start_stop_delete_test.go:186: (dbg) Done: out/minikube-linux-arm64 start -p default-k8s-diff-port-496134 --memory=2200 --alsologtostderr --wait=true --apiserver-port=8444 --driver=docker  --container-runtime=containerd --kubernetes-version=v1.30.3: (1m4.685111484s)
--- PASS: TestStartStop/group/default-k8s-diff-port/serial/FirstStart (64.69s)

                                                
                                    
x
+
TestStartStop/group/embed-certs/serial/DeployApp (9.33s)

                                                
                                                
=== RUN   TestStartStop/group/embed-certs/serial/DeployApp
start_stop_delete_test.go:196: (dbg) Run:  kubectl --context embed-certs-097595 create -f testdata/busybox.yaml
start_stop_delete_test.go:196: (dbg) TestStartStop/group/embed-certs/serial/DeployApp: waiting 8m0s for pods matching "integration-test=busybox" in namespace "default" ...
helpers_test.go:344: "busybox" [32c94bce-13ad-460c-80cc-71d2a970f12c] Pending
helpers_test.go:344: "busybox" [32c94bce-13ad-460c-80cc-71d2a970f12c] Pending / Ready:ContainersNotReady (containers with unready status: [busybox]) / ContainersReady:ContainersNotReady (containers with unready status: [busybox])
helpers_test.go:344: "busybox" [32c94bce-13ad-460c-80cc-71d2a970f12c] Running
start_stop_delete_test.go:196: (dbg) TestStartStop/group/embed-certs/serial/DeployApp: integration-test=busybox healthy within 9.003435231s
start_stop_delete_test.go:196: (dbg) Run:  kubectl --context embed-certs-097595 exec busybox -- /bin/sh -c "ulimit -n"
--- PASS: TestStartStop/group/embed-certs/serial/DeployApp (9.33s)

                                                
                                    
x
+
TestStartStop/group/embed-certs/serial/EnableAddonWhileActive (1.1s)

                                                
                                                
=== RUN   TestStartStop/group/embed-certs/serial/EnableAddonWhileActive
start_stop_delete_test.go:205: (dbg) Run:  out/minikube-linux-arm64 addons enable metrics-server -p embed-certs-097595 --images=MetricsServer=registry.k8s.io/echoserver:1.4 --registries=MetricsServer=fake.domain
start_stop_delete_test.go:215: (dbg) Run:  kubectl --context embed-certs-097595 describe deploy/metrics-server -n kube-system
--- PASS: TestStartStop/group/embed-certs/serial/EnableAddonWhileActive (1.10s)

                                                
                                    
x
+
TestStartStop/group/embed-certs/serial/Stop (12.2s)

                                                
                                                
=== RUN   TestStartStop/group/embed-certs/serial/Stop
start_stop_delete_test.go:228: (dbg) Run:  out/minikube-linux-arm64 stop -p embed-certs-097595 --alsologtostderr -v=3
start_stop_delete_test.go:228: (dbg) Done: out/minikube-linux-arm64 stop -p embed-certs-097595 --alsologtostderr -v=3: (12.197157749s)
--- PASS: TestStartStop/group/embed-certs/serial/Stop (12.20s)

                                                
                                    
x
+
TestStartStop/group/default-k8s-diff-port/serial/DeployApp (8.5s)

                                                
                                                
=== RUN   TestStartStop/group/default-k8s-diff-port/serial/DeployApp
start_stop_delete_test.go:196: (dbg) Run:  kubectl --context default-k8s-diff-port-496134 create -f testdata/busybox.yaml
start_stop_delete_test.go:196: (dbg) TestStartStop/group/default-k8s-diff-port/serial/DeployApp: waiting 8m0s for pods matching "integration-test=busybox" in namespace "default" ...
helpers_test.go:344: "busybox" [39ec11da-7f0a-42df-bdc8-2add47ab9cb5] Pending
helpers_test.go:344: "busybox" [39ec11da-7f0a-42df-bdc8-2add47ab9cb5] Pending / Ready:ContainersNotReady (containers with unready status: [busybox]) / ContainersReady:ContainersNotReady (containers with unready status: [busybox])
helpers_test.go:344: "busybox" [39ec11da-7f0a-42df-bdc8-2add47ab9cb5] Running
start_stop_delete_test.go:196: (dbg) TestStartStop/group/default-k8s-diff-port/serial/DeployApp: integration-test=busybox healthy within 8.007168887s
start_stop_delete_test.go:196: (dbg) Run:  kubectl --context default-k8s-diff-port-496134 exec busybox -- /bin/sh -c "ulimit -n"
--- PASS: TestStartStop/group/default-k8s-diff-port/serial/DeployApp (8.50s)

                                                
                                    
x
+
TestStartStop/group/embed-certs/serial/EnableAddonAfterStop (0.28s)

                                                
                                                
=== RUN   TestStartStop/group/embed-certs/serial/EnableAddonAfterStop
start_stop_delete_test.go:239: (dbg) Run:  out/minikube-linux-arm64 status --format={{.Host}} -p embed-certs-097595 -n embed-certs-097595
start_stop_delete_test.go:239: (dbg) Non-zero exit: out/minikube-linux-arm64 status --format={{.Host}} -p embed-certs-097595 -n embed-certs-097595: exit status 7 (101.229602ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
start_stop_delete_test.go:239: status error: exit status 7 (may be ok)
start_stop_delete_test.go:246: (dbg) Run:  out/minikube-linux-arm64 addons enable dashboard -p embed-certs-097595 --images=MetricsScraper=registry.k8s.io/echoserver:1.4
--- PASS: TestStartStop/group/embed-certs/serial/EnableAddonAfterStop (0.28s)

                                                
                                    
x
+
TestStartStop/group/embed-certs/serial/SecondStart (297.07s)

                                                
                                                
=== RUN   TestStartStop/group/embed-certs/serial/SecondStart
start_stop_delete_test.go:256: (dbg) Run:  out/minikube-linux-arm64 start -p embed-certs-097595 --memory=2200 --alsologtostderr --wait=true --embed-certs --driver=docker  --container-runtime=containerd --kubernetes-version=v1.30.3
start_stop_delete_test.go:256: (dbg) Done: out/minikube-linux-arm64 start -p embed-certs-097595 --memory=2200 --alsologtostderr --wait=true --embed-certs --driver=docker  --container-runtime=containerd --kubernetes-version=v1.30.3: (4m56.68930898s)
start_stop_delete_test.go:262: (dbg) Run:  out/minikube-linux-arm64 status --format={{.Host}} -p embed-certs-097595 -n embed-certs-097595
--- PASS: TestStartStop/group/embed-certs/serial/SecondStart (297.07s)

                                                
                                    
x
+
TestStartStop/group/default-k8s-diff-port/serial/EnableAddonWhileActive (1.67s)

                                                
                                                
=== RUN   TestStartStop/group/default-k8s-diff-port/serial/EnableAddonWhileActive
start_stop_delete_test.go:205: (dbg) Run:  out/minikube-linux-arm64 addons enable metrics-server -p default-k8s-diff-port-496134 --images=MetricsServer=registry.k8s.io/echoserver:1.4 --registries=MetricsServer=fake.domain
start_stop_delete_test.go:205: (dbg) Done: out/minikube-linux-arm64 addons enable metrics-server -p default-k8s-diff-port-496134 --images=MetricsServer=registry.k8s.io/echoserver:1.4 --registries=MetricsServer=fake.domain: (1.519648594s)
start_stop_delete_test.go:215: (dbg) Run:  kubectl --context default-k8s-diff-port-496134 describe deploy/metrics-server -n kube-system
--- PASS: TestStartStop/group/default-k8s-diff-port/serial/EnableAddonWhileActive (1.67s)

                                                
                                    
x
+
TestStartStop/group/default-k8s-diff-port/serial/Stop (12.45s)

                                                
                                                
=== RUN   TestStartStop/group/default-k8s-diff-port/serial/Stop
start_stop_delete_test.go:228: (dbg) Run:  out/minikube-linux-arm64 stop -p default-k8s-diff-port-496134 --alsologtostderr -v=3
start_stop_delete_test.go:228: (dbg) Done: out/minikube-linux-arm64 stop -p default-k8s-diff-port-496134 --alsologtostderr -v=3: (12.448805576s)
--- PASS: TestStartStop/group/default-k8s-diff-port/serial/Stop (12.45s)

                                                
                                    
x
+
TestStartStop/group/default-k8s-diff-port/serial/EnableAddonAfterStop (0.18s)

                                                
                                                
=== RUN   TestStartStop/group/default-k8s-diff-port/serial/EnableAddonAfterStop
start_stop_delete_test.go:239: (dbg) Run:  out/minikube-linux-arm64 status --format={{.Host}} -p default-k8s-diff-port-496134 -n default-k8s-diff-port-496134
start_stop_delete_test.go:239: (dbg) Non-zero exit: out/minikube-linux-arm64 status --format={{.Host}} -p default-k8s-diff-port-496134 -n default-k8s-diff-port-496134: exit status 7 (66.225428ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
start_stop_delete_test.go:239: status error: exit status 7 (may be ok)
start_stop_delete_test.go:246: (dbg) Run:  out/minikube-linux-arm64 addons enable dashboard -p default-k8s-diff-port-496134 --images=MetricsScraper=registry.k8s.io/echoserver:1.4
--- PASS: TestStartStop/group/default-k8s-diff-port/serial/EnableAddonAfterStop (0.18s)

                                                
                                    
x
+
TestStartStop/group/default-k8s-diff-port/serial/SecondStart (269.75s)

                                                
                                                
=== RUN   TestStartStop/group/default-k8s-diff-port/serial/SecondStart
start_stop_delete_test.go:256: (dbg) Run:  out/minikube-linux-arm64 start -p default-k8s-diff-port-496134 --memory=2200 --alsologtostderr --wait=true --apiserver-port=8444 --driver=docker  --container-runtime=containerd --kubernetes-version=v1.30.3
E0812 13:22:42.840145 1004370 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19411-998978/.minikube/profiles/old-k8s-version-112335/client.crt: no such file or directory
E0812 13:22:42.845414 1004370 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19411-998978/.minikube/profiles/old-k8s-version-112335/client.crt: no such file or directory
E0812 13:22:42.855795 1004370 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19411-998978/.minikube/profiles/old-k8s-version-112335/client.crt: no such file or directory
E0812 13:22:42.876125 1004370 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19411-998978/.minikube/profiles/old-k8s-version-112335/client.crt: no such file or directory
E0812 13:22:42.916367 1004370 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19411-998978/.minikube/profiles/old-k8s-version-112335/client.crt: no such file or directory
E0812 13:22:42.996655 1004370 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19411-998978/.minikube/profiles/old-k8s-version-112335/client.crt: no such file or directory
E0812 13:22:43.157071 1004370 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19411-998978/.minikube/profiles/old-k8s-version-112335/client.crt: no such file or directory
E0812 13:22:43.477351 1004370 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19411-998978/.minikube/profiles/old-k8s-version-112335/client.crt: no such file or directory
E0812 13:22:44.118035 1004370 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19411-998978/.minikube/profiles/old-k8s-version-112335/client.crt: no such file or directory
E0812 13:22:45.398499 1004370 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19411-998978/.minikube/profiles/old-k8s-version-112335/client.crt: no such file or directory
E0812 13:22:47.959708 1004370 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19411-998978/.minikube/profiles/old-k8s-version-112335/client.crt: no such file or directory
E0812 13:22:53.080107 1004370 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19411-998978/.minikube/profiles/old-k8s-version-112335/client.crt: no such file or directory
E0812 13:23:03.320313 1004370 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19411-998978/.minikube/profiles/old-k8s-version-112335/client.crt: no such file or directory
E0812 13:23:23.800521 1004370 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19411-998978/.minikube/profiles/old-k8s-version-112335/client.crt: no such file or directory
E0812 13:24:04.193354 1004370 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19411-998978/.minikube/profiles/no-preload-824604/client.crt: no such file or directory
E0812 13:24:04.198697 1004370 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19411-998978/.minikube/profiles/no-preload-824604/client.crt: no such file or directory
E0812 13:24:04.208981 1004370 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19411-998978/.minikube/profiles/no-preload-824604/client.crt: no such file or directory
E0812 13:24:04.229303 1004370 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19411-998978/.minikube/profiles/no-preload-824604/client.crt: no such file or directory
E0812 13:24:04.269566 1004370 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19411-998978/.minikube/profiles/no-preload-824604/client.crt: no such file or directory
E0812 13:24:04.349842 1004370 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19411-998978/.minikube/profiles/no-preload-824604/client.crt: no such file or directory
E0812 13:24:04.510254 1004370 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19411-998978/.minikube/profiles/no-preload-824604/client.crt: no such file or directory
E0812 13:24:04.761676 1004370 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19411-998978/.minikube/profiles/old-k8s-version-112335/client.crt: no such file or directory
E0812 13:24:04.830870 1004370 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19411-998978/.minikube/profiles/no-preload-824604/client.crt: no such file or directory
E0812 13:24:05.471481 1004370 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19411-998978/.minikube/profiles/no-preload-824604/client.crt: no such file or directory
E0812 13:24:06.752471 1004370 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19411-998978/.minikube/profiles/no-preload-824604/client.crt: no such file or directory
E0812 13:24:09.312773 1004370 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19411-998978/.minikube/profiles/no-preload-824604/client.crt: no such file or directory
E0812 13:24:12.756671 1004370 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19411-998978/.minikube/profiles/functional-986276/client.crt: no such file or directory
E0812 13:24:14.433649 1004370 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19411-998978/.minikube/profiles/no-preload-824604/client.crt: no such file or directory
E0812 13:24:24.673866 1004370 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19411-998978/.minikube/profiles/no-preload-824604/client.crt: no such file or directory
E0812 13:24:26.575620 1004370 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19411-998978/.minikube/profiles/addons-673965/client.crt: no such file or directory
E0812 13:24:43.525664 1004370 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19411-998978/.minikube/profiles/addons-673965/client.crt: no such file or directory
E0812 13:24:45.154080 1004370 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19411-998978/.minikube/profiles/no-preload-824604/client.crt: no such file or directory
E0812 13:25:26.114722 1004370 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19411-998978/.minikube/profiles/no-preload-824604/client.crt: no such file or directory
E0812 13:25:26.682027 1004370 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19411-998978/.minikube/profiles/old-k8s-version-112335/client.crt: no such file or directory
start_stop_delete_test.go:256: (dbg) Done: out/minikube-linux-arm64 start -p default-k8s-diff-port-496134 --memory=2200 --alsologtostderr --wait=true --apiserver-port=8444 --driver=docker  --container-runtime=containerd --kubernetes-version=v1.30.3: (4m29.381171825s)
start_stop_delete_test.go:262: (dbg) Run:  out/minikube-linux-arm64 status --format={{.Host}} -p default-k8s-diff-port-496134 -n default-k8s-diff-port-496134
--- PASS: TestStartStop/group/default-k8s-diff-port/serial/SecondStart (269.75s)

                                                
                                    
x
+
TestStartStop/group/default-k8s-diff-port/serial/UserAppExistsAfterStop (6.01s)

                                                
                                                
=== RUN   TestStartStop/group/default-k8s-diff-port/serial/UserAppExistsAfterStop
start_stop_delete_test.go:274: (dbg) TestStartStop/group/default-k8s-diff-port/serial/UserAppExistsAfterStop: waiting 9m0s for pods matching "k8s-app=kubernetes-dashboard" in namespace "kubernetes-dashboard" ...
helpers_test.go:344: "kubernetes-dashboard-779776cb65-gmh8j" [6a08379f-d031-4c79-a5be-ed16c8248cf2] Running
start_stop_delete_test.go:274: (dbg) TestStartStop/group/default-k8s-diff-port/serial/UserAppExistsAfterStop: k8s-app=kubernetes-dashboard healthy within 6.003909761s
--- PASS: TestStartStop/group/default-k8s-diff-port/serial/UserAppExistsAfterStop (6.01s)

                                                
                                    
x
+
TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop (6.01s)

                                                
                                                
=== RUN   TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop
start_stop_delete_test.go:274: (dbg) TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: waiting 9m0s for pods matching "k8s-app=kubernetes-dashboard" in namespace "kubernetes-dashboard" ...
helpers_test.go:344: "kubernetes-dashboard-779776cb65-6x8zl" [d579f4b6-6f9c-486b-893c-cae7045a45ae] Running
start_stop_delete_test.go:274: (dbg) TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: k8s-app=kubernetes-dashboard healthy within 6.004053835s
--- PASS: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop (6.01s)

                                                
                                    
x
+
TestStartStop/group/default-k8s-diff-port/serial/AddonExistsAfterStop (6.11s)

                                                
                                                
=== RUN   TestStartStop/group/default-k8s-diff-port/serial/AddonExistsAfterStop
start_stop_delete_test.go:287: (dbg) TestStartStop/group/default-k8s-diff-port/serial/AddonExistsAfterStop: waiting 9m0s for pods matching "k8s-app=kubernetes-dashboard" in namespace "kubernetes-dashboard" ...
helpers_test.go:344: "kubernetes-dashboard-779776cb65-gmh8j" [6a08379f-d031-4c79-a5be-ed16c8248cf2] Running
start_stop_delete_test.go:287: (dbg) TestStartStop/group/default-k8s-diff-port/serial/AddonExistsAfterStop: k8s-app=kubernetes-dashboard healthy within 6.004124919s
start_stop_delete_test.go:291: (dbg) Run:  kubectl --context default-k8s-diff-port-496134 describe deploy/dashboard-metrics-scraper -n kubernetes-dashboard
--- PASS: TestStartStop/group/default-k8s-diff-port/serial/AddonExistsAfterStop (6.11s)

                                                
                                    
x
+
TestStartStop/group/embed-certs/serial/AddonExistsAfterStop (5.16s)

                                                
                                                
=== RUN   TestStartStop/group/embed-certs/serial/AddonExistsAfterStop
start_stop_delete_test.go:287: (dbg) TestStartStop/group/embed-certs/serial/AddonExistsAfterStop: waiting 9m0s for pods matching "k8s-app=kubernetes-dashboard" in namespace "kubernetes-dashboard" ...
helpers_test.go:344: "kubernetes-dashboard-779776cb65-6x8zl" [d579f4b6-6f9c-486b-893c-cae7045a45ae] Running
start_stop_delete_test.go:287: (dbg) TestStartStop/group/embed-certs/serial/AddonExistsAfterStop: k8s-app=kubernetes-dashboard healthy within 5.007109676s
start_stop_delete_test.go:291: (dbg) Run:  kubectl --context embed-certs-097595 describe deploy/dashboard-metrics-scraper -n kubernetes-dashboard
--- PASS: TestStartStop/group/embed-certs/serial/AddonExistsAfterStop (5.16s)

                                                
                                    
x
+
TestStartStop/group/default-k8s-diff-port/serial/VerifyKubernetesImages (0.25s)

                                                
                                                
=== RUN   TestStartStop/group/default-k8s-diff-port/serial/VerifyKubernetesImages
start_stop_delete_test.go:304: (dbg) Run:  out/minikube-linux-arm64 -p default-k8s-diff-port-496134 image list --format=json
start_stop_delete_test.go:304: Found non-minikube image: kindest/kindnetd:v20240730-75a5af0c
start_stop_delete_test.go:304: Found non-minikube image: gcr.io/k8s-minikube/busybox:1.28.4-glibc
start_stop_delete_test.go:304: Found non-minikube image: kindest/kindnetd:v20240715-585640e9
--- PASS: TestStartStop/group/default-k8s-diff-port/serial/VerifyKubernetesImages (0.25s)

                                                
                                    
x
+
TestStartStop/group/default-k8s-diff-port/serial/Pause (3.11s)

                                                
                                                
=== RUN   TestStartStop/group/default-k8s-diff-port/serial/Pause
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 pause -p default-k8s-diff-port-496134 --alsologtostderr -v=1
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 status --format={{.APIServer}} -p default-k8s-diff-port-496134 -n default-k8s-diff-port-496134
start_stop_delete_test.go:311: (dbg) Non-zero exit: out/minikube-linux-arm64 status --format={{.APIServer}} -p default-k8s-diff-port-496134 -n default-k8s-diff-port-496134: exit status 2 (330.890725ms)

                                                
                                                
-- stdout --
	Paused

                                                
                                                
-- /stdout --
start_stop_delete_test.go:311: status error: exit status 2 (may be ok)
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 status --format={{.Kubelet}} -p default-k8s-diff-port-496134 -n default-k8s-diff-port-496134
start_stop_delete_test.go:311: (dbg) Non-zero exit: out/minikube-linux-arm64 status --format={{.Kubelet}} -p default-k8s-diff-port-496134 -n default-k8s-diff-port-496134: exit status 2 (338.913657ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
start_stop_delete_test.go:311: status error: exit status 2 (may be ok)
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 unpause -p default-k8s-diff-port-496134 --alsologtostderr -v=1
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 status --format={{.APIServer}} -p default-k8s-diff-port-496134 -n default-k8s-diff-port-496134
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 status --format={{.Kubelet}} -p default-k8s-diff-port-496134 -n default-k8s-diff-port-496134
--- PASS: TestStartStop/group/default-k8s-diff-port/serial/Pause (3.11s)

                                                
                                    
x
+
TestStartStop/group/embed-certs/serial/VerifyKubernetesImages (0.29s)

                                                
                                                
=== RUN   TestStartStop/group/embed-certs/serial/VerifyKubernetesImages
start_stop_delete_test.go:304: (dbg) Run:  out/minikube-linux-arm64 -p embed-certs-097595 image list --format=json
start_stop_delete_test.go:304: Found non-minikube image: kindest/kindnetd:v20240715-585640e9
start_stop_delete_test.go:304: Found non-minikube image: kindest/kindnetd:v20240730-75a5af0c
start_stop_delete_test.go:304: Found non-minikube image: gcr.io/k8s-minikube/busybox:1.28.4-glibc
--- PASS: TestStartStop/group/embed-certs/serial/VerifyKubernetesImages (0.29s)

                                                
                                    
x
+
TestStartStop/group/embed-certs/serial/Pause (4.71s)

                                                
                                                
=== RUN   TestStartStop/group/embed-certs/serial/Pause
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 pause -p embed-certs-097595 --alsologtostderr -v=1
start_stop_delete_test.go:311: (dbg) Done: out/minikube-linux-arm64 pause -p embed-certs-097595 --alsologtostderr -v=1: (1.486104432s)
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 status --format={{.APIServer}} -p embed-certs-097595 -n embed-certs-097595
start_stop_delete_test.go:311: (dbg) Non-zero exit: out/minikube-linux-arm64 status --format={{.APIServer}} -p embed-certs-097595 -n embed-certs-097595: exit status 2 (461.56322ms)

                                                
                                                
-- stdout --
	Paused

                                                
                                                
-- /stdout --
start_stop_delete_test.go:311: status error: exit status 2 (may be ok)
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 status --format={{.Kubelet}} -p embed-certs-097595 -n embed-certs-097595
start_stop_delete_test.go:311: (dbg) Non-zero exit: out/minikube-linux-arm64 status --format={{.Kubelet}} -p embed-certs-097595 -n embed-certs-097595: exit status 2 (413.545001ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
start_stop_delete_test.go:311: status error: exit status 2 (may be ok)
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 unpause -p embed-certs-097595 --alsologtostderr -v=1
start_stop_delete_test.go:311: (dbg) Done: out/minikube-linux-arm64 unpause -p embed-certs-097595 --alsologtostderr -v=1: (1.037894377s)
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 status --format={{.APIServer}} -p embed-certs-097595 -n embed-certs-097595
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 status --format={{.Kubelet}} -p embed-certs-097595 -n embed-certs-097595
--- PASS: TestStartStop/group/embed-certs/serial/Pause (4.71s)

                                                
                                    
x
+
TestStartStop/group/newest-cni/serial/FirstStart (43.05s)

                                                
                                                
=== RUN   TestStartStop/group/newest-cni/serial/FirstStart
start_stop_delete_test.go:186: (dbg) Run:  out/minikube-linux-arm64 start -p newest-cni-784780 --memory=2200 --alsologtostderr --wait=apiserver,system_pods,default_sa --feature-gates ServerSideApply=true --network-plugin=cni --extra-config=kubeadm.pod-network-cidr=10.42.0.0/16 --driver=docker  --container-runtime=containerd --kubernetes-version=v1.31.0-rc.0
start_stop_delete_test.go:186: (dbg) Done: out/minikube-linux-arm64 start -p newest-cni-784780 --memory=2200 --alsologtostderr --wait=apiserver,system_pods,default_sa --feature-gates ServerSideApply=true --network-plugin=cni --extra-config=kubeadm.pod-network-cidr=10.42.0.0/16 --driver=docker  --container-runtime=containerd --kubernetes-version=v1.31.0-rc.0: (43.053260744s)
--- PASS: TestStartStop/group/newest-cni/serial/FirstStart (43.05s)

                                                
                                    
x
+
TestNetworkPlugins/group/auto/Start (80.29s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/auto/Start
net_test.go:112: (dbg) Run:  out/minikube-linux-arm64 start -p auto-927381 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --driver=docker  --container-runtime=containerd
net_test.go:112: (dbg) Done: out/minikube-linux-arm64 start -p auto-927381 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --driver=docker  --container-runtime=containerd: (1m20.28896385s)
--- PASS: TestNetworkPlugins/group/auto/Start (80.29s)

                                                
                                    
x
+
TestStartStop/group/newest-cni/serial/DeployApp (0s)

                                                
                                                
=== RUN   TestStartStop/group/newest-cni/serial/DeployApp
--- PASS: TestStartStop/group/newest-cni/serial/DeployApp (0.00s)

                                                
                                    
x
+
TestStartStop/group/newest-cni/serial/EnableAddonWhileActive (1.45s)

                                                
                                                
=== RUN   TestStartStop/group/newest-cni/serial/EnableAddonWhileActive
start_stop_delete_test.go:205: (dbg) Run:  out/minikube-linux-arm64 addons enable metrics-server -p newest-cni-784780 --images=MetricsServer=registry.k8s.io/echoserver:1.4 --registries=MetricsServer=fake.domain
start_stop_delete_test.go:205: (dbg) Done: out/minikube-linux-arm64 addons enable metrics-server -p newest-cni-784780 --images=MetricsServer=registry.k8s.io/echoserver:1.4 --registries=MetricsServer=fake.domain: (1.453628905s)
start_stop_delete_test.go:211: WARNING: cni mode requires additional setup before pods can schedule :(
--- PASS: TestStartStop/group/newest-cni/serial/EnableAddonWhileActive (1.45s)

                                                
                                    
x
+
TestStartStop/group/newest-cni/serial/Stop (1.35s)

                                                
                                                
=== RUN   TestStartStop/group/newest-cni/serial/Stop
start_stop_delete_test.go:228: (dbg) Run:  out/minikube-linux-arm64 stop -p newest-cni-784780 --alsologtostderr -v=3
E0812 13:26:48.034929 1004370 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19411-998978/.minikube/profiles/no-preload-824604/client.crt: no such file or directory
start_stop_delete_test.go:228: (dbg) Done: out/minikube-linux-arm64 stop -p newest-cni-784780 --alsologtostderr -v=3: (1.352475045s)
--- PASS: TestStartStop/group/newest-cni/serial/Stop (1.35s)

                                                
                                    
x
+
TestStartStop/group/newest-cni/serial/EnableAddonAfterStop (0.2s)

                                                
                                                
=== RUN   TestStartStop/group/newest-cni/serial/EnableAddonAfterStop
start_stop_delete_test.go:239: (dbg) Run:  out/minikube-linux-arm64 status --format={{.Host}} -p newest-cni-784780 -n newest-cni-784780
start_stop_delete_test.go:239: (dbg) Non-zero exit: out/minikube-linux-arm64 status --format={{.Host}} -p newest-cni-784780 -n newest-cni-784780: exit status 7 (81.757094ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
start_stop_delete_test.go:239: status error: exit status 7 (may be ok)
start_stop_delete_test.go:246: (dbg) Run:  out/minikube-linux-arm64 addons enable dashboard -p newest-cni-784780 --images=MetricsScraper=registry.k8s.io/echoserver:1.4
--- PASS: TestStartStop/group/newest-cni/serial/EnableAddonAfterStop (0.20s)

                                                
                                    
x
+
TestStartStop/group/newest-cni/serial/SecondStart (19.89s)

                                                
                                                
=== RUN   TestStartStop/group/newest-cni/serial/SecondStart
start_stop_delete_test.go:256: (dbg) Run:  out/minikube-linux-arm64 start -p newest-cni-784780 --memory=2200 --alsologtostderr --wait=apiserver,system_pods,default_sa --feature-gates ServerSideApply=true --network-plugin=cni --extra-config=kubeadm.pod-network-cidr=10.42.0.0/16 --driver=docker  --container-runtime=containerd --kubernetes-version=v1.31.0-rc.0
start_stop_delete_test.go:256: (dbg) Done: out/minikube-linux-arm64 start -p newest-cni-784780 --memory=2200 --alsologtostderr --wait=apiserver,system_pods,default_sa --feature-gates ServerSideApply=true --network-plugin=cni --extra-config=kubeadm.pod-network-cidr=10.42.0.0/16 --driver=docker  --container-runtime=containerd --kubernetes-version=v1.31.0-rc.0: (19.476065926s)
start_stop_delete_test.go:262: (dbg) Run:  out/minikube-linux-arm64 status --format={{.Host}} -p newest-cni-784780 -n newest-cni-784780
--- PASS: TestStartStop/group/newest-cni/serial/SecondStart (19.89s)

                                                
                                    
x
+
TestStartStop/group/newest-cni/serial/UserAppExistsAfterStop (0s)

                                                
                                                
=== RUN   TestStartStop/group/newest-cni/serial/UserAppExistsAfterStop
start_stop_delete_test.go:273: WARNING: cni mode requires additional setup before pods can schedule :(
--- PASS: TestStartStop/group/newest-cni/serial/UserAppExistsAfterStop (0.00s)

                                                
                                    
x
+
TestStartStop/group/newest-cni/serial/AddonExistsAfterStop (0s)

                                                
                                                
=== RUN   TestStartStop/group/newest-cni/serial/AddonExistsAfterStop
start_stop_delete_test.go:284: WARNING: cni mode requires additional setup before pods can schedule :(
--- PASS: TestStartStop/group/newest-cni/serial/AddonExistsAfterStop (0.00s)

                                                
                                    
x
+
TestStartStop/group/newest-cni/serial/VerifyKubernetesImages (0.26s)

                                                
                                                
=== RUN   TestStartStop/group/newest-cni/serial/VerifyKubernetesImages
start_stop_delete_test.go:304: (dbg) Run:  out/minikube-linux-arm64 -p newest-cni-784780 image list --format=json
start_stop_delete_test.go:304: Found non-minikube image: kindest/kindnetd:v20240719-e7903573
start_stop_delete_test.go:304: Found non-minikube image: kindest/kindnetd:v20240730-75a5af0c
--- PASS: TestStartStop/group/newest-cni/serial/VerifyKubernetesImages (0.26s)

                                                
                                    
x
+
TestStartStop/group/newest-cni/serial/Pause (3.04s)

                                                
                                                
=== RUN   TestStartStop/group/newest-cni/serial/Pause
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 pause -p newest-cni-784780 --alsologtostderr -v=1
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 status --format={{.APIServer}} -p newest-cni-784780 -n newest-cni-784780
start_stop_delete_test.go:311: (dbg) Non-zero exit: out/minikube-linux-arm64 status --format={{.APIServer}} -p newest-cni-784780 -n newest-cni-784780: exit status 2 (316.334184ms)

                                                
                                                
-- stdout --
	Paused

                                                
                                                
-- /stdout --
start_stop_delete_test.go:311: status error: exit status 2 (may be ok)
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 status --format={{.Kubelet}} -p newest-cni-784780 -n newest-cni-784780
start_stop_delete_test.go:311: (dbg) Non-zero exit: out/minikube-linux-arm64 status --format={{.Kubelet}} -p newest-cni-784780 -n newest-cni-784780: exit status 2 (369.215904ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
start_stop_delete_test.go:311: status error: exit status 2 (may be ok)
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 unpause -p newest-cni-784780 --alsologtostderr -v=1
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 status --format={{.APIServer}} -p newest-cni-784780 -n newest-cni-784780
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 status --format={{.Kubelet}} -p newest-cni-784780 -n newest-cni-784780
--- PASS: TestStartStop/group/newest-cni/serial/Pause (3.04s)
E0812 13:32:39.163753 1004370 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19411-998978/.minikube/profiles/auto-927381/client.crt: no such file or directory
E0812 13:32:42.840595 1004370 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19411-998978/.minikube/profiles/old-k8s-version-112335/client.crt: no such file or directory
E0812 13:32:49.404011 1004370 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19411-998978/.minikube/profiles/auto-927381/client.crt: no such file or directory

                                                
                                    
x
+
TestNetworkPlugins/group/kindnet/Start (76.26s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/kindnet/Start
net_test.go:112: (dbg) Run:  out/minikube-linux-arm64 start -p kindnet-927381 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --cni=kindnet --driver=docker  --container-runtime=containerd
net_test.go:112: (dbg) Done: out/minikube-linux-arm64 start -p kindnet-927381 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --cni=kindnet --driver=docker  --container-runtime=containerd: (1m16.261605782s)
--- PASS: TestNetworkPlugins/group/kindnet/Start (76.26s)

                                                
                                    
x
+
TestNetworkPlugins/group/auto/KubeletFlags (0.41s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/auto/KubeletFlags
net_test.go:133: (dbg) Run:  out/minikube-linux-arm64 ssh -p auto-927381 "pgrep -a kubelet"
--- PASS: TestNetworkPlugins/group/auto/KubeletFlags (0.41s)

                                                
                                    
x
+
TestNetworkPlugins/group/auto/NetCatPod (12.31s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/auto/NetCatPod
net_test.go:149: (dbg) Run:  kubectl --context auto-927381 replace --force -f testdata/netcat-deployment.yaml
net_test.go:163: (dbg) TestNetworkPlugins/group/auto/NetCatPod: waiting 15m0s for pods matching "app=netcat" in namespace "default" ...
helpers_test.go:344: "netcat-6bc787d567-tznsj" [73c248af-d6bf-4b45-ac92-a1980a62214c] Pending / Ready:ContainersNotReady (containers with unready status: [dnsutils]) / ContainersReady:ContainersNotReady (containers with unready status: [dnsutils])
helpers_test.go:344: "netcat-6bc787d567-tznsj" [73c248af-d6bf-4b45-ac92-a1980a62214c] Running
net_test.go:163: (dbg) TestNetworkPlugins/group/auto/NetCatPod: app=netcat healthy within 12.003004983s
--- PASS: TestNetworkPlugins/group/auto/NetCatPod (12.31s)

                                                
                                    
x
+
TestNetworkPlugins/group/auto/DNS (0.25s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/auto/DNS
net_test.go:175: (dbg) Run:  kubectl --context auto-927381 exec deployment/netcat -- nslookup kubernetes.default
--- PASS: TestNetworkPlugins/group/auto/DNS (0.25s)

                                                
                                    
x
+
TestNetworkPlugins/group/auto/Localhost (0.25s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/auto/Localhost
net_test.go:194: (dbg) Run:  kubectl --context auto-927381 exec deployment/netcat -- /bin/sh -c "nc -w 5 -i 5 -z localhost 8080"
--- PASS: TestNetworkPlugins/group/auto/Localhost (0.25s)

                                                
                                    
x
+
TestNetworkPlugins/group/auto/HairPin (0.18s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/auto/HairPin
net_test.go:264: (dbg) Run:  kubectl --context auto-927381 exec deployment/netcat -- /bin/sh -c "nc -w 5 -i 5 -z netcat 8080"
--- PASS: TestNetworkPlugins/group/auto/HairPin (0.18s)

                                                
                                    
x
+
TestNetworkPlugins/group/calico/Start (77.55s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/calico/Start
net_test.go:112: (dbg) Run:  out/minikube-linux-arm64 start -p calico-927381 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --cni=calico --driver=docker  --container-runtime=containerd
E0812 13:28:10.522425 1004370 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19411-998978/.minikube/profiles/old-k8s-version-112335/client.crt: no such file or directory
net_test.go:112: (dbg) Done: out/minikube-linux-arm64 start -p calico-927381 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --cni=calico --driver=docker  --container-runtime=containerd: (1m17.547824725s)
--- PASS: TestNetworkPlugins/group/calico/Start (77.55s)

                                                
                                    
x
+
TestNetworkPlugins/group/kindnet/ControllerPod (6.01s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/kindnet/ControllerPod
net_test.go:120: (dbg) TestNetworkPlugins/group/kindnet/ControllerPod: waiting 10m0s for pods matching "app=kindnet" in namespace "kube-system" ...
helpers_test.go:344: "kindnet-s78rh" [5278206e-2c9b-4268-9a83-31ca77c99aa5] Running
net_test.go:120: (dbg) TestNetworkPlugins/group/kindnet/ControllerPod: app=kindnet healthy within 6.00533079s
--- PASS: TestNetworkPlugins/group/kindnet/ControllerPod (6.01s)

                                                
                                    
x
+
TestNetworkPlugins/group/kindnet/KubeletFlags (0.31s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/kindnet/KubeletFlags
net_test.go:133: (dbg) Run:  out/minikube-linux-arm64 ssh -p kindnet-927381 "pgrep -a kubelet"
--- PASS: TestNetworkPlugins/group/kindnet/KubeletFlags (0.31s)

                                                
                                    
x
+
TestNetworkPlugins/group/kindnet/NetCatPod (10.33s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/kindnet/NetCatPod
net_test.go:149: (dbg) Run:  kubectl --context kindnet-927381 replace --force -f testdata/netcat-deployment.yaml
net_test.go:163: (dbg) TestNetworkPlugins/group/kindnet/NetCatPod: waiting 15m0s for pods matching "app=netcat" in namespace "default" ...
helpers_test.go:344: "netcat-6bc787d567-lmstd" [de556b42-f00f-42f2-bdcf-594d90574bfd] Pending / Ready:ContainersNotReady (containers with unready status: [dnsutils]) / ContainersReady:ContainersNotReady (containers with unready status: [dnsutils])
helpers_test.go:344: "netcat-6bc787d567-lmstd" [de556b42-f00f-42f2-bdcf-594d90574bfd] Running
net_test.go:163: (dbg) TestNetworkPlugins/group/kindnet/NetCatPod: app=netcat healthy within 10.003752578s
--- PASS: TestNetworkPlugins/group/kindnet/NetCatPod (10.33s)

                                                
                                    
x
+
TestNetworkPlugins/group/kindnet/DNS (0.2s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/kindnet/DNS
net_test.go:175: (dbg) Run:  kubectl --context kindnet-927381 exec deployment/netcat -- nslookup kubernetes.default
--- PASS: TestNetworkPlugins/group/kindnet/DNS (0.20s)

                                                
                                    
x
+
TestNetworkPlugins/group/kindnet/Localhost (0.17s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/kindnet/Localhost
net_test.go:194: (dbg) Run:  kubectl --context kindnet-927381 exec deployment/netcat -- /bin/sh -c "nc -w 5 -i 5 -z localhost 8080"
--- PASS: TestNetworkPlugins/group/kindnet/Localhost (0.17s)

                                                
                                    
x
+
TestNetworkPlugins/group/kindnet/HairPin (0.2s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/kindnet/HairPin
net_test.go:264: (dbg) Run:  kubectl --context kindnet-927381 exec deployment/netcat -- /bin/sh -c "nc -w 5 -i 5 -z netcat 8080"
--- PASS: TestNetworkPlugins/group/kindnet/HairPin (0.20s)

                                                
                                    
x
+
TestNetworkPlugins/group/custom-flannel/Start (62.44s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/custom-flannel/Start
net_test.go:112: (dbg) Run:  out/minikube-linux-arm64 start -p custom-flannel-927381 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --cni=testdata/kube-flannel.yaml --driver=docker  --container-runtime=containerd
E0812 13:29:12.756722 1004370 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19411-998978/.minikube/profiles/functional-986276/client.crt: no such file or directory
net_test.go:112: (dbg) Done: out/minikube-linux-arm64 start -p custom-flannel-927381 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --cni=testdata/kube-flannel.yaml --driver=docker  --container-runtime=containerd: (1m2.43858804s)
--- PASS: TestNetworkPlugins/group/custom-flannel/Start (62.44s)

                                                
                                    
x
+
TestNetworkPlugins/group/calico/ControllerPod (6.01s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/calico/ControllerPod
net_test.go:120: (dbg) TestNetworkPlugins/group/calico/ControllerPod: waiting 10m0s for pods matching "k8s-app=calico-node" in namespace "kube-system" ...
helpers_test.go:344: "calico-node-gxrdl" [3f8d2e34-6e89-4a40-b24b-6fe2dfc2d13a] Running
net_test.go:120: (dbg) TestNetworkPlugins/group/calico/ControllerPod: k8s-app=calico-node healthy within 6.006402391s
--- PASS: TestNetworkPlugins/group/calico/ControllerPod (6.01s)

                                                
                                    
x
+
TestNetworkPlugins/group/calico/KubeletFlags (0.36s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/calico/KubeletFlags
net_test.go:133: (dbg) Run:  out/minikube-linux-arm64 ssh -p calico-927381 "pgrep -a kubelet"
--- PASS: TestNetworkPlugins/group/calico/KubeletFlags (0.36s)

                                                
                                    
x
+
TestNetworkPlugins/group/calico/NetCatPod (11.34s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/calico/NetCatPod
net_test.go:149: (dbg) Run:  kubectl --context calico-927381 replace --force -f testdata/netcat-deployment.yaml
net_test.go:163: (dbg) TestNetworkPlugins/group/calico/NetCatPod: waiting 15m0s for pods matching "app=netcat" in namespace "default" ...
helpers_test.go:344: "netcat-6bc787d567-7fv24" [786dfaf8-2079-489b-8524-42c910a943fc] Pending / Ready:ContainersNotReady (containers with unready status: [dnsutils]) / ContainersReady:ContainersNotReady (containers with unready status: [dnsutils])
E0812 13:29:31.875756 1004370 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19411-998978/.minikube/profiles/no-preload-824604/client.crt: no such file or directory
helpers_test.go:344: "netcat-6bc787d567-7fv24" [786dfaf8-2079-489b-8524-42c910a943fc] Running
net_test.go:163: (dbg) TestNetworkPlugins/group/calico/NetCatPod: app=netcat healthy within 11.003788059s
--- PASS: TestNetworkPlugins/group/calico/NetCatPod (11.34s)

                                                
                                    
x
+
TestNetworkPlugins/group/calico/DNS (0.25s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/calico/DNS
net_test.go:175: (dbg) Run:  kubectl --context calico-927381 exec deployment/netcat -- nslookup kubernetes.default
--- PASS: TestNetworkPlugins/group/calico/DNS (0.25s)

                                                
                                    
x
+
TestNetworkPlugins/group/calico/Localhost (0.26s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/calico/Localhost
net_test.go:194: (dbg) Run:  kubectl --context calico-927381 exec deployment/netcat -- /bin/sh -c "nc -w 5 -i 5 -z localhost 8080"
--- PASS: TestNetworkPlugins/group/calico/Localhost (0.26s)

                                                
                                    
x
+
TestNetworkPlugins/group/calico/HairPin (0.27s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/calico/HairPin
net_test.go:264: (dbg) Run:  kubectl --context calico-927381 exec deployment/netcat -- /bin/sh -c "nc -w 5 -i 5 -z netcat 8080"
--- PASS: TestNetworkPlugins/group/calico/HairPin (0.27s)

                                                
                                    
x
+
TestNetworkPlugins/group/enable-default-cni/Start (56.03s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/enable-default-cni/Start
net_test.go:112: (dbg) Run:  out/minikube-linux-arm64 start -p enable-default-cni-927381 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --enable-default-cni=true --driver=docker  --container-runtime=containerd
net_test.go:112: (dbg) Done: out/minikube-linux-arm64 start -p enable-default-cni-927381 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --enable-default-cni=true --driver=docker  --container-runtime=containerd: (56.0327132s)
--- PASS: TestNetworkPlugins/group/enable-default-cni/Start (56.03s)

                                                
                                    
x
+
TestNetworkPlugins/group/custom-flannel/KubeletFlags (0.36s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/custom-flannel/KubeletFlags
net_test.go:133: (dbg) Run:  out/minikube-linux-arm64 ssh -p custom-flannel-927381 "pgrep -a kubelet"
--- PASS: TestNetworkPlugins/group/custom-flannel/KubeletFlags (0.36s)

                                                
                                    
x
+
TestNetworkPlugins/group/custom-flannel/NetCatPod (10.26s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/custom-flannel/NetCatPod
net_test.go:149: (dbg) Run:  kubectl --context custom-flannel-927381 replace --force -f testdata/netcat-deployment.yaml
net_test.go:163: (dbg) TestNetworkPlugins/group/custom-flannel/NetCatPod: waiting 15m0s for pods matching "app=netcat" in namespace "default" ...
helpers_test.go:344: "netcat-6bc787d567-4r4pp" [4c7ae848-3c59-4d48-8089-a0a44b670374] Pending / Ready:ContainersNotReady (containers with unready status: [dnsutils]) / ContainersReady:ContainersNotReady (containers with unready status: [dnsutils])
helpers_test.go:344: "netcat-6bc787d567-4r4pp" [4c7ae848-3c59-4d48-8089-a0a44b670374] Running
net_test.go:163: (dbg) TestNetworkPlugins/group/custom-flannel/NetCatPod: app=netcat healthy within 10.003545183s
--- PASS: TestNetworkPlugins/group/custom-flannel/NetCatPod (10.26s)

                                                
                                    
x
+
TestNetworkPlugins/group/custom-flannel/DNS (0.25s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/custom-flannel/DNS
net_test.go:175: (dbg) Run:  kubectl --context custom-flannel-927381 exec deployment/netcat -- nslookup kubernetes.default
--- PASS: TestNetworkPlugins/group/custom-flannel/DNS (0.25s)

                                                
                                    
x
+
TestNetworkPlugins/group/custom-flannel/Localhost (0.19s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/custom-flannel/Localhost
net_test.go:194: (dbg) Run:  kubectl --context custom-flannel-927381 exec deployment/netcat -- /bin/sh -c "nc -w 5 -i 5 -z localhost 8080"
--- PASS: TestNetworkPlugins/group/custom-flannel/Localhost (0.19s)

                                                
                                    
x
+
TestNetworkPlugins/group/custom-flannel/HairPin (0.21s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/custom-flannel/HairPin
net_test.go:264: (dbg) Run:  kubectl --context custom-flannel-927381 exec deployment/netcat -- /bin/sh -c "nc -w 5 -i 5 -z netcat 8080"
--- PASS: TestNetworkPlugins/group/custom-flannel/HairPin (0.21s)

                                                
                                    
x
+
TestNetworkPlugins/group/flannel/Start (61.82s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/flannel/Start
net_test.go:112: (dbg) Run:  out/minikube-linux-arm64 start -p flannel-927381 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --cni=flannel --driver=docker  --container-runtime=containerd
E0812 13:30:51.093007 1004370 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19411-998978/.minikube/profiles/default-k8s-diff-port-496134/client.crt: no such file or directory
E0812 13:30:51.101574 1004370 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19411-998978/.minikube/profiles/default-k8s-diff-port-496134/client.crt: no such file or directory
E0812 13:30:51.113723 1004370 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19411-998978/.minikube/profiles/default-k8s-diff-port-496134/client.crt: no such file or directory
E0812 13:30:51.134031 1004370 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19411-998978/.minikube/profiles/default-k8s-diff-port-496134/client.crt: no such file or directory
E0812 13:30:51.174918 1004370 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19411-998978/.minikube/profiles/default-k8s-diff-port-496134/client.crt: no such file or directory
E0812 13:30:51.255641 1004370 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19411-998978/.minikube/profiles/default-k8s-diff-port-496134/client.crt: no such file or directory
E0812 13:30:51.416245 1004370 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19411-998978/.minikube/profiles/default-k8s-diff-port-496134/client.crt: no such file or directory
E0812 13:30:51.737393 1004370 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19411-998978/.minikube/profiles/default-k8s-diff-port-496134/client.crt: no such file or directory
E0812 13:30:52.378137 1004370 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19411-998978/.minikube/profiles/default-k8s-diff-port-496134/client.crt: no such file or directory
E0812 13:30:53.659016 1004370 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19411-998978/.minikube/profiles/default-k8s-diff-port-496134/client.crt: no such file or directory
E0812 13:30:56.219815 1004370 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19411-998978/.minikube/profiles/default-k8s-diff-port-496134/client.crt: no such file or directory
E0812 13:31:01.340697 1004370 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19411-998978/.minikube/profiles/default-k8s-diff-port-496134/client.crt: no such file or directory
net_test.go:112: (dbg) Done: out/minikube-linux-arm64 start -p flannel-927381 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --cni=flannel --driver=docker  --container-runtime=containerd: (1m1.817157305s)
--- PASS: TestNetworkPlugins/group/flannel/Start (61.82s)

                                                
                                    
x
+
TestNetworkPlugins/group/enable-default-cni/KubeletFlags (0.41s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/enable-default-cni/KubeletFlags
net_test.go:133: (dbg) Run:  out/minikube-linux-arm64 ssh -p enable-default-cni-927381 "pgrep -a kubelet"
--- PASS: TestNetworkPlugins/group/enable-default-cni/KubeletFlags (0.41s)

                                                
                                    
x
+
TestNetworkPlugins/group/enable-default-cni/NetCatPod (11.36s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/enable-default-cni/NetCatPod
net_test.go:149: (dbg) Run:  kubectl --context enable-default-cni-927381 replace --force -f testdata/netcat-deployment.yaml
net_test.go:163: (dbg) TestNetworkPlugins/group/enable-default-cni/NetCatPod: waiting 15m0s for pods matching "app=netcat" in namespace "default" ...
helpers_test.go:344: "netcat-6bc787d567-fzb66" [3c4d8425-ce46-4bb0-9077-3afab086015b] Pending / Ready:ContainersNotReady (containers with unready status: [dnsutils]) / ContainersReady:ContainersNotReady (containers with unready status: [dnsutils])
helpers_test.go:344: "netcat-6bc787d567-fzb66" [3c4d8425-ce46-4bb0-9077-3afab086015b] Running
E0812 13:31:11.580906 1004370 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19411-998978/.minikube/profiles/default-k8s-diff-port-496134/client.crt: no such file or directory
net_test.go:163: (dbg) TestNetworkPlugins/group/enable-default-cni/NetCatPod: app=netcat healthy within 11.003754092s
--- PASS: TestNetworkPlugins/group/enable-default-cni/NetCatPod (11.36s)

                                                
                                    
x
+
TestNetworkPlugins/group/enable-default-cni/DNS (0.18s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/enable-default-cni/DNS
net_test.go:175: (dbg) Run:  kubectl --context enable-default-cni-927381 exec deployment/netcat -- nslookup kubernetes.default
--- PASS: TestNetworkPlugins/group/enable-default-cni/DNS (0.18s)

                                                
                                    
x
+
TestNetworkPlugins/group/enable-default-cni/Localhost (0.15s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/enable-default-cni/Localhost
net_test.go:194: (dbg) Run:  kubectl --context enable-default-cni-927381 exec deployment/netcat -- /bin/sh -c "nc -w 5 -i 5 -z localhost 8080"
--- PASS: TestNetworkPlugins/group/enable-default-cni/Localhost (0.15s)

                                                
                                    
x
+
TestNetworkPlugins/group/enable-default-cni/HairPin (0.29s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/enable-default-cni/HairPin
net_test.go:264: (dbg) Run:  kubectl --context enable-default-cni-927381 exec deployment/netcat -- /bin/sh -c "nc -w 5 -i 5 -z netcat 8080"
--- PASS: TestNetworkPlugins/group/enable-default-cni/HairPin (0.29s)

                                                
                                    
x
+
TestNetworkPlugins/group/bridge/Start (86.25s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/bridge/Start
net_test.go:112: (dbg) Run:  out/minikube-linux-arm64 start -p bridge-927381 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --cni=bridge --driver=docker  --container-runtime=containerd
net_test.go:112: (dbg) Done: out/minikube-linux-arm64 start -p bridge-927381 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --cni=bridge --driver=docker  --container-runtime=containerd: (1m26.254247987s)
--- PASS: TestNetworkPlugins/group/bridge/Start (86.25s)

                                                
                                    
x
+
TestNetworkPlugins/group/flannel/ControllerPod (6.01s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/flannel/ControllerPod
net_test.go:120: (dbg) TestNetworkPlugins/group/flannel/ControllerPod: waiting 10m0s for pods matching "app=flannel" in namespace "kube-flannel" ...
helpers_test.go:344: "kube-flannel-ds-llhxp" [5cf385dd-4dad-446e-b377-ea5dbabbd3e4] Running
net_test.go:120: (dbg) TestNetworkPlugins/group/flannel/ControllerPod: app=flannel healthy within 6.004249141s
--- PASS: TestNetworkPlugins/group/flannel/ControllerPod (6.01s)

                                                
                                    
x
+
TestNetworkPlugins/group/flannel/KubeletFlags (0.47s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/flannel/KubeletFlags
net_test.go:133: (dbg) Run:  out/minikube-linux-arm64 ssh -p flannel-927381 "pgrep -a kubelet"
--- PASS: TestNetworkPlugins/group/flannel/KubeletFlags (0.47s)

                                                
                                    
x
+
TestNetworkPlugins/group/flannel/NetCatPod (12.4s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/flannel/NetCatPod
net_test.go:149: (dbg) Run:  kubectl --context flannel-927381 replace --force -f testdata/netcat-deployment.yaml
net_test.go:163: (dbg) TestNetworkPlugins/group/flannel/NetCatPod: waiting 15m0s for pods matching "app=netcat" in namespace "default" ...
helpers_test.go:344: "netcat-6bc787d567-4bqc9" [f4f97d00-4836-4342-9dd2-1441a16c9ecf] Pending / Ready:ContainersNotReady (containers with unready status: [dnsutils]) / ContainersReady:ContainersNotReady (containers with unready status: [dnsutils])
helpers_test.go:344: "netcat-6bc787d567-4bqc9" [f4f97d00-4836-4342-9dd2-1441a16c9ecf] Running
net_test.go:163: (dbg) TestNetworkPlugins/group/flannel/NetCatPod: app=netcat healthy within 12.004062532s
--- PASS: TestNetworkPlugins/group/flannel/NetCatPod (12.40s)

                                                
                                    
x
+
TestNetworkPlugins/group/flannel/DNS (0.18s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/flannel/DNS
net_test.go:175: (dbg) Run:  kubectl --context flannel-927381 exec deployment/netcat -- nslookup kubernetes.default
--- PASS: TestNetworkPlugins/group/flannel/DNS (0.18s)

                                                
                                    
x
+
TestNetworkPlugins/group/flannel/Localhost (0.19s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/flannel/Localhost
net_test.go:194: (dbg) Run:  kubectl --context flannel-927381 exec deployment/netcat -- /bin/sh -c "nc -w 5 -i 5 -z localhost 8080"
--- PASS: TestNetworkPlugins/group/flannel/Localhost (0.19s)

                                                
                                    
x
+
TestNetworkPlugins/group/flannel/HairPin (0.17s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/flannel/HairPin
net_test.go:264: (dbg) Run:  kubectl --context flannel-927381 exec deployment/netcat -- /bin/sh -c "nc -w 5 -i 5 -z netcat 8080"
--- PASS: TestNetworkPlugins/group/flannel/HairPin (0.17s)

                                                
                                    
x
+
TestNetworkPlugins/group/bridge/KubeletFlags (0.28s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/bridge/KubeletFlags
net_test.go:133: (dbg) Run:  out/minikube-linux-arm64 ssh -p bridge-927381 "pgrep -a kubelet"
--- PASS: TestNetworkPlugins/group/bridge/KubeletFlags (0.28s)

                                                
                                    
x
+
TestNetworkPlugins/group/bridge/NetCatPod (8.26s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/bridge/NetCatPod
net_test.go:149: (dbg) Run:  kubectl --context bridge-927381 replace --force -f testdata/netcat-deployment.yaml
net_test.go:163: (dbg) TestNetworkPlugins/group/bridge/NetCatPod: waiting 15m0s for pods matching "app=netcat" in namespace "default" ...
helpers_test.go:344: "netcat-6bc787d567-fx6j4" [0b500479-398d-4682-aa19-33fa1a179c03] Pending / Ready:ContainersNotReady (containers with unready status: [dnsutils]) / ContainersReady:ContainersNotReady (containers with unready status: [dnsutils])
helpers_test.go:344: "netcat-6bc787d567-fx6j4" [0b500479-398d-4682-aa19-33fa1a179c03] Running
E0812 13:33:09.884369 1004370 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19411-998978/.minikube/profiles/auto-927381/client.crt: no such file or directory
net_test.go:163: (dbg) TestNetworkPlugins/group/bridge/NetCatPod: app=netcat healthy within 8.003798676s
--- PASS: TestNetworkPlugins/group/bridge/NetCatPod (8.26s)

                                                
                                    
x
+
TestNetworkPlugins/group/bridge/DNS (0.18s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/bridge/DNS
net_test.go:175: (dbg) Run:  kubectl --context bridge-927381 exec deployment/netcat -- nslookup kubernetes.default
--- PASS: TestNetworkPlugins/group/bridge/DNS (0.18s)

                                                
                                    
x
+
TestNetworkPlugins/group/bridge/Localhost (0.15s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/bridge/Localhost
net_test.go:194: (dbg) Run:  kubectl --context bridge-927381 exec deployment/netcat -- /bin/sh -c "nc -w 5 -i 5 -z localhost 8080"
--- PASS: TestNetworkPlugins/group/bridge/Localhost (0.15s)

                                                
                                    
x
+
TestNetworkPlugins/group/bridge/HairPin (0.14s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/bridge/HairPin
net_test.go:264: (dbg) Run:  kubectl --context bridge-927381 exec deployment/netcat -- /bin/sh -c "nc -w 5 -i 5 -z netcat 8080"
--- PASS: TestNetworkPlugins/group/bridge/HairPin (0.14s)

                                                
                                    

Test skip (31/336)

x
+
TestDownloadOnly/v1.20.0/cached-images (0s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.20.0/cached-images
aaa_download_only_test.go:129: Preload exists, images won't be cached
--- SKIP: TestDownloadOnly/v1.20.0/cached-images (0.00s)

                                                
                                    
x
+
TestDownloadOnly/v1.20.0/binaries (0s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.20.0/binaries
aaa_download_only_test.go:151: Preload exists, binaries are present within.
--- SKIP: TestDownloadOnly/v1.20.0/binaries (0.00s)

                                                
                                    
x
+
TestDownloadOnly/v1.20.0/kubectl (0s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.20.0/kubectl
aaa_download_only_test.go:167: Test for darwin and windows
--- SKIP: TestDownloadOnly/v1.20.0/kubectl (0.00s)

                                                
                                    
x
+
TestDownloadOnly/v1.30.3/cached-images (0s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.30.3/cached-images
aaa_download_only_test.go:129: Preload exists, images won't be cached
--- SKIP: TestDownloadOnly/v1.30.3/cached-images (0.00s)

                                                
                                    
x
+
TestDownloadOnly/v1.30.3/binaries (0s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.30.3/binaries
aaa_download_only_test.go:151: Preload exists, binaries are present within.
--- SKIP: TestDownloadOnly/v1.30.3/binaries (0.00s)

                                                
                                    
x
+
TestDownloadOnly/v1.30.3/kubectl (0s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.30.3/kubectl
aaa_download_only_test.go:167: Test for darwin and windows
--- SKIP: TestDownloadOnly/v1.30.3/kubectl (0.00s)

                                                
                                    
x
+
TestDownloadOnly/v1.31.0-rc.0/cached-images (0s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.31.0-rc.0/cached-images
aaa_download_only_test.go:129: Preload exists, images won't be cached
--- SKIP: TestDownloadOnly/v1.31.0-rc.0/cached-images (0.00s)

                                                
                                    
x
+
TestDownloadOnly/v1.31.0-rc.0/binaries (0s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.31.0-rc.0/binaries
aaa_download_only_test.go:151: Preload exists, binaries are present within.
--- SKIP: TestDownloadOnly/v1.31.0-rc.0/binaries (0.00s)

                                                
                                    
x
+
TestDownloadOnly/v1.31.0-rc.0/kubectl (0s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.31.0-rc.0/kubectl
aaa_download_only_test.go:167: Test for darwin and windows
--- SKIP: TestDownloadOnly/v1.31.0-rc.0/kubectl (0.00s)

                                                
                                    
x
+
TestDownloadOnlyKic (0.58s)

                                                
                                                
=== RUN   TestDownloadOnlyKic
aaa_download_only_test.go:232: (dbg) Run:  out/minikube-linux-arm64 start --download-only -p download-docker-202455 --alsologtostderr --driver=docker  --container-runtime=containerd
aaa_download_only_test.go:244: Skip for arm64 platform. See https://github.com/kubernetes/minikube/issues/10144
helpers_test.go:175: Cleaning up "download-docker-202455" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-arm64 delete -p download-docker-202455
--- SKIP: TestDownloadOnlyKic (0.58s)

                                                
                                    
x
+
TestOffline (0s)

                                                
                                                
=== RUN   TestOffline
=== PAUSE TestOffline

                                                
                                                

                                                
                                                
=== CONT  TestOffline
aab_offline_test.go:35: skipping TestOffline - only docker runtime supported on arm64. See https://github.com/kubernetes/minikube/issues/10144
--- SKIP: TestOffline (0.00s)

                                                
                                    
x
+
TestAddons/parallel/HelmTiller (0s)

                                                
                                                
=== RUN   TestAddons/parallel/HelmTiller
=== PAUSE TestAddons/parallel/HelmTiller

                                                
                                                

                                                
                                                
=== CONT  TestAddons/parallel/HelmTiller
addons_test.go:446: skip Helm test on arm64
--- SKIP: TestAddons/parallel/HelmTiller (0.00s)

                                                
                                    
x
+
TestAddons/parallel/Olm (0s)

                                                
                                                
=== RUN   TestAddons/parallel/Olm
=== PAUSE TestAddons/parallel/Olm

                                                
                                                

                                                
                                                
=== CONT  TestAddons/parallel/Olm
addons_test.go:500: Skipping OLM addon test until https://github.com/operator-framework/operator-lifecycle-manager/issues/2534 is resolved
--- SKIP: TestAddons/parallel/Olm (0.00s)

                                                
                                    
x
+
TestDockerFlags (0s)

                                                
                                                
=== RUN   TestDockerFlags
docker_test.go:41: skipping: only runs with docker container runtime, currently testing containerd
--- SKIP: TestDockerFlags (0.00s)

                                                
                                    
x
+
TestKVMDriverInstallOrUpdate (0s)

                                                
                                                
=== RUN   TestKVMDriverInstallOrUpdate
driver_install_or_update_test.go:45: Skip if arm64. See https://github.com/kubernetes/minikube/issues/10144
--- SKIP: TestKVMDriverInstallOrUpdate (0.00s)

                                                
                                    
x
+
TestHyperKitDriverInstallOrUpdate (0s)

                                                
                                                
=== RUN   TestHyperKitDriverInstallOrUpdate
driver_install_or_update_test.go:105: Skip if not darwin.
--- SKIP: TestHyperKitDriverInstallOrUpdate (0.00s)

                                                
                                    
x
+
TestHyperkitDriverSkipUpgrade (0s)

                                                
                                                
=== RUN   TestHyperkitDriverSkipUpgrade
driver_install_or_update_test.go:169: Skip if not darwin.
--- SKIP: TestHyperkitDriverSkipUpgrade (0.00s)

                                                
                                    
x
+
TestFunctional/parallel/MySQL (0s)

                                                
                                                
=== RUN   TestFunctional/parallel/MySQL
=== PAUSE TestFunctional/parallel/MySQL

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/MySQL
functional_test.go:1787: arm64 is not supported by mysql. Skip the test. See https://github.com/kubernetes/minikube/issues/10144
--- SKIP: TestFunctional/parallel/MySQL (0.00s)

                                                
                                    
x
+
TestFunctional/parallel/DockerEnv (0s)

                                                
                                                
=== RUN   TestFunctional/parallel/DockerEnv
=== PAUSE TestFunctional/parallel/DockerEnv

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/DockerEnv
functional_test.go:463: only validate docker env with docker container runtime, currently testing containerd
--- SKIP: TestFunctional/parallel/DockerEnv (0.00s)

                                                
                                    
x
+
TestFunctional/parallel/PodmanEnv (0s)

                                                
                                                
=== RUN   TestFunctional/parallel/PodmanEnv
=== PAUSE TestFunctional/parallel/PodmanEnv

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/PodmanEnv
functional_test.go:550: only validate podman env with docker container runtime, currently testing containerd
--- SKIP: TestFunctional/parallel/PodmanEnv (0.00s)

                                                
                                    
x
+
TestFunctional/parallel/TunnelCmd/serial/DNSResolutionByDig (0s)

                                                
                                                
=== RUN   TestFunctional/parallel/TunnelCmd/serial/DNSResolutionByDig
functional_test_tunnel_test.go:99: DNS forwarding is only supported for Hyperkit on Darwin, skipping test DNS forwarding
--- SKIP: TestFunctional/parallel/TunnelCmd/serial/DNSResolutionByDig (0.00s)

                                                
                                    
x
+
TestFunctional/parallel/TunnelCmd/serial/DNSResolutionByDscacheutil (0s)

                                                
                                                
=== RUN   TestFunctional/parallel/TunnelCmd/serial/DNSResolutionByDscacheutil
functional_test_tunnel_test.go:99: DNS forwarding is only supported for Hyperkit on Darwin, skipping test DNS forwarding
--- SKIP: TestFunctional/parallel/TunnelCmd/serial/DNSResolutionByDscacheutil (0.00s)

                                                
                                    
x
+
TestFunctional/parallel/TunnelCmd/serial/AccessThroughDNS (0s)

                                                
                                                
=== RUN   TestFunctional/parallel/TunnelCmd/serial/AccessThroughDNS
functional_test_tunnel_test.go:99: DNS forwarding is only supported for Hyperkit on Darwin, skipping test DNS forwarding
--- SKIP: TestFunctional/parallel/TunnelCmd/serial/AccessThroughDNS (0.00s)

                                                
                                    
x
+
TestGvisorAddon (0s)

                                                
                                                
=== RUN   TestGvisorAddon
gvisor_addon_test.go:34: skipping test because --gvisor=false
--- SKIP: TestGvisorAddon (0.00s)

                                                
                                    
x
+
TestImageBuild (0s)

                                                
                                                
=== RUN   TestImageBuild
image_test.go:33: 
--- SKIP: TestImageBuild (0.00s)

                                                
                                    
x
+
TestChangeNoneUser (0s)

                                                
                                                
=== RUN   TestChangeNoneUser
none_test.go:38: Test requires none driver and SUDO_USER env to not be empty
--- SKIP: TestChangeNoneUser (0.00s)

                                                
                                    
x
+
TestScheduledStopWindows (0s)

                                                
                                                
=== RUN   TestScheduledStopWindows
scheduled_stop_test.go:42: test only runs on windows
--- SKIP: TestScheduledStopWindows (0.00s)

                                                
                                    
x
+
TestSkaffold (0s)

                                                
                                                
=== RUN   TestSkaffold
skaffold_test.go:45: skaffold requires docker-env, currently testing containerd container runtime
--- SKIP: TestSkaffold (0.00s)

                                                
                                    
x
+
TestStartStop/group/disable-driver-mounts (0.17s)

                                                
                                                
=== RUN   TestStartStop/group/disable-driver-mounts
=== PAUSE TestStartStop/group/disable-driver-mounts

                                                
                                                

                                                
                                                
=== CONT  TestStartStop/group/disable-driver-mounts
start_stop_delete_test.go:103: skipping TestStartStop/group/disable-driver-mounts - only runs on virtualbox
helpers_test.go:175: Cleaning up "disable-driver-mounts-342833" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-arm64 delete -p disable-driver-mounts-342833
--- SKIP: TestStartStop/group/disable-driver-mounts (0.17s)

                                                
                                    
x
+
TestNetworkPlugins/group/kubenet (4.58s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/kubenet
net_test.go:93: Skipping the test as containerd container runtimes requires CNI
panic.go:626: 
----------------------- debugLogs start: kubenet-927381 [pass: true] --------------------------------
>>> netcat: nslookup kubernetes.default:
Error in configuration: context was not found for specified context: kubenet-927381

                                                
                                                

                                                
                                                
>>> netcat: nslookup debug kubernetes.default a-records:
Error in configuration: context was not found for specified context: kubenet-927381

                                                
                                                

                                                
                                                
>>> netcat: dig search kubernetes.default:
Error in configuration: context was not found for specified context: kubenet-927381

                                                
                                                

                                                
                                                
>>> netcat: dig @10.96.0.10 kubernetes.default.svc.cluster.local udp/53:
Error in configuration: context was not found for specified context: kubenet-927381

                                                
                                                

                                                
                                                
>>> netcat: dig @10.96.0.10 kubernetes.default.svc.cluster.local tcp/53:
Error in configuration: context was not found for specified context: kubenet-927381

                                                
                                                

                                                
                                                
>>> netcat: nc 10.96.0.10 udp/53:
Error in configuration: context was not found for specified context: kubenet-927381

                                                
                                                

                                                
                                                
>>> netcat: nc 10.96.0.10 tcp/53:
Error in configuration: context was not found for specified context: kubenet-927381

                                                
                                                

                                                
                                                
>>> netcat: /etc/nsswitch.conf:
Error in configuration: context was not found for specified context: kubenet-927381

                                                
                                                

                                                
                                                
>>> netcat: /etc/hosts:
Error in configuration: context was not found for specified context: kubenet-927381

                                                
                                                

                                                
                                                
>>> netcat: /etc/resolv.conf:
Error in configuration: context was not found for specified context: kubenet-927381

                                                
                                                

                                                
                                                
>>> host: /etc/nsswitch.conf:
* Profile "kubenet-927381" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-927381"

                                                
                                                

                                                
                                                
>>> host: /etc/hosts:
* Profile "kubenet-927381" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-927381"

                                                
                                                

                                                
                                                
>>> host: /etc/resolv.conf:
* Profile "kubenet-927381" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-927381"

                                                
                                                

                                                
                                                
>>> k8s: nodes, services, endpoints, daemon sets, deployments and pods, :
Error in configuration: context was not found for specified context: kubenet-927381

                                                
                                                

                                                
                                                
>>> host: crictl pods:
* Profile "kubenet-927381" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-927381"

                                                
                                                

                                                
                                                
>>> host: crictl containers:
* Profile "kubenet-927381" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-927381"

                                                
                                                

                                                
                                                
>>> k8s: describe netcat deployment:
error: context "kubenet-927381" does not exist

                                                
                                                

                                                
                                                
>>> k8s: describe netcat pod(s):
error: context "kubenet-927381" does not exist

                                                
                                                

                                                
                                                
>>> k8s: netcat logs:
error: context "kubenet-927381" does not exist

                                                
                                                

                                                
                                                
>>> k8s: describe coredns deployment:
error: context "kubenet-927381" does not exist

                                                
                                                

                                                
                                                
>>> k8s: describe coredns pods:
error: context "kubenet-927381" does not exist

                                                
                                                

                                                
                                                
>>> k8s: coredns logs:
error: context "kubenet-927381" does not exist

                                                
                                                

                                                
                                                
>>> k8s: describe api server pod(s):
error: context "kubenet-927381" does not exist

                                                
                                                

                                                
                                                
>>> k8s: api server logs:
error: context "kubenet-927381" does not exist

                                                
                                                

                                                
                                                
>>> host: /etc/cni:
* Profile "kubenet-927381" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-927381"

                                                
                                                

                                                
                                                
>>> host: ip a s:
* Profile "kubenet-927381" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-927381"

                                                
                                                

                                                
                                                
>>> host: ip r s:
* Profile "kubenet-927381" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-927381"

                                                
                                                

                                                
                                                
>>> host: iptables-save:
* Profile "kubenet-927381" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-927381"

                                                
                                                

                                                
                                                
>>> host: iptables table nat:
* Profile "kubenet-927381" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-927381"

                                                
                                                

                                                
                                                
>>> k8s: describe kube-proxy daemon set:
error: context "kubenet-927381" does not exist

                                                
                                                

                                                
                                                
>>> k8s: describe kube-proxy pod(s):
error: context "kubenet-927381" does not exist

                                                
                                                

                                                
                                                
>>> k8s: kube-proxy logs:
error: context "kubenet-927381" does not exist

                                                
                                                

                                                
                                                
>>> host: kubelet daemon status:
* Profile "kubenet-927381" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-927381"

                                                
                                                

                                                
                                                
>>> host: kubelet daemon config:
* Profile "kubenet-927381" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-927381"

                                                
                                                

                                                
                                                
>>> k8s: kubelet logs:
* Profile "kubenet-927381" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-927381"

                                                
                                                

                                                
                                                
>>> host: /etc/kubernetes/kubelet.conf:
* Profile "kubenet-927381" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-927381"

                                                
                                                

                                                
                                                
>>> host: /var/lib/kubelet/config.yaml:
* Profile "kubenet-927381" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-927381"

                                                
                                                

                                                
                                                
>>> k8s: kubectl config:
apiVersion: v1
clusters: null
contexts: null
current-context: ""
kind: Config
preferences: {}
users: null

                                                
                                                

                                                
                                                
>>> k8s: cms:
Error in configuration: context was not found for specified context: kubenet-927381

                                                
                                                

                                                
                                                
>>> host: docker daemon status:
* Profile "kubenet-927381" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-927381"

                                                
                                                

                                                
                                                
>>> host: docker daemon config:
* Profile "kubenet-927381" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-927381"

                                                
                                                

                                                
                                                
>>> host: /etc/docker/daemon.json:
* Profile "kubenet-927381" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-927381"

                                                
                                                

                                                
                                                
>>> host: docker system info:
* Profile "kubenet-927381" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-927381"

                                                
                                                

                                                
                                                
>>> host: cri-docker daemon status:
* Profile "kubenet-927381" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-927381"

                                                
                                                

                                                
                                                
>>> host: cri-docker daemon config:
* Profile "kubenet-927381" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-927381"

                                                
                                                

                                                
                                                
>>> host: /etc/systemd/system/cri-docker.service.d/10-cni.conf:
* Profile "kubenet-927381" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-927381"

                                                
                                                

                                                
                                                
>>> host: /usr/lib/systemd/system/cri-docker.service:
* Profile "kubenet-927381" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-927381"

                                                
                                                

                                                
                                                
>>> host: cri-dockerd version:
* Profile "kubenet-927381" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-927381"

                                                
                                                

                                                
                                                
>>> host: containerd daemon status:
* Profile "kubenet-927381" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-927381"

                                                
                                                

                                                
                                                
>>> host: containerd daemon config:
* Profile "kubenet-927381" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-927381"

                                                
                                                

                                                
                                                
>>> host: /lib/systemd/system/containerd.service:
* Profile "kubenet-927381" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-927381"

                                                
                                                

                                                
                                                
>>> host: /etc/containerd/config.toml:
* Profile "kubenet-927381" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-927381"

                                                
                                                

                                                
                                                
>>> host: containerd config dump:
* Profile "kubenet-927381" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-927381"

                                                
                                                

                                                
                                                
>>> host: crio daemon status:
* Profile "kubenet-927381" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-927381"

                                                
                                                

                                                
                                                
>>> host: crio daemon config:
* Profile "kubenet-927381" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-927381"

                                                
                                                

                                                
                                                
>>> host: /etc/crio:
* Profile "kubenet-927381" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-927381"

                                                
                                                

                                                
                                                
>>> host: crio config:
* Profile "kubenet-927381" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-927381"

                                                
                                                
----------------------- debugLogs end: kubenet-927381 [took: 4.362068868s] --------------------------------
helpers_test.go:175: Cleaning up "kubenet-927381" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-arm64 delete -p kubenet-927381
--- SKIP: TestNetworkPlugins/group/kubenet (4.58s)

                                                
                                    
x
+
TestNetworkPlugins/group/cilium (4.89s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/cilium
net_test.go:102: Skipping the test as it's interfering with other tests and is outdated
panic.go:626: 
----------------------- debugLogs start: cilium-927381 [pass: true] --------------------------------
>>> netcat: nslookup kubernetes.default:
Error in configuration: context was not found for specified context: cilium-927381

                                                
                                                

                                                
                                                
>>> netcat: nslookup debug kubernetes.default a-records:
Error in configuration: context was not found for specified context: cilium-927381

                                                
                                                

                                                
                                                
>>> netcat: dig search kubernetes.default:
Error in configuration: context was not found for specified context: cilium-927381

                                                
                                                

                                                
                                                
>>> netcat: dig @10.96.0.10 kubernetes.default.svc.cluster.local udp/53:
Error in configuration: context was not found for specified context: cilium-927381

                                                
                                                

                                                
                                                
>>> netcat: dig @10.96.0.10 kubernetes.default.svc.cluster.local tcp/53:
Error in configuration: context was not found for specified context: cilium-927381

                                                
                                                

                                                
                                                
>>> netcat: nc 10.96.0.10 udp/53:
Error in configuration: context was not found for specified context: cilium-927381

                                                
                                                

                                                
                                                
>>> netcat: nc 10.96.0.10 tcp/53:
Error in configuration: context was not found for specified context: cilium-927381

                                                
                                                

                                                
                                                
>>> netcat: /etc/nsswitch.conf:
Error in configuration: context was not found for specified context: cilium-927381

                                                
                                                

                                                
                                                
>>> netcat: /etc/hosts:
Error in configuration: context was not found for specified context: cilium-927381

                                                
                                                

                                                
                                                
>>> netcat: /etc/resolv.conf:
Error in configuration: context was not found for specified context: cilium-927381

                                                
                                                

                                                
                                                
>>> host: /etc/nsswitch.conf:
* Profile "cilium-927381" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-927381"

                                                
                                                

                                                
                                                
>>> host: /etc/hosts:
* Profile "cilium-927381" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-927381"

                                                
                                                

                                                
                                                
>>> host: /etc/resolv.conf:
* Profile "cilium-927381" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-927381"

                                                
                                                

                                                
                                                
>>> k8s: nodes, services, endpoints, daemon sets, deployments and pods, :
Error in configuration: context was not found for specified context: cilium-927381

                                                
                                                

                                                
                                                
>>> host: crictl pods:
* Profile "cilium-927381" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-927381"

                                                
                                                

                                                
                                                
>>> host: crictl containers:
* Profile "cilium-927381" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-927381"

                                                
                                                

                                                
                                                
>>> k8s: describe netcat deployment:
error: context "cilium-927381" does not exist

                                                
                                                

                                                
                                                
>>> k8s: describe netcat pod(s):
error: context "cilium-927381" does not exist

                                                
                                                

                                                
                                                
>>> k8s: netcat logs:
error: context "cilium-927381" does not exist

                                                
                                                

                                                
                                                
>>> k8s: describe coredns deployment:
error: context "cilium-927381" does not exist

                                                
                                                

                                                
                                                
>>> k8s: describe coredns pods:
error: context "cilium-927381" does not exist

                                                
                                                

                                                
                                                
>>> k8s: coredns logs:
error: context "cilium-927381" does not exist

                                                
                                                

                                                
                                                
>>> k8s: describe api server pod(s):
error: context "cilium-927381" does not exist

                                                
                                                

                                                
                                                
>>> k8s: api server logs:
error: context "cilium-927381" does not exist

                                                
                                                

                                                
                                                
>>> host: /etc/cni:
* Profile "cilium-927381" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-927381"

                                                
                                                

                                                
                                                
>>> host: ip a s:
* Profile "cilium-927381" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-927381"

                                                
                                                

                                                
                                                
>>> host: ip r s:
* Profile "cilium-927381" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-927381"

                                                
                                                

                                                
                                                
>>> host: iptables-save:
* Profile "cilium-927381" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-927381"

                                                
                                                

                                                
                                                
>>> host: iptables table nat:
* Profile "cilium-927381" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-927381"

                                                
                                                

                                                
                                                
>>> k8s: describe cilium daemon set:
Error in configuration: context was not found for specified context: cilium-927381

                                                
                                                

                                                
                                                
>>> k8s: describe cilium daemon set pod(s):
Error in configuration: context was not found for specified context: cilium-927381

                                                
                                                

                                                
                                                
>>> k8s: cilium daemon set container(s) logs (current):
error: context "cilium-927381" does not exist

                                                
                                                

                                                
                                                
>>> k8s: cilium daemon set container(s) logs (previous):
error: context "cilium-927381" does not exist

                                                
                                                

                                                
                                                
>>> k8s: describe cilium deployment:
Error in configuration: context was not found for specified context: cilium-927381

                                                
                                                

                                                
                                                
>>> k8s: describe cilium deployment pod(s):
Error in configuration: context was not found for specified context: cilium-927381

                                                
                                                

                                                
                                                
>>> k8s: cilium deployment container(s) logs (current):
error: context "cilium-927381" does not exist

                                                
                                                

                                                
                                                
>>> k8s: cilium deployment container(s) logs (previous):
error: context "cilium-927381" does not exist

                                                
                                                

                                                
                                                
>>> k8s: describe kube-proxy daemon set:
error: context "cilium-927381" does not exist

                                                
                                                

                                                
                                                
>>> k8s: describe kube-proxy pod(s):
error: context "cilium-927381" does not exist

                                                
                                                

                                                
                                                
>>> k8s: kube-proxy logs:
error: context "cilium-927381" does not exist

                                                
                                                

                                                
                                                
>>> host: kubelet daemon status:
* Profile "cilium-927381" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-927381"

                                                
                                                

                                                
                                                
>>> host: kubelet daemon config:
* Profile "cilium-927381" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-927381"

                                                
                                                

                                                
                                                
>>> k8s: kubelet logs:
* Profile "cilium-927381" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-927381"

                                                
                                                

                                                
                                                
>>> host: /etc/kubernetes/kubelet.conf:
* Profile "cilium-927381" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-927381"

                                                
                                                

                                                
                                                
>>> host: /var/lib/kubelet/config.yaml:
* Profile "cilium-927381" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-927381"

                                                
                                                

                                                
                                                
>>> k8s: kubectl config:
apiVersion: v1
clusters: null
contexts: null
current-context: ""
kind: Config
preferences: {}
users: null

                                                
                                                

                                                
                                                
>>> k8s: cms:
Error in configuration: context was not found for specified context: cilium-927381

                                                
                                                

                                                
                                                
>>> host: docker daemon status:
* Profile "cilium-927381" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-927381"

                                                
                                                

                                                
                                                
>>> host: docker daemon config:
* Profile "cilium-927381" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-927381"

                                                
                                                

                                                
                                                
>>> host: /etc/docker/daemon.json:
* Profile "cilium-927381" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-927381"

                                                
                                                

                                                
                                                
>>> host: docker system info:
* Profile "cilium-927381" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-927381"

                                                
                                                

                                                
                                                
>>> host: cri-docker daemon status:
* Profile "cilium-927381" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-927381"

                                                
                                                

                                                
                                                
>>> host: cri-docker daemon config:
* Profile "cilium-927381" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-927381"

                                                
                                                

                                                
                                                
>>> host: /etc/systemd/system/cri-docker.service.d/10-cni.conf:
* Profile "cilium-927381" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-927381"

                                                
                                                

                                                
                                                
>>> host: /usr/lib/systemd/system/cri-docker.service:
* Profile "cilium-927381" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-927381"

                                                
                                                

                                                
                                                
>>> host: cri-dockerd version:
* Profile "cilium-927381" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-927381"

                                                
                                                

                                                
                                                
>>> host: containerd daemon status:
* Profile "cilium-927381" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-927381"

                                                
                                                

                                                
                                                
>>> host: containerd daemon config:
* Profile "cilium-927381" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-927381"

                                                
                                                

                                                
                                                
>>> host: /lib/systemd/system/containerd.service:
* Profile "cilium-927381" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-927381"

                                                
                                                

                                                
                                                
>>> host: /etc/containerd/config.toml:
* Profile "cilium-927381" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-927381"

                                                
                                                

                                                
                                                
>>> host: containerd config dump:
* Profile "cilium-927381" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-927381"

                                                
                                                

                                                
                                                
>>> host: crio daemon status:
* Profile "cilium-927381" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-927381"

                                                
                                                

                                                
                                                
>>> host: crio daemon config:
* Profile "cilium-927381" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-927381"

                                                
                                                

                                                
                                                
>>> host: /etc/crio:
* Profile "cilium-927381" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-927381"

                                                
                                                

                                                
                                                
>>> host: crio config:
* Profile "cilium-927381" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-927381"

                                                
                                                
----------------------- debugLogs end: cilium-927381 [took: 4.697090337s] --------------------------------
helpers_test.go:175: Cleaning up "cilium-927381" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-arm64 delete -p cilium-927381
--- SKIP: TestNetworkPlugins/group/cilium (4.89s)

                                                
                                    
Copied to clipboard